Senior Data Engineer at The Washington Post in Washington, Washington DC

Job Description:

Job Description

We're looking for a Senior Data Engineer to join the Commercial Business Intelligence team. The Commercial Business Intelligence Team is architecting new ways to surface insights to both the Washington Post and our SAAS customers. We are looking for a self-motivated engineer with a conscientious mentality and a relentless commitment to quality and stability.

Responsibilities

• Participate in all stages of software development - from early brainstorming to coding and bug fixing


• Model, query, and analyze large, business-critical datasets


• Architect, build and deploy on AWS


• Plan and then execute successful complex technical projects in an Agile process.


• Help in on call activities when the ETL is broken or have data issues.


• Assist business with ad hoc reports and business requirements.

Qualifications

Minimum Qualifications

• BA/BS in Computer Science or related technical field or equivalent practical experience.


• 6+ years of experience modeling, querying and analyzing large datasets using SQL


• 6+ years ETL/ELT experience


• 3+ years of Python programming skills


• Strong Hive and Pyspark skills


• Experience building business-critical, data processing pipelines on AWS

Preferred Qualifications

• Experience using stream and batch processing technologies including Hadoop, Spark, and Kafka


• Experience with AWS data warehouse technologies including GLUE ETL, Lambda, S3, EMR, and EC2


• Experience with multiple database technologies including Postgres, MySQL, MongoDB, and DynamoDB

The Post strives to provideits readerswith high-quality, trustworthy news and information while constantly innovating. That mission is best served by a diverse, multi-generational workforce with varied life experiencesand perspectives.All cultures and backgrounds are welcomed.

The innovation doesn't end in the Newsroom - dozens of teams power The Washington Post. We are now hiring the next innovator - how will you Impact Tomorrow?

#washpostlife