Data Engineer at Federal Reserve Bank (FRB) in New York, New York

Job Description:

Company

Federal Reserve Bank of New York

Working at the Federal Reserve Bank of New York positions you at the center of the financial world with a unique perspective on national and international markets and economies. You will work in an environment with a diverse group of experienced professionals to foster and support the safety, soundness, and vitality of our economic and financial systems.  
 
The Bank believes in work flexibility to balance the demands of work and life while also connecting and collaborating with our colleagues in person. Employees can expect to be in the office a couple of days per week as needed for meetings and team collaboration and should live within a commutable distance. 

What we do:   

As a member of Markets Technology Delivery supporting the Markets business domain; the area responsible for the Auctions, Trading Desks and Operations, you will contribute to financial applications and tools in support of Markets’ auctions, trading, operations planning, and execution. You will be part of an agile squad that requires close collaboration with other members of the technology team, business users, and other development team members to solve for integration, and analytics use cases.

Your role as a Data Engineer: 

In this role you will be responsible for designing, developing, and maintaining data pipelines in support of data management functions such as data engineering, data integration and data quality and governance activities. You must be passionate about data management with a solid background in AWS, Databricks, Python, Trino/Starburst, Databases and SQL.

                                                                                                                        

• Design, develop, monitor, and maintain data pipelines in an AWS Gov Cloud ecosystem with AWS, Databricks, Delta Lake and Trino as the underlying platforms.


• Collaborate with cross-functional teams to understand data needs and translate them into effective data pipeline solutions.


• Establish data quality checks and ensure data integrity and accuracy throughout the data lifecycle.


• Automate testing of the data pipelines and configure as part of CICD.


• Optimize data processing and query performance for large-scale datasets within AWS and Databricks environments.


• Document data engineering processes, architecture, and configurations.


• Troubleshooting and debugging data-related issues on the AWS Databricks platform.  


• Integrating Databricks with other AWS products such as SNS, SQS, and MSK.

What we are looking for: 

• Bachelor's or master's degree in computer science, Information Technology, or a related field.


• 
  Strong technical proficiency to contribute to data engineering task in an AWS and Databricks ecosystem.


• 
  Strong technical proficiency with Spark, Trino, Python, PySpark and SQL


• Proven ability in Gitlab with CI/CD.


• Proven ability in AWS Services like S3, RDS, Lambda, SQS, SNS, MSK is required.


• Strong SQL skills to perform data analysis and understanding of source data.


• Proven ability with data pipeline orchestration tools


• Proven ability with ETL tools and Relational databases


• Proven ability to troubleshoot complex data issues and implement effective solutions.


• Proven ability in staying updated with industry trends and emerging technologies in data engineering.

Salary Range: $116500 - $200400 / year  

We believe in transparency at the NY Fed. This salary range reflects a variety of skills and experiences candidates may bring to the job. We pay individuals along this range based on their unique backgrounds. Whether you’re stretching into the job or are a more seasoned candidate, we aim to pay competitively for your contributions.  

  

Our Touchstone Behaviors—Communicate Authentically, Collaborate Inclusively, Drive Progress, Develop Others, and Take Ownership—help shape the culture of the Bank. They also provide a shared language for how we work together and achieve success, and they set clear expectations for leading with impact at every stage of your career with us. Learn more.  

  

Benefits:  

Our organization offers benefits that are the best fit for you at every stage of your career:  

• Fully paid Pension plan and 401k with Generous Match  




• Comprehensive Insurance Plans (Medical, Dental and Vision including Flexible Spending Accounts and HSA)  




• Subsidized Public Transportation Program  




• Tuition Assistance Program   




• Onsite Fitness & Wellness Center  




• And more  

The New York Fed expects its employees to perform their duties with honesty, integrity, and impartiality, and without improper preferential treatment of any person. Learn more about our code of conduct and conflicts of interest rules.  

  

The Federal Reserve Bank of New York is committed to a diverse workforce and to providing equal employment opportunity to all persons without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, genetic information, disability, pregnancy, or military service.  

  

We value accessibility for all candidates and are happy to provide an accommodation or assistance. Please email us at ny.leaves@ny.frb.org and we’ll be glad to help. Please note, this is a dedicated e-mail box designed exclusively to assist applications with accommodation requests in relation to our recruiting process. All other inquires including the status of applications will not receive a response from this e-mail box.   

  

This is not necessarily an exhaustive list of all responsibilities, duties, performance standards or requirements, efforts, skills or working conditions associated with the job. While this is intended to be an accurate reflection of the current job, management reserves the right to revise the job or to require that other or different tasks be performed when circumstances change.  

This position requires access to confidential supervisory information (CSI) and/or Federal Open Market Committee (FOMC) information. Access to CSI and FOMC information is limited to U.S. citizens, lawful permanent residents, individuals who meet the definition of “protected individual” under 8 U.S.C. § 1324b(a)(3), and certain other nonimmigrants. All non-U.S. citizens authorized to access CSI and/or FOMC information must sign a declaration of intent to expeditiously become a lawful permanent resident and thereafter a U.S. citizen when eligible.   

Full Time / Part Time

Full time

Regular / Temporary

Regular

Job Exempt (Yes / No)

Yes

Job Category

Information Technology

Work Shift

First (United States of America)

The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.

Privacy Notice

Apply Now