Senior Cloud Data Engineer at Arrowstreet Capital in Boston, Massachusetts

Job Description:

Job Overview

The Research Systems Data Engineer will work in a development team that builds data driven solutions to support the quantitative investment Research group. As a systematic asset manager, Arrowstreet must identify investable trading strategies and implement them quickly and with the highest quality. The rapid integration of novel data sources is a vital competitive advantage for the Research group and essential to the continued success of the firm, as is the ability to extract useful information through high-performance data transformations and analytics.

In this role, the candidate will contribute to the creation and build of the next evolution of the Data Engineering Platform. The candidate will build features that will make it possible to rapidly on-board new data at very large scale that can be governed, tracked and integrated into a variety of uses.

Responsibilities

• Contribute to data platform that supports batch and real-time data sets using modern data processing frameworks.


• Build features to enable data discovery, lineage, governance, ingestion operation, cost management, performance, etc.


• Assist the team in investigating potential improvements achieved by adopting new data technologies and frameworks.


• Achieve high quality metrics through automated testing, robust operational tooling and reliable designs.


• Production support of the platform to avoid disruption to investment processes.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering or a related discipline


• At least 3 years of experience working with data lakes, data warehousing, and/or database systems, including processing frameworks like Spark, Hadoop, Presto, etc.


• At least 3 years of experience working with compute infrastructure on Kubernetes.


• You strive to write elegant code, and you're comfortable with picking up new technologies independently.


• You are proficient in at least one major programming language (e.g. Python, Java, Scala) and comfortable working with SQL


• You have experience working with one of the major cloud providers (e.g. AWS, Azure, GCP) and automation through infrastructure as code.


• (Preferred) You have experience with data catalog, lineage and/or governance tools, e.g. Apache Atlas, DataHub, Amundsen, MetaCat, etc.

We maintain a friendly, team-oriented environment and place a high value on professionalism, attitude and initiative.

We maintain a friendly, team-oriented environment and place a high value on professionalism, attitude and initiative.