Elmwood Park, NJ (Hybrid, 3 days on-site per week)
RedStream Technology is recruiting for a Data Engineer to work with our client, a leading mdeical services provider. The Data Engineer needs to be proficient with Matillion, Snowflake, and dbt in a hybrid Azure cloud environment. This role involves designing, implementing, and managing secure and efficient data solutions that support our advanced analytics and data science initiatives.
Responsibilities: • Design and build scalable and efficient data pipelines using Matillion, Snowflake, and dbt within Azure cloud architecture. • Manage data workflows and transformations, ensuring data integrity and availability for analytics and business intelligence uses. • Develop, maintain, and optimize data models in Snowflake, supporting high-performance queries and data analysis. • Utilize dbt to manage data transformation workflows and ensure data quality and consistency across all platforms. • Collaborate with data scientists, analysts, and other stakeholders to gather requirements and deliver data solutions that support organizational objectives. • Implement monitoring, logging, and alert systems to ensure performance and availability of data infrastructure. • Document all data engineering processes, models, and schemas in a clear and concise manner. • Maintain data security and compliance according to industry standards and regulatory requirements.
Qualifications: • Bachelor's degree in Computer Science, Data Science, Engineering, or a related field. Master's degree preferred. • Minimum of 3 years' experience in data engineering, with expertise in Matillion, Snowflake, and dbt. • Strong proficiency in SQL and experience with Azure cloud services. • Solid understanding of data modeling, ETL processes, and data warehousing concepts. • Experience building and optimizing 'big data' data pipelines, architectures, and data sets. • Problem-solving skills and ability to work under tight deadlines. • Excellent interpersonal and communication skills.
Additional Skills: • Experience in the healthcare or biotechnology sector is highly advantageous. • Familiarity with other ETL tools, BI technologies, and data integration strategies is desirable.