We are seeking a highly skilled and experienced Principal Data Engineer to lead the design, development, implementation, and support of our client's enterprise data warehouse solutions in CA. This pivotal role involves managing both on-premise and cloud-based data warehouses to ensure their efficient, secure, and continuous operation, thus meeting critical business needs. The successful candidate will offer technical leadership and manage complex data projects within the organization.
Responsibilities:
Oversee the entire lifecycle of the data warehouse environments crucial for business operations.
Design and implement a flexible, enterprise-level environment that integrates multiple data warehouses.
Develop and maintain scalable data pipelines and ensure the integration of new data sources as needed.
Implement automation to streamline data processes and optimize the performance of the analytics platform.
Collaborate with business users to refine data requirements, enhancing data models and pipelines.
Provide expert-level problem-solving to diagnose and resolve complex technical issues.
Lead the creation of technical specification documents and manage ETL processes.
Ensure data security and compliance with relevant regulations and best practices.
Mentor junior team members, fostering a collaborative and knowledge-sharing team environment.
Qualifications:
Proficient in Data Lake architectures, ETL/ELT operations, and database design.
Experienced in deploying modern data solutions using Azure technologies like Azure Data Factory, Azure Data Lake, Azure SQL, and Azure Synapse, among others.
Familiarity with DevOps tools such as Azure DevOps, Jenkins, and Maven.
Strong project management skills and the ability to work effectively in both leadership and team roles.
Excellent communication skills with the capability to engage effectively with both technical and non-technical stakeholders.
Education & Experience:
Bachelor's degree in a relevant field with at least 10 years of related experience.
Extensive experience in Data Warehouse architecture and development, particularly with Microsoft SQL Server and/or Azure.
Working Conditions:
Flexible hours with the possibility of periodic overtime, including evenings and weekends.
On-call availability for emergency support and occasional travel for business engagements.