Data Infrastructure Engineer at Valassis Digital Corp in Austin, Texas

Job Description:

The Data Infrastructure Engineer is a critical contributor to developing and growing a modern data mesh architecture for scalable analytics and innovation within a data lakehouse framework. This new architecture enables organizations to build valuable data products within a self-service infrastructure, in turn making them discoverable, reliable, reusable, and compliant. This role will build the key architectural and feature components for the data lakehouse, including but not limited to data APIs, metadata cataloging, documentation, data lineage, and user access. Additionally, the project includes implementing the orchestration, transformation, and data movement of the datasets involved in the data lakehouse architecture. The Data Infrastructure Engineer will report to the Principal Data Infrastructure Lead.

Primary Responsibilities:

• Design and troubleshoot data systems powering and serving the data lakehouse, databases, event stores, and large-scale data processing engines


• Design and implement self-service tools enabling development teams to quickly deploy their own data infrastructure and pipelines with appropriate guardrails in place to ensure reliability


• Developing and documenting APIs using commercial, full API lifecycle management tools and best practices


• Build unit test cases for data products and execute them for coverage


• Contribute to a cross functional Agile Scrum team using Agile Scrum best practices, ceremonies, and artifacts

Required Skills, Experience, Qualification:

• 3-5+ years of hands-on data engineering experience, preferably in a cloud or hybrid cloud environment


• Experience with creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop,


• Hive, Spark, NoSQL, RDBMS, S3, and Snowflake


• Experience building ETL/ELT data pipelines, data quality checks and data anomaly detection and notification systems


• Knowledge of BI concepts and implementation experience across multiple backends


• Experience curating APIs for compliant data consumption


• Experience with migration of infrastructure from on-prem to cloud


• Curiosity to learn and apply new technologies


• Excellent verbal and communication skills


• Experience with agile development methodologies

Salary: $140,000 - $155,000
\n
\nVericast offers a generous total rewards benefits package that includes medical, dental and vision coverage, and generous PTO allowance. A wide variety of additional benefits like life insurance, employee assistance and pet insurance are also available, not to mention smart and friendly coworkers!

At Vericast, we don't just accept differences - we celebrate them, we support them, and we thrive on them for the benefit of our employees, our clients, and our community.As an Equal Opportunity employer, Vericast considers applicants for all positions without regard to race, color, creed, religion, national origin or ancestry, sex, sexual orientation, gender identity, age, disability, genetic information, veteran status, or any other classifications protected by law. Applicants who have disabilities may request that accommodations be made in order to complete the selection process by contacting our Talent Acquisition team at talentacquisition@vericast.com . EEO is the law. To review your rights under Equal Employment Opportunity please visit: www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf

#LI-TT1
\n#LI-REMOTE

Apply Now