Senior Big Data Platform Engineer at Hewlett Packard Enterprise Company in Frisco, Texas

Job Description:

Senior Big Data Platform Engineer

This role has been designated as 'Remote/Teleworker', which means you will primarily work from home.

Who We Are:

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today's complex world. Our culture thrives on finding new and better ways to accelerate what's next. We know diverse backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.

Job Description:

Senior Big Data Platform Engineer

HPE is looking for Big data platform engineers with a strong background in building robust and scalable solutions in data warehousing, ETL, big data/analytics, data science, and cloud platforms based on Hadoop/Cloudera , Data Bricks and other cloud platforms. The individual will be responsible for designing, developing, testing and managing large scale, high-performance data processing systems (batch and/or streaming) in a Multi Cloud environment to provide a robust analytical pipeline and ensure capturing End-to-End Data Governance, Data Quality and Data Lineage metrics a. Incumbent will also be responsible for day-to-day activities and onboarding new capabilities to support HPE's business community.

Education and Experience Required: Technical bachelor's degree and a minimum of 12 years related experience, or a master's degree and a minimum of 10 years of experience.

QUALIFICATIONS:

• Minimum 8+ years of administration experience on Hadoop Clusters using components - HDFS, HIVE, HBase, Spark, Flume, NIFI, Ranger.


• Experience with data pipeline and workflow management using components Kafka, Spark Streaming. NIFI, Strom is a plus Hands-on experience with Kerberized environment.


• Expert knowledge of Azure services with a focus on Modern Data Solutions and Frameworks, adapters/connectors, and orchestration components


• Experience with Databricks or Synapse and associated languages such as (Python, SQL, Scala, etc.)


• Demonstrated experience in designing and building cloud and hybrid solutions that run on Azure, including: (Compute, Network, Storage, Monitoring, Security.)


• Expert knowledge of the following Azure services: Azure DevOps, Blob Storage, Virtual Machines, Logic Apps, API Management, Azure Synapse Analytics, AAD, Azure Data Factory.


• 5+ years of experience in SQL, data transformations, migration, statistical analysis, and troubleshooting across more than one Database Platform (Oracle, PostgreSQL, Redshift, SQL).


• Work effectively in a Software development team leveraging agile tools like DevOps, Jira, Confluence, GitHub, GitHub Actions, Slack, etc.


• Implementation and helping the ongoing platform governance and administration of the platform.


• Significant experience with Data Governance concept such as Data lineage, Data Quality etc., and hands on experience with DG tools such as Collibra or Talend or other,


• Perform incident investigation, diagnosis and provide resolution.


• Manage cluster provisioning, performance tuning, and security configuration.


• System monitoring and remediation of any production issues. Identify recurring problems and perform root cause analysis • Provide and implement sustainable solutions.


• Collaborate with the application teams to install updates, fixes, and patches • Coordinate and perform version upgrades.


• File system management and monitoring •


• Act as a primary contact for the platform, provide access to backline support.


• Perform application deployments acting as a gatekeeper to the production environment.


• Point of contact for hardware and vendor escalation including cloud


• Hortonworks distribution experience is a plus.


• Experience with containerized platform will be a plus (Docker, Kubernetes)

• Bachelor's degree or equivalent experience with a minimum of 8 years of related experience.


• Excellent oral and written communication, time management and organizational skills with demonstrated ability to work with individuals at all levels of the organization.


• Outstanding communication skills with the ability to clearly present data, context and implications to senior IT leaders


• Ability to manage lead, manage and coordinate teams responsible for design, development and delivery to the architectural roadmap.


• Identifies and resolves problems which may impact projects by monitoring progress and project status.


• Ability to work with a global team, experienced in handling teams across various cultures and management of remote teams.


• Designing and leading implementation of platform-based applications that meet business needs.


• Demonstrates proven extensive knowledge and success as a team leader, including supervising teams to create an atmosphere of trust while seeking diverse views to encourage improvement and innovation.

Level: Expert

Location: Dallas but remote eligible

Job Family Definition:

Researches, designs, develops, configures, integrates, tests and maintains existing and new business applications and/or information systems solutions including databases through integration of technical and business requirements. Applications and infrastructure solutions include both 3rd party software and internally developed applications and infrastructure. Responsibilities include, but are not limited to, analysis of business requirements, coding of modifications or new program, creation of documentation, testing and maintenance of applications, infrastructure, and information systems including database management systems. Works within the Information Technology function, obtaining resources and working in support of objectives and strategies. Provides required documentation and participates in architecture reviews to ensure that the solutions comply with standards and use approved technologies. Typical customers are company end users and various functional areas such as Supply Chain, Research and Development, Marketing, Finance, a business, or the company.

Management Level Definition:

Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors. Leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives. Acts as an expert providing direction and guidance to process improvements and establishing policies. Frequently represents the organization to external customers/clients. Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives. May provide mentoring and guidance to lower level employees.

Additional Skills:

Accountability, Accountability, Action Planning, Active Learning, Active Listening, Agile Methodology, Bias, Business, Coaching, Creativity, Critical Thinking, Cybersecurity, Data Analysis Management, Data Collection Management, Data Controls, Design Thinking, Development Methodologies, Empathy, Follow-Through, Growth Mindset, Implementation Methodologies, Infrastructure Design, Intellectual Curiosity, Long Term Planning, Managing Ambiguity {+ 4 more}

What We Can Offer You:

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have - whether you want to become a knowledge expert in your field or apply your skills to another division.

Diversity, Inclusion & Belonging

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know diverse backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Let's Stay Connected:

Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.

#unitedstates

#globalIT

Job:
Information Technology
Job Level:
TCP_04

States with Pay Range Requirement

The expected salary/wage range for a U.S. -based hire filling this position is provided below. Actual offer may vary from this range based upon geographic location, work experience, education/training, and/or skill level. If this is a sales role, then the listed salary range reflects combined base salary and target-level sales compensation pay. If this is a non-sales role, then the listed salary range reflects base salary only. Variable incentives may also be offered. Information about employee benefits offered can be found at https://myhperewards.com/main/new-hire-enrollment.html .

USD Annual Salary: $99,500.00 - $228,000.00

HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT and Affirmative Action employer. We are committed to diversity and building a team that represents a variety of backgrounds, perspectives, and skills. We do not discriminate and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global diverse team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity .

Hewlett Packard Enterprise is EEO F/M/Protected Veteran/ Individual with Disabilities.

HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories. .