Specialist, Lead Systems (Data Platform Engineer) at Enterprise Products Company in Houston, Texas

Job Description:

Enterprise Products Partners L.P. is one of the largest publicly traded partnerships and a leading North American provider of midstream energy services to producers and consumers of natural gas, NGLs, crude oil, refined products and petrochemicals. Our services include: natural gas gathering, treating, processing, transportation and storage; NGL transportation, fractionation, storage and import and export terminals; crude oil gathering, transportation, storage and terminals; petrochemical and refined products transportation, storage and terminals; and a marine transportation business that operates primarily on the United States inland and Intracoastal Waterway systems. The partnership’s assets include approximately 50,000 miles of pipelines; 260 million barrels of storage capacity for NGLs, crude oil, refined products and petrochemicals; and 14 billion cubic feet of natural gas storage capacity.

We are currently seeking an experienced Data Platform
Engineer to join the Big Data and Advanced Analytics department.  As part of the Data Engineering team, the
Data Platform Engineer will work closely with Data Engineers and the IT
Infrastructure team to ensure the data platform is highly available, reliable,
and scalable.  This individual will
provide technical and thought leadership to the team to streamline the delivery
of analytics to the business.

 
Responsibilities include:
 

• Architect and implement technical solutions
  which improve the service level of the data platform


• Install, configure, and administer Hadoop ecosystem
  tools and technologies


• Perform incident investigation, diagnosis, and
  provide resolution


• Manage cluster provisioning, performance tuning,
  and security configuration


• Perform system monitoring and remediation of any
  platform related issue


• Identify recurring problems and perform root
  cause analysis


• Collaborate with Data Engineers and Data Scientists
  to perform upgrades and patching


• Ensure continuous availability of data platform
  services


• Serve as the primary contact for the data platform
  for hardware and vendor escalation


• Assist Data Engineers and Data Scientists with performance
  tuning and system resource allocations


• Document and maintain the data platform
  architecture


• Perform application deployments acting as a
  gatekeeper to the production environment


• Identify opportunities
  for platform improvements and present recommendations to management

The successful candidate will meet the following
qualifications:

• 5+ years of experience installing,
  administering, and maintaining Linux based software


• 5+ years of experience administering Hadoop
  ecosystem tools and technologies


• 5+ years of experience designing and
  implementing redundant systems including data backups/recoveries, high
  availability, load balancing, and disaster recovery


• 5+ years of experience designing, analyzing, and
  repairing large-scale distributed systems


• 2+ years of experience in application deployment
  automation and DevOps practices


• 2+ years of experience supporting container
  based platforms including Docker and Kubernetes


• 2+ years of experience with IT automation tools
  such as Ansible, Chef, Puppet, or Terraform


• Knowledgeable of core IT infrastructure
  technologies including virtualization, networking, and storage management


• Knowledgeable of modern DevOps practices and
  infrastructure as code