Sr. Data Engineer at Visa in Austin, Texas

Job Description:

Company Description

As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce.

At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.

You're an Individual. We're the team for you. Together, let's transform the way the world pays.

Visa Corporate IT (CIT) group has embarked on a major transformation journey. We are transforming ourselves into a true engineering organization where we put customer experience and end user support first. As part of this strategy, we are consolidating several of our Operational functions into a single area focused on providing world-class operational support to our End users. Visa's Engineering, Applications and Analytics team is looking for curious, creative, and technology experts to join our growing team. We focus on delivering and supporting integrated platforms that enables Visa's finance applications, which are used by Visa business partners to service Visa clients globally. We also develop analytics and reporting by using revenue data.

The successful candidate is expected to be expert in platform deployed onlinux systems. The selected candidate will be fully responsible for both service delivery and operational excellence of services built using Hadoop technologies.

Essential Functions:

• Data Integration, Processing & Governance


• Data Storage and Computation Frameworks, Performance Optimizations


• Analytics & Visualizations


• Data Management Platforms


• Implement scalable architectural models for data processing and storage


• Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode


• Build functionality for data analytics, search and aggregation.

Basic Qualifications:

• Overall 4+ years of IT experience with 2+ years in Data related technologies


• Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, NiFi, Spark, Hive, Oozie, Airflow and other components required in building end to end data pipeline.


• Excellent experience in at least of the programming language Java, Scala, Python. Java preferable


• Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra.


• Well-versed and working knowledge with data platform related services.


• Strong in debugging, monitoring end to end system

Preferred Qualifications:

• Proactive in communication and good in analytical abilities.


• Strong in customer engagement and other stakeholders


• Provide right and faster solution for any issues.


• Maintain best practices on managing systems and services across all environments

Work Authorization:

• Authorization to work in the U.S. isa precondition of employment for this position. Visa will not sponsor applicants for work visas in connection with this position.

Travel Requirements:

• This position requires the incumbent to travel for work <5% of the time

Work Hours:

• Incumbent must work during core business hours

Mental/Physical Requirements:

• This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers, and reach with hands and arms

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.