This job listing has expired and the position may no longer be open for hire.

Spark and Jupyter Intern at Yahoo

Posted in General Business 30+ days ago.

This job brought to you by eQuest

Type: Full-Time
Location: Champaign, Illinois





Job Description:

Oath, a subsidiary of Verizon, is a values-led company committed to building brands people love. We reach over one billion people around the world with a dynamic house of media and technology brands. A global leader in digital and mobile, Oath is shaping the future of media.

ABOUT Oath

Oath is focused on making the world's daily habits more inspiring and entertaining. By creating highly personalized experiences for our users, we keep people connected to what matters most to them, across devices and around the globe. In turn, we create value for advertisers by connecting them with the audiences that build their businesses. Oath is headquartered in Sunnyvale, Calif., and has offices located throughout the Americas, Asia Pacific (APAC) and the Europe, Middle East and Africa (EMEA) regions.

ABOUT The Team

Oath is looking for engineers to join the Oath Big Data & Machine Learning Platform team. The team has openings in Champaign IL and Sunnyvale CA. In this role you would be working on developing the next generation Big Data stack utilizing Hadoop for Batch, Storm for real time, and Spark for Iterative. Hadoop is the de-facto operating system for the worldwide cloud computing industry. Oath is the birthplace of Hadoop and has the largest Hadoop install in the world. The server count has grown from a few hundred nodes, to over 30,000 in the past few years. We have over 400,000 cores that process nearly 300PB of data spread over 25 clusters running a mix of Hadoop, Storm, and Spark

Job Responsibilities

We are looking for experienced and motivated software engineers to help build a highly scalable and robust next generation Big Data stack to power Oaths data processing needs. The qualified engineer would work on one or more of the following open source projects: Spark and Jupyter.

If you have strong distributed systems background, love to solve complex and challenging problems, can work independently, and want to participate in some of the most exciting open source projects, we want to hear from you!. If you want to learn about Spark, Jupyter and get a deep understanding of cloud computing, this is the job for you.

Minimum Job Qualifications (skills/knowledge/abilities required to qualify for the job)


  • Pursuing BS/MS/PHD in Computer Science (or equivalent)

  • Strong in Java or C++

  • Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques



Preferable Job Qualifications (skills/knowledge/abilities that are nice to have)

  • Experience with one or more of the following: Hadoop Core, Pig, Hive, Hcat, Oozie, Hbase, Spark, or Storm

  • Experience with large distributed data and systems

  • Knowledge of machine learning techniques

  • Knowledge of database internals and query optimization

Oath is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Oath is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. Please let us know if you need a reasonable accommodation to apply for a job or participate in the application process.

Currently work for Oath? Please apply on our internal career site. ​