Robustness Analysis, ML Engineer - SIML, ISE at Apple in Cupertino, California

Posted in Information Technology 10 days ago.

Type: Full Time





Job Description:

Summary Posted: May 11, 2022 Role Number:200378544 Are you passionate about inclusion and fairness in AI-enabled features that ship on 1.5B Apple products across the globe? As a robustness analysis (RA) engineer in the System Intelligence and Machine Learning (SIML) group, you will work in close collaboration with R&D and Data teams to ensure robustness of key Apple features. Impact machine learning which transforms the way millions of people capture, discover and share the most special moments of their lives! Examples include face detection, scene classification, OCR, and handwriting recognition, on all Apple platforms (macOS, iOS, tvOS, watchOS). RA is vital to ensure that our products and features perform equally well for diverse customers within Apple's global user base. This is an exciting time to join us: grow fast, and have a positive impact on multiple key features on your first day at Apple! Key Qualifications Experience in training machine learning models (preferably text or computer vision) Familiarity with the challenges associated to building ML datasets and models (eg face detector): definition and coverage of target data distribution, potential biases, potential failure modes (eg low light, pale/dark skin etc...) Strong Python coding skills to manipulate data at scale & to run ML models Creativity and a good sense of product, which enable you to create tools/frameworks that are impactful and convenient to use by different types of end users You're driven and pragmatic Strong communication skills and proactivity Description Apple's commitment to deliver incredible experiences to a global and diverse set of users, in full respect of their privacy, has recently led to the development of the RA function. This is a data driven initiative to monitor ML model performance on relevant axes, and surface, measure and mitigate ML failure modes, in order to improve overall user experience and reduce risks, with specific attention given to inclusion and fairness. In this position, you will join a team of pioneers in robustness analysis by leading RA operations for key Apple features. This includes: - define product-centered axes of analysis (eg lighting conditions for images) and associated classes (eg low light < 100 ISO, backlit, ...) relevant to target feature, in collaboration with model DRI and feature DRI - identify other potential failure modes based on a data driven approach - when applicable, benchmark model using targeted public datasets - characterize potential biases in training set along chosen axes - request data collection efforts and/or implement automated pipelines based on advanced ML technology and humans in the loop to create test sets covering the various axes of investigation - report progress and issues found in technical and sponsor meetings - suggest mitigation options (data and/or model) and lead mitigation experiments, when issues are found - contribute to the emergence of standardized RA processes and to the maturation of specs to drive the creation/improvement of RA tools Education & Experience Bachelors or Masters in Computer Science, Data Science, Mathematics, Physics, or a related field (or equivalent practical experience) Additional Requirements PDN-9648fa52-fcd5-4f11-a729-88b6295de440


More jobs in Cupertino, California

General Business
about 8 hours ago

Infosys Limited
General Business
1 day ago

Hilton
Marketing
1 day ago

Apple
More jobs in Information Technology

Information Technology
14 minutes ago

HPE
Information Technology
14 minutes ago

Griffith Foods
Information Technology
37 minutes ago

IHG