Machine Learning Engineer, Software QA - Creativity Apps

About the role

Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. The Creativity Apps QA team is seeking a Software QA Engineer, Machine Learning to help us ensure that our iOS and macOS creativity applications are high-quality. We're looking for an engineer to take projects from defining evaluation strategy, evaluation scripting and automation, leading all stages of testing, triaging and driving issues to resolution, and ensuring high quality models are integrated into our Apps' clients through rigorous testing methodologies. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of Apple's customers every day.

Responsibilities

• Scripting, parsing data, and working closely with the annotation operations team
• Analyzing annotations and test results to ensure the features work end-to-end for customers
• Developing and implementing workflow projects, regression testing, and bug filing
• Working closely with team members to develop requirements, identify appropriate testing implementations processes, and methodologies
• Managing priorities effectively and systematically, and communicating progress as well as risk through regular status updates
• Ramping up quickly on both existing and new technologies

This position requires a self-motivated individual with strong technical, problem solving and communication skills, and the willingness to work in a sophisticated environment. You should be comfortable with ambiguity and able to make educated, critical judgments.

Minimum Qualifications

• At least 5 years industry experience ideally in quality assurance with a prior focus in Machine Learning
• Strong comprehension of machine learning algorithms, supervised and unsupervised modeling techniques
• Understanding of the mechanics of machine learning, deep learning, computer vision, natural language processing, and generative AI
• Proficient in Python and/or Swift or comparable languages
• Experience preparing and collecting data for evaluation and ensuring data quality
• Meticulous, analytical, methodical and creative problem solving ability with a commitment to driving quality forward
• Prototyping and tools development experience
• Strong presentation skills and ability to adapt technical presentation to various audiences
• Proficiency in utilizing LLMs and Generative AI frameworks to automate model evaluation processes, optimize test execution times, and improve evaluation accuracy and efficiency
• Bachelor's degree in Computer Science, Data Science, Applied Mathematics or similar, combined with an understanding of SQA methodologies, machine learning and software engineering experience

Preferred Qualifications

• Understanding of subjective/objective image and video quality evaluation, and color science concepts
• Understanding of SQA methodologies and practices, software engineering experience
• iOS and macOS familiarity