Machine Learning Engineer I - Large Language Models - AI & Human Health Research

LLM Engineer I

About the Role

The LLM Engineer will play a key role in designing, building, and deploying large language model (LLM) applications including retrieval-augmented generation (RAG) systems, agentic platforms, and clinical chatbots. The role will be responsible for designing, maintaining, and optimizing data infrastructure and model validation pipelines that ensure all AI systems, Generative and Non-Generative, deployed across the Mount Sinai Health System (MSHS) are rigorously validated for compliance, performance, and patient safety.

Responsibilities

• Work closely with AI product teams, clinical and technical stakeholders, DevOps engineers, and the AI Governance Committee to engineer scalable data flows that support model validation, real-time monitoring
• Contribute to the development and enhancement of machine learning applications and systems
• Work closely with other engineers and data scientists to design and implement scalable and efficient machine learning systems

About Mount Sinai Health System

Mount Sinai Health System is one of the largest academic medical systems in the New York metro area, with more than 48,000 employees working across eight hospitals, more than 400 outpatient practices, more than 300 labs, a school of nursing, and a leading school of medicine and graduate education.

Mount Sinai advances health for all people, everywhere, by taking on the most complex health care challenges of our time — discovering and applying new scientific learning and knowledge; developing safer, more effective treatments; educating the next generation of medical leaders and innovators; and supporting local communities by delivering high-quality care to all who need it.

The Health System includes more than 9,000 primary and specialty care physicians; 13 joint-venture outpatient surgery centers throughout the five boroughs of New York City, Westchester, Long Island, and Florida; and more than 30 affiliated community health centers.

Recognition and Rankings

• Consistently ranked by U.S. News & World Report's Best Hospitals, receiving high "Honor Roll" status
• No. 1 in Geriatrics
• Top 5 in Cardiology/Heart Surgery
• Top 20 in Diabetes/Endocrinology, Gastroenterology/GI Surgery, Neurology/Neurosurgery, Orthopedics, Pulmonology/Lung Surgery, Rehabilitation, and Urology
• New York Eye and Ear Infirmary of Mount Sinai ranked No. 12 in Ophthalmology
• Mount Sinai Kravis Children's Hospital ranked among the country's best in several pediatric specialties by U.S. News & World Report's "Best Children's Hospitals"
• Icahn School of Medicine at Mount Sinai ranked No. 11 nationwide in National Institutes of Health funding and in the 99th percentile in research dollars per investigator according to the Association of American Medical Colleges
• The Mount Sinai Hospital ranked No. 1 in New York and in the top five globally by Newsweek's "The World's Best Smart Hospitals"
• Mount Sinai Morningside ranked in the top 20 globally by Newsweek's "The World's Best Smart Hospitals"

Our Commitment to Inclusion

Mount Sinai Health System is committed to fostering an environment where everyone can contribute to excellence. We share a common dedication to delivering outstanding patient care.

When you join us, you become part of Mount Sinai's unparalleled legacy of achievement, education, and innovation as we work together to transform healthcare. We encourage all team members to actively participate in creating a culture that ensures fair access to opportunities, promotes inclusive practices, and supports the success of every individual.

At Mount Sinai, our leaders are committed to fostering a workplace where all employees feel valued, respected, and empowered to grow. We strive to create an environment where collaboration, fairness, and continuous learning drive positive change, improving the well-being of our staff, patients, and organization. Our leaders are expected to challenge outdated practices, promote a culture of respect, and work toward meaningful improvements that enhance patient care and workplace experiences.

We are dedicated to building a supportive and welcoming environment where everyone has the opportunity to thrive and advance professionally.

Equal Opportunity Employer

The Mount Sinai Health System is an equal opportunity employer, complying with all applicable federal civil rights laws. We do not discriminate, exclude, or treat individuals differently based on race, color, national origin, age, religion, disability, sex, sexual orientation, gender, veteran status, or any other characteristic protected by law.

We are deeply committed to fostering an environment where all faculty, staff, students, trainees, patients, visitors, and the communities we serve feel respected and supported. Our goal is to create a healthcare and learning institution that actively works to remove barriers, address challenges, and promote fairness in all aspects of our organization.