Machine Learning Engineer, GeForce G-Assist

About the role

At NVIDIA, we're building GeForce G-Assist — an on-device AI assistant that combines Small Language Models (SLMs), retrieval systems, and hybrid cloud capabilities to deliver responsive, context-aware assistance inside the GeForce ecosystem. We work closely across engineering and product teams to ensure G-Assist performs reliably in real-world scenarios.

What you'll be doing

• Evaluate and improve Small Language Models used in GeForce G-Assist, with an emphasis on accuracy, robustness, and conversational reliability
• Identify and mitigate conversation and context contamination, including state drift, prompt leakage, and retrieval cross-talk
• Work with SLM and VLM architectures to support text and multimodal interactions
• Collaborate on hybrid architectures that combine local SLMs with cloud-based models
• Optimize local inference using llama.cpp, including quantization, memory usage, and performance tuning
• Read, write, and optimize C/C++ code in performance-critical paths
• Design and integrate retrieval-augmented generation (RAG) systems that ground responses in system and user context
• Support agentic AI workflows, enabling planning, tool use, and multi-step execution

Requirements

• 5+ years of validated experience in system software or a related field
• M.S. or higher degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience)
• Strong ability to read and write C/C++ code in systems-level or performance-sensitive environments
• Proficiency in Python
• Hands-on experience with llama.cpp or similar local inference frameworks
• Hands-on experience evaluating Small Language Models, including task-based and conversational testing, with an understanding of conversation dynamics, long-context behavior, and contamination challenges
• Knowledge of SLM and VLM architectures and their trade-offs
• Experience with retrieval technologies and language-model integration
• Familiarity with agentic AI patterns such as tool use and planning
• Enjoys solving real problems, learning as they go, and collaborating in a tight-knit environment

Ways to stand out from the crowd

• Experience contributing to language or multimodal models that power user-facing products, features, or workflows
• A track record of collaborating with product, platform, or systems teams to balance model capability, performance, and user experience
• Demonstrated ability to translate user needs or feedback into measurable improvements in model behavior or system reliability

Compensation and benefits

• Base salary range: 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4
• Base salary determined based on location, experience, and pay of employees in similar positions
• Eligible for equity and benefits
• Competitive salaries and generous benefits package

Additional information

• Applications accepted at least until October 20, 2026
• This posting is for an existing vacancy
• NVIDIA uses AI tools in its recruiting processes
• NVIDIA is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law