Job Information
- Date Opened: 09/08/2026
- Job Type: Full time
- Industry: IT Services
- Location: Hyderabad OR Pune
- State/Province: Telangana
- Country: India
- Zip/Postal Code: 500001
- Notice Period: 0-30 Days
- Mode of Work: Hybrid
About the Role
ML / Fine-Tuning Engineer
We are looking for an ML / Fine-Tuning Engineer who can deliver (under supervision of ProServe Tech Lead) the end-to-end fine-tuning of open-source LLMs for a narrow, high-volume production task on AWS — SFT and alignment experiments (GRPO, DPO), debugging training on multi-GPU clusters, and iterating to strict accuracy targets. Models from 8B to 70B parameters.
Responsibilities
- Fine-tune open-source LLMs (Qwen, Llama) from experiment to production-ready checkpoint
- Run SFT and RL alignment (GRPO, DPO) to improve output accuracy
- Execute training on AWS GPU instances (p4d, p5, g5) using distributed training
- Diagnose/fix training issues: loss imbalances, OOM errors, gradient instabilities
- Collaborate with evaluation and data engineering to iterate on quality gaps
- Make data-driven model scaling decisions (8B → 14B → 70B) based on offline metrics
Requirements
- Experience: 5+ years ML engineering, with 2+ years in LLM fine-tuning
- LLM Models: Hands-on with open-source LLMs — Qwen and Llama required
- Training Methods: SFT, LoRA/QLoRA, GRPO, DPO/RLHF
- Frameworks: NVIDIA NeMo/NeMoRL, VeRL, HuggingFace TRL — must have used at least two
- Distributed Training: DeepSpeed ZeRO, FSDP2, multi-node GPU orchestration
- AWS Infrastructure: p4d/p5/g5 GPU instances, SageMaker Training Jobs
- Languages: Python, PyTorch; CUDA debugging a plus
Preferred Qualifications
- Fine-tuning for tool-calling/agent tasks
- Multi-node GRPO/RLHF with NeMoRL or VeRL
- Tokenizer internals and chat-template rendering for tool-use formats
Benefits
- Comprehensive Medical Coverage: Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
- Robust Protection Plans: Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
- Retirement Benefits: PF and Gratuity provided as per standard government regulations.
- Flexible Work Options: Enjoy hybrid work arrangements & flexible working hours.
- Generous Leave Policy: 21 days of annual leave, in addition to 10 company-declared holidays.
- Employee Well-being Spaces: Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.
About DATAECONOMY
DATAECONOMY is a data and AI consultancy that provides enterprise-grade solutions for data modernization, analytics, and artificial intelligence. The company serves financial services, banking, insurance, and other enterprises with services spanning data engineering, data governance, AI/ML, cloud enablement, and digital transformation.
Interested in this role?
Apply now to join DATAECONOMY.