Senior AI & RAG Engineer (m/w/d)
About the Role
Support the company in successfully implementing strategic goals through innovative technologies. In the Consulting – Technology Strategy & Transformation division, we shape and manage digital transformation programs that make our customers more agile and future-ready in the long term.
Locations: Berlin, Düsseldorf, Frankfurt (Main), Hamburg, Hannover, Köln, München and Stuttgart
Your Impact
As Senior AI & RAG Engineer (m/w/d), you will support our customers in the conception, development and optimization of modern AI solutions. You will develop scalable Retrieval-Augmented-Generation (RAG) architectures and intelligent knowledge services that enable the efficient use of Large Language Models (LLMs) in productive enterprise environments.
Expertise: You bring expertise in Retrieval-Augmented Generation (RAG), Large Language Models (LLMs), Code-RAG, Source-Code-Retrieval and Hybrid Search. You also have sound knowledge in Context Engineering, Metadata Filtering, Reranking and the integration of modern Embedding and LLM APIs.
Architecture: You support the definition of target architectures and technical guidelines for AI solutions and work closely with Solution Architects and technical teams to design powerful and future-proof AI platforms.
Development: You conceive and implement production-ready RAG systems, develop retrieval mechanisms for technical knowledge databases and source code repositories, and ensure structured preparation of data and source code for optimal use by AI models.
Analysis: You analyze the quality of AI-generated results, develop evaluation approaches for RAG and LLM solutions, and optimize performance through systematic measurement, testing and continuous improvement.
Innovation: You evaluate new technologies and methods in the field of Generative AI, Knowledge Retrieval and Code Intelligence and actively contribute to the development of innovative solutions and best practices.
Your Skillset
- Successfully completed Bachelor's or Master's degree, for example in Business Administration, Business Informatics, Industrial Engineering or a comparable program
- Experience in the field of IoT, IT architecture, and in the development of RAG solutions, Large Language Models (LLMs) and AI applications
- Sound knowledge of Python, API development and modern AI and Machine Learning frameworks
- Experience in collaboration with technical teams, departments and customers. You also convince with your pronounced communication skills in German and English (minimum C1 level)
Nice to have:
- First experience in the IT/OT infrastructure environment
- Knowledge in SD-WAN, network optimization, Zero Trust, OT infrastructures, Microsoft 365 and Cloud and data center strategies
What We Offer
- Exciting tasks in an innovative environment with highly motivated colleagues who are already looking forward to your input
- Good working conditions with attractive salary and numerous additional benefits, e.g. company smartphone for private use, bicycle leasing and Corporate Benefits
- Work-Life-Balance through Mobile Working & Part-time, EU Remote Working, Sabbaticals, Employee Events, Well-being offers such as health days, cooperations with fitness providers and the Family Service, which supports you with private challenges
- Excellent further education at Deloitte University, in on- and offline seminars and as part of professional qualification
- Diverse scope for design and active promotion of an inclusive corporate culture – including through our Diversity & Inclusion Employee Networks
How to Apply
Please submit your application documents (CV as well as school leaving certificates, university and work references) via our online form. A cover letter is not required.
We welcome applications from people as diverse as we are – regardless of age, disability, ethnic origin and nationality, gender, religion, sexual orientation or social background. Have more questions? You can find all information about our application process in our Application FAQs.
About Deloitte
Deloitte is one of the world's largest professional services firms, offering a wide range of services in audit and assurance, consulting, financial advisory, risk management, and tax. Deloitte operates in more than 150 countries and is known for its commitment to innovation, technology, and developing future business leaders.
Interested in this role?
Apply now to join Deloitte.