automationroles.aiJoin
SAP IT Business Systeme

Senior Data Scientist - Agentic AI

Full timeBrno2 days ago

Senior Data Scientist - Agentic AI

Full-time

Company Description

You'll help shape SAP's global analytics community, contribute to internal thought leadership, and foster a culture where diverse voices and international collaboration elevate the work.

What you'll do

  • Design and scale agentic AI systems, including multi-agent orchestration, tool integration, memory, and human-in-the-loop workflows.
  • Design and maintain enterprise ontologies and semantic models that give AI agents accurate, grounded understanding of SAP and connected business landscapes harmonizing data from SAP and external providers into unified semantic layers.
  • Build LLM-powered applications using prompt engineering, RAG, tool calling, and reasoning pipelines.
  • Build AI capabilities including RAG pipelines, embeddings, vector databases, and enterprise knowledge grounding that make SAP's agents accurate and reliable in production.
  • Work with cloud and data platforms including Databricks, SAP Datasphere, SAP HANA Cloud, AWS, Azure, and GCP to support reliable, scalable AI workflows.
  • Fine-tune and adapt LLMs for domain-specific use cases such as code generation, transformation, and automation.
  • Translate business requirements into end-to-end AI solutions, defining data, modeling, and evaluation strategies.
  • Apply machine learning, deep learning, and statistical modeling to develop and evaluate AI solutions using real-world enterprise datasets.
  • Develop and maintain high-quality data pipelines for training, validation, and continuous improvement.
  • Lead experimentation and optimization using prompt tuning, PEFT, and model selection techniques.
  • Ensure production readiness through evaluation, monitoring, observability, and cost-performance trade-offs.
  • Collaborate with cross-functional teams and mentor junior engineers/data scientists.
  • Continuously evaluate emerging trends in generative AI and agentic systems.
  • Productize Agentic SaaS based solutions on SAP BTP with proper multi-tenancy and lifecycle management.
  • Implement CI/CD pipelines for agents (automated build, test, evaluation gates, deployment, rollback).
  • Embed security and compliance by design — secure secrets/credential handling, and AI guardrails.

Required qualifications

  • Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field.
  • 6+ years of experience delivering ML and generative AI solutions in production.
  • Strong expertise in agentic AI systems, including orchestration, planning, memory, and tool usage.
  • Hands-on experience with LLM frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel).
  • Solid understanding of LLM techniques, including fine-tuning, prompt engineering, and RAG.
  • Strong Python skills with ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face).
  • Experience building scalable, reliable AI systems with a focus on performance and maintainability.
  • Familiarity with MLOps/LLMOps practices and cloud platforms (AWS, Azure, GCP).
  • Experience with CI/CD tooling (GitHub Actions, Jenkins, Piper) and containerization (Docker, Cloud Foundry/Kyma).
  • Understanding of security practices — SaaS-based Security Standards, IAS (OAuth2, XSUAA), Customer Managed Keys, Malware scanning.
  • Familiarity with AI governance, Data Integrity, Handling DPP/PII, and audit/traceability.
  • Strong analytical thinking, problem-solving, and clear communication skills.

Preferred qualifications

  • Deep working knowledge of SAP data models, metadata structures, and core business processes end-to-end.
  • Hands-on experience with the SAP data and AI platform stack — SAP Datasphere, SAP HANA Cloud Knowledge Graph Engine, SAP Business Data Cloud, SAP One Domain Model, SAP Graph API, and SAP Business Accelerator Hub.
  • Deep expertise across the W3C stack (OWL, RDF/RDFS, SKOS, SHACL) and/or property graph query languages (Cypher, GQL).
  • Hands-on experience with SAP BTP AI stack — SAP AI Core, Gen AI Hub, HANA Cloud, UCL registry for provisioning and CAP/BTP services.

Your team

You will be joining the SAP Private Cloud Cross Technology and Architecture unit, which is driving technology empowering innovations in business and people. This unit is part of the global organization Private Cloud dedicated to delivering innovative solutions to meet customers' unique business process needs in Private Cloud.

  • Dynamic and passionate team dedicated to leveraging Agentic AI and Enterprise Ontologies to facilitate seamless interactions between individuals and information.
  • Culture of collaboration, learning, and growth, encouraging all team members to contribute ideas and perspectives.
  • Diverse and international environment, with opportunities to collaborate with colleagues from around the globe.

Our vision is to become the premier strategic RISE with SAP enabler, driving accelerated innovation and technology adoption leveraging the SAP Business Technology Platform, focusing on a clean core approach.

About SAP

With a global network of customers, partners, employees, and thought leaders, SAP helps the world run better and improves people's lives. As a leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations spanning finance, procurement, HR, supply chain, and customer experience.

Inclusion and accommodations

SAP's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone, regardless of background, feels included and can run at their best. SAP believes it is made stronger by the unique capabilities and qualities that each person brings to the company and invests in employees to inspire confidence and help everyone realize their full potential.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate the website or complete the application, please send an email with your request to the Recruiting Operations Team: [email protected]

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to age, race, religion, national origin, ethnicity, gender (including pregnancy and childbirth), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

About SAP IT Business Systeme

SAP SE provides enterprise software for managing business operations and customer relations. It develops business software, including e-business and enterprise management software, consults on the organizational use of its application software, and provides training services.

Industry
Information technology
Head office
Walldorf, Baden-Württemberg, Germany
Company size
113,709
Founded
1972
Enterprise Resource PlanningFinancial ManagementSupply Chain ManagementHuman Capital ManagementCustomer Experience ManagementBusiness Artificial IntelligenceCloud ComputingAnalytics
See all 16 jobs at SAP IT Business Systeme→

Interested in this role?

Apply now to join SAP IT Business Systeme.

Similar roles

Let employers come to you

Upload your CV and we build your profile from it. Employers contact you. Free for job seekers.

Create your profile
Free email alerts

Be the first to know.

New AI and automation jobs, employers and talent, straight to you as they go live. Stay in the loop.

Get the inside track →

Senior Data Scientist - Agentic AI