We help the world run better

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

Meet your team

We are looking for a strong AI/ML Specialist to bring deep artificial intelligence expertise into the SAP Business AI COE. This role is meant to complement, not replace, SAP functional and technical expertise. The candidate does not need to be an SAP expert on day one, but must be capable of working with SAP consultants, architects, and customer stakeholders to design reliable, scalable, and governed AI-led solutions.

The role will focus on translating business problems into appropriate AI solution patterns across Generative AI, classical ML, RAG, agentic workflows, document intelligence, voice AI, recommendation, prediction, and automation use cases. The person should help the team move beyond demos and build production-grade AI solutions with measurable quality, guardrails, and business impact.

What you'll do

SAP consultants bring business process, customer landscape, integration, and delivery context. A pure AI specialist brings depth in model behavior, data science, evaluation, hallucination control, RAG quality, agent design, and responsible AI.
SAP context can be learned with guidance, but deep AI engineering maturity is harder to build quickly through tool enablement alone.
This role will help the COE avoid building only AI-wrapped SAP demos and instead create reusable, enterprise-grade AI assets that can be tested, governed, improved, and scaled.

Expected Outcomes

Design AI-led architectures aligned to business outcomes and SAP-centric processes.
Establish reusable AI patterns for customer support agents, quote creation agents, document intelligence, voice agents, knowledge assistants, and internal productivity tools.
Define evaluation frameworks to measure accuracy, retrieval quality, consistency, confidence, and business value.
Improve solution reliability through guardrails, human-in-the-loop design, observability, test datasets, and feedback loops.
Coach SAP consultants on when to use GenAI, classical ML, automation, RAG, fine-tuning, or agentic orchestration.

Key Responsibilities

AI Solution Architecture and Design
Architect AI solutions that enhance business processes, decision-making, automation, and customer experience.
Translate business requirements into AI solution patterns across SAP and non-SAP landscapes.
Define end-to-end technical designs covering data flow, model selection, orchestration, integration, observability, and human oversight.
Partner with SAP CX, BTP, integration, and functional consultants to embed AI into enterprise workflows.
Generative AI, RAG, and Agentic AI Development
Design and build LLM-based applications using prompt engineering, tool calling, function calling, RAG, agent workflows, memory, and guardrails.
Define when to use prompting, retrieval, fine-tuning, classical ML, workflow automation, or human approval.
Work with vector databases, embeddings, chunking strategies, retrieval pipelines, reranking, and grounding techniques.
Develop agentic workflows that can reason, retrieve, call tools/APIs, execute tasks, and escalate safely when needed.
AI Quality, Evaluation, and Continuous Improvement
Create evaluation frameworks for AI outputs using golden datasets, human review, automated scoring, regression tests, and business KPIs.
Measure and improve accuracy, hallucination rate, retrieval relevance, completeness, consistency, confidence scoring, and task success rate.
Design feedback loops for continuous learning, prompt improvement, knowledge updates, and quality governance.
Set up experimentation practices to compare models, prompts, retrieval approaches, and agent designs objectively.
Machine Learning and Data Science
Apply classical ML techniques where GenAI is not the right fit, including classification, forecasting, clustering, anomaly detection, recommendation, sentiment analysis, and entity extraction.
Work with structured and unstructured data to identify patterns, build features, train models, and validate outcomes.
Support use cases involving predictive insights, prioritization, matching, routing, recommendation, and decision support.
Enterprise Integration and SAP Business AI Alignment
Collaborate with SAP teams to integrate AI capabilities with SAP CX, SAP Business Suite, SAP BTP, APIs, microservices, and enterprise data sources.
Leverage or align with services such as SAP Generative AI Hub, SAP AI Core, SAP AI Launchpad, SAP HANA Cloud vector capabilities, SAP Integration Suite, and relevant BTP services where applicable.
Design AI solutions that can work across SAP and non-SAP systems through secure APIs, event-driven flows, and reusable service patterns.
Stay current with SAP Business AI, Joule, AI agents, A2A/MCP patterns, and emerging enterprise AI architecture practices.
Governance, Security, and Responsible AI
Ensure AI solutions follow enterprise standards for data privacy, security, access control, auditability, explainability, and responsible AI.
Define guardrails for sensitive data handling, prompt injection risk, hallucination management, bias checks, and controlled tool execution.
Document model assumptions, evaluation results, known limitations, fallback behavior, and human oversight mechanisms.
Technical Leadership and Enablement
Provide AI technical leadership to project teams during discovery, solutioning, prototyping, delivery, and production hardening.
Mentor SAP consultants and developers on AI solution patterns, evaluation methods, prompt design, RAG quality, and agent architecture.
Contribute reusable assets, templates, reference architectures, and accelerators for the AI COE.

What you bring

Bachelor's or Master's degree in Computer Science, Engineering, Data Science, AI/ML, or a related discipline; equivalent practical experience may also be considered.
12+ years of strong hands-on experience in AI/ML solution development, with proven exposure to GenAI and LLM-based application design.
Proficiency in Python/Java and working knowledge of APIs, JSON, REST services, microservices, and cloud-based integration patterns.
Deep understanding of prompt engineering, embeddings, vector search, RAG architectures, agentic workflows, model behavior, and LLM limitations.
Experience with AI frameworks and tools such as LangChain, LlamaIndex, Semantic Kernel, CrewAI, AutoGen, or comparable orchestration frameworks.
Knowledge of ML frameworks such as TensorFlow, PyTorch, scikit-learn, or similar.
Ability to design evaluation methods for AI outputs, including accuracy testing, retrieval evaluation, confidence scoring, and regression testing.
Strong problem-solving, communication, stakeholder management, and technical leadership skills.
Ability to understand business problems and convert them into practical AI-led solution designs.

Preferred Skills

Exposure to SAP BTP, SAP Generative AI Hub, SAP AI Core, SAP HANA Cloud, SAP Integration Suite, SAP Analytics Cloud, or SAP Extension Suite.
Exposure to SAP CX, SAP S/4HANA, SAP Business Suite, CRM, sales, service, commerce, ERP, or enterprise SaaS platforms.
Experience with vector databases, knowledge graphs, document intelligence, speech-to-text/text-to-speech, OCR, and voice agent architecture.
Experience with cloud platforms such as Azure, AWS, GCP, or SAP BTP.
Experience with front-end or full-stack development using JavaScript, HTML, UI frameworks, Fiori elements, or API-based applications is desirable.
Experience in at least one industry domain and ability to understand industry-specific business challenges.
SAP certification in BTP or relevant SAP modules is a plus, but not mandatory.

Preferred Candidate Profile

A hands-on AI practitioner who can move from experimentation to production-oriented design.
A pragmatic technologist who can challenge the assumption that every problem needs GenAI.
A collaborator who can work with SAP consultants, business stakeholders, architects, and developers.
A learner who can pick up SAP business process and platform context over time.
A quality-focused engineer who treats evaluation, governance, and reliability as core design responsibilities.

Location - Bangalore/Gurgaon

#BusinessProcessT3

Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: [HIDDEN TEXT].

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 445212 | Work Area: Consulting and Professional Services | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations:

AI/ML Specialist - SAP CX Business AI COE - 12+ years