SAP

Senior Machine Learning Engineer

Posted on: 7 Apr 2026

Palo Alto, CA

Job Description

Description

As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM?based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives.

Key Responsibilities

Architect, design, and implement production systems in Go, Java, and Python (full?stack experience a plus).
Build and optimize backend services, databases, APIs, and LLM infrastructure.
Leverage technologies such as Kafka, Postgres, HANA, gRPC, and advanced LLM frameworks.
Mentor and guide engineers from junior to senior levels, fostering technical excellence.
Partner with cross?functional teams to translate business goals into scalable, high?impact solutions.

Minimum Qualifications

Bachelor’s degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise.
6+ years of software engineering experience, with a track record of delivering complex systems.
Proven ability to work independently and lead initiatives from idea to deployment.
Hands-on experience with AI/ML and/or LLM systems in a production environment.
Expertise in distributed systems design and implementation.
Familiarity with CI/CD pipelines and modern development practices.
Strong English communication skills and ability to thrive in a global, multicultural team.

Preferred Qualifications

Open-source contributions or significant personal technical projects.
Experience integrating AI capabilities into large?scale enterprise products.
Strong problem?solving skills and an iterative, results?oriented mindset.

Why Join Us

Build cutting-edge AI and LLM systems used across SAP’s global platform.
Work in a high?autonomy, trust?based environment without unnecessary bureaucracy.
Collaborate with some of the best engineers in the industry in a fast?paced, impact?driven team.
Take ownership of projects that directly influence SAP’s AI strategy and product capabilities.

#SAPAICareers #SAPAIAPP

SAP

Newtown Square, PA

SAP is the market leader in enterprise application software, helping companies of all sizes and in all industries run at their best: 77% of the world’s transaction revenue touches an SAP system. Our machine learning, Internet of Things (IoT), and advanced analytics technologies help turn customers’ businesses into intelligent enterprises. Our end-to-end suite of applications and services enables our customers to operate profitably, adapt continuously, and make a difference. 

At SAP, our purpose is to help the world run better and improve people’s lives. Our promise is to innovate to help our customers run at their best. We engineer solutions to fuel innovation, foster equality, and spread opportunity across borders and cultures. 

SAP is a leader across all categories in the latest analyst reports – and preferred by 200 million cloud users and counting. Learn more about how we can help you thrive in the digital era.

As the leader in technology software, SAP is proud to expand its relationships within the sports and entertainment world.  Partnerships with world-class teams, leagues, and properties have afforded SAP the ability to create technology solutions that engage fans, media, players, coaches on another level, integrating real-time cloud-based analytics.

  • Industry
    Information Technology
  • No. of Employees
    101,450+
  • Jobs Posted
    1581

Similar Jobs