Principal AI Architect -SAP ERP Operation and AI technologies (SAP Joule, SAP AI Core, ALM, AI governance)

Role : Principal AI Architect – SAP ERP Operations, Agentic AI & Automation.

Fulltime role

Location : hybrid at New Jersey

Skills needed : SAP AI technologies such as SAP Joule, SAP AI Core, SAP BTP, SAP Cloud ALM, SAP Knowledge Graph, or related SAP Business AI capabilities. Agentic AI , RAG/GraphRAG, AI governance

Principal AI Architect – SAP ERP Operations, Agentic AI & Automation.

Role Summary

We are looking for a hands-on AI Architect to lead the design, development, and industrialization of AI, Agentic AI, and Automation solutions across SAP ERP Platform Managed Services. The role requires a practitioner who has built and deployed production-grade AI solutions, agents, and automation frameworks for enterprise Platform operations (SAP preferred).

Key Responsibilities

• Design and implement AI, Agentic AI, and automation solutions for SAP ERP Operations, AMS, and Platform Services.
• Build and operate AI platform components including orchestration services, agent gateways, agent lifecycle management, knowledge layers, and AI observability.
• Develop AI-powered use cases for incident management, RCA, transport management, job scheduling, monitoring, compliance, and self-healing operations.
• Design and train domain-specific agents and copilots using SAP Joule, SAP AI Core, Knowledge Graphs, BlueVerse AI models, and enterprise AI platforms.
• Implement event-driven architectures, APIs, microservices, and agent integrations using Kafka, REST, gRPC, and MCP patterns.
• Build and maintain RAG/GraphRAG solutions leveraging vector databases, enterprise search, and knowledge graphs.
• Define AI governance, HITL controls, confidence scoring, approval workflows, auditability, and Responsible AI practices.
• Define operational KPIs including automation coverage, incident reduction, MTTR improvement, ticket deflection, self-healing success, and AI ROI.
• Partner with SAP, hyperscalers, NVIDIA teams to accelerate AI-led innovation.
• Mentor engineering teams and establish architectural standards, runbooks, and best practices.

Required Qualifications

• 10+ years of experience in enterprise platforms, cloud engineering, ERP operations, managed services, or software engineering.
• 3+ years of hands-on experience designing and implementing GenAI, Agentic AI, or enterprise AI solutions in production.
• Strong experience with SAP Basis, SAP Operations, ERP Managed Services, AIOps, Service Management, or enterprise support environments.
• Hands-on experience with SAP AI technologies such as SAP Joule, SAP AI Core, SAP BTP, SAP Cloud ALM, SAP Knowledge Graph, or related SAP Business AI capabilities.
• Experience building agent-based solutions using frameworks such as LangGraph, CrewAI, MCP architectures, OpenAI Agents, ADK, or equivalent.
• Hands-on experience with RAG, GraphRAG, vector databases, knowledge graphs, enterprise search, and LLM integration patterns.
• Strong experience with Kubernetes, Kafka, Python, API Gateways, microservices, CI/CD, Prometheus/Grafana, and observability tooling.
• Experience implementing AI governance, HITL frameworks, model evaluation, drift monitoring, prompt management, and Responsible AI controls.
• Strong understanding of enterprise security, RBAC, SSO, audit logging, and compliance frameworks.
• Excellent communication and stakeholder management skills.

Preferred Qualifications

• Experience building AI-driven solutions for transport automation, predictive monitoring, Control-M automation, compliance automation, incident triage, RCA, and self-healing operations.
• Experience with SAP Managed Services, SAP S/4HANA transformations, or large-scale ERP modernization programs.
• Familiarity with SAP Joule Studio, Business Data Cloud, Signavio, LeanIX, and SAP Business AI ecosystem.
• Experience working with NVIDIA, AWS Bedrock, Azure AI, or equivalent enterprise AI platforms.
• Participation in AI innovation programs, hackathons, or development of reusable AI accelerators and enterprise agents.

Deliverables & Artifacts

• AI & Agentic Architecture Designs
• Agent Development Standards and Runbooks
• CI/CD Pipelines and Deployment Artifacts
• Automated Testing Frameworks
• Knowledge Architecture (RAG / Knowledge Graph)
• AI Governance and HITL Frameworks
• KPI Dashboards and AI ROI Reports
• Agent Evaluation Scorecards and Quality Metrics
• Solution Playbooks and Operational Procedures

Ideal Candidate: A builder who combines SAP operations expertise wit…