Lead AI Platform Architect

Key Responsibilities

• Architect and design end-to-end LLM-based systems, including Retrieval-Augmented Generation and multi-agent workflows, ensuring they are scalable and secure.
• Define system design patterns for scalability, low-latency inference, and high-throughput workloads to ensure optimal system performance.
• Lead architectural decisions regarding model selection, retrieval strategies, and orchestration frameworks to align with business needs and technological advancements.
• Design and build enterprise-grade LLM platforms that enable rapid experimentation, standardized deployment, and the creation of reusable AI components.
• Establish best practices for CI/CD in ML and LLM systems, including model lifecycle management and benchmarking frameworks.
• Lead the development of enterprise copilots and decision intelligence systems while driving innovation in prompt engineering and agent orchestration patterns.
• Build and mentor a high-performing team of AI, ML, and platform engineers, providing technical direction and fostering a culture of innovation and excellence.
• Partner with cross-functional teams to translate business problems into scalable AI solutions, supporting pre-sales and solution design for AI-driven initiatives.

Overview

• The LLM Ops Lead Architect is a pivotal role within the consulting sector, primarily based in Bangalore and Hyderabad, tasked with shaping the future of AI platforms.
• This position demands a strategic visionary who can navigate the complexities of large language models (LLMs) and AI infrastructure, ensuring robust and scalable solutions.
• As an integral part of the organization, the role requires collaboration across multiple teams to translate business requirements into cutting-edge AI capabilities.
• The architect will drive innovation by leveraging advanced AI technologies to enhance decision-making processes and operational efficiency.
• This leadership role involves not only designing but also implementing next-generation AI systems that are both secure and production-ready.
• The LLM Ops Lead Architect will be responsible for architecting systems such as RAG systems, agentic workflows, and decision intelligence platforms, ensuring they meet the highest standards of performance and reliability.
• The role is hands-on, requiring deep technical expertise and the ability to lead and mentor a team of engineers.
• The role offers a unique opportunity to influence the development of enterprise-scale AI platforms from inception, working on pioneering technologies like agentic AI, enterprise copilots, and decision intelligence.
• With a focus on innovation, this position provides high visibility and ownership, enabling the architect to drive significant impacts across the organization.
• The architect will also be responsible for establishing governance frameworks to ensure compliance with security standards and the ethical use of AI.
• This includes overseeing the implementation of measures to prevent hallucination, ensure data protection, and maintain explainability and auditability of AI systems.

Requirements

• 8+ years of experience in AI/ML with a strong focus on LLMs and Generative AI technologies.
• Proven track record in designing and deploying production-grade AI systems, with hands-on experience in RAG pipelines and vector databases.
• Strong programming skills in Python, with experience in cloud platforms such as AWS, Azure, or GCP.
• Deep understanding of MLOps practices, including containerization with Docker and Kubernetes, to ensure scalable system design.
• Experience with multi-agent systems or AI copilots, with familiarity in LLM evaluation frameworks like RAGAS or LangSmith.
• Prior experience in leading teams or architecting platforms, demonstrating a history of fostering innovation and engineering excellence.