Principal Software Engineer, AI Platforms

We are hiring a Principal Software Engineer for Arm’s AI Platforms team in Bangalore. You will help shape technical direction, build production software, and establish the engineering practices of a growing team. Working with the Director of Engineering and technical leaders across Arm, you will take responsibility for significant platform capabilities and remain closely involved in their implementation.

We are looking for an exemplary practitioner whose code, technical decisions, and approach to difficult problems set the standard for the team. You will combine systems engineering depth with hands-on expertise in agentic AI across the software development lifecycle (SDLC), helping engineers embrace new methods and assess their effect on delivery and quality.

Responsibilities

• Define technical direction with engineering leadership. Assess platform needs, explore design options, and turn decisions into software the team can deliver and operate.
• Design and implement distributed platform services. Write critical code, review implementations, and rapid prototyping to test uncertain assumptions before committing to a design.
• Shape the engineering culture through daily practice. Help the team deliver frequent changes with clear ownership, useful design and code reviews, and verification appropriate to the software being built.
• Build and use agentic AI workflows across the SDLC. Give agents useful project context, connect them to development tools, and establish feedback through tests and code review. Measure their effect on delivery speed and software quality.
• Keep current with developments in software engineering, AI development tools, and cloud systems. Evaluate promising approaches through hands-on experiments and adopt them when the results justify the change.
• Resolve difficult design and production problems involving concurrency, data consistency, performance, and failure recovery. Use what you learn to improve the architecture and the team’s engineering practices.
• Help recruit staff and senior engineers, and develop their judgment through shared technical work. Support engineers in taking ownership of complete capabilities and working through unfamiliar problems.
• Partner with Arm teams in the US and UK on architecture and shared interfaces. Make technical decisions understandable and establish clear ownership across teams.

Required skills and experience

• 12+ years building distributed software, cloud platforms, or production infrastructure, or equivalent experience demonstrated through the scope and impact of your work.
• Strong programming skills in Go, C++, Rust, Python, or a comparable language. Experience designing service interfaces, working with concurrency and persistent data, and debugging complex failures.
• Experience building and operating software on Kubernetes and Linux, with an understanding of workload lifecycle, networking, resource management, and failure recovery.
• Hands-on expertise with agentic AI tools and harnesses for the SDLC. Experience configuring and extending workflows, assessing generated code, and verifying changes through automated checks and engineering review.
• A record of technical leadership grounded in your own engineering work, including mentoring experienced engineers, explaining design choices, and improving how a team develops software.

Preferred skills and experience

• Experience with AI inference infrastructure or model serving, including how workload and hardware choices affect latency, throughput, and resource use. Knowledge of inference performance and resource-efficiency considerations.
• Familiarity with frameworks such as PyTorch, Ray, vLLM, SGLang, TensorRT-LLM, or Dynamo or experience qualifying accelerators and tuning distributed workloads.
• Kubernetes controllers or operators, deployment systems, or software that manages releases across different compute environments.
• Developer productivity tools, build and test infrastructure for large scale distributed systems.
• Distributed tracing, observability, diagnostics, or data processing systems used to understand production behavior.

**In Return:** We provide an opportunity to learn about the latest Arm architecture features, working closely with a highly skilled engineering team on ground-breaking technology!

**Our 10x Mindset** At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x min…