Job Closed
Senior Software Engineer AI Inference
- Source: Naukri
- Hiringeye Solutions
- Hybrid
- Bengaluru
- Full-Time
- Senior
Job Description
We are looking for a Senior Software Engineer AI Inference to design and develop scalable AI inference platforms for large-scale production environments. The ideal candidate should have strong expertise in distributed systems, cloud-native technologies, and AI inference frameworks.
Key Responsibilities
- Design and build scalable, high-performance AI inference services.
- Develop and optimize distributed systems for reliability, scalability, and performance.
- Collaborate with cross-functional teams to deliver production-ready AI infrastructure.
- Improve system performance through observability, automation, and infrastructure optimization.
- Mentor team members and contribute to architecture and technical design.
Required Skills
- 5+ years of experience in backend software engineering or distributed systems.
- Strong programming skills in Go/Golang or Python.
- Experience with Kubernetes, microservices, and cloud-native architectures.
- Knowledge of AI inference frameworks such as vLLM, Ray Serve, SGLang, or similar.
- Understanding of GPU optimization, LLM serving, distributed systems, and Infrastructure as Code (IaC).
- Familiarity with gRPC, observability tools, and open-source technologies is a plus.
Skills
- Golang
- Python
- Kubernetes
- sglang
- gRPC
This job is no longer accepting applications.
Join the Club — Free ForeverYou missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
