Agentic AI Architect — Backend Platforms and Voice Agents

Role Overview We are hiring a hands-on architect to design the backend foundations and the shared agent platform

that every team builds products on. You will own architecture across products and client deployments

— service boundaries, data flows, agent execution, real-time voice infrastructure and operational

reliability — and consolidate the systems different teams use today into one platform that is faster and

safer to build on. You will set the engineering practices the whole company follows, and partner with

senior AI engineers on solution delivery and with inference engineers on model-serving interfaces.

Key Responsibilities Backend and distributed systems

• Design service boundaries, APIs, data models, databases, caching and event-driven integrations

that scale to [thousands] of concurrent agent sessions.

• Make consistency, partitioning and replication trade-offs explicit, and design for partial failure

with timeouts, backpressure, circuit breakers and graceful degradation.

• Scale real-time voice infrastructure: session routing, media servers, and horizontal scaling of

WebSocket, SIP and WebRTC connections.

• Set reliability targets (SLOs), latency and cost budgets, and plan capacity across cloud and on-

premises deployments.

• Manage all infrastructure as code with GitOps workflows, so every environment is reproducible,

reviewed and auditable.

• Track model, speech and infrastructure cost per team, product and client, and set up chargeback

so owners see and control their spend.

Agent platform

• Build a shared agent platform: agent runtime, tool registry, enterprise connectors, memory and

retrieval services, and a model gateway with routing, fallbacks, rate limits and caching.

• Architect durable agent execution with persisted state, checkpoints, retries, idempotency,

timeouts, compensation for failed actions and human approval points.

• Enforce tenant isolation, authentication, authorisation, tool permissions and audit trails at the

platform level, so every product inherits them.

• Make the platform self-serve: SDKs, templates and documentation that let a team launch a new

voice or chat agent in days, not weeks.

• Run an internal developer portal (such as Backstage) as the single place to find services,

connectors, templates, owners and docs.

• Provide shared evaluation, tracing and monitoring services that every agent uses by default.
• Build a data platform for call and agent analytics: transcripts, outcomes, tool usage and latency,

feeding product insights, evals and client reporting.

Consolidation And Company-wide Practices

• Audit existing agent and voice stacks, and consolidate duplicate pipelines, connectors and

prompt setups onto the platform with migration plans that keep live clients running.

• Define reference architectures and golden paths for common use cases, such as voice agents,

chat agents and document workflows.

• Set engineering standards: architecture decision records, design reviews, API guidelines, testing

and eval requirements, release controls and incident management.

• Maintain a tech radar of approved, trial and retired tools, and lead build-versus-buy decisions

for agent frameworks, model providers, speech vendors and infrastructure.

Security, governance and resilience

• Design systems to meet security and compliance standards such as SOC 2, ISO 27001 and India’s

DPDP Act, and support audits with evidence from the platform.

• Set AI governance policy: red-teaming of agents before launch, model risk reviews, prompt-

injection defences and rules for which data each model may see.

• Define disaster recovery targets (RPO and RTO), run regular recovery drills and use chaos testing

to prove agents and voice sessions survive failures.

Technical leadership

• Translate business workflows into technical designs, build reference implementations and

review critical code.

• Guide engineering teams through architectural decisions, and mentor senior engineers to make

sound design choices on their own.

• Manage a team of [N] engineers: set goals, run one-on-ones and performance reviews, and

support their career growth.

• Act as solution architect in pre-sales: scope client requirements, design proposed solutions,

estimate effort and present the architectur…