Software Engineer - AI - Innovation Engineering [T500-29587]

About Costco Wholesale:

Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.

About Costco Wholesale India:

At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.

Position Summary:

The AI Software Engineer is responsible for the hands-on development, maintenance, and expansion of our enterprise AI Platform as a Service. In this role, you will be a key contributor to building the ‘Operating System for Intelligence,’ developing the shared services, standardized interfaces, and agentic orchestration modules that enable the organization to deploy semantic discovery, conversational intelligence, and autonomous agents. This role will move beyond building isolated applications to engineering a scalable, multi-tenant execution architecture using a managed Agent Runtime Environment. Your mission is to maintain the platform’s core infrastructure while building specialized supervisor agents and standardized toolsets that serve as the modular building blocks for enterprise-wide automation.

Job Duties/Essential Functions:

• Maintain and evolve core AI platform services, such as shared memory banks and session management. This includes managing the central reasoning engine.
• Architect and optimize modular agentic framework templates using standardized orchestration SDKs to manage complex, stateful workflows.
• Create and maintain a library of standardized capability servers using the model context protocol, enabling agents to securely orchestrate tasks across enterprise data platforms, customer relationship management systems, and distributed microservices.
• Integrate the AI Platform as a Service with existing enterprise infrastructure. This includes developing code for authentication systems, logging pipelines, and CI/CD workflows.
• Manage and optimize the platform’s semantic retrieval architecture, ensuring high-speed, low-latency access to grounded enterprise knowledge through a unified discovery and retrieval engine.
• Engineer and optimize discovery agents that leverage semantic retrieval and neural search platforms to ingest, validate, and cite evidence from unified multimodal lakehouses.
• Establish Agent Identity (IAM) protocols to ensure every autonomous action is authenticated, authorized, and logged under a secure service principal.
• Implement and scale automated AI performance benchmarking systems to continuously monitor mission success rates and proactively identify regressions in reasoning, safety guardrails, or autonomous decision-making.
• Serve as the primary responder for systemic platform anomalies, utilizing distributed traceability and aggregated telemetry to diagnose and resolve bottlenecks within complex multi-agent reasoning chains.
• Maintain internal documentation and SDKs that empower other software teams to onboard their use cases onto the AI Platform as a Service.
• Ensures the longevity, scalability and quality of our systems through continuous improvement, comprehensive documentation, meticulous profiling, and significant performance enhancements.
• Regular and reliable workplace attendance at your assigned location.

Ability to operate vehicles, equipment or machinery:

• Computer, phone, printer, copier, fax.

Non-Essential Functions:

• Assists in other areas of the department as necessary.
• Assists in other areas of the company as necessary.

Ability to operate vehicles, equipment or machinery:

• Same as Essential Functions

Experience, Skills, Education & Licenses/Certifications:

Required:

• 12+ years years of experience in backend software development with a focus on API design and microservices.
• 1+ years of hands-on experience building with LLM APIs, function calling, or orchestration frameworks.
• Expertise experience architecting and maintaining containerized autonomous workloads across elastic container orchestration and scalable serverless runtimes, with a focus on high-availability event-driven archite…