AI Ops Application Operations Lead

Role Overview The AI Ops Application Operations Lead owns the production lifecycle of agentic coding applications, plugins, and skills across Zeta. The role helps teams move high-value prototypes into production and keeps applications reliable, useful, governed, and measurable after launch.

This role partners closely with application owners, AI Operations, IT, Security, and other technical teams. Its primary focus is production readiness, lifecycle and release management, feedback loops, and clear visibility into adoption, performance, and business impact.

The ideal candidate combines application operations, technical program management, and product fluency. They do not need to be the primary developer for every application, but they must be comfortable working with AI-assisted development tools, understanding application architecture, translating business needs into technical requirements, and coordinating work across stakeholders.

Key Responsibilities Production Readiness and Launch

• Partner with owners of agenticly coded applications to assess whether an application is ready to move from prototype to production.
• Establish and manage a consistent production-readiness process covering security, privacy, data access, architecture, user experience, support, monitoring, and documentation.
• Identify launch risks, dependencies, and gaps, and coordinate the work required to address them.
• Connect application owners with IT, Security, Data, Legal, and other teams involved in production approval and deployment.
• Develop launch plans, readiness checklists, support models, and ownership documentation for each application.
• Ensure applications have clear business objectives, target users, success measures, and accountable owners before launch.

Application Operations and Lifecycle Management

• Manage the ongoing operational health of production applications.
• Maintain a prioritized backlog of fixes, enhancements, and technical improvements based on direction from the application owner.
• Coordinate application updates, testing, release management, and communication to users.
• Help ensure applications remain compatible with changes to models, APIs, enterprise systems, data sources, and security requirements.
• Establish clear escalation paths for defects, incidents, access issues, and performance concerns.
• Maintain accurate documentation for application functionality, dependencies, ownership, and support procedures.

Feedback, Adoption, and Continuous Improvement

• Help application owners establish structured feedback loops with users.
• Collect and organize user feedback, feature requests, defects, and usage insights.
• Translate feedback into clear product requirements and backlog items.
• Support application owners in prioritizing improvements based on user value, business impact, risk, and effort.
• Coordinate user testing and validation before major releases.
• Identify common patterns across applications that could inform shared standards, reusable components, or broader AI Ops priorities.

Measurement and Analytics

• Develop and maintain dashboards that provide application owners with visibility into adoption, usage, reliability, performance, and business outcomes.
• Define appropriate metrics for each application, including active users, usage frequency, task completion, response quality, errors, latency, user satisfaction, and estimated time or cost savings.
• Monitor application health and surface risks, adoption gaps, and improvement opportunities.
• Partner with application owners to review performance regularly and agree on actions.
• Help determine whether applications should be expanded, redesigned, consolidated, or retired based on evidence.

Governance, Standards, and Portfolio Management

• Apply AI Ops standards for application development, production readiness, responsible AI, security, documentation, and measurement.
• Help create reusable templates, checklists, playbooks, and operating procedures for agentic coding applications.
• Support the development of a governed application portfolio and inventory.
• Ensure applications have clear ownership, approved data access, defined user groups, and appropriate controls.
• Promote consistency across applications while allowing teams to move quickly and iterate.

Key Outcomes Success In This Role Will Be Measured By

• Increased percentage of high-value prototypes successfully moved into prod…