AI Platform Architect

AI Platform Architect

Location: New York, NY with 3 days in office

Our client is seeking an AI Platform Architect to lead the design and evolution of enterprise scale AI platforms and capabilities. This role will be responsible for defining architecture standards, scalable AI patterns, governance frameworks, and engineering best practices that enable teams to build secure, resilient, and production ready GenAI solutions.

The ideal candidate will have deep expertise in enterprise architecture, distributed systems, and generative AI technologies, with experience designing platforms that support multiple products, teams, and business domains within a large financial services environment.

Responsibilities

• Define and maintain the enterprise reference architecture for GenAI solutions, including model access, orchestration, retrieval, agent frameworks, tool integration, and runtime controls.
• Ensure architecture and engineering approaches align with broader platform strategy and enterprise technology standards.
• Lead end-to-end solution design and delivery for complex AI platform capabilities and services.
• Partner with engineering, security, architecture, and business stakeholders to translate business needs into scalable technical solutions.
• Establish architectural standards for identity management, access controls, data governance, observability, resiliency, and human oversight.
• Define best practices for Retrieval Augmented Generation (RAG), vector search, tool calling, agent orchestration, guardrails, and evaluation frameworks.
• Design highly available, fault tolerant, and resilient AI platforms capable of operating at enterprise scale.
• Develop capacity planning, workload distribution, performance optimization, and scalability strategies across distributed environments.
• Define service tiering, disaster recovery, and business continuity approaches for AI platforms and services.
• Evaluate emerging technologies, frameworks, and tooling to improve platform capabilities and engineering efficiency.
• Drive engineering excellence through architecture reviews, design guidance, code quality standards, and automation practices.
• Enable and support CI/CD adoption across development teams and platform services.
• Establish monitoring, telemetry, tracing, logging, and alerting standards to support operational excellence and platform reliability.
• Conduct technology research, proof of concepts, and architecture evaluations to support future platform direction.
• Provide technical leadership and mentorship to engineering teams implementing enterprise AI solutions.

Requirements

• 7+ years of experience in Enterprise Architecture, Platform Architecture, Software Engineering, or Distributed Systems Design.
• Proven experience designing and operating enterprise scale platforms that support multiple applications, teams, and business functions.
• Deep understanding of Generative AI architecture and platform design.
• Hands on experience with model gateways, Retrieval Augmented Generation (RAG), vector databases, orchestration frameworks, tool calling, AI guardrails, and evaluation strategies.
• Experience designing and operating Agentic RAG architectures.
• Experience designing and operating multi-agent systems.
• Experience designing and operating complex retrieval workflows.
• Experience designing and operating governed AI ecosystems with enterprise controls and oversight.
• Strong experience designing highly available, scalable, resilient distributed systems.
• Demonstrated expertise in capacity planning, workload management, performance engineering, and scalability strategies.
• Experience establishing standards for identity and access management, secure integrations, and data governance.
• Knowledge of observability frameworks, monitoring, telemetry, auditability, traceability, and operational support models.
• Experience working within financial services, banking, or other highly regulated environments.
• Experience building enterprise AI platforms supporting multiple products, business units, and engineering teams.
• Familiarity with AI model registries, model lineage, governance controls, compliance metadata, and AI benchmarking methodologies.
• Strong communication and stakeholder management skills with the ability to influence technical and business leaders.