Architect, AI Platform

We are seeking a visionary Red Hat Architect specializing in Machine Learning Operations (MLOps) and Artificial Intelligence (AI) to design, build, and scale our enterprise AI platform. In this role, you will bridge the gap between enterprise-grade infrastructure and cutting-edge artificial intelligence.

You will lead the architectural design of our container-native machine learning pipelines on Red Hat OpenShift, with a heavy focus on Large Language Models (LLMs), containerized model serving, scalable runtime environments, and automated benchmarking.

What you will do:

• Design and advocate solutions that leverage the full Red Hat ecosystem to solve complex business problems, explicitly aligning AI/ML capabilities with customer strategic goals.
• Work hand-in-hand with customer associates and executive stakeholders to guide the adoption of Artificial Intelligence and MLOps processes, drastically improving model time-to-market and operational efficiency.
• Collaborate with project and customer team members to manage scope, mitigate architectural risks, and consistently meet delivery timelines and project goals.
• Participate in consulting sales motions to discover customer pain points, scope complex engineering engagements, architect high-level proposals, and deliver compelling technical demonstrations/proof-of-concepts (PoCs).
• Contribute heavily to project documentation and diagrams, capturing architectural blueprints, deployment guides, and best practices to ensure long-term customer success and internal knowledge reuse.
• Commit to continuous training and professional development to stay at the absolute forefront of the rapidly evolving LLM, MLOps, and Cloud-Native ecosystem.
• Architect and build production-grade MLOps pipelines using Red Hat OpenShift Container Platform and Red Hat OpenShift AI (RHOAI).
• Guide customers through Model Selection (e.g., Llama, Mistral, Granite) by analyzing specific business use cases against hardware/GPU memory constraints, cost profiles, and licensing models.
• Design containerized Model Deployment architectures using KServe, optimizing low-latency Inference Servers (e.g., vLLM, TGI, Triton) within OpenShift environments.
• Establish automated Benchmarking and Test pipelines to measure tokens-per-second throughput, hardware efficiency, and cost-per-inference metrics.
• Mentor and share knowledge with customers through structured workshops, paired programming sessions, and architectural reviews, empowering their internal teams to confidently manage the platform post-delivery.
• Act as an internal champion, coaching junior consultants and engineering associates on the nuances of deploying AI workloads on Kubernetes.

What you will bring:

• 8-10 years in a related technology position, e.g., sales, consulting, operations, development, etc
• 5+ years of experience with Public Cloud and Linux technologies
• 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes
• 3+ years experience in production ready AI solutions.
• 3+ years experience in production ready Machine Learning use cases.

Nice to have:

• Experience in designing and delivering implementations using various public and private cloud infrastructure technologies and providers
• Red Hat Certified Architect (RHCA) or Specialist certifications in OpenShift.
• Demonstrated experience publishing technical whitepapers, architectural blueprints, or speaking at industry conferences (e.g., Red Hat Summit, KubeCon).
• Experience in Financial Services

The salary range for this position is $142,370.00 - $234,770.00. Actual offer will be based on your qualifications.

Pay Transparency

Red Hat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of Red Hat’s compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience.

About Red Hat

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-offic…