⚠︎ This job is no longer accepting applications.

Be the Candidate They Can't Ignore.

Don't just send a resume; set yourself up so the right work finds you.

  • Look like a pro instantly with a stunning personal brand.

  • Gain instant "Top Ten" status so you aren't just another name in a pile.

  • Wake up to booked meetings instead of "rejection" emails.

Join the Club — Free Forever
Job Closed

MLOps Engineer

  • Source: LinkedIn
  • Evlo AI
  • Remote
  • New York City
  • Full-Time
  • Mid level

Job Description

About The Role The role owns the infrastructure that makes machine learning work in production: CI/CD for models, scalable training pipelines, feature stores, and monitoring systems that catch drift before it breaks anything. This is not a generic DevOps role — it sits at the intersection of ML systems and platform engineering.

The MLOps engineer enables data scientists and ML engineers to ship models fast without sacrificing reliability. As model complexity grows and GPU costs matter, the work here directly determines how quickly the entire ML organization can iterate and deploy.

Key Responsibilities

  • Build and maintain CI/CD pipelines for ML model deployment using tools like Kubeflow, MLflow, Argo Workflows, or GitHub Actions
  • Design and operate training and inference infrastructure on Kubernetes (EKS/GKE), including GPU scheduling, autoscaling, and cost optimization
  • Implement model serving stacks using TorchServe, NVIDIA Triton, vLLM, or KServe with low-latency, high-throughput requirements
  • Establish model monitoring and observability: data drift detection, performance metrics, alerting with tools like Evidently, Grafana, and Prometheus
  • Develop automated data and feature pipelines using Airflow, dbt, or Spark, ensuring reproducibility from raw data to training datasets
  • Manage experiment tracking, model registries, and artifact versioning (MLflow, Weights & Biases) with clear promotion and rollback workflows
  • Write infrastructure-as-code using Terraform and collaborate with data scientists to productionize models without handoffs slowing anyone down

What We Are Looking For

  • 3–6 years of experience in MLOps, ML platform engineering, or backend/DevOps engineering with significant ML infrastructure exposure
  • Strong Python skills plus production experience with Kubernetes, Docker, and at least one workflow orchestrator (Airflow, Kubeflow, Dagster)
  • Hands-on experience deploying and serving models in production on AWS, GCP, or Azure, including GPU-based inference workloads
  • Deep understanding of CI/CD principles applied to ML systems: model versioning, canary deployments, shadow traffic, automated rollback
  • Experience with monitoring and observability tooling for ML systems (drift detection, latency/throughput SLOs, cost tracking)
  • BS/MS in Computer Science, Engineering, or equivalent practical experience building large-scale distributed systems
  • Bonus: Experience with LLM inference optimization (quantization, batching, KV-cache tuning), feature stores (Feast, Tecton), or FinOps for GPU cost management

Skills

  • drift
  • kubeflow
  • ml-flow
  • mlflow
  • argo
  • Github
  • github-actions
  • Kubernetes
  • aws-auto-scaling
  • nvidia
  • triton
  • vllm1
  • Grafana
  • Prometheus
  • Airflow
  • apache-airflow
  • dbt
  • Spark
  • Terraform
  • Python
  • Docker
  • orchestrator
  • pypi-dagster
  • amazon-web-services
  • google-cloud-platform
  • microsoft-azure
  • tecton
This job is no longer accepting applications.

You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.

Join the Club — Free Forever
Create Free Account & Apply
  • Free personal website
  • Built-in Talent Agent
  • Apply to future jobs in 1 click
  • Get matched to similar roles
or
Apply as a guest this time

You'll apply successfully, but won't be able to track your application, save this job, or get matched to similar roles.

This listing is a publicly available opportunity curated by Try Club to help talent discover relevant roles. Try Club is an independent platform and is not affiliated with Evlo AI

Get Similar Jobs

Browse more similar roles on TRY and find your perfect match.

Show Me Similar Jobs

Stop Searching. Start Thriving.

Why waste time chasing leads when the perfect projects can find you?
With TRY, clients actively searching for professionals with your skills can discover you in seconds. Whether it's a quick gig or your dream role, we connect you with opportunities that matter.

  • Get found faster
  • Let projects come to you
  • Build a career on your terms

Take control of your career today.

Claim Free Website in 2 Minutes