Be the Candidate They Can't Ignore.

Don't just send a resume; set yourself up so the right work finds you.

  • Look like a pro instantly with a stunning personal brand.

  • Gain instant "Top Ten" status so you aren't just another name in a pile.

  • Wake up to booked meetings instead of "rejection" emails.

Join the Club — Free Forever

Principal AI/ML Software Engineer

  • Source: LinkedIn
  • Octave
  • Remote
  • Madison
  • Full-Time
  • Staff

Job Description

**Responsibilities** Position Overview We are seeking a motivated AI/ML Engineer to build reliable, scalable systems and Generative AI and Agentic AI features, and build and deploy data-driven solutions for our document-based compliance management platform. This role requires a technical expert who can develop, deploy, and maintain ML systems in production environments.

**Key Responsibilities**

  • Build and deploy Generative AI features using foundation models (AWS Bedrock, OpenAI, Anthropic Claude) and inference pipelines with optimization of latency and cost
  • Design agentic AI systems that autonomously handle compliance workflows, document review, regulatory mapping, and multi-step reasoning tasks
  • Integrate comprehensive LLM evaluation frameworks with development and production systems
  • Build and operate end-to-end MLOps pipelines, deployment systems, monitoring, and rollbacks workflows
  • Implement explainability frameworks (SHAP/LIME) and monitoring dashboards ensuring transparency and regulatory adherence
  • Collaborate with cross-functional teams to translate business needs into ML solutions and communicate insights to stakeholders

LI-Remote

**Education / Qualifications** Technical Skills

  • Python (5+ years): Production-level experience with Pandas, NumPy, scikit-learn, XGBoost, TensorFlow/PyTorch, Hugging Face Transformers, FastAPI/Flask, MLflow, and pytest
  • SQL: Advanced proficiency with complex queries, window functions, and optimization
  • Machine Learning & NLP: Strong foundation in supervised/unsupervised learning, deep learning, document understanding, text classification, and semantic analysis
  • Generative AI & LLMs: Hands-on experience with foundation models (GPT, Claude, Llama), prompt engineering, RAG architectures, and vector databases (Pinecone, Weaviate, Chroma)
  • MLOps & ModelOps: End-to-end experience with ML pipelines, model versioning, feature stores, drift detection, CI/CD for ML, and Docker containerization
  • LLM Evaluation: Experience with evaluation frameworks (RAGAS, DeepEval), custom metrics, benchmark datasets, and human-in-the-loop validation
  • Cloud & AWS: Experience with AWS services including SageMaker, Bedrock, S3, Lambda, EC2, and CloudWatch
  • Statistics & Experimentation: Strong foundation in statistics, A/B testing, causal inference, and experimental design
  • Visualization: Proficiency with Tableau, Power BI, or Python visualization libraries

**Experience & Education**

  • 5+ years in data science, ML engineering, or related roles
  • 3+ years building NLP/generative AI applications and implementing MLOps in production
  • Bachelor’s or Master’s degree in Data Science, Computer Science, Statistics, or related field
  • Track record of deploying ML systems processing large-scale datasets with proper monitoring and governance

**Preferred Qualifications**

  • Experience with agentic AI frameworks (LangGraph, LangChain, AutoGen, CrewAI) ?
  • Knowledge of Life Sciences/regulated industries (FDA, EMA, ISO, GxP) and compliance management systems
  • Familiarity with big data tools (Spark, Databricks, Snowflake), orchestration (Airflow, Kubeflow), and monitoring tools (Datadog, Prometheus)
  • Experience with LLM fine-tuning, document processing libraries, multi-modal AI, or distributed training
  • Understanding of ML governance, bias detection, model risk management, and data privacy regulations (GDPR, CCPA, HIPAA)
  • Experience working in agile environments with Jira
  • AWS ML certifications or similar credentials

Key Competencies

  • Strong communication skills explaining complex models to technical and nontechnical audiences
  • Ability to work independently and collaboratively in fast-paced environments
  • Proven ability to convert POCs into production-grade solutions
  • Understanding of ethical AI and building trustworthy, explainable systems for regulated environments

**What You’ll Build**

  • LLM evaluation frameworks ensuring 95%+ accuracy for compliance-critical features
  • Prompts for LLMs to achieve specific, high-quality outcomes
  • Agentic AI systems autonomously handling document review and compliance workflows
  • GenAI document understanding features processing millions of regulatory documents
  • Predictive models identifying compliance risks before they occur
  • Real-time semantic search and explainable ML systems meeting regulatory requirements
  • Production MLOps pipelines supporting dozens of models with automated monitoring and retrain…

Skills

  • amazon-web-services
  • bedrock
  • openai
  • claude-by-anthropic
  • Python
  • Pandas
  • NumPy
  • Scikit-learn
  • xgboost
  • Tensorflow
  • PyTorch
  • hugging-face
  • Transformers
  • FastAPI
  • Flask
  • ml-flow
  • mlflow
  • Pytest
  • meta-llama
  • llama
  • chroma
  • drift
  • Docker
  • benchmark
  • amazon-sagemaker
  • amazon-s3
  • aws-lambda
  • amazon-ec2
  • amazon-cloudwatch
  • Tableau
  • power-bi
  • LangGraph
  • LangChain
  • crewai
  • Spark
  • azure-databricks
  • databricks
  • Snowflake
  • Airflow
  • apache-airflow
  • kubeflow
  • datadog
  • Prometheus
  • JIRA
  • octave
  • turning

Create Free Account & Apply
  • Free personal website
  • Built-in Talent Agent
  • Apply to future jobs in 1 click
  • Get matched to similar roles
or
Apply as a guest this time

You'll apply successfully, but won't be able to track your application, save this job, or get matched to similar roles.

This listing is a publicly available opportunity curated by Try Club to help talent discover relevant roles. Try Club is an independent platform and is not affiliated with Octave

Get Similar Jobs

Browse more similar roles on TRY and find your perfect match.

Show Me Similar Jobs

Stop Searching. Start Thriving.

Why waste time chasing leads when the perfect projects can find you?
With TRY, clients actively searching for professionals with your skills can discover you in seconds. Whether it's a quick gig or your dream role, we connect you with opportunities that matter.

  • Get found faster
  • Let projects come to you
  • Build a career on your terms

Take control of your career today.

Claim Free Website in 2 Minutes