AI Research Engineer | Remote
- Source: LinkedIn
- Crossing Hurdles
- Remote
- United States
- Mid level
Job Description
Position: Member of Technical Staff, Cortex Lab
Type: Full-time
Compensation: $300K - $700K/yr
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
- Design and implement evaluation frameworks, benchmarks, and datasets for LLM-powered agents and complex AI workflows.
- Identify, analyze, and prioritize model, agent, and workflow failures in real-world production environments.
- Run rapid experiments to validate hypotheses, measure performance, and improve agent reliability and effectiveness.
- Partner with enterprise customers and researchers to evaluate, deploy, and optimize AI systems across production workflows.
- Develop high-quality training and evaluation data, task specifications, and feedback mechanisms to improve system performance.
- Build Python-based evaluation pipelines, experimentation tools, and lightweight research infrastructure.
Requirements
- Strong background in applied AI research, research engineering, machine learning, or LLM-based systems.
- Hands-on experience designing and implementing evaluations for AI agents, including tool use, multi-step workflows, and task completion.
- Strong Python programming skills and experience building evaluation pipelines, experimental tooling, or ML infrastructure.
- Experience developing benchmarks, datasets, evaluation metrics, and experimental methodologies for AI systems.
- Ability to analyze agent failures, identify root causes, and translate findings into measurable performance improvements.
- Understanding of LLM behavior, agentic architectures, and common challenges in reliability, robustness, and generalization.
Application Process
- Easy Apply on LinkedIn
- Check email for next steps
- Participate in resume evaluation & interview stage
Skills
- cortex
- Python
