Senior AI Trainer | $14–36/hr
- Source: LinkedIn
- Codefeast
- Remote
- United States
- Senior
Job Description
Senior AI Trainer
Role Overview
Evaluate AI chat and search responses for an AI training and evaluation project. Write and refine prompts, apply grading rubrics, check consistency, and document feedback to help shape how AI models learn, reason, and perform.
Key Responsibilities
- Evaluate AI chat and search tool performance under standardized, repeatable conditions.
- Apply grading guidelines to evaluate, rank, and annotate model responses with structured feedback.
- Write, refine, and stress-test prompts covering diverse scenarios, edge cases, and user intents.
- Verify consistency and accuracy across evaluations, correcting discrepancies against rubrics.
- Record findings and submit evaluation datasets via AI training platforms.
- Collaborate with trainers to resolve ambiguities and maintain evaluation consistency.
Key Requirements
- Exceptional attention to detail and accuracy reviewing AI-generated content.
- Strong written and verbal communication skills.
- Demonstrated time management and self-organization for independent remote work.
- Analytical, problem-solving mindset.
- Preferred: experience with AI model training, RLHF, data labeling, or similar evaluation work; familiarity with prompt engineering; experience writing rubrics or grading model outputs for accuracy, helpfulness, and safety.
Selection Process
- Apply
- Assessment/Interview
- Profile Review
- Onboarding
