LLM AI Quality Analysts
- Source: Careerplug
- Donato Technologies Inc
- $31,200 /yr
- Remote
- United States
- Full-Time
- Mid level
Job Description
We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity.
Rate: $15/hr USD
Start Date: Immediately
Availability: 30–40 hours/week
PST Overlap: 4 hours required
Engagement: Contractor
Education: Bachelor’s or Master’s degree in IT or any IT-related field
Approved States:
Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, Wyoming.
Requirements
- Strong English reading and writing skills
- Strong analytical and attention-to-detail skills
- AI evaluation, data annotation, content moderation, or related experience preferred
- Ability to work independently in a remote environment
- Laptop/Desktop with reliable internet
- Willingness to use a primary personal Google account and enable personal data sources for the assessment
What You’ll Do
- Evaluate personalized AI/Gemini responses
- Create and test multi-turn prompts
- Assess AI responses for Grounding, Integration, and Helpfulness
- Compare model responses side-by-side
- Identify incorrect personalization, poor inferences, and hallucinations
- Provide detailed feedback and rationales
Interested?
Please send your updated resume + current location + availability to:
This is a remote position.
Skills
- Gemini
- careerplug
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
