AI Quality & Evaluation Specialist | $25/hr Remote
- Source: LinkedIn
- Crossing Hurdles
- Remote
- United States
- Senior
Job Description
Position: LLM - AI Quality Analyst (Personalization) - English
Type: Contractor Assignment
Compensation: $25/hr
Location: Remote
Commitment: Full-time (30 - 40 hours/week), with at least 4 hours of PST overlap during business hours
Role Responsibilities
- Design and execute multi-turn conversational prompts based on personal context.
- Evaluate AI responses to determine whether personalization was appropriately applied.
- Analyze responses for Grounding issues, unsupported claims, flawed inferences, or hallucinations.
- Assess Integration quality and whether personal information is incorporated naturally.
- Evaluate model responses side-by-side and write clear, structured rationales for comparisons.
Requirements
- Strong proficiency in English, both written and verbal.
- Exceptional analytical thinking and ability to evaluate nuanced AI responses.
- Experience designing creative, multi-turn prompts based on personal context.
- Strong understanding of personalization and ability to identify incorrect personalization, poor inferences, and forced connections.
- Strong attention to detail when reviewing side-by-side model responses.
Application Process
- Apply via Easy Apply.
- Check your email for next steps.
