AI Evaluator | $90/hr Remote

Position: AI Agent Power User

Type: Contract

Compensation: $30 - $90/hour

Location: Remote

Commitment: 10-40 hrs/week

Role Responsibilities

• Run complex, multi-step business scenarios using AI assistants to reflect genuine professional workflows.
• Document each step, highlighting AI performance alignment or divergence from realistic business needs.
• Evaluate and score AI-generated outputs using specified rubrics and criteria for quality and relevance.
• Draft clear, constructive feedback based on rubric findings to inform AI research and product teams.
• Identify recurring patterns in AI behavior, including strengths, weaknesses, and opportunities for improvement.
• Connect AI tools to workplace platforms to mirror authentic use cases.
• Maintain meticulous written records and communicate findings in professional English.

Requirements

• Have strong relevant experience in any business function utilizing technology to solve operational challenges.
• Completed Bachelor s degree or higher in any discipline.
• Consistent, hands-on daily use of ChatGPT and/or Claude for actual work.
• Experience grading, applying, or creating evaluation rubrics, QA scorecards, or content review guidelines.
• General comfort integrating AI tools with business software and productivity platforms.
• Demonstrated excellence in written English, focusing on clear, actionable documentation and feedback.

Application Process

• Easy Apply on LinkedIn
• Check email for next steps
• Participate in resume evaluation & interview stage