AI Data Quality Specialist — Content Review and Evaluation

About the opportunity

We’re seeking detail-oriented professionals to review AI-generated content and annotated data for accuracy, clarity, and consistency. This role is well suited to candidates with backgrounds in editing, teaching, instructional design, quality assurance, research, or AI data annotation.

You will apply detailed written guidelines, identify subtle errors, and explain your decisions clearly. Assignments may include written content, image comparisons, and other evaluation tasks that require sustained focus and independent judgment.

What you will do

• Review AI-generated responses and annotated data against project guidelines and scoring rubrics.
• Identify errors, inconsistencies, unsupported statements, and cases that require further review.
• Write clear, specific feedback explaining what is incorrect and how it should be improved.
• Compare images or video frames to identify subtle visual differences, where required.
• Maintain consistent judgments across lengthy tasks and multiple documents.
• Incorporate feedback and participate in calibration exercises to align with project standards.
• Flag unclear guidelines and recommend improvements to rubrics, SOPs, or review instructions.
• Manage assignments independently and meet agreed quality and delivery expectations.

Required qualifications

• Professional experience in at least one of the following areas:
• Language and writing: Editing, proofreading, transcription, localization, or professional writing.
• Teaching and learning: Classroom teaching, ESL instruction, curriculum development, or instructional design.
• Analysis and quality: Quality assurance, data validation, statistics, market research, or AI data annotation.
• Excellent written English, including strong grammar, clarity, and the ability to explain errors precisely.
• Experience producing or reviewing work against documented standards, guidelines, or evaluation criteria.
• Strong attention to detail and the ability to maintain accuracy during extended assignments.
• Ability to interpret complex instructions, recognize ambiguity, and escalate questions appropriately.
• Experience working independently, managing deadlines, and applying feedback consistently.

Preferred qualifications

• Experience as a reviewer, QA specialist, quality lead, or quality manager on an AI data or annotation platform.
• At least 18 months of continuous AI annotation or evaluation experience.
• Paid experience writing, editing, proofreading, transcribing, or localizing content.
• A sustained record of independent remote work.
• Experience creating rubrics, SOPs, style guides, annotation guidelines, or instructional materials.
• Experience in video editing, color correction, photo retouching, or visual quality inspection.
• Experience reviewing peers’ work, coaching contributors, or resolving differences in evaluation judgments.