Humanities Expert – AI Content Evaluation

Job Description

We are looking for experienced Humanities Experts to support the development and evaluation of high-quality AI systems.

In this role, you will use your subject-matter expertise, critical thinking, analytical reasoning, and strong written English skills to review and evaluate AI-generated questions and answers across various humanities disciplines.

You will help ensure that AI-generated content is accurate, relevant, clear, complete, coherent, and logically sound.

Key Responsibilities

• Review and evaluate questions and answers related to humanities disciplines.
• Assess content for factual accuracy, relevance, clarity, completeness, and logical consistency.
• Identify inaccuracies, misleading statements, gaps in reasoning, ambiguities, and other quality issues.
• Evaluate nuanced and complex humanities topics using subject-matter expertise.
• Determine whether responses appropriately address the questions and requirements.
• Provide clear and consistent evaluations based on established guidelines.
• Apply best practices in AI training data generation, annotation, and evaluation.
• Contribute to improving the quality and reliability of datasets used to train and evaluate AI models.

Required Qualifications

• 5+ years of professional or academic experience.
• Bachelor’s degree or equivalent expertise in a Humanities-related field.
• Strong knowledge of one or more areas such as:
• History
• Philosophy
• Literature
• Linguistics
• Languages
• Cultural Studies
• Sociology
• Anthropology
• Political Science
• Religious Studies
• Arts & Humanities
• Related disciplines
• Excellent critical thinking and analytical reasoning skills.
• Excellent written and reading English proficiency.
• Strong attention to detail.
• Ability to objectively evaluate written content and distinguish strong from weak answers.
• Ability to follow detailed guidelines and apply evaluation criteria consistently.
• Ability to work independently in a remote environment.

Preferred

Experience in any of the following is preferred, but not mandatory:

• AI evaluation
• Data annotation
• Content review
• Quality assurance
• Analytical/research roles

Engagement Details

• Employment Type: Contractor
• Duration: 4 weeks
• Working Hours: 40 hours/week
• Time Zone Requirement: 4 hours of overlap with PST
• Work Mode: Remote

Ideal Candidate

This opportunity is particularly suitable for experienced Humanities professionals, academics, researchers, educators, writers, editors, or subject-matter experts who have strong analytical and written communication skills and are interested in contributing to AI evaluation.
Interested candidates please share your resume
[email protected]

Pay: Up to ₹100,000.00 per month

Application Question(s):

• Do you have 5+ years of professional or academic experience?
• Do you have a Bachelor’s degree or equivalent expertise in Humanities or a related discipline?
• Which Humanities discipline is your primary area of expertise?

History
Philosophy
Literature
Linguistics
Languages
Cultural Studies
Sociology
Anthropology
Political Science
Religious Studies
Arts & Humanities
Other

• Do you have any experience with AI evaluation, AI training, data annotation, or similar AI-data workflows?

Work Location: Remote