LLM AI Quality Analyst- Chinese Mandatory
- Source: Careerplug
- Donato Technologies Inc
- $20,800 to $27,040 /yr
- Remote
- United States
- Full-Time
- Mid level
Job Description
Hiring: LLM – AI Quality Analyst (Personalization) – Chinese
We are looking for Chinese-speaking AI Quality Analysts to support a short-term AI evaluation project with a leading AI technology company.
Locations: USA
USA sourcing: Please do not source from Texas or Illinois
Duration: 4 months
Schedule: 30 or 40 hours/week | Minimum 4 hours/day
Time-zone requirement: 4 hours overlap with PST
Remote | Immediate Start
What You’ll Do
Evaluate personalized AI responses and determine their quality
Create multi-turn prompts based on personal experiences and context
Review AI responses for accuracy, helpfulness, and appropriate personalization
Identify incorrect personalization, unsupported assumptions, and hallucinations
Compare AI responses side-by-side and provide detailed feedback
- Write clear rationales explaining your evaluations
Requirements
- Strong Chinese reading and writing skills
Excellent analytical and critical-thinking skills
Strong written communication - Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred
Bachelor’s degree or equivalent experience
Comfortable working independently in a remote environment
Laptop/desktop with reliable internet - Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation
Student-friendly opportunity: This may be a good fit for students or recent graduates who have strong Chinese language skills and are interested in AI, language, data annotation, content evaluation, or technology and can meet the required weekly schedule.
Selection Process
Job Interest Form
Profile review
Online assessment — must be completed within 24 hours
Pre-onboarding discussion
Interested candidates: Please send your updated resume and confirm:
Chinese proficiency
Current location
Availability (30 or 40 hrs/week)
Earliest start date
Confirmation that you can provide 4 hours of PST overlap
This is a remote position.
Skills
- careerplug
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
