Healthcare Operations AI Trainer - 258050
- Source: LinkedIn
- Medix™
- Remote
- United States
- Mid level
Job Description
Healthcare AI Model Evaluator
**Fully Remote Flexible Schedule 5–40 Hours/Week 1099 Contract $40-$125/hr**About the Opportunity
We are seeking experienced healthcare professionals to support a major AI initiative focused on improving the accuracy, safety, and reliability of healthcare-focused AI models.
In this role, you will use your real-world healthcare expertise to evaluate AI-generated responses, identify errors, and create detailed evaluation criteria based on clinical, operational, documentation, and compliance standards.
This is a fully remote position with no direct patient care, shifts, or on-call responsibilities.
What You’ll Do
- Evaluate AI model responses to healthcare-related prompts and scenarios.
- Assess accuracy, safety, clinical reasoning, documentation, and workflow logic.
- Create and apply detailed grading rubrics to measure AI performance.
- Validate healthcare terminology, documentation requirements, compliance standards, and operational workflows.
- Identify errors, inconsistencies, omissions, and potentially unsafe recommendations.
- Work independently using provided AI tools, project instructions, and reference materials.
- Apply current guidelines and real-world healthcare experience when evaluating AI outputs.
Ideal Clinical Background
We are especially interested in professionals with 5+ years of current or recent hands-on healthcare experience , including:
- Registered Nurses (RN)
- Nurse Practitioners (NP)
- Physician Assistants (PA)
- Physicians (MD/DO)
- Pharmacists (PharmD)
- Respiratory Therapists
- Physical Therapists
- Midwives
- Other licensed healthcare professionals with independent clinical judgment
Healthcare Operations Backgrounds
Professionals with strong healthcare administrative or operational expertise are also encouraged to apply, particularly those with experience in:
- Medical coding, billing, and revenue cycle
- Clinical Documentation Improvement (CDI)
- Health Information Management (HIM)
- Utilization review and case management
- Claims and payer/health plan operations
- Credentialing and compliance
- Healthcare practice or operations management
Certifications such as CPC, CCS, or CCA are preferred but not required when strong practical experience is demonstrated.
Qualifications
- 5+ years of relevant healthcare experience
- Bachelor’s, Master’s, or PhD preferred; equivalent advanced practical experience may be considered
- Current or recent clinical license for clinical-track candidates
- Strong analytical and written communication skills
- Ability to interpret healthcare documentation and apply professional judgment
- Exceptional attention to detail and ability to work independently
- Availability to work 5–40 hours per week
- Reliable computer and high-speed internet connection
- Must reside in the United States
- Prior AI, LLM testing, data annotation, or model evaluation experience is a plus
Compensation & Growth
All new contractors start at $40/hour. The role offers flexible scheduling with the ability to work 5–40 hours per week.
As you establish yourself on the platform and gain access to additional projects and higher-level work, hourly rates can increase significantly, with opportunities reaching up to $125/hour depending on project, qualifications, performance, and available work.
Simple Application Process
Bring your healthcare expertise to the future of AI. Apply today.
