Clinical Product Specialist - AI Safety & Validation

The Opportunity

Nursing is where patient care happens. Nurses know what patients need, what works in real clinical environments, and how AI can actually help. At Hippocratic AI, we’re building AI systems that earn the trust of nurses and clinicians because they’re designed with clinical reality in mind from the start. You’ll be the clinical voice shaping that design—ensuring our systems are accurate, safe, and actually useful to the people delivering care.

At Hippocratic AI, we’re different. We’re building the only generative AI platform designed for safe, autonomous clinical conversations with patients. Our 99.9%+ accuracy isn’t accidental—it’s earned through rigorous clinical validation by experienced nurses and clinicians who understand real-world care.

We need a Clinical Product Specialist (RN) who can bridge the gap between clinical reality and AI capability. You’ll be the voice of frontline nursing in our product and ML teams, working alongside leaders to validate, test, and continuously improve our medical large language models (LLMs). You’ll execute clinical validation protocols, author test cases and gold standards, and provide clinical insights that shape product decisions. You’ll travel 25-40% to health systems and user research—staying connected to real clinical workflows and learning how our platform performs in the field.

This is hands-on, high-impact work where you’ll grow your product muscles while making clinical safety your specialty. You’ll own execution. You’ll contribute strategic thinking. And you’ll be part of a team that treats clinical integrity as our most important feature.

What Success Looks Like in Year One

• Validation Protocol Execution: You’ve successfully executed 2-3 full clinical validation cycles—from protocol design (with guidance from your lead) through systematic testing to documentation and recommendations for improvement.
• Gold Standards Library: You’ve authored or co-authored 30-50 test cases, rubrics, and reference answers for clinical scenarios. You understand the difference between a good test case and a great one. Your work is used by engineering teams to benchmark model performance.
• Clinical Gap Identification: Through hands-on testing and analysis, you’ve identified 5-10 clinical inaccuracies, edge cases, or safety concerns in the model. You’ve documented them clearly and worked with senior team members to prioritize fixes.
• Product Contribution: You’ve participated in 3-4 product discussions where your clinical input changed a decision—whether that’s safety rail design, dialog flow changes, or escalation criteria. You’re comfortable speaking up about clinical concerns in technical rooms.
• Health System Connection: You’ve visited 2-3 health systems to observe real patient interactions with our platform. You’ve gathered direct feedback from nurses and patients. You’ve synthesized observations into clear clinical insights for the team.
• Learning in Public: You’ve grown your understanding of LLMs, clinical validation frameworks, and product development. You can explain model capabilities and limitations to other clinicians. You’re asking better questions and connecting clinical problems to technical solutions.
• Quality Mindset: You’ve developed a rigorous approach to clinical testing. You know what “good” looks like. You’ve caught issues before release. You take ownership of clinical accuracy and safety.

Your Core Responsibilities

Clinical Validation & Testing

• Execute clinical evaluation protocols designed by senior team members. Conduct systematic testing of model behavior against high-stakes scenarios (medication questions, symptom assessment, escalation triggers, patient communication).
• Design and run test cases; document findings clearly and identify patterns in model behavior—where it excels and where it struggles.
• Identify safety risks, clinical inaccuracies, and edge cases through hands-on interaction with the model. Flag concerns early and escalate appropriately.
• Maintain detailed testing documentation that helps the team understand model performance and improvement priorities.

Gold Standards Development

• Author and refine test cases, rubrics, and reference answers for clinical scenarios. Work with senior team members to establish what “accurate” and “safe” means in specific contexts.
• Build out the gold standards library systematically—documenting clinical best practices, nursing workflows…