Senior QA Engineer – AI & Health Tech (Startup)

Senior QA Engineer – AI & Health Tech (Startup)

Overview

We are seeking a Senior

QA Engineer to help build and scale quality across a fast-moving healthcare startup. This role leads testing for patient-facing web experiences, backend APIs, and AI-powered features that support clinicians and operations.

The ideal candidate combines strong UI/front-end and API testing skills with experience validating AI- or LLM-driven workflows. You will partner closely with engineering, product, design, and clinical stakeholders to ensure every release is reliable, safe, and ready for real-world healthcare use.

Key Responsibilities

• Own end-to-end quality strategy for core product areas, including frontend, backend services, integrations, and AI-enabled workflows.
• Design, execute, and continuously improve manual and automated testing for web UI, APIs, and regression suites.
• Validate AI-powered features, including prompt behavior, workflow reliability, output consistency, and edge-case handling.
• Collaborate with product and engineering to define clear acceptance criteria and embed quality into sprint planning and backlog refinement.
• Investigate defects across the stack, document risk and impact clearly, and drive issues to resolution.
• Support pilot launches and production monitoring, including smoke checks, user-flow validation, and incident triage.
• Help evolve QA processes, tooling, and standards that balance startup speed with healthcare-grade reliability.

Required Qualifications

• 5+ years of experience in software QA, test engineering, or quality automation roles.
• Strong hands-on experience testing modern web applications, including UI/front-end workflows and end-to-end scenarios.
• Solid API testing skills (REST or GraphQL), including functional, integration, and negative testing.
• Practical experience building and maintaining automated tests in Python, JavaScript, Java, or a similar language.
• Experience working in Agile product teams and contributing to release quality in fast-paced environments.
• Strong debugging and analytical skills, with the ability to trace issues across logs, APIs, and UI.
• Clear written and verbal communication, including well-structured defect reports and risk summaries.

Preferred Qualifications

• Experience testing AI/LLM features, conversational systems, or AI-assisted workflows (for example prompt evaluation, response grading, or RAG-style flows).
• Experience in healthcare, digital health, telehealth, or other regulated environments.
• Familiarity with HIPAA, PHI handling, and data sensitivity considerations in testing.
• Experience with CI/CD pipelines, cloud environments, and microservices-based architectures.
• Prior experience in an early-stage or growth-stage startup, with comfort operating in ambiguity.
• Build and maintain scalable automation for UI and API layers using modern tools (for example Playwright, Cypress, Selenium, Postman, or similar).

What Success Looks Like

• High confidence in release quality across UI, API, and AI layers.
• Stable and maintainable test automation that fits into the team’s delivery pipeline.
• Early, proactive identification of quality risks that informs product and technical decisions.
• Smooth pilot and production rollouts with minimal critical issues impacting patients or clinicians.