QA Engineer, AI Automation

About The Company Twin Health is a pioneering digital health company dedicated to transforming the management and prevention of chronic metabolic diseases such as type 2 diabetes and obesity. By leveraging innovative AI Digital Twin technology, Twin Health creates personalized metabolic models for each individual, utilizing data from continuous glucose monitors (CGMs), smartwatches, meal logs, and other health metrics. This approach enables tailored treatment plans that empower members to achieve significant health improvements, including lowering A1C levels below diabetic ranges, attaining sustainable weight loss, and reducing or eliminating medications. Recognized for its innovation and positive workplace culture, Twin Health has received numerous accolades, including Innovator of the Year by the Employer Health Innovation Roundtable, inclusion in CB Insights’ Digital Health 150, and being named one of Newsweek’s Top Most Loved Workplaces. With substantial funding from leading venture firms like ICONIQ Growth, Sequoia, Sofina, Temasek, and Peak XV, Twin Health is rapidly scaling its impact across the United States and globally, aiming to set a new standard of care in metabolic health.

About The Role We are seeking an experienced AI Automation QA Engineer to join our dynamic team. The ideal candidate will possess extensive manual testing skills combined with expertise in AI-driven test automation. This role involves developing comprehensive regression test coverage for complex web and mobile applications, ensuring the highest quality standards in a fast-paced enterprise or startup environment. The successful candidate will work closely with stakeholders to derive detailed test plans, design and implement AI-enhanced automated testing strategies, and contribute to evaluating and validating internally developed models. Additionally, this role involves automating data generation for testing scenarios, collaborating with developers, product managers, and UX designers to deliver an exceptional user experience, and continuously evolving testing infrastructure to leverage agentic AI capabilities for rapid test generation and healing. The position offers a unique opportunity to be part of a cutting-edge health technology company committed to innovation and impactful solutions in metabolic health.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field
• Minimum of 3 years of experience in QA engineering with a focus on test automation
• Proven experience testing web UIs and mobile applications (iOS, Android, Flutter)
• Strong programming skills in Java, Python, or JavaScript
• Hands-on experience with automation tools such as Playwright, Maestro, Appium, or Selenium
• Solid understanding of SQL databases and experience with test data generation
• Experience testing REST API backends for high-scale consumer applications
• Familiarity with automated performance testing tools like jMeter or Locust
• Experience developing AI-driven regression automation using models like Claude or similar
• Excellent verbal and written communication skills
• Strong analytical and critical thinking abilities
• Experience building and maintaining evaluation frameworks for internal models is a plus
• Knowledge of healthcare, biosensors, or conversational agent validation is a plus

Responsibilities

• Collaborate with stakeholders to derive comprehensive end-to-end regression test cases and test plans covering critical application functionalities
• Design, implement, and maintain robust AI-driven automated regression test suites for web and mobile applications
• Contribute to the evaluation and validation of internally developed models, ensuring accuracy and reliability
• Develop AI-enabled automated testing strategies, including rapid prompt-driven test generation and test healing techniques
• Design and develop automated data generation processes to support testing scenarios
• Work closely with developers, product managers, and UX designers to ensure seamless delivery of a high-quality user experience across the integrated application ecosystem
• Continuously improve testing infrastructure by integrating new AI tools and methodologies
• Participate in troubleshooting, debugging, and resolving automation issues
• Document testing processes, results, and improvements for ongoing quality assurance
• Perform other duties as assigned to support project goals and team success

**…