AI Test Automation Engineer

About the Role This role is the automation backbone of the Qira QE team. You will build and maintain test automation frameworks that validate AI-powered features across a large ecosystem of evices spanning Android phones, Windows PCs, and cross-device interaction scenarios. Youre as comfortable writing scalable test code as you are understanding AI system behavior.

• Architect and maintain scalable test automation frameworks for Android, Windows, and API layers.
• Automate functional, regression, latency, battery consumption, and memory testing for AI features.
• Build and maintain AI-powered test generation workflows using tools like Cursor AI.
• Validate cross-device handoff, continuity, and device-intelligence features end-to-end.
• Integrate automation into CI/CD pipelines across multiple device variants and OS versions.
• Develop reusable test utilities for LLM output validation including accuracy and groundedness checks.
• Perform physical device testing in Bangalore and Chicago labs.

Required Skills

• 3+ years of test automation experience; no manual-only profiles considered.
• Strong proficiency in Python, Java, JavaScript, or TypeScript.
• Expertise in Playwright, Selenium, Appium, or API automation frameworks.
• Experience with Android testing (ADB, Android Instrumentation, Appium) or Windows desktop automation.
• Ability to build maintainable frameworks; low maintenance overhead is a key requirement.
• Self-sufficient; able to operate without hand-holding in a fast-moving team.

Nice to Have

• Experience with AI or ML feature testing model output validation, latency testing, performance benchmarking.
• Familiarity with GenAI tools or LLM APIs.
• Device lab experience with physical hardware at scale.
• Knowledge of memory profiling or battery consumption analysis tools on Android/Windows.

Locations

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.