AI Testing Architect

AI Testing Architect - QA & Automation

Experience: 10+ Years

Location: Hyderabad Work Mode: WFO

About the Role

We are looking for an experienced AI Testing Architect to provide technical leadership across multiple QA teams and projects. The role involves reviewing and evaluating QA deliverables, guiding teams on the right testing and automation approaches, solving complex technical challenges, and ensuring the overall quality of deliverables meets client expectations.

The ideal candidate should have strong experience in Manual & Automation Testing, Test Architecture, and emerging AI-powered testing, AI agents, and LLM-based application testing.

Key Responsibilities

• Provide technical leadership and guidance to multiple QA teams and projects.

• Review test strategies, test cases, automation scripts, frameworks, and QA deliverables.

• Evaluate team work, identify gaps, and provide practical technical solutions.

• Ensure testing approaches and deliverables meet project and client expectations.

• Define and improve testing strategies for Web, Mobile, API, and Integration applications.

• Guide teams on automation framework design, tools, best practices, and scalability.

• Drive adoption of AI-powered testing, AI agents, and intelligent automation.

• Guide teams in testing and evaluating LLM-based applications and AI agents.

• Evaluate AI-generated test cases and AI agent outputs for quality, accuracy, reliability, and coverage.

• Mentor QA engineers and leads and help improve their technical capabilities.

• Evaluate new testing and AI technologies and recommend suitable solutions.

• Work with clients, development teams, and project stakeholders on technical and quality-related discussions.

Must-Have Skills

• 10+ years of experience in Software Testing / QA.

• Strong expertise in Manual & Automation Testing.

• Experience in QA Technical Leadership / Test Architecture.

• Proven experience leading or guiding multiple QA teams/projects.

• Strong knowledge of Playwright, Selenium, Cypress, Appium, or equivalent tools.

• Good programming/scripting knowledge in Java, Python, JavaScript, or TypeScript.

• Strong experience in Web, API, Mobile, Integration, and End-to-End Testing.

• Good understanding of CI/CD, Git, Jenkins, GitHub Actions, or equivalent.

• Strong understanding of AI/GenAI concepts and AI-powered software testing.

• Practical knowledge of AI Agents / Agentic AI and testing AI-based applications.

• Strong analytical, problem-solving, communication, and client-handling skills.

Good to Have

• Experience with Playwright + MCP or similar AI-assisted testing approaches.

• Experience with AI test case generation and AI evaluation.

• Experience testing LLM, RAG, chatbot, or AI agent-based applications.

• Experience evaluating and implementing emerging AI testing tools and frameworks.

What We Expect

Someone who can review, challenge, guide, and improve the work of QA teams, identify the right technical approach for a problem, and ensure that the final deliverable is of high quality and aligned with client expectations.