AI Test Lead – Automation (Playwright)

AI Test (QA) Lead – Automation (Playwright)

Location: Montvale, NJ

Job Type: Long-Term Contract

Job Summary

STAFFXPERT LLC is seeking an AI Test (QA) Lead – Automation (Playwright) on behalf of our client in Montvale, NJ.

We are seeking a highly experienced Quality Assurance leader with deep expertise in Playwright-based test automation and a strong background supporting AI-driven applications. This role will be responsible for leading end-to-end quality engineering initiatives, building scalable automation frameworks, and ensuring the reliability, performance, and quality of modern intelligent platforms. The ideal candidate combines strong technical testing expertise with leadership capabilities and thrives in a fast-paced Agile environment.

Key Responsibilities

QA Leadership

• Lead end-to-end QA activities for AI and intelligent application initiatives.
• Define, implement, and maintain comprehensive testing strategies and quality frameworks.
• Manage QA deliverables, timelines, risks, and team coordination.
• Serve as the primary point of contact for all quality assurance activities.
• Drive continuous improvement across testing processes and methodologies.

Test Automation

• Design, develop, and maintain robust automation frameworks using Playwright.
• Create and execute automated UI, API, and end-to-end test suites.
• Ensure automation assets are scalable, reusable, maintainable, and aligned with best practices.
• Integrate automated testing into CI/CD pipelines to support continuous delivery.

AI Testing & Validation

• Validate AI, GenAI, and LLM-based applications, APIs, and workflows.
• Test model outputs, prompt responses, and intelligent application behavior.
• Evaluate system reliability, accuracy, security, and performance.
• Collaborate with AI/ML teams to validate model integrations and business outcomes.

Collaboration & Stakeholder Engagement

• Partner with developers, product owners, business stakeholders, and cross-functional teams.
• Participate in Agile ceremonies, including sprint planning, standups, reviews, and retrospectives.
• Provide test execution reports, defect metrics, and quality status updates.
• Mentor QA engineers and promote testing excellence across teams.

Quality Engineering

• Ensure adherence to QA standards, SDLC practices, and Agile methodologies.
• Support user acceptance testing, release validation, and defect management activities.
• Identify opportunities to improve testing efficiency, coverage, and overall product quality.

Required Qualifications

Experience

• 15+ years of overall IT experience.
• 8-12+ years of experience in Software Testing and Quality Assurance.
• 3-5+ years of experience leading QA or Test Engineering teams.
• Proven experience working on large-scale enterprise applications.

Technical Skills

• Strong hands-on experience with Playwright (mandatory).
• Expertise in automation framework development for UI, API, and end-to-end testing.
• Strong proficiency in JavaScript and/or TypeScript .
• Experience integrating automated testing into CI/CD pipelines .
• Experience with API Testing , RESTful services, and related testing tools.
• Exposure to Selenium or other automation technologies is a plus.

AI & Modern Testing

• Experience testing AI, GenAI, or LLM-based applications.
• Understanding of prompt validation and AI workflow testing.
• Experience validating intelligent application behavior, integrations, and outcomes.

Preferred Qualifications

• Experience working within Agile/Scrum delivery environments.
• Strong analytical, troubleshooting, and problem-solving capabilities.
• Excellent communication and stakeholder management skills.
• Experience leading and mentoring distributed QA teams.
• Passion for quality engineering, automation, and continuous improvement.