AI Project - QA Automation Engineer

Job Description QA Engineer – AI-Driven Systems

Location: Parsippany, NJ (Remote)

Software

Overview We are seeking a highly skilled QA Engineer with 3-5 years of experience and expertise in AI-driven systems to support our AI initiative. The role involves validating AI-powered customer interactions and ensuring high-quality, scalable, and reliable system behavior across multiple channels.

Key Responsibilities

• Execute standard QA testing cycles including Functional, Regression, and Synthetic testing.
• Validate AI-driven customer interactions across chat, voice, and email channels.
• Perform integration testing with backend systems (APIs, case management, data services).
• Test agent handoff and escalation workflows to ensure seamless transitions.
• Ensure consistency of customer experience across multiple communication channels.
• Conduct User Experience (UX) testing for clarity, usability, and interaction quality.
• Perform Data Quality testing to validate accuracy and completeness of data used by AI systems.
• Develop and maintain QA automation frameworks and test suites.
• Design and implement AI-driven test suites to validate model accuracy, response quality, consistency, and overall system behavior.
• Build and maintain API test automation.
• Develop conversation simulation tests for AI interaction validation.
• Maintain and enhance regression automation suites.
• Integrate QA automation into CI/CD pipelines to enable continuous testing.

Required Skills & Expertise

• Strong experience in QA methodologies and automation frameworks.
• Hands-on experience testing AI/LLM-based applications.
• Experience with API testing and automation tools (e.g., pytest, Postman, REST frameworks).
• Understanding of multi-channel communication systems (chat, voice, email).
• Experience with CI/CD tools and pipeline integration.
• Strong analytical and problem-solving skills.

Work Type: Remote