Automation Test Engineer - AI Chatbot testing

QA Test Automation engineer
Location: Hyderabad, Chennai, Bangalore, Pune, Mumbai or Coimbatore
Work Time: 2PM to 11PM
Work Mode: Hybrid
Qualification: Bachelor’s degree in Computer Science, Information Technology, Quality Assurance, or related field

Job description:

• Strong proficiency in test automation frameworks and programmings languages (Python, JavaScript/TypeScript);
• Experience testing RESTful APIs, webhooks, and integration layers across enterprise systems;
• Familiarity with Agentic AI platforms and conversational AI testing methodologies;
• Understanding of MCP server validation, A2A orchestration testing, and AI agent behavior verification;
• Knowledge of NLU/intent testing: precision, recall, F1 scoring, utterance coverage, and entity extraction validation;
• Experience with CI/CDintegrated test pipelines (GitHub Actions, Azure DevOps Pipelines, Jenkins);
• Proficiency with defect tracking and test management tools (Jira, Azure DevOps, TestRail, or similar);
• Understanding of performance/load testing tools (JMeter, k6, Locust) for AI platform scalability validation;
• Familiarity with ServiceNow, Workday, and identity management system testing;
• Understanding of data privacy, security testing, and compliance validation in AIdriven workflows;
• Strong analytical, documentation, and crossfunctional communication skills.

Skills

• Experience in QA engineering, test automation, or software quality assurance;
• Experience testing conversational AI / chatbot / virtual assistant platforms (Leena AI, Moveworks, or similar) preferred;
• Handson experience with API testing tools (Postman, Newman, RESTassured) and test automation frameworks (Selenium, pytest, Cypress, or similar);
• Familiarity with Agentic AI concepts, LLM output validation, and nondeterministic testing strategies is a plus;