AI Testing Specialist - Hyderabad- 5+yrs!
- Source: Naukri
- SP Staffing
- On-site
- Hyderabad
- Full-Time
- Senior
Job Description
Work Location: Hyderabad
Experience: 5+yrs
Required Skills:
Design and implement model evaluation frameworks using RAGAS, custom scorers, and automated accuracy benchmarking to validate agent outputs against structured specifications and Gherkin acceptance criteria.
Develop adversarial prompt testing suites that probe agent behaviour for hallucinations, prompt injection vulnerabilities, and edge-case failures across the Refinement, Decision, and Coding Agents.
Build and maintain regression test suites that continuously verify agent behaviour consistency across model updates, prompt changes, and skill-file modifications within the LangGraph-based architecture.
Integrate AI-specific test tooling into CI/CD pipelines using GitHub Actions, ensuring every agent deployment is gated by automated quality, fairness, and reliability checks aligned with EU AI Act and DORA requirements.
Thanks & Regards
Suganya R - Team Lead
Skills
- LangGraph
- Github
- github-actions
