AI Testing
- Source: Naukri
- Hexaware Technologies
- $4,133.09 to $6,199.63 /yr
- On-site
- Chennai
- Full-Time
- Mid level
Job Description
- Strong understanding of RAG & agentic system architecture
- Ability to develop AI Assurance test strategy to assess AI systems for quality, safety, reliability and responsible AI behavior
- Design AI evaluation strategy for LLMs, RAG and agent evaluation across functional and non-functional dimensions
- Experience in Golden dataset curation & Synthetic dataset generation
- Experience in implementing AI evaluation frameworks like Ragas, DeepEval, etc.
- Experience in using AI Evaluation tools like LangSmith, Arize, Langfuse, Galileo, Evidently, etc.
- Experience in instrumentation to establish AI Observability / tracing using OTEL libraries
- Experience in Integrating AI evaluation into CI/CD pipeline
- Experience in Responsible AI validation
- Knowledge of regulatory considerations for AI systems
Skills
- galileo
