Generative AI Tester

Job Title: AI Tester

Location: Remote

Job Summary:

We are looking for an AI Tester with strong 7+experience in validating AI/ML models, Generative AI applications, and LLM-based systems.

The candidate will be responsible for ensuring the accuracy, reliability, safety, and performance of AI-powered products through specialized testing techniques including model validation, prompt testing, and bias detection.

Key Responsibilities :

• Test AI/ML models and Generative AI applications for accuracy, reliability, and performance.

• Validate LLM responses to ensure correctness, relevance, and safety.

• Perform prompt testing and prompt validation for AI chatbots and AI assistants.

• Design and execute test cases for AI models, including edge cases and adversarial inputs.

• Evaluate model hallucinations, bias, toxicity, and fairness issues.

• Conduct data validation testing to ensure training and testing datasets are clean and unbiased.

• Collaborate with AI Engineers, Data Scientists, and Product teams to improve model quality.

• Test AI APIs and integrations across applications and platforms.

• Build automated testing frameworks for AI systems.

• Monitor model performance metrics such as accuracy, precision, recall, and F1 score.

• Document test results and provide recommendations for improvements.