Python Automation Test Engineer - Gen AI

Job Description: QA Engineer (Mid-Level, GenAI Applications)

Experience: 59 years

About the Role

We are seeking a hands-on QA Engineer with solid experience in testing Python-based APIs, React applications, and AWS deployments, combined with exposure to GenAI workflows. This role is critical in ensuring the quality, accuracy, and reliability of a GenAI-powered Assistant

The ideal candidate will have strong API/UI testing skills, automation experience, and a curiosity for validating GenAI features such as prompt outputs, vector database retrievals, and RAG-based responses.

Key Responsibilities

• Functional & API Testing

• Test RESTful APIs (FastAPI) for functionality, performance, and security.
• Validate API integrations with front-end React applications.

• Ensure consistency and correctness of data across services.

• Automation & Frameworks

• Build and maintain automated test scripts using Python (Pytest), Postman/Newman, or similar frameworks.
• Automate UI tests for React applications (Playwright, Cypress, Selenium).

• Integrate automated tests into CI/CD pipelines.

• GenAI-Specific QA

• Test LLM prompts and workflows for correctness, consistency, and reduced hallucinations.
• Validate RAG pipelines (retrieval-augmented generation) and ensure vector database lookups return accurate results.

• Collaborate with engineers to define LLM evaluation criteria (relevance, factual accuracy, completeness).

• Performance & Reliability Testing

• Conduct performance/load testing using tools like JMeter, Locust, or k6.

• Validate application scalability on AWS-hosted environments.

• Collaboration & Agile Practices

• Work closely with squad leads, backend/frontend engineers, and product owners.
• Participate in sprint ceremonies, defect triage, and backlog grooming.
• Provide clear defect reports and root cause analysis.

Required Skills & Experience

• 5–9 years of QA/testing experience with enterprise applications.

• Strong hands-on skills in:

• API testing (Postman, REST Assured, Swagger).
• UI testing (Cypress, Playwright, Selenium).

• Automation frameworks in Python (Pytest).

• Familiarity with databases (SQL/NoSQL) for data validation.
• Exposure to AWS-hosted applications and CI/CD testing workflows.
• Experience in performance/load testing.