QA Engineer: AI-Assisted Testing

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a QA Engineer: AI-Assisted Testing based in United States.

The QA Engineer will play a central role in protecting the quality and reliability of a technology platform that processes critical legal documents and workflows. This is a hands-on testing position focused primarily on exploratory, functional, regression, integration, and security testing across complex SaaS systems. You will use AI as a testing co-pilot to identify risks, generate test scenarios, investigate issues, analyze logs, and improve test coverage. The role spans user interfaces, APIs, databases, external integrations, document-processing pipelines, and AI-powered features. You will have meaningful influence over how software is tested and shipped in a fast-moving, AI-assisted engineering environment. There is also room to introduce targeted automation where it can provide meaningful value on high-risk or frequently repeated workflows.

Accountabilities:

• Use AI-assisted workflows to analyze tickets, merge requests, code changes, and acceptance criteria; identify risks and edge cases; and develop focused test charters and checklists.
• Perform risk-based exploratory, functional, regression, and integration testing across web dashboards, administrative tools, email notifications, document workflows, and external integrations.
• Validate end-to-end document retrieval, parsing, categorization, storage, and delivery across external portals, authentication flows, and third-party platforms.
• Investigate backend and platform functionality using API calls, SQL queries, logs, dashboards, and monitoring tools such as Grafana/Loki and Sentry.
• Generate realistic test data, sample documents, email scenarios, and edge cases with AI tools and use simulators and test environments to reproduce difficult production scenarios.
• Evaluate AI-powered document categorization and LLM-facing functionality for accuracy, consistency, robustness, and unexpected behavior, including testing unusual or adversarial inputs.
• Test authentication, SSO, OAuth, user roles, permissions, sessions, and data isolation to help ensure secure access and protect information between customers.
• Investigate customer-reported and production issues, reproduce defects consistently, identify likely root causes, and create clear, actionable bug reports.
• Build or maintain targeted automated checks when appropriate, using tools such as Playwright or API testing frameworks, with AI assisting development while carefully reviewing generated code.
• Collaborate with engineers and product managers during sprint planning, backlog refinement, and retrospectives, helping establish testable acceptance criteria and identifying quality risks early.
• Continuously improve testing strategies, documentation, test coverage, and quality processes within an AI-assisted development environment.
• Apply careful data-handling practices when using AI tools, ensuring customer and sensitive data is never submitted to unauthorized services.

Requirements

• 3–7 years of professional software QA experience, particularly testing web or SaaS applications and complex, data-intensive systems.
• Strong hands-on experience with exploratory and manual testing, including functional, regression, integration, and risk-based testing approaches.
• Demonstrated ability to use AI assistants such as Claude, Claude Code, Cursor, ChatGPT, or comparable tools to generate test ideas, create test data, write queries, analyze logs and code changes, investigate defects, and produce test documentation.
• Strong AI judgment, including the ability to provide effective context and prompts, verify AI-generated results, recognize incorrect or unreliable outputs, and retain independent ownership of testing decisions.
• Experience testing AI or LLM-based features, including classification accuracy, hallucinations, prompt injection, consistency, and evaluation using representative sample sets and repeated testing.
• Experience writing or maintaining automated tests using tools such as Playwright, Selenium, API test frameworks, or similar technologies, including reviewing and correcting AI-generated test code.
• Strong SQL skills, preferably with PostgreSQL, for data validation, troubleshooting, and investigation.
• Experience testing APIs directly using tools such as Postman, curl, Bruno, or equivalent, wi…