Role Value Proposition

MetLife is offering an exciting opportunity to contribute to our digital and AI transformation journey. We are seeking experienced SDET’s who can also operate as AI Engineers to drive the transformation that will enable business results.

The AI Engineer (Test Engineering) has the responsibility of delivering high-quality software in an Agile environment. This includes the adoption of test automation within the Agile sprint, and the leverage of Gen-AI toolset to achieve high velocity of releases without compromising delivery quality. In this role, the SDET also operates as an AI Engineer – using GitHub Copilot and Copilot Agent Mode on our GitHub Enterprise platform, together with the Microsoft AI Foundry stack, to build AI agents that automate testing, and to design and run AI evaluations (AI evals) that measure the performance and reliability of those agents.

Key Responsibilities:

• Design, build and scale testing capabilities using AI agents – using GitHub Copilot Agent Mode on the GitHub Enterprise platform and the Microsoft AI Foundry stack – to automate testing tasks such as test case generation, test data creation, defect triage, and regression analysis.

• Develop and run AI evaluation (AI eval) frameworks and metrics to measure the accuracy, reliability, and performance of AI agents and Gen-AI-assisted testing workflows and iterate on prompts and agent design based on eval results.

• Write efficient test automation code using coding standards and best practices.

• Validate application functionality through the implementation of test strategies, automation frameworks, tools, and dashboard

• Participate in planning and documentation of test strategies and acceptance criteria based on customer needs.

• Participate in test execution (automated and manual) (new builds and regression), analyze the reports, troubleshoot & investigate the failure.

• Maintain automation scripts and perform peer reviews of the automation codebase.

• Analyze and repair broken test cases and failures.

• Investigate, diagnose, and repair complex problems, test, and manage bug reports.

• Adoption of the Agile ways of working in the software delivery lifecycle.

Candidate Qualifications:

Education:

• Bachelor in Computer Science or Equivalent

Experience

• At least 3+ years in automation testing preferably using AI in high tech and/or highly regulated industries

• Hands-on experience with AI-assisted engineering tools such as GitHub Copilot (including Agent Mode) on GitHub Enterprise, and the Microsoft AI Foundry stack, including building AI agents and running AI evaluations to validate agent performance.

• Developing and implementing automation testing practices using modern technology stack and patterns.

• Strong scripting and programming skills in languages such as Java, Python, Bash, or PowerShell.

• AI Engineering: Ability to design agent instructions/prompts, build and orchestrate AI agents (e.g. via GitHub Copilot Agent Mode and the Microsoft AI Foundry stack), and apply AI evaluation techniques to validate agent accuracy and performance within the test lifecycle

• Hands-on in test automation using scripting and programming skills

• Exposure to Behavior Driven Development (BDD)

• Continuous learning mindset, ability to acquire new skills and competencies independently and proactively

Tech Stack

Development & Delivery Methods:

Agile (Scaled Agile Framework)

Mobile:

Appium

Automated TestingFramework + UI:

Selenium, TOSCA, BDD-Cucumber, Playwright

UI: Java, JavaScript, Python, GitHub, DS-Algo

API:

RestAssured, Postman,KarateDSL

Cloud Platform:

Azure DevOps - Test Plan, Perfecto, SauceLabs, BrowserStack

Performance Testing:

Jmeter, Blazemeter

AI Engineering / GenAI Tools:

GitHub Enterprise – GitHub Copilot, Copilot Agent Mode

Microsoft AI Foundry Stack:

AI Foundry, Prompt Engineering, AI Agent Evaluation (AI Evals)

LI-WRAPJOB

About MetLife

Recognized on Fortune magazine’s list of the “World’s Most Admired Companies” and Fortune World’s 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and th…