Software Engineer – AI Evaluation (South Asia) | $40/hr

South Asian Software Engineers: Coding Tasks for AI Evaluation

Experience: Professional Software Engineering Experience Required

Job Type: Contractor

Location: Remote (South Asia)

Compensation: $40/hour

Payment: Weekly

Required Profiles: LinkedIn profile required to apply

Role Overview

We are looking for experienced software engineers in South Asia to review coding tasks and evaluation environments used to assess AI coding agents. You’ll provide technical feedback on how realistic, challenging, and robust these tasks are, drawing on your experience building or reviewing complex codebases.

Key Responsibilities

• Review proposed coding tasks and programming environments for realism.
• Assess the structure and difficulty of evaluation harnesses.
• Explain approaches to verifying complex coding challenges.
• Suggest improvements to make test suites more robust.

Key Requirements

• Professional software engineering experience and residence in South Asia.
• Experience building or reviewing realistic programming tasks.
• Familiarity with coding evaluation harnesses or test automation.
• Comfortable discussing technical workflows in an interview.
• Availability to work remotely on a flexible schedule.

Preferred Technical Skills

• Backend, test automation, or full-stack engineering.
• Experience working with complex codebases.
• Familiarity with automated testing and evaluation harnesses.

Selection Process:

Step 1 – Short Screener

Step 2 – AI Interview

Step 3 – Paid Work Trial

Step 4 – Project Onboarding