Software Engineer AI (Remote)

• Role Software Engineer AI (Remote)
• Location Remote (Work from Anywhere)
• Job Type Full-Time
• Payout Competitive, based on experience

Role Overview:

We are hiring for one of our clients, seeking a Software Engineer – AI Code Evaluation & Benchmarking (US candidates only) to work on a full-time basis. The role focuses on assessing AI‑generated code, validating solutions against real‑world software engineering tasks, and contributing to high‑quality evaluation datasets and benchmarks. Your work will directly influence the measurement and improvement of advanced AI coding systems.

Key Responsibilities:

• Review AI‑generated code for correctness, efficiency, maintainability, and compliance with specified requirements.

• Analyze software engineering tasks and verify that proposed solutions achieve expected outcomes.

• Debug code, reproduce issues, and confirm fixes across multiple programming environments.

• Evaluate model‑generated explanations and reasoning for technical accuracy and relevance.

• Create, refine, and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks.

• Identify edge cases, failure modes, and recurring weaknesses where AI systems struggle with software problems.

• Document findings clearly and provide structured feedback to improve evaluation quality and consistency.

• Collaborate with project teams to define quality standards and evaluation methodologies.

Required Skills & Qualifications:

• Bachelor’s or master’s degree in computer science, software engineering, or a related technical field.

• Minimum three years of professional software engineering experience.

• Strong proficiency in at least one language such as Python, Java, C/C++, Go, Swift, Objective‑C, PHP, or SQL.

• Deep understanding of data structures, algorithms, software design principles, and debugging methodologies.

• Experience performing code reviews and assessing code quality in complex technical scenarios.

• Ability to design and maintain evaluation datasets and benchmarks for AI‑driven coding tasks.

• Excellent written communication skills for documenting findings and providing actionable feedback.

More About the Opportunity:

This role offers a unique opportunity to work with a global leader in the AI industry, contributing to the advancement of large language models’ coding capabilities. The position supports the creation of reliable evaluation frameworks that shape future AI development.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.

Apply Now!