AI Software Engineering Expert (Python)

Hello,

Greetings from ZettaMine Labs Pvt Ltd!!

We are looking for AI Software Engineering Experts (Python) for PAN India.

Job Role:

AI Software Engineering Expert (Python)

Location: PAN India (Remote)

Notice Period:NA (As it is for Gig Workers)

Experience: 5+ Years

Relevant Experience:

Minimum 5 years of experience in Python Software Development with expertise in the below skills:

• Python Programming
• Backend Development
• REST APIs
• Object-Oriented Programming (OOP)
• Algorithms & Data Structures
• Software Architecture
• Debugging & Troubleshooting
• Code Reviews
• Unit & Integration Testing
• Git Version Control
• Performance Optimization
• Distributed Systems
• Docker
• CI/CD Pipelines

Mandatory Qualifications

• Bachelor’s or Master’s Degree in Computer Science, Information Technology, Software Engineering, or related discipline.
• Minimum 5 years of professional software development experience.
• Strong hands-on experience in Python.
• Excellent debugging and problem-solving skills.
• Strong understanding of Software Engineering principles.
• Experience with Git and collaborative development workflows.
• Knowledge of testing methodologies including Unit Testing and Integration Testing.
• Excellent written communication and technical documentation skills.

Job Description

As an AI Software Engineering Expert (Python), you will contribute to building the next generation of Artificial Intelligence systems by creating, validating, and evaluating real-world software engineering tasks used to train and benchmark Large Language Models (LLMs).

You will collaborate on challenging engineering problems inspired by production environments while helping improve AI reasoning, code quality, debugging capabilities, and software engineering benchmarks.

Key Responsibilities

Software Engineering Task Creation

• Create production-level software engineering tasks for AI model evaluation.
• Design realistic coding and debugging scenarios.
• Develop reference implementations and benchmark solutions.

Code Review & Technical Evaluation

• Review AI-generated code for correctness, efficiency, maintainability, and security.
• Evaluate multiple implementation approaches.
• Identify logical flaws, edge cases, and performance bottlenecks.
• Provide structured technical reasoning and feedback.

Debugging & Quality Engineering

• Reproduce and troubleshoot complex software defects.
• Validate unit tests and integration tests.
• Ensure benchmark quality and consistency.
• Review software architecture and engineering best practices.

Engineering Excellence

• Optimize application performance.
• Follow Git-based development workflows.
• Maintain high technical accuracy and documentation quality.
• Collaborate with AI benchmarking teams on continuous improvements.

Preferred Skills

Experience in one or more of the following will be an added advantage:

• Docker
• Kubernetes
• Microservices
• Cloud-native Development
• CI/CD Pipelines
• Open Source Contributions
• Software Architecture
• Performance Engineering
• Security Best Practices
• Technical Mentoring

Preferred AI Experience

Candidates having experience in any of the following will be preferred:

• SWE-Bench
• AI Coding Evaluation
• RLHF (Reinforcement Learning from Human Feedback)
• LLM Evaluation
• AI Model Training
• HumanEval
• CodeContests
• AI Code Review

Note: Prior AI benchmarking experience is not mandatory. Strong software engineering and debugging skills are the primary requirement.

Please provide the following details along with your updated profile to [email protected]

• Primary Skill
• Total Experience
• Relevant Experience
• Current Location
• Highest Qualification
• Current Company
• Current CTC
• Expected CTC
• Notice Period
• GitHub Profile (if available)
• LinkedIn Profile (if available)
• AI/LLM Evaluation Experience (if any)

I will be reaching out to you over a call or email as soon as possible.

Thanks & Regards,
HR Team
ZettaMine Labs Pvt Ltd