QA Automation Engineer (MLOps/ AI)

Job description

We are looking for a driven Senior AI/CV QA Automation Engineer to take ownership of our automated evaluation and testing framework for our core Video Analytics Engine. In this role, you will design automated evaluation infrastructure, benchmark Computer Vision model performance, and optimize end-to-end testing execution time down to 3–4 minutes per cycle. You will collaborate closely with R&D, Platform, and System Architecture teams to ensure high stability and continuous release quality.

Key Responsibilities

• Infrastructure & Optimization: Build, maintain, and optimize automated evaluation pipelines for AI/CV models and core video analytics libraries to achieve rapid, end-to-end test execution times (target: 3–4 minutes).
• Automation & CI/CD Integration: Develop Python automation test suites and integrate evaluation workflows directly into CI/CD pipelines for automated testing on Pull Requests (PRs).
• Metrics & Analytics: Measure and report model accuracy metrics (mAP, Precision, Recall, IoU) and system performance metrics (FPS, Latency, CPU/GPU/Memory utilization).
• Dataset Management: Manage, curate, and maintain golden datasets and annotation standards for regression, performance, and stress testing.
• Cross-functional Collaboration: Work with Core C++ and Architecture teams to identify pipeline bottlenecks, isolate root causes, and drive continuous release pipeline improvements.

Your skills and experience

• Bachelor Degree in Software Engineering, Computer Science, or any relevant field
• 3+ years of experience in QA Automation, MLOps, Software Engineer in Test (SET), or AI/CV Evaluation.
• Strong proficiency in Python for test framework development and data processing.
• Hands-on experience with Docker containerization and CI/CD tools (Jenkins, GitLab CI, GitHub Actions).
• Solid understanding of Machine Learning and Computer Vision evaluation metrics.
• Proficient in Linux environments and Bash/Shell scripting.
• Strong problem-solving skills with a focus on performance and execution speed.

Nice to Have

• Ability to read and understand basic C/C++ code.
• Familiarity with video streaming concepts and processing frameworks (e.g., GStreamer).
• Prior experience with Edge AI, Smart Cameras, or Embedded Vision systems.

Why you’ll love working here

• Compensation & bonus: 13th & 14th salary, AIP bonus, Holidays, Tet, and Long year service …
• Social insurance, Health insurance, Unemployment insurance: by Social Insurance and Labor Law
• The regime of annual leave, company trip, and checkup examination
• Award for marriage, newborn
• We have AON insurance package for employee, spouse, and children every year
• You will be trained, learned & work with the best technical managers who help you improve various dev skills & career path
• You’ll love working in our dynamic environment employees, young & active
• We love sport activities, as marathon, football, swimming,…
• Working time: From Monday to Friday 08:30-12:00 & 13:00-17.30