AI Tools & Reliability Engineer--Remote Job

This is a Fully Remote Job

About Our Client:

The organization operates within the AI and machine learning industry, focusing on deploying and maintaining AI applications that require reliable performance and scalability. It addresses challenges related to the health, efficiency, and cost management of AI/ML systems at scale.

About the Opportunity:

The AI TOOLS & RELIABILITY ENGINEER role is designed to ensure the stability, performance, and cost-effectiveness of AI and machine learning applications. This position plays a critical role in monitoring, troubleshooting, and optimizing AI tools and cloud infrastructure, directly impacting the quality and reliability of AI services provided by the organization.

Responsibilities:

• Monitor health, performance, and reliability of AI/ML applications
• Use AI tools including LangSmith, PromptFlow, and OpenTelemetry
• Establish and maintain monitoring, logging, and alerting systems
• Track AI model metrics such as performance, response time, errors, and availability
• Monitor token usage and AI/API costs
• Troubleshoot AI application and cloud environment issues
• Create dashboards and reports for AI performance and reliability
• Support AI evaluations to assess response quality and accuracy
• Work with cloud monitoring tools like AWS CloudWatch and Azure Monitor
• Collaborate with AI/ML engineers, DevOps, and cloud teams

Requirements:

• Experience with monitoring and reliability of AI/ML applications
• Proficiency in AI tools such as LangSmith, PromptFlow, and OpenTelemetry
• Familiarity with cloud monitoring tools including AWS CloudWatch and Azure Monitor
• Ability to analyze performance metrics and troubleshoot issues
• Experience working in collaborative engineering and cloud teams

Pay Range and Compensation Package:

• The pay range and compensation package for this role will be determined based on the candidate’s experience, skills, and other relevant factors.

Benefits & Perks:

• 401(k)
• 401(k) matching
• Bonus based on performance

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

TalentHop is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.