⚠︎ This job is no longer accepting applications.

Be the Candidate They Can't Ignore.

Don't just send a resume; set yourself up so the right work finds you.

  • Look like a pro instantly with a stunning personal brand.

  • Gain instant "Top Ten" status so you aren't just another name in a pile.

  • Wake up to booked meetings instead of "rejection" emails.

Join the Club — Free Forever
Job Closed

AI Engineer

  • Source: LinkedIn
  • The Phoenix Group
  • $145,000 to $175,000 /yr
  • On-site
  • New York City
  • Full-Time
  • Mid level

Job Description

Senior Software Engineer – AI & LLMs

About the Role

We are seeking a Senior Software Engineer – AI & LLMs to design, build, and integrate AI-powered solutions within a sophisticated enterprise technology environment.

The ideal candidate is a strong software engineer with experience building and architecting enterprise applications who has expanded into AI/LLM engineering . This role requires strong Python skills and hands-on experience building production AI applications, agents, and LLM-powered workflows. Experience with C#/.NET and Microsoft-based enterprise applications is strongly preferred .

You will work across existing enterprise applications and new AI initiatives, integrating both externally hosted models and internally hosted LLMs into business-critical systems.

Responsibilities

  • Design, develop, and deploy production-grade AI and LLM-powered applications using Python.
  • Architect AI solutions that integrate with existing enterprise applications, APIs, databases, and business systems .
  • Build AI agents, agentic workflows, and autonomous processes to automate complex business tasks.
  • Design and develop custom MCP servers, tools, and integrations that allow AI systems to securely interact with enterprise applications.
  • Build solutions utilizing OpenAI APIs as well as internally/self-hosted language models.
  • Work with local model inference technologies such as Ollama, vLLM, Hugging Face, LM Studio, or similar platforms .
  • Develop solutions utilizing RAG, embeddings, semantic/vector search, tool calling, prompt engineering, and LLM orchestration .
  • Evaluate and optimize models and AI workflows for performance, reliability, security, and scalability.
  • Develop evaluation and testing strategies for production AI applications.
  • Establish best practices around agent development, MCP, AI tooling, model integration, and AI-assisted software development .
  • Collaborate directly with technical and business stakeholders to translate complex requirements into scalable AI solutions.
  • Evaluate emerging AI models, frameworks, developer tools, and infrastructure.
  • Participate in architecture discussions, code reviews, troubleshooting, and knowledge sharing.

Qualifications

  • 5+ years of professional software engineering, application development, or systems architecture experience.
  • Strong hands-on development experience with Python .
  • Experience with C#/.NET, ASP.NET, or another enterprise application development stack strongly preferred .
  • Hands-on experience building production AI/LLM applications , rather than solely prototypes or proof-of-concept projects.
  • Experience building AI agents, agentic workflows, or autonomous AI systems .
  • Experience with MCP (Model Context Protocol) , including MCP servers, tools, or integrations.
  • Experience working with OpenAI APIs and/or other leading LLM APIs.
  • Experience with self-hosted or locally deployed LLMs using technologies such as Ollama, vLLM, Hugging Face, LiteLLM, or similar.
  • Experience integrating AI into existing enterprise software and business applications .
  • Understanding of RAG, embeddings, vector/semantic search, tool calling, prompt engineering, and AI evaluation .
  • Strong knowledge of software architecture, APIs, databases, authentication, security, testing, and production development practices.
  • Experience with Azure and/or AWS .
  • Strong communication skills and the ability to collaborate with both technical and business stakeholders.

Preferred Qualifications

  • Professional experience with C#/.NET, ASP.NET MVC/Core, SQL Server, and T-SQL .
  • Experience modernizing legacy applications or adding AI capabilities to existing enterprise software .
  • Experience with AI development tools such as Claude Code, Codex, OpenCode, or similar technologies .
  • Experience creating reusable AI Skills, plugins, tools, or internal AI platforms .
  • Experience with Microsoft Entra ID, OAuth, authentication/authorization, and secure service-to-service integrations .
  • Experience with Docker, CI/CD, Azure DevOps, and containerized workloads .
  • Experience with enterprise platforms such as iManage, Salesforce, SharePoint, Aderant, or Workday .
  • Experience within the **legal industry, professional services, or another complex enterpri…

Skills

  • Python
  • c-sharp
  • dot-net
  • vllm1
  • hugging-face
  • asp-net
  • microsoft-azure
  • amazon-web-services
  • claude-code
  • Codex
  • opencode
  • microsoft-entra-id
  • oauth
  • Docker
  • azure-devops
  • Salesforce
  • workday
This job is no longer accepting applications.

You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.

Join the Club — Free Forever
Create Free Account & Apply
  • Free personal website
  • Built-in Talent Agent
  • Apply to future jobs in 1 click
  • Get matched to similar roles
or
Apply as a guest this time

You'll apply successfully, but won't be able to track your application, save this job, or get matched to similar roles.

This listing is a publicly available opportunity curated by Try Club to help talent discover relevant roles. Try Club is an independent platform and is not affiliated with The Phoenix Group

Get Similar Jobs

Browse more similar roles on TRY and find your perfect match.

Show Me Similar Jobs

Stop Searching. Start Thriving.

Why waste time chasing leads when the perfect projects can find you?
With TRY, clients actively searching for professionals with your skills can discover you in seconds. Whether it's a quick gig or your dream role, we connect you with opportunities that matter.

  • Get found faster
  • Let projects come to you
  • Build a career on your terms

Take control of your career today.

Claim Free Website in 2 Minutes