AI Engineer – Agentic AI / LLM

Position Title AI Engineer – Agentic AI / LLM Location New York City, NY Work Arrangement 3 days onsite per week

Employment Type: Full-Time

Work Hours: Must be able to overlap with EST

Experience: Flexible; candidates with strong relevant AI experience will be considered.

About the Role:

We are looking for an AI Engineer to design, develop, and deploy production-grade AI, LLM, and agentic AI solutions for enterprise clients.

The ideal candidate has strong hands-on experience with Python, LLMs, RAG, AI agents, MCP, tool calling, embeddings, vector databases, and cloud-based AI applications.

This is an engineering-focused role. We are looking for candidates who have built and deployed real-world AI systems rather than candidates whose experience is limited to prompt engineering, research, or basic LLM API integrations.

Key Responsibilities:

Design, build, and deploy AI and agentic AI applications using LLMs and modern AI frameworks.

Develop AI agents capable of reasoning, tool calling, retrieval, and secure interaction with enterprise systems.

Build production-grade RAG pipelines, including chunking, embeddings, retrieval, reranking, and response validation.

Develop backend services and APIs supporting AI/LLM applications.

Integrate LLMs with enterprise tools and systems using MCP and tool/function calling.

Build and maintain AI data pipelines and supporting services.

Implement guardrails, validation, fallback mechanisms, and reliability patterns for production AI systems.

Develop evaluation and testing frameworks to measure LLM/agent performance and detect regressions.

Implement observability and tracing for AI applications.

Optimize AI applications for latency, scalability, token usage, and cost.

Deploy and operate AI applications in AWS or other major cloud environments.

Collaborate with product, engineering, data science, and business teams to translate requirements into production AI solutions.

Required Technical Skills:

Python / Software Engineering:

Hands-on Python development

Strong understanding of software engineering fundamentals

Experience developing APIs, microservices, and backend systems

Knowledge of system design and distributed systems

AI / Machine Learning / GenAI:

Strong AI/ML/Generative AI background

Strong hands-on experience with LLMs

Experience taking AI solutions from development/POC through production

Experience building AI-powered applications and services

Agentic AI:

Experience building AI agents / agentic systems

Production experience with one or more agent frameworks such as:

LangGraph

Google ADK

CrewAI

Claude Agent SDK

Equivalent frameworks

MCP / Tool Calling

Experience with MCP (Model Context Protocol)

Experience building MCP servers or tool interfaces

Hands-on experience with tool calling / function calling

RAG / Vector Search:

Strong understanding of RAG architecture

Experience with:

Chunking strategies

Embeddings

Vector and hybrid search

Retrieval

Reranking

Response validation

Experience with vector databases such as:

Pinecone

Milvus

Weaviate

FAISS

Equivalent cloud vector databases

LLM Evaluation & Observability:

Experience with LLM evaluation and testing

Regression testing for AI/LLM systems

Experience with AI observability/tracing tools such as:

LangSmith

Langfuse

Equivalent platforms

Understanding of AI guardrails and reliability patterns

Cloud / DevOps:

Hands-on experience with AWS preferred

Experience with services such as:

EKS / ECS

Lambda

S3

DynamoDB

Redshift

Step Functions

Amazon Bedrock

Experience with CI/CD

Terraform or CloudFormation experience preferred

AI Performance Optimization

Experience with some of the following is highly desirable:

Token optimization

Context-window management

Context shaping, pruning, and compaction

Model routing

Caching

Batching

Streaming

Parallel tool calls

Latency and cost optimization

Preferred Qualifications:

Experience with Amazon Bedrock, Azure AI, or Google Vertex AI

Experience building enterprise AI platforms

Experience working with regulated or enterprise environments

Experience with production-scale distributed systems

Strong communication and problem-solving skills

Ability to work directly with technical and business stakeholders

What We’re Looking For

**We are parti…