Senior Gen AI Architect

New York City, New York 07008 Posted August 27th, 2026

Job Type: Full Time

Job Category: IT

Job Description

Role: Senior Gen AI Architect
Location :NYC / NJC – Hybrid

FTE

Job Description

We are looking for a Senior Gen AI Architect with strong expertise in Data Engineering, Analytics, Generative AI, and Agentic AI workflows. The candidate will design and build scalable AI-driven solutions that leverage enterprise data, LLMs, RAG, and agent-based architectures.

Key Responsibilities:

• Design and develop Gen AI and Agentic AI applications using Python and modern AI frameworks.

• Build scalable data pipelines, data processing, and analytics solutions.

• Develop LLM/RAG-based applications integrating enterprise data sources.

• Design and implement agentic workflows, AI agents, orchestration, and tool integrations.

• Work with structured and unstructured data to support AI and analytics use cases.

• Integrate LLMs with APIs, databases, knowledge sources, and enterprise platforms.

• Implement evaluation, monitoring, security, and governance for Gen AI solutions.

• Collaborate with Data Engineers, Data Scientists, Architects, and business stakeholders.

• Drive solutions from POC/prototype through production deployment.

Must-Have Skills

• 15+ years of software/data engineering experience

• Strong Python

• Generative AI / LLM / RAG

• Agentic AI / AI Agents / Agent Orchestration

• Strong Data Engineering & Analytics

• SQL and modern data platforms

• Experience with APIs, microservices, and cloud platforms

• Experience with LLM frameworks such as Lang Chain, Lang Graph, or similar

• Strong understanding of AI architecture, data architecture, and enterprise integration

• Excellent communication and stakeholder management skills

Required Skills

Performance Architect