Senior AI Engineer

Senior AI Software Engineer, Applied AI & Product

Compensation: $230,000–$300,000 cash compensation

Location: Hybrid New York City

Employment Type: Full-time

A leading investment platform is building a new AI and Product function to bring practical, high-impact AI solutions into the firm and across its broader portfolio.

We’re partnering with a highly respected private investment firm that works with exceptional management teams to build market-leading companies. With a long track record of scaling businesses and creating value, the firm is now investing in a new AI capability designed to improve decision-making, increase productivity, and unlock opportunities across multiple companies and teams.

This is a rare opportunity to join early and help shape how AI is applied inside a high-caliber investment environment. As a Senior AI Engineer, you’ll work closely with the Head of AI/ML, product leaders, investment professionals, business stakeholders, data teams, and technology leaders to identify high-value use cases and turn them into working products.

You’ll be building internal tools, intelligent workflows, search and retrieval systems, and AI-powered applications that help teams operate more effectively. This is a hands-on role for a strong software engineer who enjoys moving quickly, learning new domains, and solving real business problems with modern AI systems.

What You’ll Do

• Design, build, and deploy AI-powered applications and workflows that improve productivity, decision-making, and operational efficiency.
• Partner with AI, Product, and business stakeholders to identify, prioritize, and deliver high-impact AI initiatives.
• Build full-stack solutions, including backend services, APIs, data pipelines, integrations, and user-facing applications.
• Develop applications powered by commercial foundation models such as OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, or similar platforms.
• Work across prompt engineering, agent workflows, retrieval-augmented generation, evaluation, and AI-enabled automation.
• Build and maintain search, retrieval, and knowledge management systems using embeddings, vector search, RAG, and related techniques.
• Integrate AI capabilities into existing business systems and workflows, including tool and data integrations through standards such as Model Context Protocol.
• Help evaluate, optimize, and monitor AI systems to ensure they are reliable, useful, and aligned to business needs.
• Collaborate with Product and business users to gather feedback, document technical designs, and iterate toward successful launches.
• Stay current with emerging AI technologies and help identify where they can create value across the firm and portfolio.

What You’ll Bring

• Software engineering experience, ideally focused on AI, machine learning, data products, or applied AI systems.
• Bachelor’s or Masters degree in Computer Science required ; Master’s degree in Computer Science, AI, ML, or a related technical field preferred.
• Strong software engineering fundamentals, including experience building scalable systems and writing clean, maintainable code.
• Strong Python experience.
• Experience building production applications that use foundation models for language, vision, search, retrieval, automation, or workflow use cases.
• Hands-on experience with LLM applications, RAG, embeddings, prompt engineering, agentic workflows, or evaluation.
• Experience deploying applications or models on AWS, Azure, GCP, or similar cloud platforms.
• Ability to build AI systems from scratch in a greenfield environment, including retrieval pipelines, model integrations, evaluation tooling, and deployment workflows.
• Strong product instincts and the ability to turn ambiguous business problems into practical technical solutions.
• Excellent communication skills and the ability to explain technical concepts clearly to non-technical stakeholders.
• Comfort working independently in a fast-paced, high-expectation environment.

Tech Stack

• Python
• OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, or similar foundation model platforms
• PyTorch, Hugging Face, LangChain, LlamaIndex, or similar AI/ML tooling
• FastAPI or similar backend frameworks
• Vector databases, embeddings, semantic search, and RAG systems
• Cloud platforms such as AWS, Azure, or GCP

About People In AI

People In AI is a specialist recruitment partner for high-growth AI, machine learning, and data-driven tec…