Senior AI Software Engineer

Position Description

CGI is seeking an AI Software Engineer to join our growing AI Engineering team and help shape the future of enterprise AI solutions. At CGI, you’ll work alongside industry-leading professionals to build innovative, AI-native products that solve complex business challenges for global clients. As one of the world’s largest independent IT and business consulting services firms, CGI empowers our professionals to take ownership, collaborate across disciplines, and deliver meaningful outcomes through technology.

In this role, you will design and develop production-grade AI capabilities that are embedded directly into our products, not simply chatbot experiences. You will build intelligent agentic workflows, retrieval and reasoning systems, and scalable AI services that enable next-generation enterprise applications. If you’re passionate about applying cutting-edge AI technologies to solve real-world problems, we’d like to meet you.

This position can be performed in the Tri-State area where CGI has an office.

Your future duties and responsibilities

• Design and build AI capabilities embedded throughout enterprise products, including agentic workflows, retrieval systems, and reasoning engines.
• Develop production-grade AI applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), semantic search, and vector databases.
• Implement multi-agent orchestration using frameworks such as LangGraph, CrewAI, Semantic Kernel, or Model Context Protocol (MCP).
• Build AI capabilities including document intelligence, knowledge retrieval, planning, reasoning, and AI-assisted decision support.
• Design and optimize data extraction, classification, embedding, and indexing pipelines.
• Integrate AI and LLM services with enterprise APIs, document repositories, and business workflows.
• Evaluate and improve model performance, reliability, accuracy, and observability through monitoring, testing, and drift detection.
• Partner closely with software engineers, product managers, and architects to deliver scalable AI services through well-designed APIs.
• Document AI architecture, prompt engineering strategies, agent workflows, and evaluation methodologies while promoting engineering best practices.

Required Qualifications To Be Successful In This Role

• Must have a minimum of 8 years of software engineering experience, including at least 2 years developing production-grade AI/LLM applications beyond proof-of-concept or notebook development.
• Experience developing enterprise B2B SaaS products with embedded AI capabilities.
• Hands-on experience with one or more multi-agent orchestration frameworks such as LangGraph, CrewAI, Semantic Kernel, or MCP.
• Strong experience designing and implementing Retrieval-Augmented Generation (RAG), vector database, and semantic search solutions.
• Advanced Python development experience, including FastAPI or similar frameworks for AI service development.
• Experience integrating LLM-based applications with enterprise data sources, APIs, and business workflows.
• Strong analytical, problem-solving, and collaboration skills with the ability to communicate technical concepts effectively.

Preferred Qualifications:

• Experience building AI-native enterprise products comparable in complexity to Harvey AI, Cursor, Notion AI, Linear, Canva, or similar platforms.
• Experience in regulated industries such as Life Sciences, Clinical Research, Healthcare, or Pharmaceuticals.
• Experience with Intelligent Document Processing (IDP) solutions such as Azure AI Document Intelligence.
• Experience deploying AI solutions on cloud platforms including Azure, AWS, or Google Cloud.
• Familiarity with MLOps, AI observability, model evaluation frameworks, and responsible AI practices.

Bachelor’s degree in computer science, Engineering, or a related field, or equivalent professional experience.

Other Information:

CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate o…