AI Engineer/ Manager

Job Title: AI Engineer/ Manager

Location: NYC, NY (Hybrid)( 2 daysx weekly in New York office)

Duration: 03 months + possible extension Contract

Location & Work Arrangement:

• Location: New York
• Work Model: 2 daysx weekly in New York office
• Travel Required: N/A
• Hours per week: 45

Contract Duration:

Role Summary:

We are seeking an experienced AI Engineer Contractor to provide subject matter expertise.

Technology is the key differentiator that ensures that we manage our global businesses and serve clients on a market-leading platform that is resilient, safe, efficient, smart, fast and flexible. The Technology division partners with our business units and leading technology companies to redefine how we do business in ever more global and dynamic financial markets.

Our sizeable investment in technology results in leading-edge tools, software, and systems. Our insights, applications, and infrastructure give a competitive edge to client’s businesses and to our own.

Enterprise Technology & Services (ETS) delivers shared technology services for the Firm supporting all business applications and end users. ETS provides capabilities for all stages of the Firm’s software development lifecycle, enabling productive coding, functional and integration testing, application releases, and ongoing monitoring and support for over 3,000 production applications.

ETS also delivers all workplace technologies (desktop, mobile, voice, video, productivity, intranet/internet) in integrated configurations that boost the personal productivity of our employees. Application and end user services are delivered on a scalable, secure, and reliable infrastructure composed of seamlessly integrated datacenter, network, compute, cloud, storage, and database services.

Organizational Description:

The Data Engineering & Analytics group in the Core Infrastructure at the client provides technologies and platform required to model, provision, transform, analyze, report, visualize, store and protect enterprise data on-prem and in public cloud. The team is responsible for the delivery and operation of these products

Job Description:

We are looking for a Senior Databricks AI Platform Engineer to join our Platform Engineering team. This role will be critical in designing, building, and optimizing a scalable, secure, and developer-friendly Databricks platform to enable Machine Learning (ML) and Artificial Intelligence (AI) workloads at enterprise scale

You will partner with ML engineer, data scientists, platform teams, and cloud architects to automate infrastructure, enforce best practices, and streamline the end-to-end ML lifecycle using modern cloud-native technologies.

Qualifications - External

Total Experience – 8+ Years. Bachelor’s or master’s degree in computer science, Engineering or a related field.

Responsibilities:

• Design and implement secure, scalable, and automated Databricks environments to support AI/ML workloads.
• Develop infrastructure-as-code (IaC) solutions using Terraform for provisioning Databricks, cloud resources, and network configurations.
• Build automation and self-service capabilities using Python, Java and APIs for platform onboarding, workspace provisioning, orchestration and monitoring.
• Collaborate with data science and ML teams to define compute requirements, governance policies, and efficient workflows across dev/qa/prod environments.
• Integrate Databricks offering with cloud-native services on Azure/AWS
• Champion CI/CD and GitOps for managing ML infrastructure and configurations.
• Ensure compliance with enterprise security and data governance policies using RBAC, Audit Controls, Encryption, Network Isolation, and policies.
• Monitor platform performance, reliability, and usage, and drive improvements to optimize cost and resource utilizations

Required Skills:

• Proven experience with Terraform for building and managing infrastructure.
• Strong programming skills in Python and Java
• Hands-on experience with cloud networking, identity and access management, key vaults, monitoring, and logging in Azure
• Hands on experience with Databricks (Workspace management, Clusters, Jobs, MLFlow, Delta Lake, Unity Catalog, Mosaic AI)
• Deep understanding of Azure or AWS infrastructure (e.g. IAM, VNets/VPC, Storage, Networks, Compute, Key management, monitoring)
• Strong experience in distributed system design, development and deployment u…