Azure Databricks Developer

Atos is the Atos Group brand dedicated to AI-powered, secure, end-to-end digital services. Atos designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements.

With more than 54,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core IT systems, accelerate cloud and data transformation, strengthen cybersecurity, and deliver secure digital workplace environments to support its clients, its employees and society. Atos also provides consulting and advisory services through its Atos Amplify brand.

A trusted partner in operating complex and mission-critical environments, Atos supports organizations across highly regulated and sovereign contexts.

About Atos Group Atos Group is a global leader in digital transformation with c. 56,000 employees and annual revenue of c. €7.2 billion (at the go-forward perimeter), operating in 54 countries under two brands - Atos for services and Eviden for products and systems. European number one in cybersecurity and a leader in cloud, Atos Group is committed to a secure and decarbonized future and provides tailored AI-powered, end-to-end solutions for all industries. Atos Group is listed on Euronext Paris.

About The Practice Our Data & AI Practice helps organisations unlock the value of their data through modern cloud platforms, data engineering, analytics, artificial intelligence, and machine learning solutions. We work with clients across the public and private sectors to design and deliver data platforms that drive innovation, improve decision-making, and create measurable business outcomes.

Where purpose meets career Join a team that is transforming how organisations use data to solve complex challenges and deliver meaningful outcomes.

• Work on large-scale, cloud-native data platforms using cutting-edge Azure technologies.
• Collaborate with experienced architects, engineers, and data specialists on impactful projects.
• Develop your technical expertise across data engineering, AI, analytics, and modern DevOps practices.

About The Role We are seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions using Azure Databricks and the broader Azure data platform.

In this role, you will build robust data ingestion, transformation, and processing pipelines that enable advanced analytics, artificial intelligence, machine learning, and business intelligence capabilities. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, you will help deliver trusted, high-quality data products while ensuring compliance with security, governance, and operational standards.

Key Responsibilities

• Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads.
• Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems.
• Implement data quality, validation, monitoring, and governance controls across the data lifecycle.
• Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support.

Skills We Can’t Do Without

• Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise.
• Experience building enterprise-scale ETL/ELT pipelines within Azure environments.
• Strong Python and SQL development skills.
• Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory.
• Git version control and software engineering best practices.

Skills We’d Like

• Experience with Microsoft Fabric, Azure Synapse Analytics, Azure Event Hubs, or Kafka.
• Knowledge of Azure DevOps, Terraform, Unity Catalog, MLflow, or Azure Machine Learning.

Additional Requirements

• Candidates must be eligible to obtain and maintain SC and NPPV3 clearance.
• Proven experience working with large-scale data processing and distributed computing technologies.
• Experience working within Agile delivery teams.

**Location UK-based. Remote working is available, with national mobility r…