DATA Engineer - Azure data bricks - All GDS Locations
- Source: Naukri
- EY
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
Job Summary
We are looking for a strong Azure Data Engineer with hands-on expertise in Azure Databricks, PySpark, Python, and SQL.
The candidate should have proven experience in designing and developing scalable ETL/ELT pipelines and processing large-volume datasets.
Strong knowledge of Delta Lake, Spark SQL, DataFrame transformations, joins, window functions, and incremental/CDC processing is required.
Experience with Azure Data Factory (ADF), ADLS Gen2, and Medallion Architecture is highly preferred.
The candidate should be proficient in Spark performance optimization, data quality, dimensional modeling, and SQL query optimization.
Hands-on exposure to Azure DevOps, Git, CI/CD, monitoring, and production deployment will be an added advantage.
Skills
- microsoft-azure
- delta-lake
- Spark
- apache-spark-sql
- azure-data-factory
- azure-devops
