Azure Data Engineer in Globant
- Source: Naukri
- Globant
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
Job Summary: As an Azure Data Engineer, you will design, develop, and implement data solutions using Azure ecosystem. Your role will involve bridging traditional data warehousing with modern Lakehouse environments, utilising your expertise in SQL, Azure Databricks, Spark, and Delta Lake.
Skill set:
- Advanced PySpark & Spark internals coding, debugging, performance tuning, Catalyst, AQE, memory, shuffle, skew handling.
- Azure Databricks & Delta Lake – Auto Loader, DLT, Delta transaction logs, concurrency, Liquid Clustering.
- Data Engineering Pipelines – ADF, ADLS Gen2, ELT pipelines, file validation/checksum frameworks.
- Advanced SQL – complex queries, analytical functions, and query optimization.
- Large-Scale Data Architecture – high-volume data, concurrent workloads, partition-level locking, and scalability.
- Performance & Cost Optimization – serverless compute, job clusters, workload optimization.
- Enterprise Data Management – metadata-driven processing, Delta Sharing, Azure Files, and Azure SQL.
Skills
- microsoft-azure
- azure-databricks
- databricks
- Spark
- delta-lake
- pyspark
- catalyst
- liquid
- serverless
- azure-files
- azure-sql
