Databricks Data Engineer | Azure | PySpark
- Source: Naukri
- Tiger Analytics
- $20,804.66 to $26,005.83 /yr
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
Role & responsibilities
Job Description
Tiger Analytics is a global AI and Analytics company helping Fortune 1000 organizations build data-driven solutions using modern cloud technologies.
We are looking for skilled Databricks Data Engineers with strong expertise in Azure Data Engineering to build scalable, high-performance data platforms and pipelines.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using Azure Databricks.
- Build data ingestion and transformation frameworks for batch and streaming data.
- Develop data pipelines using PySpark, Azure Data Factory, and ADLS Gen2.
- Implement Delta Lake and Lakehouse architecture.
- Optimize Spark jobs for performance and scalability.
- Build logging, monitoring, and exception handling frameworks.
- Collaborate with Data Architects, Data Scientists, and Business teams.
Required Skills
- Azure Databricks
- PySpark
- Python
- SQL
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS Gen2)
- Delta Lake
- Spark SQL
- ETL/ELT Development
- Data Engineering
Preferred Skills
- Azure Synapse Analytics
- Unity Catalog
- Delta Live Tables (DLT)
- Kafka/Event Hubs
- Azure DevOps
- CI/CD
- Databricks Workflows
Experience
46 Years
Employment Type
Full-Time
Preferred candidate profile
Skills
- azure-databricks
- databricks
- microsoft-azure
- pyspark
- azure-data-factory
- delta-lake
- Python
- azure-storage
- aws-data-lake-storage
- apache-spark-sql
- Spark
- azure-synapse
- microsoft-azure-synapse
- azure-synapse-analytics
- unity-3d
- Kafka
- azure-devops
