Databricks Azure Data Engineer / Senior Data Engineer
- Source: Naukri
- Tiger Analytics
- $16,791.34 to $31,483.77 /yr
- Hybrid
- Bengaluru
- Full-Time
- Senior
Job Description
Role & responsibilities
We are looking for talented Data Engineers and Senior Data Engineers (312 years) with strong hands-on experience in Databricks, PySpark, Spark SQL, and modern cloud-based data engineering. Candidates with experience on Azure, AWS, or GCP are encouraged to apply.
The ideal candidate should have experience building scalable ETL/ELT pipelines, implementing Lakehouse architectures, optimizing Spark workloads, and delivering enterprise-grade analytics solutions.
Responsibilities :
- Design and develop scalable cloud data pipelines using Databricks, PySpark, and Spark SQL.
- Build enterprise ETL/ELT frameworks on Azure, AWS, or GCP.
- Implement Delta Lake and Medallion Architecture.
- Develop batch and streaming data pipelines.
- Optimize Spark workloads for performance and scalability.
- Implement logging, monitoring, and exception handling.
- Build CI/CD pipelines using Git and DevOps tools.
- Collaborate with architects, data scientists, and business stakeholders.
- Ensure high data quality and production reliability.
Preferred candidate profile
Skills
- azure-databricks
- databricks
- microsoft-azure
- pyspark
- Spark
- apache-spark-sql
- amazon-web-services
- google-cloud-platform
- delta-lake
