ADB / Azure Databricks Architect - 8+yrs - Pan India!
- Source: Naukri
- SP Staffing
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
Work Location: Pan India
Experience: 8+yrs
Required Skills:
- Design and implement end-to-end data architecture using Azure Databricks and Microsoft Azure services.
- Architect scalable data lakehouse solutions using Delta Lake and medallion architecture (Bronze, Silver, Gold).
- Define data ingestion, transformation, integration, and orchestration strategies.
- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.
- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Implement data governance, security, access control, and compliance using Unity Catalog, RBAC, and Azure security services.
- Optimize Spark workloads, cluster configurations, job performance, and cloud costs.
- Integrate Databricks with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and other enterprise data sources.
- Establish CI/CD, deployment automation, monitoring, and data quality standards.
Thanks & Regards
Suganya R
Skills
- microsoft-azure
- azure-databricks
- databricks
- delta-lake
- pyspark
- Spark
- apache-spark-sql
- Python
- azure-data-factory
- unity-3d
- azure-rbac
- azure-storage
- aws-data-lake-storage
- azure-synapse
- microsoft-azure-synapse
- azure-synapse-analytics
