Azure Data Engineer Lead
- Source: Naukri
- Tata Consultancy Services
- On-site
- Bengaluru
- Full-Time
- Senior
Job Description
Job description
As an Azure Data Engineer, you will be instrumental in delivering top-tier solutions on the Azure Cloud, employing core data warehouse tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL DW, and other Big Data technologies. This role emphasizes application-level data engineering rather than infrastructure.
Responsibilities:
- Collaborate with multiple teams to develop and maintain Data Pipelines, harvesting data from Systems of Record to create data products.
- Engage in complex coding activities using U-SQL, Spark (Scala or Python), and T-SQL.
- Develop modern data warehouse solutions utilizing the Azure Stack (Data Lake, Data Factory, Databricks).
- Analyze data and strategize for populating data lakes.
Skills/Qualifications:
- experience as an Azure Data Engineer, including hands-on experience with Azure Databricks.
- Proven ability to transform business use cases and requirements into technical solutions.
- Expertise in Azure services: Data Factory, Data Lake, Synapse, Data Lake Analytics & U-SQL, SQL DW.
- Proficiency in Python, Spark, and SQL.
- Experience with Azure DevOps and CI/CD (using ARM, YAML, Terraform).
- Familiarity with source code control systems such as GIT
Skills
- microsoft-azure
- azure-data-factory
- azure-databricks
- databricks
- azure-synapse
- microsoft-azure-synapse
- azure-synapse-analytics
- azure-sql
- Spark
- Scala
- Python
- azure-stack
- azure-devops
- yaml
- Terraform
