Senior Azure Data Engineer
- Source: Naukri
- Tech Mahindra
- $15,661.56 to $20,882.08 /yr
- Remote
- Bengaluru
- Full-Time
- Senior
Job Description
Roles and Responsibilities
- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Lake Storage.
- Collaborate with cross-functional teams to gather requirements for data warehousing solutions and implement ETL processes using SSIS.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Cloudera Hadoop ecosystem.
- Lead junior engineers in design reviews, code reviews, and mentorship to ensure high-quality deliverables.
Desired Candidate Profile
- 5-10 years of experience in Data Engineering with expertise in ADF, Azure Databricks, Pyspark, Cloudera/Hadoop.
- Strong understanding of Data Warehousing concepts including star schema design and dimensional modeling.
- Proficiency in writing complex SQL queries for query optimization and troubleshooting purposes.
Skills
- microsoft-azure
- azure-data-factory
- azure-storage
- aws-data-lake-storage
- Hadoop
- apache-hadoop
- azure-databricks
- databricks
- pyspark
