Azure Data Engineer
- Source: Naukri
- mroads
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
Roles and Responsibility
- Design and develop large-scale data pipelines using Azure Data Factory and Databricks.
- Create efficient ETL processes to extract, transform, and load data from various sources into Azure Blob Storage and other target systems.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop and maintain complex SQL queries to optimize database performance and troubleshoot issues.
- Implement data quality checks and validation processes to ensure accuracy and integrity of the data.
- Work closely with stakeholders to understand their data needs and provide timely updates on project progress.
Job Requirements
- Strong understanding of SQL concepts, including query optimization and performance tuning.
- Experience with Databricks, Azure Data Factory, and ETL pipeline development.
- Knowledge of data processing technologies such as data warehousing, data lakes, and big data analytics.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
- Strong analytical and critical thinking skills, with the ability to make informed decisions.
Skills
- microsoft-azure
- azure-data-factory
- azure-databricks
- databricks
- azure-storage
