Job Closed
Azure Data Engineer
- Source: Naukri
- Premium
- $1,055.69 to $29,559.25 /yr
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure storage solutions.
- Collaborate with cross-functional teams to gather requirements for ETL processes and ensure seamless integration with existing systems.
- Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality, integrity, and security.
- Implement automated monitoring and alerting mechanisms to ensure high availability of ADF workflows.
Job Requirements :
- 8-12 years of experience in designing, developing, testing & deploying large-scale ETL/ELTL processes using PySpark on Azure Databricks platform.
- Strong understanding of SQL programming language for querying relational databases like SQL Server or PostgreSQL.
- Experience working with Azure services such as Azure Storage (Blob/File Shares), Azure SQL Database, Azure Data Lake Store etc. .
- Proficiency in Python programming language with hands-on experience in working with PySpark framework.
Skills
- microsoft-azure
- azure-data-factory
- microsoft-azure-storage
- pyspark
- azure-databricks
- databricks
- PostgreSQL
- azure-storage
- azure-sql
- azure-sql-database
- Python
This job is no longer accepting applications.
Join the Club — Free ForeverYou missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
