Job Closed
Azure Databricks Engineer - Selective
- Source: Naukri
- Tech Mahindra
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
Interested candidates can share their profiles to [email protected]
Role & responsibilities
Location : Pan India
- 7+yrs. in Azure Databricks technologies.
- Good understanding of ETL , BI and DW technologies.
- Hands-on experience on Jason or XML files as sources.
- Experience in autoloader for incremental loading and explode options for flattening data
- Experience in loading Delta live tables
- Experience in PySpark or Spark using data frames.
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
- Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
- Utilizing Azure Data Bricks to create and maintain ETL (Extract, Transform, Load) operations.
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
- Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
- Monitoring and resolving data pipeline problems to guarantee consistency and availability of the data.
- Good communication skills Oral & Written
Skills
- microsoft-azure
- azure-databricks
- databricks
- xml-format
- pyspark
- Spark
- azure-sql
- azure-sql-database
- azure-storage
This job is no longer accepting applications.
Join the Club — Free ForeverYou missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
