Azure Data Engineer,Azure Data Lake Engineer
- Source: Naukri
- Burgeon It Services
- $12,482.8 to $22,885.13 /yr
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
Position: Azure Data Lake Engineer- Scala/Spark
Work Location: Pan India
Total Experience: 7-12 Years
Relevant Experience: 6 Years
Job Type: Contract to Hire
Notice Period: Immediate-30 Days
Job Description:
- We are looking for a Azure Data Lake Engineer who is passionate about building scalable, secure, and high-performance data architectures. In this role, you will be the primary architect and developer for our Azure Data Lake ecosystem. Your expertise in Scala and Apache Spark will be critical in transforming massive raw datasets into actionable data products for our analytics
Mandatory Skills:
- 7+ years overall backend development experience in production environments
- Primary Language: Advanced proficiency in Scala (Functional Programming, Spark APIs).
- Azure Big Data Stack: Expert knowledge of Azure Data Lake Storage Gen2, Databricks, and Data Factory.
- Distributed Computing: Deep understanding of Apache Spark (Data Frames, Datasets, Spark SQL, and optimization techniques like Caching and Broadcast joins).
- SQL Mastery: Ability to write and optimize complex SQL queries for Synapse or Azure SQL.
- DevOps: Experience with Azure DevOps , CI/CD pipelines, and version control (Git).
- Data Modeling: Familiarity with Star/Snowflake schemas
Skills
- microsoft-azure
- Scala
- Spark
- azure-stack
- azure-storage
- aws-data-lake-storage
- azure-databricks
- databricks
- azure-data-factory
- apache-spark-sql
- azure-synapse
- azure-sql
- azure-devops
- Snowflake
