Job Closed
Azure Data Engineer
- Source: LinkedIn
- Lavance LLC
- On-site
- New York City
- Full-Time
- Mid level
Job Description
Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure services.
- Build ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Develop data transformation logic using PySpark, Spark SQL, and Python.
- Manage Delta Lake and Lakehouse architectures.
- Optimize SQL queries and Spark workloads for performance.
- Integrate data from APIs, databases, and third-party applications.
- Implement data quality, validation, and monitoring processes.
- Collaborate with analysts, data scientists, and business stakeholders.
- Implement CI/CD pipelines using Azure DevOps.
- Ensure data security, governance, and compliance.
Required Skills
- Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, PySpark, Python, SQL, Delta Lake, Git, Power BI, REST APIs
Skills
- microsoft-azure
- azure-data-factory
- azure-databricks
- databricks
- pyspark
- Spark
- apache-spark-sql
- Python
- delta-lake
- azure-devops
- azure-storage
- aws-data-lake-storage
- azure-synapse
- microsoft-azure-synapse
- azure-synapse-analytics
- power-bi
This job is no longer accepting applications.
Join the Club — Free ForeverYou missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
