Senior Azure Data Engineer with Azure DevOps

Position Overview

We are seeking a skilled Senior Azure Data Engineer with expertise in Azure cloud technologies, big data processing, ETL/ELT pipeline development, Azure DevOps, and enterprise system integrations. The ideal candidate should have hands-on experience with Azure Databricks, PySpark, Azure Data Factory, Synapse Analytics, APIs, SQL, Python, Power BI, and Azure DevOps to build scalable, secure, and automated data and analytics solutions.

Required Skills:

• Azure Data Factory (ADF)
• Azure Databricks
• Apache Spark & PySpark
• Azure Synapse Analytics
• Azure Data Lake & Blob Storage
• Python & SQL
• REST & SOAP API Integrations
• SQL Query Optimization & Database Management
• ETL/ELT Pipeline Development
• Data Warehousing (Star & Snowflake Schema)
• Microsoft Power BI
• Salesforce & NetSuite Integrations
• Delta Lake, Spark SQL, Databricks Workflows
• CI/CD & DevOps for Data Pipelines
• Azure DevOps (Repos, Pipelines, Boards, Releases)
• CI/CD Pipeline Automation using Azure DevOps
• Git Version Control & Branching Strategies
• Deployment Automation & Release Management
• Agile Methodologies
• Cloud Security & Access Management

Nice to Have

• Kafka / Event Hub
• Real-time Streaming Pipelines
• Dell Boomi / MuleSoft
• Data Governance & Security Best Practices
• Terraform / ARM Templates
• Azure Monitor & Log Analytics

Key Responsibilities

• Build scalable ETL/ELT pipelines on Azure
• Develop big data solutions using Databricks & PySpark
• Integrate enterprise systems via REST/SOAP APIs
• Optimize SQL queries and Spark workloads
• Build dashboards and analytics using Power BI
• Design modern cloud data platforms and data warehouses
• Implement CI/CD pipelines using Azure DevOps
• Manage source control, deployments, and release automation
• Collaborate with DevOps and infrastructure teams for cloud deployments
• Monitor, troubleshoot, and optimize Azure data platform performance