Sr. Data Engineer (Azure.)- W2 Contract- Remote

Hiring: Senior Azure Data Engineer – 12+ Years of Experience

Title : Senior Azure Data Engineer

Location : Remote

Experience : 12+ years

Type : W2 Contract ONLY - US Citizen / Green Card (Preffered)

Technology Stack: Azure Data Factory, Azure Databricks, PySpark, Python, SQL, ADLS Gen2, Azure

Job Summary

We are seeking a highly experienced Senior Azure Data Engineer with 12+ years of experience in data engineering, data warehousing, ETL/ELT development, and cloud-based data solutions.

The ideal candidate will have extensive hands-on experience with Microsoft Azure data services, Azure Data Factory, Azure Databricks, PySpark, Python, SQL, and Azure Data Lake Storage Gen2.

The successful candidate will collaborate with architects, technical leads, business stakeholders, and cross-functional teams to develop and maintain high-performance data platforms that support business intelligence, analytics, and reporting requirements.

Key Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines using Azure Data Factory and Azure Databricks.
• Build complex ETL/ELT workflows for data ingestion, transformation, integration, and processing from multiple source systems.
• Develop advanced data processing solutions using Python, PySpark, Apache Spark, and SQL.
• Design and implement data lake and lakehouse solutions using Azure Data Lake Storage Gen2 and Delta Lake.
• Develop and optimize data models, data transformations, and cloud data warehouse solutions.
• Implement incremental data loads, change data capture (CDC), and efficient data processing strategies.
• Optimize Spark jobs, SQL queries, pipeline execution, and cloud resource utilization.
• Establish data quality checks, validation frameworks, monitoring, logging, and error-handling mechanisms.
• Implement CI/CD pipelines, source control, and automated deployment processes using Azure DevOps and Git.
• Ensure data security, access controls, governance, and compliance with enterprise standards.
• Collaborate with data architects, application teams, business analysts, and stakeholders to translate business requirements into technical solutions.
• Provide technical guidance, conduct code reviews, troubleshoot production issues, and mentor junior data engineers.
• Contribute to data platform modernization, cloud migration, and continuous improvement initiatives.

Required Qualifications

• 12+ years of overall IT experience, with significant hands-on experience in Data Engineering and enterprise data solutions.
• Strong expertise in SQL, Python, and data transformation techniques.
• Extensive hands-on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks, PySpark, and Apache Spark.
• Experience with Azure Data Lake Storage Gen2 (ADLS Gen2).
• Strong understanding of ETL/ELT architecture, data warehousing, data modeling, and data integration.
• Experience designing, developing, and supporting production-grade data pipelines.
• Knowledge of Delta Lake, incremental processing, and distributed data processing.
• Experience with Azure DevOps, Git, CI/CD, and deployment automation.
• Strong problem-solving, analytical, communication, and stakeholder collaboration skills.
• Ability to work independently, own technical deliverables, and support enterprise-scale data engineering initiatives.