Microsoft Fabric / Azure Data Engineer

Job Title: Microsoft Fabric / Azure Data Engineer

Job Location: Indore, Pune, Hyderabad, Bangalore

Experience: 5 6 years of relevant experience

Employment Type: Full-Time

Job Summary We are looking for an experienced Microsoft Fabric / Azure Data Engineer with strong hands-on experience in Microsoft Fabric, Azure Data Factory (ADF), and Azure Databricks . The ideal candidate should have strong expertise in Azure data engineering, ETL development, data migration, database design, cloud data solutions, and data governance.

The candidate will be responsible for designing, developing, testing, and maintaining scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Microsoft Fabric.
• Create and manage pipelines, datasets, dataflows, integration runtimes, triggers, and monitoring processes.
• Perform data extraction, transformation, and loading (ETL) from various source systems.
• Use Azure Databricks for data processing and transformation.
• Develop and optimize SQL queries and scripts for complex data processing requirements.
• Design database structures and prepare database design documents based on business and client requirements.
• Work closely with development teams to create database structures, queries, stored procedures, and triggers.
• Develop Azure Synapse pipelines for data migration from Azure Data Lake Storage Gen2 to Azure SQL.
• Design and implement data migration pipelines for migrating on-premises data to Azure.
• Perform database migration from on-premises SQL Server to Azure environments using Azure Database Migration Service (DMS) and Data Migration Assistant (DMA).
• Support lift-and-shift activities from development environments to production.
• Implement data migration solutions using Azure SQL and Azure Cosmos DB.
• Work with Azure data governance and data catalog solutions.
• Develop solutions for batch processing, interactive processing, and real-time data processing.
• Design, develop, test, troubleshoot, and optimize Microsoft Azure cloud data solutions.
• Monitor pipeline execution, identify failures, troubleshoot issues, and implement corrective actions.

Required Technical Skills Mandatory Skills

• Microsoft Fabric
• Azure Data Factory (ADF)
• Azure Databricks

Additional Required Skills

• Azure Synapse Analytics
• Azure Storage / ADLS Gen2
• Azure SQL Database
• SQL & ETL
• Azure Cosmos DB
• Azure Event Hubs
• Azure Functions
• Azure Data Catalog
• Azure Purview
• Azure Database Migration Service (DMS)
• Data Migration Assistant (DMA)
• Data Governance
• Big Data Processing

Required Experience

• Minimum 5 years of relevant experience in Azure Data Engineering.
• Strong hands-on experience with Microsoft Fabric, Azure Data Factory, and Azure Databricks.
• Experience in designing and developing Azure-based data pipelines.
• Experience with on-premises to Azure data and database migration.
• Strong knowledge of SQL and database concepts.
• Experience working with batch, interactive, and real-time data processing solutions.
• Good understanding of Azure cloud architecture and data governance.