Azure Data Engineer

We are seeking an Azure Data Platform Engineer with a strong focus on Administration and hands-on experience in Azure platform engineering services.

Ideal candidates should have expertise in administering services such as:

· Azure Data Factory (Administration)

· Azure Synapse Analytics (Administration)

· Azure Databricks (Administration)

· Cosmos DB (Administration)

· Azure Key Vault

· Function App & Logic App

· Azure Data Lake Storage (ADLS)

· App Services

· Event Hub

· Azure Monitor & Log Analytics

· Capacity planning of Azure resources

· Azure DevOps & CI/CD pipelines

· Provisioning of Azure resources

· Python / Shell scripting

· Monitoring, and troubleshooting of Azure resources

· Azure Kubernetes Service (AKS)

· Provisioning of VNet and subnet and creating service endpoints & private endpoints.

· Additional knowledge of Tableau and Power BI would be a plus.

Also, candidates should have hands-on experience managing and ensuring the stability, security, and performance of these platforms, with a focus on automation, monitoring, and incident management.

· Proficient in distributed system architectures and Azure Data Engineering services like Event Hub, Data Factory, ADLS Gen2, Cosmos DB, Synapse, Databricks, APIM, Function App, Logic App, and App Services

· Implement, and manage infrastructure using IaC tools such as Azure Resource Manager (ARM) templates and Terraform.

· Manage containerized applications using Docker and orchestrate them with Azure Kubernetes Service (AKS).

· Set up and manage monitoring, logging, and alerting systems using Azure Monitor, Log Analytics, and Application Insights.

· Implement disaster recovery (DR) strategies, backups, and failover mechanisms for critical workloads.

· Automate infrastructure provisioning, scaling, and management for high availability and efficiency.

· Experienced in managing and maintaining clusters across Development, Test, Preproduction, and Production environments on Azure.

· Skilled in defining, scheduling, and monitoring job flows, with proactive alert setup.

· Adept at troubleshooting failed jobs in azure tools like Databricks and Data Factory, performing root cause analysis, and applying corrective measures.

· Hands-on experience with distributed streaming tools like Event Hub.

· Expertise in designing and managing backup and disaster recovery solutions using Infrastructure as Code (IaC) with Terraform.

· Strong experience in automating processes using Python, shell scripting, and working with Jenkins and Azure DevOps.

· Proficient in designing and maintaining Azure CI/CD pipelines for seamless code integration, testing, and deployment.

· Experienced in monitoring and troubleshooting VM resources such as memory, CPU, OS, storage, and network.

· Skilled at monitoring applications and advising developers on improving job and workflow performance.

· Capable of reviewing and resolving log file issues for system and application components.

· Adaptable to evolving technologies, with a strong sense of responsibility and accomplishment.

· Knowledgeable in agile methodologies for software delivery.

· Experience with Azure and cloud platforms, leveraging cloud-native tools to build, manage, and optimize secure, scalable solutions.

Pay: ₹100,000.00 - ₹120,000.00 per month

Benefits:

• Work from home

Experience:

• data Engineer: 6 years (Preferred)
• Overall: 7 years (Preferred)

Work Location: Remote