Senior Azure Data Engineer with Gen AI
- Source: LinkedIn
- Prophecy Technologies
- Hybrid
- Hyderabad
- Full-Time
- Senior
Job Description
Job Title: Azure Data Engineer – Databricks | Snowflake | GenAI
Experience: 5+Years
Notice Period: Immediate Joiners to 30days
Location: PAN India
Job Type: Full-Time
Job Summary
We are looking for an experienced Azure Data Engineer with 6–8 years of expertise in designing, developing, and maintaining scalable cloud-based data solutions. The ideal candidate should have strong hands-on experience with Azure Databricks, Snowflake, Azure services, and CI/CD pipelines, along with exposure to Generative AI technologies. The candidate will work closely with cross-functional teams to build modern data platforms and enable enterprise analytics.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines using Azure Databricks.
- Build and maintain cloud-native data solutions on Microsoft Azure.
- Develop and optimize data warehouse solutions using Snowflake.
- Design and implement ETL/ELT workflows for large-scale data processing.
- Build and integrate REST APIs and GraphQL services for data access.
- Develop serverless applications using Azure Functions.
- Implement Infrastructure as Code (IaC) using Terraform.
- Build CI/CD pipelines for automated deployment using Azure DevOps or GitHub Actions.
- Work with Kafka for real-time data ingestion and streaming solutions.
- Collaborate with data scientists and AI teams to integrate Generative AI capabilities into data platforms.
- Optimize performance, scalability, and security of enterprise data solutions.
- Follow Agile development methodologies and DevOps best practices.
Required Skills
- 6–8 years of experience in Data Engineering.
- Strong experience with Azure Databricks.
- Hands-on experience with Microsoft Azure services.
- Expertise in Snowflake.
- Strong knowledge of CI/CD pipelines.
- Experience with Generative AI concepts and LLM integrations.
- Experience with GraphQL.
- Strong understanding of REST APIs.
- Experience with Terraform.
- Experience with Apache Kafka.
- Hands-on experience with Azure Functions.
- Good understanding of SQL and Python is preferred.
- Experience with Git, Azure DevOps, or GitHub.
- Experience with enterprise cloud migration projects.
- Knowledge of data governance and security best practices.
- Exposure to AI/ML workloads on Azure.
- Microsoft Azure or Databricks certifications are an added advantage.
Skills
- microsoft-azure
- azure-databricks
- databricks
- Snowflake
- GraphQL
- serverless
- azure-functions
- microsoft-azure-functions
- Terraform
- azure-devops
- Github
- github-actions
- Kafka
- Python
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
