Azure Databricks Engineer

KPI Partners is looking for passionate and experienced Databricks Engineers to join our growing Data Engineering team. If you have hands-on experience building scalable data solutions using Databricks and Apache Airflow, we’d love to hear from you!

Experience Level- 6 to 12 years

Location- Bangalore, Pune, Hyderabad

Work mode- Hybrid (8 days in a month)

Notice Period- Immediate to 15 days

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and manage workflow orchestration using Apache Airflow (DAGs).
• Develop and optimize ETL/ELT pipelines for high performance and reliability.
• Collaborate with data scientists, analysts, and cross-functional teams to deliver high-quality data solutions.
• Monitor, troubleshoot, and resolve data pipeline issues to ensure seamless operations.
• Create and maintain technical documentation for data architecture, workflows, and best practices.
• Stay updated with the latest trends and technologies in data engineering and analytics.

Required Skills:

• Hands-on experience with Databricks and Apache Airflow.
• Strong understanding of ETL/ELT, Data Modeling, and Data Warehousing concepts.
• Proficiency in Python or Scala.
• Experience working with cloud platforms such as Azure, AWS, or Google Cloud Platform (GCP).
• Strong analytical, problem-solving, and debugging skills.
• Excellent communication and collaboration abilities.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
• Relevant experience in Data Engineering with expertise in Databricks and Airflow.

Location: Pune, Bangalore, Hyderabad -Hybrid