Senior Databricks Data Engineer (AWS,Airflow)

KPI Partners is seeking a highly skilled Senior Databricks Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with Databricks, AWS, and Apache Airflow, and will play a critical role in designing, developing, and maintaining our data processing pipelines and architectures.

Key Responsibilities:

• Design and implement scalable data processing solutions using Databricks on AWS.
• Develop and maintain ETL processes using Apache Airflow.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
• Optimize data workflows and ensure efficient data storage and retrieval practices.
• Monitor and troubleshoot complex data workflows and pipelines in a production environment.
• Stay current with industry trends and best practices in data engineering and cloud technologies.
• Document processes, architectures, and code to ensure project continuity and knowledge sharing.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a similar role.
• Strong expertise in Databricks and AWS services (such as S3, Redshift, Lambda, etc.).
• Proficiency in using Apache Airflow for workflow orchestration.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent programming skills in languages such as Python or Scala.
• Strong problem-solving skills and ability to work in a fast-paced environment.
• Effective communication skills and the ability to work collaboratively in a team.

Benefits:

• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance.
• Retirement savings plan with company matching.
• Opportunities for professional development and continuous learning.
• A supportive and inclusive work culture that values innovation and collaboration.

Join KPI Partners and be part of a team that is dedicated to delivering high-quality data solutions that drive business success. If you are passionate about data engineering and want to make an impact, we invite you to apply.