Lead AWS Data Engineer

Key Skills: Pyspark, AWS, Databricks, Data Modelling, SQL, Python, Airflow, GIT, CICD

Roles and Responsibilities:

• Design and build scalable data pipelines and transformation workflows on AWS and Databricks
• Develop efficient Python, SQL, and PySpark solutions for batch data processing and data preparation
• Implement robust data models and warehouse-ready datasets to support reporting and analytics use cases
• Orchestrate and maintain scheduled data workflows using Airflow and related cloud services
• Partner with engineering and analytics teams to deliver trusted, reusable data assets across the platform

Skills Required:

• 6-12 years of relevant data engineering experience
• Strong hands-on experience with AWS, Python, PySpark, SQL, Databricks, data modelling, and Airflow
• Experience designing cloud-based data platforms and building scalable data processing solutions
• Ability to write complex SQL and optimize data transformations for large datasets
• Experience delivering production-grade data pipelines and integrating data from multiple sources

Good to Have:

• Git
• CI/CD

Education: Bachelor’s degree in Computer Science or related field; Master’s degree preferred