Data Engineer (Databricks & AWS)

Job Title: Data Engineer (Databricks & AWS)Employment Type: Full TimePosition Location: HyderabadReports to: Delivery HeadQualifications: BE/B.Tech/MCA Degree in Computer Science, Engineering, or similar relevant fieldWorking Model: HybridShift Timing: 10pm 7am Night Shift ( Not a regular week offs)
Organization Brief:CapTech (www.captechconsulting.com) is a U.S.-based technology and management consulting firm and part of the Markel Group (NYSE: MKL), a Fortune 500 family of companies. We help leading organizations design, build, and modernize digital products, data platforms, and customer experiences that create measurable business impact.Our Global Capability Center (GCC) in Noida/Hyderabad, operated by RDSolutions India (also a Markel Group company), extends CapTech’ s consulting excellence through world-class engineering, analytics, and innovation capabilities delivered from India.  About the RoleWe are seeking a Lead Data Engineer with strong experience in data engineering, analytical data modeling, and cloud-based data platforms. This role will lead the offshore technical support and engineering activities for enterprise data pipelines built on AWS and Databricks.The position combines hands-on engineering expertise with operational leadership, ensuring reliable execution of data pipelines, effective troubleshooting of complex issues, and delivery of analytics-ready datasets for reporting, dashboards, and advanced analytics.The ideal candidate will demonstrate strong analytical thinking, technical problem solving, and operational ownership, guiding the offshore team in maintaining platform reliability while continuously improving Databricks-based data pipelines and data models.
Key Responsibilities

• Design and maintain scalable data pipelines and transformation workflows using Databricks Lakehouse architecture
• Build and maintain analytics-ready data models to support reporting and insights
• Develop data transformations using SQL and Python
• Work with Databricks-based data Lakehouse environments to process and manage large datasets
• Ensure reliability and performance of data ingestion, transformation, and processing pipelines
• Collaborate with engineering and analytics teams to support data quality, data governance, and analytics delivery
• Troubleshoot pipeline issues and support improvements in platform stability and performance

Required Skills

• Strong data engineering experience building ETL / ELT pipelines
• Expertise in SQL and Python
• Strong understanding of data modeling and analytics data structures
• Strong working experience with Databricks, including:
• Pyspark
• Delta Lake
• Databricks SQL
• Data Lakehouse architecture
• Experience working with AWS data services (S3, Lambda, Glue, Redshift, etc.)
• Familiarity with dbt or similar transformation frameworks
• Experience with GitHub, Terraform, and Jira

Nice to Have

• Experience with Tableau
• Exposure to Kubernetes or containerized workloads
• Experience with workflow orchestration tools such as MWAA or Airflow