Data Engineer( AWS Redshift, python, airflow)

Role - Data Engineer

Location Hyderabad /chennai/Noida/pune,Bangalore- IndiaAbout the

Specialization :

• Good to have : AWS - RedShift

Key Responsibilities :

We are seeking a highly skilled Data Engineer with strong expertise in Amazon Redshift, Apache Airflow, and Python, with a primary focus on query tuning, performance optimization, and scalable data pipeline development. The ideal candidate will have hands-on experience working with large-scale datasets (10M+ records) and possess excellent communication skills to collaborate effectively with cross-functional teams.

Key Responsibilities

Design, develop, and maintain scalable and reliable data pipelines using Python and Apache Airflow.

Optimize and tune complex SQL queries in Amazon Redshift to improve performance, scalability, and cost efficiency.

Process and manage large-scale datasets (10M+ records) while ensuring data accuracy, integrity, and high performance.

Build, enhance, and maintain robust ETL/ELT workflows for structured and semi-structured data sources.

Monitor data pipeline performance, identify bottlenecks, and troubleshoot production issues proactively.

Implement data modeling, partitioning, indexing, and query optimization best practices.

Collaborate with Data Analysts, Data Scientists, Product Teams, and Business Stakeholders to understand and deliver data requirements.

Ensure adherence to data quality, governance, security, and documentation standards across all data processes.

Support performance monitoring, capacity planning, and continuous improvement initiatives within the data platform.

Develop and maintain technical documentation for data workflows, architectures, and operational procedures.