Aws Data Engineer
- Source: Naukri
- Tech Mahindra
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
Position Details:
Role: AWS Data Engineer/AWS Data Analyst
Experience: 4-7 years
Location: Pan India
Shift Timing: 2 PM- 10 PM
Job DescriptionWe are seeking a highly skilled AWS Data Engineer with 4+ years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based data solutions. The ideal candidate should have strong expertise in AWS services, Python, and SQL, along with experience in data warehousing and ETL/ELT processes.Key Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS.
- Build and optimize ETL/ELT workflows using Python and SQL.
- Develop data integration solutions for structured and unstructured data sources.
- Implement data transformation, validation, and quality checks.
- Work with AWS data services such as S3, Glue, Lambda, Redshift, Athena, EMR, and RDS.
- Optimize database performance and write efficient SQL queries.
- Design and maintain data warehouses and data lakes.
- Collaborate with business stakeholders, analysts, and data scientists.
- Monitor and troubleshoot data processing workflows.
- Ensure data security, governance, and compliance standards.
Required Skills
- 4-7 years of Data Engineering experience.
- Strong hands-on experience in Python and SQL.
-
Expertise in AWS services:
- Amazon S3
- AWS Glue
- AWS Lambda
- Amazon Redshift
- Amazon Athena
- Amazon RDS
-
AWS EMR (preferred)
- Experience in ETL/ELT pipeline development.
- Knowledge of Data Warehousing concepts and dimensional modeling.
- Experience with Airflow or similar orchestration tools.
- Familiarity with Git and Agile methodologies.
Preferred Skills
- PySpark and Apache Spark.
- Databricks or Snowflake.
- CI/CD and DevOps practices.
- AWS Certifications.
Skills
- amazon-web-services
- Python
- amazon-s3
- aws-glue
- aws-lambda
- amazon-redshift
- amazon-athena
- amazon-emr
- amazon-rds-for-mysql
- Airflow
- apache-airflow
- pyspark
- Spark
- azure-databricks
- databricks
- Snowflake
