Aws Data Engineer Lead
- Source: Naukri
- Teksystems
- On-site
- Hyderabad
- Full-Time
- Senior
Job Description
Job highlights
- 10+ years experience with AWS Glue, EMR, Redshift, Pyspark, Python, and SQL
- Design and manage ETL/ELT pipelines, data modeling, and data warehousing using AWS services and big data frameworks
Role & responsibilities
AWS Glue, Amazon EMR, Amazon Redshift,Pyspark,Python,SQL
Cloud and AWS Expertise:
In-depth knowledge of AWS services related to data engineering: EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg,EMR, and Athena.
Strong understanding of cloud architecture and best practices for high availability and fault tolerance.
Data Engineering Concepts:
Expertise in ETL/ELT processes, data modeling, and data warehousing.
Knowledge of data lakes, data warehouses, and big data processing frameworks like Apache Hadoop and Spark.
Proficiency in handling structured and unstructured data.
Programming and Scripting:
Proficiency in Python, Pyspark and SQLfor data manipulation and pipeline development.
Expertise in working with data warehousing solutions like Redshift.
10+yrs
Skills
- amazon-web-services
- aws-glue
- amazon-emr
- amazon-redshift
- pyspark
- Python
- amazon-ec2
- amazon-s3
- amazon-rds-for-mysql
- amazon-dynamodb
- aws-lambda
- aws-step-functions
- amazon-kinesis
- amazon-athena
- Hadoop
- apache-hadoop
- Spark
