Data Engineer with AWS
- Source: Naukri
- Virtusa
- On-site
- Chennai
- Full-Time
- Mid level
Job Description
Job Description
- Experience Required: 10+ years in Data Engineering and Data Warehousing.
- Core AWS Services: Hands-on expertise with AWS Glue, Amazon Redshift, Amazon S3, EMR, and Athena.
- Pipeline Development: Design, build, and optimize scalable batch and real-time data pipelines using PySpark and Python.
- Data Warehousing: Expertise in Amazon Redshift modeling, optimization, and S3 data lake architecture.
- Workflow Orchestration: Manage dependencies and automate tasks using Apache Airflow or AWS Step Functions.
- Infrastructure & DevOps: CI/CD integration, infrastructure support, and deployment automation.
- Data Quality & Security: Implement data validation, encryption, IAM roles, and governance policies.
- Query Performance: Advanced SQL optimization for large-scale enterprise data.
- Collaboration: Partner with cross-functional teams, architects, and stakeholders to deliver solutions.
Skills
- amazon-web-services
- aws-glue
- amazon-redshift
- amazon-s3
- amazon-emr
- amazon-athena
- pyspark
- Python
- Airflow
- apache-airflow
- aws-step-functions
