Aws Data Engineer
- Source: Naukri
- TAO Digital
- $18,782.2 to $31,303.67 /yr
- Hybrid
- Bengaluru
- Full-Time
- Mid level
Job Description
Key Responsibilities
Technical Leadership & Platform Ownership
- Serve as the technical lead and design authority for AWS data engineering initiatives across multiple enterprise platforms.
- Own architectural decisions related to scalability, reliability, security, and cost optimization of AWS data platforms.
- Define and enforce engineering standards, coding patterns, and operational best practices for cloud data pipelines.
- Provide handson technical guidance, design reviews, and code reviews for data engineers.
AWS Data Platform Engineering
- Lead the design, development, and support of cloudnative data pipelines using Amazon S3, AWS Glue (PySpark), MWAA (Apache Airflow), and AWS Step Functions.
- Drive onpremises to AWS data platform migrations, including reverse engineering of legacy ETL workflows and reimplementation using AWSnative services.
- Rearchitect legacy Oracle Data Integrator (ODI)based ETL processes into scalable PySparkbased Glue jobs.
- Optimize Spark workloads for performance, memory usage, and cost efficiency in AWS Glue environments. Role & responsibilities
Preferred candidate profile
Skills
- amazon-web-services
- amazon-s3
- aws-glue
- pyspark
- Airflow
- apache-airflow
- aws-step-functions
- oracle
