AWS Data Engineer - Chennai, Bangalore, Hyderabad,Pune,Mumbai!
- Source: Naukri
- SP Staffing
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
Work Location: Chennai, Bangalore, Hyderabad,Pune,Mumbai
Experience: 8+yrs
Required Skills:
- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks, PySpark, Python, and SQL.
- Develop batch and streaming data processing solutions using Apache Spark/PySpark.
- Implement data ingestion, transformation, cleansing, validation, and aggregation processes.
- Develop and optimize Databricks notebooks, jobs, workflows, clusters, and Delta Lake solutions.
- Work with AWS data services such as S3, Glue, Lambda, Redshift, Athena, EMR, IAM, and CloudWatch.
- Develop and manage data integration pipelines using Azure Data Factory (ADF) where required in hybrid/multi-cloud environments.
- Build and manage workflow orchestration using Apache Airflow.
Thanks & Regards
SUganya R
Skills
- amazon-web-services
- azure-databricks
- databricks
- pyspark
- Python
- Spark
- delta-lake
- amazon-s3
- aws-glue
- aws-lambda
- amazon-redshift
- amazon-athena
- amazon-emr
- aws-iam
- amazon-cloudwatch
- microsoft-azure
- azure-data-factory
- Airflow
- apache-airflow
