Data Engineer_ Python/pyspark + AWS
- Source: Naukri
- Tata Consultancy Services
- On-site
- Hyderabad
- Full-Time
- Mid level
Job Description
Role & responsibilities
Total Experience > 8 Years with 6 Years of relevant Experience
Should have working experience:
- Development: Python, PySpark & with Spark Framework
-
Cloud: 2+ years experience AWS Services (Lambda, S3, Glue, Step Functions, Event Bridge, ECS, EKS)
- DevOps & IaC tooling: Terraform, CI/CD pipelines, Git
- Python (preferred) or PowerShell scripting
- SonarQube and Veracode.
- Proficiency with automated testing tools (e.g. Pytest, Scalates).
- Knowledge of RESTful and microservice architectures.
Preferred candidate profile
- Looking for immediate joiners or candidates serving notice period of upto 15 days for Data Engineer (Python, PySpark with Spark Framework & AWS)role in Hyderabad.
Skills
- Python
- pyspark
- amazon-web-services
- Spark
- spark-framework
- aws-lambda
- amazon-s3
- aws-glue
- aws-step-functions
- bridge
- amazon-ecs
- amazon-eks
- Terraform
- powershell
- sonarqube
- veracode
- Pytest
