Walk-in || AWS + Pyspark Walk in
- Source: Naukri
- Tata Consultancy Services
- On-site
- Hyderabad
- Full-Time
- Mid level
Job Description
Role- Data Engineer
Required Technical Skill Set - ETL, SQL & AWS
Desired Experience Range - 5+ years
Location of Requirement-Hyderabad
Desired Competencies (Technical/Behavioral Competency)
Must-Have- Strong Knowledge of Aws Glue/AWS REDSHIFt/SQL/ETL.Good knowledge and experience in Pyspark for forming complex Transformation logic.
Good-to-Have- Python
SN Responsibility of / Expectations from the Role
1 Good knowledge of SQL and Data warehousing Concepts
2 Experienced in AWS cloud services such as AWS EC2, AWS S3, AWS Lambda, AWS Glue and AWS Redshift
3 Hand on knowledge of Using Python & Pyspark for Data transformations
4 Good knowledge in glue to write transformation logic/ call custom code written in SQL /Pysprak file with transformation logic
5 To handle complex data processing using air flow
6 Cloud watch, custom logging using python
7 To perform data quality analysis using glue/pyspark
Skills
- amazon-web-services
- pyspark
- aws-glue
- Python
- amazon-ec2
- amazon-s3
- aws-lambda
- amazon-redshift
