AWS Glue Developer - 26 Aug (Wednesday)- 5-8yrs- Video Interview
- Source: Naukri
- Tata Consultancy Services
- On-site
- Hyderabad
- Full-Time
- Mid level
Job Description
- Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage efficiently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.
Key Responsibilities*
- Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage effeciently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.
Skills
- amazon-web-services
- aws-glue
- aws-lambda
- aws-step-functions
- Python
- pyspark
- azure-databricks
- databricks
- PostgreSQL
- MongoDB
