AWS data engineer
- Source: Naukri
- Tata Consultancy Services
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
Roles and Responsibilities
- Design, develop, test, deploy, and maintain large-scale data pipelines using Scala and Spark on AWS.
- Develop complex SQL queries to optimize database performance and troubleshoot issues.
- Implement data quality checks and ETL processes to ensure accurate data processing.
Desired Candidate Profile
- 6-8 years of experience as a Data Engineer with expertise in Scala, Spark, Hadoop, Oozie, and AWS.
- Strong understanding of big data technologies such as Apache Spark and Hive.
- Proficiency in writing efficient SQL queries for querying large datasets.
- Experience working with cloud-based platforms like Amazon Web Services (AWS).
Skills
- amazon-web-services
- Scala
- Spark
- Hadoop
- apache-hadoop
