Aws Data Engineer

Given your work experience, we believe it would be a great opportunity for you to progress in your career at Capgemini.

AWS Data Engineer

Location: Hyderabad/Chennai/Bangalore

Experience: 3.5 - 6 Years

We are seeking a skilled AWS senior Developer to join our dynamic team. The ideal candidate will have strong expertise in designing, implementing, and maintaining data pipelines on AWS platform. As an AWS senior Developer, you will play a key role in building robust, scalable, and efficient data processing pipelines to support our organization’s data-driven initiatives.

Responsibilities:

• Design, develop, and implement data pipelines on AWS platform using various AWS services such as AWS Glue, AWS Data Pipeline, AWS Lambda, AWS Batch, etc.
• Expertise on Amazon RDS.
• Collaborate with cross-functional teams including Data Engineers and Business Analysts to understand data requirements and design appropriate data pipelines.
• Build data ingestion pipelines to collect data from various sources such as databases, APIs, SharePoint, SFTP, Excel files.
• Optimize and fine-tune data pipelines for performance, scalability, and reliability.
• Ensure data quality and integrity throughout the data pipeline process by implementing appropriate data validation and cleansing techniques.
• Monitor and troubleshoot data pipeline issues, identify bottlenecks, and implement solutions to enhance pipeline efficiency.
• Implement security best practices to ensure data privacy and compliance with regulatory requirements.
• Document technical specifications, deployment procedures, and operational guidelines for data pipelines.
• Stay updated with the latest AWS services, tools, and best practices in data engineering and recommend innovative solutions to improve data pipeline infrastructure.
• Provide technical guidance and support to junior team members and collaborate with other teams to drive continuous improvement initiatives.

Requirements:

• Proven experience as a Data Engineer, Software Engineer or similar role with a focus on building data pipelines with an over all experience between 6 10 years.
• Strong proficiency in AWS cloud services such as AWS Glue, AWS Data Pipeline, AWS Lambda, AWS Batch, Amazon S3, Amazon Redshift, etc.
• Hands-on experience with programming languages such as SQL, Python, Java, or Scala for building data processing applications.
• Solid understanding of data modeling, ETL (Extract, Transform, Load) processes, and data warehousing concepts.
• Experience with big data technologies such as Apache Spark, Hadoop, or Apache Kafka is a plus.
• Familiarity with DevOps practices and tools for continuous integration and deployment (CI/CD) is desirable.
• Excellent problem-solving skills and the ability to work effectively in a fast-paced environment.
• Experience with Azure platform will be a big plus
• Strong communication skills with the ability to effectively collaborate with cross-functional teams.
• AWS certification(s) such as AWS Certified Developer, AWS Certified Data Analytics - Specialty, or AWS Certified Solutions Architect is a plus.