Sr. AWS Data Platform Cloud Engineer

Tech Lead Data Platform Cloud Engineer

Location: Hyderabad

Experience: 8-12 years

Immediate Joiners Preferred.

Mandatory Skills: AWS Cloud Infrastructure, Data Platform Engineering, Amazon Redshift Administration, Terraform Automation, Amazon Bedrock

Job Description :

• Design, build and maintain data platform infrastructure on AWS & Databricks environment with automation tools such as Terraform, Code pipeline, Code Build and Jenkins.
• Leverage AI tools on development (such as AWS Bedrock, Agent Core.. etc) of Infrastructure-as-code
• Monitor & manage all aspects of system security, performance, storage, incidents, usage, backup and recovery for databases, applications, and infrastructure on AWS
• Maintain and support Redshift Cluster and Schemas and business pipelines. Take ownership of the design, governance, performance tuning, capacity planning, data availability and operational aspects of the data solutions
• Use your coding skills across a number of languages (such as SQL, Python and/or Java) and develop appropriate instrumentation to collect metrics on system performance, cost, data ingress/egress /storage processes
• Work with information security and compliance teams in governing policies and procedures
• Have a clear understanding of building observability dashboards (such as Splunk, SignalFx, Grafana.. ect) for infra and Operational monitoring
• Coordinate infrastructure enhancements and maintenance with the system/network engineering teams
• Perform technology evaluations and testing to introduce new technologies to be adopted by the data platform team
• Participate in 24x7 on-call rotation to handle issues that occur outside of business hours

Requirements:

• Good years of experience with building and maintaining distributed and high-performance production environments in large-scale consumer enterprises.
• Development and deployment experience with most if not all of the following components of AWS in data space:
• Management - CloudWatch (Events/Logs), IAM, CloudTrail, EC2 Systems Manager and Splunk
• IaaS – EC2, VPC, EBS, ELB, KMS, SNS, Secrets Manager, S3 and Glacier
• Data Management – DMS, Redshift, RDS, EMR, Data Bricks, AWS Batch, Airflow Managed Service, Glue Services and Lambda
• CI/CD – Jenkins, AWS code pipeline, Code Build, Lambda
• Other - Server Migration, Storage Gateway, CDN
• Very good hands-on experience with development and deployment of above infrastructure with automation tools such as Terraform
• Strong Redshift database administration experience would be a plus
• Strong CS fundamentals, experience with one of the programming languages (Java, Python) and able to write pipelines for automation, metrics/data collection and system administration purposes
• Understanding automation and orchestration platforms such as Airflow/MWAA and AWS Step Functions.

• Ability to learn quickly and think outside of the box with excellent communication skills (written and oral).

• Management Level : 4C
• Primary location : 1401-G-India: Floor 1 to 12, Hafeezpet Phoenix, Hyderabad
• Remote type : Office
• Shift : Rotational