Senior AWS Data Engineer

Software Guidance & Assistance, Inc. (SGA) is searching for a Senior AWS Data Engineer for a C ontract assignment with one of our premier Financial Services clients located in Midtown, NYC. This role follows a hybrid schedule requiring 2 days onsite and 3 days remote .

Responsibilities The Senior AWS Data Engineer will design, build, and optimize cloud-native data platforms and AWS Data Lake solutions supporting enterprise-scale data workloads. This individual will work closely with data engineers, software engineers, architects, and business stakeholders to deliver secure, scalable, and highly available data solutions leveraging AWS native services.

Key responsibilities include:

• Design, build, and support enterprise-scale AWS Data Lake solutions utilizing Amazon S3, AWS Glue, Athena, Glue Data Catalog, and Lake Formation.
• Design, develop, and optimize scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, EMR, PySpark, and related AWS services.
• Design and support cloud-native data lake and data warehouse architectures for enterprise analytics and reporting.
• Engineer, administer, and optimize Aurora MySQL and AWS RDS database environments, including performance tuning, backup and recovery, replication, monitoring, and SQL optimization.
• Develop Python-based automation for data ingestion, transformation, monitoring, and operational support.
• Build and maintain Infrastructure-as-Code deployments using Terraform and/or CloudFormation.
• Develop and support Git-based CI/CD pipelines for AWS data platform deployments.
• Implement data governance, metadata management, lineage, cataloging, and security controls using AWS Glue Data Catalog, Lake Formation, and related AWS services.
• Collaborate with architects and engineering teams to define scalable data models, ingestion patterns, and cloud data platform best practices.
• Monitor production environments, troubleshoot complex issues, and drive continuous improvements in automation, performance, scalability, and reliability.
• Participate throughout the SDLC including design, development, testing, deployment, and production support.
• Participate in scheduled after-hours deployments and production support as required.
• Ensure compliance with enterprise security, governance, and cloud operational standards.

Required Skills

• 5+ years of hands-on AWS Data Engineering experience building enterprise cloud-native data platforms.
• Strong hands-on experience designing, building, and supporting AWS Data Lake solutions utilizing Amazon S3, AWS Glue, Athena, Glue Data Catalog, and Lake Formation.
• Strong experience developing ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, EMR, PySpark, and related AWS technologies.
• Strong Aurora MySQL and/or AWS RDS MySQL database engineering experience, including performance tuning, backup/recovery, replication, monitoring, and SQL optimization.
• Strong proficiency in Python and SQL for data engineering, automation, and complex data transformations.
• Experience designing cloud-native data lake and data warehouse architectures.
• Experience implementing Infrastructure-as-Code using Terraform and/or CloudFormation.
• Experience developing and supporting Git-based CI/CD pipelines.
• Experience implementing data governance, metadata management, lineage, and cataloging using AWS-native services.
• Strong understanding of AWS Cloud architecture, security, IAM, monitoring, and automation best practices.
• Excellent analytical, troubleshooting, collaboration, and communication skills.

Preferred Skills

• Financial services industry experience.
• Experience with Amazon Redshift or other enterprise data warehouse technologies.
• Experience with SageMaker or machine learning data pipelines.
• AWS Certifications (Data Analytics Specialty, Solutions Architect Associate/Professional, or equivalent).

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let’s work better together, we mean it. You’ll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/ .

SGA is an Equal Opportunity…