Senior Data Engineer with AWS & AI Experience - W2 Position

Title: Senior Data Engineer (AWS & Generative AI Experience)

Location: Raritan, NJ / Boston, MA / NYC, NY (5 Days Onsite)

Looking for Visa Independent Consultants - W2 Position

Job Description:

We are seeking an experienced Senior Data Engineer with strong expertise in AWS Cloud, Data Engineering, and Generative AI (Gen AI) to design, build, and optimize scalable data platforms and AI-enabled solutions. The ideal candidate should have extensive experience developing cloud-native data pipelines, modern data lake architectures, and integrating Large Language Models (LLMs) into enterprise applications. Experience in financial services is highly preferred.

Required Skills

• 10+ years of experience in Data Engineering.
• Strong hands-on experience with AWS Cloud services.
• Expertise in Python, SQL, and Spark.
• Experience building ETL/ELT pipelines.
• Strong knowledge of data warehousing concepts.
• Experience with Generative AI and Large Language Models (LLMs).
• Experience with Retrieval-Augmented Generation (RAG).
• Knowledge of vector databases and embeddings.
• Experience with prompt engineering and AI model integration.
• Strong understanding of REST APIs and microservices.
• Experience with CI/CD and Infrastructure as Code.
• Excellent communication and stakeholder management skills.

Responsibilities

• Design and develop scalable data pipelines on AWS.
• Build and maintain enterprise data lakes and data warehouses.
• Develop batch and real-time data processing solutions.
• Optimize ETL/ELT workflows for performance and reliability.
• Integrate Generative AI capabilities into enterprise applications.
• Design and implement RAG-based AI solutions.
• Develop APIs for AI-powered applications.
• Work with structured and unstructured datasets.
• Build data models to support analytics and machine learning workloads.
• Implement data quality, governance, security, and compliance standards.
• Collaborate with Data Scientists, ML Engineers, Product Owners, and Business Stakeholders.
• Optimize cloud infrastructure for scalability and cost efficiency.
• Mentor junior engineers and establish engineering best practices.
• Troubleshoot production issues and improve platform reliability.
• Participate in architecture discussions and technical design reviews.