Be the Candidate They Can't Ignore.

Don't just send a resume; set yourself up so the right work finds you.

  • Look like a pro instantly with a stunning personal brand.

  • Gain instant "Top Ten" status so you aren't just another name in a pile.

  • Wake up to booked meetings instead of "rejection" emails.

Join the Club — Free Forever

SOFTWARE ENGINEER - DATA ENGINEERING

  • Source: Naukri
  • Caterpillar Inc
  • On-site
  • Bengaluru
  • Full-Time
  • Mid level

Job Description

Job Summary

Career Area: Technology, Digital and Data

We are looking for a highly motivated and experienced Data Engineer to join our data engineering team. The ideal candidate will have a strong background in building scalable data pipelines using the AWS cloud stack and extensive hands-on experience with Snowflake. Proficiency in Python and SQL, along with graph and vector database technologies, is essential. This role requires strong problem-solving abilities and a proactive mindset to deliver efficient, scalable, and reliable data solutions.

This position requires working onsite five days a week.

Relocation is available for this position.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines on AWS using services such as S3, Glue, Lambda, Redshift, and EMR.
  • Build and optimize data warehousing solutions using Snowflake, including performance tuning and data modeling.
  • Write efficient and reusable code in Python and SQL for data transformation and processing.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements.
  • Monitor, troubleshoot, and improve pipeline performance and reliability.
  • Ensure data quality, integrity, and security across all stages of the pipeline.
  • Participate in code reviews, architecture discussions, and continuous improvement initiatives.

Required Qualifications

  • 5-8 years of experience in data engineering or related roles.
  • Strong hands-on experience with AWS cloud services, including data and AI workloads.
  • Deep understanding of Snowflake architecture, performance tuning, and best practices.
  • Advanced proficiency in Python and SQL for data pipelines, transformations, and services.
  • Strong understanding of graph and vector data modelling concepts and their practical applications.
  • Experience developing and operating CI/CD pipelines (GitHub Actions) and cloud native deployments.
  • Experience working with Azure DevOps (AzDO) boards for backlog management in Agile environments.
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration abilities.
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Nice to Have Skills

  • Knowledge of the NVIDIA ecosystem and its applications in data and AI.
  • Hands-on experience with Vector (Milvus or similar) and Graph (Neo4J or similar) databases.

Preferred Qualifications

  • Experience with orchestration tools such as AWS Step Functions.
  • Familiarity with data governance and compliance practices.
  • Exposure to real-time data processing frameworks (e.g., Kafka, Spark Streaming).

Locations

Bangalore, Karnataka; Chennai, Tamil Nadu

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

Skills

  • amazon-web-services
  • amazon-s3
  • aws-glue
  • aws-lambda
  • amazon-redshift
  • amazon-emr
  • Snowflake
  • Python
  • microsoft-graph
  • Github
  • github-actions
  • microsoft-azure
  • azure-devops
  • nvidia
  • Milvus
  • neo4j
  • aws-step-functions
  • Kafka
  • Spark
  • apache-spark-streaming

Create Free Account & Apply
  • Free personal website
  • Built-in Talent Agent
  • Apply to future jobs in 1 click
  • Get matched to similar roles
or
Apply as a guest this time

You'll apply successfully, but won't be able to track your application, save this job, or get matched to similar roles.

This listing is a publicly available opportunity curated by Try Club to help talent discover relevant roles. Try Club is an independent platform and is not affiliated with Caterpillar Inc

Get Similar Jobs

Browse more similar roles on TRY and find your perfect match.

Show Me Similar Jobs

Stop Searching. Start Thriving.

Why waste time chasing leads when the perfect projects can find you?
With TRY, clients actively searching for professionals with your skills can discover you in seconds. Whether it's a quick gig or your dream role, we connect you with opportunities that matter.

  • Get found faster
  • Let projects come to you
  • Build a career on your terms

Take control of your career today.

Claim Free Website in 2 Minutes