Software development Engineer - Java

Job Title: Software development Engineer - Java Hadoop Apache Spark AWS 3y to 5y

Role Overview:

We are looking for a highly motivated Software Development Engineer (SDE) with 3 5 years of experience in Big Data Engineering and Data Analytics to design, develop, and optimize scalable data platforms and distributed processing systems. The ideal candidate should have strong expertise in Java/Scala-based backend development, big data technologies, and cloud-native data processing frameworks. The role involves building high-performance data pipelines, processing large-scale datasets, and contributing to the architecture and implementation of modern data platforms.

The candidate will collaborate with cross-functional teams including product, analytics, platform engineering, and operations teams to deliver reliable, scalable, and efficient data solutions that power critical business insights and applications.

Key Responsibilities

• Design, develop, test, and maintain scalable data processing applications and distributed systems.
• Build and optimize large-scale batch and streaming data pipelines.
• Develop high-performance solutions using Java and/or Scala for data-intensive workloads.
• Work with big data ecosystems to process, transform, and analyze large datasets efficiently.
• Participate in system design discussions and contribute to High-Level Design (HLD) and Low-Level Design (LLD) activities.
• Implement software engineering best practices including Test-Driven Development (TDD), code reviews, CI/CD, and automated testing.
• Troubleshoot production issues and drive performance optimization initiatives.
• Collaborate with data engineers, architects, product managers, and business stakeholders to deliver data-driven solutions.
• Ensure reliability, scalability, security, and maintainability of data platforms and applications.
• Contribute to technical documentation, architecture reviews, and knowledge-sharing initiatives.

About You :

• Professional Experience: 3 5 years of experience in software development with a focus on big data platforms and analytics systems
• Foundational Knowledge: Strong academic background in Data Structures & Algorithms, Operating Systems, Database Management Systems, Computer Networks, and Object-Oriented Programming.
• Core Competencies: Ability to build scalable and reliable distributed applications, strong problem-solving and analytical skills, experience in Agile environments, excellent communication and stakeholder collaboration, and a proven ability to learn new technologies quickly.
• Big Data & Analytics: Apache Spark, Hadoop, MapReduce, Apache HBase, data pipeline development, and large-scale data processing.
• Programming: Expert-level proficiency in Java and Scala; strong foundation in data structures, algorithms, and concurrency.
• Cloud & Platform: Experience with AWS, Amazon EMR, Amazon EKS, and Kubernetes.
• Data Streaming & Orchestration: Proficient with Apache Kafka, Apache Oozie, and Hue.
• DevOps & Tools: CI/CD pipeline implementation, GitHub, and SVN.
• Architecture & Engineering: Expertise in HLD/LLD, Microservices design patterns, and TDD practices.
• Education: Bachelors degree (BE/B.Tech) in Computer Science, IT, or Software Engineering from a reputed university.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.