STAFF, SOFTWARE ENGINEER

Position Summary… What youll do… Skillset: Python or Scala, Spark, Kafka, Azure, GCP, Airflow Experience range: 9 - 14 years

About the Team :

Enterprise Business Services is invested in building a compact, robust organization that includes service operations and technology solutions for Finance, People, Associate Digital Experience.

Our team is responsible for design, development, and operations of large-scale data systems operating at petabytes scale. We focus on creating pipelines, curating and aggregating huge data, distributed spark infrastructure. We interact with multiple teams across the company to provide scalable robust technical solutions.

This role will focus on Data engineering and ETL development. A majority of the transformation logic will be in Databricks. A strong understanding of creating workflow is needed. This role will assist in ETL design leveraging standard Data Warehousing techniques and functional programming techniques.

What youll do:

• Design, build, test, and deploy cutting-edge data solutions at Walmart scale, impacting millions of customers worldwide.
• Develop high-performance, scalable Spark and Big Data solutions to extract, transform, and load large-scale datasets.
• Perform root cause analysis on data and processes to answer business questions and identify improvement opportunities.
• Build and optimize data pipelines, architectures, and datasets handling terabytes and petabytes of data.
• Collaborate with Walmart engineering teams across geographies to leverage expertise and contribute to the technology community.
• Partner with Product Management and business teams to drive priorities and deliver innovative product features.
• Work closely with Data Engineers to evaluate and implement open-source tools through research, POCs, and pilot programs.
• Support business and product teams by building data solutions and developing deep expertise in data analytics.
• Collaborate with team members to define best practices and meet client requirements for software development.
• Analyze and test programs and products before launch to ensure high-quality performance.
• Develop solutions and monitoring mechanisms to ensure software security and protect sensitive information.
• Continuously identify opportunities to enhance software performance, scalability, and effectiveness.
• Mentor, coach, and support team members to strengthen their confidence and proficiency in software applications.
• Contribute to a culture of innovation, collaboration, and continuous improvement across the engineering organization

What youll bring:

• Bachelor s or master s degree in computer science or a related technical field.

• 11 years of hands-on object-oriented programming experience in Python.

• 8+ years of hands-on in Database Fundamentals, SQL, PLSQL, Store Procedures.

• 7+ years of experience in designing and developing large-scale, fault-tolerant, highly scalable data pipelines using big data technologies (e.g., Apache Spark, Kafka, Cassandra, Hadoop, Hive, Presto, Airflow).

• Strong understanding experience in system design, algorithms, distributed systems, and high-scale data processing.

• Deep understanding of ETL, Data Modeling Data Warehousing concepts.

• Strong programming expertise to understand requirements, design high-level low-level solutions (HLD/LLD), and implement design patterns with S.O.L.I.D principles.

• Experience in end-to-end product development, emphasizing configuration-driven, behavior-driven, and test-driven development (including unit test cases and DevOps best practices).

• Designing systems that gracefully handle failures, high concurrency, data inconsistencies, and edge cases.

• Ensuring zero data loss and 100% accuracy in data pipelines, even under high-volume traffic.

• Implementing and tuning systems that process petabytes of data with sub-second latency.

• Experience in mentoring junior resources
• Platform driven approach.

-Implementing fine-grained access controls, encryption, and data masking techniques.

• Implementing real-time monitoring, logging, tracing, and alerting to ensure high availability and proactive issue resolution.

• Writing robust integration, regression, and performance test cases to detect defects early.

• Experience with Jenkins, GitHub Actions, or GitLab CI/CD to streamlin…