Software Development Engineer II

About the role We are looking for an experienced Data Engineering Developer (SDE2) to design and build scalable, high-performance data solutions. The ideal candidate will have strong expertise in Apache Spark, Databricks, and Scala, with a passion for building reliable data pipelines and ensuring data quality at scale. If you enjoy solving complex data challenges and working in a fast-paced, collaborative environment, we’d love to hear from you

You will be responsible for

Design, develop, and maintain scalable and reliable ETL pipelines using Apache Spark and Databricks.

Write high-performance, production-grade Scala code for data processing and transformation.

Implement and manage observability, monitoring, and alerting frameworks to ensure system health and data integrity.

Develop and maintain CI/CD pipelines for data applications and infrastructure using tools such as GitHub Actions or Azure DevOps.

Ensure adherence to data governance, data quality, and security best practices across all data systems.

Collaborate closely with cross-functional teams including platform, analytics, and product teams to deliver robust data solutions.

Continuously improve system performance, scalability, and operational excellence through best engineering practices.

Stay updated with emerging technologies, including advancements in Generative AI (GenAI), and evaluate their applicability to data platforms.

You will need Strong hands-on expertise in Apache Spark and Databricks.

Proficiency in Scala, with a solid understanding of functional programming concepts.Experience in building and maintaining scalable ETL/data pipelines.Hands-on experience with CI/CD tools and practices (e.g., GitHub Actions, Azure DevOps).Experience in implementing monitoring, logging, and alerting systems for distributed data platforms.Good understanding of data governance, security, and data quality principles.Strong analytical, problem-solving, and debugging skills.Ability to work effectively in a collaborative, Agile environment.ShapeNice-to-Have:Exposure to Generative AI (GenAI) or AI/ML data pipelines.Experience working with cloud platforms (Azure/AWS/GCP).

Whats in it for you?

At Tesco, we are committed to providing the best for you. 

 

As a result, our colleagues enjoy a unique, differentiated, market- competitive reward package, based on the current industry practices, for all the work they put into serving our customers, communities and planet a little better every day. 

 

Our Tesco Rewards framework consists of pillars - Fixed Pay, Incentives, and Benefits.  

 

Total Rewards offered at Tesco is determined by four principles -simple, fair, competitive, and sustainable. 

 

Salary - Your fixed pay is the guaranteed pay as per your contract of employment. 

 

Leave & Time-off - Colleagues are entitled to 30 days of leave (18 days of Earned Leave, 12 days of Casual/Sick Leave) and 10 national and festival holidays, as per the company’s policy. 

 

Making Retirement Tension-FreeSalary - In addition to Statutory retirement beneets, Tesco enables colleagues to participate in voluntary programmes like NPS and VPF. 

 

Health is Wealth - Tesco promotes programmes that support a culture of health and wellness including insurance for colleagues and their family. Our medical insurance provides coverage for dependents including parents or in-laws. 

 

Mental Wellbeing - We offer mental health support through self-help tools, community groups, ally networks, face-to-face counselling, and more for both colleagues and dependents.  

 

Financial Wellbeing - Through our financial literacy partner, we offer one-to-one financial coaching at discounted rates, as well as salary advances on earned wages upon request.  

 

Save As You Earn (SAYE) - Our SAYE programme allows colleagues to transition from being employees to Tesco shareholders through a structured 3-year savings plan.  

 

Physical Wellbeing - Our green campus promotes physical wellbeing with facilities that include a cricket pitch, football field, badminton and volleyball courts, along with indoor games, encouraging a healthier lifestyle. 

About Us At Tesco, inclusion is at the heart of everything we do. We believe in treating everyone fairly and with respect, valuing individuality and uniqueness to create a true sense of belonging. Diversity and inclusion are deeply embe…