Senior Software Engineer

Job highlights

• You have experience working in relation data systems,preferably PostgreSQL and SparkSQL
• You are proficient with bug tracking and test management toolsets to support development processes such as CI / CD.
• Job Summary. Overview Why we are looking for you: You have experience working as a Data Engineer with strong database fundamentals and ETL background

Job Summary

Overview Why we are looking for you: You have experience working as a Data Engineer with strong database fundamentals and ETL background. You have experience working in a Data warehouse environment and dealing with data volume in terabytes and above. You have experience working in relation data systems, preferably PostgreSQL and SparkSQL. You have excellent designing and coding skills and can mentor a junior engineer in the team. You have excellent written and verbal communication skills. You are experienced and comfortable working with global clients You work well with teams and are able to work with multiple partners including clients, vendors and delivery teams. You are proficient with bug tracking and test management toolsets to support development processes such as CI/CD.

Responsibilities

• Develop a deep understanding of the business context under which your team operates and present feature recommendations in an agile working environment.
• Lead, design and code solutions on and off database for ensuring application access to enable data-driven decision making for the company s multi-faceted ad serving operations.
• Working closely with Engineering resources across the globe to ensure enterprise data warehouse solutions and assets are actionable, accessible and evolving in lockstep with the needs of the ever-changing business model.
• This role requires deep expertise in spark and strong proficiency in ETL, SQL, and modern data engineering practices.
• Design, develop, and manage ETL/ELT pipelines in Databricks using PySpark/SparkSQL, integrating various data sources to support business operations.
• Lead in the areas of solution design, code development, quality assurance, data modelling, business intelligence.
• Mentor Junior engineers in the team.
• Stay abreast of developments in the data world in terms of governance, quality and performance optimization.
• Able to have effective client meetings, understand work, and drive successful outcomes.

Qualifications

• Bachelor s Degree or equivalent experience in Computer Science or equivalent degree is required.
• 5 - 8 years of data engineering experience with expertise using Apache Spark and Databases (preferably Databricks) in marketing technologies and data management, and technical understanding in these areas.
• Monitor and tune Databricks workloads to ensure high performance and scalability, adapting to business needs as required.
• Strong experience in Basic and Advanced SQL writing and tuning.
• Experience with Python
• Strong understanding of CI/CD practices with experience in Git for version control and integration for spark data projects.
• Strong understanding of Disaster Recovery and Business Continuity solutions
• Experience with scheduling applications with complex interdependencies, preferably Airflow
• Good experience in working with geographically and culturally diverse teams.
• Understanding of data management concepts in both traditional relational databases and big data lakehouse solutions such as Apache Hive, AWS Glue or Databricks.
• Excellent written and verbal communication skills.
• Ability to handle complex products.
• Excellent communication and problem-solving skills, with the ability to manage multiple priorities.
• Ability to diagnose and troubleshoot problems quickly.
• Detail oriented, able to multi-task, prioritize and able to quickly change priorities.
• Good time management.
• Good to have knowledge of cloud platforms (cloud security) and familiarity with Terraform or other infrastructure-as-code tools.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.