Data Platform Software Engineer- Min 3 Yrs

OLE OVERVIEW :

We are looking for a Data Platform Lead to own the design, build, and governance of our enterprise data platform. This is a role within the Data COE, responsible for driving platform maturity across a federated, multi-cloud environment. You will set engineering standards, eliminate data duplication and drift across domains, and enable reliable, governed data access - without creating centralisation bottlenecks.

KEY RESPONSIBILITIES :

• Design and evolve the enterprise data platform spanning Snowflake and Databricks across Azure and AWS

• Build and maintain production-grade ELT/ETL pipelines using Spark, dbt, Airflow, and Kafka

• Define and enforce platform standards for ingestion, transformation, storage, and access across federated domain teams

• Drive data quality, data contract adoption, and lineage visibility across the estate

• Own cloud storage architecture across S3 and ADLS; lead CI/CD practices for all platform assets

• Lead containerized workload deployment using Kubernetes for data platform services

• Coordinate with domain teams to align on standards; represent platform engineering in architecture forums

• Mentor mid-level engineers and conduct technical design reviews for platform-impacting changes

MUST-HAVE SKILLS :

• Snowflake - expert-level : data modelling, performance tuning, role-based access, zero-copy sharing, dynamic data masking

• Databricks - production experience : Delta Lake, Unity Catalog, cluster management, Databricks Workflows

• Python and SQL - strong proficiency; Scala advantageous

• Apache Spark - distributed data processing at scale

• Apache Kafka - real-time event streaming, pipeline design, topic management

• Apache Airflow - pipeline orchestration, DAG design, dependency management

• DBT - transformation layer modelling, testing, documentation

• Cloud storage - S3 and ADLS; familiarity with Parquet, Delta, and partitioning strategies

• Kubernetes - container orchestration for data platform services

• CI/CD - GitHub Actions or equivalent for data platform assets (pipelines, schemas, infra)

Pay: ₹1,500,000.00 per year

Work Location: In person