Aws data bricks
- Source: LinkedIn
- GGST Innovations Private Limited
- On-site
- Hyderabad
- Full-Time
- Mid level
Job Description
Databricks Development: Hands-on development skill using Databricks for large-scale data processing and analytics
Ø Data Engineering: Strong experience building and maintaining ETL / ELT pipelines
Ø Processing Frameworks: Apache Spark, PySpark, Spark SQL, Python, Scala, Power BI
Ø Delta Lake: Hands-on experience with Delta Lake (ACID transactions, schema evolution, performance optimization)
Ø Data Pipelines: Development of batch and near real-time data ingestion pipelines
Ø Data Modelling: Implementation of analytical and dimensional data models (Star / Snowflake)
Ø Cloud Storage: Experience with AWS cloud-based storage systems
Ø Development Best Practices: Adherence to coding standards, documentation, and data engineering best practices
Ø Collaboration: Working closely with architects, BI teams, and data science teams to deliver end-to-end solutions
Secondary Skill :
Ø Exposure to ML/AI workloads on Databricks, including feature engineering
Ø Familiarity with MLflow or similar model tracking tools
Ø Experience with Databricks CI/CD and Git-based version control
Ø Understanding of data governance, security, and compliance concepts
Ø Familiarity with Agile / Scrum delivery methodologies
Ø Domain experience in Insurance
Skills
- amazon-web-services
- azure-databricks
- databricks
- processing-js
- Spark
- pyspark
- apache-spark-sql
- Python
- Scala
- power-bi
- delta-lake
- Snowflake
- ml-flow
- mlflow
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
