Job Closed
Azure Databricks Architect (Local to NJ Only)
- Source: LinkedIn
- Extend Information Systems Inc.
- On-site
- Edison
- Mid level
Job Description
Job Title: Azure Databricks Architect
Location: Edison, NJ (Hybrid)
Duration: Long Term Contract
Job Description:
Azure Databricks Data Engineering Lakehouse Architecture
Skills
Mandatory Skills: Azure Databricks
Must Have Skills
- Strong experience in designing and developing data pipelines and ETLELT workflows using Azure Databricks
- 15 to 20 years of total experience
- Expertise in Apache Spark PySpark, Scala and SQL for largescale data processing
- Handson experience with Delta Lake and Lakehouse architecture
- Experience in building scalable optimized and performant data pipelines
- Strong understanding of data modeling data integration and big data processing frameworks
- Experience with Azure ecosystem ADLS ADF Synapse
- Knowledge of data governance security and data quality frameworks within Databricks
- Ability to monitor troubleshoot and optimize Databricks workloads and performance
- Experience working with cross functional teams for integrating data solutions
- Proven experience in architectural design and data engineering strategy planning
- Experience with machine learning workflows on Databricks MLflow model deployment
- Familiarity with Unity Catalog data lineage and governance frameworks
- Exposure to CICD DevOps and orchestration tools Airflow Azure DevOps
- Experience with streaming frameworks Kafka Structured Streaming
- Knowledge of BI tools such as Power BI
- Domain exposure in Insurance Financial Services
- Experience in evaluating and adopting emerging data engineering tools and technologies
Soft Skills
- Strong technical leadership and mentoring abilities
- Excellent stakeholder management and requirement translation skills
- Effective communication and collaboration across business and technical teams
- Problem solving mindset with focus on performance optimization and innovation
- Ability to drive best practices code quality and continuous improvement initiatives
- Strategic thinking with ability to contribute to enterprise data architecture decisions
Skills
- microsoft-azure
- azure-databricks
- databricks
- Spark
- pyspark
- Scala
- delta-lake
- azure-synapse
- ml-flow
- mlflow
- unity-3d
- Airflow
- apache-airflow
- azure-devops
- Kafka
- power-bi
This job is no longer accepting applications.
Join the Club — Free ForeverYou missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
