Sr. Data Engineer with Azure Databricks
- Source: Indeed
- Aurum Groups
- from $125,000 /yr
- On-site
- Warren Township
- Full-Time
- Senior
Job Description
Job Summary
Position :- Sr. Data Engineer with Azure Databricks
Location :- Warren, NJ (Onsite)
Visa Work :- Only USC/ GC EAD/ H4 EAD/L2 EAD/H1B
Over All Experience :- 15+ Years
Mandatory Azure Databricks Certification
Mandatory Skills : Azure, ADF, SQL, Databricks, Python , lakehouse
Key Responsibilities
Lead the architecture, design, and delivery of scalable enterprise data platforms using Azure Databricks,
Delta Lake, and lakehouse patterns.
Build and optimize reliable batch and real-time data pipelines for analytics, reporting, and Al workloads.
Establish reusable engineering frameworks, coding standards, CI/CD practices, and performance and cost-optimization strategies.
Implement data governance, security, lineage, and quality controls, including Unity Catalog capabilities.
Provide technical leadership, mentor engineering teams, and collaborate with business, architecture, analytics, and data science stakeholders.
Key Skills
Azure Databricks and Lakehouse: Databricks platform, Delta Lake, Unity Catalog, and enterprise lakehouse architecture.
Data Engineering: Apache Spark, BySpark or Scala, advanced SQL, ETL/ELT design, and distributed processing
Azure Data Services: Azure Data Factory, ADLS Gen2, Synapse Analytics, Key Vault, Monitor, and Log Analytics.
Architecture and Governance: Data modeling, security, data quality, lineage, scalability, and performance optimization.
Engineering Leadership: Azure DevOps, CI/CD, Agile delivery, stakeholder management, mentoring, and technical roadmap development.
Pay: From $125,000.00 per year
Benefits:
- Employee assistance program
- Health insurance
- Professional development assistance
Work Location: In person
Skills
- microsoft-azure
- azure-databricks
- databricks
- Python
- delta-lake
- unity-3d
- Spark
- Scala
- azure-data-factory
- azure-synapse
- azure-key-vault
- vault
- azure-monitor
- azure-devops
