Databricks Platform Architect (Azure Databricks to AWS Databricks)
- Source: LinkedIn
- Droisys
- On-site
- Somerville
- Mid level
Job Description
Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.
Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for amazing talent who can contribute to our growth by delivering top results for our clients. Join us to challenge yourself and accomplish work that matters.
Job Title Databricks Platform Architect or Lead – Databricks (Azure to AWS)
Job Location Raritan, NJ [Onsite Work]
Duration 12 Months Contract
About the Role
- As a Data Platform Architect – Databricks (AWS), you will lead the architecture and design of a modern enterprise data platform built on Databricks and AWS. You will define the foundational architecture, governance standards, security controls, integration patterns, and operational frameworks that enable scalable, secure, and self-service data capabilities across the organization.
- Working closely with data engineers, cloud architects, platform teams, cybersecurity stakeholders, and program leadership, you will establish the technical direction of the platform and ensure it supports both current and future business needs.
Key Responsibilities
- Platform Architecture & Design
- Lead the end-to-end architecture and design of the Databricks Lakehouse platform on AWS
- Define foundational architecture components including landing zones, medallion architecture (Bronze, Silver, Gold), storage architecture, and compute strategies
- Establish scalable platform standards, frameworks, and engineering patterns to support enterprise-wide data initiatives
- Design platform capabilities that support both batch and real-time streaming workloads
- Define data access, consumption, and serving patterns that enable trusted and governed self-service analytics
- Ensure platform architecture is aligned with enterprise data strategy and long-term modernization objectives
AWS Infrastructure & Integration
- Design and govern the AWS infrastructure supporting the Databricks platform, including networking, security, storage, and identity architecture
- Define integration patterns with internal systems and AWS services including S3, Glue, Kinesis, EventBridge, and related data services
- Establish infrastructure-as-code standards using Terraform or equivalent tooling
- Collaborate with DevOps and Cloud Engineering teams to implement automated deployment and configuration management practices
- Ensure platform scalability, resiliency, performance, and operational efficiency across environments
Security, Governance & Compliance
- Embed security-by-design principles into all platform architecture decisions
- Lead the implementation and governance of Unity Catalog, including metastore design, workspace governance, and access control frameworks
- Ensure compliance with public sector security requirements, GDPR, and applicable regulatory frameworks
- Define platform-wide monitoring, observability, audit logging, and alerting capabilities
- Collaborate with Cyber Security, Risk, and Data Governance teams to establish enterprise governance controls and operational guardrails
Technical Leadership & Standards
- Serve as the senior technical authority for the Databricks platform architecture
- Establish engineering best practices covering Delta Lake design, workload orchestration, compute optimization, and cost management
- Provide technical assurance across platform implementation activities delivered by internal teams and external partners
- Define reusable architecture patterns, standards, and accelerators that improve consistency and delivery quality
- Continuously evaluate emerging Databricks and AWS capabilities and recommend innovative platform enhancements
Stakeholder Management & Advisory
- Engage with senior client stakeholders, program leadership, and governance boards to communicate architecture decisions and technical strategy
- Translate complex architecture concepts into clear and business-friendly communications
- Facilitate architecture reviews, technical workshops, and design governance sessions
- Build strong relation…
Skills
- azure-databricks
- databricks
- azure-arc
- microsoft-azure
- amazon-web-services
- amazon-s3
- aws-glue
- amazon-kinesis
- amazon-eventbridge
- Terraform
- unity-3d
- workspace
- guardrails
- delta-lake
- aws-iam
- amazon-vpc
- google-vpc
- amazon-cloudwatch
- Spark
- dbt
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
