Our client is seeking an experienced Azure Data Engineer with strong expertise in Azure cloud services, Databricks, Python, SQL, and Apache Spark to develop and enhance scalable data pipelines and reliable data platforms.

Mandatory Requirement: Hands-on experience in the healthcare domain is essential , including working with healthcare data such as claims, encounters, ADT, FHIR, or EHR .

Key Responsibilities

• Develop and enhance Databricks data pipelines to support scalable and reliable data processing.
• Work with business-critical data and closely collaborate with business stakeholders.
• Apply data engineering best practices to build high-quality, highly available, and trusted data models .
• Scope and implement new entities within the unified data model .
• Gather business requirements and develop new datasets for the data platform.
• Identify, investigate, and resolve data quality issues to improve data reliability and user experience.
• Extract, transform, and integrate data from diverse and heterogeneous data sources .
• Design, implement, and support platforms that provide ad hoc access to large datasets .
• Model data and metadata to support machine learning and AI initiatives .

Required Skills

• 7+ years of experience with cloud-based services , with a focus on Azure for this Azure Data Engineer role.
• Experience working with healthcare data , such as claims, encounters, Admission/Discharge/Transfer (ADT), FHIR, and Electronic Health Records (EHR).
• Hands-on experience developing, maintaining, and enhancing Databricks data pipelines .
• Strong proficiency in Python, SQL, and Apache Spark .
• Excellent SQL and Spark debugging skills .
• Strong understanding of database structures, theories, principles, and practices .
• Knowledge of data modeling techniques , including normalized, dimensional, star schema, and snowflake schema models.
• Experience following Software Development Life Cycle (SDLC) best practices , including documentation, coding standards, code reviews, source control management, testing, deployment, and operations.
• Ability to work independently, investigate complex data issues, and proactively improve data quality.
• Strong written and verbal communication skills with the ability to collaborate effectively with technical and non-technical stakeholders.

Nice-to-Have Skills

• Databricks or Microsoft Azure certifications.
• A master’s degree in a healthcare-related field.
• Experience supporting data integration initiatives involving multiple healthcare systems.

About YMinds.AI

YMinds.AI connects organizations with skilled technology professionals and helps businesses identify talent aligned with their technical and project requirements. We focus on connecting specialized technology expertise with evolving business needs.

Keywords

Principal Azure Data Engineer, Azure Data Engineering, Microsoft Azure, Databricks, Data Pipelines, Python, SQL, Apache Spark, Healthcare Data, Data Engineering, Data Modeling, Data Integration, Data Quality, ETL/ELT, Unified Data Models, Claims Data, ADT, FHIR, EHR, Database Design, SDLC, Cloud Data Platforms.

Hashtags

AzureDataEngineer #PrincipalDataEngineer #MicrosoftAzure #Databricks #DataEngineering #Python #SQL #ApacheSpark #HealthcareData #DataPipelines #DataModeling #DataQuality #FHIR #EHR #YMindsAI