Azure Databricks Architect

Must Have Skills:

• Strong experience in designing and developing data pipelines and ETL/ELT workflows using Azure Databricks
• Expertise in Apache Spark PySparkScala and SQL for largescale data processing
• Handson experience with Delta Lake and Lakehouse architecture
• Experience in building scalable optimized and performant data pipelines
• Strong understanding of data modeling data integration and big data processing frameworks
• Experience with Azure ecosystem ADLS ADF Synapse
• Knowledge of data governance security and data quality frameworks within Databricks
• Ability to monitor troubleshoot and optimize Databricks workloads and performance
• Experience working with crossfunctional teams for integrating data solutions
• Proven experience in architectural design and data engineering strategy planning

Secondary - Nice To Have Skills:

• Experience with machine learning workflows on Databricks MLflow model deployment
• Familiarity with Unity Catalog data lineage and governance frameworks
• Exposure to CICD DevOps and orchestration tools Airflow Azure DevOps
• Experience with streaming frameworks Kafka Structured Streaming
• Knowledge of BI tools such as Power BI
• Domain exposure in Insurance Financial Services
• Experience in evaluating and adopting emerging data engineering tools and technologies

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law . https://www.e-verify.gov/sites/default/files/everify/posters/IER_RighttoWorkPoster.pdf