Manager - Azure Databricks - MosaicAI

Job Description

Role & responsibilities

Responsibilities

Designing and implementing scalable data infrastructure and systems to support efficient data processing and analysis
Developing and managing data pipelines, integration, and transformation solutions using Azure Databricks and other data engineering platforms
Leading teams in the strategic planning and execution of data-driven projects, confirming alignment with client expectations
Utilizing advanced technologies such as Apache Hadoop and Apache Airflow to enhance data processing capabilities
Overseeing the deployment and optimization of data warehouses, confirming data quality and security
Collaborating with business and technology leaders to identify and address data challenges and opportunities
Mentoring team members to develop their skills and encourage innovation in data engineering practices
Validating data integrity and compliance within analytics frameworks to support informed decision-making
Promoting the use of cloud-based analytics platforms like Snowflake and AWS for enhanced insights generation
Encouraging a culture of continuous learning and development within the team to adapt to evolving data technologies

What You Must Have

What Sets You Apart

Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
Demonstrating proficiency in Microsoft Azure Databricks and Snowflake platforms
Utilizing advanced data engineering techniques for complex data transformations
Excelling in strategic planning and execution within data modernization projects
Leading teams in agile environments to deliver data-driven solutions
Mentoring junior staff to enhance their data engineering capabilities
Embracing technology and innovation to drive client success

Preferred candidate profile