Azure Databricks Data Engineer

Role description

Azure Databricks Data Engineer

Location Rartian NJ Onsite

Role Overview

We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practices

The ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processes

and working with Delta Lake technologies The candidate must possess excellent Python programming skills

a solid understanding of Unity Catalog and the ability to collaborate effectively within large crossfunctional teams

Key Responsibilities

Design develop and maintain scalable ETLELT pipelines Notebooks using Databricks

Build and optimize data processing solutions using PySpark and Python

Implement and manage data governance security and access controls using Unity Catalog

Work with Delta Lake features including Delta Sharing Time Travel Change Data Feed CDF and data optimization techniques

Develop and maintain CICD pipelines for Databricks deployments using industrystandard DevOps practices

Perform performance tuning and optimization of Databricks workloads

Collaborate with architects business analysts and stakeholders to understand data requirements and deliver solutions

Support production deployments troubleshooting monitoring and performance improvements

Follow coding standards documentation and best practices for software development lifecycle SDLC

Required Skills

Databricks Strong

Strong understanding of Databricks architecture and ecosystem

Handson experience with

Delta Lake

Delta Sharing

Unity Catalog

Structured Streaming

Workflow orchestration

Performance tuning and optimization

Data governance and access management

Experience with Medallion Architecture Bronze Silver Gold layers

Programming

Strong handson coding experience in Python

Experience with PySpark for largescale data processing

Good understanding of SQL and query optimization

DevOps CICD

Experience implementing CICD processes for Databricks workloads

Familiarity with Gitbased source control and branching strategies

Experience with deployment automation tools and DevOps pipelines

Data Engineering Concepts

ETLELT design patterns

Data modeling and data warehousing concepts

Data quality monitoring and observability frameworks

Good to Have Skills

AWS Cloud

AWS Glue

S3

IAM

Lambda

Azure Cloud

Azure Data Factory ADF

Azure Storage

Azure Databricks

Key Vault

Soft Skills

Excellent verbal and written communication skills

Strong problemsolving and analytical abilities

Ability to work effectively in a large global team environment

Strong stakeholder management and collaboration skills

Selfdriven proactive and able to work independently with minimal supervision”

Skills

Mandatory Skills : Databricks

Other details

Actual compensation within the range will be dependent upon the individual’s skills, experience, performance and internal equity.

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypic…