Databricks Python Developer
- Source: LinkedIn
- Envision Technology Solutions
- On-site
- New York City
- Full-Time
- Mid level
Job Description
Role : Databricks Python Developer
Location: New York City, NY / Jersey, City, NJ (4 Days a week)
Must Have Technical/Functional Skills
• 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development.
• 5+ years of hands-on experience with Databricks, Python, and PySpark.
• Strong hands-on experience in Databricks, Python, and PySpark development.
• Experience building and supporting large-scale ETL/ELT data pipelines.
• Strong knowledge of Spark SQL, Delta Lake, and Data Lakehouse architecture.
• Experience working with structured and unstructured data from multiple sources.
• Strong SQL skills and experience with relational databases.
• Experience with data modelling, data transformation, and data quality processes.
• Knowledge of orchestration tools such as Airflow, ADF, or similar.
• Experience with Git, CI/CD, and Agile development methodologies.
• Strong analytical, debugging, and performance tuning skills.
• Excellent verbal and written communication skills.
Skills
- azure-databricks
- databricks
- Python
- pyspark
- Spark
- apache-spark-sql
- delta-lake
- Airflow
- apache-airflow
