AWS Databricks Engineer
- Source: Naukri
- Tekskills Inc.
- On-site
- Hyderabad
- Full-Time
- Mid level
Job Description
Job Summary
- We are looking for a skilled AWS Databricks Engineer to design, build, and optimize scalable data pipelines and analytics solutions on cloud platforms.
- The ideal candidate should have strong hands-on experience with Databricks, Spark, and AWS services.
Responsibilities
- Design and develop scalable data pipelines using Databricks and Apache Spark
- Build ETL/ELT workflows using Python, SQL, and PySpark
- Integrate data from multiple sources (structured & unstructured)
- Optimize data processing and performance on Databricks clusters
- Work with AWS services like S3, Glue, Redshift, Lambda, EC2, and RDS
- Implement data governance, security, and best practices
- Collaborate with data engineers, analysts, and business stakeholders
Required Skills
- Databricks
- Spark
- PySpark
- SQL
- AWS
- Glue
- Redshift
Nice to Have
- Delta Lake
- MLflow
- Lakehouse architecture
- Airflow
- Kafka
- Streaming data pipelines
Immediate joiners preferred.
Skills
- amazon-web-services
- azure-databricks
- databricks
- Spark
- Python
- pyspark
- amazon-s3
- aws-glue
- amazon-redshift
- aws-lambda
- amazon-ec2
- amazon-rds-for-mysql
- delta-lake
- ml-flow
- mlflow
- Airflow
- apache-airflow
- Kafka
