Azure Data Engineer
- Source: Naukri
- EY
- On-site
- Bengaluru
- Full-Time
- Mid level
Job Description
Roles and Responsibilities :
- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures for big data workloads on Microsoft Azure platform.
- Develop machine learning models using PySpark and Python libraries such as scikit-learn or TensorFlow to solve complex business problems.
- Troubleshoot issues related to ADF workflows, ML models, and other Azure services.
Job Requirements :
- 4-7 years of experience in a similar role as an AI Data Engineer expertise in artificial intelligence, generative AI, large language modeling, retrieval augmented generation.
- Strong proficiency in working with Microsoft Azure platform including Data Bricks, Databricks Notebooks, Function Applications etc. .
- Experience with developing machine learning models using popular Python libraries like scikit-learn or TensorFlow.
Skills
- microsoft-azure
- azure-data-factory
- microsoft-azure-storage
- pyspark
- Python
- Scikit-learn
- Tensorflow
- azure-databricks
- databricks
