Azure Data Engineer

Job Details

• Location: Hyderabad, Telangana
• Working Schedule: Full-Time
• Work Arrangement: Hybrid
• Relocation Assistance Available: No

Role Overview

This role involves designing, developing, and maintaining cloud-native data solutions while working in an Agile environment.

Key Responsibilities

• Modern Data Platform Development:
  • Build data lake components on cloud-based platforms.
  • Design and develop data marts for business analysts and data scientists.
• Data Engineering Pipelines:
  • Design data pipelines to integrate structured, semi-structured, and unstructured data from multiple sources.
  • Implement ETL/ELT processes to transform and cleanse data.
  • Ensure data quality and transformation rules align with enterprise standards.
  • Work with Medallion architecture and implement best practices for data modeling.
• Agile DevOps Practices:
  • Deliver solutions using Agile methodologies in a CI/CD-driven environment.
  • Work on containerized solutions (Azure Kubernetes) and scheduling tools like Azure Scheduler.
  • Follow secure coding practices and authentication/authorization protocols.

Candidate Qualifications

• Education: Bachelor’s degree in Computer Science or equivalent.
• Experience:
  • 4 - 8 years of experience in data engineering or data application development (ETL/ELT/BI).
  • 2+ years of experience in cloud-based data platform development.
  • Expertise in building Azure-based data pipelines, including:
    • Azure Data Factory / Synapse
    • DataBricks / Synapse Spark Pool
    • Cosmos DB
    • Azure Data Lake Storage (ADLS)
    • Dedicated SQL Pool / Azure SQL
    • Azure Logic Apps
  • Hands-on experience with data transformation cleansing using Spark, Python, R, SQL.
  • Strong understanding of CI/CD, test-driven development, and domain-driven design.

Skills Competencies

• Technical Expertise:
  • Proficiency in Python, SQL, Spark, Azure Data Factory, and ETL processes.
  • Experience in secure coding, authentication, and monitoring tools like Veracode, MS Entra, PingOne.
  • Working knowledge of Azure Kubernetes, Azure DevOps, SonarQube, and Azure AppInsights.
• Soft Skills:
  • Strong communication and collaboration in global, multi-cultural environments (Japanese experience is a plus).
  • Able to work in a high-paced, diverse environment with a can-do attitude.
• Language:
  • Business proficiency in English; Japanese language is a plus.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.