Job Title: Senior Data Engineer (Databricks & AI Solutions)

💼 Experience Required: 6 to 11 Years

💎 Annual CTC Budget: Best in Industry (As per market standards)

📍 Location: Hyderabad

⚠️ MANDATORY CRITICAL MATCH CRITERIA (READ FIRST):

✅ Experience: 6 to 11 years of dedicated Data Engineering experience. A stable career history with a mandatory minimum of 2 years per organization is strictly required.

✅ Education: B.E. / B.Tech / M.E. / M.Tech / MCA / M.Sc in Computer Science or related fields.

✅ Core Skills: Hands-on experience in Lakehouse Architecture, PySpark, Spark Structured Streaming, Databricks Lakeflow (CDC, Declarative Pipelines), and AI/GenAI integrations (LLMs, RAG, Vector Search).

✅ Software/Tools: Databricks, PySpark, Delta Lake, Unity Catalog, SQL, NoSQL, Git, Databricks Asset Bundles (DABs).

✅ Communication: Exceptional English communication skills (mandatory, non-negotiable).

✅ Logistics: Strictly Hybrid model (3 days work from office) in Hyderabad.

➡️ Position Overview

Engineers scalable data platforms and real-time streaming pipelines using Databricks and Lakehouse architecture. Implements robust data governance via Unity Catalog and integrates enterprise data with cutting-edge AI/GenAI applications.

💼 Core Responsibilities

✔️ Data Pipeline Development: Design and deploy batch/streaming PySpark and Spark Structured Streaming pipelines across Bronze, Silver, and Gold Delta Lake layers.

✔️ Lakeflow & CDC Implementation: Build end-to-end Lakeflow pipelines utilizing Declarative Pipelines, Lakeflow Connect, Change Data Capture, and automated data quality checks.

✔️ AI & GenAI Integration: Construct AI Agents, Copilots, and RAG solutions incorporating LLMs, Vector Search, and Prompt Engineering into enterprise data workflows.

✔️ Governance & Security: Enforce Unity Catalog security policies, RBAC, data masking, audit logging, and automated lineage tracking.

✔️ DevOps & CI/CD: Maintain deployment pipelines and automated releases using Git, Databricks Repos, and Databricks Asset Bundles (DABs).

How to Apply



🚨 If you meet the requirements outlined in the job description and are interested in this opportunity, please email your resume to [email protected] , mentioning your Current CTC, Expected CTC, and Notice Period. Alternatively, click the “Apply” button directly on this platform. Applications with incomplete responses or profiles failing to meet baseline experience metrics will be filtered automatically.

DataEngineering #Databricks #PySpark #GenAI #HyderabadJobs