Job Opening For Python Gen AI Developer

Hello,

Greetings from GlobalData!!!

Urgent job openings for Data Engineer - GD @HYD

Position Title: Python Gen AI Developer

Job Description

GlobalData is hiring a Python GenAI Developer to join our team in Hyderabad, India.

GlobalData is a specialist information services business on a mission to help our clients decode the future, make better decisions, and reach more customers. In this role, you will design and build production-ready Python services that move data through collection, transformation, validation, and delivery. You will also strategically apply Large Language Models (LLMs) within those services to solve complex data processing challenges that rule-based logic cannot handle.

Role & responsibilities

• Pipeline Development: Build and maintain scalable Python data services and production-grade pipelines.
• Data Integration: Integrate high-volume data from a range of internal and external sources, including APIs and web-based sources.
• Incremental Processing: Design robust pipelines that process data incrementally and gracefully handle upstream changes.
• Data Validation: Model and validate data against defined schemas (using Pydantic) to maintain contracts across pipeline stages.
• GenAI Integration: Apply LLMs to complex processing tasks, ensuring outputs are structurally constrained, validated, and verified downstream.
• Quality Assurance: Implement strict quality checks, flag low-confidence records for human review, and measure output quality against fixed test sets.
• Monitoring & Optimization: Track pipeline performance, monitoring processing costs, logging, retries, and checkpointing for unattended services.
• Engineering Excellence: Build shared, reusable components, participate in code reviews, maintain documentation, and contribute to engineering standards.

Preferred candidate profile

Python & Software Engineering:

• Experience: 3 to 8 years of solid software engineering experience with strong production Python.
• Concurrency: Proven experience with asynchronous and concurrent Python programming (asyncio with httpx or aiohttp).
• Data Management: Strong proficiency in SQL, relational databases, and data validation using Pydantic (or similar tools).
• System Resilience: Experience building unattended services with built-in retries, idempotency, checkpointing, and logging.
• DevOps Practices: Mastery of Git, code reviews, unit testing, and CI/CD pipelines as standard practice.

AI & LLMs:

• Production GenAI: Hands-on experience integrating LLM APIs within live production applications.
• Structured Outputs: Demonstrated ability to extract, constrain, and validate reliable structured data from LLMs.
• Prompt Engineering: A systematic approach to prompt development, versioning, and evaluation against fixed evaluation datasets

Thanks & Regards

Tejaswini.P

(Human Resource)