Sr. AI Engineer

Senior AI Engineer (5 – 8 Years Experience)📍 Location

Cybergateway, Hyderabad

🏢 Work Mode

Work From Office (5 Days/Week)

💼 Experience

5 to 8 Years

About Us

Techmatic Systems India Pvt Ltd is a technology-driven organization headquartered at Cybergateway, Hyderabad. We build intelligent, scalable software and AI-powered solutions that solve complex enterprise challenges across industries. As we continue expanding our AI capabilities, we are looking for highly experienced AI Engineers with strong expertise in designing AI architectures, building production-grade LLM systems, and developing intelligent AI agents using both proprietary and open-source models.

Role Overview

We are looking for a highly skilled Senior AI Engineer / AI Architect with hands-on experience in architecting and building enterprise-grade AI systems powered by Large Language Models (LLMs), Agentic AI, and Multi-Agent Architectures.

The ideal candidate should have deep expertise in designing scalable AI infrastructures using both cloud-hosted foundation models (OpenAI, Anthropic Claude, Gemini, etc.) and self-hosted/local open-source LLMs (Llama, Qwen, Mistral, DeepSeek, Phi, Gemma, etc.) .

You will be responsible for designing complete AI ecosystems including AI agents, orchestration layers, retrieval systems, tool calling, model routing, inference optimization, AI security, and production deployment.

This role goes far beyond chatbot development and requires experience in building reliable AI products from architecture through production deployment.

Job Details

Role: Senior AI Engineer / AI Architect

Experience Required: 5 to 8 Years

Employment Type: Full-Time, Permanent

Work Schedule: Monday to Friday | 5 Days Work From Office

Work Location: Cybergateway, Hyderabad

Key Responsibilities

• Design end-to-end AI architectures for enterprise-scale applications using Large Language Models and Agentic AI.
• Architect and build production-grade AI agents, autonomous workflows, and multi-agent systems capable of reasoning, planning, tool usage, and memory management.
• Develop AI systems using both commercial APIs (OpenAI, Anthropic Claude, Gemini) and locally hosted open-source models including Llama, Qwen, Mistral, DeepSeek, Gemma, Phi, and other foundation models.
• Build, fine-tune, optimize, and deploy local LLMs from scratch using modern inference frameworks and GPU-based deployments.
• Design hybrid AI architectures capable of intelligently routing requests between proprietary and local LLMs based on latency, cost, privacy, and task complexity.
• Architect scalable Retrieval-Augmented Generation (RAG) systems using vector databases, hybrid search, semantic retrieval, reranking, and metadata filtering.
• Design advanced tool-calling architectures integrating AI systems with enterprise databases, APIs, ERP systems, vector stores, and external services.
• Build production-ready Text-to-SQL pipelines with schema reasoning, SQL validation, deterministic execution, and secure query generation.
• Develop AI reliability mechanisms including structured outputs, response validation, guardrails, hallucination mitigation, grounding strategies, and semantic verification.
• Design scalable inference infrastructure supporting streaming responses, model serving, caching, batching, GPU optimization, and cost-efficient deployments.
• Build AI observability frameworks including tracing, evaluation, benchmarking, prompt versioning, response scoring, regression testing, and production monitoring.
• Develop secure multi-tenant AI systems with role-based access control, data isolation, prompt security, and enterprise-grade governance.
• Collaborate with engineering, product, and design teams to define AI architecture, technical direction, and best practices.
• Stay updated with advancements in LLM research, reasoning models, AI agents, orchestration frameworks, inference optimization, and open-source AI ecosystems.

Required Skills & QualificationsEducation

• B.E. / B.Tech / M.Tech / M.Sc. in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Information Technology, or related disciplines.

Core Technical SkillsAI Architecture

• Strong experience designing enterprise AI architectures and production AI platforms.
• Deep understanding of LLM architecture, transformer models, inference pipelines, embeddings, tokenization, and context management.

Large Language Models

Hands-on experience with:

• …