Agent Engineer – Build Production AI Agents

About the role

Agent Engineers at Sarvam build AI agents that run in live production for India's largest banks, insurers, NBFCs, government departments and fast‑growing companies. The role focuses on designing, engineering, testing and maintaining agents that handle millions of real interactions.

Key responsibilities

• Build production agents on the Sarvam stack, including prompts, system design, workflows, tool integrations and evaluations.
• Map the full space an agent must cover, designing scenario coverage and handling edge cases.
• Create proof‑of‑concept demos for customers and deliver convincing results quickly.
• Integrate agents with systems such as core banking, CRM, ticketing, telephony and other customer platforms.
• Own end‑to‑end quality by defining metrics, building evaluation pipelines and closing performance gaps.
• Engineer agents as versioned software with regression testing and rollback capability.
• Tune agents for accuracy, cost, reliability and performance under real load.
• Design for scale and consistency, ensuring stable behavior across thousands of interactions.

Required profile

• 3+ years of experience building production‑grade software that real users depend on.
• Hands‑on experience shipping AI agents to production and maintaining them.
• Deep familiarity with LLMs, prompt engineering, tool use, memory handling and failure modes at scale.
• Experience with agentic frameworks and both open‑source and closed‑source models.
• Strong engineering discipline: versioning, testing, regression and reproducibility.
• Ability to define meaningful evaluation metrics and build evaluation pipelines.
• Proficient in Python and comfortable across backend services, data pipelines, APIs and cloud infrastructure.
• Excellent communication skills to collaborate with customer engineering teams.

Required skills

• Python
• Large Language Model (LLM) engineering
• Prompt engineering and context management
• Agentic frameworks (e.g., LangChain, AutoGPT)
• Backend development (APIs, services)
• Data pipelines
• Cloud infrastructure (AWS, GCP, etc.)
• Version control and CI/CD
• Evaluation metric design and instrumentation