AI Engineer - LLMs, Agents & RAG

About the role

aion is an enterprise AI platform that builds, fine-tunes and deploys AI at scale, with teams across the US, UK and India. It is looking for an AI Engineer in Bengaluru who enjoys building production-ready AI applications powered by large language models, multimodal AI and intelligent agents, and who understands that successful AI products also need robust engineering, scalable infrastructure and evaluation.

Key responsibilities

• Design, build and deploy AI applications using LLMs, multimodal models and agents, and prototype and productionise AI use cases across industries
• Build prompt engineering strategies, RAG pipelines and multi-agent systems, and integrate foundation models while optimising performance, reliability and cost
• Integrate AI applications with enterprise systems, databases, APIs and third-party platforms, and build scalable inference pipelines
• Implement evaluation frameworks, observability, monitoring and logging, and ensure security, privacy, governance and compliance
• Write clean, maintainable code, run code reviews, and collaborate with Product, Platform, Infrastructure and Customer Success teams

Required profile

• 3+ years of experience building AI, machine learning or backend software applications
• Strong Python and hands-on experience with LLMs, prompt engineering, RAG and AI agent frameworks
• Experience integrating AI apps with REST APIs, databases and cloud services, and understanding of model evaluation and prompt optimisation
• Exposure to fine-tuning, model serving, MLOps or inference infrastructure is highly desirable

Required skills

• Frameworks such as LangChain, LlamaIndex, CrewAI, AutoGen or LangGraph
• Vector databases such as Pinecone, Weaviate, Milvus, Chroma or PGVector
• Docker, Kubernetes and cloud platforms such as AWS, Azure or GCP
• Git, CI/CD pipelines and distributed systems
• Bonus: vLLM, TensorRT-LLM, TGI, PyTorch or TensorFlow, and experience with CRMs, ERPs or developer tools

What we offer

• Equity with significant ownership and impact
• Competitive compensation and flexible work options
• Wellness benefits