Lead QA Engineer – GenAI & Automation (MiDAS)

About the role

We are looking for a Lead Quality Assurance Engineer to shape the AI quality strategy for our MiDAS platform. You will design and own evaluation frameworks for generative AI solutions, ensuring faithfulness, relevance, and hallucination detection while driving test automation across deterministic and probabilistic dimensions.

Key responsibilities

• Develop and maintain an AI quality evaluation framework using LLM‑as‑a‑judge approaches.
• Architect a dual‑layered automation suite: deterministic E2E UI tests with Playwright and API tests with Pytest, plus probabilistic evaluation of LLM outputs.
• Integrate automated quality checks into GitHub Workflows for continuous CI/CD.
• Lead performance and resilience testing using JMeter.
• Collaborate with engineering teams to define quality metrics for Retrieval‑Augmented Generation (RAG) systems.

Required profile

• 8+ years of professional experience in software quality assurance.
• Strong problem‑solving ability to define quality in non‑deterministic AI contexts.
• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.

Required skills

• Expert‑level Python programming.
• Hands‑on experience with Pytest (API testing).
• Proficiency in Playwright for end‑to‑end UI testing.
• Performance testing expertise with JMeter.
• Advanced knowledge of GitHub Actions/Workflows for automated test execution.

What we offer

• Opportunity to work on cutting‑edge GenAI quality challenges.
• Access to Bosch’s global technology ecosystem and resources.
• Collaborative environment within a leading engineering hub in India.