Lead QA Engineer – GenAI Solutions (MiDAS)

About the role

Join Bosch's MiDAS team as a Lead QA Engineer, driving quality for cutting‑edge Generative AI solutions. You will shape the evaluation framework, build robust test automation, and embed quality checks directly into the CI/CD pipeline.

Key responsibilities

• Design and own an AI quality strategy focused on faithfulness, relevancy, and hallucination detection using LLM‑as‑a‑judge approaches.
• Architect a dual‑layered automation suite: deterministic E2E UI (Playwright) and API testing (Pytest/Requests) plus probabilistic evaluation of non‑deterministic LLM outputs.
• Integrate automated quality gates into GitHub Workflows for shift‑left testing.
• Lead performance and resilience testing using JMeter.

Required profile

• 8+ years of professional experience in software quality assurance.
• Bachelor’s or Master’s degree in Computer Science, Software Engineering or a related field.
• Strong problem‑solving ability to define quality in ambiguous, non‑deterministic AI contexts.

Required skills

• Expert‑level Python programming.
• Hands‑on experience with Pytest (API testing), Playwright (E2E UI testing) and JMeter (performance testing).
• Advanced knowledge of GitHub Actions/Workflows for automated test execution.
• Familiarity with LLM evaluation concepts (faithfulness, relevancy, groundedness) and Retrieval‑Augmented Generation (RAG) systems.

What we offer

• Opportunity to work on innovative GenAI products within a global technology leader.
• Collaborative environment with access to Bosch’s extensive resources and expertise.