Lead QA Engineer for GenAI Solutions (MiDAS)

About the role

We are seeking a Lead QA Engineer to define and own the evaluation framework for Generative AI solutions within the MiDAS team at Bosch. You will shape quality standards for AI‑first engineering and ensure the reliability of vehicle software development worldwide.

Key responsibilities

• Develop and own an AI quality strategy, focusing on faithfulness, relevancy, and hallucination detection using LLM‑as‑a‑judge frameworks.
• Architect a dual‑layered test automation suite: deterministic E2E UI (Playwright) and API testing (Pytest/Requests) plus probabilistic evaluation of non‑deterministic LLM outputs.
• Embed automated quality checks into GitHub Workflows for seamless CI/CD (shift‑left integration).
• Lead performance and resilience testing using JMeter.

Required profile

• 8+ years of experience in software quality assurance.
• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
• Proven ability to define “quality” in an ambiguous, non‑deterministic AI landscape.

Required skills

• Expert‑level Python programming.
• Hands‑on experience with Pytest (API testing) and Playwright (E2E UI testing).
• Performance testing expertise using JMeter.
• Advanced knowledge of GitHub Actions/Workflows for automated test execution.
• Familiarity with probabilistic quality monitoring tools such as Langfuse.