Senior QA Automation Engineer - AI Testing

About the role

Capco, a Wipro company and global technology and management consulting firm, is looking for a highly skilled Senior QA Automation Engineer with 10+ years of experience in software testing and automation. The role focuses on UI and API test automation with Playwright and TypeScript, and on validating AI-driven applications, including agentic AI workflows, large language models (LLMs) and AI agents. The position is based in Mumbai.

Key responsibilities

• Design, develop and maintain UI and API automation frameworks using Playwright and TypeScript.
• Automate functional, regression, smoke, integration and end-to-end test scenarios.
• Build reusable automation components and improve framework scalability and maintainability.
• Validate AI-driven applications, agentic AI workflows, LLM-powered systems and intelligent agents.
• Design and execute test strategies for AI models, prompts, workflows and autonomous agent behaviors.
• Develop and run evaluation frameworks to measure AI response quality, accuracy, reliability, safety and performance.
• Automate API testing with REST APIs and validate request/response payloads.
• Collaborate with developers, product owners, business analysts and AI/ML teams on requirements.
• Integrate automation suites into CI/CD pipelines and ensure continuous quality delivery.
• Track defects, perform root cause analysis and support issue resolution.
• Prepare test plans, test cases, automation scripts, execution reports and quality metrics.
• Mentor junior QA engineers and share automation best practices.

Required profile

• 10+ years of experience in software testing and automation.
• Strong domain knowledge and skills, especially in investment banking/BFSI.

Required skills

• Playwright with TypeScript
• UI and API test automation
• Agentic AI testing, LLMs and AI agents
• REST API testing
• CI/CD integration