Senior Software Engineer – Big Data & Streaming Platforms

About the role

Mastercard is seeking a Senior Software Engineer to design, test and validate large‑scale batch and real‑time data platforms built on Apache Spark, Kafka and NiFi. The role focuses on ensuring data quality, latency, fault tolerance and reliability for mission‑critical big‑data systems that support the company’s global payments network.

Key responsibilities

• Analyze business, regulatory and technical requirements to create risk‑based, audit‑compliant test scenarios.
• Develop, maintain and execute comprehensive test plans, cases and test data with full traceability to requirements.
• Perform functional, regression and system integration testing on distributed data pipelines.
• Validate JSON payloads, cloud storage data and NiFi data flows for accuracy and completeness.
• Log, track and manage defects in JIRA, providing clear reproduction steps and impact assessments.
• Collaborate with development teams to resolve defects and meet quality gates.
• Participate in design and test‑plan reviews, Agile ceremonies and provide status, risk and quality metrics.

Required profile

• Proven experience as a Senior QA Engineer or SDET working on large‑scale data platforms.
• Strong understanding of data quality, test automation and production readiness for streaming architectures.
• Ability to work in a regulated environment and produce audit‑ready documentation.

Required skills

• Apache Spark
• Apache Kafka
• Apache NiFi
• Apache Ozone or Ceph storage systems
• JSON data handling
• JIRA for defect management
• Test automation, functional, regression and system integration testing