Senior Data Engineer

About the role

Mastercard is looking for a Senior Data Engineer to join the AI Innovation at Scale team in Pune. You will work with cutting‑edge big‑data platforms, partner with data‑science teams, and help bring AI/ML models into production at petabyte scale.

Key responsibilities

• Design, build, and maintain data pipelines that integrate multiple sources for a unified merchant registry.
• Collaborate with data‑science, operations, and governance teams to ensure data compliance and security.
• Develop, test, and deploy model features and artifacts into production environments.
• Automate and monitor data workflows in distributed environments, improving reliability and efficiency.
• Analyze and optimise ETL/ELT processes for high‑performance data access and model execution.

Required profile

• Proven ability to learn independently and solve complex data‑engineering problems.
• Strong understanding of end‑to‑end ML model development workflows and entity‑centric data systems.
• Experience collaborating across data‑science, engineering, and governance teams.
• Excellent communication skills and a proactive, quality‑focused mindset.
• Bachelor’s degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or equivalent practical experience.

Required skills

• Python
• SQL
• Apache Spark or similar distributed compute frameworks
• Databricks
• Cloud platforms such as AWS or GCP
• Big‑data technologies and petabyte‑scale data processing