Data Engineer

About the role

Bureau is a unified risk decisioning platform that powers compliance, fraud and transaction risk decisions for over 150 banks, fintechs and retailers worldwide. As a Data Engineer you will help build the data infrastructure that enables real‑time identity verification and fraud detection for billions of users.

Key responsibilities

• Design, develop and maintain batch and streaming pipelines that ingest, clean and transform data from device SDKs, partner APIs and third‑party providers.
• Write and own backend services and RESTful APIs that expose data to internal teams and real‑time decisioning paths.
• Develop Airflow DAGs for reporting, compliance analytics, model training and feature pipelines, and keep them healthy.
• Implement Spark jobs and SQL transformations on the data lake, tuning performance and cost.
• Add monitoring, alerting and data‑quality checks to ensure pipeline reliability.
• Debug production issues across Kafka consumers, schema changes, slow queries and resource bottlenecks.
• Collaborate with infrastructure teams on containers, Kubernetes deployments and cost‑effective cluster configurations.

Required profile

• 1–3 years of professional software engineering experience with data‑intensive systems.
• Strong programming skills in Python, Java or Scala and production‑grade code.
• Deep knowledge of SQL, query optimisation and differences between OLTP and OLAP databases.
• Hands‑on experience with a distributed processing framework (Spark preferred) and building REST APIs.
• Familiarity with a major cloud platform (AWS) and core services such as S3, EC2 and managed databases.

Required skills

• Python, Java, Scala
• SQL, Spark, Airflow
• Kafka, MSK
• Docker, Kubernetes, Terraform
• Git, CI/CD
• AWS (S3, EC2), managed databases

What we offer

• Competitive salary with potential equity
• Health benefits and flexible PTO
• Learning budget for professional development