Senior Data Engineer – Real-time & Batch Data Pipelines

About the role

As a Senior Data Engineer you will design, build, and manage components of highly available real‑time and batch data pipelines that handle petabytes of data. Our platform ingests billions of events daily and delivers aggregated insights within minutes to power analytics for internal and external customers.

Key responsibilities

• Architect, build, and own real‑time and batch data aggregation systems for analytical reporting.
• Collaborate with Data Scientists, Backend Engineers, Infrastructure Operations, and Product Managers to deliver new features.
• Develop clean, safe, testable and cost‑efficient solutions.
• Make well‑informed decisions, anticipate shortcomings and drive resolutions.

Required profile

• Bachelor’s degree in Computer Science or equivalent.
• 6+ years of software or data engineering experience with a focus on big data.
• Strong development skills in Java or Scala and Python.
• Solid foundation in distributed systems, large‑scale data processing, database schema design and data warehousing.
• Practical experience managing AWS or Google Cloud environments.
• Experience with containerized deployment or Kubernetes is a plus.
• Good understanding of NoSQL, relational and analytical/columnar stores.
• Ability to balance scalability, availability and latency in system design.

Required skills

• Java
• Scala
• Python
• Flink
• Spark
• Kafka
• Iceberg
• Druid
• AWS
• Google Cloud
• Kubernetes
• Postgres
• Vertica
• Redshift
• Hadoop
• Hive
• Cassandra
• Aerospike
• Redis

What we offer

• Comprehensive benefits package.
• Health and wellness programs.
• Paid time off.
• Retirement planning options.
• Potential equity for qualifying positions.
• Inclusive culture that values diverse perspectives.