Senior Software Engineer - Data Engineering

About the role

Epsilon, part of the Epsilon Technology practice within Publicis Groupe, is hiring a Senior Software Engineer in Bengaluru. The role sits in the digital marketing domain, working with petabyte-scale data and on homegrown frameworks such as Spark and Airflow. It suits someone with a strong ETL and data warehouse background who can mentor junior engineers and work with global clients.

Key responsibilities

• Develop a deep understanding of the business context and present feature recommendations in an agile environment.
• Lead, design and code solutions on and off database so that applications can access data for ad-serving operations.
• Work with engineering teams worldwide to make enterprise data warehouse solutions actionable and accessible.
• Design, develop and manage ETL/ELT pipelines in Databricks using PySpark/SparkSQL, integrating data sources.
• Lead solution design, code development, quality assurance, data modelling and business intelligence.
• Mentor junior engineers and stay up to date on data governance, quality and performance optimisation.
• Hold effective client meetings and drive successful outcomes.

Required profile

• Bachelor's degree in Computer Science or equivalent experience.
• 5 to 8 years of data engineering experience with Apache Spark and databases (preferably Databricks).
• Strong SQL writing and tuning, and experience with Python.
• CI/CD practices, Git for version control, and scheduling applications such as Airflow.
• Disaster recovery and business continuity awareness; good experience with diverse teams.
• Excellent written and verbal communication and problem-solving skills.

Required skills

• Apache Spark, PySpark, SparkSQL, Databricks
• ETL/ELT pipelines, SQL, Airflow
• Git, CI/CD, Terraform or similar infrastructure-as-code tools (good to have)
• Data lakehouse concepts such as Apache Hive, AWS Glue or Databricks