Data Engineer – Production Support & Development

About the role

We are looking for a Data Engineer to join a client‑focused engagement, splitting time evenly between production support and new development. The role combines day‑to‑day pipeline maintenance with the design and optimisation of scalable data solutions.

Key responsibilities

• Provide 50% of your time supporting existing data pipelines, monitoring, troubleshooting and resolving incidents.
• Design, build and maintain the remaining 50% of scalable ETL/ELT workflows using Python, SQL and Spark.
• Collaborate with cross‑functional and client teams to translate data requirements into technical solutions.
• Perform root‑cause analysis on pipeline failures and implement fixes with minimal downtime.
• Optimise data workflows for performance, reliability and cost‑efficiency.
• Document architecture, processes and support runbooks for knowledge continuity.
• Participate in on‑call rotations and support the client environment as needed.
• Work with Databricks and/or AWS cloud services to build or support data solutions.

Required profile

• 2‑4 years of hands‑on experience in a Data Engineering role.
• Strong proficiency in Python and SQL.
• Practical experience with Apache Spark.
• Prior experience on client‑based projects (mandatory).
• Ability to balance operational support with development tasks.
• Excellent problem‑solving and communication skills for client‑facing situations.

Required skills

• Python
• SQL
• Apache Spark
• Databricks (preferred)
• AWS services such as S3, Glue, EMR, Lambda, Redshift (preferred)
• CI/CD pipelines for data engineering (preferred)
• Workflow orchestration tools like Airflow (preferred)

What we offer

• Competitive salary and a strong insurance package.
• Extensive learning and development resources to support career growth.