Data Engineer – 5+ years experience

About the role

We are looking for an experienced Data Engineer to join our team and drive the design, development, and optimisation of ETL pipelines using Spark, PySpark, Azure Databricks and Python. The role involves close collaboration with development and testing teams to ensure high‑quality data flows for our FCRM application.

Key responsibilities

• Design and implement new or modified Spark SQL and PySpark code, as well as Azure Databricks notebooks.
• Prepare detailed technical specifications and support source system analysis.
• Develop, maintain, and optimise complex ETL jobs and frameworks using the bank's standard tools.
• Provide production support, including escalation handling for complex data issues.
• Orchestrate workflows with Azure Data Factory and Azure Databricks Jobs.
• Work with structured and semi‑structured data formats such as JSON, CSV, Parquet and Delta tables.

Required profile

• 5+ years of hands‑on experience in data engineering.
• Strong programming skills in Python and SQL.
• Proven experience with Azure Databricks (Unity Catalog preferred) and Apache Spark/PySpark.
• Familiarity with Azure Data Factory or similar orchestration tools.
• Ability to analyse source systems and implement best‑practice optimisation techniques.

Required skills

• Python
• SQL
• Azure Databricks
• Unity Catalog
• Apache Spark
• PySpark
• Azure Data Factory
• JSON
• CSV
• Parquet
• Delta tables