Data Engineer (PySpark)

About the role

We are looking for a Data Engineer to design, develop and maintain robust data solutions that support data generation, collection and processing across the organisation. The role focuses on building efficient data pipelines, ensuring data quality and implementing ETL processes to move data between systems.

Key responsibilities

• Design, develop and optimise data pipelines using PySpark.
• Implement and maintain ETL workflows for data migration and deployment.
• Collaborate with cross‑functional teams to gather data requirements and deliver scalable solutions.
• Monitor, troubleshoot and improve performance of data processing jobs.
• Document data processes and communicate status to stakeholders.
• Provide guidance and mentorship to junior team members.

Required profile

• Minimum 3 years of professional experience with PySpark and big‑data technologies.
• Strong understanding of distributed computing and data‑modeling concepts.
• Ability to work independently and become a subject‑matter expert.
• Excellent problem‑solving skills and attention to data quality.

Required skills

• PySpark
• ETL design and implementation
• Data pipeline development
• Distributed computing frameworks (e.g., Spark)
• Big data storage solutions and data modelling