Data Engineer

About the role

We are looking for a Data Engineer to design, develop and maintain robust data solutions that support data generation, collection and processing across the organization. You will build efficient pipelines, ensure data quality and implement ETL processes to enable seamless data migration and deployment.

Key responsibilities

• Design, develop and maintain data pipelines and ETL workflows using PySpark.
• Collaborate with cross‑functional teams to gather data requirements and deliver scalable solutions.
• Monitor, troubleshoot and optimise data processing jobs for performance and reliability.
• Document data processes and communicate clearly with stakeholders.
• Provide guidance and knowledge sharing to junior team members.

Required profile

• Minimum 3 years of professional experience working with PySpark.
• At least 15 years of full‑time education (equivalent to a bachelor’s degree).
• Ability to work independently and become a subject‑matter expert.

Required skills

• Proficiency in PySpark.
• Experience building and managing data pipelines and ETL workflows.
• Strong understanding of distributed computing and big‑data frameworks.
• Knowledge of data storage solutions, data modeling concepts and data quality assurance techniques.