Custom Software Engineer (Apache Spark)

About the role

The Custom Software Engineer will design, develop, and enhance bespoke software components that meet specific business requirements. Working within an agile environment, you will leverage modern frameworks and Apache Spark to deliver high‑performing, scalable solutions for large‑scale data processing.

Key responsibilities

• Collaborate with cross‑functional teams to gather and analyse requirements for custom software projects.
• Design, code, test, and deploy components using Apache Spark and related big‑data technologies.
• Maintain and optimise existing software to improve functionality, performance, and reliability.
• Document technical specifications, architecture decisions, and development processes.
• Provide guidance and mentorship to junior team members.

Required profile

• Minimum three years of professional experience working with Apache Spark.
• Strong understanding of the software development life‑cycle and agile methodologies.
• Ability to troubleshoot and optimise performance in complex distributed systems.
• Effective communication skills and a collaborative mindset.

Required skills

• Proficiency in Apache Spark for distributed data processing.
• Experience handling large‑scale datasets and integrating Spark with other big‑data tools.
• Competence in writing clean, maintainable, and efficient code.