Data Developer (PySpark)

About the role

You will join Airbus DCS, the team responsible for Big Data development and support, to design highly optimized, scalable server‑side solutions in Python and PySpark. The role focuses on building the data backbone for Airframe Services and ensuring the Skywise platform delivers rapid insights that maximise aircraft availability and streamline customer contracts.

Key responsibilities

• Performance tuning of Spark jobs – manage partitioning, caching, broadcast joins and resolve data skew.
• Implement data governance using Unity Catalog for fine‑grained access control and lineage.
• Build and maintain CI/CD pipelines with Git and automated deployment frameworks.
• Prototype and develop high‑quality data objects, KPIs and dashboards on the Skywise platform.
• Participate in Agile development cycles, provide weekly updates and challenge business requirements for technical feasibility.

Required profile

• 2–4 years of hands‑on PySpark experience with a strong focus on performance optimisation.
• Advanced Python programming skills for complex data processing.
• Experience with Unity Catalog for metadata management and data governance.
• Proficiency in Git (branching, merging, PR workflows) and CI/CD pipelines.
• Expert‑level SQL for complex querying and data validation.

Required skills

• PySpark
• Python
• Unity Catalog
• Git
• CI/CD
• SQL
• AWS (S3, EC2, Glue, EMR)
• Java
• Skywise / Palantir ecosystem
• Jira
• VersionOne
• Qlik