Senior Associate Data Engineer – Databricks

About the role

PwC is looking for a Senior Associate Data Engineer specialized in Databricks to design, build and operate high‑performance data pipelines on the Databricks Lakehouse Platform. You will work closely with analytics, AI/ML and business teams to turn raw data into actionable insights.

Key responsibilities

• Design, develop and maintain end‑to‑end data pipelines using Databricks (PySpark / Spark SQL).
• Implement batch and incremental processing with Delta Lake and multi‑hop architecture.
• Develop, optimise and schedule Databricks notebooks, jobs and workflows.
• Ingest, transform and curate large‑scale structured and semi‑structured datasets.
• Support analytics, reporting and downstream data consumption use cases.
• Ensure data quality, reliability, lineage and governance.
• Collaborate with data scientists, analysts and architects on AI/ML workloads.

Required profile

• Proven experience as a Data Engineer working with Databricks and Apache Spark.
• Hands‑on expertise in building data pipelines and using cloud‑native services.
• Ability to work with cross‑functional analytics and AI/ML teams.
• Senior‑level experience appropriate for a Senior Associate position.

Required skills

• Databricks
• Apache Spark
• PySpark
• Spark SQL
• Delta Lake
• Cloud services (AWS/Azure/GCP)

What we offer

• Opportunity to work on cutting‑edge data and AI projects.
• Inclusive benefits, flexibility programmes and mentorship.
• Collaborative environment focused on innovation and impact.