Senior Associate Data Engineer – Databricks (Gurgaon)

About the role

PwC’s Advisory practice is looking for a Senior Associate Data Engineer with deep expertise in Databricks to design, build and operate scalable data pipelines on the Lakehouse platform. You will work closely with analytics, AI/ML and business teams to turn raw data into actionable insights that drive client growth.

Key responsibilities

• Design, build and maintain end‑to‑end data pipelines using Databricks (PySpark / Spark SQL).
• Implement batch and incremental processing with Delta Lake and multi‑hop architecture.
• Develop and optimise Databricks notebooks, jobs and workflows.
• Ingest, transform and curate large‑scale structured and semi‑structured datasets.
• Support analytics, reporting and downstream data consumption use cases.
• Ensure data quality, reliability, lineage and governance.
• Collaborate with data scientists, analysts and architects on AI/ML workloads.
• Provide production support and troubleshoot pipeline issues.

Required profile

• 3‑8 years of experience as a Data Engineer with strong Databricks expertise.
• Bachelor’s or Master’s degree in Computer Science, Engineering or a related field (minimum 60%).
• Hands‑on experience with Apache Spark, PySpark, Spark SQL and Delta Lake.
• Familiarity with at least one cloud platform (Azure, AWS or GCP).
• Experience working in Agile teams.

Required skills

• Databricks Unified Data Analytics Platform
• Apache Spark, PySpark, Spark SQL
• Delta Lake and Lakehouse architecture
• Advanced SQL
• ETL/ELT design patterns
• Cloud services (Azure, AWS, GCP)
• Python for data engineering
• CI/CD for data pipelines

What we offer

• A vibrant community of solvers that leads with trust.
• Inclusive benefits, flexibility programmes and mentorship.
• Commitment to equal employment opportunities and a supportive work environment.