Senior Associate - Databricks Data Engineer
pwc · Bengaluru Millenia
Job description
About the role
PwC is hiring a Senior Associate Data Engineer focused on Databricks within its Advisory practice in Bangalore. The role centres on designing, building and operating scalable, high-performance data pipelines on the Databricks Lakehouse Platform, working closely with analytics, AI/ML and business teams.
Key responsibilities
- Design, build and maintain end-to-end data pipelines using Databricks (PySpark / Spark SQL)
- Implement batch and incremental data processing using Delta Lake and multi-hop architecture
- Develop and optimise Databricks notebooks, jobs and workflows
- Ingest, transform and curate large-scale structured and semi-structured datasets
- Support analytics, reporting and downstream data consumption use cases
- Ensure data quality, reliability, lineage and governance
- Collaborate with data scientists, analysts and architects on AI/ML workloads
- Optimise Spark jobs for performance and cost efficiency
- Follow enterprise security, access control and compliance standards
- Provide production support and troubleshoot pipeline issues
- Document technical designs, data flows and operational runbooks
- Mentor junior engineers and share best practices
Required profile
- 4+ years of experience as a Data Engineer with strong Databricks expertise
- Bachelor's or Master's degree in Computer Science, Engineering or a related field (60% above)
- Experience in Agile teams
Required skills
- Apache Spark, PySpark and Spark SQL
- Delta Lake and Lakehouse architecture
- Advanced SQL
- ETL/ELT patterns and data warehousing concepts
- At least one cloud platform (Azure / AWS / GCP)
- Distributed computing concepts
- Preferred: Unity Catalog, Auto Loader or streaming frameworks, CI/CD for data pipelines, Python for data engineering, Databricks certification
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 6 days ago
Expires 1 month from now
20 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
pwc
Bengaluru Millenia
Related job offers
-
SAP GRC Security Manager
pwc Bengaluru Millenia -
Senior Associate - Governance, Risk & Compliance (GRC) Advisory
pwc Bengaluru Millenia -
Senior Associate - Java Full Stack Engineer (D&A Advisory)
pwc Bengaluru Millenia -
Senior Site Reliability Engineer - Private Cloud
barclays Bengaluru -
QA Engineer - Salesforce & Enterprise Applications
labcorp Bengaluru India