Tech Lead - Databricks & Data Platform

About the role

We are looking for a senior Technical Lead to drive the design, development, and delivery of a modern data platform built on Databricks Lakehouse. The role combines hands‑on engineering with leadership of a distributed team, ensuring high‑quality, secure, and scalable data solutions for clinical and life‑science initiatives.

Key responsibilities

• Own the architecture and implementation of Databricks Lakehouse, Delta Lake, Unity Catalog, Medallion architecture, and SQL Warehouses.
• Lead end‑to‑end delivery of data pipelines, curated datasets, and analytics‑ready data products.
• Manage and mentor a team of 5–10+ data engineers across onsite and offshore locations.
• Provide technical direction on pipeline design, data modeling, performance tuning, security, and production readiness.
• Collaborate with AWS services (S3, EMR/Athena, Secrets Manager, IAM) and ensure cloud‑native security patterns.
• Drive sprint planning, backlog grooming, code reviews, release planning, and delivery governance.
• Partner with Clinical Operations, Biostatistics, Data Management, IT, and business stakeholders to translate requirements into technical solutions.

Required profile

• 12+ years of experience in data engineering, data architecture, or cloud data platform delivery.
• Proven track record leading teams of 5–10+ engineers and delivering complex data solutions.
• Strong understanding of data pipeline design, batch processing, data transformation, and analytics enablement.
• Experience working in regulated or life‑science environments is a plus.

Required skills

• Databricks Lakehouse (Delta Lake, Unity Catalog, Medallion architecture, SQL Warehouses)
• AWS services: S3, EMR, Athena, Secrets Manager, IAM
• Data pipeline performance tuning and optimization
• Data modeling and schema design
• Agile delivery practices (sprint planning, backlog management, release governance)