Lead Engineer, EDT Data & Analytics Cloud Engineering

About the role

The Lead Cloud Platform Engineer supports the operational excellence, security and reliability of the enterprise data and analytics platform on Azure and Databricks. The role combines platform operations, DevOps automation and Infrastructure as Code across Azure Databricks, Synapse, ADLS Gen2, Azure SQL, Azure Data Factory, Key Vault and Unity Catalog, with a reliability-engineering mindset. It is a hybrid position based in Gurugram.

Key responsibilities

• Design, build, test and operate Azure DevOps CI/CD pipelines that package code, run quality checks, deploy infrastructure and data workloads, and promote releases across development, testing and production.
• Monitor pipeline runs, diagnose failed builds and deployments, fix pipeline definitions and improve rollback, approval and promotion controls.
• Write, review and maintain Terraform modules for provisioning Azure and Databricks components, and provision workspaces, compute, storage, networking, private connectivity, identities and access.
• Configure and troubleshoot RBAC, service principals, managed identities, secrets, storage permissions, cluster policies and Unity Catalog grants, applying least-privilege access and secrets-management controls.
• Build monitoring, alerts, dashboards and runbooks, take part in incident response, perform root-cause analysis and implement preventive automation.
• Monitor integration runtimes, clusters, jobs and pipelines, inspect logs and metrics, and resolve performance and runtime issues.
• Work with Data Platform and Data Product teams to deploy ingestion pipelines, orchestration and Databricks jobs, and support production rollouts.
• Translate stakeholder needs into technical changes, contribute code and configuration, lead technical working sessions and document solutions and handoffs.

Required profile

• Bachelor's or master's degree in computer science, engineering, information systems, business or a related technical discipline.
• 5-7 years of experience designing, engineering and supporting cloud-based data and analytics platforms, data warehouses and modern data ecosystems.
• Proven experience implementing platform security controls, governance frameworks and Azure data platform best practices.
• Excellent analytical, problem-solving and communication skills, with a proactive approach to automation and process improvement.

Required skills

• Strong hands-on expertise with Azure data services: Azure Databricks, Synapse Analytics, ADLS Gen2, Azure SQL, Azure Data Factory, Key Vault and Unity Catalog.
• IaC with Terraform and Azure DevOps CI/CD pipelines.
• Monitoring, performance tuning, alerting, incident management and root cause analysis.
• Azure/Databricks platform certifications are a plus.