Azure Data Engineer

About the role

We are seeking a skilled and motivated Azure Data Engineer to join Deloitte India's dynamic team in Bhubaneshwar or Coimbatore. The role focuses on designing, developing, and maintaining scalable data pipelines on Azure, ensuring data availability for analytics and business intelligence.

Key responsibilities

• Design, develop, and deploy scalable data pipelines using Databricks (PySpark, Spark SQL), Azure Data Factory and other Azure data services.
• Implement ETL/ELT processes to ingest, transform, and load data from diverse sources into data lakes and warehouses.
• Optimize and tune pipelines for performance, scalability, and cost efficiency.
• Write and optimize complex SQL queries for extraction, transformation and analysis.
• Integrate structured, semi‑structured and unstructured data via APIs, streaming and batch processing.
• Apply data governance practices to ensure quality, consistency and security.
• Collaborate with data scientists, analysts and DevOps teams to deliver end‑to‑end solutions.
• Document pipelines, workflows, data models and maintain up‑to‑date architecture records.

Required profile

• Bachelor’s or Master’s degree in Computer Science, Information Technology or a related field.
• 6 to 9 years of experience in data engineering, preferably on Azure platforms.
• Proven ability to work independently and as part of a cross‑functional team.

Required skills

• Databricks (Serverless SQLWH, Unity Catalog, Lakehouse, Medallion Architecture)
• Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, Azure Key Vault
• Strong SQL proficiency and query optimization
• PySpark for large‑scale data processing
• ETL/ELT design and implementation
• Data modeling techniques
• Data governance, quality and security practices
• Azure DevOps for CI/CD pipelines (good to have)
• Delta Live Table (DLT) knowledge (good to have)