Senior Azure Data Engineer (Bengaluru)

About the role

We are seeking an experienced Data Engineer with over 4 years of expertise in data engineering and a focus on leveraging GenAI solutions. The role involves designing, building, and optimizing scalable data pipelines on Azure while integrating AI‑driven capabilities.

Key responsibilities

• Design and implement efficient ETL/ELT pipelines using Azure Data Factory and Azure Databricks, ensuring high performance and scalability.
• Manage relational databases, design schemas, and write advanced SQL queries for optimal data access.
• Develop, debug, and optimize Python, PySpark, and SQL code to process large datasets.
• Implement data validation, cleansing, and monitoring to uphold data quality and governance standards.
• Identify and resolve performance bottlenecks, optimizing resource utilization on Azure services.
• Collaborate with AI, analytics, and product teams, documenting processes and best practices.

Required profile

• 4+ years of experience in data engineering.
• Proficiency with Azure Data Factory and Azure Databricks.
• Strong expertise in relational databases and advanced SQL.
• Solid programming skills in Python and PySpark.
• Bachelor’s degree in Computer Science, IT, or a related field.
• Familiarity with data governance best practices; GenAI experience is a plus.

Required skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse (or other cloud data platforms)
• Python
• PySpark
• SQL
• Relational database management
• CI/CD pipelines for data workflows
• GenAI solutions (optional)