Azure Data Engineer (Mid-Level)

About the role

Datamaze AI, a consultancy offering AI, data and analytics services, is looking for an experienced mid-level Azure Data Engineer. You will design, build and optimise data solutions using Microsoft Azure tools, work with cross-functional teams to develop data pipelines and integrate data, and help ensure the reliability and scalability of the data infrastructure. The role is based in Hyderabad, India or Dubai, UAE.

Key responsibilities

• Design, build and maintain scalable data pipelines with Azure Data Factory, Databricks and other Azure services
• Integrate structured and unstructured data from many sources into Azure-based data platforms
• Develop and maintain data models for analytics and reporting
• Monitor and optimise pipelines for performance, scalability and cost
• Administer Azure Synapse Analytics, Azure SQL Database and other databases
• Implement ETL processes to turn raw data into actionable insights
• Work with analysts and business teams to meet their data needs
• Ensure compliance with security policies and regulations, and document workflows and architectures

Required profile

• Bachelor's degree in Computer Science, Data Engineering, IT or a related field, or equivalent experience
• 3-5 years of experience in data engineering or a similar role
• Experience with large datasets and cloud-based pipeline optimisation
• Hands-on experience delivering end-to-end data solutions on Azure
• Problem-solving, analytical and communication skills; able to work both collaboratively and independently

Required skills

• Azure Data Factory, Azure Synapse Analytics, Azure Databricks and Azure Storage
• Big data technologies such as Spark and Hadoop
• SQL and NoSQL databases such as Cosmos DB or MongoDB
• ETL/ELT methods; Python, Scala or Java
• Data lake architecture and Azure security/governance (RBAC, Azure Key Vault)
• Power BI knowledge is a plus