Solutions Architect – Azure Databricks

About the role

Arrow is looking for a Solutions Architect to lead the design and implementation of scalable, secure, and high‑performing data solutions on Azure Databricks. You will own the end‑to‑end architecture process, from requirements gathering to technical reviews, ensuring compliance with data privacy and governance standards.

Key responsibilities

• Design and implement data solutions using Azure Databricks, Delta Lake, and Delta Live Tables.
• Define best practices for cloud data architecture, data modeling, ELT/ETL pipelines, workspace setup, cluster management, repos, and job orchestration.
• Coordinate with onshore and offshore teams, including data engineers, reporting specialists, and business analysts.
• Conduct performance tuning, optimization, and monitoring of Databricks clusters and pipelines.
• Lead integration of Databricks with other data platforms and tools, and ensure data quality, lineage, and observability.

Required profile

• 8+ years of enterprise data architecture experience and 5+ years of hands‑on data engineering on Databricks.
• Proven experience migrating legacy data warehouses to modern cloud platforms.
• Architect‑level certifications in Databricks and DBT are a plus.

Required skills

• Azure Databricks (workspace, clusters, jobs, repos, Delta Live Tables)
• PySpark, Delta Lake, Unity Catalog, MLflow, DBT
• Azure data services: Data Lake, Azure SQL, Synapse, Azure Data Factory
• Data modeling, ELT/ETL pipeline design, cloud data architecture