Solutions Architect – Azure Databricks

About the role

Arrow Electronics is hiring a Solutions Architect for its Bangalore office (SKAV Seethalakshmi) to lead the design and implementation of scalable, secure and high-performing data solutions on Azure Databricks. The role covers the full architecture process, from requirements gathering and solution design to documentation, technical reviews and implementation.

Key responsibilities

• Own the architecture process: requirements gathering, solution design, documentation, technical reviews and implementation of advanced data solutions on Databricks.
• Define best practices for cloud data architecture, data modeling, ELT/ETL pipelines, workspace setup, cluster management, repos and job orchestration.
• Coordinate with onshore and offshore teams, including end-users, data engineers, reporting specialists and business analysts.
• Ensure compliance with data privacy, security and governance standards.
• Tune and optimize Databricks clusters, and ensure data quality, lineage and observability across pipelines.
• Monitor and troubleshoot data pipelines, integrate Databricks with other data platforms and tools, and run solution reviews and audits.
• Keep up with industry best practices and Azure Databricks developments and improve the technical stack.

Required profile

• At least 8+ years of experience in enterprise data architecture, including large-scale data platforms.
• 5+ years of relevant data engineering experience on Databricks.
• Proven experience migrating from legacy data warehouse and reporting systems to modern cloud platforms.
• Excellent communication, collaboration, problem-solving and analytical skills, able to influence decisions across the organization.

Required skills

• Databricks (Workspace, Clusters, Jobs, Repos, Delta Live Tables)
• Azure Databricks, PySpark, Delta Lake, Unity Catalog, MLflow, DBT and Azure data services (Data Lake, SQL, Synapse, ADF)
• Architect-level certifications in Databricks and DBT are a plus