Finance Data and AI Lead

About the role

This role is part of the Finance Organisation at Databricks. As the Finance Data Lead on the Finance Data and AI team, you will be the technical authority behind data pipelines, AI systems, and internal applications that power the Finance and Accounting organisation. The position is based in Bengaluru.

Key responsibilities

• Design and develop ETL pipelines using Databricks SQL and Python/PySpark for reporting, journal automation, and core financial processes.
• Architect and own complex finance data pipelines in the Finance data lake using Databricks Jobs and Lakeflow Declarative Pipelines with built‑in validation and reconciliations.
• Lead technical design of AI use cases such as forecasting automation, anomaly detection, and natural‑language interfaces to financial data.
• Build and maintain internal Finance applications (Databricks Apps, Genie Agents, AI/BI dashboards) for self‑service users.
• Define and enforce coding standards, data‑modelling conventions, documentation practices, and testing frameworks.
• Manage Git‑based version control, pull‑request reviews, and CI/CD pipelines to satisfy SOX change‑management requirements.
• Serve as primary technical point of contact during financial close, ensuring data accuracy and timely issue resolution.
• Mentor junior and mid‑level engineers through code reviews, pairing, and design discussions.

Required profile

• 12+ years of experience in data engineering, analytics engineering, or finance systems, with end‑to‑end production‑grade pipeline ownership.
• Strong understanding of core finance and accounting concepts, including close processes, revenue recognition, intercompany, chart of accounts, and financial reporting.
• Proven ability to translate ambiguous finance requirements into well‑architected, maintainable technical solutions.
• Experience driving technical conversations with both engineering peers and non‑technical finance stakeholders.

Required skills

• SQL
• Python
• PySpark / Apache Spark
• Databricks platform (Databricks SQL, Jobs, Lakeflow, Unity Catalog)
• Git, GitHub Actions, CI/CD pipelines
• Declarative Automation Bundles
• Financial source systems integration (NetSuite, Salesforce, Stripe, Zuora)
• AI/ML concepts and tools (Genie, AI/BI dashboards)