Staff Designated Support Engineer

About the role

As a Staff Designated Engineer and technical subject‑matter expert, you will partner closely with Field and Engineering teams to deliver high‑touch, specialized support and tailored technical solutions for Databricks' largest and most strategic customers in the Digital Native Business segment.

Key responsibilities

• Perform advanced troubleshooting and root‑cause analysis for performance and reliability issues in Spark, SQL, Delta, Streaming, and Databricks runtime features using tools such as Spark UI metrics, Mosaic AI Model Service, DAGs, and event logs.
• Define continuous‑monitoring requirements, work with R&D and NOC teams to detect early performance issues and optimize customer environments.
• Build rapid proof‑of‑concepts, test, deploy, and monitor solutions created by Databricks Engineering to address customer challenges and showcase advanced Spark/ML/AI capabilities.
• Develop comprehensive playbooks and maintain a knowledge base of common Spark, ML, and AI workflow issues and solutions.
• Train customer engineering and business teams on performance tuning, debugging, and effective use of Databricks features.
• Collaborate onsite with Field Engineering, Sales, and Product teams during engagements and technical presentations to provide rapid solutions to production‑impacting issues.

Required profile

• 8–12 years of experience designing, building, and troubleshooting distributed computing applications, with 4+ years delivering production‑scale Spark/ML/AI solutions using Python, Java, or Scala.
• Hands‑on expertise with data lakes, SQL‑based databases, and cloud data‑warehousing/ETL tools such as Snowflake, Redshift, and BigQuery.
• Deep knowledge of Spark core internals, Delta/Iceberg, JVM optimization, memory management, and AI ecosystems (ML, DL, Generative AI).
• Practical experience with AWS, Azure, or GCP and building/managing CI/CD pipelines, monitoring, and alerting systems.
• 3–5 years in customer‑facing roles (e.g., Technical Account Manager, Solutions Architect) with strong communication and problem‑solving skills.

Required skills

• Apache Spark
• Python
• Java
• Scala
• SQL
• Delta Lake / Iceberg
• AWS
• Azure
• GCP
• CI/CD pipelines
• Monitoring & alerting
• Snowflake
• Redshift
• BigQuery
• Machine Learning
• Deep Learning
• Generative AI