Director, Data Engineer (Python, PySpark, MLOps, SQL, Databricks)

About the role

Gartner is hiring a Director of Data Engineering for its Tech Market Economics team in Gurgaon. The role leads a rapidly growing capability that builds Gartner's next generation of analytical platforms, moving from artisanal research to a continuous, AI-powered insight engine. It is a strategic leadership position focused on architecting the destination state of data, analytics and MLOps platforms, with the agility of a startup and the backing of Gartner.

Key responsibilities

• Architect high-volume data pipelines supporting model training and complex, multi-prompt inference at enterprise scale.
• Build evaluation frameworks, guardrails and automated quality gates for consistent, reliable AI outputs.
• Establish MLOps/LLMOps practices and telemetry to monitor pipeline health, data and model drift and production performance.
• Partner with Data Science, Product and Research leaders to turn prototype models into production-grade capabilities.
• Design solutions for data isolation, metadata management and data classification across internal, external and unstructured sources.
• Set engineering standards, code design principles and CI/CD governance, and lead modernization of production data platforms.

Required profile

• 9+ years of progressive experience in data engineering, advanced analytics, MLOps and distributed system architecture.
• Bachelor's degree required; Master's in Computer Science, Data Science, Software Engineering or a related quantitative field preferred.
• Proven track record deploying, monitoring and scaling AI models in production, with automated regression and evaluation suites.
• Hands-on experience architecting scalable data systems in major cloud environments.
• Ability to build evaluation tooling, monitoring dashboards and alerting frameworks.

Required skills

• Python, with numerical processing, orchestration and automated testing libraries
• SQL, PySpark, Databricks
• MLOps and LLMOps practices

What we offer

• Competitive salary, generous paid time off and charity match program
• Group medical insurance, parental leave and Employee Assistance Program
• Hybrid work environment, collaborative culture and professional development opportunities