Data Engineer – Build AI‑Driven Data Platform

About the role

We are seeking experienced Data Engineers to join a high‑impact engagement focused on building an AI‑driven data platform from the ground up. You will work closely with a growing user base to design accelerators, define self‑service frameworks, and own the end‑to‑end delivery of data pipelines from enterprise source systems.

Key responsibilities

• Design and implement scalable data pipelines using Databricks, Spark, and Delta Lake.
• Create reusable accelerators and self‑service tools for internal stakeholders.
• Manage data security, governance, and cataloging with Unity Catalog.
• Integrate data from diverse sources such as SAP Fieldglass, Bullhorn, Beeline, and Kafka.
• Automate infrastructure provisioning using Terraform or Pulumi.
• Collaborate with cross‑functional teams to evolve requirements and drive clarity.

Required profile

• Proven experience delivering end‑to‑end data solutions in cloud environments.
• Strong problem‑solving mindset and ability to work autonomously.
• Excellent communication skills to translate technical concepts for non‑technical audiences.

Required skills

• Databricks
• Spark
• Delta Lake
• Unity Catalog
• Python
• SQL
• PySpark
• dbt
• AWS
• Azure
• GCP
• CI/CD
• Data Security
• LLM APIs
• Bullhorn
• Beeline
• SAP Fieldglass
• Kafka
• Terraform
• Pulumi