AI Data Engineering and Sr Cloud Specialist

About the role

We are looking for an experienced AI Data Engineer and Senior Cloud Specialist to design, develop, and maintain scalable data pipelines that support autonomous driving research. You will work closely with data scientists, researchers, and engineers to turn complex data requirements into robust technical solutions.

Key responsibilities

• Design, develop, and maintain scalable data pipelines and infrastructure for autonomous driving projects.
• Extract, transform, and load (ETL) data from sensors, simulations, and databases.
• Collaborate with cross‑functional teams to understand data needs and deliver technical solutions.
• Develop and optimise data storage and retrieval strategies, ensuring data quality and integrity.
• Implement data governance and security measures for sensitive data.
• Monitor, troubleshoot, and resolve issues in data pipelines and systems.
• Explore and evaluate new data technologies to improve processing efficiency and scalability.
• Mentor junior data engineers and support their professional growth.

Required profile

• Minimum 6 years of relevant experience in data engineering and cloud platforms.
• BE/MTech/PhD in Computer Science, Data Engineering, or a related field.
• Strong problem‑solving and analytical abilities.
• Excellent communication and documentation skills.

Required skills

• Python (or comparable programming language).
• Apache Spark, Hadoop, Kafka, Airflow.
• Data warehousing and data lake concepts.
• Microsoft Azure and Azure data services.
• SQL and NoSQL databases.
• Site Reliability Engineering practices.
• TensorFlow, PyTorch (nice to have).
• Docker, Kubernetes (nice to have).
• CI/CD pipelines and DevOps practices (nice to have).
• Data governance frameworks such as GDPR and CCPA (nice to have).