Senior Data Engineer – Azure & PySpark

About the role

Bosch Group is seeking a Senior Data Engineer to design, build, and optimise large‑scale data pipelines in its Bengaluru centre. You will work with cutting‑edge Azure services and open‑source technologies to deliver reliable, high‑performance data solutions for internal stakeholders.

Key responsibilities

• Design, develop and maintain ETL/ELT pipelines using Python and PySpark on Azure Databricks and Azure Data Factory.
• Ingest data from transactional databases, APIs, batch and streaming sources, including Kafka and Azure Event Hubs.
• Implement unit and integration testing, monitoring, alerting and dashboarding (e.g., Grafana) for data quality and pipeline health.
• Manage cloud infrastructure on OpenShift, using HELM for packaging and deployment.
• Drive CI/CD processes with GitHub Actions, ensuring automated testing and seamless releases.
• Write complex SQL queries, model data, and optimise performance in SQL Server and Azure SQL environments.
• Collaborate with data scientists, analysts and engineering teams, documenting architecture and processes.

Required profile

• Strong proficiency in Python and PySpark for large‑scale data processing.
• Hands‑on experience with Azure Databricks, Azure Data Factory, Kafka, Azure Event Hubs and OpenShift.
• Solid SQL skills and experience with data modelling and performance optimisation.
• Familiarity with CI/CD tools (GitHub Actions) and orchestration platforms such as Airflow.

Required skills

• Python
• PySpark
• Azure Databricks
• Azure Data Factory
• Kafka
• Azure Event Hubs
• Grafana
• OpenShift
• HELM
• GitHub Actions
• SQL
• SQL Server
• Azure SQL Server
• Azure Key Vault
• Azure Functions
• Airflow
• CI/CD
• Data modelling