Senior Data Engineer (Python, PySpark, Kafka)

About the role

We are looking for an experienced Senior Data Engineer to join our Bangalore team. You will design, develop, and maintain high‑performance data pipelines and transformation jobs using Python, PySpark and Apache Kafka, supporting Bosch’s global software initiatives.

Key responsibilities

• Develop and maintain robust Python code for data manipulation, scripting, and application development.
• Design and build high‑performance data transformation jobs using PySpark on large‑scale datasets.
• Build and maintain real‑time data streaming pipelines with Apache Kafka, including Kafka Connect and Kafka Streams.
• Work with Hadoop ecosystem components such as HDFS, YARN, and Hive.
• Extract, query, and manage data using SQL and relational databases (PostgreSQL, SQL Server).
• Apply data warehousing and dimensional modeling principles to optimise data architecture.
• Manage code repositories and collaborate using Git/GitHub.

Required profile

• B.Tech or M.Tech degree in a relevant field.
• 6–9 years of professional experience in data engineering or related roles.
• Strong problem‑solving abilities and experience with large‑scale data processing.

Required skills

• Python
• PySpark
• Apache Kafka (Kafka Connect, Kafka Streams)
• HDFS
• YARN
• Hive
• SQL
• PostgreSQL
• SQL Server
• Git
• GitHub