Python Developer – Data Engineering (PySpark, Hive, AWS)

About the role

We are looking for a Python Developer specialized in data engineering to design, build and optimise data pipelines and warehouse solutions. The role focuses on leveraging Python, PySpark and SQL technologies to transform large datasets and support analytics teams.

Key responsibilities

• Develop and maintain data pipelines using Python and PySpark.
• Write, optimise and troubleshoot complex SQL queries in Hive and Impala.
• Perform performance tuning of database queries, including index and partition strategies.
• Collaborate on data modelling, dimensional modelling and schema design.
• Implement data quality checks, governance practices and DataOps processes.
• Support integration with AWS services where applicable.

Required profile

• 4‑6 years of experience in IT, database or data‑warehouse environments.
• Strong proficiency in Python and PySpark.
• Extensive experience writing and optimising SQL in Hive/Impala.
• Familiarity with shell scripting.
• Understanding of query optimisation, indexing and partitioning.
• Experience with AWS is a plus.

Required skills

• Python
• PySpark
• Hive
• Impala
• SQL
• Shell scripting
• AWS (optional)