Data Engineer

About the role

Blend360 is building a Media Mix Optimization (MMO) platform that requires a robust on‑premises data infrastructure. As a hands‑on Data Engineer you will design, implement and optimise ingestion, transformation and storage workflows that feed advanced analytics models. The role focuses on large‑scale, distributed processing using Hadoop ecosystem tools and relational databases.

Key responsibilities

• Design, build and optimise scalable data pipelines in Apache NiFi for ingestion, cleansing and enrichment of structured, semi‑structured and unstructured sources.
• Architect and manage high‑volume datasets on HDFS, applying partitioning, bucketing and indexing to improve query performance.
• Develop distributed processing workflows in PySpark and Hive for petabyte‑scale transformations, aggregations and joins.
• Maintain and tune PostgreSQL databases for high availability, integrity and performance, writing advanced SQL for ETL and analytics.
• Implement monitoring, logging and alerting to ensure pipeline health and resolve issues promptly.

Required profile

• Bachelor’s degree in Computer Science, IT or related field (Master’s preferred).
• Proven experience as a Data Engineer with hands‑on expertise in HDFS, Apache NiFi, Hive, PySpark, PostgreSQL, Python and SQL.
• Strong background in ETL/ELT design, distributed processing and relational database management.
• Experience with on‑premises big‑data ecosystems supporting distributed computing.
• Solid debugging, optimisation and performance‑tuning skills.
• Ability to work in agile, cross‑functional teams and communicate technical concepts effectively.

Required skills

• HDFS
• Apache NiFi
• Hive
• PySpark
• PostgreSQL
• Python
• SQL