Senior Data Engineer

About the role

Avathon is seeking a Senior Data Engineer to build and optimise data pipelines that power real‑time monitoring, forecasting, predictive maintenance and grid optimisation for renewable energy assets. You will enable data scientists and AI models to turn raw IoT, PLC and smart‑meter data into actionable intelligence for smarter, more efficient energy systems.

Key responsibilities

• Build and optimise data architectures handling large‑scale IoT, PLC and SCADA streams across cloud and on‑premise environments.
• Design scalable ETL and data workflows that support advanced analytics and machine‑learning models in renewable‑energy domains.
• Collaborate with cross‑functional teams to deliver end‑to‑end data solutions that generate business insights.
• Own and lead data‑platform modernisation projects, ensuring high performance, security and scalability.
• Tackle complex data‑engineering challenges that push the boundaries of cloud data infrastructure.

Required profile

• Bachelor’s or Master’s degree in Computer Science, Engineering or a related technical field.
• 5+ years designing and implementing large‑scale data platforms, with at least 2 years leading or mentoring data engineers.
• Hands‑on experience with Python (Pandas, Polars) and modern big‑data tools such as Databricks (Spark), Flink or Kafka.
• Strong understanding of data‑pipeline development, ETL frameworks and data lakes/warehouses.
• Extensive experience with cloud data platforms – AWS (S3, Redshift, Lambda, Glue), GCP (BigQuery, Dataflow, Dataproc) or Snowflake.
• Familiarity with workflow‑orchestration tools like Airflow or Prefect.
• Proven ability to lead data‑engineering teams and mentor junior engineers.

Required skills

• Python (including Pandas and Polars)
• Databricks/Spark, Flink, Kafka
• AWS, GCP, Snowflake (cloud data platforms)
• Airflow or Prefect for orchestration