AWS Data Engineer

About the role

We are looking for an experienced AWS Data Engineer to design, build, and optimise data pipelines on the Amazon cloud. The role involves working closely with business and IT stakeholders to deliver robust, scalable solutions that support our data‑driven initiatives.

Key responsibilities

• Develop and maintain data processing workflows using PySpark on AWS EMR.
• Design and manage data storage solutions in Amazon S3, ensuring security and cost‑efficiency.
• Implement serverless components such as AWS Lambda, SNS, and SQS to orchestrate data movement.
• Perform performance tuning, debugging, and optimisation of Spark jobs via Spark UI.
• Write clean, reusable Python scripts for data transformation and validation.
• Collaborate in an Agile environment to estimate effort, plan sprints, and deliver incremental value.
• Apply data modelling concepts like Data Vault, data mesh, and data fabric to structure enterprise data.

Required profile

• 4+ years of professional experience in data engineering or related fields.
• Strong communication skills to interact with both technical and non‑technical stakeholders.
• Proven ability to plan project execution and provide accurate effort estimates.
• Experience working in Agile teams.

Required skills

• Python programming
• PySpark and Apache Spark
• AWS services: EMR, S3, IAM, Lambda, SNS, SQS
• SQL (including sub‑queries, joins, CTEs)
• Big Data processing concepts
• Data modelling techniques such as Data Vault, data mesh, data fabric