Software Engineer III – Data Engineering

About the role

As a Data Engineer within LexisNexis Risk Solutions, you will design, build, and optimise scalable data pipelines and platforms on Azure to enable reliable, secure data processing for analytics and reporting.

Key responsibilities

• Design, develop and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and Azure storage services.
• Ingest data from relational databases, APIs and file systems into Azure data platforms.
• Implement data transformations on HPCC using ECL and on Azure using SparkSQL and PySpark.
• Write efficient Spark jobs and optimise workloads for performance and scalability.
• Collaborate with business analysts, data scientists and application teams to understand requirements and promote best practices.

Required profile

• Strong proficiency in SQL and data‑warehousing concepts.
• Hands‑on experience with Azure Databricks, Spark SQL and PySpark.
• Experience with Azure Data Factory, ADLS Gen2 and Azure Synapse.
• Familiarity with Agile development methodologies.
• Excellent communication and problem‑solving skills.

Required skills

• Python
• PySpark
• ECL (HPCC)
• Azure Data Factory
• Azure Databricks
• Azure Data Lake Storage (ADLS Gen2)
• Azure SQL / Synapse
• SQL