Software Engineer III – Data Platform Development

About the role

Join LexisNexis Risk Solutions' Data Intelligence Team to design, build, and optimise scalable data platforms that turn complex data into actionable insights. You will work with modern Azure technologies and collaborate with analysts, data scientists, and application teams.

Key responsibilities

• Design, develop and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and Azure storage services.
• Ingest data from relational databases, APIs and file systems into Azure data platforms.
• Implement data transformations on HPCC with ECL and on Azure with SparkSQL and PySpark.
• Write and optimise Spark jobs for large‑scale processing and create data models using Delta Lake, Parquet or columnar formats.

Required profile

• Strong proficiency in SQL and data‑warehousing concepts.
• Hands‑on experience with Azure Databricks, Spark SQL, PySpark and Azure Data Factory.
• Experience with large‑scale structured and semi‑structured datasets and Agile development.
• Excellent communication and problem‑solving skills, with knowledge of insurance terminology.

Required skills

• Python
• PySpark
• ECL (HPCC)
• Talend
• Azure Data Factory
• Azure Data Lake Storage (ADLS Gen2)
• Azure Synapse / Azure SQL
• SparkSQL