Senior Data Engineer

Senior Data Engineer Up to £95,000 + benefits | Hybrid (3 days a week in City of London)

A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team.

You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements.

This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability.

Key responsibilities

• Design and build robust ETL pipelines using Python and AWS services

• Own and maintain Airflow workflows

• Ensure high data quality through rigorous testing and validation

• Analyse and understand complex data sets before pipeline design

• Collaborate with stakeholders to translate business requirements into data solutions

• Monitor and improve pipeline performance and reliability

• Maintain documentation of systems, workflows, and configs

Tech environment

• Python, SQL/PLSQL (MS SQL + Oracle), PySpark

• Apache Airflow (MWAA), AWS Glue, Athena

• AWS services (CDK, S3, data lake architectures)

• Git, JIRA

You should apply if you have:

• Strong Python and SQL skills

• Proven experience designing data pipelines in cloud environments

• Hands-on experience with Airflow (ideally MWAA)

• Background working with large, complex datasets

• Experience in finance or similar high-volume, regulated industries (preferred but not essential)

• High attention to detail and a clear commitment to data quality

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.