Data Engineering Lead - Financial Services
Data Engineering Lead - £900 Per Day Inside IR35 - 6-month contract - 3 days per week on-site - London
A leading financial services organisation is looking for an experienced Data Engineering Lead to lead a team of 3-5 Data Engineers, overseeing the design, development and delivery of complex data pipelines supporting clearing operations, regulatory reporting, risk analytics and financial markets.
The successful candidate will take ownership of technical design and engineering delivery, leading the migration of Legacy data warehouse pipelines onto a modern enterprise data platform. This will involve developing scalable data solutions, integrating Kafka-based feeds and working closely with the Data Lakehouse and Platform Engineering teams.
This is a hands-on leadership position, with approximately 60% technical leadership and 40% hands-on engineering, requiring strong experience building on-premises data pipelines and managing engineering teams.
What you'll need to succeed
- Proven experience leading a team of Data Engineers, including technical guidance, mentoring and delivery management.
- Strong hands-on experience designing, developing and maintaining on-premises data pipelines.
- Excellent technical experience with Python, SQL and Apache Spark, including batch and streaming data processing.
- Strong knowledge of OpenMetadata, Apache Polaris and OpenShift (OCP).
- Experience with Kafka, Apache Iceberg, Airflow and dbt.
- Experience migrating Legacy data warehouse pipelines and reporting processes onto modern data platforms.
- Strong technical design leadership, including data modelling, source-to-target mappings, data contracts and engineering standards.
- Experience integrating Kafka-based data feeds and developing reliable, reusable data products.
- Experience running Scrum ceremonies and managing engineering delivery within Agile environments.
- Ability to collaborate with Data Lakehouse, Platform Engineering and business stakeholders.
- Data Lakehouse experience or relevant certifications would be advantageous.
- Previous experience within clearing houses, financial exchanges or capital markets would be highly desirable.
What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.