Lead Data and AI Engineer

Your new company This is a pivotal opportunity to join the Data and Innovation division of a large complex organisation leading the delivery of SAM (Supervisory Analytics and Metrics)-a transformative programme enhancing supervisory decision-making through advanced data and analytics. You will architect and implement cloud-native data solutions aligned with the organisation's enterprise cloud strategy and SAM's Target Operating Model. This is a high-impact role where you'll shape the future of supervisory technology in a collaborative, forward-thinking environment.

Your new role

• Define and implement the data engineering strategy aligned with business and technology goals.
• Lead development of data ingestion, quality, and metadata pipelines powering SAM's supervisory tools.
• Deliver scalable, secure, and production-ready data platforms using Azure and Databricks.
• Collaborate across Technology and DAT to integrate SAM solutions into the organisations Enterprise Data Platform (EDP).
• Champion CI/CD, DevOps, data governance and federated development within the PRA's Hub & Spoke model.
• Mentor and coach data engineers on Azure tooling, pipeline management, coding practices, and design principles.
• Work with data governance teams to maintain a comprehensive data catalogue and ensure compliance with security and privacy regulations.
• Contribute to Communities of Practice and support their cloud-first strategy.

What you'll need to succeed

• Extensive experience in cloud-based data engineering (preferably Databricks), with a strong background in modernisation and large-scale migration.
• Expertise in Azure services (API Manager, App Service), Databricks, Spark, Python, SQL, and AI/ML frameworks.
• Proven track record of leading technical teams and delivering complex data solutions in production.
• Strong understanding of data governance, security, and compliance in regulated environments.

Essential Criteria

• Proven experience designing and deploying cloud-native data architectures at scale.
• Proficiency in Python, SQL, PySpark.
• Demonstrated ability to build secure, scalable, cost-efficient data solutions on Azure.
• Experience with data security and regulatory compliance tools (e.g. Microsoft Purview, Unity Catalog).
• Ability to translate strategic goals into technical delivery plans and roadmaps.

Desirable Criteria

• Experience designing and implementing AI/ML-driven solutions within data platforms.
• Relevant certifications (e.g. Databricks Engineer Professional, Azure Data Engineer Associate, Azure Solutions Architect).
• Advanced academic qualifications or industry recognition in data engineering and cloud technologies.
• Experience in DevOps practices using GitHub Actions and automated CI/CD pipelines.

What you'll get in return

This is a unique opportunity to work on a high-profile programme within a prestigious institution, contributing to the future of supervisory technology. The role is based in Leeds with flexible working arrangements and offers the chance to lead innovation in a supportive and mission-driven environment. Salary package negotiable on experience up to £90,000 plus excellent benefits package including generous annual leave, fantastic pension and hybrid working.

What you need to do now

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk