1 to 25 of 50 Permanent Lead Data Engineer Jobs in the UK

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run … an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a More ❯

Lead Data Engineer - Preston A Lead Data Engineer to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as … a Senior or Lead data engineer Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies AWS or Azure cloud experience Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling … experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead More ❯

Lead Data Engineer Opportunity for a Lead Data Engineer to join a market leading Software House company in London Salary up to £150,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING … As a Lead Data Engineer, you’ll take ownership of the entire data function — designing, scaling, and optimising the data platform that powers AI-driven products and insights. You’ll lead a small team of data engineers, set technical direction, and shape the company’s data strategy while staying hands-on with … modern tooling across pipelines, cloud infrastructure, and data architecture. WHO WE ARE: As a recently founded company we develop technology to modernise workflows in the pet care sector. Our platform uses automation and AI to simplify routine tasks, reduce administrative burdens, and improve communication, allowing our professionals to focus more on care. With early funding and industry partnerships, we More ❯

Lead Data Engineer Opportunity for a Lead Data Engineer to join a market leading Software House company in London Salary up to £150,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING … As a Lead Data Engineer, you’ll take ownership of the entire data function — designing, scaling, and optimising the data platform that powers AI-driven products and insights. You’ll lead a small team of data engineers, set technical direction, and shape the company’s data strategy while staying hands-on with … modern tooling across pipelines, cloud infrastructure, and data architecture. WHO WE ARE: As a recently founded company we develop technology to modernise workflows in the pet care sector. Our platform uses automation and AI to simplify routine tasks, reduce administrative burdens, and improve communication, allowing our professionals to focus more on care. With early funding and industry partnerships, we More ❯

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to reuse data flows where possible. Coordinate … teams and set best practices and standards when it comes to data engineering principles. Champion data engineering across projects and clients. Responsibilities Lead by example, holding responsibilities for team culture, and how projects deliver the most impact and value to our clients. Be accountable for the strategic direction, delivery and growth of our work. Lead teams … of work and outcomes, owning commercial responsibilities. Hold and manage uncertainty and ambiguity on behalf of clients and our teams. Ensure teams and projects are inclusive through how you lead and manage others. Effectively own and hold the story of our work, ensuring we measure progress against client goals and our DT missions. Work with our teams to influence More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development … of their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on role … where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data solutions to More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on role … where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data solutions to More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development … of their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development … of their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how data powers every decision being made. As the Lead Data Platform Engineer , you will lead the design, development, and optimisation of the organisation’s enterprise data platform and its pipelines, enabling data-driven decision-making and innovation. You will act as the technical lead for a team of skilled data engineers and More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team … supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Lead Data Engineer be Doing? You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing More ❯

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where you'll be leading a team … of up to 6 engineers, helping set the technical direction, collaborating with a variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 2+ years of experience in a Leadership role Python/SQL … DBT, BigQuery, Airflow AWS/GCP, Terraform Data warehousing ETL Hybrid working with offices based in Central London Base salary of £120k-£140k + Bonus up to 15% and stock options Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP More ❯

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where you'll be leading a team … of up to 6 engineers, helping set the technical direction, collaborating with a variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 2+ years of experience in a Leadership role Python/SQL … DBT, BigQuery, Airflow AWS/GCP, Terraform Data warehousing ETL Hybrid working with offices based in Central London Base salary of £120k-£140k + Bonus up to 15% and stock options Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP More ❯

Lead Data Engineer – Manchester – £70,000–£75,000 + Bonus Hybrid – 2–3 days per week in the office We’re representing an award-winning, tech-driven organisation in the travel industry that’s scaling its data capability to support rapid growth and digital transformation. They’re seeking a Lead Data Engineer to … guide a small, dynamic team and help shape the future of their cloud-based data platform. This is a fantastic opportunity for a technically strong engineer with a collaborative mindset, someone who can translate complex data challenges into clear business outcomes. You’ll be joining a company where data sits at the heart of decision-making … and innovation, working alongside passionate professionals in an ambitious, people-focused culture. The Role Lead, mentor, and develop a small team of two Data Engineers. Design, build, and optimise data pipelines and integrations (using dbt, Airbyte , OpenFlow , APIs , and Python ) to deliver reliable and scalable data. Support the development of a new cloud-based data platform More ❯

Lead Data Engineer Salary/Rate : £100,000 - £120,000 per annum + Bonus Location : North London Company : Retelligence About Retelligence Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to … deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression. The Role Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The … company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a More ❯

Lead Data Engineer, based Waltham Abbey (Hybrid role). Salary £60-80k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to lead a team and be hands on in replacing old tech systems and create ETL pipelines. We’re a … support office in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Lead Data Engineer This role sits within our IT team. Success measures will include project delivery and impact, data quality and management, innovation and technology, stakeholder engagement … build, and maintain serverless and traditional backend architectures using best practices. (We build on AWS using Lambdas and ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and are moving to Airflow/Snowflake only architecture. More ❯

Lead Data Engineer As a Lead Data Engineer, you’ll be instrumental in driving innovation through advanced analytics, AI, cloud technologies, and data science. You will help build a new Data & Analytics function and unified data platform. Key Responsibilities: Develop and execute a data engineering strategy that aligns with organisational … goals and technological advancements. Design and implement a scalable, reliable, and cost-efficient modern cloud data platform. Build and maintain robust ETL/ELT pipelines for processing and managing large volumes of structured and unstructured data. Create and manage Power BI dashboards, reports, and data models to provide strategic insights. Integrate cutting-edge technologies like AI, real-time … analytics, and automation into our data infrastructure. Lead operational AI initiatives, including the development of machine learning models for predictive analytics. Technical Skills: Proficiency in cloud platforms (Azure, AWS, or GCP) and data processing services. Advanced skills in Power BI, including DAX, Power Query, and data modelling. Strong programming abilities in Python, SQL, and/or More ❯

Lead Data Engineer As a Lead Data Engineer, you’ll be instrumental in driving innovation through advanced analytics, AI, cloud technologies, and data science. You will help build a new Data & Analytics function and unified data platform. Key Responsibilities: Develop and execute a data engineering strategy that aligns with organisational … goals and technological advancements. Design and implement a scalable, reliable, and cost-efficient modern cloud data platform. Build and maintain robust ETL/ELT pipelines for processing and managing large volumes of structured and unstructured data. Create and manage Power BI dashboards, reports, and data models to provide strategic insights. Integrate cutting-edge technologies like AI, real-time … analytics, and automation into our data infrastructure. Lead operational AI initiatives, including the development of machine learning models for predictive analytics. Technical Skills: Proficiency in cloud platforms (Azure, AWS, or GCP) and data processing services. Advanced skills in Power BI, including DAX, Power Query, and data modelling. Strong programming abilities in Python, SQL, and/or More ❯

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and … shape how data enables every part of the business: lending, finance, analytics, and risk. This is a hands-on leadership role in a high-trust, high-ownership environment. You’ll lead a squad of talented engineers, architect the future of our data ecosystem, and drive modern, scalable engineering practices across the organisation. What you’ll do Lead and develop a squad of 4–6 data engineers. Own the technical strategy for the data platform and internal data products. Design scalable, secure, observable data architectures. Work closely with product and business teams to deliver meaningful outcomes. Drive engineering excellence, automation, and standardisation. Mentor and coach engineers, raising the bar across the function. Stay More ❯

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and … shape how data enables every part of the business: lending, finance, analytics, and risk. This is a hands-on leadership role in a high-trust, high-ownership environment. You’ll lead a squad of talented engineers, architect the future of our data ecosystem, and drive modern, scalable engineering practices across the organisation. What you’ll do Lead and develop a squad of 4–6 data engineers. Own the technical strategy for the data platform and internal data products. Design scalable, secure, observable data architectures. Work closely with product and business teams to deliver meaningful outcomes. Drive engineering excellence, automation, and standardisation. Mentor and coach engineers, raising the bar across the function. Stay More ❯

Lead Data Engineer - Shape the Future of Data & Analytics - Azure I am currently recruiting for an exciting Lead Data Engineer role with a leading organisation undergoing a major digital transformation . This is a fantastic opportunity to define and lead the data engineering strategy, building a scalable, insight-driven data infrastructure that leverages AI, cloud technologies, and advanced analytics to drive business success. Why Apply? High-Impact Role : Take ownership of data platform development, ensuring scalability, reliability, and efficiency. Technical Innovation : Work at the intersection of AI, machine learning, and real-time analytics , integrating cutting-edge technologies. Leadership & Strategy : Lead a team of data engineers and … analysts , collaborating with senior stakeholders to drive a data-driven culture . Key Responsibilities: Design and implement a modern cloud data platform (Azure) to support scalable analytics. Build ETL/ELT pipelines to process structured and unstructured data, enabling real-time insights. Develop and maintain Power BI dashboards, forecasting models, and business intelligence tools . Establish data More ❯

Lead Data Engineer Hybrid (London/Reading - 1-2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We're partnering with a global leader in marketing data and insights … that's seeking a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. Why this role? Play a key role in building and optimising global data pipelines … supporting over 50 consumer panels worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1-2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with the resources of a world More ❯

Lead Data Engineer (SC Cleared) | Outside IR35 | £600/day | Remote | 6-Month Contract (Extension Likely) You will need to be SC cleared for this role and immediately available. 💰 Rate: Up to £600/day (Outside IR35) 📍 Location: 100% Remote (You have to be UK-based) ⏳ Duration: 6 months initially, with strong potential to extend The role … is a hands-on Lead Data Engineer who thrives in fast-moving environments and enjoys balancing leadership with technical delivery. I am working for a forward-thinking organisation seeking a Lead Data Engineer to guide a small, high-performing team on data and ML projects. 📋 The Role Lead and mentor a team … the CTO Split your time 50/50 between hands-on technical work and team leadership Collaborate cross-functionally with DevOps, Product, and other key stakeholders Work in production data and machine learning environments Required Tech Experience You must have strong, proven experience in a contracting capacity with: Python SQL Azure Fabric Highly advantageous if you have: dbt (Data More ❯

Lead Data Engineer (SC Cleared) | Outside IR35 | £600/day | Remote | 6-Month Contract (Extension Likely) You will need to be SC cleared for this role and immediately available. 💰 Rate: Up to £600/day (Outside IR35) 📍 Location: 100% Remote (You have to be UK-based) ⏳ Duration: 6 months initially, with strong potential to extend The role … is a hands-on Lead Data Engineer who thrives in fast-moving environments and enjoys balancing leadership with technical delivery. I am working for a forward-thinking organisation seeking a Lead Data Engineer to guide a small, high-performing team on data and ML projects. 📋 The Role Lead and mentor a team … the CTO Split your time 50/50 between hands-on technical work and team leadership Collaborate cross-functionally with DevOps, Product, and other key stakeholders Work in production data and machine learning environments Required Tech Experience You must have strong, proven experience in a contracting capacity with: Python SQL Azure Fabric Highly advantageous if you have: dbt (Data More ❯