20 of 20 Permanent Lead Data Engineer Jobs

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run … an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development … of their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k More ❯

Lead Data Engineer - Edinburgh Job Description At Aberdeen, our ambition is to be the UK’s leading Wealth & Investments group. Strengthening talent and culture is one of our strategic priorities. We strive to make Aberdeen a great place to work so that we can attract and retain the industry’s best talent. Our people put our stakeholders … areas where we have both strength and scale to capitalise on the key themes shaping the market, through either public markets or alternative asset classes. About the Department The Data Engineering team sits within the wider Data & Analytics function at Aberdeen, delivering high-quality reporting, analytics, and insights to key stakeholders. The team is focused on transforming raw … data from source systems into trusted, integrated datasets that power decision-making and strategic planning across the business. About the Role We are seeking a dynamic and experienced Lead Data Engineer to spearhead the development of our centralised “single view” data model and lead the evolution of our data engineering capabilities. This role More ❯

Role Overview- SC Cleared or Eligible only Salary- 70k -80k per annum We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders … to translate requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering … teams and communities, ensuring delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and More ❯

Lead Data Engineer £110,000 GBP Remote WORKING Type: Permanent Job Title: Lead Data Engineer Location: Home-based (UK) with options in Belfast, Birmingham, and London Salary: Up to £110,000 + 5% bonus Our client is a leading digital transformation consultancy, delivering large-scale data solutions, digital services, and AI-powered initiatives … across the public and private sectors. We create real impact by solving complex problems and enabling organisations to modernise and optimise their data capabilities. We are looking for an experienced Lead Data Engineer (Consultant) to join our Data & AI teams. This is a hands-on leadership role where you'll design and develop data-intensive systems, guide engineers, and ensure solutions are robust, scalable, and aligned with business needs. The Role Lead the design and development of data processing and persistence components handling data at scale. Provide technical leadership , guiding other engineers in implementing data-intensive systems. Take ownership of whole components or subsystems, from design and coding to More ❯

Lead Data Engineer Job Tenure: Full-time, permanent Salary: Competitive Company Description Ready to join a team that's leading the way in reshaping the future of insurance? Here at esure Group, we are on a mission to revolutionise insurance for good! We’ve been providing Home and Motor Insurance since 2000, with over 2 million customers … way the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Lead Data Engineer to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making across our insurance More ❯

Lead Data Engineer Salary/Rate : £100,000 - £120,000 per annum + Bonus Location : North London Company : Retelligence About Retelligence Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to … deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression. The Role Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The … company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a More ❯

Lead Data Engineer, based Waltham Abbey (Hybrid role). Salary £60-80k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to lead a team and be hands on in replacing old tech systems and create ETL pipelines. We’re a … support office in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Lead Data Engineer This role sits within our IT team. Success measures will include project delivery and impact, data quality and management, innovation and technology, stakeholder engagement … build, and maintain serverless and traditional backend architectures using best practices. (We build on AWS using Lambdas and ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and are moving to Airflow/Snowflake only architecture. More ❯

Lead Data Engineer - Shape the Future of Data & Analytics - Azure I am currently recruiting for an exciting Lead Data Engineer role with a leading organisation undergoing a major digital transformation . This is a fantastic opportunity to define and lead the data engineering strategy, building a scalable, insight-driven data infrastructure that leverages AI, cloud technologies, and advanced analytics to drive business success. Why Apply? High-Impact Role : Take ownership of data platform development, ensuring scalability, reliability, and efficiency. Technical Innovation : Work at the intersection of AI, machine learning, and real-time analytics , integrating cutting-edge technologies. Leadership & Strategy : Lead a team of data engineers and … analysts , collaborating with senior stakeholders to drive a data-driven culture . Key Responsibilities: Design and implement a modern cloud data platform (Azure) to support scalable analytics. Build ETL/ELT pipelines to process structured and unstructured data, enabling real-time insights. Develop and maintain Power BI dashboards, forecasting models, and business intelligence tools . Establish data More ❯

Lead Data Engineer Hybrid (London/Reading - 1-2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We're partnering with a global leader in marketing data and insights … that's seeking a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. Why this role? Play a key role in building and optimising global data pipelines … supporting over 50 consumer panels worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1-2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with the resources of a world More ❯

Lead Data Engineer London/Hybrid Circa £95k-£100k + bonus + benefits Fabric, Azure, Python Lead Data Engineer with a strong Azure skillset is required by global business. This is a fantastic opportunity to shape the data landscape of a business that’s investing heavily in modern data platforms and looking … for someone to set the standard. You’ll join a small but highly capable data team that’s centralising and unifying data across multiple international divisions with the goal to create a single, coherent view of the business through a shared data ecosystem built on Microsoft Fabric. Key Responsibilities: Lead the effort to define and implement … data engineering standards across divisions. Collaborate with colleagues in the UK and Europe to unify data models and drive common practices. Troubleshoot and optimise pipelines and processes across Fabric, Databricks, and Azure Data Factory. Partner with engineers, analysts, and business leaders to ensure that data is consistent, reliable, and ready for advanced analytics. Help shape communities More ❯

LEAD DATA ENGINEER £80,000 - £90,000 - LONDON Company Our client is a global leader in data and analytics , working with major brands across 90+ markets. They combine deep industry expertise, vast datasets, and advanced technology to help businesses understand people and drive smarter decisions. The company is backed by a top-tier private equity firm … and is currently investing heavily in its data and technology platforms, offering the feel of a scale-up within a global business. Role As a Lead Data Engineer , you'll take ownership of designing, maintaining, and evolving the data pipelines that power large-scale analytical and machine learning models. You'll work closely with Data Scientists, Analysts, and Software Engineers to deliver robust, scalable data infrastructure. The focus areas include building and optimising pipelines for survey data, improving anti-fraud models, and supporting new data science initiatives.You'll manage two mid-level engineers, providing technical direction, mentoring, and helping the team refine ways of working. The role is hands-on and More ❯

Lead Data Engineer Opportunity: Permanent Salary: Up to £85k Hybrid: 2 days per week onsite Office Location: Central London Our client a UK-based fintech are seeking a Lead Data Engineer to take ownership of their data infrastructure and play a pivotal role in powering AI-driven decision-making across the organisation. You … ll be the architect behind the data systems that fuel both business intelligence and cutting-edge AI capabilities. Key Responsibilities Architect and own the data warehouse infrastructure, ensuring optimal performance and accessibility Design, build, and maintain ELT pipelines that integrate internal systems and external partner data Collaborate with stakeholders and customers to deliver actionable insights and refined … data models Resolve production issues, bugs, and participate in code reviews to maintain engineering quality Mentor team members and champion emerging technologies to advance our data capabilities Technical Skills Deep expertise in SQL and database design principles Hands-on experience with modern data warehousing platforms (Snowflake, PostgreSQL, MySQL) Proficiency in Python for data engineering tasks Experience More ❯

Lead Data Engineer Salary: £90,000 - £115,000 Location: West London (3 Days in Office) Using data science at their core, they transform complex property and customer data into insights that enhance targeting, retention, and performance. The Opportunity This flexible, data-driven start-up places Data Science at the heart of its business … using cutting-edge UK property data to deliver powerful insights for real estate partners and retailers. By leveraging advanced analytics, predictive modelling, and customer segmentation, the company helps clients better understand and engage with their audiences, improving marketing precision, timing, and overall performance. With a strong technical foundation and a collaborative team led by experienced data leaders, the … company is building efficient, automated data pipelines and scalable systems to power intelligent decision-making. This is an exciting opportunity for forward-thinking professionals to join a growing team, shape best practices, and make a real impact in a fast-evolving data and technology environment. The Role and Responsibilities This is an exciting opportunity for a technically strong More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to … streamline operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through to … straight-through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data pipelines (API More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to … streamline operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through to … straight-through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data pipelines (API More ❯

We’re seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You’ll own the full data lifecycle — from ingestion and processing to deployment and monitoring of machine learning models — while leading a small, high-performing team. What You’ll Do Build and maintain data pipelines and cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI … tech. What We’re Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in More ❯

We're seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You'll own the full data life cycle - from ingestion and processing to deployment and monitoring of machine learning models - while leading a small, high-performing team. What You'll Do Build and maintain … data pipelines and cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging … AI tech. What We're Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience More ❯

Your new company This is a pivotal opportunity to join the Data and Innovation division of a large complex organisation leading the delivery of SAM (Supervisory Analytics and Metrics)-a transformative programme enhancing supervisory decision-making through advanced data and analytics. You will architect and implement cloud-native data solutions aligned with the organisation's enterprise cloud … Model. This is a high-impact role where you'll shape the future of supervisory technology in a collaborative, forward-thinking environment. Your new role Define and implement the data engineering strategy aligned with business and technology goals. Lead development of data ingestion, quality, and metadata pipelines powering SAM's supervisory tools. Deliver scalable, secure, and production … ready data platforms using Azure and Databricks. Collaborate across Technology and DAT to integrate SAM solutions into the organisations Enterprise Data Platform (EDP). Champion CI/CD, DevOps, data governance and federated development within the PRA's Hub & Spoke model. Mentor and coach data engineers on Azure tooling, pipeline management, coding practices, and design principles. More ❯

Aufgaben Profil Wir bieten Advancing medicine to save lives. Together. Thanks to many decades of experience and our passion for what we do, we make an essential contribution to the global availability of biopharmaceuticals, especially for patients with rare and More ❯