1 to 25 of 26 Lead Data Engineer Jobs in England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run … an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development … of their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on role … where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data solutions to More ❯

Lead Data Engineer, Snowflake, 4 months, Remote, CO7368 A leading software consultancy requires a Lead Data Engineer/Tech Lead with strong Snowflake skills - for the next 4 months with the likelihood of significant extension - to provide technical leadership for a prestigious client project to deliver an innovative data platform. Working remotely … and outside of IR35, the Snowflake Lead Data Engineer/Tech Lead will actively work on delivering the technical solutions whilst carrying out code reviews, setting best practices, ensuring code quality, keeping everyone aligned from a technical standpoint, and fostering good communication and collaboration. This will involve: Working with the project owner to gather ongoing requirements … from the client Improving the transparency and traceability of data through well-documented pipelines and clear data lineage. Empowering internal teams with cleaner, structured data, reducing dependence on tribal knowledge and manual interventions. Enabling future scalability by establishing robust, modular foundations Experience Required: Snowflake expertise Solid data engineering expertise including strong SQL and Python Proficiency in More ❯

Role Overview- SC Cleared or Eligible only Salary- 70k -80k per annum We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders … to translate requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering … teams and communities, ensuring delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and More ❯

Role Overview- SC Cleared or Eligible only Salary- 70k -80k per annum We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders … to translate requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering … teams and communities, ensuring delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and More ❯

Lead Data Engineer Job Tenure: Full-time, permanent Salary: Competitive Company Description Ready to join a team that's leading the way in reshaping the future of insurance? Here at esure Group, we are on a mission to revolutionise insurance for good! We’ve been providing Home and Motor Insurance since 2000, with over 2 million customers … way the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Lead Data Engineer to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making across our insurance More ❯

Lead Data Engineer Salary/Rate : £100,000 - £120,000 per annum + Bonus Location : North London Company : Retelligence About Retelligence Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to … deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression. The Role Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The … company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a More ❯

Lead Data Engineer, based Waltham Abbey (Hybrid role). Salary £60-80k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to lead a team and be hands on in replacing old tech systems and create ETL pipelines. We’re a … support office in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Lead Data Engineer This role sits within our IT team. Success measures will include project delivery and impact, data quality and management, innovation and technology, stakeholder engagement … build, and maintain serverless and traditional backend architectures using best practices. (We build on AWS using Lambdas and ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and are moving to Airflow/Snowflake only architecture. More ❯

Lead Data Engineer - Shape the Future of Data & Analytics - Azure I am currently recruiting for an exciting Lead Data Engineer role with a leading organisation undergoing a major digital transformation . This is a fantastic opportunity to define and lead the data engineering strategy, building a scalable, insight-driven data infrastructure that leverages AI, cloud technologies, and advanced analytics to drive business success. Why Apply? High-Impact Role : Take ownership of data platform development, ensuring scalability, reliability, and efficiency. Technical Innovation : Work at the intersection of AI, machine learning, and real-time analytics , integrating cutting-edge technologies. Leadership & Strategy : Lead a team of data engineers and … analysts , collaborating with senior stakeholders to drive a data-driven culture . Key Responsibilities: Design and implement a modern cloud data platform (Azure) to support scalable analytics. Build ETL/ELT pipelines to process structured and unstructured data, enabling real-time insights. Develop and maintain Power BI dashboards, forecasting models, and business intelligence tools . Establish data More ❯

Lead Data Engineer Hybrid (London/Reading - 1-2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We're partnering with a global leader in marketing data and insights … that's seeking a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. Why this role? Play a key role in building and optimising global data pipelines … supporting over 50 consumer panels worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1-2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with the resources of a world More ❯

Proven experience working as a principal or lead data engineer * Strong background working with large datasets, with proficiency in SQL, Python, and PySpark * Experience managing and mentoring engineers with varying levels of experience I'm currently working with a leading insurance broker who is looking to hire a Lead Azure Data Engineer on an … initial 12-month fixed-term contract, with strong potential for extension. This is a great opportunity for an experienced Data Engineer to take on a leadership role, mentoring a small team of junior engineers while playing a key part in driving the development of an Azure-based data lakehouse. Key requirements: * Proven experience working as a principal … or lead data engineer * Strong background working with large datasets, with proficiency in SQL, Python, and PySpark * Experience managing and mentoring engineers with varying levels of experience * Hands-on experience deploying pipelines within Azure Databricks, ideally following the Medallion Architecture framework Hybrid working: Minimum two days per week on-site in London. If this sounds like something More ❯

Lead Data Engineer London/Hybrid Circa £95k-£100k + bonus + benefits Fabric, Azure, Python Lead Data Engineer with a strong Azure skill set is required by global business. This is a fantastic opportunity to shape the data landscape of a business that's investing heavily in modern data platforms and … looking for someone to set the standard. You'll join a small but highly capable data team that's centralising and unifying data across multiple international divisions with the goal to create a single, coherent view of the business through a shared data ecosystem built on Microsoft Fabric. Key Responsibilities: Lead the effort to define and … implement data engineering standards across divisions. Collaborate with colleagues in the UK and Europe to unify data models and drive common practices. Troubleshoot and optimise pipelines and processes across Fabric, Databricks, and Azure Data Factory. Partner with engineers, analysts, and business leaders to ensure that data is consistent, reliable, and ready for advanced analytics. Help shape More ❯

LEAD DATA ENGINEER £80,000 - £90,000 - LONDON Company Our client is a global leader in data and analytics , working with major brands across 90+ markets. They combine deep industry expertise, vast datasets, and advanced technology to help businesses understand people and drive smarter decisions. The company is backed by a top-tier private equity firm … and is currently investing heavily in its data and technology platforms, offering the feel of a scale-up within a global business. Role As a Lead Data Engineer , you'll take ownership of designing, maintaining, and evolving the data pipelines that power large-scale analytical and machine learning models. You'll work closely with Data Scientists, Analysts, and Software Engineers to deliver robust, scalable data infrastructure. The focus areas include building and optimising pipelines for survey data, improving anti-fraud models, and supporting new data science initiatives.You'll manage two mid-level engineers, providing technical direction, mentoring, and helping the team refine ways of working. The role is hands-on and More ❯

Lead Data Engineer Opportunity: Permanent Salary: Up to £85k Hybrid: 2 days per week onsite Office Location: Central London Our client a UK-based fintech are seeking a Lead Data Engineer to take ownership of their data infrastructure and play a pivotal role in powering AI-driven decision-making across the organisation. You … ll be the architect behind the data systems that fuel both business intelligence and cutting-edge AI capabilities. Key Responsibilities Architect and own the data warehouse infrastructure, ensuring optimal performance and accessibility Design, build, and maintain ELT pipelines that integrate internal systems and external partner data Collaborate with stakeholders and customers to deliver actionable insights and refined … data models Resolve production issues, bugs, and participate in code reviews to maintain engineering quality Mentor team members and champion emerging technologies to advance our data capabilities Technical Skills Deep expertise in SQL and database design principles Hands-on experience with modern data warehousing platforms (Snowflake, PostgreSQL, MySQL) Proficiency in Python for data engineering tasks Experience More ❯

Up to £85k 1 day onsite per week London Lead Data Engineer Opportunity: Permanent Salary: Up to £85k Hybrid: 1 day per week onsite Office Location: Central London Our client a UK-based fintech are seeking a Lead Data Engineer to take ownership of their data infrastructure and play a pivotal role in … powering AI-driven decision-making across the organisation. you'll be the architect behind the data systems that fuel both Business Intelligence and cutting-edge AI capabilities. Key Responsibilities Architect and own the data warehouse infrastructure, ensuring optimal performance and accessibility Design, build, and maintain ELT pipelines that integrate internal systems and external partner data Collaborate with … stakeholders and customers to deliver actionable insights and refined data models Resolve production issues, bugs, and participate in code reviews to maintain engineering quality Mentor team members and champion emerging technologies to advance our data capabilities Technical Skills Deep expertise in SQL and database design principles Hands-on experience with modern data warehousing platforms (Snowflake, PostgreSQL, MySQL More ❯

Up to £85k 1 day onsite per week London Lead Data Engineer Opportunity: Permanent Salary: Up to £85k Hybrid: 1 day per week onsite Office Location: Central London Our client a UK-based fintech are seeking a Lead Data Engineer to take ownership of their data infrastructure and play a pivotal role in … powering AI-driven decision-making across the organisation. You'll be the architect behind the data systems that fuel both business intelligence and cutting-edge AI capabilities. Key Responsibilities Architect and own the data warehouse infrastructure, ensuring optimal performance and accessibility Design, build, and maintain ELT pipelines that integrate internal systems and external partner data Collaborate with … stakeholders and customers to deliver actionable insights and refined data models Resolve production issues, bugs, and participate in code reviews to maintain engineering quality Mentor team members and champion emerging technologies to advance our data capabilities Technical Skills Deep expertise in SQL and database design principles Hands-on experience with modern data warehousing platforms (Snowflake, PostgreSQL, MySQL More ❯

and a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future. Your Role And Responsibilities As a Lead Data Engineer, you'll drive the strategic vision and execution of our data engineering and modeling initiatives, ensuring our data assets are architected, integrated, and … optimized to deliver maximum business impact. You will combine deep technical expertise with leadership skills to guide our team in building innovative, high-quality data solutions that support our growth and success. If you're passionate about solving complex data challenges, designing best-in-class data models, and leading technical teams toward excellence, we'd love to … hear from you. Responsibilities Define and lead the organization's data engineering and data modeling strategy, ensuring alignment with business objectives and industry best practices. Design, develop, and implement complex data models and pipelines for applications and enterprise systems. Mentor and guide senior engineers, fostering a culture of continuous learning, technical excellence, and innovation. Collaborate closely More ❯

Lead Data Engineer Salary: £90,000 - £115,000 Location: West London (3 Days in Office) Using data science at their core, they transform complex property and customer data into insights that enhance targeting, retention, and performance. The Opportunity This flexible, data-driven start-up places Data Science at the heart of its business … using cutting-edge UK property data to deliver powerful insights for real estate partners and retailers. By leveraging advanced analytics, predictive modelling, and customer segmentation, the company helps clients better understand and engage with their audiences, improving marketing precision, timing, and overall performance. With a strong technical foundation and a collaborative team led by experienced data leaders, the … company is building efficient, automated data pipelines and scalable systems to power intelligent decision-making. This is an exciting opportunity for forward-thinking professionals to join a growing team, shape best practices, and make a real impact in a fast-evolving data and technology environment. The Role and Responsibilities This is an exciting opportunity for a technically strong More ❯

About the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across the business. … This is a hands-on, strategic role where you'll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2, using Bronze/Silver/Gold architecture. … Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable “batch-first” integration strategy with AS400 during its .NET migration, with a roadmap toward API integration. Data Governance More ❯

We're the world's leading data, insights, and consulting company; we shape the brands of tomorrow by better understanding people everywhere. Kantar's Profiles division is home to the world's largest audience network. With access to 170m+ people in over 100 global markets, we offer unrivalled global reach with local relevancy. Validated by industry leading anti-fraud … technology, Kantar's Profiles Audience Network delivers the most meaningful data with consistency, accuracy, and accountability – all at speed and scale. Job Details Location: Reading or London, UK Please note: You must have the right to work in the UK. We are unable to offer visa sponsorship for this role. At Kantar, we help the world's leading brands … make better decisions through data. We're now looking for an experienced Lead Data Engineer to join our team and help us elevate the quality and integrity of our global consumer panels. These panels—more than 50 worldwide—are the foundation of our data-driven insights. Your mission? To build and evolve the data ecosystem More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to … streamline operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through to … straight-through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data pipelines (API More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to … streamline operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through to … straight-through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data pipelines (API More ❯

We’re seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You’ll own the full data lifecycle — from ingestion and processing to deployment and monitoring of machine learning models — while leading a small, high-performing team. What You’ll Do Build and maintain data pipelines and cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI … tech. What We’re Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in More ❯

We're seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You'll own the full data life cycle - from ingestion and processing to deployment and monitoring of machine learning models - while leading a small, high-performing team. What You'll Do Build and maintain … data pipelines and cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging … AI tech. What We're Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience More ❯