1 to 25 of 29 Lead Data Engineer Jobs in the UK

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run … an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a More ❯

Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the companys data strategy, build … can be based in either UK or Portugal Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI … Developers and Data Analysts. Working as the Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer youll be the driving force behind ensuring the companys data is accurate, secure, and fully leveraged. As the Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer youll More ❯

Lead Azure Data Engineer The Lead Azure Data Engineer will play a pivotal role in managing and optimising data solutions within the financial services sector. This position focuses on leveraging Azure-based technologies to support the analytics department in delivering high-performing data solutions. Client Details Lead Azure Data Engineer … sized organisation within the financial services industry, known for its focus on innovation and technology-driven solutions. It offers a collaborative environment, fostering growth within the analytics field. Description Lead Azure Data Engineer Design and implement scalable data solutions using Azure technologies. Collaborate with the analytics team to align data architecture with business objectives. Develop … and maintain robust ETL pipelines for data processing and integration. Ensure data security and compliance with industry standards and regulations. Monitor and optimise data storage and processing performance within Azure environments. Provide technical leadership and mentoring to junior team members. Document processes, system designs, and workflows for future reference. Stay updated on emerging trends and technologies in More ❯

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction … and impact of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the … team's vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data More ❯

Lead Data Engineer £90,000 - £110,000 GBP 5% Bonus + Benefits Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Lead Data Engineer Location: UK-wide (London preferred) Salary: Up to £110,000 + 5% Bonus Are you ready to lead the development of data-intensive systems that make … a real impact? We're seeking a Lead Data Engineer to join a dynamic team of innovators and problem-solvers. This is a hands-on leadership role where you'll guide engineering teams, shape technical solutions, and drive excellence in data engineering practices. Key Responsibilities: Lead the design and development of scalable data processing … Engage with stakeholders to estimate effort and advise on technical implications. Contribute to technical proposals and support pre-sales activities. Essential Skills & Experience: Proven leadership in engineering teams delivering data-intensive systems. Proficiency in Java, Scala, or Python . Experience with platforms like Informatica , Azure Databricks , or other ETL tools. Strong SQL expertise and understanding of distributed data More ❯

Lead Data Engineer Salary/Rate : £100,000 - £110,000 per annum + Bonus Location : North London Company : Retelligence About Retelligence Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to … deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression. The Role Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The … company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a More ❯

A leading consultancy is hiring a Data Lead Engineer (Refinery Divestment) who has experience with Refinery Divestment within the Oil & Gas industry. Hybrid position. 6-month rolling contract, paying up to £800 per day Experience and skills required for the Lead Data Engineer, Refinery Divestment, Oil & Gas In-depth experience with Refinery Divestment Proven … experience in data leadership roles within M&A, divestments, or large-scale transformation programmes. Strong understanding of refinery operations and oil & gas industry data domains. Expertise in data governance, data architecture, and data quality management. Familiarity with regulatory frameworks (e.g., HSE, environmental compliance). Experience with data room setup and management (e.g., Intralinks, Ansarada … . Excellent stakeholder management and communication skills. Package for the Lead Data Engineer, Refinery Divestment, Oil & Gas Hybrid position Paying up to £800 per day More ❯

Job Title: Lead Data Engineer Role Type: Permanent Location: Birmingham (Hybrid) Role Overview As a Lead Data Engineer, you will be responsible for maintaining data infrastructure on Microsoft Azure and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role … in the team optimising data infrastructure. Key Responsibilities Collaborate with cross-functional teams to achieve common business goals. Develop and maintain curated business models to support accurate and insightful decision-making. Utilise SSRS, SSAS, and SSIS to design, develop, and implement robust reporting and analytics solutions. Conduct complex data analysis to identify trends, patterns, and insights that drive … business improvement. Demonstrate expertise in Azure Synapse and Azure Data Factory/Lakes for data integration, orchestration, and management. Implement and optimise data pipelines for seamless and efficient data flow within the Azure ecosystem. Extract data from Dynamics to build and enhance curated business models in Synapse/PowerBI. Ensure data security, compliance, and More ❯

Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and drive … strategic decision-making through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading a talented team … of engineers. This is an outstanding opportunity for someone who's passionate about cutting-edge technology and wants to shape the future of enterprise data management. What's on offer: Up to £70k DOE Hybrid working from their Liverpool office – 3 days on site Opportunity to work with industry-leading cloud technologies Leadership role with genuine career progression prospects More ❯

Lead Data Engineer - £65-70k + bonus + benefits - Basingstoke 3 days a week The Opportunity: We are looking for a Lead Data Engineer to join a Basingstoke based organisation who are investing heavily in their Digital Transformation Programme. The Role: There is currently 1 Data Engineer in the team and … you'll join to play a proactive role in the delivery of their next-generation data platform, manage/mentor the existing person and drive the design, development and governance of the data pipelines. You'll be working really closely with stakeholders across the technology function and within the business and will the availability, integrity and compliance of … the systems. You'll play a key role in the ownership of the core architecture/engineering across the new Azure Databricks ecosystem. You'll ensure that the data platform architecture supports availability and growth targets and that the platforms leverage advances in AI and Machine Learning capability. The Person: Key to this is proactivity - they're really looking More ❯

way the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Lead Data Engineer to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making across our insurance … business. What you’ll do: Lead on data engineering projects, managing a sub- team within engineering, building out our data warehouse & pipelines Collaborate effectively across data science, analytics, product, engineering and commercial business teams Build and support esure’s data products within our industry leading platform Work with product managers, data & AI engineers to More ❯

Job Title: Lead Data Engineer Location: Warwick (Hybrid - once per week onsite) Remuneration: From £700 per day (via umbrella company) Contract Details: Fixed Term Contract, 6 months, Full Time Are you ready to take the lead in transforming data engineering? Our client, a forward-thinking organisation, is seeking a highly skilled and hands-on Lead Data Engineer to drive their Data & Insights platform built on the Azure stack. This is a Databricks-heavy role , ideal for someone who thrives in technical environments and enjoys working directly with cutting-edge tools. Why This Role Stands Out This is not just a leadership role - it's a hands-on engineering opportunity where your … expertise will be front and centre . You'll be the go-to person for all things Databricks, from architecture and configuration to pipeline promotion and troubleshooting. Key Responsibilities Lead and deliver hands-on data engineering across all layers of the Azure-based data platform. Act as the Databricks SME (Subject Matter Expert) , overseeing architecture, configuration, and More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf)Salary: £115000 - 120000 A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities:* Design … and maintain scalable data pipelines, warehouses, and lakes using AWS technologies.* Implement robust data governance, quality, and security practices.* Collaborate with data scientists to deploy machine learning models.* Lead or contribute to strategic planning, risk management, and stakeholder engagement.* Drive innovation through advanced analytics and research-based problem solving. To be successful you should have … years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing and analysis using Python and SQL. Experience with data More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf) Salary: £(phone number removed) - (phone number removed) A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business … units. Key Responsibilities: * Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies. * Implement robust data governance, quality, and security practices. * Collaborate with data scientists to deploy machine learning models. * Lead or contribute to strategic planning, risk management, and stakeholder engagement. * Drive innovation through advanced analytics and research-based problem solving. To be successful … you should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing and analysis using Python and More ❯

We are hiring a Lead Data Engineer: Exciting role in the Financial Services Space Location: UK-based | Flexible/Hybrid Working Options Contract Type: Permanent/Full-Time Overview I'm currently recruiting on behalf of a prestigious UK financial services organisation that is expanding its Retail Data Operations team . Following a strategic internal merger … they are hiring three Lead Data Engineers to support the build-out of new data capabilities focused on retirement solutions. This is a fantastic opportunity to join a forward-thinking team working with cutting-edge technologies in a collaborative and inclusive environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using Snowflake, Azure Synapse, DBT … and Azure DevOps Ensure solutions are GDPR-compliant and aligned with business and technical requirements Lead Agile delivery within Scrum teams, translating user stories into actionable engineering tasks Collaborate with architects, product owners, and stakeholders to deliver high-impact data solutions Drive continuous improvement in engineering standards and release management processes Mentor and support junior and mid-level More ❯

We are hiring a Lead Data Engineer: Exciting role in the Financial Services Space Location: UK-based | Flexible/Hybrid Working Options Contract Type: Permanent/Full-Time Overview I'm currently recruiting on behalf of a prestigious UK financial services organisation that is expanding its Retail Data Operations team . Following a strategic internal merger … they are hiring three Lead Data Engineers to support the build-out of new data capabilities focused on retirement solutions. This is a fantastic opportunity to join a forward-thinking team working with cutting-edge technologies in a collaborative and inclusive environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using Snowflake, Azure Synapse, DBT … and Azure DevOps Ensure solutions are GDPR-compliant and aligned with business and technical requirements Lead Agile delivery within Scrum teams, translating user stories into actionable engineering tasks Collaborate with architects, product owners, and stakeholders to deliver high-impact data solutions Drive continuous improvement in engineering standards and release management processes Mentor and support junior and mid-level More ❯

We are hiring a Lead Data Engineer: Exciting role in the Financial Services Space Location: UK-based | Flexible/Hybrid Working Options Contract Type: Permanent/Full-Time Overview I'm currently recruiting on behalf of a prestigious UK financial services organisation that is expanding its Retail Data Operations team . Following a strategic internal merger … they are hiring three Lead Data Engineers to support the build-out of new data capabilities focused on retirement solutions. This is a fantastic opportunity to join a forward-thinking team working with cutting-edge technologies in a collaborative and inclusive environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using Snowflake, Azure Synapse, DBT … and Azure DevOps Ensure solutions are GDPR-compliant and aligned with business and technical requirements Lead Agile delivery within Scrum teams, translating user stories into actionable engineering tasks Collaborate with architects, product owners, and stakeholders to deliver high-impact data solutions Drive continuous improvement in engineering standards and release management processes Mentor and support junior and mid-level More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be … working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the … front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling, and integration across More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be … working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the … front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling, and integration across More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be … working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the … front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling, and integration across More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be … working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the … front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling, and integration across More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be … working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the … front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling, and integration across More ❯

About The Role FDM is a global business and technology consultancy seeking a Lead Data Engineer to work for our client within the public sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role based in either London, Birmingham, Cardiff, Darlington, Edinburgh or Salford. Our client is seeking … Lead Data Engineer to take a key role in the delivery of a secure, scalable Analytical Platform for internal analyst teams. Operating within the Analysis & Corporate Services function, this role is integral to driving the department's analytical capabilities by improving access to high-quality data and modernising analytical infrastructure. This is a delivery-focused role … requiring a hands-on engineer with strong technical capabilities in cloud infrastructure, data pipeline development, and secure data environments. The platform will enable departmental analysts to work entirely within a secure Python-based environment without reliance on local data downloads. Responsibilities Designing, developing and finalising data infrastructure to support complex analytical workloads Building and maintaining More ❯

Our client at very well known Retail Giant is currently looking to hire a Senior/Lead Technical Engineer (Data/ML) based from their offices in London. As the Senior/Lead Tech Engineer (Data/ML) you will be part of build a small team and mentor during the build phase along … with the Engineering Manager. Job Title: Senior/Lead Tech Engineer (Data/ML) Location: London/Hybrid - Once a Week (Thursday) in London Duration: 6 Months Day Rate: £550 to £575prd (Inside IR35 - Umbrella) This is a greenfield based project with crossover from another tech team conducting a similar model. Interaction with Key Stakeholders and like … minded Tech Teams is essential. Working alongside the Data Scientist and Data Architect Experience at a Tech Lead/Senior Engineering Level Mentoring/Team Leading experience - Nice to have (Full Support from Engineering Manager) Hands on development/engineering background Machine Learning or Data background Technical Experience: PySpark, Python, SQL, Jupiter Cloud: AWS, Azure (Cloud More ❯

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting … through cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … closely with BI and Analytics teams, you'll help evolve our data warehouse and implement best-in-class engineering practices across Azure. Key Responsibilities Build and enhance ETL/ELT pipelines in Azure Databricks Develop facts and dimensions for financial reporting Collaborate with cross-functional teams to deliver robust data solutions Optimize data workflows for performance and More ❯