1 to 25 of 35 Lead Data Engineer Jobs in England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run … an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a More ❯

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction … and impact of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the … team's vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data More ❯

Data Engineer Lead - NatGas and Power page is loaded Data Engineer Lead - NatGas and Power Apply locations London posted on Posted 12 Days Ago job requisition id JR102268 Job Title: Data Engineer Lead - NatGas and Power Contract Type: Time Type: Job Description: Reporting to the Head of Data, the Data Engineering Lead will oversee the design, development, and maintenance of high-performance data systems that support trading, risk, and analytics functions across the Natural Gas and Power business. This role bridges technical execution and business impact, ensuring that data pipelines, platforms, and products are robust, scalable, and aligned with enterprise data strategy. The ideal candidate … will lead a team of data engineers, collaborate with trading desks and analysts, and ensure that data infrastructure supports pre-trade modeling, live execution, and post-trade analytics with precision and reliability. Main Responsibilities 1. Data Platform Ownership Lead the development and maintenance of scalable data pipelines and databases tailored to Natural Gas and More ❯

Position: Lead Data Migration Engineer Location: Farnborough HQ Working Hours: Full-Time, 40 Hours per week We are looking to add a Lead Data Migration Engineer to our current data team of 4, who will help to manage challenging and rewarding data migrations for our clients. The Lead Data Migration … Engineer is a key member of the Customer Success team at myairops. This is a hands-on technical role, with around 80% of your time focused on personally delivering customer data migrations; transforming and onboarding customer data from third-party systems into the myairops platform. The remaining 20% of your time will provide technical leadership to the … wider data engineering function. Youll help set and maintain standards across all migration projects, reduce technical debt, and design improved, streamlined processes for data onboarding. Youll work closely with customers, Solution Consultants (product specialists), and Developers to ensure every migration is accurate, efficient, and sets our customers up for long-term success with the myairops platform. About us More ❯

Lead Data Engineer – Up to £85,000 + Bonus – Financial Services – London Overview: We are currently partnered with a market-leading financial services organisation who are seeking an experienced Lead Data Engineer to join their team and deliver their business-wide data strategy. You will define how data is governed, integrated and … scaled across the business, whilst also building and optimising the ETL pipelines which power our analytics and reporting.As the business embarks on a major modernisation of its data infrastructure, this is a unique opportunity to shape the future data strategy and lead the transformation of the entire data platform. Role & Responsibilities: Lead the data engineering function and define the organisation’s data architecture and governance strategy Design and implement scalable ETL pipelines and modern workflow orchestration Drive the selection and deployment of a new data tech stack as part of a wider platform modernisation Collaborate with stakeholders across research, finance, CRM, and commercial teams to support analytics and decision-making Ensure More ❯

Lead Data Engineer, £ 70000 - 80000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Expanding SaaS product company are looking for a Lead Data Engineer as they continue to grow. In this hands-on role you will be part of the team … responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data Architects to determine technical delivery and functionality. Design data solutions based on optimal … performance, scalability and reliability. Create, optimise and maintain logical and physical data models, including data warehouses and data lakes. Design and manage the data integration process. Work with the team to improve their skills and knowledge (mentoring, training coaching, etc) Contribute as a member of the agile team. Work closely with Data Scientists, Data More ❯

Lead Data Engineer ££64,000 GBP Hybrid WORKING Location: Leeds, Yorkshire and the Humber - United Kingdom Type: Permanent This is an exciting opportunity for a skilled Lead Data Engineer to advance their career while remaining deeply technical. The role offers a clear path for progression without requiring a move into management or sales, allowing … individuals to focus on what they do best-engineering high-quality, scalable data solutions. Why Join? This organisation values continuous learning and personal growth. Team members benefit from a dedicated learning allowance, enabling them to shape their own development journey. Paid overtime and a strong emphasis on work-life balance ensure that individuals are recognised and supported-especially during … demanding projects. The business is committed to employee wellbeing and fosters a positive, inclusive culture. Role Overview The Lead Data Engineer will take a hands-on technical leadership role, guiding the delivery of high-impact solutions within cloud-based environments. This position is ideal for professionals who are passionate about modern data engineering and want to More ❯

Lead Data Engineer As a Lead Data Engineer, you'll be instrumental in driving innovation through advanced analytics, AI, cloud technologies, and data science. You will help build a new Data & Analytics function and unified data platform. Key Responsibilities: * Develop and execute a data engineering strategy that aligns with organisational … goals and technological advancements. * Design and implement a scalable, reliable, and cost-efficient modern cloud data platform. * Build and maintain robust ETL/ELT pipelines for processing and managing large volumes of structured and unstructured data. * Create and manage Power BI dashboards, reports, and data models to provide strategic insights. * Integrate cutting-edge technologies like AI, real-time … analytics, and automation into our data infrastructure. * Lead operational AI initiatives, including the development of machine learning models for predictive analytics. Technical Skills: * Proficiency in cloud platforms (Azure, AWS, or GCP) and data processing services. * Advanced skills in Power BI, including DAX, Power Query, and data modelling. * Strong programming abilities in Python, SQL, and/or More ❯

Lead Data Engineer £75,000-£85,000 ️ AWS, Python, SQL, Airflow Brighton, hybrid working Analyse customer behaviour using AI & ML We are partnered with a private equity backed company who provide an AI-powered, guided selling platform that helps businesses improve online sales and customer experience. They are looking for a Lead Data Engineer to lead a small team in building a key part of their data infrastructure. The role This role blends people management, individual contribution, and technology leadership. What you'll be doing Individual Contribution: You will take ownership of project briefs and design robust architectural plans. You will also champion the importance of thorough testing and ensure alignment … with stakeholder expectations throughout the development process. People Management: You will lead and mentor a small team of Data Engineers, fostering a high-performance culture by guiding their professional growth and ensuring effective communication within the team and with stakeholders. Technology Leadership: You will guide strategic decision-making regarding technology and architecture, ensuring solutions are scalable, cost-effective More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Lead Data Engineer be Doing? You will develop … mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to connect operational systems with More ❯

Lead Data Engineer - Shape the Future of Data & Analytics - Azure I am currently recruiting for an exciting Lead Data Engineer role with a leading organisation undergoing a major digital transformation . This is a fantastic opportunity to define and lead the data engineering strategy, building a scalable, insight-driven data infrastructure that leverages AI, cloud technologies, and advanced analytics to drive business success. Why Apply? High-Impact Role : Take ownership of data platform development, ensuring scalability, reliability, and efficiency. Technical Innovation : Work at the intersection of AI, machine learning, and real-time analytics , integrating cutting-edge technologies. Leadership & Strategy : Lead a team of data engineers and … analysts , collaborating with senior stakeholders to drive a data-driven culture . Key Responsibilities: Design and implement a modern cloud data platform (Azure) to support scalable analytics. Build ETL/ELT pipelines to process structured and unstructured data, enabling real-time insights. Develop and maintain Power BI dashboards, forecasting models, and business intelligence tools . Establish data More ❯

We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You will … provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a culture of innovation … collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting More ❯

We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You will … provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a culture of innovation … collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a … focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using … Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join … their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver … actionable insights and support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with cloud platforms More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join … their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver … actionable insights and support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with cloud platforms More ❯

Lead Data Engineer Leeds - Hybrid working £85,000-£90,000 Robert Walters are delighted to be partnering with an 8-figure turnover business based in Leeds. They are currently undergoing a transformation and are looking to hire a Lead Data Engineer to spearhead a greenfield project. The ideal candidate will have experience with Microsoft … Fabric, with additional experience in Azure or AWS being highly advantageous. Responsibilities Lead the end-to-end design and development of a new, cloud-based data platform focusing on scalability, performance, and security to support enterprise data initiatives. Serve as the subject matter expert for Microsoft Fabric, guiding its implementation and integration within the company's cloud … environment, which is currently AWS with potential migration to Azure. Establish and enforce best practices for data ingestion, transformation, storage, and orchestration, laying a solid foundation for analytics, reporting, and AI/ML projects. Collaborate with data analysts, data scientists, and business leaders to gather requirements and develop scalable data solutions. Design and build scalable data More ❯

advice on this job and more exclusive features. nCino offers exciting career opportunities for individuals who want to join the worldwide leader in cloud banking. We are seeking a Lead Engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role can be based either at our … recently acquired FullCircl. This position will be within our FullCircl brand, which was established in 2021 through the merger of Artesian Solutions and DueDil. FullCircl subsequently acquired W2 Global Data Solutions to further enhance its capabilities. FullCircl connects the insight you need when it matters most. We partner with more than 500 of the UKs leading banks, insurers and … push boundaries and exceed expectations. We pride ourselves in bringing together a diverse group of individuals with the skills, energy and shared passion to help us do amazing things. LEAD ENGINEER Key Responsibilities Leadership Develop a deep understanding of our customers, the problems they are trying to solve, and how we can help solve them. Absorb and process More ❯

Databricks Data Engineer (roles available at Lead, Senior and Mid Level), £ 50000 - 85000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work … with the Data Architects and Data team to determine technical delivery and functionality. Design data solutions based on optimal performance, scalability and reliability. Create, optimise and maintain logical and physical data models, including data warehouses and data lakes. Design and manage the data integration process. Work with the team to improve their skills More ❯

Calling for a Lead Data Engineer to join our Housing sector client in London. This is a hybrid contract role: 2 days onsite - 3 days remote. Our client is looking for an experienced Lead Data Engineer with the following skill set: Experience with Azure data services, Azure Data Factory (ADF), API development … and integration, Databricks, Python programming, Unit testing, GIT version control, Data management and data governance, Data security. If this is you, get in touch ASAP and send us your CV More ❯

Lead Data Engineer | Enterprise Retail Tech | Newcastle – Hybrid Salary & Benefits - £70,000 to £85,000 + 34 days annual leave, health, cycle to work, staff discounts A cutting-edge retailer at the intersection of tech and luxury fashion is on the hunt for a Lead Data Engineer to spearhead its growing data platform … UK's fastest expanding—offers a dynamic, digitally driven environment where innovation is the heartbeat of everything they do.This is your chance to own and evolve an enterprise-scale data ecosystem, with Fabric at its core, and help shape the next generation of insight delivery for a global audience. What You’ll Tackle Leading a new in-house Data Engineering function focused on Fabric integration Designing and evolving robust architectures using Fabric components—Data Warehouses, Lakehouses, Real-Time Analytics & Pipelines Building scalable, cloud-first data models tailored to retail operations and customer intelligence Driving end-to-end development across Azure and Microsoft Fabric environments Managing technical delivery across cross-functional teams and third-party collaborators Embedding More ❯

Lead Data Science Engineer Hybrid - 2 days a week Competitive salary + excellent benefits About the Role: A forward-thinking tech company is seeking a Lead Data Science Engineer to join their growing data function. This is a strategic, hands-on role where you'll design and build modern data infrastructure, guide … the deployment of machine learning models, and shape the delivery of data-driven products and APIs. You'll lead technical initiatives while working closely with data engineers, scientists, architects, and product stakeholders to ensure real-world impact through data. What You'll Be Doing: Architect and implement scalable pipelines and data systems that power advanced analytics … and ML applications Lead the rollout of data products, including APIs and secure data delivery mechanisms for clients and internal use Partner with cross-functional teams to align data solutions with wider business goals Take ownership of productionising ML models and integrating them into operational systems Improve access to data through the development of self More ❯

Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in … PySpark, Glue, Athena, AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and More ❯

Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in … PySpark, Glue, Athena, AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum About the Role Are you an experienced Senior Data Engineer ready to step into a managerial role? We are seeking a Data Engineering Manager to lead our Leeds-based team, working mostly remotely with one day on … site per week. In this role, you will manage the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL. You will lead and mentor a team of data engineers, drive engineering best practices, and own the data architecture strategy in an agile environment. Key Responsibilities Manage the development of data pipelines and solutions using Databricks, Python, and SQL Oversee the design and maintenance of data models that support analytics and business intelligence needs Ensure efficient ELT/ETL processes on AWS or Azure cloud platforms Collaborate with analysts, architects, and stakeholders to deliver high-quality data products Promote best practices in testing, CI/CD, version control More ❯