1 to 25 of 153 Data Engineer Jobs in London

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email … WHO WE ARE? We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who is … working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such as Hadoop, Cloudera More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and excellence … across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering … standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of a modern event-sourcing architecture, enabling efficient More ❯

AWS Data Engineer Rate: Up to £400 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of … large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services … such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions Implement and optimise ETL/ELT processes , ensuring data integrity, consistency and quality across multiple sources Apply best practices in data modelling, version control More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation, and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect … design, and implement scalable Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows More ❯

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to reuse data flows where possible. Coordinate teams and … set best practices and standards when it comes to data engineering principles. Champion data engineering across projects and clients. Responsibilities Lead by example, holding responsibilities for team culture, and how projects deliver the most impact and value to our clients. Be accountable for the strategic direction, delivery and growth of our work. Lead teams, strands of work and … mid- to long-term delivery cycles (612 months), ensuring that near-term work supports broader programme and client objectives. About You Professional knowledge and experience Essential Proven experience in data engineering, data integration and data modelling Expertise with cloud platforms (e.g. AWS, Azure, GCP) Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with More ❯

The Opportunity Are you passionate about data engineering? The Open Data team at the Parliamentary Digital Service (PDS) is beginning the development of a new Open Data Platform for parliamentary procedure data, replacing existing platforms and their associated data integration and publishing services. As our Senior Data Engineer you will play a key … role in designing, building, and evolving the data platforms that support decision-making across the organisation. This role sits at the intersection of engineering, analytics, and product delivery. You'll work closely with cross-functional teams to provide high-quality, reliable, and scalable data solutions that drive insight and operational excellence. You'll bring strong software engineering experience … production-ready code as standard. Alongside this, you'll have hands-on cloud experience (Azure preferred, but AWS or GCP also welcome), including deploying, managing, and supporting cloud-hosted data services and applications. Using your advanced technical expertise and experience delivering modern data systems, you'll help shape our data strategy, improve how teams access and use More ❯

Data Engineer Remote (UK-Based) Salary: c£60,000 - £65,000 per annum + benefits Employment Type: Full-time, Permanent About the Role Were looking for an experienced Data Engineer to join a highly acquisitive, fast-growing organisation thats driving a major digital transformation. The Data Engineer will be responsible for designing, building, and … maintaining robust data infrastructure to support the organisations expanding data and analytics needs. This includes leading the migration of legacy systems to modern cloud-based platforms , managing APIs for seamless data exchange , and ensuring data quality, security, and reliability across all systems. Youll play a key role in developing and optimising ETL pipelines , automating data workflows , and supporting integration between core business systems such as Microsoft Dynamics . Strong hands-on experience with Azure, SQL, and Python-based data engineering is essential. This is an excellent opportunity for someone who thrives in a scalable, acquisition-driven environment , enjoys solving complex data challenges, and wants to help shape the data strategy of More ❯

Data Engineer Salary £60,000–£75,000 + Equity, 25 days holiday, Pension + more Location - London (Hybrid) | Python | ETL | Impact-Driven Team I’m working with a fast-growing healthtech client that’s reshaping access to fertility care across Europe. They’ve just hired one Data Engineer and urgently need another to join their lean … high-performing team.This is a hands-on Data Engineer role where you’ll be at the heart of a major migration project — moving legacy IT systems and databases onto modern platforms. You’ll write Python scripts, build ETLs, and find smart ways to transform messy, unstructured data into clean, structured formats that support machine learning models and … real-time decision-making.You’ll be joining a team that values speed, autonomy, and output. The environment is fast-paced, collaborative, and mission-driven ideal for a Data Engineer who thrives on solving real problems and wants their work to make a tangible difference. What You’ll Be Doing Build and optimize ETL pipelines in Python Migrate legacy More ❯

Data Engineer Role Opportunity for a Data Engineer to join a scaling startup in the Education sector Salary up to £70k , depending on experience Fully remote role (Europe-based) Tech stack: Python, GCP, PostgreSQL, MongoDB, ML If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to … AI-powered platform that helps university students prepare for exams and supports children in improving their reading and writing skills. As we continue to scale, we're expanding our data engineering capability to strengthen our AI-driven learning ecosystem. WHAT YOU WILL BE DOING: Design, build, and maintain ETL/ELT data pipelines and integrations to support platform … and analytics needs. Develop scalable, reliable data architectures using GCP, MongoDB, PostgreSQL, and Python. Collaborate with cross-functional teams to define and implement data models and storage strategies. DATA ENGINEER - ESSENTIAL SKILLS: Proven experience as a Data Engineer, Data Developer, or similar role. Strong experience with GCP (e.g. BigQuery, Cloud Storage, Dataflow) and More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and … integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse More ❯

to support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using … Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and Responsibilities Design, build, and maintain large … scale data pipelines using Microsoft Fabric and Databricks Develop and implement data architectures that meet business requirements and ensure data quality, security, and compliance Collaborate with wider Product & Engineering teams to integrate data pipelines with machine learning models and analytics tools Optimise data processing and storage solutions for performance, scalability, and cost-effectiveness Develop and More ❯

Senior Data Engineer Azure, Power BI, ADF, Synapse Salary: £60,000£70,000 + excellent benefits Location: Birmingham or London (12 days per month in office) Employment: Full time Join a leading and growing UK financial services company as a Senior Data Engineer, taking ownership of enterprise-grade Azure data solutions and advanced Power BI … reporting. This is a high-impact role for an experienced data engineer who wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the design, build, and … optimisation of Azure Data Factory (ADF) ETL pipelines . Develop scalable Synapse Analytics data models and performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition to Microsoft Fabric More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion and … strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on role, where you'll … also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data solutions to support analytics, machine learning More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000-£100,000 Sector: Fintech We're looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who began their … career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You'll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines and models that support decision … making across the business. This is a hands-on, collaborative role, suited to someone who's confident communicating with data, product, and engineering teams, not a 'heads-down coder' type. Top 4 Core Skills Python - workflow automation, data processing, and ETL/ELT development. Snowflake - scalable data architecture, performance optimisation, and governance. SQL - expert-level query writing More ❯

DATA ENGINEER UP TO £75,000 + BENEFITS HYBRID - LONDON If you're a technically strong, proactive Data Engineer looking to join a FTSE-listed business during a major transformation, this could be a fantastic next step. THE COMPANY: Having recently joined forces with a major FTSE 100 company, this client is merging systems, data, and teams - creating a once-in-a-career opportunity for a driven Data Engineer to make a visible impact.With a flat and collaborative structure, you will have direct access to senior decision-makers and be able to input how their data function evolves. THE ROLE: This is a hands-on engineering role sitting at the heart … of the data and digital transformation. You'll own and manage the data warehouse, ensuring data quality, reliability, and scalability, while contributing to how data is used to drive commercial decisions - particularly around pricing, revenue, and customer insight. Key responsibilities include: Manage and maintain the company's data warehouse (Python, Airflow, DBT, Kimball) Ensure data More ❯

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology, and wider business … stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who delivers results through collaboration and … technical excellence. Data Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to translate business More ❯

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology, and wider … business stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who delivers results through collaboration … and technical excellence. Data Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to translate More ❯

If you are a natural collaborator and a creative problem solver - this position might be for you! We are looking for a Senior Data Engineer to join our Data team and be a part of Nest's transformation to use its data and insight to drive decision making.You’ll work closely with stakeholders to develop, test … and maintain data products and solutions that align with their requirements. You’ll be helping to develop and maintain a cloud-based data and analytics platform on Azure and help end-users of every level integrate their workflows between this and other platforms, including AWS-based solutions.You’ll combine data from different sources, and build data pipelines to transform and organise raw data into formats and structures that can be easily used for business intelligence, visualisations and dashboards, deep dive analysis, and long term forecasting/modelling. To be successful in this positions you will have the following skills, competencies and experience: You’re a natural collaborator and a creative problem solver who knows More ❯

Robert Half Technology are assisting a market leading real estate organisation to recruit a Data Engineer on a contract basis - Hybrid Working - London based - Outside IR35 In this role, you will manage and optimise the data infrastructure, driving insights and supporting our decision-making processes. Your expertise will be crucial in contributing to our organisation's data … driven success. As a key member of our team, you will have the opportunity to work on exciting projects and make a significant impact on our business Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to fulfil their data requirements … and support their work. Collect and process datasets from various sources, ensuring data quality and integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and More ❯

Data Engineer (with MS Fabric experience) Initial 6 month contract outside IR35 - Circ £500 - £600 per day (DOE) Work From Home + Central London office 1 or 2 days per week A pragmatic and self-sufficient Data Engineer with solid practical experience of the Microsoft Fabric platform in an Enterprise setting is required for this initial … month assignment with potential for further extension. Working along our clients Data Architect, the Data Engineer will work closely with the Global Finance team and external partners to deliver Finance solutions. Having implemented a Finance Lakehouse using the MS Fabric platform primarily integrating D365 data, they are now expanding into additional regions and integrating with other … systems. The Data Engineer will use their knowledge of working with the MS Fabric platform to recommend improvements to the current setup, so it's important they can engage effectively with finance stakeholders regarding the implementation and testing of new features/changes. Key responsibilities include: Enhance the use of Fabric within the Finance Lakehouse by recommending setup More ❯

Data Engineer (with MS Fabric experience) Initial 6 month contract outside IR35 - Circ £500 - £600 per day (DOE) Work From Home + Central London office 1 or 2 days per week A pragmatic and self-sufficient Data Engineer with solid practical experience of the Microsoft Fabric platform in an Enterprise setting is required for this initial … month assignment with potential for further extension. Working along our clients Data Architect, the Data Engineer will work closely with the Global Finance team and external partners to deliver Finance solutions. Having implemented a Finance Lakehouse using the MS Fabric platform primarily integrating D365 data, they are now expanding into additional regions and integrating with other … systems. The Data Engineer will use their knowledge of working with the MS Fabric platform to recommend improvements to the current setup, so it's important they can engage effectively with finance stakeholders regarding the implementation and testing of new features/changes. Key responsibilities include: Enhance the use of Fabric within the Finance Lakehouse by recommending setup More ❯