1 to 25 of 152 Data Engineer Jobs in London

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email … WHO WE ARE? We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply More ❯

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help organizations … unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design and … develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and enabling More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who is … working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such as Hadoop, Cloudera More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and excellence … across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering … standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of a modern event-sourcing architecture, enabling efficient More ❯

AWS Data Engineer Rate: Up to £400 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of … large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services … such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions Implement and optimise ETL/ELT processes , ensuring data integrity, consistency and quality across multiple sources Apply best practices in data modelling, version control More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation, and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect … design, and implement scalable Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows More ❯

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to reuse data flows where possible. Coordinate teams and … set best practices and standards when it comes to data engineering principles. Champion data engineering across projects and clients. Responsibilities Lead by example, holding responsibilities for team culture, and how projects deliver the most impact and value to our clients. Be accountable for the strategic direction, delivery and growth of our work. Lead teams, strands of work and … mid- to long-term delivery cycles (612 months), ensuring that near-term work supports broader programme and client objectives. About You Professional knowledge and experience Essential Proven experience in data engineering, data integration and data modelling Expertise with cloud platforms (e.g. AWS, Azure, GCP) Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with More ❯

The Opportunity Are you passionate about data engineering? The Open Data team at the Parliamentary Digital Service (PDS) is beginning the development of a new Open Data Platform for parliamentary procedure data, replacing existing platforms and their associated data integration and publishing services. As our Senior Data Engineer you will play a key … role in designing, building, and evolving the data platforms that support decision-making across the organisation. This role sits at the intersection of engineering, analytics, and product delivery. You'll work closely with cross-functional teams to provide high-quality, reliable, and scalable data solutions that drive insight and operational excellence. You'll bring strong software engineering experience … production-ready code as standard. Alongside this, you'll have hands-on cloud experience (Azure preferred, but AWS or GCP also welcome), including deploying, managing, and supporting cloud-hosted data services and applications. Using your advanced technical expertise and experience delivering modern data systems, you'll help shape our data strategy, improve how teams access and use More ❯

Data Engineer Salary £60,000–£75,000 + Equity, 25 days holiday, Pension + more Location - London (Hybrid) | Python | ETL | Impact-Driven Team I’m working with a fast-growing healthtech client that’s reshaping access to fertility care across Europe. They’ve just hired one Data Engineer and urgently need another to join their lean … high-performing team.This is a hands-on Data Engineer role where you’ll be at the heart of a major migration project — moving legacy IT systems and databases onto modern platforms. You’ll write Python scripts, build ETLs, and find smart ways to transform messy, unstructured data into clean, structured formats that support machine learning models and … real-time decision-making.You’ll be joining a team that values speed, autonomy, and output. The environment is fast-paced, collaborative, and mission-driven ideal for a Data Engineer who thrives on solving real problems and wants their work to make a tangible difference. What You’ll Be Doing Build and optimize ETL pipelines in Python Migrate legacy More ❯

Data Engineer Role Opportunity for a Data Engineer to join a scaling startup in the Education sector Salary up to £70k , depending on experience Fully remote role (Europe-based) Tech stack: Python, GCP, PostgreSQL, MongoDB, ML If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to … AI-powered platform that helps university students prepare for exams and supports children in improving their reading and writing skills. As we continue to scale, we're expanding our data engineering capability to strengthen our AI-driven learning ecosystem. WHAT YOU WILL BE DOING: Design, build, and maintain ETL/ELT data pipelines and integrations to support platform … and analytics needs. Develop scalable, reliable data architectures using GCP, MongoDB, PostgreSQL, and Python. Collaborate with cross-functional teams to define and implement data models and storage strategies. DATA ENGINEER - ESSENTIAL SKILLS: Proven experience as a Data Engineer, Data Developer, or similar role. Strong experience with GCP (e.g. BigQuery, Cloud Storage, Dataflow) and More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and … integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse More ❯

to support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using … Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and Responsibilities Design, build, and maintain large … scale data pipelines using Microsoft Fabric and Databricks Develop and implement data architectures that meet business requirements and ensure data quality, security, and compliance Collaborate with wider Product & Engineering teams to integrate data pipelines with machine learning models and analytics tools Optimise data processing and storage solutions for performance, scalability, and cost-effectiveness Develop and More ❯

Senior Data Engineer Azure, Power BI, ADF, Synapse Salary: £60,000£70,000 + excellent benefits Location: Birmingham or London (12 days per month in office) Employment: Full time Join a leading and growing UK financial services company as a Senior Data Engineer, taking ownership of enterprise-grade Azure data solutions and advanced Power BI … reporting. This is a high-impact role for an experienced data engineer who wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the design, build, and … optimisation of Azure Data Factory (ADF) ETL pipelines . Develop scalable Synapse Analytics data models and performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition to Microsoft Fabric More ❯

Senior Data Engineer – Hybrid/London - £130K + Bonus & Benefits – FinTech Overview: An established global FinTech organisation is seeking a skilled Senior Analytics Engineer/Data Engineer to help define and manage its analytical data models and semantic layers.You will support the development of reliable, well-structured datasets that enable accurate reporting, improved data … scalable semantic/analytics layers to create consistent business metrics and definitions. Work with teams across the business to understand requirements and translate them into reliable models. Develop core data models following modern data warehouse principles. Write high-quality SQL and maintain dbt-based transformations, tests, and documentation. Support colleagues by ensuring data quality and clarity throughout … the analytics ecosystem. Collaborate with data engineering teams to shape upstream data needs. Work with analysts and data consumers to promote usability and data literacy. Essential Skills & Experience: Fluent Russian language proficiency. Experience as an Analytics Engineer or Data Engineer, particularly in data modelling. Strong SQL and hands-on dbt experience. Ability More ❯

all, we're backed by a culture of respect. We embrace authenticity and inspire people to thrive. As part of the Direct-to-Consumer Decision Sciences team, the Lead Data Engineer - Data Quality will be responsible for overseeing a critical function that bridges data management with operational excellence. The role requires strong cross-functional collaboration skills … to effectively engage with software engineering, and data analytics to deliver robust and effective data quality solutions. In this role, the Lead Data Engineer - Data Quality will share responsibilities in the development and operation of Data Quality monitors, automation of data quality pipelines reporting of data quality to the business, as well … as support ongoing operations related to the Direct to Consumer data ecosystem. The candidate will act as a liaison between data engineering and other teams, advocating for data-driven decision making and best operational practices. Responsibilities include, but are not limited to: Help manage a high-performance team of Data Quality Engineers & Analysts. Contribute to and More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion and … strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on role, where you'll … also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data solutions to support analytics, machine learning More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000-£100,000 Sector: Fintech We're looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who began their … career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You'll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines and models that support decision … making across the business. This is a hands-on, collaborative role, suited to someone who's confident communicating with data, product, and engineering teams, not a 'heads-down coder' type. Top 4 Core Skills Python - workflow automation, data processing, and ETL/ELT development. Snowflake - scalable data architecture, performance optimisation, and governance. SQL - expert-level query writing More ❯

DATA ENGINEER UP TO £75,000 + BENEFITS HYBRID - LONDON If you're a technically strong, proactive Data Engineer looking to join a FTSE-listed business during a major transformation, this could be a fantastic next step. THE COMPANY: Having recently joined forces with a major FTSE 100 company, this client is merging systems, data, and teams - creating a once-in-a-career opportunity for a driven Data Engineer to make a visible impact.With a flat and collaborative structure, you will have direct access to senior decision-makers and be able to input how their data function evolves. THE ROLE: This is a hands-on engineering role sitting at the heart … of the data and digital transformation. You'll own and manage the data warehouse, ensuring data quality, reliability, and scalability, while contributing to how data is used to drive commercial decisions - particularly around pricing, revenue, and customer insight. Key responsibilities include: Manage and maintain the company's data warehouse (Python, Airflow, DBT, Kimball) Ensure data More ❯

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology, and wider business … stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who delivers results through collaboration and … technical excellence. Data Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to translate business More ❯

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology, and wider … business stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who delivers results through collaboration … and technical excellence. Data Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to translate More ❯

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology, and wider … business stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who delivers results through collaboration … and technical excellence. Data Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to translate More ❯

Principal Data Engineer - Core Systems Team Hybrid in London/Remote within UK The company Imagine a world where every small business has the power to thrive. That's the world we're building at iwoca. Small businesses aren't just statistics - they're the heartbeat of our communities, the character of our high streets, and the engine … s leading fintech innovators. But we're just getting started. Our mission? To empower one million businesses with the financial tools they deserve. We combine cutting-edge technology and data science with genuine human understanding to make finance feel less like a barrier and more like a superpower. Whether it's managing cash flow or seizing unexpected opportunities, we … the funds they need - often within minutes. The team You'll join the Core Systems team, who are responsible for driving innovation across the business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. More ❯