126 to 150 of 430 Data Engineer Jobs in London

This is a fantastic opportunity to work as a Data Engineer on a long term project, for a high profile airline group, inside IR35. It's important to note that this Data Engineer position will require 2 days per week in Heathrow. The key skills required … for this Data Engineer position are: Snowflake Python AWS DBT Airflow If you do have the relevant experience for this Data Engineer position, please do apply. More ❯

Senior Data Engineer - Snowflake - £110,000 (+10% Bonus) - London - Hybrid Company Overview: My client is a global leader in the insurance industry, serving millions of customers worldwide. With strong financial foundations established over decades, their commitment to utilising innovative solutions and cutting-edge technologies is a key pillar … as other amazing benefits, and a great company culture - over 4 out of 5 employees would recommend working here. Role Overview: As a Senior Data Engineer you'll be responsible for building and deploying full solutions from scratch, while maintaining security and data best practices. Duties will … tasks. Due to your seniority you will also be tasked with mentoring junior engineers. You will be joining a close-knit team of 6 Data Engineers, as well as 30 Engineers in the businesses data arm. Requirements: 3+ Years data engineering experience Snowflake experience Proficiency across an More ❯

NOTE - That to be considered you must be in possession of active NPPV3 clearance. THE ROLE To design, implement, and develop robust and scalable data infrastructure that supports advanced analytics and intelligence operations within the police department, enabling data-driven decision-making for crime prevention, investigations, and public … safety. This post will work within a 130-strong team of intelligence professionals. Enabling seamless integration and analysis of complex criminological and intelligence data, empowering analysts and investigators to identify crime patterns, predict future incidents, and enhance investigative outcomes. Ensuring the integrity, security, and ethical use of sensitive criminal … justice information, adhering to stringent compliance standards and fostering public trust. Drive innovation in data management and analytics, leveraging cutting-edge technologies to enhance the department's ability to respond to evolving crime trends and emerging threats. Empower the department with the tools to transform data into actionable More ❯

Databricks Data Engineer | London | £50,000 - £65,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio … of clients and projects. Due to exciting growth plans we are now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid More ❯

Databricks Data Engineer | London | £50,000 - £65,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio … of clients and projects. Due to exciting growth plans we are now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid More ❯

REQUIRED: DATA ENGINEER - SC CLEARED LOCATION: FULLY REMOTE WITH OCCASIONAL TRAVEL TO CENTRAL LONDON IR35 STATUS: INSIDE DURATION: 6 MONTH INITIAL CONTRACT Seeking a Data Engineer who has a strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark … schema management etc - Strong understanding of complex JSON manipulation - Experience working with Data Pipelines using a custom Python/PySpark frameworks - Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. - Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets - Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve) - Experience working in a support More ❯

REQUIRED: DATA ENGINEER - SC CLEARED Location: Fully remote with occasional travel to Central London IR35 Status: Inside Duration: 6-month initial contract Job Description: Seeking a Data Engineer with a strong understanding of data concepts, including data types, data structures, schemas (JSON and … Spark), and schema management. Key Skills and Experience: Strong understanding of complex JSON manipulation Experience with Data Pipelines using custom Python/PySpark frameworks Knowledge of the 4 core Data categories (Reference, Master, Transactional, Freeform) and handling Reference Data Understanding of Data Security principles, access controls … advanced proficiency, Pydantic bonus) SQL PySpark Delta Lake Bash Git Markdown Scala (bonus) Azure SQL Server (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Data ingestion and integration) JIRA Additional Notes: Candidates with current or past high-level security clearance are encouraged to More ❯

Job Title: Azure Data Engineer Lead - Outside IR35 Location: Remote Salary/Rate: £450 per day - Outside IR35 Start Date: 28/04/2025 Duration: 3 months We have an exciting opportunity with a major retail company. They are looking for a Lead Azure Data Engineer … working outside IR35 and fully remote. Job Responsibilities/Objectives: Lead the design and execution of the end-to-end migration from on-premise data systems to Azure, ensuring scalability, reliability, and performance. Develop and optimise data pipelines using Azure Data Factory, Synapse Analytics, and related services … to support data ingestion, transformation, and integration. Architect and implement Azure-based data solutions, including Data Lake, SQL Database, and Databricks, aligning with business and technical requirements. Establish cloud data engineering best practices, including governance, security, monitoring, and cost optimisation. Collaborate cross-functionally with cloud architects More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great … customer experience. We are looking for someone who has a passion for data, learning and self-development. You will have 0-1 year experience in data engineering and analytics. We do not expect you to know everything, but we do expect you to be inquisitive, innovative and fast More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great … customer experience. We are looking for someone who has a passion for data, learning and self-development. You will have 0-1 year experience in data engineering and analytics. We do not expect you to know everything, but we do expect you to be inquisitive, innovative and fast More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all … delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You … will work closely with data scientists, analysts, and software engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and More ❯

Hybrid/Remote from within the UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organisation, we push the boundaries of data science, optimisation and artificial intelligence to solve the hardest problems in industry. Satalia is a community of individuals devoted to working on diverse and … shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. We are hiring across all experience levels in data science, from entry-level to seasoned professionals, and offer competitive salaries commensurate with experience and skills. It is a great time to be joining … as the industry transforms itself in what we believe is a generational moment for technology and AI. YOUR RESPONSIBILITIES Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. They develop … products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities … Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. They develop … products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities … Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying More ❯

Data Engineer (UKIC DV Clearance) Remote £75,000 - £90,000 + Training + Progression + Company Benefits Are you a Data Engineer with developed vetting looking to join on of the worlds most renowned multinational technology businesses where you will be working on some of the … of how quickly you progress with access to constant personal and professional development opportunities? On offer is the exciting opportunity for a Linux Infrastructure Engineer who currently has developed vetting to join one of the world's most well known, multinational, technology business who have consistently been in the … this global tech giant as well as a vital role within the UK and Global Defence industry. In this role, the successful Linux Infrastructure Engineer will be responsible for both continuous improvement and continuous deployment across many different projects and teams. The ideal Data Engineer would have More ❯

Fabric Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Fabric Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Fabric implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights … creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of cloud data platforms solutions More ❯

Data Engineer We are on the lookout for a Data Engineer who will play a key role in analysing, documenting, and implementing data solutions to enable analytics across the business. You’ll play an integral part in claims and supporting management information dashboards through the … automation and streamlining of data processes. What you’ll be doing: Build and maintain data warehouses on the Azure Cloud and create one source of truth data sets to drive consistency and ease of business reporting Work with multiple business customers (Underwriting, Operations, Technical Accounts, Finance, Actuarial … Claims etc.) to collate, update and balance monthly/quarterly data by implementing repeatable automated processes Liaise with business customers and IT to produce accurate Management Information and data flow automation, including data reconciliation with Finance, Technical Accounts, and Actuarial departments Interact with IT, Underwriting, Operations, Technical More ❯

Data Engineer We are on the lookout for a Data Engineer who will play a key role in analysing, documenting, and implementing data solutions to enable analytics across the business. You’ll play an integral part in claims and supporting management information dashboards through the … automation and streamlining of data processes. What you’ll be doing: Build and maintain data warehouses on the Azure Cloud and create one source of truth data sets to drive consistency and ease of business reporting Work with multiple business customers (Underwriting, Operations, Technical Accounts, Finance, Actuarial … Claims etc.) to collate, update and balance monthly/quarterly data by implementing repeatable automated processes Liaise with business customers and IT to produce accurate Management Information and data flow automation, including data reconciliation with Finance, Technical Accounts, and Actuarial departments Interact with IT, Underwriting, Operations, Technical More ❯

your ambition to work every day, which is why, at British Airways the sky is never the limit. We are looking for talented Principal Data Engineers with deep technical data platform engineering skills including SQL, AWS, Snowflake, Airflow, Git, and Python. As a Principal Data Engineer, you'll serve as a technical lead overseeing Senior Data Engineers, driving industry best practices to build a world-class data engineering function and providing direction for engineering a modern data platform. You'll lead end-to-end data product development in an Agile environment … contributing to British Airways' renowned service and shaping the future of our business. Your responsibilities will include: Bringing an innovative and creative mindset to data engineering challenges to develop a modern data platform with efficient reusable components Developing the BA Data Engineering community of practitioners Leading or More ❯

diversity as we possibly can. If this sounds good to you, then we're thrilled you're considering joining our team! Role Overview The Data Engineer will play a critical role in implementing and maintaining Lumon's technical data infrastructure. Reporting to the Head of Data, you will focus on building and optimising the Azure Synapse data warehouse, developing robust data pipelines, and delivering high-quality datasets for reporting and analytics. This role is ideal for a technically skilled professional who thrives on designing scalable data solutions and enjoys solving complex data challenges. Key Responsibilities Data Infrastructure and Pipeline Development Design, develop, and maintain ETL/ELT pipelines using Azure Synapse Analytics, Data Factory and other Azure related cloud warehouse tools. Optimise the Azure Synapse data warehouse for performance, scalability, and reliability. Integrate data from various internal More ❯

diversity as we possibly can. If this sounds good to you, then we're thrilled you're considering joining our team! Role Overview The Data Engineer will play a critical role in implementing and maintaining Lumon's technical data infrastructure. Reporting to the Head of Data, you will focus on building and optimising the Azure Synapse data warehouse, developing robust data pipelines, and delivering high-quality datasets for reporting and analytics. This role is ideal for a technically skilled professional who thrives on designing scalable data solutions and enjoys solving complex data challenges. Key Responsibilities Data Infrastructure and Pipeline Development Design, develop, and maintain ETL/ELT pipelines using Azure Synapse Analytics, Data Factory and other Azure related cloud warehouse tools. Optimise the Azure Synapse data warehouse for performance, scalability, and reliability. Integrate data from various internal More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python … objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … independently with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning features More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python … objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … independently with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning features More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access … and supporting a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with … business growth Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple data sources to ensure real-time availability Promote high More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access … and supporting a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with … business growth Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple data sources to ensure real-time availability Promote high More ❯