101 to 125 of 338 Data Engineer Jobs in London

Lead Data Engineer - Shape the Future of Data & Analytics - Azure I am currently recruiting for an exciting Lead Data Engineer role with a leading organisation undergoing a major digital transformation . This is a fantastic opportunity to define and lead the data engineering strategy, building a scalable, insight-driven data infrastructure that leverages … AI, cloud technologies, and advanced analytics to drive business success. Why Apply? High-Impact Role : Take ownership of data platform development, ensuring scalability, reliability, and efficiency. Technical Innovation : Work at the intersection of AI, machine learning, and real-time analytics , integrating cutting-edge technologies. Leadership & Strategy : Lead a team of data engineers and analysts , collaborating with senior stakeholders … to drive a data-driven culture . Key Responsibilities: Design and implement a modern cloud data platform (Azure) to support scalable analytics. Build ETL/ELT pipelines to process structured and unstructured data, enabling real-time insights. Develop and maintain Power BI dashboards, forecasting models, and business intelligence tools . Establish data governance frameworks , ensuring compliance More ❯

Are you from a data and analytical background and looking to use your skills in as a Senior Data Engineer? We are looking for someone to join our International Portfolio Analytics team here at Markel What part will you play? If you're looking for a place where you can make a meaningful difference, you've found … business and is represented within the Wholesale Leadership Team. Its focus is on the areas that are critical to achieve profitability and performance targets for a specialty lines insurer: Data, Analytics and Insights, Portfolio Management and Pricing Model development. The IPA team provides support to the following Divisions within Markel Wholesale: Cyber writes many differing types of business and … Science and Clinical Trials The primary function of this position is to assist in providing valuable insights, solutions, services and operational improvements across MINT Wholesale through the use of data & insights. This will mainly include working to improve and augment underwriting and claims enabling data driven decision making. It will also include creating business MI for the various More ❯

Role: 12 month FTC - Data Engineer Salary: £60,000-£65,000 WFH: London (Hybrid - 1 day per week in-office) Start Date: September/October 2025 I'm working with a leading global retail brand to find a talented Data Engineer who can help shape and deliver their evolving data strategy. This role is perfect … for someone who loves building robust, scalable data pipelines and turning complex datasets into actionable insights for the business. In this role, you will: Develop and maintain a cloud-based data warehouse (BigQuery, GCP) Create and optimise ETL processes (SSIS, Talend, Airflow) Collaborate with BI teams to deliver key performance metrics Ensure data quality, security, and cost … efficient storage What you'll bring: Strong SQL and data modelling skills Data warehouse design experience (BigQuery a plus) BI tool experience (Power BI preferred) Cloud architecture knowledge and problem-solving flair Bonus: ERP knowledge (Microsoft NAV/Business Central) or ML skills in Python/R If you're a proactive Data Engineer ready to More ❯

Lead AWS Data Engineer/Architect - Databricks - LondonI'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and despite having … top 100 best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature … within their data services however, there is always room for improvements so we're looking for an expert to not look to be involved in new processes but equally, help to reverse engineer the existing platform to increase efficiency and performance.This is a salaried position paying up to £130k as a base salary. It's hybrid working with More ❯

Lead AWS Data Engineer/Architect - Databricks - London I'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and despite … top 100 best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature … within their data services however, there is always room for improvements so we're looking for an expert to not look to be involved in new processes but equally, help to reverse engineer the existing platform to increase efficiency and performance. This is a salaried position paying up to £130k as a base salary. It's hybrid working More ❯

Principal Data Engineer - AWS Location: London (Hybrid) Practice Area : Technology & Engineering Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We're looking for a Principal Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You'll … play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry. What You'll Do Design and build end-to-end data pipelines leveraging AWS-native tools … and modern data architectures. Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems. Apply AWS Well-Architected Principles to ensure scalability, security, and resilience. Lead in the development of robust, tested, and fault-tolerant data engineering solutions. Support and mentor junior engineers, contributing to knowledge sharing across the team. What We're Looking For More ❯

it is deeply rooted throughout our work, to elevate and bring to life our differences throughout the platform world Overview We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the … data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also. As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimizing data workflows, and ensuring data availability and quality for production technology. The ideal … candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key to success in this role. Responsibilities Architect and More ❯

agency still grounded in our founding principle that people are at the centre of all we do. Each day, we apply this belief to harness the transformative power of data and technology to inspire and move people and business forward. With more than 7,000 employees in over 100 offices around the world, we are the flagship Publicis Media … incredibly high demand. If you are passionate about shaping the future of AI and thrive on complex, high-impact challenges, we encourage you to apply. Responsibilities As a Senior Data Engineer for AI/ML, you will be the architect and builder of the data infrastructure that feeds our intelligent systems. Your responsibilities will include: Design and … Build Scalable Data Pipelines: Architect, implement, and optimize robust, high-performance real-time and batch ETL pipelines to ingest, process, and transform massive datasets for LLMs and foundational AI models. Cloud-Native Innovation: Leverage your deep expertise across AWS, Azure, and/or GCP to build cloud-native data solutions, ensuring efficiency, scalability, and cost-effectiveness. Power Generative More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture and advanced analytics. … Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into technical solutions. Core Skills Cloud & Platforms : Azure … AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture and advanced analytics. … Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into technical solutions. Core Skills Cloud & Platforms : Azure … AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you More ❯

Data Engineer - Permanent As a data Engineer, you will shape next-gen data architecture, build smart solutions with Web and Data Science teams, and harness Gen AI to move faster and smarter. You will be experienced in AI and enjoy writing code. Responsibilities Build and maintain scalable distributed systems using Scala and Java Design … complex Spark jobs, asynchronous APIs, and parallel processes Use Gen AI tools to enhance development speed and quality Collaborate in Agile teams to improve their data collection pipelines Apply best practices like TDD, SOLID, and their engineering standards Design relational and non-relational databases and data models Support the Data Science team in deploying machine learning models … to production Leverage data structures, algorithms, and design patterns effectively Foster empathy and collaboration within the team and with customers Preferred Experience Degree in Computer Science or equivalent practical experience Commercial experience with Spark, Scala, and Java (Python is a plus) Strong background in distributed systems (Hadoop, Spark, AWS) Skilled in SQL/NoSQL (PostgreSQL, Cassandra) and messaging tech More ❯

Data Engineer - Permanent As a data Engineer, you will shape next-gen data architecture, build smart solutions with Web and Data Science teams, and harness Gen AI to move faster and smarter. You will be experienced in AI and enjoy writing code. Responsibilities Build and maintain scalable distributed systems using Scala and Java Design … complex Spark jobs, asynchronous APIs, and parallel processes Use Gen AI tools to enhance development speed and quality Collaborate in Agile teams to improve their data collection pipelines Apply best practices like TDD, SOLID, and their engineering standards Design relational and non-relational databases and data models Support the Data Science team in deploying machine learning models … to production Leverage data structures, algorithms, and design patterns effectively Foster empathy and collaboration within the team and with customers Preferred Experience Degree in Computer Science or equivalent practical experience Commercial experience with Spark, Scala, and Java (Python is a plus) Strong background in distributed systems (Hadoop, Spark, AWS) Skilled in SQL/NoSQL (PostgreSQL, Cassandra) and messaging tech More ❯

Senior Data Engineer Salary: £85K - £95K Location: London - Flexible working Data Idols are working with a fast-growing, product-led tech company to hire a Senio Data Engineer and help shape the data platform. They are looking for this person to provide technical leadership and lead projects end to end. The Opportunity Whilst acting … opportunity to have real technical ownership over the systems and models that power decision making across the entire organisation. In this role, you'll drive the design of robust data pipelines, evolve our warehouse strategy, and align cross-functional teams around shared, reusable models. You'll be part of a company that takes data seriously, where your work … Experience Strong Python SQL Experience working with GCP dbt If you are looking for a new challenge, then please submit your CV for initial screening and more details. Senior Data Engineer More ❯

high-growth Google Cloud consultancy. At Qodea, you'll be part of a team energised by innovation and passionate about delivering exceptional results. We craft cutting-edge solutions in data and analytics, AI, cloud infrastructure and security, driving digital transformation that empowers our customers to scale, modernise and lead in their industries. We're driven by ideas and powered … by our people. We are looking for a Senior Data Engineer to deliver solutions that surpass our customers expectations, by utilising cutting-edge tools and technologies. We really value in-person collaboration, so we're looking for you to spend at least 60% of your time on-site. This means being at our company offices or at a … client's site. How You'll Shape Our Success The purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets. What You'll Do Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data More ❯

eSC Cleared Data Engineer Bristol or London (Mostly working from home) Up to 745 per day (Umbrella, Inside IR35) Must hold live and transferrable Enhanced SC Security Clearance About the Role We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll be … instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems. If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact. Key Responsibilities Design & Optimise Pipelines - Build and refine ETL/ELT workflows using … Apache Airflow for orchestration. Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services. Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift). Data Quality & Governance - Implement automated validation, testing, and monitoring for data integrity. Performance & Troubleshooting - Monitor More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform data … machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends, themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer … data to understand each client's consumer base, building personalisation and other machine learning models to better engage with and excite consumers Data Engineering & Data Architecture : data engineering across a variety of tools to integrate these leading technologies into optimised and efficient data models and ecosystems, feeding into best-in-class analytics dashboards, marketing activation More ❯

by delivering ultrafast connectivity to business dense areas across the UK, working with partners to identify the right locations and then maximising subsequent connection rates. Role Description As a Data Engineer at ITS you will be a core member of the wider technical team, responsible for designing, building, and optimising the pipelines that turn raw network, commercial, and … operational data into trustworthy, analytics ready assets. Working closely with Data Analysts, Network Engineering, and Digital teams, you will own our data platform, ensuring data is accurate, timely, and secure to drive reporting, automation, and develop towards AI driven decision making. Key Responsibilities • Design, develop and maintain scalable ELT/ETL pipelines that ingest data from network devices (IPDR, SNMP, OSS/BSS), CRM, finance, and IoT platforms into our BI warehousing environment. • Model data using Kimball/star schemas and data vault principles to support BI and self service analytics. • Implement data quality, lineage, and observability tooling (e.g., dbt tests, Great Expectations, Azure Purview). • Optimise storage and compute costs More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their London … based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver actionable insights and … support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with cloud platforms (GCP preferred) and More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their London … based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver actionable insights and … support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with cloud platforms (GCP preferred) and More ❯

Senior AWS Data Engineer - Greenfield Market Data Platform | London | Vice President Level Location: London - Canary Wharf (Hybrid: 2-3 days/week in office) Salary: Up to around £120,000 + Bonus + Benefits Employment Type: Permanent Industry: Financial Services We're working with a prestigious financial services client on a greenfield data engineering opportunity that … s set to transform how market data is accessed and used across the business. This is a rare chance to join a high-impact initiative at its inception, designing and building a cutting-edge Market Data Store (MDS) platform using the latest cloud technologies. This individual contributor role is ideal for a hands-on Senior Data Engineer who thrives in technically complex environments and enjoys solving large-scale data pipeline challenges. You'll work with tools like AWS Glue, PySpark, Iceberg, Databricks, and Snowflake , collaborating with data scientists and stakeholders across multiple business units. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures. Implement secure and efficient data lakes and More ❯

Senior AWS Data Engineer - Greenfield Market Data Platform | London | Vice President Level Location: London - Canary Wharf (Hybrid: 2-3 days/week in office) Salary: Up to around £120,000 + Bonus + Benefits Employment Type: Permanent Industry: Financial Services We're working with a prestigious financial services client on a greenfield data engineering opportunity that … s set to transform how market data is accessed and used across the business. This is a rare chance to join a high-impact initiative at its inception, designing and building a cutting-edge Market Data Store (MDS) platform using the latest cloud technologies. This individual contributor role is ideal for a hands-on Senior Data Engineer who thrives in technically complex environments and enjoys solving large-scale data pipeline challenges. You'll work with tools like AWS Glue, PySpark, Iceberg, Databricks, and Snowflake , collaborating with data scientists and stakeholders across multiple business units. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures. Implement secure and efficient data lakes and More ❯

Europe's biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. … You'll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while using AI … itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill Implement data infrastructure More ❯

Europe's biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. … You'll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while using AI … itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill Implement data infrastructure More ❯

My client is based in the London area are currently looking to recruit for an experienced Data Engineer to join their team. They are one of the leaders within their space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … which will allow them to implement and utilise the most in demand and cutting edge technology on the market right now. Your role will include: Building and maintaining scalable data workflows that connect various internal platforms, including customer management, HR, and financial systems.Automate data ingestion and transformation processes using contemporary cloud-based technologies.Apply rigorous data quality checks … and cleansing procedures to maintain integrity across datasets.Data Structuring & Enrichment Work closely with architecture teams to define unified data representations across business areas.Develop comprehensive datasets tailored for reporting and advanced analytics.Harmonise performance indicators to enable consistent insights across departments.Infrastructure & Workflow Automation Ensure data workflows are modular, version-controlled, and integrated with automated deployment pipelines.Enhance efficiency of data More ❯

Senior AWS Data Engineer I am working with a leading organisation that is embarking on a greenfield initiative to revolutionise how their data is accessed and utilised. As part of this transformation, they're looking for a highly skilled Senior AWS Data Engineer to join their team and help design and build a cutting-edge … data platform. This is a rare opportunity to work on a high-impact project, collaborating with multiple business units and leveraging modern technologies such as Databricks and Snowflake. You'll be at the forefront of solving complex data pipeline challenges while contributing to strategic data architecture decisions. As part of this role, you will be responsible for … some of the following areas: Design and build scalable data pipelines using AWS technologies Collaborate with cross-functional teams to deliver robust data solutions Implement best practices for data governance, quality, and security Process and analyse large datasets using Python and SQL Support the deployment and optimisation of data platforms including Databricks and Snowflake Contribute to More ❯