126 to 150 of 707 Data Pipeline Jobs in London

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading global investment firm is looking for a Data Support Engineer to join a high-impact team supporting quantitative researchers and traders. This is a fantastic opportunity to work in a fast-paced, data-driven environment where technology and research are at the heart of the business. You'll play a key role in ensuring … the smooth operation of data systems, supporting users across the business, and contributing to the ongoing development of a world-class data platform. Responsibilities Act as the first point of contact for researchers and traders needing support with data access, usage, and tooling. Troubleshoot and resolve data-related issues in collaboration with … data engineering teams. Onboard new users and provide training on internal data tools and best practices. Maintain and improve internal documentation to ensure clarity and consistency across the platform. Manage support workflows using tools like JIRA, ensuring timely resolution of requests. Contribute to expanding data coverage, including live data collection and historical More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

and we need your skills to support us on this exciting journey! Don't look back and submit your application before the opportunity passes you by Department: Analytics & Data Reporting to: Lead Data Engineer Who we are We're part of Super Group, the NYSE-listed digital gaming company behind some of the world's leading … on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision. As a Data Engineer you'll play a vital role in leveraging cutting-edge data technologies in Azure to drive innovation across our industry-leading brands. Design and develop robust … data frameworks, power real-time data pipelines, and create data services that deliver actionable insights to our global customer base. At Betway, we foster a culture of innovation and continuous improvement. Collaborate with a diverse team of experts, embrace technical challenges, and unleash your creativity. Thrive in an environment that values authenticity, responsibility, and More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Robert Half Technology are assisting a market-leading pharmaceuticals organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based (one day per week on site). Role * The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance.* Collaborate with data scientists, analysts, and business stakeholders to fulfil their data requirements and support their work.* Collect, process, and transform datasets from various sources, ensuring data quality and integrity.* Optimise and maintain the organisation's Snowflake infrastructure, providing performance tuning, enhancements, and regular "MOT" checks.* Develop and maintain DBT pipelines, mainly on Snowflake, to enable … efficient transformation and modelling of data.* Implement efficient data models and schemes for storage and retrieval, optimising processes for improved performance.* Troubleshoot and resolve data pipeline and infrastructure issues swiftly and effectively.* Keep abreast of industry trends and emerging technologies in data engineering and cloud infrastructure, continuously improving skills and knowledge. Profile * The More ❯

Robert Half have partnered with one of our Pharmaceutical manufacturing organisations to help them recruit for an experience Snowflake Data Engineer on an initial 6 months experienced based out of their London office. You will play a key role in designing and managing our Snowflake data warehouse and leveraging dbt (Data Build Tool) to … transform raw data into reliable, analysis-ready datasets that support regulatory compliance, operational efficiency, and innovation. Responsibilities: Design, develop, and maintain scalable data pipelines to support manufacturing, quality, and supply chain data workflows. Implement and manage data transformation models using dbt to standardise and validate datasets. Optimise and monitor performance of Snowflake … data warehouse environments. Collaborate with cross-functional teams (Data Scientists, Quality, Manufacturing, IT) to define data requirements and deliver reliable data solutions. Develop and maintain ETL/ELT workflows using modern orchestration and integration tools (e.g., Airflow, Fivetran, or similar). Implement data governance, lineage, and documentation best practices. Support More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Data Engineer – Sports Betting Location: London - Hybrid Salary: £100,000 + Bonus + Benefits A leading name in the sports betting industry is looking for a talented Data Engineer to help design, build, and scale data solutions that power trading, risk, and customer insight models. You’ll play a central role in transforming raw … data into actionable intelligence, working closely with data scientists, quants, and business stakeholders to shape cutting-edge betting products. Key Responsibilities Build and optimise data pipelines and ETL workflows in AWS using Python and SQL. Partner with analysts and quants to deliver reliable datasets for predictive modelling and pricing. Design and maintain data models supporting trading, risk, and customer behaviour analytics. Develop Power BI dashboards to provide insights across trading and product teams. Ensure high standards of data governance, quality, and scalability. Collaborate with product, trading, and technology teams to support innovation in the betting platform. What you’ll bring Proven experience as a Data Engineer in More ❯

Data Engineer – Sports Betting Location: London - Hybrid Salary: £100,000 + Bonus + Benefits A leading name in the sports betting industry is looking for a talented Data Engineer to help design, build, and scale data solutions that power trading, risk, and customer insight models. You’ll play a central role in transforming raw … data into actionable intelligence, working closely with data scientists, quants, and business stakeholders to shape cutting-edge betting products. Key Responsibilities Build and optimise data pipelines and ETL workflows in AWS using Python and SQL. Partner with analysts and quants to deliver reliable datasets for predictive modelling and pricing. Design and maintain data models supporting trading, risk, and customer behaviour analytics. Develop Power BI dashboards to provide insights across trading and product teams. Ensure high standards of data governance, quality, and scalability. Collaborate with product, trading, and technology teams to support innovation in the betting platform. What you’ll bring Proven experience as a Data Engineer in More ❯

Akkodis is partnering with a reputable client in Finance and they are looking for a Data Engineer with strong Databricks experience to expand their IT Team. They are currently improving their CX transformation programme and making changes to their institutional reporting suite. Job title: Data Engineer - Data BricksSTART :ASAPLocation: Liverpool Street - 3 days a … eek (NON Negotiable), the rest WFHDuration: 3 months rolling contractType of contract : Freelance, Inside IR35Level: mid-Senior Duties and Tasks: Develop and optimize data pipelines using Databricks and Spark.Design and implement data models and ETL processes in Snowflake.Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, and security across platforms.Monitor and troubleshoot data workflows and performance issues. Requirements: Proven experience with Databricks and Snowflake.Strong proficiency in SQL and Python.Extract Load Transform procedures, Data Lineage & Analysis.Familiarity with cloud platforms (e.g., Azure, AWS, or GCP).Experience with CI/CD and version control tools (e.g., Git).Excellent problem-solving and More ❯

DV Cleared Data Engineers Wanted – London – AWS or Azure – Senior/Principal We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in London. If you hold active DV clearance and want to work on … cutting-edge, mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable, reliable data solutions Collaborating with cross-functional teams including engineers, data scientists, and architects … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure … Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating … experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics Proficiency in SQL and Python for data transformation and pipeline logic Please note: you will be working in a US time zone. Please contract/01676545407 to discuss in more detail. ECS Recruitment Group Ltd is acting as an More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Lead Data Analyst – Data & Analysis Join us on our journey At Nando’s, our purpose is simple: to Create Lasting Happiness – for our people, our customers, and the communities we’re part of. Born in Johannesburg and growing worldwide, we’ve always been about more than flame-grilled PERi-PERi chicken. We’re about warmth, belonging … and creating experiences that matter – for our teams, for our guests, and for you. Now, we’re building exciting new digital and data capabilities. Our tech team has expanded rapidly over the last five years, and we’re bringing fresh ideas and innovation to the restaurant industry. This is your chance to help shape that journey. The role … We’re looking for a Lead Data Analyst to join our Data & Analysis team. This role isn’t just about crunching numbers – it’s about using data to tell stories, spark ideas, and make real impact. You’ll guide how we use data to make decisions, help shape our data More ❯

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯

Data Engineer Location: Paddington, London (Onsite) Salary: Up to £100,000 Job Type: Full Time We’re partnered with a well-funded early-stage tech company that’s using data and AI to bring greater financial intelligence to complex, data-heavy industries. Having recently secured significant investment from top-tier VCs, they’re now … entering a rapid growth phase and expanding their engineering team in London. They’re looking for a Data Engineer to help design and scale the core systems that power their platform - turning fragmented data into meaningful insights. You’ll work closely with technical leadership to build robust, modern data pipelines and play a key … Engineer or similar. Strong background with the modern data stack (e.g. Airbyte, dbt, BigQuery, Dagster, or equivalents). Skilled in SQL, data modelling, and pipeline orchestration. Analytical, pragmatic, and product-minded — focused on delivering impact. Comfortable in a fast-paced, collaborative, and evolving environment. A genuine interest in building technology that makes real-world More ❯

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯