451 to 475 of 925 Data Pipeline Jobs in the UK

Mid-Level Data Scientist Up to 65,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer … insights, predict behaviour, and enable hyper-targeted marketing. Responsibilities: Collaborate to develop data science solutions and outputs supporting the organisation’s product offerings Recognise opportunities to use data science or ML to solve product problems Develop data pipelines to support data science experimentation Show an understanding of the organisation and the benefits … of data science Develop, deploy and support science models in live production products Confidently talk about the benefits of data science approaches to existing and potential customers Requirements: 2/3 years in data science or a related field, or a Master’s degree. Proficient in Python (core skill), with strong experience in SQL More ❯

Channeling your inner grit will accelerate your growth, help us win as a team, and create unforgettable moments for our customers. The Crown Is Yours As a Senior Data Engineer, Games, you will help lead the design and implementation of reliable, scalable systems for transforming raw data into structured, usable formats that power data … and operational workflows. You'll operate across varied business domains and play a critical role in aligning technical solutions with business strategy. Your work will enable clean, performant data solutions that drive impact at scale. If you're excited about solving complex data challenges in a fast-paced, high-growth environment, come join us and grow … your career at DraftKings. Your work will create the next generation of immersive, data-powered gaming experiences that captivate audiences worldwide. What you'll do as a Senior Data Engineer Dive into the world of DraftKings to understand the systems and data structures that support our products Work with engineering, product, and business teams More ❯

Senior Data Engineer (3-Month Contract) Trailmix is an award-winning studio based in the heart of London, backed by mobile giants Supercell. We are actively growing the talented team behind our hit game Love & Pies , and setting up new titles with equally high ambition. If you want to shape the foundation of data in our … be the perfect role for you. About the role: This is a 3-month contract position reporting to the Engineering Lead . You will work alongside one other Data Engineer and collaborate closely with our Data Analytics , Product , Marketing , and Game teams. This role spans both live game support and the setup of data infrastructure for new games. You'll ensure we have robust pipelines and quality data for decision-making, and help scale systems to support complex event economies, growth loops, and game telemetry. We're looking for someone who can quickly contribute value by bringing practical solutions and modern best practices in data engineering - ideally with More ❯

BI Analyst Location: Bristol (Hybrid 2/3 days a week onsite) Salary: £35,000 - £45,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Purpose Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk, Group Sales Director , providing strategic data and insight to support their decision … making. Design, build, and deliver group-wide reporting programmes , primarily using Power BI , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CPO Bespoke data More ❯

Lead Data Engineer – London – £120,000 Sector: AI Consulting | Client Delivery Type: Full-time | Hybrid Join a tech consultancy at the forefront of applied AI—helping global brands design and deploy intelligent systems that solve real business problems. They combine deep engineering know-how with domain expertise to build the data infrastructure that powers machine learning … and generative AI at scale. 🔍 About the Role As a Lead Data Engineer , you’ll play a critical role in delivering AI-driven solutions for clients—owning the architecture and development of robust, scalable data platforms that feed into machine learning models and intelligent applications. You’ll work closely with Data Scientists, MLOps Engineers … and domain experts to ensure clean, accessible, and production-grade data pipelines are in place to support experimentation and deployment. 🛠️ Key Responsibilities Build and maintain high-performance data pipelines to power AI/ML use cases Architect cloud-native data platforms using tools like Databricks , Airflow , Snowflake , and Spark Collaborate with AI/ML More ❯

Lead Data Engineer – London – £120,000 Sector: AI Consulting | Client Delivery Type: Full-time | Hybrid Join a tech consultancy at the forefront of applied AI—helping global brands design and deploy intelligent systems that solve real business problems. They combine deep engineering know-how with domain expertise to build the data infrastructure that powers machine learning … and generative AI at scale. 🔍 About the Role As a Lead Data Engineer , you’ll play a critical role in delivering AI-driven solutions for clients—owning the architecture and development of robust, scalable data platforms that feed into machine learning models and intelligent applications. You’ll work closely with Data Scientists, MLOps Engineers … and domain experts to ensure clean, accessible, and production-grade data pipelines are in place to support experimentation and deployment. 🛠️ Key Responsibilities Build and maintain high-performance data pipelines to power AI/ML use cases Architect cloud-native data platforms using tools like Databricks , Airflow , Snowflake , and Spark Collaborate with AI/ML More ❯

SEM Data Optimisation Manager Remote-first but office available (UK preferred) | ~£75,000 base + annual bonus We’re partnering exclusively with a global leader in online travel experiences to find their next Paid Search Data Technology Manager — a rare opportunity for someone working at the intersection of performance marketing, martech, data engineering and … data science . This remote-first role sits at the heart of a high-impact SEM function, where technical innovation and data-led strategy are critical to growth. You won’t just support campaigns — you’ll help engineer the systems and signals that drive one of the largest paid search programmes in the travel space. Why … build custom signals that power smarter bidding strategies. Own and optimise data integrations between internal systems and platforms like Google Ads, SA360, and BigQuery. Monitor and troubleshoot pipeline operations to ensure seamless signal flow into bidding systems. Collaborate with data science and engineering teams to enhance SEM targeting through better data use and More ❯

Senior Data Engineer Up to £95,000 + benefits | Hybrid (3 days a week in City of London) A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team. You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus … on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements. This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability. Key responsibilities Design and build … Python and AWS services Own and maintain Airflow workflows Ensure high data quality through rigorous testing and validation Analyse and understand complex data sets before pipeline design Collaborate with stakeholders to translate business requirements into data solutions Monitor and improve pipeline performance and reliability Maintain documentation of systems, workflows, and configs Tech More ❯

Data Engineer We’re looking for a Data Engineer to join our fast-moving, hands-on data engineering team. This isn’t a traditional pipelines-for-analysts role - you’ll be building data systems and products that directly power real-time applications, internal tooling, and commercial projects across the business. Entrepreneurial and … space to experiment and the responsibility to stabilise when it counts. You’ll work across AWS and GCP, using a modern, containerized, event-driven stack. From real-time data processing to batch workflows, from APIs to backend services, you’ll help evolve our data fabric — the foundation for how data flows and generates value … across the business. What you’ll be doing: -Design and build real-time, event-driven, and batch data pipelines using Python. -Develop and deploy containerized microservices using Docker, running in ECS Fargate or similar cloud-native environments. -Work across AWS and GCP, leveraging services like Lambda, Kinesis, SQS, EventBridge, AWS Batch, Spark, and BigQuery to power cross-cloud More ❯

to ensure workflow reliability and performance AI-Enhanced Integration Development • Integrate Large Language Models (LLMs) into existing workflows for tasks like customer query processing, product description generation, and data enrichment • Develop intelligent automation that can understand context and make decisions based on business rules and AI insights • Build conversational interfaces that connect AI assistants with our e-commerce … implement optimizations for speed, accuracy, and cost-effectiveness Technical Integration Management • Develop and maintain API integrations with e-commerce platforms, payment gateways, shipping providers, and marketing tools • Design data transformation logic to ensure seamless information flow between CRM, inventory, and financial systems • Implement webhook-based automations for real-time order processing and customer communication • Build intelligent data … platforms, CRM systems, marketing tools, and payment gateways Understanding of AI integration patterns and prompt engineering (experience with LangChain, LangGraph, or similar frameworks preferred) • Experience with data pipeline development and ETL processes • Knowledge of version control systems (Git) and CI/CD pipelines • Familiarity with cloud platforms for hosting automation solutions • Work from the comfort of your More ❯

Measurement teams build tools and pipelines that power model evaluation at scale. As we scale our evaluation approaches and tooling, we need to process massive volumes of test data efficiently and reliably. This Data Engineer will be embedded in the AI Evaluation division to ensure our evaluation and analytics pipelines are robust, performant, and future-proof. … Their work will strengthen our data foundations for fast decision-making, accelerate the availability of large-scale image and video analytics, and help us rapidly integrate and leverage data from external partners - enabling faster iteration across both offline and on-road evaluation. Challenges you will own Build scalable and reliable data and analytics pipelines … wide development and decision-making. Collaborate across functions - including research engineers, simulation experts, robotics engineers, data scientists and safety drivers - to deliver and visualise enriched data. Improve pipeline observability, validation, and fault tolerance for production-grade robustness. Enable LLM-driven workflows by shaping data to be AI-consumable (e.g. chunking, embeddings, metadata). Reduce tech More ❯

Data EngineerLocation: UK – remoteLength: 3 monthsStart Date: October 2025 Rate: 41.35 per hourHours: 9am-6pmJob Description:This is Data Engineer role in the Central Integrity & Support org, where they will be responsible for performing day-to-day data engineering tasks to support the High Touch Support space, with a focus on improving user experience … and customer satisfaction. This includes designing, developing, and maintaining scalable data pipelines, architectures, and solutions that enable the organization to make data-driven decisions and drive business outcomes.Role and teams:There are multiple teams in the Central Integrity & Support org. there is a comms tool supporting customer comms tool, another team works on what are the … resolve a customer query. The CW will support both teams. Team of 7 FTEs they support the AI high touch support space.Day-to-Day activities in the role:Data Visualization· They will mostly work autonomously but will have interactions with Eng, DS and product manager at different stages to get insights.· DS will give the definition of the More ❯

form you are consenting to receive communications from LoopMe. Please tick the box below to confirm that you understand this. I agree to receive communications from LoopMe Lead Data Analyst - Commercial Finance - London London, England, United Kingdom Marketing and Advertising Full-time Description LoopMe is one of Campaign's Best Places to Work 2023 & 2024! Our vision is … supercharges LoopMe's mission, creating a globally scaled 1st party ad-tech platform built on patented AI. What we need We're looking for a hands-on Lead Data Analyst who can sit at the intersection of data science, business and finance to turn high-volume data into clear commercial insight. You will play … pivotal role in turning vast and complex datasets into actionable intelligence, leveraging business intelligence tools and advanced analytics to inform strategic decision-making. Working closely with Finance leadership, Data Science, and cross-functional stakeholders, you'll build compelling dashboards, uncover financial trends, and support our AI-driven business models. This is a high-impact role for someone who More ❯

fields of land use planning and sustainable infrastructure construction. Bouygues Travaux Publics is committed to diversity and is open to all talents. We are currently looking for a Data Engineering Lead to join us at the Civil Works Alliance (CWA) as we deliver one of the UK's most significant infrastructure projects - Sizewell C . This is a … rare opportunity to play a leading role in shaping the future of low-carbon energy in the UK. As our Data Engineering Lead, you'll be responsible for designing and leading the development of a secure, scalable data platform on Microsoft Azure , helping turn complex construction data into actionable insight. You'll manage the … full data lifecycle - from ingestion and transformation to warehousing and modelling - all while ensuring data quality, integrity, and alignment with business goals. Key responsibilities will include: Leading the design, development, and deployment of ETL pipelines across diverse business systems Driving the data platform roadmap and delivery using best-in-class engineering practices Managing a More ❯

Power Platform & Azure Data Developer Are you a data-driven developer with a passion for automation, analytics, and AI? We're working with a forward-thinking organisation that's investing heavily in digital transformation - and they're looking for a Power Platform & Azure Data Developer to join their growing team. This is a fantastic … opportunity to work on cutting-edge projects that blend Power Platform , Azure Data Services , and AI technologies to deliver intelligent, scalable solutions across the business. This is a hybrid role, with 2 days per week in their Central London office to collaborate with your team and business stakeholders. What You'll Be Doing: Power Platform Development : Build and … maintain Power Automate flows, Power Apps, and Power BI dashboards. Azure Data Engineering : Design and manage robust data pipelines using Azure Data Factory. AI & Advanced Analytics : Collaborate on AI/ML projects, integrating models into Power BI and Azure services. Collaboration & Documentation : Work closely with stakeholders to gather requirements and document technical solutions. What More ❯

Power Platform & Azure Data Developer Are you a data-driven developer with a passion for automation, analytics, and AI? We're working with a forward-thinking organisation that's investing heavily in digital transformation - and they're looking for a Power Platform & Azure Data Developer to join their growing team. This is a fantastic … opportunity to work on cutting-edge projects that blend Power Platform , Azure Data Services , and AI technologies to deliver intelligent, scalable solutions across the business. This is a hybrid role, with 2 days per week in their Central London office to collaborate with your team and business stakeholders. What You'll Be Doing: Power Platform Development : Build and … maintain Power Automate flows, Power Apps, and Power BI dashboards. Azure Data Engineering : Design and manage robust data pipelines using Azure Data Factory. AI & Advanced Analytics : Collaborate on AI/ML projects, integrating models into Power BI and Azure services. Collaboration & Documentation : Work closely with stakeholders to gather requirements and document technical solutions. What More ❯

these to you): Alex, a clinical engineer, built 'Slack for medical teams', supporting 1000s of channels per organisation and a real time single source of truth for patient data, in 4 weeks, picking up a large set of new technologies on the way (ground up built from low-level services like Appsync, GraphQL, not Twilio). Dennis built … their fundamental motivations and needs/pain points. Next 6 months - some examples of what to expect: Help architect and deploy a scalable & cost effective ETL data pipeline with version control, outputting clean data ready for tokenisation. Help deploy our active deep learning training & validation architecture to prod, so that we can correctly eat up … autonomous lance of elite engineers to fix healthcare and save lives. Work with the ML/data team to creatively ideate and ship features to improve ETL pipeline throughput and quality through a data-driven approach powered by analytics. More ❯

these to you): Alex, a clinical engineer, built 'Slack for medical teams', supporting 1000s of channels per organisation and a real time single source of truth for patient data, in 4 weeks, picking up a large set of new technologies on the way (ground up built from low-level services like Appsync, GraphQL, not Twilio). Dennis built … their fundamental motivations and needs/pain points. Next 6 months - some examples of what to expect: Help architect and deploy a scalable & cost effective ETL data pipeline with version control, outputting clean data ready for tokenisation. Help deploy our active deep learning training & validation architecture to prod, so that we can correctly eat up … autonomous lance of elite engineers to fix healthcare and save lives. Work with the ML/data team to creatively ideate and ship features to improve ETL pipeline throughput and quality through a data-driven approach powered by analytics. More ❯

Lead Data Engineer Location: Leeds (hybrid) Salary: Up to £70,000 (depending on experience) + bonus Clearance Requirement: Candidates must be eligible for UK National Security Vetting. We're looking for an experienced Lead Data Engineer to join a fast-growing digital technology team working on secure, high-impact projects. This role is ideal for someone … passionate about data engineering, cloud-native architecture, and delivering real-world solutions at scale. You’ll lead the technical delivery of complex data engineering solutions for high-profile clients, working within a multidisciplinary team. You'll be empowered to bring modern engineering practices to life while mentoring others and continuously improving standards. What You’ll Be … Doing: Leading end-to-end delivery of data engineering projects with accountability for quality and performance. Designing and building scalable, secure data pipelines using modern cloud and open-source tooling. Working closely with architects and analysts to translate business requirements into technical solutions. Driving engineering best practices, including code review standards and agile delivery. Contributing to More ❯

technology and engineering consultancy based in the UK, specializing in product development and digital transformation across sectors such as healthcare, automotive, and consumer products is seeking a talented Data & AI Engineer to join their team. In this role, you will design and implement data pipelines while also assisting in the development and promotion of MLOps best … AI-driven approach. If you're a driven Data & AI Engineer looking to make an impact, apply today to join their team! Key Responsibilities: Data Pipeline Design & Implementation: Design efficient, scalable data pipelines to specific workload requirements and performance optimization. MLOps Development: Drive the development of MLOps best practices, including experiment tracking, data … platforms such as Azure and GCP based on project requirements. Must-Have Skills: Strong experience with AWS and/or Azure AI services Expertise in building and maintaining data pipelines Nice-to-Have Skills: Familiarity with DevOps practices and tools Benefits: Hybrid working in a dynamic environment in Cambridge Opportunities to work with cutting-edge AI and cloud More ❯

In details, the position encompasses duties and responsibilities as follows: An experienced Data Engineer is required for the Surveillance IT team to develop ingestion pipelines and frameworks across the application portfolio, supporting Trade Surveillance analysts with strategy and decision-making. The team has recently developed a new data lake house infrastructure and ingestion architecture and is … of: Bachelor's degree in Information Systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training and experience. 5+ years proven experience in a data engineering role demonstrating a strong track record of designing, building, and maintaining data pipelines and data architectures. Good communicator, with good interpersonal skills and the … on own initiative Good problem solving and ability to think quickly under pressure. Skills: Programming Languages: Strong proficiency in Python and PySpark. Database Management: Expertise in SQL for data manipulation and querying. Data Orchestration: Experience with orchestration tools such as Apache Airflow or Dagster. Containerization: Familiarity with containerization technologies, specifically Kubernetes and Docker. Data More ❯

Possibility of remote work: Hybrid (number of WFO days will depend on the client's needs) Contract duration: 6 months Location: London JOB DETAILS Role Title: Senior Data Engineer Note: (Please do not submit the same profiles as for 111721-1) Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years … Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands-on experience with PySpark, Python, AWS, data modelling. Must have experience … in ETL processes. Must have hands-on experience in Databricks development. Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands-on experience in SQL development. Excellent communication skills & logical thinking. More ❯

TL;DR Kharon is seeking a full-time, London or Madrid-based Data Engineer . Occasional in office attendance is required for this role. RESPONSIBILITIES: Own it end-to-end. Design, develop, deploy, monitor, and fix the data services and pipelines you build. Robust data pipelines. Orchestrate workflows that ingest, transform, and serve large … volumes of multilingual, multi-format open-source data. Model data for humans & machines. Draft schemas across SQL, NoSQL, graph, and search systems so analysts and algorithms can both fly. Innovate. Evaluate and integrate LLM and other AI based solutions to improve data extraction and analysis across Kharon's products. Partner with the doers. Sit with product … managers, data scientists, investigators, and sanctions experts - translate fuzzy problems into clean, testable code. QUALIFICATIONS: Bachelor's degree in Computer Science, Statistics, Engineering, or a related field. 2+ years of professional experience in software or data engineering. Ability to work standard European time-zone hours and legal authorisation to work in your country of residence. Strong More ❯

Pay rate: up to 41.35ph PAYE, depending on location - must be UK based Key Responsibilities Data Infrastructure Development Design, build, visualise, and maintain scalable data pipelines and ETL processes. Collaborate with engineers to integrate new data sources into existing systems. Data Analytics Support Partner with data scientists to deliver clean … reliable datasets for reporting and analysis. Develop and maintain dashboards and visualisations as required. Data Management Ensure data quality, consistency, and accessibility. Implement and uphold data governance best practices. Support the team's on-call duties as needed. Day-to-Day Activities Be assigned to one primary project with a clear scope, timeline, and … deliverables. Work closely with Data and Software Points of Contact (POCs). Communicate effectively regarding timelines, progress, and potential issues. Focus primarily on: Building and backfilling datasets Creating dashboards and presenting insights Responsible for micro-deliveries or smaller tasks alongside main projects. Success will be measured by the quality and timeliness of your project deliverables. Qualifications A minimum More ❯

you're inspired to think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Data Scientist/Senior Data Scientist Join British Airways as a Data Scientist in our cutting-edge Operations Decision Support (ODS) product team. This full-stack … role sits at the heart of our transformation, combining data science, machine learning, and optimisation to build industrialised decision-support software. If you're passionate about solving real-world problems through intelligent, data-driven solutions and thrive in a collaborative, agile environment-this is your opportunity to make a real impact. What you'll do: Design … with software engineering teams, product & change teams to turn their models into industrialized products that are used by the airline every day to make better decisions. Build robust data pipelines, automate data cleaning, and deliver scalable, production-grade Python code using best practices such as typing, testing, and modular design. Integrate models into orchestration frameworks (e.g. More ❯