476 to 500 of 675 Data Pipeline Jobs in the UK

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Lead Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Lead Data Engineer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

Databricks Consultant/Data Engineer A technology consultancy client of ours is investing heavily in a dedicated Databricks capability. They need an experienced Databricks contractor to join client-facing delivery, work on high-impact programmes and help set the standard for a new practice. The Role … work directly with clients to design, build and optimise modern data platforms on Databricks and cloud-native technologies. This goes beyond standard engineering: you'll influence delivery standards and contribute to reusable frameworks and accelerators. What You'll Be Doing Building production-grade data pipelines with ...

Principal Engineer for Identity & Privacy, you'll shape the technical foundations that help us earn traveller trust while safely unlocking the data and AI capabilities behind brilliant product, personalisation, experimentation and advertising experiences. This is a senior technical leadership role with impact right across Skyscanner. … technical strategy and set standards for identity, consent and privacy engineering across our traveller-facing products, data platforms and operational systems - spanning web, app, backend, experimentation, analytics, advertising and machine learning. What you'll be doing Setting our technical strategy: You'll define and communicate the long-term ...

Principal Engineer for Identity & Privacy, you'll shape the technical foundations that help us earn traveller trust while safely unlocking the data and AI capabilities behind brilliant product, personalisation, experimentation and advertising experiences. This is a senior technical leadership role with impact right across Skyscanner. … technical strategy and set standards for identity, consent and privacy engineering across our traveller-facing products, data platforms and operational systems - spanning web, app, backend, experimentation, analytics, advertising and machine learning. What you'll be doing Setting our technical strategy: You'll define and communicate the long-term ...

capabilities within air-gapped environments Deploy and manage containerised applications using Docker and Kubernetes Build and integrate APIs and microservices Develop and maintain data pipelines and workflow orchestration Configure and integrate workflow tooling such as Jira Work with a range of database, search and storage technologies Troubleshoot … management Previous experience working within air-gapped environments Strong understanding of APIs and microservices Experience with Prefect, Airflow or similar data pipeline/orchestration technologies Experience configuring and integrating workflow tooling such as Jira Experience with database and storage technologies such as: SQL Elasticsearch MongoDB DSE/ ...

looking for a talented Data Engineer to join a growing team in London, working on high-impact data projects for well-known UK brands. Like the look of this opportunity Make sure to apply fast, as a high volume of applications is expected Scroll down … read the complete job description. You'll design and build scalable data pipelines, work with cloud technologies, and turn complex data into trusted, usable assets. You'll have the opportunity to work across a variety of projects while exploring how Agentic AI is transforming data ...

gapped environments \n Deploy and manage containerised applications using Docker and Kubernetes \n Build and integrate APIs and microservices \n Develop and maintain data pipelines and workflow orchestration \n Configure and integrate workflow tooling such as Jira \n Work with a range of database, search and storage technologies … Previous experience working within air-gapped environments \n Strong understanding of APIs and microservices \n Experience with Prefect, Airflow or similar data pipeline/orchestration technologies \n Experience configuring and integrating workflow tooling such as Jira \n \n Experience with database and storage technologies such ...

hiring Senior BI Analysts to join our Collections & Recoveries team. This role is ideal for technically strong, curious analysts who enjoy using data, reporting and automation to solve meaningful business problems. You will improve access to insight, reduce manual processes and build scalable data solutions that … support better decisions across the bank. The opportunity This role has a strong BI and reporting focus, with a meaningful element of data modelling and collaboration with Analytics Engineering. You will build trusted data pipelines, establish semantic layers with clearly defined metrics and design self-serve ...

will work on a wide range of systems that fuel our trading success including, but not limited to, core tooling and frameworks, data pipelines used to feed predictive models in research and trading, and software products used worldwide by traders and researchers. You will collaborate with experienced software ...

value outcomes over output, build the smallest thing that works and then iterate. Skills: • Distributed systems • Cloud (cost and security aware) and IaC • Data pipelines, vector stores and embeddings • AI assisted engineering (Claude Code, agents, evals) • Consulting and stakeholder management You should be tech agnostic and expect ...

Bugs: Track down issues across the whole system-from a button glitch on screen down through the background servers, data pipelines, and logins. Keep Code Clean: Write solid automated tests for your changes and participate in regular team code reviews. Essential Skills Proven Engineering Experience (5+ years ...

contractual security obligations. Key Responsibilities: Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

contractual security obligations. Key Responsibilities: Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

contractual security obligations. Key Responsibilities: Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

their needs, and translating them into effective outcomes. You understand and align with our Values Requirements The Role: We are seeking an AI Data Scientist to help build intelligent, data-driven products. You will design, develop, and deploy machine learning models, working across data engineering and analytics to solve complex business problems. Youll collaborate with product, engineering, and business teams to transform data into actionable insights and high-impact AI solutions. Key Responsibilities: Design, develop, and deploy machine learning and AI models (e.g., predictive models, NLP, computer vision, recommender systems ...

their needs, and translating them into effective outcomes. You understand and align with our Values Requirements The Role: We are seeking an AI Data Scientist to help build intelligent, data-driven products. You will design, develop, and deploy machine learning models, working across data engineering and analytics to solve complex business problems. You'll collaborate with product, engineering, and business teams to transform data into actionable insights and high-impact AI solutions. Key Responsibilities: Design, develop, and deploy machine learning and AI models (e.g., predictive models, NLP, computer vision, recommender ...

Their primary focus is on execution within defined parameters, applying modern engineering practices including CI/CD, automated testing, code quality, observability and data quality controls. They may also be accountable for regular reporting or process administration within the squad. Working in partnership with more experienced staff, their … practical, well-engineered technical solutions. Build production-ready solutions using modern engineering practices, including CI/CD, automated testing, code quality, observability and data quality controls. Support data quality, monitoring, reporting and process administration activities to help ensure accurate and consistent outcomes. Identify and resolve technical ...

Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale ...

join our team in London, UK in a hybrid working mode. This role involves designing and leading enterprise-scale Azure and Databricks data platforms to enable advanced analytics and Real Time processing capabilities. You will be responsible for platform architecture, governance, cost optimization and ensuring delivery of high … quality solutions that meet critical business needs in a complex, data-driven environment. Responsibilities Lead architecture design and implementation of scalable solutions on Azure Databricks Define and enforce platform standards, ensuring compliance with data governance and security policies Build and optimize Databricks streaming workloads, including Structured ...

Data Scientist (Fixed Term Contract) Contract Details: Contract Type: Fixed Term Contract Contract Length: 12 months Working Pattern: Full Time Daily Rate: 600 to 750 Our client, a leading player in the retail industry, is seeking a talented Data Scientist to join their dynamic team … term contract basis for 12 months. This is an exceptional opportunity to leverage your expertise in machine learning and statistics to drive impactful data science solutions that enhance customer experiences and optimise business operations. Role Overview: As a Data Scientist, you will be at the forefront ...

Data Scientist (Fixed Term Contract) Contract Details: Contract Type: Fixed Term Contract Contract Length: 12 months Working Pattern: Full Time Daily Rate: £600 to £750 Our client, a leading player in the retail industry, is seeking a talented Data Scientist to join their dynamic team … term contract basis for 12 months. This is an exceptional opportunity to leverage your expertise in machine learning and statistics to drive impactful data science solutions that enhance customer experiences and optimise business operations. Role Overview: As a Data Scientist, you will be at the forefront ...

Power BI Are you a Senior Analyst with strong GIS and geospatial analytics experience looking to take ownership of a growing data function? This is a unique opportunity to join a business where GIS sits at the heart of operational decision-making, combining spatial analysis, automation, reporting, optimisation … deliver real-world impact. The Company This growing organisation delivers large-scale operational programmes for clients across critical infrastructure and field-based environments. Data is central to how they plan, monitor and optimise services, with a particular focus on using geospatial and operational data to drive ...

develop, test, and deploy high-fidelity rule-based and anomaly-based detections-as-code Detect and respond to cyber threats using security data lake, SIEM, and cloud platforms Respond to alerts, cyber threats, and drive end-to-end incident response investigations Perform digital forensic investigations to include collection … sophisticated threats Develop AI-first security systems to automate detection and response operations Conduct threat hunts across corporate, cloud and product environments Support data engineering workflows for core security data lake and SIEM platforms Be an active member of D&R on-call rotations Coach ...

storage supporting current and future AI deployments • Troubleshoot integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft … Claude Cowork, and Claude Skills is a plus. Qualifications • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft ...

teams understand what their services cost and make better technical decisions. This is an engineering role, focused on building and running the platforms, data products and tooling that enable ASOS to understand and optimise cloud usage. At this level, you'll take ownership of complex, high-impact problems … warehousesKQL — Azure Monitor, Log Analytics and resource telemetryGitHub and GitHub Actions — source control, CI/CD and automationAzure DevOps — work item tracking and pipeline managementGitHub Copilot and Claude Code — agentic development and engineering workflowsAdditional InformationWhat's in it for you? Competitive salary, pension, and private medical care schemePerformance related ...