326 to 350 of 414 Data Pipeline Jobs in the UK excluding London

Databricks Consultant/Data Engineer A technology consultancy client of ours is investing heavily in a dedicated Databricks capability. They need an experienced Databricks contractor to join client-facing delivery, work on high-impact programmes and help set the standard for a new practice. The Role … work directly with clients to design, build and optimise modern data platforms on Databricks and cloud-native technologies. This goes beyond standard engineering: you'll influence delivery standards and contribute to reusable frameworks and accelerators. What You'll Be Doing Building production-grade data pipelines with ...

Principal Engineer for Identity & Privacy, you'll shape the technical foundations that help us earn traveller trust while safely unlocking the data and AI capabilities behind brilliant product, personalisation, experimentation and advertising experiences. This is a senior technical leadership role with impact right across Skyscanner. … technical strategy and set standards for identity, consent and privacy engineering across our traveller-facing products, data platforms and operational systems - spanning web, app, backend, experimentation, analytics, advertising and machine learning. What you'll be doing Setting our technical strategy: You'll define and communicate the long-term ...

gapped environments \n Deploy and manage containerised applications using Docker and Kubernetes \n Build and integrate APIs and microservices \n Develop and maintain data pipelines and workflow orchestration \n Configure and integrate workflow tooling such as Jira \n Work with a range of database, search and storage technologies … Previous experience working within air-gapped environments \n Strong understanding of APIs and microservices \n Experience with Prefect, Airflow or similar data pipeline/orchestration technologies \n Experience configuring and integrating workflow tooling such as Jira \n \n Experience with database and storage technologies such ...

value outcomes over output, build the smallest thing that works and then iterate. Skills: • Distributed systems • Cloud (cost and security aware) and IaC • Data pipelines, vector stores and embeddings • AI assisted engineering (Claude Code, agents, evals) • Consulting and stakeholder management You should be tech agnostic and expect ...

contractual security obligations. Key Responsibilities: Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

contractual security obligations. Key Responsibilities: Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

Their primary focus is on execution within defined parameters, applying modern engineering practices including CI/CD, automated testing, code quality, observability and data quality controls. They may also be accountable for regular reporting or process administration within the squad. Working in partnership with more experienced staff, their … practical, well-engineered technical solutions. Build production-ready solutions using modern engineering practices, including CI/CD, automated testing, code quality, observability and data quality controls. Support data quality, monitoring, reporting and process administration activities to help ensure accurate and consistent outcomes. Identify and resolve technical ...

Data Scientist (Fixed Term Contract) Contract Details: Contract Type: Fixed Term Contract Contract Length: 12 months Working Pattern: Full Time Daily Rate: £600 to £750 Our client, a leading player in the retail industry, is seeking a talented Data Scientist to join their dynamic team … term contract basis for 12 months. This is an exceptional opportunity to leverage your expertise in machine learning and statistics to drive impactful data science solutions that enhance customer experiences and optimise business operations. Role Overview: As a Data Scientist, you will be at the forefront ...

Power BI Are you a Senior Analyst with strong GIS and geospatial analytics experience looking to take ownership of a growing data function? This is a unique opportunity to join a business where GIS sits at the heart of operational decision-making, combining spatial analysis, automation, reporting, optimisation … deliver real-world impact. The Company This growing organisation delivers large-scale operational programmes for clients across critical infrastructure and field-based environments. Data is central to how they plan, monitor and optimise services, with a particular focus on using geospatial and operational data to drive ...

storage supporting current and future AI deployments • Troubleshoot integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft … Claude Cowork, and Claude Skills is a plus. Qualifications • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft ...

Viridien () is an advanced technology, digital and Earth data company that pushes the boundaries of science for a more prosperous and sustainable future. With our ingenuity, drive and deep curiosity we discover new insights, innovations, and solutions that efficiently and responsibly resolve complex natural resource, digital, energy transition … infrastructure challenges. Job Summary We're seeking a versatile Senior Machine Learning Engineer with strong data engineering instincts and a passion for production-grade AI systems. You'll play a pivotal role across the AI development lifecycle — from data ingestion to deployment — ensuring our models ...

Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. … take on complex, hands-on engineering challenges, building modern data platforms that have a tangible impact on how public services are delivered. Key Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver ...

Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. … take on complex, hands-on engineering challenges, building modern data platforms that have a tangible impact on how public services are delivered. Key Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver ...

Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. … take on complex, hands-on engineering challenges, building modern data platforms that have a tangible impact on how public services are delivered. Key Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver ...

site p/week Active SC required Up to £700/d inside ir35 3-year engagement Experience required in Model Development, Data Pipelines, Production Deployment Role Opportunity This is a long-term engagement with a leading Consultancy supplying into the Public Sector for an experienced Machine Learning ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

libraries/frameworks such as PyTorch, TensorFlow etc.) \n * Experience with RAG and LLM-based solutions \n * Solid understanding of AI architectures and data pipelines \n * Knowledge of security, compliance, and governance principles from a development perspective \n * Proven mentoring and team development capabilities \n * Excellent communication ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

Data Analyst - SQL, Power BI & Power Platform - £45,000/£47,000 - Grimsby, Lincoln, York, Louth or Hull Hybrid Working - 3 Days On-Site, 2 Days Working From Home The Opportunity We're working with an established business undergoing an exciting period of technology transformation, looking to recruit … experienced IT Data Analyst to join its growing team. This is an excellent opportunity for a hands-on developer to play a key role in designing, developing and improving business-critical applications, data solutions and reporting capabilities across a Microsoft-focused technology stack. Working closely with ...

About The Role FDM is a global business and technology consultancy seeking a Cyber Data Engineer to work for our client within the Financial Services sector. This is initially a 6-12 month contract with the potential to extend and will be a hybrid role that will … experience deploying and managing large-scale Elasticsearch platforms in production; Splunk experience is valuable given our ongoing migration Experience with Elastic Stack ingest and pipeline tooling (e.g. Logstash, Beats or equivalent) Elastic Certified Engineer or equivalent Elasticsearch/Elastic Stack certification; Splunk certification is a plus given our ongoing ...

leading global investment bank. JOB DESCRIPTION We are looking for a curious, impact-driven engineer who thrives at the intersection of data, product, and platform someone who can turn complex engineering signals into clear, compelling insights that drive decisions at scale. We invest in the tools and talent … analytical data stores at scale, including data warehouse concepts and query optimization Demonstrated engineering practices including CI/CD pipeline implementation, automated testing, and code review standards Analytical capability to develop and validate metrics including exploratory analysis, cohort and trend analysis, and anomaly detection ...

hiring an AI Engineer to design and build the embedded software, data pipelines and machine learning systems behind our sensing and communications technology. You will take ideas from a clean sheet through to efficient, tested code running in live deployments. Because of the nature of our work ...

Senior Azure Developer Competitive Salary + Excellent Benefits | Permanent | Hybrid We're looking for an experienced Azure Developer to join a growing data team, designing and delivering scalable cloud-based data integration and analytics solutions. Key Responsibilities Design, develop, and maintain Azure-based data integration solutions. Build and support ETL processes, data pipelines, and application interfaces. Develop cloud-native integrations using Azure services including ADF, Synapse, Logic Apps, and Function Apps. Support real-time, batch, and event-driven data processing. Collaborate with architects, analysts, and developers to deliver ...

ABOUT US: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across … distributed tracing or observability platforms. OpenTelemetry SDKs, collectors or telemetry standards. Kubernetes, containers or cloud platforms. Data-processing, event-streaming or telemetry-pipeline technologies. CI/CD, GitOps or configuration-as-code approaches. Synthetic monitoring, automated testing, probes or distributed agents. WHAT YOU'LL GET IN RETURNThis ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...