226 to 250 of 306 Data Pipeline Jobs in the UK excluding London

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath — data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments • Troubleshoot integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

role, 1-3 days per week in Farnborough is needed. Key skills required Backed development experience (Mid-senior level) Python Data Pipeline Creation and Management API Creation and Integration Database Creation and Integration Working with JSON If you have worked in a security cleared environment, have ...

Robert Half Technology are assisting a telecommunications business to recruit a Senior Data Platform Engineer on a 9-month contract basis. Hybrid working - Hampshire/London based. ASAP start. Role * The Senior Data Platform Engineer will take full ownership of the production data platform … including ingestion, orchestration, infrastructure, and observability. * Design, build, and deliver scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover, including hypercare support. * Build and maintain integrations across Salesforce/Ability (CRM), NetSuite/Sage X3 (ERP), and Billing ...

Robert Half Technology are assisting a leading telecommunications business to recruit a Senior Data Platform Engineer on a contract basis. Hybrid working - 2 days on-site in Hampshire every other week. Role * The Senior Data Platform Engineer will take ownership of the end-to-end production … data platform, including ingestion, orchestration, infrastructure, and observability. * Design, develop, and maintain scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover and provide support during hypercare phases. * Build and maintain integrations across Salesforce/Ability ...

Join a fast-growing technology business delivering impactful data and AI solutions across complex defence environments. This is a hands-on leadership role where you’ll shape technical direction, lead delivery teams, and build scalable software that makes a real-world difference. Role Overview: Location: Bath area … days on-site per week) Package: Competitive salary + annual bonus + extensive benefits package Industry: Data, AI & Software Engineering What You’ll Be Doing: Lead the end-to-end delivery of complex software engineering projects from concept through to deployment Oversee the design, development, testing, and release ...

workflows across the group Experimenting with large language models (LLMs), APIs, and emerging AI platforms to solve real business challenges Developing internal dashboards, data pipelines, and reporting tools to support commercial decision-making Researching and evaluating new AI technologies, tools, and vendors relevant to talent acquisition and professional … services Collaborating with consultants, managers, and clients to understand pain points and translate them into technical solutions Supporting data quality, CRM optimisation, and systems integration projects across the business Contributing to the company’s broader technology strategy and AI roadmap What We’re Looking For: A qualification ...

reporting tools. Some of the main responsibilities of the Power BI Developer will include: Develop, maintain, and enhance Power BI dashboards and data models to support Quality performance monitoring and informed project decision-making. Produce weekly, monthly, and quarterly performance reports that deliver clear, actionable insights to Quality … Leadership. Ensure the integrity, accuracy, and validation of all Quality data, guaranteeing alignment with actual project progress and performance. Lead the analysis, interpretation, and presentation of complex datasets across multiple Quality reporting disciplines. Identify trends, anomalies, and root causes, supporting the development and implementation of improvement action plans ...

Robert Half Technology are assisting UK's market leading telecommunications organisation to recruit a Data Engineer on a contract basis - Hybrid working - London/Hampshire based We are supporting a data transformation programme and are looking for a Senior Data/Platform Engineer … take full ownership of the production data platform. This role is critical to delivering a scalable, production-ready platform ahead of a mid-August NetSuite cutover, including responsibility for build, integration, and operational readiness. Role The Data Engineer will own the end-to-end data ...

century, we've been the foundation the travel industry builds on, trusted, proven, essential. Today, we're going beyond. We combine unmatched data quality, quantity and access with breakthrough technology and deep industry expertise to deliver what the industry truly needs: not just more data … airports to technology companies and financial institutions. We are actively embedding AI throughout our intelligence layer, combining nearly a century of proprietary data with the latest technology to deliver answers that were simply not possible before. We exist because travel moves the world, and we move travel. ...

focus on Adobe Experience Platform (AEP), RTCDP, and Journey Optimisation. The role will be responsible for defining scalable architecture, enabling real-time customer data capabilities, and ensuring alignment with enterprise standards. ## Key Responsibilities - Lead **end-to-end solution architecture** for Adobe Martech platforms (AEP, RTCDP, AJO) - Define … data architecture, ingestion patterns, and activation frameworks** across channels - Translate business requirements into **scalable architecture, data models, and integration designs - Design and govern **identity management, segmentation, consent, and profile strategy** - Collaborate with stakeholders across **marketing, data, and technology teams** to define solutions - Ensure alignment ...

technology and energy Who We Are Hypercube is a rapidly growing AI-for-energy company building CAIRN, an operational intelligence platform that connects data, workflows, and decision-making across the energy asset lifecycle. We work with asset owners, operators, traders, and fund managers to replace fragmented tools … engage clients, and how we grow. You'll embed with clients, own the technical relationship, and make CAIRN work where the data is real, the stakes are high, and the requirements were never written down. You'll run discovery sessions with operations directors and trading desks, deploy ...

Data Engineer - SC Cleared Whitehall Resources currently require an experienced Data Engineer to work with a key client **Please note this role requires active SC Clearance and falls Inside IR35** What you’ll do • Build, enhance and operate data pipelines for ingestion, transformation … curation. • Design secure, reliable and performant data integration solutions. • Work closely with product teams and stakeholders to shape requirements and deliver high quality data products. • Share best practice, mentor colleagues and contribute to our engineering community. • Collaborate in Agile, multi disciplinary teams. What you’ll bring ...

Description 12 month contract 100% Remote Working Inside IR35 Role Overview Working on a data migration project involving pipelines The focus is heavily on migrating pipelines containing large volumes of data (millions of records) This is a delivery-focused role due to a tight project schedule … Skills & Experience Strong Experience with data engineering, particularly: Data pipelines Databases and large-scale data handling Java is required Role split: 7080% data engineering/2030% Java Experience with Cloud: This is a migration to azure - so Experience with azure is necessary ...

working on developing AI led solutions for improved productivity and efficiencies across the landscape. Your responsibilities: Assist in designing, building, and maintaining scalable data pipelines for structured and unstructured data Develop, train, and evaluate machine learning and deep learning models, including neural networks Work with Large … Generative AI (GenAI) applications and experimentation Implement and integrate RESTful APIs for deploying AI models into production environments Collaborate with senior engineers and data scientists to improve model performance and reliability Participate in code reviews, testing, and documentation to ensure high-quality deliverables Support model monitoring, debugging ...

Real Time CDP, and Adobe Journey Optimizer. Proven background designing Martech solutions within financial services or other regulated environments. Deep understanding of customer data platforms, identity resolution, segmentation, consent management, and profile unification. Experience designing both Real Time and batch data pipelines. Strong understanding of APIs … event-driven architecture, cloud data platforms, and enterprise integration patterns. Experience working with CRM systems, data lakes, data warehouses, and marketing activation platforms. Strong knowledge of data governance, privacy, security, and regulatory requirements. Excellent stakeholder management skills, with the ability to engage ...

groups, and neurodivergent candidates. We offer reasonable adjustments throughout the hiring process and are dedicated to creating a supportive, accessible environment for everyone. Data Engineer (Snowflake) Location Erskine, Newcastle, Farnborough or London Candidates must be eligible for clearance and be a sole UK national Were looking … passionate Data Engineer whos excited to grow, collaborate, and shape meaningful data solutions. If you enjoy solving problems, learning new technologies, and working in a supportive environment where diverse perspectives are valued, wed love to meet you. Key Responsibilities Partner with the team to coordinate ...

area. Device & Embedded Software Systems Embedded Linux, C++/Python, embedded systems, multi-sensor and camera-based devices (including thermal and line-scan), data acquisition and edge processing, device-to-cloud pipelines, networking, system integration, hardware/software collaboration, field diagnostics, performance optimisation, secure and robust systems, Linux … build systems (e.g. Yocto), media pipelines (e.g. GStreamer), FFMPEG, IoT devices, sensor data processing, signal conditioning, computer vision, FPGA exposure, electronics fundamentals. Platform Engineering Cloud infrastructure, AWS, distributed systems, backend services, RESTful APIs, microservices architecture, service integration, data pipelines, storage systems, relational databases (MySQL), scalability, system ...

Role * The AI Engineer will design, develop, and deploy scalable AI and machine learning solutions across digital sports media platforms. * Collaborate with product, data, and engineering teams to deliver AI-driven features and audience engagement tools. * Build and optimise LLM-powered applications, recommendation systems, and intelligent content workflows. … Develop and maintain robust data pipelines and model deployment infrastructure. * Implement monitoring, evaluation, and governance processes for AI systems to ensure reliability and performance. * Work with structured and unstructured datasets including video, social, audience, and editorial content. * Optimise AI models and inference pipelines for scalability, latency, and cost ...

experience) Hybrid working Southampton A bout Ordnance Survey Ordnance Survey is the national mapping agency for Great Britain, providing world-class geospatial data and services that power innovation, support national infrastructure, and help people make better decisions every day. We're passionate about using cutting-edge technology … Senior Backend Developer, you'll take a leading role in designing, building and delivering scalable, high-performance backend systems that power our geospatial data platforms and services. You'll guide technical decision-making, champion engineering best practices, and help shape robust data-driven solutions ...

required for this role. Our client are seeking a Software Developer to contribute to the ongoing operation and evolution of a large-scale data platform supporting complex analytical use cases. The platform consolidates event data from a wide range of user-facing systems, processing and publishing … Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. Awareness of and experience with security scanning and vulnerability tooling (e.g. Trivy, Trend Micro, Wiz or similar). ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

future of energy exploration Join a well-funded start-up with strong backing and clear growth plans. Own and shape a modern data platform built on GCP and cutting-edge tools. Real opportunity to grow into a future leadership role. We’re working with an early-stage, well … company that’s tackling one of the biggest challenges in energy today. They’re building a new approach to natural exploration, using advanced data, geoscience, and cloud tech to drive smarter decisions. They’re now looking for a Senior Data Platform Engineer to take ownership ...

Title: Senior Engineering Lead – Azure Cloud Data Platform Work Location: Cardiff, UK (Hybrid - once a week working from office) Job Description: Key Responsibilities Provide strategic guidance and technical leadership to the Nucleus product team, ensuring alignment with business objectives and cloud best practices. Support, develop and evolve … Event Grid. Experience with Azure messaging and integration services, particularly Azure Service Bus, Event Hubs, and API Management. Demonstrable expertise in Azure data services including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Familiarity with Azure SQL, Cosmos ...