101 to 125 of 129 Data Pipeline Jobs in the North of England

the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building core capabilities that power our data and AI infrastructure—enabling scalable, resilient, and intelligent systems to support enterprise-scale Business Planning Software solutions. Your Impact Design, build, and operate platform capabilities supporting batch, streaming, and … systems using Apache Kafka, Flink, Pulsar, and cloud-native technologies Collaborate with AI/ML teams to deploy models and enable generative AI use cases Implement integrations with data lakes and event stores to enable real-time data flow Contribute fullstack features, including React-based frontends and backend services in Java and Python Ensure code quality … software engineering, especially in platform/backend systems Expert-level skills in Java and strong proficiency in Python Experience with Apache Kafka, Flink, and Pulsar for building distributed data pipelines Familiarity with scalable data storage and data lake integrations Proven ability to integrate AI/ML models and work with prompt-based applications Fullstack More ❯

the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building core capabilities that power our data and AI infrastructure—enabling scalable, resilient, and intelligent systems to support enterprise-scale Business Planning Software solutions. Your Impact Design, build, and operate platform capabilities supporting batch, streaming, and … systems using Apache Kafka, Flink, Pulsar, and cloud-native technologies Collaborate with AI/ML teams to deploy models and enable generative AI use cases Implement integrations with data lakes and event stores to enable real-time data flow Contribute fullstack features, including React-based frontends and backend services in Java and Python Ensure code quality … software engineering, especially in platform/backend systems Expert-level skills in Java and strong proficiency in Python Experience with Apache Kafka, Flink, and Pulsar for building distributed data pipelines Familiarity with scalable data storage and data lake integrations Proven ability to integrate AI/ML models and work with prompt-based applications Fullstack More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Senior Software Engineer (Data-Centric) Manchester (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter decision-making. We … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

detection logic or supporting telemetry. Skills and Attributes Detection Engineering Framework experience Threat Hunting & Log Analysis experience Threat Modelling & Framework Alignment experience Desirable (but not essential) Data Pipeline & Telemetry Management Benefits At Claranet, we go the extra mile with our people—because we believe in building a workplace where everyone feels valued and supported. Our flexible benefits More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Integrations Developer - Aberdeen, Hybrid Are you a problem-solver who enjoys working with data and modern .Net technologies? Were looking for an Integrations Developer in Aberdeento join a forward-thinking company and help shape the future of a global SaaS platform used across the oil, gas, and renewables industries. Youll play a key role in connecting systems, transforming … Hybrid working with 2-3 days a week into the office Pension scheme Career progression opportunities City centre parking What you will be doing: Developing and maintaining data integrations between internal and client systems. Building reliable ETL processes to manage and transform large data sets. Working closely with clients and internal teams to support smooth onboarding … and data flows. Contributing to the ongoing development of our SaaS platform and related APIs. Creating tools and automations that improve how data is handled across the business. The ideal candidate: Were after someone whos confident working across both code and data, someone who can spot problems quickly, communicate clearly, and enjoys finding elegant More ❯

Integrations Developer - Aberdeen, Hybrid Are you a problem-solver who enjoys working with data and modern .Net technologies? Were looking for an Integrations Developer in Aberdeento join a forward-thinking company and help shape the future of a global SaaS platform used across the oil, gas, and renewables industries. Youll play a key role in connecting systems, transforming … Hybrid working with 2-3 days a week into the office Pension scheme Career progression opportunities City centre parking What you will be doing: Developing and maintaining data integrations between internal and client systems. Building reliable ETL processes to manage and transform large data sets. Working closely with clients and internal teams to support smooth onboarding … and data flows. Contributing to the ongoing development of our SaaS platform and related APIs. Creating tools and automations that improve how data is handled across the business. The ideal candidate: Were after someone whos confident working across both code and data, someone who can spot problems quickly, communicate clearly, and enjoys finding elegant More ❯

help shape the future of our engineering function. Who We're Seeking We're searching for an experienced technical leader to own and drive our back-end and data strategy. You'll lead teams responsible for designing, developing, and optimising cloud-based systems, data pipelines, and APIs - ensuring our solutions are robust, secure, and aligned with … scalable solutions, fostering a high-performance culture within the engineering team. What You'll Be Doing Lead the design, development, and implementation of .NET back-end systems and data workflows using Databricks . Oversee the build and optimisation of data pipelines within AWS . Drive engineering excellence , establishing and maintaining standards, metrics, and best practices. Mentor … What You'll Bring Proven expertise in back-end development using .NET/C# . Strong technical leadership and experience managing engineering teams. Hands-on experience with AWS data services and cloud-native architectures. Proficiency in Python and SQL Excellent stakeholder management skills, able to bridge technical and business perspectives. Knowledge of Azure and experience with Databricks or More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

My client is a UK sovereign AI company developing secure, mission-critical artificial intelligence and data platforms for defence, national security, and strategic industry partners. Our systems operate at the intersection of Real Time data, autonomous decision support, and cloud-native infrastructure, with a strong emphasis on security, integrity, and performance. They are scaling rapidly and … engineers) delivering secure, scalable, and high-availability AI systems. Own AWS-based infrastructure: Lambda, EC2, S3, CloudFormation/Terraform, CloudWatch, and VPC security. Oversee JSON-based API integrations, data pipelines, and serverless event-driven architectures. Implement continuous integration and deployment (CI/CD) pipelines for code, models, and infrastructure. Ensure DevSecOps best practices - patching, logging, monitoring, and compliance … with UK MoD or ISO27001 frameworks. Manage incident response, uptime SLAs, and operational dashboards. Collaborate with software engineers, AI researchers, and data scientists to optimise cloud performance. Maintain documentation and enforce secure coding and deployment standards. Support accreditation, audits, and readiness for UK sovereign hosting environments (IL2-IL5). Report directly to the Head of Engineering/CTO More ❯