851 to 875 of 1,766 Data Pipeline Jobs in the UK

Principal GIS Consultant — GeoAI & Spatial Intelligence

Location
Birmingham, England, United Kingdom
with a particular focus on supporting complex infrastructure and land projects. Reporting to an Associate/Associate Director and collaborating with GIS, Geospatial, Data Science Data Engineering, AI and Technical Specialist teams, you\'ll help the team grow both personally and technically to maintain top-tier … property, water, and environmental sectors. This is a hands-on technical role. You will develop production-grade Python workflows, design and optimise spatial data pipelines, and integrate AI and machine learning frameworks into GIS environments to deliver scalable, data-driven insights. You will ...

Principal GIS Consultant — GeoAI & Spatial Intelligence

Location
Reading, England, United Kingdom
with a particular focus on supporting complex infrastructure and land projects. Reporting to an Associate/Associate Director and collaborating with GIS, Geospatial, Data Science Data Engineering, AI and Technical Specialist teams, you\'ll help the team grow both personally and technically to maintain top-tier … property, water, and environmental sectors. This is a hands-on technical role. You will develop production-grade Python workflows, design and optimise spatial data pipelines, and integrate AI and machine learning frameworks into GIS environments to deliver scalable, data-driven insights. You will ...

Principal GIS Consultant — GeoAI & Spatial Intelligence

Location
Greater London, England, United Kingdom
with a particular focus on supporting complex infrastructure and land projects. Reporting to an Associate/Associate Director and collaborating with GIS, Geospatial, Data Science Data Engineering, AI and Technical Specialist teams, you\'ll help the team grow both personally and technically to maintain top-tier … property, water, and environmental sectors. This is a hands-on technical role. You will develop production-grade Python workflows, design and optimise spatial data pipelines, and integrate AI and machine learning frameworks into GIS environments to deliver scalable, data-driven insights. You will ...

Lead Data Engineer (GCP)

Hiring Organisation
Consortia
Location
London, UK
Employment Type
Full-time
ready to lead cutting-edge data solutions that drive smarter pricing, market analysis, and investment strategies? Join a leader in its field, working alongside a passionate, highly skilled team with sustainability at the core of everything they do. What You'll Do: Take ownership … design and development of scalable, cloud-based data infrastructure, with a primary focus on Google Cloud Platform (GCP).Lead, mentor, and develop the existing team of two data engineersBuild and optimise robust data pipelines with Python, Snowflake, and Databricks, ensuring seamless integration into business ...

Remote Data Pipeline Engineer (Python + React)

Location
United Kingdom
Crossing Hurdles is seeking a Software Engineer to join our Human Data Platforms team. You will build features across backend and frontend using Python/FastAPI and React, delivering robust, scalable applications. You will develop data pipelines for evaluation and model control, create OCR and search … systems for PDFs and images, and ensure data integrity by enforcing complex JSON structures. This remote role offers strong collaboration across time zones. #J-18808-Ljbffr ...

AWS Data Engineer

Location
Greater London, England, United Kingdom
Title: AWS Data Engineer Job Location: London, UK/Hybrid Job Type: 12 Months FTC Job Description: Need Expert in Python Pyspark, AWS, Cloud, AWS Services, AWS Components Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with … design, and automated testing Contributing to the development of a lakehouse architecture using Apache Iceberg Collaborating with business teams to translate requirements into data-driven solutions Building observability into data flows and implementing basic quality checks Participating in code reviews, pair programming, and architecture discussions Continuously ...

Security Data and Platform Engineer

Location
Greater London, England, United Kingdom
that supports how our engineering teams build and operate complex systems at scale. Take the next step in your career. As a Security Data and Platform Engineer, you will combine broad security engineering expertise with deep knowledge of security data pipelines and Elastic Security. … organisation’s Security Data SME, you will own the onboarding, tuning, stabilisation and evolution of security telemetry across cloud, hybrid and corporate environments. Alongside this specialist focus, you will contribute as a well‐rounded Security Engineer, applying software engineering, automation and platform thinking to solve a broad range ...

Senior Data Engineer - Customer Data Platform (Hybrid)

Location
Greater London, England, United Kingdom
Morson is seeking a Senior Data Engineer – Customer Data in London (Waterloo) on a hybrid basis. This six-month contract role pays £650–£700 per day Inside IR35 and focuses on building reliable, production-grade data ingestion and transformation pipelines for customer data capabilities. You will design and operate scalable data pipelines, support Customer 360 initiatives, and collaborate with senior engineers to drive data solutions in a modern software engineering environment. #J-18808-Ljbffr ...

Security Data and Platform Engineer

Hiring Organisation
G Research
Location
London, UK
Employment Type
Full-time
supports how our engineering teams build and operate complex systems at scale. Take the next step in your career. The roleAs a Security Data and Platform Engineer, you will combine broad security engineering expertise with deep knowledge of security data pipelines and Elastic Security. … organisation's Security Data SME, you will own the onboarding, tuning, stabilisation and evolution of security telemetry across cloud, hybrid and corporate environments. Alongside this specialist focus, you will contribute as a well-rounded Security Engineer, applying software engineering, automation and platform thinking to solve a broad range ...

Senior DevOps Engineer - AWS & AI-Driven Payments

Location
Glasgow, Scotland, United Kingdom
solutions, working in an agile environment across multiple platforms and business functions. You will apply enterprise DevOps, AI-assisted development practices, and Databricks data pipelines while collaborating with teams to ensure high availability and performance of critical systems. #J-18808-Ljbffr ...

Senior ML Engineer, Disputes Platform & MLOps

Location
Greater London, England, United Kingdom
Disputes ML team and help build our new ML-driven dispute optimisation suite. You will work on end-to-end features from data pipelines to model deployment, collaborating with platform and backend engineers to scale production systems. Applicants should have 5+ years in ML/MLOps, strong Python ...

Data Scientist Consultant (Contract)

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£500.00 - £640.00 per day
Data Scientist Consultant Fully Remote (Need right to work in UK) Inside IR35 £500 - £640 Per Day Start Immediately The Company They are a well-established organisation with a strong focus on data-driven innovation within financial services and credit analytics. Their teams develop sophisticated modelling … solutions, risk products, and decisioning tools powered by extensive commercial data assets. With continued investment in cloud technologies and advanced analytics, they are building the next generation of AI and machine learning capabilities. You will join a collaborative environment that values technical excellence, innovation, and commercial impact. ...

Applied AI Engineer London

Location
Greater London, England, United Kingdom
Develop and deploy AI-powered features in production , including RAG (Retrieval-Augmented Generation) systems, multi-agent infrastructure, and evaluation frameworks (Evals) . Create data pipelines for AI model training, evaluation, and continuous improvement. Mentor junior developers and promote engineering best practices. Required Qualifications 5+ years of professional software ...

Senior Software Engineer

Location
Greater London, England, United Kingdom
Have: Experience building or integrating LLM-powered features in production (RAG pipelines, agent workflows, evaluation frameworks) Familiarity with sports tech, real-time data pipelines, or performance-sensitive consumer applications Experience with infrastructure-as-code or deployment automation Location Candidate can be located in London Ontario with occasional travel ...

Backend Engineer (Java+AWS+AI)

Location
Greater London, England, United Kingdom
systems and CI/CD pipelines. REST API Services: Proficient in designing and consuming RESTful web services. Kafka: Skilled in implementing real‐time data pipelines and messaging systems. Splunk: Expertise in monitoring, logging, and troubleshooting application performance. Team Leadership: Proven experience in leading, mentoring, and managing development teams. ...

Python Developer - Security - Cambridge/London

Hiring Organisation
Salt Search
Location
Cambridge, Cambridgeshire, United Kingdom
Employment Type
Full-Time
Salary
Salary negotiable
experience or strong demonstrable ability considered). Desirable (but not required) Experience with Kubernetes or container orchestration. Exposure to ML/AI projects, data pipelines, or research-driven engineering. Experience with observability tooling, CI/CD, and testing best practices. Degree in Computer Science, Engineering, or related technical ...

AI Technical Lead - Contract

Hiring Organisation
167 Solutions Ltd
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£500.00 - £700.00 per day
technologies Designing solutions across AWS and GCP Building AI services using AWS Bedrock Evaluating and integrating foundation models and LLM platforms Building APIs, data pipelines and integrations between AI services and existing enterprise systems Leading technical decisions around scalability, performance, security and AI governance Taking AI prototypes ...

Staff Software Engineer, Infrastructure (Distributed Systems)

Location
Greater London, England, United Kingdom
About the role Anthropic's Infrastructure organization builds and operates the distributed systems that train, serve, and secure our AI models. That includes data pipelines, some of the largest Kubernetes clusters in the world, and the databases, observability, and developer tooling that every other team at Anthropic depends ...

Solutions Engineer, Real-Time Intelligence Platforms – Security Clearance

Location
Greater London, England, United Kingdom
Understand defence and security users' needs in situational awareness and force protection, then scope solutions Design, build, and deploy Palantir Foundry data pipelines, ontology models, and operator-facing applications Integrate live intelligence into existing workflows, common operating pictures, and command-and-control tooling Build and tune custom widgets … Highest-signal resume keywords Palantir Foundry Development Python Programming Docker Containerization Kubernetes Orchestration Solutions Engineering Experience ATS Optimization Keywords Hard Skills Data Pipeline Development Ontology Modeling Application Development SQL Programming Java Programming TypeScript Programming JavaScript Programming Bash Scripting Go Programming Networking Fundamentals Soft Skills Stakeholder Communication Problem ...

Software Engineer, Data

Location
Greater London, England, United Kingdom
Build and maintain ingestion pipelines into the data warehouse using Fivetran and custom pipelines Own data orchestration to keep data moving on schedule and recover cleanly from failures Build and manage AWS-based data infrastructure as code with Terraform Build enterprise-grade … customer data pipelines and connectors for HR, payroll, and other systems Reliably and securely move customer data in and out at enterprise volumes Connect data to AI agents and services, including through MCP connectors Work with product and stakeholders to scope problems and agree ...

Mission Systems Engineer – Foundry Pipelines, Operator Apps

Location
Greater London, England, United Kingdom
defence and security users to understand situational-awareness and force-protection needs Scope solutions for operational requirements Design, build, and deploy Palantir Foundry data pipelines, ontology models, and operator-facing applications Integrate live intelligence into existing workflows, common operating pictures, and command-and-control tooling Build and tune … standards. Highest-signal resume keywords Palantir Foundry Experience Python Programming Kubernetes Orchestration Security Clearance Solutions Engineering ATS Optimization Keywords Hard Skills Data Pipeline Development Ontology Modeling Application Development SQL Programming Java Programming TypeScript Programming JavaScript Programming Bash Scripting Go Programming Linux Fundamentals Soft Skills Stakeholder Communication Customer ...

Software Engineer

Hiring Organisation
QinetiQ
Location
Manchester, UK
Employment Type
Full-time
5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Software Engineer at Naimuri ...

Lead Data Engineer - Start-Up / Scale-up experience required

Hiring Organisation
FBI &TMT
Location
City of London, London, United Kingdom
Employment Type
Permanent
Lead Data Engineer (Permanent, London on-site 4 Days) - Sponsorship is not available for this role A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used … property teams. This is a hands-on, high-ownership role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. Start-up or Scale-up experience required coupled with a computing degree from a Russell Group university. ...

Lead Data Engineer - Start-Up / Scale-up experience required

Hiring Organisation
Matchtech
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£100,000 - £160,000 per annum
Lead Data Engineer (Permanent, London on-site 4 Days) - Sponsorship is not available for this role A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used … property teams. This is a hands-on, high-ownership role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. Start-up or Scale-up experience required coupled with a computing degree from a Russell Group university. ...

Associate Principal Scientist, AI and Computational Tools, Oncology R&D (1-year FTC)

Location
Cambridge, England, United Kingdom
central to how we build and embed AI-first workflows across our discoverygroup. You will combine scientific domainexpertisewith strong software and data-engineering skills to lead the design and deployment of AI-powered tools, shape robust data-infrastructurestrategiesand serve as arecognisedAI Architect for the group. … leadership across multiple initiatives,identifyopportunities, proposesolutionsand build capabilities that can be adoptedmore widely across Oncology R&D. Working closely with wet-lab scientists, data scienceteamsand R&D IT, you will translate experimental data into scalable,reproducibleand insight-generating systems, while supportingcolleagues toadoptAI-enabled approachesand strong data ...