676 to 700 of 925 Data Pipeline Jobs in the UK excluding London

Senior Data Engineer: AI, ML Pipelines & Data Innovation

Location
Milton Keynes, England, United Kingdom
Unisys in Milton Keynes is seeking a Senior Data Engineer to design and implement data pipelines, develop ML models, and translate business needs into technical solutions. You will work with stakeholders to understand requirements and leverage AI/LM technologies to deliver actionable insights. The role … involves collaborating with data scientists and engineers, and communicating findings to varied audiences while staying aligned with enterprise data governance and quality practices. #J-18808-Ljbffr ...

Databricks Lead Engineer: Architect Data Lakehouse

Location
Birmingham, England, United Kingdom
DATA, Inc. is seeking a senior data engineer in the United Kingdom to lead client engagements, design and implement data pipelines on the Databricks platform, and shape cloud-native data architectures for enterprise-scale solutions. You will own data modelling … governance, and security, mentor engineers, and collaborate with architects and analytics leadership to deliver scalable, lakehouse-based data solutions. #J-18808-Ljbffr ...

AI Data Engineer – GCP, Python, Kafka Pipelines (Hybrid)

Location
Leeds, England, United Kingdom
Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

AI Data Engineer – GCP, Python, Kafka Pipelines (Hybrid)

Location
Manchester, England, United Kingdom
Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Lead SQL Developer

Location
Leeds, England, United Kingdom
maintaining existing solutions. Working closely with developers, business analysts and stakeholders across the business, you'll help transform business requirements into practical, data-driven solutions that support decision making and drive operational improvements. As a Lead SQL Developer, You Will Analyse business requirements and translate them into database … maintain SQL queries, stored procedures, scripts and database objects. Build and support integrations between internal and third-party systems. Integrate, transform and validate data for reporting and operational processes. Investigate and resolve data, reporting, performance and integration issues. Document data flows and technical changes. ...

Senior Data Platform & AI Architect

Location
Manchester, England, United Kingdom
OrderYOYO is seeking a Senior Data & AI Platform Engineer to own the modern data platform, migrating to a governed Microsoft Fabric layer, and to lead data engineering with AI-enabled capabilities. You will mentor engineers, design semantic models, and ensure reliable data pipelines across CRM and analytics reporting. The role focuses on data governance, scalable architecture, and senior leadership for data delivery during a critical growth phase. #J-18808-Ljbffr ...

DV Cleared Data Engineers Wanted Mid to Senior AWS - Data Platforms - Hybrid

Hiring Organisation
Avanti
Location
Manchester, Lancashire, United Kingdom
Employment Type
Full-Time
Salary
£55,000 - £80,000 per annum
Cleared Data Engineers Wanted - Mid to Senior | AWS/Data Platforms | UK (Hybrid) £55,000 – £70,000 + bonus + benefits | Bristol/Manchester (hybrid) Active SC or DV Clearance Required I'm working with a successful multinational tech consultancy that has secured a number … long-term client programmes and is now looking to bring in several DV Cleared Data Engineers, from mid to senior level, to meet that demand. If you're SC or DV cleared and have built your career on AWS, this is one where that depth gets used properly. ...

Senior Platform Engineer (Azure)

Hiring Organisation
Yolk Recruitment Limited
Location
Cardiff, South Glamorgan, Wales, United Kingdom
Employment Type
Permanent
with plenty of scope to improve automation, Infrastructure as Code and engineering standards. You'll also get exposure to Microsoft Fabric and modern data platforms as they become an increasingly important part of the organisation's technology estate. What you'll be doing Taking ownership of engineering across … security controls Working with technologies including Azure Policy, Key Vault, Private Endpoints and Defender Supporting the engineering platform behind Microsoft Fabric and modern data workloads Leading technical projects and influencing cloud architecture decisions Helping replace legacy and manual processes with modern, automated solutions Acting as a senior technical ...

Senior Data Platform Engineer: Python & Databricks (Hybrid)

Location
City of Edinburgh, Scotland, United Kingdom
Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

Senior Azure Data Engineer

Hiring Organisation
Rise Technical Recruitment
Location
Thatcham, Berkshire, United Kingdom
Employment Type
Permanent
Salary
£60000 - £67000/annum 10% Pension + Hybrid Working + More
Senior Azure Data Engineer Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits Are you an experienced Azure … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...

Senior E-commerce Backend Engineer: AI Native (f/m/d)

Location
York and North Yorkshire, England, United Kingdom
discovery, Digital Asset Management (DAM), Product Information Management (PIM), and internal SAP/HANA systems. The role will design and develop APIs, services, data flows, and integrations that allow these platforms to work together reliably at scale. A defining requirement for this position is an AI-native development … ready E-commerce Systems Integration: Integrate key e-commerce capabilities including personalization platforms, semantic/LLM search and discovery, DAM, PIM, analytics and data services, and other modular components as the e-commerce ecosystem evolves Enterprise Data & ERP Integration: Build and maintain reliable integrations between ...

Azure Data Engineer – Remote, Scalable Pipelines

Location
Bristol, England, United Kingdom
AtkinsRéalis is seeking an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines on the Microsoft Azure platform. You will optimise data storage, processing, and enable data-driven decision-making for diverse client projects. The role requires expertise … Azure data services, ETL/ELT patterns, and collaborating with stakeholders to deliver robust solutions in a fast-paced agile environment. Some on-site work at client sites is required. #J-18808-Ljbffr ...

Senior Software Engineer Python

Hiring Organisation
MarkIT Placements
Location
Didcot, Oxfordshire, South East, United Kingdom
Employment Type
Permanent, Work From Home
event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Senior Cloud Engineer

Location
Manchester, England, United Kingdom
production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

Senior Cloud Engineer

Location
Leeds, England, United Kingdom
production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

Senior Cloud Engineer

Location
City of Edinburgh, Scotland, United Kingdom
production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

AI & Automation Lead for Plant Transformation - Plant Biology Institute

Location
Oxford, England, United Kingdom
external partners, providing plant sciences subject matter expertise to co‐develop AI and automation solutions that transform and accelerate plant transformation workflows while enhancing pipeline efficiency. The successful candidate will work within a matrixed, cross functional project team to guide the design and deployment of technology which integrates robotics … matter expertise to design, develop and implement automated robotic systems for transformation and tissue culture workflows Co‐develop computer vision systems for the transformation pipeline, validation of phenotyping and automation tools, and performance optimization. Lead the data strategy and validation of predictive ML models to optimize transformation ...

AI & Automation Lead for Plant Transformation - Plant Biology Institute Plant Biology Institute Oxford, England, United Kingdom

Location
Oxford, England, United Kingdom
external partners, providing plant sciences subject matter expertise to co‐develop AI and automation solutions that transform and accelerate plant transformation workflows while enhancing pipeline efficiency. The successful candidate will work within a matrixed, cross functional project team to guide the design and deployment of technology which integrates robotics … matter expertise to design, develop and implement automated robotic systems for transformation and tissue culture workflows. Co‐develop computer vision systems for the transformation pipeline, validation of phenotyping and automation tools, and performance optimization. Lead the data strategy and validation of predictive ML models to optimize transformation ...

Senior Data & AI Consultant: Azure, Fabric & Power BI

Location
Saint Helier, Jersey, United Kingdom
Alliance Group, part of BDO, is seeking a Data & AI Senior Consultant to join our Jersey-based practice. You will design, build and deliver modern data and AI solutions across Microsoft Fabric, Azure, and related services, focusing on hands-on delivery and stakeholder engagement. Responsibilities include … developing data pipelines, semantic models and reporting using SQL, Python and Power BI, ensuring robust, scalable outputs and adherence to quality standards. #J-18808-Ljbffr ...

Software Engineer III - DevOps & AWS

Location
Glasgow, Scotland, United Kingdom
startups and internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required Qualifications, Capabilities, And Skills Formal … tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks. Strong programming skills in Python and Java, including experience with distributed data processing. Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while ...

Full Stack Lead Engineer - App, Data & AI Engineering

Hiring Organisation
JP Morgan Chase
Location
Glasgow, UK
Employment Type
Full-time
realized by automationRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experienceStrong software engineering fundamentals — system design, data structures, algorithms, and architectural thinking — with the ability to ramp up quickly across varied tech stacks and project typesHands-on practical experience in full … stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude ...

Lead Data Engineer — Cloud Data Pipelines & Leadership

Location
Manchester, England, United Kingdom
Hippo in Manchester is seeking a Lead Data Engineer to guide data-centric delivery across client engagements and internal platforms. You will drive architecture, pipelines and best practices while mentoring a growing team of engineers. You will lead complex data projects using Python ...

Product Manager - Financial Assurance

Hiring Organisation
ENSEK
Location
Nottingham, UK
Employment Type
Full-time
defining strategy, shaping the roadmap, writing detailed specifications and driving measurable outcomes. You will work at the intersection of product management, financial accounting, data modelling and energy retail, partnering closely with engineering teams and senior finance stakeholders. This is a hands-on product role requiring strong analytical thinking … delivering valuable, scalable software solutions. Key responsibilities: Own the strategy, vision and roadmap for Financial Assurance, using customer insight, commercial input and product data to continuously evolve priorities. Write high-quality product specifications and requirements that engineering teams can build from with confidence and minimal clarification. Define, track ...

Senior Data Platform Engineer — Cloud Data Lakes & AI

Location
Birmingham, England, United Kingdom
leading global consulting firm is seeking a Data Engineer in Birmingham to design and implement high-performance data pipelines and maintain secure data platforms. The role requires at least 10 years of relevant experience, expertise in cloud technologies like AWS and Azure, and strong ...

Bi/GCP Analyst

Hiring Organisation
Sphere Digital Recruitment
Location
London, South East England, United Kingdom
Employment Type
Part-Time
Salary
£325.00 - £365.00 per day
exciting media agency in London is looking for a Contract Data Engineer/BI Consultant to join the team on a short-term contract, supporting dashboard development and data infrastructure projects until a permanent hire joins in December. Based in London 4 days per week … until 7th December 2026 (with potential handover period) Start date: ASAP Up to £365 per day Outside Ir35 The Job As the Contract Data Engineer/BI Consultant , your responsibilities will include: Building and enhancing dashboards and data visualisation solutions for internal and client reporting. Developing ...