351 to 375 of 520 Data Pipeline Jobs in the UK excluding London

Data Engineer - SC Cleared 6+ month Contract Rate: £400 - £450 per day insideIR35 Flexible Hybrid - West Midlands/West Sussex - twice a month We are looking for an experienced Data Engineer to join a large-scale UK public sector programme, working on secure and modern data platforms supporting digital transformation and emerging AI capabilities. Responsibilities: * Build, enhance and support data pipelines for ingestion, transformation and curation * Develop secure, reliable and high-performing data integration solutions * Work with product teams and stakeholders to deliver high-quality data products * Contribute ...

DATA ENGINEER Up to £70,000 + Benefits London (Hybrid) This is a great opportunity to join a high-growth FinTech where you can take ownership of the data infrastructure and decisioning systems that power a live lending platform. THE COMPANY: Thisis a fast-growing FinTech … phase, supported by new funding. Rather than relying solely on traditional credit scoring, the business uses a broader range of financial and income data to provide a more personalised lending experience. THE ROLE: You will take ownership of the infrastructure, pipelines and production processes that support the company ...

services that power the Syrup platform and Anaplan’s forecasting and predictive solutions. The team owns the production services behind forecasting, scoring, and data processing, along with the pipelines and infrastructure that bring ML and AI capabilities to enterprise customers. As a backend engineer, you will build … growing your craft alongside experienced engineers. This role reports to the Director of Engineering for Predictive Intelligence and works closely with backend engineers, data scientists, and platform partners. Your Impact Build and maintain backend services, APIs, and data processing components across the Predictive Intelligence stack. Contribute ...

startups and internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required qualifications, capabilities, and skills Formal … tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks. Strong programming skills in Python and Java, including experience with distributed data processing. Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while ...

deliver and operate production-grade capabilities that power cyber operations at scale. You will build reliable, secure and observable services, tools, platforms, or data pipelines aligned to shared engineering standards. You will own the service lifecycle, drive architectural decisions with stakeholders, and push platform maturity through automation ...

Electronics Bedlington is seeking a Lead Digitisation Engineer to shape the strategy, architecture and delivery of automated data pipelines, IoT integration and smart manufacturing systems. You will drive yield optimisation, predictive maintenance and lights-out automation across cleanroom and assembly lines, bridging traditional semiconductor processes with cutting-edge ...

scale. You will mentor senior engineers, shape architecture with Product Leadership, and drive measurable, impactful outcomes across edge-to-cloud compute and data pipelines. #J-18808-Ljbffr ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates …/ML platforms and workloads on AWS (or multi-cloud with strong AWS depth). Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data ...

area. Device & Embedded Software Systems Embedded Linux, C++/Python, embedded systems, multi-sensor and camera-based devices (including thermal and line-scan), data acquisition and edge processing, device-to-cloud pipelines, networking, system integration, hardware/software collaboration, field diagnostics, performance optimisation, secure and robust systems, Linux … build systems (e.g. Yocto), media pipelines (e.g. GStreamer), FFMPEG, IoT devices, sensor data processing, signal conditioning, computer vision, FPGA exposure, electronics fundamentals. Platform Engineering Cloud infrastructure, AWS, distributed systems, backend services, RESTful APIs, microservices architecture, service integration, data pipelines, storage systems, relational databases (MySQL), scalability, system ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Cleared Data Engineers Wanted - Mid to Senior | AWS/Data Platforms | UK (Hybrid) £55,000 – £70,000 + bonus + benefits | Bristol/Manchester (hybrid) Active SC or DV Clearance Required I'm working with a successful multinational tech consultancy that has secured a number … long-term client programmes and is now looking to bring in several DV Cleared Data Engineers, from mid to senior level, to meet that demand. If you're SC or DV cleared and have built your career on AWS, this is one where that depth gets used properly. ...

with plenty of scope to improve automation, Infrastructure as Code and engineering standards. You'll also get exposure to Microsoft Fabric and modern data platforms as they become an increasingly important part of the organisation's technology estate. What you'll be doing Taking ownership of engineering across … security controls Working with technologies including Azure Policy, Key Vault, Private Endpoints and Defender Supporting the engineering platform behind Microsoft Fabric and modern data workloads Leading technical projects and influencing cloud architecture decisions Helping replace legacy and manual processes with modern, automated solutions Acting as a senior technical ...

Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

Senior Azure Data Engineer Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits Are you an experienced Azure … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemerally environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

Alliance Group, part of BDO, is seeking a Data & AI Senior Consultant to join our Jersey-based practice. You will design, build and deliver modern data and AI solutions across Microsoft Fabric, Azure, and related services, focusing on hands-on delivery and stakeholder engagement. Responsibilities include … developing data pipelines, semantic models and reporting using SQL, Python and Power BI, ensuring robust, scalable outputs and adherence to quality standards. #J-18808-Ljbffr ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

Azure) Conduct rigorous model evaluation, A/B testing, and performance monitoring Mentor junior ML engineers and conduct technical code reviews Collaborate with data engineers to optimise feature stores and data pipelines Stay current with latest ML research and evaluate applicability to client projects Requirements 5+ ...