151 to 175 of 267 Data Pipeline Jobs in the UK excluding London

working with a consulting client who are looking to grow their Data capability. The client is seeking candidates who have experience with pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus ...

glue' between the company's hardware and cloud intelligence, transforming raw telemetry into cost-saving insights and predictive maintenance through robust data engineering and modern software practices. The focus of this role is to integrate existing and open-source software and hardware to deliver these innovative services. This … includes building and maintaining automated data pipelines, managing cloud infrastructure and creating digital applications using modern analytics and software engineering practices. What We're Looking For Minimum 2 years' experience in Full Stack activities including but not limited to ingestion and storage of data, data ...

Senior Software Engineer - National Security (Data Systems) About the role You'll design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher level ...

Data Architect - outside IR35 £600-650/day outside IR35 6-month initial contract Once a week in Staffordshire MUST have prior Martech or loyalty experience. We're seeking a Data Architect to design and deliver scalable data solutions supporting marketing and loyalty platforms. … define data models, build modern lakehouse architectures and enable customer-centric use cases such as personalisation and campaign activation. Key Requirements: Strong experience in data architecture and data modelling Expertise in data lakes/lakehouse Experience within MarTech and loyalty/customer ...

Fabric Platform Engineer| Outside IR35 | £400 - £450 | Hybrid We are seeking a Fabric Platform Engineer to join a growing data and analytics team. This role will play a key part in designing, building, and maintaining a modern data platform using Microsoft Fabric, enabling the business … make data-driven decisions at scale. Key Responsibilities Build, maintain, and optimise data solutions within Microsoft Fabric. Build and support data pipelines, integrations, and Lakehouse environments. Ensure platform performance, security, and reliability. Work with stakeholders to deliver data and analytics requirements. Troubleshoot ...

client, a leading global SaaS organisation is looking for a Data Engineer to join their International Engineering team. This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud … Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build the AI/ML user experience. This a 12 months contract Hybrid role with the opportunity for the role to go permanent. What You'll Do: Build and maintain ...

Principal Data & AI Consultant – Waracle is a digital technology consultancy. This Hybrid role is based at Dundee, London, or Glasgow , with around 2 days per week in office. Key Aspects of the Role Include Architecture & Vision: Designing, developing, and maintaining robust data pipelines using batch … streaming processing, championing data governance, security, privacy, and legislatory compliance. Acting as a Trusted Advisor: Translating complex business challenges into clear technical roadmaps, communicating with executive stakeholders and non-technical peers. Enabling Innovation: Designing usable data models and building reliable foundations that empower advanced analytics, LLMs ...

Lead Data Engineer (Permanent, London on-site) A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used by property teams. This is a hands-on, high-ownership … role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. What you'll do Architect and build scalable data pipelines and distributed data systems Design ingestion, transformation and storage patterns for operational ...

leading Financial Services organisation is going through a large scale data transformation and is looking to hire several Senior Data Engineers on a permanent basis. The roles offer a base salary between £55,000 and £75,000 + a strong benefits package and very flexible working. … They are looking for curious, commercially minded Data Engineers who want to develop their skills in modern data technologies and play a part in the organisations expansion into AI. You will be involved in building scalable data pipelines, improving data models ...

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … mission-critical programmes within the National Security sector, delivering innovative solutions across AI, machine learning, cyber security and geospatial intelligence. As a Senior Data Engineer, you will join a collaborative Agile environment, playing a key role in designing, building and maintaining scalable data platforms and processing ...

Data & Insights Analyst Location: London (Hybrid: 2-3 days/week in office) Contract: 11-Month Contract (Potential to extend) Rate: Up to £375 per day (Umbrella) About the Business A world-renowned global entertainment brand known for delivering iconic film, television, and streaming content to millions … consumers worldwide. About the Role We are seeking an ambitious Data & Insights Analyst to join a high-impact, specialist Digital Marketing function. Acting as an internal data consultant, you will translate complex marketing performance data into actionable commercial recommendations, shape campaign measurement frameworks ...

hands-on technical role, suited to someone with strong Splunk Enterprise and Splunk Enterprise Security experience, who can take ownership of platform engineering, data ingestion, detection content and performance tuning across complex client environments. This is a key technical leadership role, responsible for ensuring the right tooling, controls … designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise. Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures. Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher level ...

deploy Python-based services and tooling. JavaScript/TypeScript Cloud, DevOps & Infrastructure - Mandatory Microsoft Azure - Cloud-Native Development Experience Azure DevOps - CI/CD Pipeline Design and Management Infrastructure as Code - Terraform and/or Bicep Containerisation - Docker and/or Kubernetes Development Practices - Mandatory RESTful API design, development … Design and NCSC software security standards. Experience working in UK public sector or government digital services. Python geospatial tooling or data pipeline experience. Tech Stack: Backend: .NET Core 10.0, .NET Framework 4.8, C#, Python (Astral UV), REST APIs, Microservices Frontend: JavaScript, TypeScript, HTML5, CSS3, WCAG AA Cloud ...

Data Engineer (Pentaho, Talend, Denodo) - MUST HAVE SC CLEARANCE - Telford and remote - 6 months+/RATE: £525 per day inside IR35 One of our Blue Chip Clients is urgently looking for a SAS Data Engineer (Pentaho, Talend, Denodo) Please find some details below: Clearance Required … RTENG to build the SA registration network, SAS Viya 3.5 tools for risk assessment of new SA registrations. The POC leveraged data from 20 different sources, most of which were already housed in the Minerva Oracle database. Previously, some data had to be transferred manually. However ...

Data Engineer £500 - £550 per day inside IR35 6-month contract Hybrid working in London We're working with a global healthcare and AI research organisation at the forefront of applying data engineering and machine learning to accelerate scientific discovery. Their work supports large-scale, domain … specific datasets that power research into life-changing treatments. They're now looking for a GCP Data Engineer to join a multidisciplinary team responsible for building and operating robust, cloud-native data infrastructure that supports ML workloads, particularly PyTorch-based pipelines. The Role You'll focus ...

Data Engineer/BI Engineer Salary: Up to £50,000 Location: Hybrid (3 days per week in the office) Type: Permanent We're looking for a Data Engineer/BI Engineer to join a growing team and play a key role in developing and enhancing data and reporting solutions across the business. This is an excellent opportunity for someone with strong data engineering and BI experience who wants to be involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data ...

Were looking for a proactive, solution-focused end to end developer to join a multidisciplinary reporting team within the National Data and Analytics (NDA) department. In this role, you will be responsible for designing, developing, and delivering high-quality national reporting solutions across one or more business areas. … Youll work alongside fellow developers and data engineers to create reporting products that empower decision-making and drive strategic outcomes. As an NDA developer, youll report directly to the NDA Executive Manager and play a key role in the full delivery lifecyclefrom understanding gathered requirements, data ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) – Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access Soft Skills Strong problem-solving and troubleshooting capabilities. Ability to work collaboratively across security, engineering, and operations teams. Excellent communication ...

looking for a proactive, solution-focused end to end developer to join a multidisciplinary reporting team within the National Data and Analytics (NDA) department. In this role, you will be responsible for designing, developing, and delivering high-quality national reporting solutions across one or more business areas. … work alongside fellow developers and data engineers to create reporting products that empower decision-making and drive strategic outcomes. As an NDA developer, you’ll report directly to the NDA Executive Manager and play a key role in the full delivery lifecycle—from understanding gathered requirements, data ...

Public facing, household name, critical national infrastructure organisation are seeking an experienced Data Engineer with a strong background in modern data engineering practices and technologies. Note - this is a part-time contract role requiring 2 days a week for a period of 6 months … week in fantastic Central London location). It is a great opportunity to work on challenging, large-scale data projects and deliver real business value. Key Responsibilities & Requirements: Design, build, and maintain robust data pipelines using modern data engineering best practices Hands-on development ...

looking for Data Engineers to help deliver secure, mission-critical solutions for customers across the National Security sector. Working as part of a collaborative engineering team, you'll design and develop scalable data platforms, build robust data pipelines and transform complex datasets into meaningful … insights. You'll have the opportunity to work with modern cloud technologies, distributed systems and large-scale data environments on projects that have real-world impact. Key Responsibilities * Design and develop scalable data pipelines and ingestion frameworks * Integrate, process and enrich data from multiple ...

experienced founders and investors, we're building toward a clear goal: the defining AI platform in our category As the first senior data hire, you'll architect and scale the systems powering our client's AI products: from real-time pipelines and analytics infrastructure to vector databases … data workflows. You'll define data architecture, tooling, and engineering standards, working closely with AI and backend engineers, and lay the foundations for the future data te Duties Architect and build scalable data pipelines and infrastructure for AI and product systems Design ...

Senior Software Engineer - National Security (Data Systems) About the role You'll design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential... WKCL1_UKTJ ...

Senior Software Engineer - National Security (Data Systems) About the role You'll design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems click apply for full job details ...