301 to 325 of 581 Data Pipeline Jobs in the UK

obligation to do so now. Flexible working will be part of the discussion at offer stage. PURPOSE OF THE ROLE The BBC Data Platform is the foundation that enables teams across the organisation to capture, process, govern, and utilise data. It powers our analytics, personalisation, and insights … such as iPlayer, Sounds, and News. We're in the middle of a major transformation to modernise how we ingest, process, and serve data in real time. Our ambition is to build an enterprise data platform that provides reliable, real-time data at scale ...

Automation Engineer with expertise in Python, Large Language Models (LLMs), Spark, and ETL development. The role focuses on building intelligent automation solutions, scalable data pipelines, and integrating AI capabilities into enterprise workflows. Automation & Python Development Design and develop automation frameworks using Python. Build reusable scripts for data … years of experience in automation or data engineering. Strong Python programming skills. Hands-on experience with LLMs and Spark. Experience in ETL pipeline development. Preferred Qualifications Experience with GCP Cloud platforms. Exposure to Teradata systems. Knowledge of orchestration tools like Airflow. Familiarity with Docker and Kubernetes. ...

ensuring the organisation can forecast with accuracy, speed, and control. The modeller will work closely with FP&A, Finance Business Partners, and our data team to develop scalable, best practice Anaplan solutions that support strategic decision making. Key Role Accountabilities: · Design and build Anaplan models to support automated … budgeting, scenario modelling, and multi dimensional analysis· Lead the development of connected planning across Finance, integrating underwriting, claims, operational and other insurance specific data sources· Translate complex business requirements from Finance and FP&A teams into robust technical Anaplan solutions· Partner with data ...

Graduate Data Analyst | Edinburgh (Hybrid) | Graduate Opportunity | Competitive Pay & Benefits Kick-start your data career with one of Scotland’s leading Microsoft Partners. At Quorum, we don’t just offer jobs - we build careers. As a Microsoft Direct Cloud Solutions Provider (CSP) and one of Scotland … largest Microsoft Partners, we’re growing fast and looking for a curious, driven Graduate Data Analyst to join our team. If you’re passionate about data, love solving problems, and want to work in an environment that invests heavily in your development - this could ...

Location-Chippenham, UK (On-Site) Monday to Friday - Office Hours At Oakhouse Foods, part of Pilgrim's Europe, data drives everything we do — from operational performance to customer experience. We're looking for a technically strong and commercially aware Integrations & Data Engineer to design, build … support resilient data pipelines and system integrations that power our business. This is a hands-on role where you'll combine technical expertise with problem-solving capability to reduce manual processes, improve automation, and deliver reliable, future-proof solutions. The Role You will ensure business data ...

Position: Starburst Developer (Data Visualisation SME) Day rate (Inside IR35) - £600/day Client: Investment bank Location: Central London Initial duration: 6 months Our client provide technology services for a global investment bank. Do you have Starburst Development experience, designing data pipelines Can you contribute … building a data‐driven, insight‐led operating model within a highly regulated banking environment? If yes, then please read on..... You will design and maintain data pipelines using Starburst and related technologies, optimizing query performance and resolving data processing bottlenecks. You will need experience ...

Data Engineer (AWS) Location: (Hybrid 2-3 days onsite) Salary: £60,000 - £70,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget Security Clearance: Must be eligible for SC Clearance (5+ years UK residency) Sector: Public Sector & Government Client Build the Data Infrastructure That Powers … Public Sector We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn't just about moving data; it's about modernizing essential services and delivering secure, reliable data products at scale. You will play ...

excellent opportunity for someone at the start of their analytics career to develop strong technical and commercial skills in a supportive, data-driven environment. You will gain hands-on experience working with modern data platforms, building robust analytics solutions, and translating data into insights … that influence real business decisions. The Company They are a large, well-established organisation with a strong focus on using data and analytics to drive smarter decision-making. With a collaborative culture and a clear investment in technology, they provide an environment where early-career analysts can learn ...

seeking a highly skilled Teradata Engineer for an initial 6 month contract, mainly remote. The role will see you building robust data pipelines, modernizing Legacy code, and ensuring data delivery, working closely with Data Architects, System Analysts, and QA Automation Engineers. Key Responsibilities; Build … maintain scalable data pipelines to migrate from Teradata to Amazon S3 Analyze and convert Legacy Teradata BTEQ scripts into modular, version-controlled, and highly performant dbt (data build tool) models for data transformation. Work alongside the QA team to configure and execute selected automated ...

currently working with a leading Leisure & Hospitality client based in Birmingham who are recruiting for a Junior Data Engineer on a permanent basis. This is a great opportunity for someone early in their data career who wants hands-on experience with data pipelines …/ELT processes, and analytics platforms - essentially you will help build modern, cloud-based data solutions using Microsoft Fabric and Azure. The role will require you to: Support the development and maintenance of data pipelines Help ingest, transform, and load data from multiple systems ...

Position: Data Visualisation SME (Denodo Platform) Day rate (Inside IR35) - £600/day Client: Investment bank Location: Central London Initial duration: 6 months Our client provide technology services for a global investment bank. Do you have Denodo platform experience, designing data pipelines Can you contribute … building a data‐driven, insight‐led operating model within a highly regulated banking environment? If yes, then please read on..... You will design and maintain data pipelines using Denodo and related technologies, optimizing query performance and resolving data processing bottlenecks. You will need experience ...

Principal Data Platform Engineer Java, Kafka, AWS Remote (UK‐based) Permanent – Up to £130,000 + Benefits Security Clearance Requirement For this role, you must be eligible for SC Clearance . Due to the secure nature of the work, this requires British Citizenship , as some data is UK Eyes Only . Overview We are seeking an experienced Principal Data Platform Engineer to play a key technical leadership role within a high‐impact programme delivering secure, scalable, real‐time data platforms for critical UK Government and national infrastructure clients. This ...

strong governance, usability, and performance. Act as a Power BI specialist, developing scalable datasets, semantic models, and reusable reporting components. Design and implement data solutions using Microsoft Fabric, including Lakehouse and Data Pipelines where required. Build and maintain API integrations with third-party systems. Work with … Databricks and Fabric for advanced data processing and analytics workloads where required. Work with Azure Integration Services (Logic Apps, Function Apps) Azure Platform We predominantly operate within a Microsoft Azure cloud environment, and the role requires strong working knowledge of its core services and configurations. Maintain and support ...

Senior Data Engineer | Oxford (Hybrid) We’re partnering with a fast-growing, globally recognised organisation at the forefront of a complex, data-rich industry and they’re looking for a Senior Data Engineer to help shape the future of their internal data platform. This is a high-impact role where you’ll work closely with senior stakeholders, design scalable data solutions, and play a key part in building a modern, enterprise-wide data ecosystem. What you’ll be doing: Designing and building robust, scalable data ...

Senior Vice President of Product. This role drives technical strategy, fosters cross-functional collaboration, and delivers secure, scalable SaaS B2B industrial data analytics solutions. Embracing our vision of a zero-carbon future and our mission to innovate for cost reduction, value creation, and sustainable growth, this role ensures … excellence, ensuring high standards in secure, reliable, and scalable engineering practices. Enable the team to deliver high‐quality solutions by promoting agile practices, data‐driven decision‐making, and continuous improvement. Customer‐Centric Leadership Set the direction for delivering innovative and scalable solutions that address customer challenges and align ...

Title: Senior Platform Engineer (AWS) – Data Platform Focus Location: Hybrid, 2days/week onsite-London, UK Duration: 6Months+ Contract Outside IR35 520GBP/Day Outside IR35 Overview We are hiring a Senior Platform Engineer (AWS) to work on a large project focused on moving data to AWS and building a modern data platform. The role is mainly platform and DevOps focused, with some involvement in data migration and data pipelines. We’re looking for someone who is strong in AWS, infrastructure, and automation, and can help build ...

Azure Data Engineer – SC Cleared Contract – Inside IR35 6 Months (Likely Extension) We’re looking for a senior Azure Data Engineer with active SC Clearance to join a high-impact data programme. This role is strictly for hands-on engineers who can design, build … Clearly articulate and own what you’ve built end-to-end Required Experience Strong Azure Synapse Analytics experience (essential) Proven expertise with: Synapse Notebooks Pipeline development Solid Python (data engineering focus) and SQL Experience designing and structuring ETL/data engineering frameworks Ability to work ...

DATA ENGINEER 6-MONTH CONTRACT LONDON (1 day in office) £500 - £550 per day (Outside IR35) This position as a Snowflake Engineer offers the opportunity to join a leading travel company based near West London, currently undergoing a major cloud data transformation. THE COMPANY This established … Pharma brand is known for its innovation and commitment to delivering seamless customer experiences through data. With a focus on modernising its data platforms, the company is investing in Snowflake and cloud-native tooling to better understand customer journeys, improve operations, and fuel growth. Contractors and perm hires ...

Senior Consulting Engineer - Forward Deployed London | Hybrid/client-site as needed | Active SC clearance required I’m supporting a fast-growing data and AI consultancy, founded by ex-Palantir engineers, as they build out a team of SC-cleared Consulting Engineers across data, software … client-facing delivery. This is not a traditional data engineering role. It sits across data engineering, software engineering and technical consulting , working directly with clients across public sector, defence and national security. You’ll be helping organisations make sense of complex data, build practical ...

Data Engineer Hybrid: Birmingham Salary: £45000 to £50000. This is an exciting opportunity to step into a hands on Data Engineer role within an analytics team that is growing in both scope and influence. You will play a key part in stabilising and evolving a broad … data environment while supporting a business that is increasing its digital footprint and analytical maturity. The Company They are an established manufacturer in the healthcare space with a strong reputation for product quality, research, and customer care. The organisation is scaling quickly, expanding internationally, and investing in data ...

leading Financial Services organisation in London is seeking an experienced Data Engineering Manager to join on a permanent basis. This role offers a base salary of up to £90,000, alongside a strong benefits package and flexible working arrangements. This is a hands-on leadership role where … will be responsible for building, scaling, and optimising data engineering capability. You will lead a team of engineers while remaining closely involved in the design, development, and ongoing improvement of robust, cloud based data platforms and pipelines. Key responsibilities include: Leading and mentoring a team ...

compliance-ready healthcare professionals – without the hassle of traditional agencies. The Role We’re looking for a Market Intelligence Specialist to build a data advantage in one of the most complex markets in the world: healthcare workforce and operations. This is not a reporting role. This is about … creating signal from noise — turning fragmented, delayed, and often opaque data into something our commercial teams can actually use to win. You’ll combine public sector data (FOI/open records), historical datasets, and real-time market signals to map demand, identify opportunities, and guide where ...

Description Contract GCP Data Engineer - £600-£700/day (Outside IR35) Rate: £600-£700 per day Contract Type: Outside IR35 Duration: Initial 4 weeks (high likelihood of extension) Location: Central London (on-site with client) Start: Immediate Overview We're supporting a well-established insurance broker in Central … London seeking a GCP Data Engineer for an initial short-term engagement, with strong potential for continued work. This role requires a hands-on contractor who can quickly integrate into an existing data function, take ownership of deliverables, and provide immediate impact within a fast-paced ...

real world. You’ll work across: Flight and mission systems Operator interfaces and 3D environments Connectivity and distributed systems Simulation, testing, and data pipelines Your primary impact will be in: Defining architecture and technical strategy Driving engineering standards and system evolution Ensuring the platform scales ...

Support and coordinate other delivery managers contributing to the AI strategy, aligning plans and sharing good practice Translate technical concepts - such as architectures, data pipelines, and AI engineering approaches - into clear, accessible language for stakeholders Plan and prioritise work packages, balancing short-term delivery needs with longer-term ...