151 to 175 of 579 Data Pipeline Jobs in the UK

partner with intimate knowledge of your industry and first-hand experience of defining its future.Glasgow, Manchester, London# Managing Consultant/Senior Manager- Data & AI Architecture## Managing Consultant/Senior Manager - Data & AI ArchitectureAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend … today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional ...

introducing process improvement and improving stakeholder experience. You will also review our current integration and any optimising of connections to Power BI and data warehouses alongside our internal Data and Insights team. You will introduce Prism Analytics capability to HR and build internal team capability through … Review and document existing data flows between Workday and PowerBI Assess integration patterns Identify gaps and recommend improvement to data pipeline architecture Work with data/BI teams to align Workday models with warehouse schemas Prism Analytics: Assess readiness and define a roadmap ...

growing fleet of commercial vessels. Working across engineering , software , and commercial teams, you will own the end-to-end data and insight pipeline , designing how operational data flows from onboard systems through to internal engineering tools and customer-facing reporting. You will play a central … close the loop between real-world operation and product development . Responsibilities will include: Owning the end-to-end data and insight pipeline across operational performance reporting Designing how data flows from onboard systems into internal engineering tools and customer-facing outputs Building and maintaining ...

Data Engineering Lead/York (hybrid)/75k- 90k We're hiring a Data Engineering Lead to take ownership of a growing Azure-based data platform, working as part of a small, high-impact team. This is a hands-on technical leadership role focused … building, improving, and stabilising data pipelines and architecture - while also supporting a broader BI environment. What do we need from you? Strong experience with Azure Data Factory and the Microsoft data stack Solid SQL and Python skills Experience building and maintaining data ...

Senior Data Engineer London Hybrid Salary £80,000 - £90,000 (depending on experience) VIQU has partnered with a leading organisation in the clean energy sector to recruit a Senior Data Engineer. You will design and build scalable data infrastructure, turning complex datasets into valuable … collaborative, agile team, you ll take ownership of key initiatives while contributing to best practices and mentoring others. Key Responsibilities of the Senior Data Engineer: • Build and maintain scalable data infrastructure using cloud technologies • Develop and optimise ETL pipelines for efficient data processing • Support ...

Data Engineer (Palantir, AI & Advanced Analytics) London | Permanent | Hybrid Working Our client is a fast‐growing technology and AI consultancy that helps organisations solve complex data challenges across government and enterprise environments. The firm specialises in delivering Palantir‐led data platforms and decision‐intelligence … solutions , supporting clients to unify fragmented data, build operational workflows, and enable informed decision‐making in mission‐critical settings. As a Data Engineer , you will work at the intersection of software engineering, analytics, and AI‐enabled consulting. This is a hands‐on role where ...

Senior Data Engineer London – Hybrid Salary £80,000 - £90,000 (depending on experience) VIQU has partnered with a leading organisation in the clean energy sector to recruit a Senior Data Engineer. You will design and build scalable data infrastructure, turning complex datasets into valuable … collaborative, agile team, you’ll take ownership of key initiatives while contributing to best practices and mentoring others. Key Responsibilities of the Senior Data Engineer: • Build and maintain scalable data infrastructure using cloud technologies • Develop and optimise ETL pipelines for efficient data processing • Support ...

Senior Data Engineer London – Hybrid Salary £80,000 - £90,000 (depending on experience) VIQU has partnered with a leading organisation in the clean energy sector to recruit a Senior Data Engineer. You will design and build scalable data infrastructure, turning complex datasets into valuable … collaborative, agile team, you’ll take ownership of key initiatives while contributing to best practices and mentoring others. Key Responsibilities of the Senior Data Engineer: • Build and maintain scalable data infrastructure using cloud technologies • Develop and optimise ETL pipelines for efficient data processing • Support ...

Senior Data Engineer 6 months London, Hybrid - £350 p/d (Outside IR35) Experienced Senior Data Engineer required to join our client on an initial six-month contract to support the design, build, and delivery of enterprise-scale data platform solutions. This … hands-on technical leadership role responsible for building core platform components while setting and maintaining engineering standards across the wider data engineering team. The successful candidate will lead the technical design and delivery of data pipelines, transformations, and data models across the platform, ensuring ...

About Accelerant Accelerant is a data-driven risk exchange connecting underwriters of specialty insurance risk with risk capital providers. Accelerant was founded in 2018 by a group of longtime insurance industry executives and technology experts who shared a vision of rebuilding the way risk is exchanged – so that … interfaces for internal operational tooling, including dashboards, data observability views, and stakeholder communication surfaces Developing rich data visualizations that surface pipeline health, data quality metrics, and business KPIs to technical and non-technical audiences Building and maintaining backend services that support operational tooling ...

Data Engineer Location: Remote/monthly visits to Cardiff Salary: up to £72,000 with generous bonus We're looking for a Data Engineer to join a forward-thinking data team focused on enabling smarter decision-making across the business. This team plays … role in shaping and delivering data platforms, pipelines, and analytics capabilities that empower users and unlock valuable insights. The Role As a Data Engineer, you'll design, build, and maintain scalable data solutions that meet both business and customer needs. You'll work within ...

Data Engineer (Quantexa) Hybrid Working - London - 1-2 days a week on site. Financial Services Lorien's leading banking client is looking for a Data Engineer to join a newly built team on a new project. The Ideal Candidate will design, build, and maintain scalable data pipelines and analytical solutions with a strong emphasis on Scala-based data processing, graph analytics, advanced data wrangling, and experienced in using and understanding Quantexa. You will work closely with data scientists, analysts, and platform engineers to enable insights from complex, interconnected ...

Contract Data Engineer (Azure/Databricks) Remote (UK-based) | Occasional travel to Kent | Outside IR35 | 3-Month Initial Contract Elevation Tech & Transformation are supporting a UK-based organisation undergoing a wider IT and data recovery programme, and they’re looking to bring in an experienced Data Engineer on a short-term contract to stabilise and improve their current data environment. This is a hands-on role focused on back-end data engineering, working with fragmented and inconsistent data sets to create structure, reliability, and improved data ...

title: Junior Data Engineer Location : Edinburgh Hybrid role: working 2 days a week in the office Salary: £36,000 to £41,000 pa plus 5% bonus Contract: 12-month fixed term contract Our market-leading financial services client is seeking an a motivated, detail focused Junior Data Engineer to join the Business Transaction Banking division. This role involves building, optimising, and scale data pipelines and large-scale data processing workloads in a cloud-native environment. You will work with modern distributed data systems, contribute to data platform ...

Data Engineer - Databricks - AWS - London (Hybrid) - Up to £65,000 This is an opportunity to join a fast-growing analytics and technology business operating across the sports, media and entertainment space. The company is scaling rapidly following recent growth, with data at the centre … drives performance, commercial outcomes and strategic decision-making. You'd be joining a business where data matters, projects are high-profile and your work has visible impact, across well-known organisations and brands. It's a collaborative, ambitious environment that appeals to engineers who want ownership, variety ...

capabilities in sales and presales. Programming & Scripting Languages: Proficiency in languages such as Python or R, with strong knowledge of relevant libraries for data manipulation, scripting, and custom solution development. Experience with SQL for complex queries and data extraction. Cloud Architecture & Data Management: Strong … understanding of cloud platforms (e.g., AWS, Google Cloud, Microsoft Azure) and their architecture. Knowledge of data warehousing, ETL processes, data pipelines, and data governance principles. Data Visualisation & Reporting: Skilled in using data visualisation tools (e.g., Tableau, Power BI) to create ...

Opportunity As a Performance Engineer, you will play a key role in owning and improving the full operational data and insight pipeline from onboard vessel systems through to engineering analysis and customer-facing reporting. You will work closely with engineering, software, and commercial teams to transform complex … performance is understood and communicated within a rapidly growing business. Key Responsibilities Own the end-to-end operational data and insight pipeline Design and improve how onboard system data flows into internal engineering tools and customer-facing outputs Build and maintain data pipelines ...

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working with some … most complex data challenges in the insurance and financial services sector, operating in a highly regulated and analytically demanding environment. You’ll help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping long‐term Azure ...

drawn from the world’s top physical AI specialists and led by originators of the field. Your Role: We are hiring a Data Engineer to help build the systems that prepare, curate, and scale training and evaluation data for machine learning in autonomous driving. You will … work across the full data lifecycle, from raw vehicle logs and simulation outputs to curated, labelled, and model-ready datasets. This includes handling multimodal sensor data, scaling labelling through both human and ML-based workflows, and enabling intelligent selection of high-value data from ...

SENIOR DATA ENGINEER £100,000 REMOTE (LONDON) An opportunity to join a fast-growing, consumer-focused digital platform that is redefining how modern users interact with data-led products. This is a senior, high-impact role within a scaling data function, offering ownership, influence … first culture. The business values scalable solutions over quick fixes, with a collaborative and technically ambitious environment. The role sits within a growing data function that plays a critical part in supporting continued customer growth and increasingly real-time analytics use cases. THE ROLE As a Senior Data ...

analytics, reporting and AI capability within a large-scale business services transformation programme. This role suits an experienced analytics, BI or data product professional who can shape strategy, lead delivery, manage stakeholders and support a small team. What You'll be doing Leading the development and improvement … analytics products using Oracle Analytics Cloud and Oracle Fusion Data Intelligence. Owning the analytics, AI and machine learning roadmap. Managing and mentoring a small team of reporting specialists and analysts. Working with stakeholders to turn insight requirements into dashboards, reports and automated data solutions. Promoting data ...

Description Data Engineer (Quantexa) Hybrid Working - London - 1-2 days a week on site. Financial Services Lorien's leading banking client is looking for a Data Engineer to join a newly built team on a new project. The Ideal Candidate will design, build, and maintain scalable … data pipelines and analytical solutions with a strong emphasis on Scala-based data processing, graph analytics, advanced data wrangling, and experienced in using and understanding Quantexa. You will work closely with data scientists, analysts, and platform engineers to enable insights from complex ...

quantitative analytics platforms across physical and derivatives markets. You'll work closely with traders, quants, and senior engineers on the development of modern data and analytics tooling used across the business. The environment is C# and Python-focused, with increasing adoption of cloud-native data technologies … markets Experience with derivatives pricing or risk systems Knowledge of Numerix or similar quant/risk platforms Understanding of ETL and data pipeline design Experience working in Agile delivery environments McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

Description Contract Data Engineer (Azure/Databricks) Remote (UK-based) | Occasional travel to Kent | Outside IR35 | 3-Month Initial Contract Elevation Tech & Transformation are supporting a UK-based organisation undergoing a wider IT and data recovery programme, and they’re looking to bring in an experienced … Data Engineer on a short-term contract to stabilise and improve their current data environment. This is a hands-on role focused on back-end data engineering, working with fragmented and inconsistent data sets to create structure, reliability, and improved data ...

Oxfordshire/Hybrid £60,000 – £80,000 DOE Permanent | Full-time We’re working with a purpose-led consultancy looking for a Senior Data Engineer to take ownership of a key data function that sits … heart of their client delivery. This is not a standard “keep the pipelines running” role. You’ll inherit an existing data pipeline framework, assess what is working, decide what needs improving or replacing, and take the lead on building a robust, scalable approach for the future. What ...