26 to 50 of 580 Data Pipeline Jobs in the UK

Data Engineer/Data Architect - Azure Stack We are looking for an experienced ETL Data Engineer/Data Architect to deliver projects in collaboration with our IT partners and internal stakeholders that will transform our product landscape. This role is hands … would be expected to contribute to ETL development as well data architecture. You will be taking business requirements from stuctured data sets from the research teams and and transforming into technical documents. Essential Skills Educated to degree level in a relevant IT subject. Expertise in designing ...

deploying top-tier engineers into mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid … working with flexibility Collaborate with high-performing engineering teams Exposure to modern data stacks and cloud technologies Clear progression in a growing consultancy The Role You’ll design, build, and optimise data pipelines and systems that support critical business decisions. Key Responsibilities Build and maintain data ...

want to build the infrastructure that brings advanced analytics and AI from theory into reality? University College London Hospitals is looking for a Data Engineer (AI Enablement) to join the SAFEHR team.We are solving hard problems: building the secure, modern data infrastructure that lets advanced research … will develop and improve UCLH's data warehouse environments. Being involved in the transition from using an R-based data pipeline to Spark jobs running on a data platform. You will model and transform data from our Epic electronic health record ...

exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start … delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring ...

team that holds a high bar for itself — keep reading. About the Role We are seeking a highly analytical and impact-driven Senior Data Scientist to join our Data Science Data team at Socure. In this role, you will work at the intersection … learn) for model development and evaluation. Deep understanding of machine learning algorithms, model evaluation techniques (e.g., AUC, lift, calibration, stability), and data pipeline development for both batch and near‐real‐time use cases. Experience building and maintaining data pipelines and workflows in distributed or large ...

Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data … Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality ...

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading global … energy trading firm offering the opportunity for a contract Business Analyst to support a major data transformation programme. This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data ...

Data Engineer 12 months Bath - x3 days onsite £550 Outside ir35 Active DV clearance (SC Considered) required Role Overview We are seeking an experienced DV (SC Considered) Cleared Data Engineer to support a high-profile, mission-critical programme within a secure government environment. The role will … Skills & Experience Proven experience as a Data Engineer in secure or government environments Strong skills in Python, SQL, and data pipeline development Experience with data integration tools (e.g. Airflow, NiFi, Azure Data Factory, AWS Glue, or similar) Hands-on experience with ...

Senior Data Engineer Location : Remote with visits to our Sheffield HQ a minimum of 6 times a year Twinkl is on an exciting journey to redefine how we serve our global teaching community through data. We're building a world-class data engineering function to power … technical decisions We focus on impact and outcomes over process What will you be doing? As our Senior Data Engineer , you will: Pipeline Development: Design, build, and maintain scalable data pipelines that move data efficiently across the organization. Data Modeling: Optimize ...

Consultant/Data Engineer Location: Telford or Worthing (hybrid working 2 days onsite) Type: Full Time, Permanent Salary: £50,000 - £70,000 DOE + comprehensive benefits package Deerfoot Recruitment is working with a major consultancy partner on a long-term public sector engagement and is seeking experienced … Senior Data Engineer/Analytics Engineer/Data Platform Engineer/Data Integration Engineer/Data Pipeline Engineer/Data Solutions Engineer/Enterprise Data Engineer Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy ...

Data Scientist – Bayesian Hierarchical Modelling (R/Python/AWS) Overview We are seeking a highly capable Data Scientist with strong experience in Bayesian hierarchical modelling and advanced statistical techniques to join a growing data and analytics capability. This role sits across data science, data engineering, and backend development, supporting the delivery of scalable models, robust data pipelines, and high-quality insight products. You will work with complex, high-volume datasets, applying statistical rigour to solve real business problems, while also contributing to the engineering layer that ...

transformation programme across a complex, multi-asset portfolio. You’ll act as the go-to technical lead for investment data , owning pipeline architecture, driving automation across operations, and ensuring data is reliable, scalable, and decision-ready. 🔧 What you’ll be doing … data pipeline ecosystem (APIs, integrations, data flows across multiple platforms) Define and implement data architecture, standards, and governance frameworks Build and scale robust, production-grade pipelines supporting reporting & analytics Drive automation across investment operations — removing manual, spreadsheet-heavy processes Develop dashboards, reconciliation tools ...

integrate data from multiple sources Support data warehouse development and optimisation Implement best practices across data engineering and pipeline performance Contribute to CI/CD pipelines and deployment processes Required Skills & Experience Strong experience with Azure Data Factory, Azure Data Lake, and Azure SQL Solid background in ETL development and data pipeline engineering Proficiency in Python and SQL Experience with Spark and Databricks Strong understanding of data warehousing concepts Experience building and maintaining scalable data architectures Desirable Skills Experience with Azure ...

footprint, currently investing in the build-out of its in-house FX, trading and investment technology platforms. The business operates in a highly data-driven environment where technology plays a key role in supporting investment teams, trading workflows, portfolio decision-making, risk visibility and operational efficiency. They … role focused on one small part of a trading system. The key requirement is someone who understands the complete FX trade lifecycle - how data is sourced, ingested, validated, transformed, consumed and reported across pricing, execution, booking, positions, risk, P&L, portfolio views and downstream systems. You’ll work ...

Lead Data Engineer Hybrid Working - 2-4 day per month in the office (East London/Essex) Salary to £75k A Lead Data Engineer is required for a transformational role. With Fabric already in place, the focus is now on maturing the environment from Bronze through … Gold over the next 1218 monthsimproving architecture, data quality, and overall platform capability. This is a hands-on leadership role, acting as the senior technical escalation point while helping shape best practice, refine existing pipelines, and drive data modernisation across a complex data landscape. ...

days at home;) Permanent Sellick Partnership are proud to be partnered with a well-established business who are investing in professionalising its data capability. They are looking for a Data Engineer to join them to help design and build the foundations of a modern data … Responsibilities Design and build a modern Azure-based data platform, including: Azure Data Lake Data ingestion pipelines Data modelling and transformation Automate ingestion of data from: Bespoke operational systems ERP systems High-volume transactional sources (1,000+ transactions per hour ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. ...

Method Resourcing are delighted to partner with an innovative SaaS business based in London looking to hire a Senior Data Engineer to join their talented team as they continue to grow. The Senior Data Engineer will be a key member of the Data & Analytics … growth. Experience integrating data from diverse sources, maintaining accuracy and consistency throughout the ETL process. Skilled at troubleshooting complex data pipeline and infrastructure issues. Collaborative team player, able to align data solutions with business objectives across cross-functional teams. Familiar with CI/ ...

building readiness and defences; detect and monitor infectious diseases using cutting-edge environmental and biological surveillance; analyse threats using world-class science and data analytics; respond with rapid, collaborative and effective actions;and lead strong global, national, regional and local partnerships designed to save lives and protect … that they can be themselves at work and that they are valued. Main duties of the job We are looking for two Lead Data Engineers to join our team. The UKHSA Chief Data Officer (CDO) provides strategic leadership and oversight for developing and managing a common ...

opportunity Take ownership of an existing data function and scale it to match Breakout's next stage of growth Report directly to the COO with full mandate to elevate data maturity across the business Evolve current pipelines and infrastructure into a reliable, scalable data platform Expand self‐serve analytics so every team can access insight without depending on engineering Grow and lead the data team, hiring, mentoring, and setting the bar for craft Establish data governance, quality standards, and a shared data model that the whole ...

Data Quality Analyst - London (Hybrid) - Azure, Databricks, SQL, Power BI - Up to £55,000 This is an opportunity to join a global organisation that takes data quality seriously and sees it as essential to how the business operates and reports. The organisation continues to invest … data platforms and governance, with a clear focus on reliability, consistency and long-term improvement. You'll be part of a Global Data Team where quality matters, collaboration is encouraged, and people are trusted to take ownership. If you enjoy getting into the detail of data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. ...

Role Summary Leyton Orient is building a genuinely data-driven recruitment operation one where statistical rigour, AI tooling, and traditional scouting judgement work in concert rather than in tension. This role sits at the centre of that ambition. As Recruitment Data Scientist, you will design … databases or semantic search systems for unstructured data retrieval Exposure to cloud infrastructure (AWS, GCP, or Azure) for scalable data pipeline deployment Experience with modern data orchestration tools (Airflow, Prefect, dbt) What We Offer Direct access to senior football operations leadership, with genuine ...