151 to 175 of 915 Data Pipeline Jobs in the UK

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data More ❯

Join our innovative AI/ML team at Barclays Corporate Bank as a Senior Machine Learning Engineer , where we bridge the gap between cutting-edge data science exploration and real-world business application integration. We manage internal cloud platforms that support exploratory data science work while specialising in transforming conceptual ML models into production-ready applications … decisions and processes. As part of Barclays' strategic AI/ML initiative, our team plays a vital role in establishing the corporate bank as a leader in financial data analytics innovation. We offer the opportunity to work with enterprise-scale data using cloud technologies, implement MLOps best practices, and collaborate with talented data scientists … experience in AWS based Machine Learning technologies (AWS SageMaker, Lambda, S3, EC2). Experience with CI/CD pipelines and Docker containerisation for ML model development/deployment. Data preprocessing and feature engineering expertise. Programming skills in Python and ML frameworks (TensorFlow, Torch, scikit-learn). Statistical analysis and model evaluation capabilities. Previous experience in the banking sector More ❯

complexity manageable and insight actionable - supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. Location London Job type Permanent As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium, Ads, and Royalties. We create libraries and … tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify's ambitions forward. We are looking for engineers who are excited to shape the future of financial data at Spotify. You will design and operate scalable pipelines … that process billions of records. You will apply product thinking to financial data - managing the full lifecycle from sourcing to documentation to exposure. You will define abstractions that simplify complexity and create intuitive paths for our consumers. Together, we advocate for standards, champion quality, and build systems that others can rely on with confidence. If you thrive on More ❯

Role Summary Tasman is defining the future of Data Analytics-as-a-Service. We are a young and growing company funded fully by analytics & data science work for our ambitious clients. We are hiring a senior data engineer at Tasman to: Take ownership of the design and implementation of data pipelines and … platforms for our clients Mentor and develop other Engineers to achieve their full potential Work with Data Product Manager to develop plans and roadmaps that deliver on client objectives each sprint and throughout the engagement Support and enable other functions within your team to deliver data products. ABOUT TASMAN At Tasman, we transform disorganised data … As a boutique consultancy with offices in the UK and the Netherlands, we have been serving clients across Europe since 2017. Our expertise spans analytics, business intelligence, and data science, allowing us to deliver rapid, impactful results through tailored, scalable solutions. Our past and current clients include well known brands like The Earthshot Prize, Verisure, Paired, Ecosia, Gousto More ❯

AWS Data Architect Principal (Assembly, Bristol, United Kingdom) Recruiter: BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached … we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies. The Data Engineering Principal leads the AWS design, building and implementation of processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning … the most complex business needs into the data that supports the DD Ops and BT group’s data strategies. This role involves both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality, scalable, and efficient data infrastructure. Lead End-to-End Data Lifecycle: Own and manage More ❯

AWS Data Architect Principal (Assembly, Bristol, United Kingdom) Recruiter: BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached … we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies. The Data Engineering Principal leads the AWS design, building and implementation of processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning … the most complex business needs into the data that supports the DD Ops and BT group’s data strategies. This role involves both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality, scalable, and efficient data infrastructure. Lead End-to-End Data Lifecycle: Own and manage More ❯

Tableau Developer We are looking for a Tableau Developer in our Data team. You will be joining our Analytics Excellence team. In this role, you will hold a range of responsibilities critical to the successful use of Tableau Cloud at Funding Circle. You will be the primary point of contact for complex Tableau issues. You will troubleshoot and … help to resolve Tableau Cloud performance, dashboards, data sources and Tableau Bridge connectivity queries and provide solutions for users. Who are we? We're Funding Circle. We back small businesses to succeed. At Funding Circle, we believe the world needs small businesses. That's why we've made it our mission to help them get the finance they … and data governance processes across Funding Circle. Collaborate with Cloud Infrastructure and Data Platform teams to monitor Tableau Bridge Server , monitor overall data pipeline efficiency for Tableau Cloud and ensure the Tableau configurations are appropriate Provide training and support to tableau users. Stay up to date with Tableau releases and new features What More ❯

Job Title: Data Engineer Reporting to: Head of Innovation Date of Issue: July 2025 Role Objective Reporting to the Head of Innovation, you will join a newly formed team to support the delivery of a major data transformation initiative. As a hands on and forward thinking Data Engineer, you'll be instrumental in designing … and implementing a robust, scalable data platform that underpins the business's strategic growth. This role offers a unique opportunity to help shape a best in class data engineering function from the ground up. Duties & Responsibilities Design, build, and maintain scalable data pipelines for collecting, processing, and storing large datasets. Develop and optimize database … strong transferable skills from other cloud platforms. Experience using SQL for database management essential. Proficiency in programming languages (e.g., Python, Java, or Scala) desirable. Experience with data pipeline frameworks and ETL tools and familiarity with big data technologies. Understanding of version control principles and tools essential. Knowledge of data integration tools and languages More ❯

money laundering, and terrorism financing. Our mission is to minimise losses and risk exposure while supporting trust, operational efficiency, and regulatory compliance. We are a multidisciplinary team of data scientists, analysts, machine learning engineers, and backend engineers working together to detect and respond to suspicious activity. We own the end-to-end platform that powers our real-time … and batch monitoring capabilities, including: A custom alerting and orchestration platform, built on Airflow, that enables scalable, auditable detection pipelines. Data pipelines in DBT and Snowflake that serve both ML models and rule-based logic. Backend services and APIs that handle case management, automated decisioning, merchant termination workflows, and integrations with adjacent platform services. We collaborate closely with … systems and software design principles. Proficiency in at least one of the following languages: Python, Golang, Java. Experience with multiple languages is a plus. Familiarity with data pipeline tooling such as Airflow and DBT, and cloud data warehouses like Snowflake. Understanding of testing strategies, including unit, integration, and system testing (TDD/BDD is a More ❯

Do you want to use data to help drive the direction of products that impact the lives of over 1 billion people every day? If yes, we want to talk to you. We're looking for a leader in our Data Engineering team to work closely with Product Managers, Data Scientists and Software Engineers … to support product launches and roadmaps by building the data architecture that informs and drives insight. In this role, you'll see a direct link between your work, company growth, and user satisfaction. You'll work with some of the brightest minds in the industry, work with one of the richest data sets in the world … use cutting edge technology, and see your efforts affect products and people on a regular basis. Proactively drive the vision for BI and Data Warehousing across a product vertical, and define and execute on a plan to achieve that vision. Define the processes needed to achieve operational excellence in all areas, including project management and system reliability. Build More ❯

SENIOR ANALYTICS ENGINEER UP TO £80,000 + BENEFITS PRIMARILY REMOTE Looking to take ownership of scalable data models, shape a brand-new analytics function, and work with the modern data stack from day one? THE COMPANY: I'm working with a fast-scaling, tech-driven organisation that's investing heavily in its data capabilities. As part of a wider data transformation, they're building out a dedicated Analytics Engineering team focused on creating scalable, trusted data infrastructure. With strong support from BI, Data Science, and Engineering teams, this function is central to how the business defines and uses data going forward. THE ROLE … skills and hands-on experience with dbt (or similar tools) Experience designing as well as building data models Exposure to Snowflake and/or data pipeline tools Understanding of testing, CI/CD, and data quality frameworks THE BENEFITS: You will receive a salary dependent on experience-up to £80,000. On top More ❯

SENIOR ANALYTICS ENGINEER UP TO £80,000 + BENEFITS PRIMARILY REMOTE Looking to take ownership of scalable data models, shape a brand-new analytics function, and work with the modern data stack from day one? THE COMPANY: I'm working with a fast-scaling, tech-driven organisation that's investing heavily in its data capabilities. As part of a wider data transformation, they're building out a dedicated Analytics Engineering team focused on creating scalable, trusted data infrastructure. With strong support from BI, Data Science, and Engineering teams, this function is central to how the business defines and uses data going forward. THE ROLE … skills and hands-on experience with dbt (or similar tools) Experience designing as well as building data models Exposure to Snowflake and/or data pipeline tools Understanding of testing, CI/CD, and data quality frameworks THE BENEFITS: You will receive a salary dependent on experience-up to £80,000. On top More ❯

Data focused tech business within the automotive industry. Role - Data Engineer Type - Fixed term contract (3 months) Salary - £70,000 - £75,000 Location - Hybrid, 2 days per week in the office (Victoria, London)/3 day remote Start - ASAP, need to have the ability to start by 8th August Spec - PURPOSE OF POST: To implement scalable … and efficient data models, databases, and processing systems Create and test the additional Reports/Extracts required for Customers Support the Data team with process implementation, E2E testing, OLTP/OLAP reconciliation activities, keeping documentation up to date, fixing any issues with data based on feedback from SMEs To build robust, fault-tolerant data pipelines for ingesting, processing and transforming large volumes of data To collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data requirements and provide solutions To assist with report/data extract creation and data delivery activities related to the transition of More ❯

best platform, people, and partners together to create limitless opportunities for growth. For more information, visit About Choreograph: A Leading WPP Media Brand Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. … We work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers … be able to work with huge data sets SQL, experience with GCP, Snowflake and other databases to extract the data and build data pipeline Experience with Power BI or other data visualization tools especially geo coded data is a big plus Bayesian statistics, propensity modelling also a big plus More ❯

You will be joining the Data Science and Engineering team to help get the most value out of our real-time data streams with a focus on elevating business decisions and ensuring genuine fans have the best opportunity to buy tickets. THE JOB We are seeking a skilled Data Engineering Manager to join and … lead our growing Data Engineering team and play a critical role in developing and maintaining our data infrastructure. As a member of the Data Science and Engineering leadership team, you will be key in driving the technical strategy and vision for data infrastructure, ensuring alignment with business objectives, and overseeing the delivery … of complex data-related projects. The ideal candidate will have a deep understanding of data platforms and tools, as well as experience designing and implementing data pipelines and ETL processes. WHAT YOU WILL BE DOING Lead the Data Engineering team in delivering high-quality data solutions that meet business needs More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical … solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Lead Data Engineer be Doing? You … will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to More ❯

Yum! Brands is seeking a highly skilled and experienced Senior Data Engineer to join our UK-based team. This role is ideal for someone with a strong background in data engineering who thrives in solving complex problems, building scalable data infrastructure, and collaborating across teams to drive data-driven decision-making. Key … Responsibilities Independently resolve a diverse range of complex data engineering problems where precedent may not exist. Apply sound judgment in evaluating and selecting methods to develop scalable data solutions. Design, build, and optimize data pipelines, architectures, and datasets to support business intelligence and advanced analytics. Create or significantly improve existing data solutions … processes, and tools to enhance data quality, reliability, and performance. Operate with minimal guidance on nearly all assignments; work is reviewed at critical milestones and upon completion. Serve as a mentor and technical resource for less experienced engineers. Collaborate with cross-functional teams including analytics, product, and engineering to deliver impactful data solutions. Represent the data More ❯

employees to work with artificial intelligence (AI). One of BCAI's many training offerings is the 18-month expert program, in which employees develop into experts in data engineering and data science. "In a few years, software competence will be standard for every engineer", says Máté. As part of the expert program, the group leader … is training to become a data engineer. A data engineer's job is to organize, cleanse and make data available to others for use in training an artificial intelligence, for example. "As a leader, I feel a responsibility to educate myself in the field and be a role model. I didn't know anything … test reports should be generated automatically. He is bringing this project into the advanced training program to become a data engineer. The idea: "The data pipeline begins with the collection, conversion and structured storage of raw data. By means of AI, relevant data is automatically printed in the report, which only needs to More ❯

walks of life and so do our people. We're a small but perfectly formed team, made up of insurance industry specialists alongside a diverse mix of technologists, data scientists and customer and marketing champions from all sorts of industries and backgrounds. We all bring our individual expertise, an appetite for innovation and a shared ambition to empower … Great Place to Work for the last five consecutive years. Sound good? Read on to find out more about joining our team KEY RESPONSIBILITIES As our Head of Data Platform, you will be instrumental in the successful migration of our existing Azure data warehouse to Google BigQuery, laying the foundation for a modern, scalable, and reliable … team of data engineers, fostering a culture of technical excellence and collaboration. Define and enforce best practices in data modelling, ETL/ELT processes, and pipeline monitoring. Work closely with stakeholders across analytics, pricing, operations, finance, and product to understand their data needs and ensure the platform meets them. Manage project timelines, risks More ❯

pipelines, automating workflows, and scaling cloud-based data infrastructure. Key Responsibilities: Design, build, and optimize data pipelines using Airflow, DBT, and Databricks. Monitor and improve pipeline performance to support real-time and batch processing. Manage and optimize AWS-based data infrastructure, including S3 and Lambda, as well as Snowflake. Implement best practices for … cost-efficient, secure, and scalable data processing. Enable … and optimize AWS SageMaker environments for ML teams. Collaborate with ML, Data Science, and Reporting teams to ensure seamless data accessibility. Implement data pipeline monitoring, alerting, and logging to detect failures and performance bottlenecks. Build automation to ensure data quality, lineage tracking, and schema evolution management. Participate in incident response, troubleshooting More ❯

combines expertise across clinical, technical, commercial, and operational domains. We're solving real problems for patients and health systems-and growing fast. ️ What You'll Do as a Data Engineer We're looking for a Data Engineer to play a key role in the next phase of our platform evolution. This is a hybrid role, with … your time split equally: 50% with the Data team, focusing on our analytics stack and the quality of data we ingest and produce. 50% with the Platform Engineering team, helping shape the backend systems that support safe, scalable healthcare delivery. Some things you'll do as a Data Engineer Architect and build scalable data … Data warehouse migration experience - Proven track record migrating large-scale systems (e.g., BigQuery Redshift) Infrastructure as Code - Experience with tools like Terraform Data Engineering: ELT pipeline mastery - Experience with tools like Fivetran, dataform, dbt, and Airflow for building reliable data workflows Custom integrations - Strong Python skills for building data ingestion from More ❯

AWS Data Architect Principal (Assembly, Bristol, United Kingdom) Recruiter: Daniel McCarthy Internal Closing Date: 18/08/25 About us BT Group was the worlds first telco and our heritage in the sector is unrivalled. As home to several of the UKs most recognised and cherished brands BT, EE, Openreach and Plusnet, we have always played a … time to join a company and leadership team with the skills, experience, creativity, and passion to take this company into a new era. Why this job matters The Data Engineering Principal leads the AWS design, building and implementation of processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning … the most complex business needs into the data that supports the DD Ops and BT groups data strategies. This role involves both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality, scalable, and efficient data infrastructure. What youll be doing your accountabilities Lead End-to-End Data More ❯

our success is a strong culture where people are encouraged to be present, bold, and curious, allowing them to achieve their individual goals. We are currently seeking a Data Analytics Architect based in Manchester on a full-time basis, reporting to the Head of Subsection for Data and Analytics . Responsibilities: Lead the design and implementation … of scalable data architecture supporting analytics and digitalization for MR Syndicate (MRSL) within a cross-functional team of architects from business and technology. Develop and maintain data models (logical and physical) to support business needs, ensuring data integrity and efficiency. Design and govern data architecture and integration standards across Azure Data Factory and Databricks to enable integrated analytics solutions. Support Munich Re's pillars for Data Governance, Metadata Management, MDM, Data Quality, Data Warehousing, Sourcing and Staging of data, BI, Advanced Analytics, and R&D, in close alignment with business functions and enterprise information management. Manage the Information Management framework, architecture More ❯

Norfolk St, Sheffield City Centre, Sheffield S1 2JE, UK • Job Description Posted Tuesday 1 July 2025 at 05:00 Department: Data & Insights Location: Sheffield or London Working Pattern: Hybrid, includes 3 days each week in the office Contact Type: Full time, permanent Tes is an international provider of software-enabled services passionate about using technology to make life … help provide valuable insights, improve decision-making leading us to deliver value where schools and teachers need it most. We are looking for a junior to mid-level Data Engineer to join our team and help us build and maintain our data infrastructure. Our Data Engineering team sits within the Data & Insights … team. Key Responsibilities: Design, develop, and implement data pipelines and data processing systems. Work alongside Data Analysts and Analytics Engineers to build and maintain data models and infrastructure. Delivering a platform that meets their and business stakeholder's needs. Take ownership of deploying your code and optimise data pipelines for More ❯

Job Title:Data Analyst Company: Genie Ventures Ltd Department: Genie Shopping Network Location: Flexible - Distributed with use ofCambridge officeand occasional travel Working Hours: Full Time 37.5 hours per week with flexible working arrangements Salary Range: £36,500 - £39,500 pa About Us Genie Shopping is into its next growth phaseand being part of the TEAM team is at … and team socials. There are requirements to travel to Cambridge once a month, with London (or other UK locations) once a month on average. Job Overview As a Data Analyst at Genie Shopping, you will play a crucial role in our continued growth and success within the performance marketing landscape. Genie Shopping is a leading European CSS, running … Genie Shopping team recognised as the "Best Team in Performance Marketing 2025" and "Great Places to Work 2024-25." In this role, you will analyse affiliate marketing data to track key commercial and performance metrics, verify data accuracy, and ensure this is reflected in our systems. Your responsibilities will include structuring reports, extracting data More ❯