401 to 425 of 1,138 Data Pipeline Jobs in the UK excluding London

Senior Data Engineer – Assistant Manager Base Location: Leeds based (Hybrid – 3 days per week in office) https://kpmg.com/uk/en/about/offices.html As a result of the work that we do, we require applicants to hold or be capable of obtaining UK National Security Vetting, the requirements for which could include but … for the future of the planet or everything in-between. In a world where tech is always changing, so are we. Why Join KPMG Curve as a Senior Data Engineer Progression at pace. Innovation, led by constant learning. Work that excites you with every twist and turn. It all starts at KPMG Curve. Here, you’ll progress your … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline To discuss this or wider Technology roles with our recruitment team, all you need to do is apply, create a profile, upload your CV and begin to make your More ❯

Data Engineer Bolton- Hybrid £45,000 - £55,000 (dependent on experience) We're looking for a Data Engineer experienced in Generative AI to join our growing international and cross functional client. In this role, you'll be responsible for evaluating, building, and maintaining high quality data sets that support their internal stakeholders across the … business. You'll play a key part in ensuring data pipelines are secure, reliable, and scalable. Data Engineer Duties: Design, develop, and maintain robust data pipelines and architectures. Evaluate, build, and optimise data sets for internal customers. Ensure data systems comply with governance and security standards. Collaborate with internal teams … to understand data needs and deliver effective solutions. Stay ahead of emerging data and AI technologies, contributing to our innovation roadmap. Support the integration of generative AI capabilities into existing systems. As a Data Engineer, you will have: Strong experience with SQL (e.g., MS SQL, Oracle). Knowledge of NoSQL technologies (e.g., MongoDB, InfluxDB More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

Analytics Engineer London (onsite) | Full-Time, Permanent We're on an exciting data transformation journey and are looking for a skilled Analytics Engineer to join our growing data team. In this role, you'll help design and implement scalable, high-performance data infrastructure using the modern data stack, including Azure Databricks , Azure … Data Factory , dbt , SQL , Python , and Power BI . You'll act as the bridge between data engineering and analytics-building robust data models, automated pipelines, and self-service tools that drive decision-making across the business. This is a hands-on technical role with real impact. You'll collaborate with engineers, analysts, and … stakeholders to deliver clean, trusted, and accessible data. Key Responsibilities: Develop and maintain data pipelines using Databricks and ADF Create dimensional models and transformation workflows using dbt Implement automated data quality checks and monitoring systems Empower business users through self-service analytics using Power BI Document technical processes and uphold coding standards Collaborate with cross-functional More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

We are seeking a talented and motivated Data Engineer to join our IT department, focusing on Business Intelligence, you will play a crucial role in designing and building infrastructure to support the extraction, transformation, and loading (ETL) of data from various sources. This is an exciting opportunity to work with cutting-edge analytical tools and ensure … the stability and performance of our data pipelines. Candidates should have demonstratable experience in an IT role. Key Responsibilities Design, maintain, and configure data pipelines, platforms, and sources. Integrate and validate new software and technical solutions. Monitor and ensure the stability and performance of data pipelines. Provide technical leadership to deliver innovative solutions. Collaborate … with partners and business owners to address data quality issues. Support existing business systems and BI via the Service Desk as needed. About You You possess strong capabilities in data management and in delivering data solutions that meet business requirements. You are proactive, detail-oriented, and able to challenge preconceived solutions while maintaining awareness More ❯

Data Analyst (BI & SQL) Up to £50K plus benefits Birmingham Role Summary We are seeking a skilled and motivated SQL Analyst. In this role, you will play a vital part in analysing, creating, implementing, and maintaining data infrastructure, ensuring the seamless operation of corporate IT systems. This is a unique opportunity to contribute to our journey … of innovation, efficiency, and customer excellence. Core Duties Design, implement, and maintain on-prem and cloud data infrastructure to support IT services. Administer corporate databases, including maintenance, upgrades, and monitoring for resilience and efficiency. Develop and implement data pipelines for data warehousing and analytics requirements. Perform database administration tasks such as user management, backups … APIs and web services. Experience Required In-depth knowledge of Microsoft SQL Server (2017 and above), including SSMS, SSRS, SSAS, SSIS, and SQL scripting. Expertise in database development, data cubes, and data marts. Proficiency with data visualisation tools like Power BI, Tableau, or SAP BusinessObjects. Familiarity with cloud data services such as More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to streamline … operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through … through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data More ❯

Lead Automation & Data Engineer Build the Digital Backbone of a Growing Business The Opportunity My client are a profitable company targeting significant revenue growth while maintaining operational excellence and margin expansion. Currently, many of their processes are manual and labour-intensive, which limits scalability and introduces delivery risk. They're investing in automation and ERP integration to streamline … operations, reduce overhead, and enable seamless data flows across the enterprise. Their vision is to automate core back-office processes, integrate systems for scalability, and position themselves as a digitally enabled leader in their sector. This is a hands-on technical leadership role where you'll own the entire automation and data platform from design through … through processing Own technical assets such as scripts, libraries, and run-books, ensuring robust exception handling Partner with Operations and Finance to embed new workflows and drive adoption Data Integration & Warehousing Own the design and build of our operational data stack (ingestion → transformation → warehousing) to support automation, analytics, and reporting Develop robust, reusable data More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of … years of experience in solution architecture and design governance, ideally in financial services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of … years of experience in solution architecture and design governance, ideally in financial services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be More ❯