376 to 400 of 724 Data Pipeline Jobs in the UK

Data Engineer We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business. What you’ll … be doing: -Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform. -Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge. -Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery. -Modernise legacy batch processes into stream-first architectures. -Build and integrate … and existing projects, balancing speed with resilience. -Take ownership of key pipelines and services, ensuring reliability, performance, and scalability. -Share best practices and mentor others in event-driven data engineering. What we’re looking for: -Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event More ❯

Data Engineer We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business. What you’ll … be doing: -Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform. -Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge. -Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery. -Modernise legacy batch processes into stream-first architectures. -Build and integrate … and existing projects, balancing speed with resilience. -Take ownership of key pipelines and services, ensuring reliability, performance, and scalability. -Share best practices and mentor others in event-driven data engineering. What we’re looking for: -Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event More ❯

Data Engineer We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business. What you’ll … be doing: -Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform. -Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge. -Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery. -Modernise legacy batch processes into stream-first architectures. -Build and integrate … and existing projects, balancing speed with resilience. -Take ownership of key pipelines and services, ensuring reliability, performance, and scalability. -Share best practices and mentor others in event-driven data engineering. What we’re looking for: -Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event More ❯

Data Engineer We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business. What you’ll … be doing: -Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform. -Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge. -Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery. -Modernise legacy batch processes into stream-first architectures. -Build and integrate … and existing projects, balancing speed with resilience. -Take ownership of key pipelines and services, ensuring reliability, performance, and scalability. -Share best practices and mentor others in event-driven data engineering. What we’re looking for: -Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event More ❯

solving, and hands-on contribution. The role involves Re-architecting an AWS environment that has grown inconsistently, addressing security, governance, and scalability. Designing and implementing distributed systems and data pipelines, with a focus on reliability and resilience. Working directly on code and infrastructure as code (around 50% of your time). Running proofs of concept to evaluate approaches … as Node.js, C#, or Java (currently use serverless architecture using Node.js and React). Understand SQL at a solid level, with broader experience across NoSQL and data pipeline design. Have experience with distributed systems or progressive web applications. Think carefully about problems, explore alternatives, and can explain the reasoning behind their choices. This role may suit someone … currently working as Lead Developer/Senior Software Engineer Lead DevOps Engineer Solutions Architect with hands-on coding experience Senior Data Engineer with strong AWS expertise Technical Lead in a small-to-medium software team It would particularly fit someone who enjoys combining practical engineering with higher-level architectural thinking, and who wants the space to solve technical More ❯

Data Engineer (Databricks) Location: London (Hybrid - 2 days onsite and 3 days from home ) Type: Permanent Note: No sponsorship available Represented by: Robert Half Limited Our client is a fast-growing tech business building a modern data platform. They're looking for a Data Engineer with strong Databricks skills to design, build, and optimise … scalable data pipelines and models that power analytics across the company. Key Skills: 3-5+ years as a Data Engineer Hands-on with Databricks, Spark, Python, SQL Cloud experience (Azure, AWS, or GCP) Strong understanding of data quality, governance, and security Nice to Have: Delta Lake, DBT, Snowflake, Terraform, CI/CD, or … You'll: Build and optimise ETL pipelines Enable analytics and reporting teams Drive automation and best practices Why Apply? Modern tech stack, fast-paced environment Direct impact on data strategy Quick 2-stage process + excellent benefits Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is More ❯

team on an initial 6-month contract. Key skills/knowledge required: Strong proficiency in Python-based testing frameworks (e.g., Behave, PyTest, unittest) Experience in automated testing of data pipelines and ETL processes Experience with data validation frameworks and testing data transformations across Snowflake and AWS environments Knowledge of API testing tools and frameworks … Postman, REST Assured, or similar) Hands-on experience testing OMS platform integrations (Aladdin, Murex, Charles River) and validating trade lifecycle data flows Experience integrating automated tests into CI/CD pipelines for continuous delivery Hands-on experience validating data accuracy and integrity across multiple systems Experience working embedded within cross-functional agile teams rather than separate … QA departments Strong problem-solving skills with ability to design effective test strategies for complex data workflows Ability to work collaboratively with engineers, delivery roles, and business stakeholders Knowledge of testing methodologies for data pipelines, APIs, and integrations Knowledge of data quality testing patterns and anomaly detection in capital markets data Understanding More ❯

Chief Data Officer - Your chance to lead every aspect of data, and value creation from data for a Insight solutions provider in the Media Industry. Your role will have responsibility particularly for data pipelines within the company, ensuring robust data governance and excellent data quality within the company. … In the first 2 years you will also take ultimate responsibility for a project team within the company focused on designing & delivering fresh and innovative data products to the market - particularly focusing on delivering products for major consumer brands driven by unique mobile data. You will be part of the companies leadership team, giving you an input into … overall strategic direction of the company, and report into the CEO. Contact us now to discuss this Chief Data Officer role in more detail. More ❯

Data Engineer (Databricks) Location: London (Hybrid – 2 days onsite and 3 days from home ) Type: Permanent Note: No sponsorship available Represented by: Robert Half Limited Our client is a fast-growing tech business building a modern data platform. They’re looking for a Data Engineer with strong Databricks skills to design, build, and optimise … scalable data pipelines and models that power analytics across the company. Key Skills: 3–5+ years as a Data Engineer Hands-on with Databricks, Spark, Python, SQL Cloud experience (Azure, AWS, or GCP) Strong understanding of data quality, governance, and security Nice to Have: Delta Lake, DBT, Snowflake, Terraform, CI/CD, or DevOps … You’ll: Build and optimise ETL pipelines Enable analytics and reporting teams Drive automation and best practices Why Apply? Modern tech stack, fast-paced environment Direct impact on data strategy Quick 2-stage process + excellent benefits More ❯

Data Engineer (Databricks) Location: London (Hybrid – 2 days onsite and 3 days from home ) Type: Permanent Note: No sponsorship available Represented by: Robert Half Limited Our client is a fast-growing tech business building a modern data platform. They’re looking for a Data Engineer with strong Databricks skills to design, build, and optimise … scalable data pipelines and models that power analytics across the company. Key Skills: 3–5+ years as a Data Engineer Hands-on with Databricks, Spark, Python, SQL Cloud experience (Azure, AWS, or GCP) Strong understanding of data quality, governance, and security Nice to Have: Delta Lake, DBT, Snowflake, Terraform, CI/CD, or DevOps … You’ll: Build and optimise ETL pipelines Enable analytics and reporting teams Drive automation and best practices Why Apply? Modern tech stack, fast-paced environment Direct impact on data strategy Quick 2-stage process + excellent benefits More ❯

Data Engineer (Databricks) Location: London (Hybrid – 2 days onsite and 3 days from home ) Type: Permanent Note: No sponsorship available Represented by: Robert Half Limited Our client is a fast-growing tech business building a modern data platform. They’re looking for a Data Engineer with strong Databricks skills to design, build, and optimise … scalable data pipelines and models that power analytics across the company. Key Skills: 3–5+ years as a Data Engineer Hands-on with Databricks, Spark, Python, SQL Cloud experience (Azure, AWS, or GCP) Strong understanding of data quality, governance, and security Nice to Have: Delta Lake, DBT, Snowflake, Terraform, CI/CD, or DevOps … You’ll: Build and optimise ETL pipelines Enable analytics and reporting teams Drive automation and best practices Why Apply? Modern tech stack, fast-paced environment Direct impact on data strategy Quick 2-stage process + excellent benefits More ❯

Data Engineer (Databricks) Location: London (Hybrid – 2 days onsite and 3 days from home ) Type: Permanent Note: No sponsorship available Represented by: Robert Half Limited Our client is a fast-growing tech business building a modern data platform. They’re looking for a Data Engineer with strong Databricks skills to design, build, and optimise … scalable data pipelines and models that power analytics across the company. Key Skills: 3–5+ years as a Data Engineer Hands-on with Databricks, Spark, Python, SQL Cloud experience (Azure, AWS, or GCP) Strong understanding of data quality, governance, and security Nice to Have: Delta Lake, DBT, Snowflake, Terraform, CI/CD, or DevOps … You’ll: Build and optimise ETL pipelines Enable analytics and reporting teams Drive automation and best practices Why Apply? Modern tech stack, fast-paced environment Direct impact on data strategy Quick 2-stage process + excellent benefits More ❯

Data Engineer (Databricks) Location: London (Hybrid – 2 days onsite and 3 days from home ) Type: Permanent Note: No sponsorship available Represented by: Robert Half Limited Our client is a fast-growing tech business building a modern data platform. They’re looking for a Data Engineer with strong Databricks skills to design, build, and optimise … scalable data pipelines and models that power analytics across the company. Key Skills: 3–5+ years as a Data Engineer Hands-on with Databricks, Spark, Python, SQL Cloud experience (Azure, AWS, or GCP) Strong understanding of data quality, governance, and security Nice to Have: Delta Lake, DBT, Snowflake, Terraform, CI/CD, or DevOps … You’ll: Build and optimise ETL pipelines Enable analytics and reporting teams Drive automation and best practices Why Apply? Modern tech stack, fast-paced environment Direct impact on data strategy Quick 2-stage process + excellent benefits More ❯

for a highly skilled and motivated Snowflake Developer to join our client's team. The ideal candidate will have extensive experience with Snowflake and a strong background in data modeling, SQL, and Python. You will be responsible for designing, developing, and maintaining our data infrastructure to support various data-driven initiatives. Role: Snowflake Developer … Date: ASAP Note: This role does not provide any visa sponsorship. Looking for candidates who do not require any visa sponsorship. What You'll Do: Design and build data pipelines using Snowflake. Write and optimize complex SQL queries. Develop and manage Dimensional Data Models. Use Python for scripting and data automation. Collaborate with stakeholders … to deliver data-driven solutions. Required Skills: Snowflake ANSI-SQL Dimensional Data Modeling Python Experience with Gitlab Bonus Points: Knowledge of data science and machine learning Experience in the finance industry Familiarity with Power BI Knowledge of SQL Server or Oracle If you're ready to take your skills to the next level and More ❯

for a highly skilled and motivated Snowflake Developer to join our client's team. The ideal candidate will have extensive experience with Snowflake and a strong background in data modeling, SQL, and Python. You will be responsible for designing, developing, and maintaining our data infrastructure to support various data-driven initiatives. Role: Snowflake Developer … Date: ASAP Note: This role does not provide any visa sponsorship. Looking for candidates who do not require any visa sponsorship. What You'll Do: Design and build data pipelines using Snowflake. Write and optimize complex SQL queries. Develop and manage Dimensional Data Models. Use Python for scripting and data automation. Collaborate with stakeholders … to deliver data-driven solutions. Required Skills: Snowflake ANSI-SQL Dimensional Data Modeling Python Experience with Gitlab Bonus Points: Knowledge of data science and machine learning Experience in the finance industry Familiarity with Power BI Knowledge of SQL Server or Oracle If you're ready to take your skills to the next level and More ❯

for a highly skilled and motivated Snowflake Developer to join our client's team. The ideal candidate will have extensive experience with Snowflake and a strong background in data modeling, SQL, and Python. You will be responsible for designing, developing, and maintaining our data infrastructure to support various data-driven initiatives. Role: Snowflake Developer … Date: ASAP Note: This role does not provide any visa sponsorship. Looking for candidates who do not require any visa sponsorship. What You'll Do: Design and build data pipelines using Snowflake. Write and optimize complex SQL queries. Develop and manage Dimensional Data Models. Use Python for scripting and data automation. Collaborate with stakeholders … to deliver data-driven solutions. Required Skills: Snowflake ANSI-SQL Dimensional Data Modeling Python Experience with Gitlab Bonus Points: Knowledge of data science and machine learning Experience in the finance industry Familiarity with Power BI Knowledge of SQL Server or Oracle If you're ready to take your skills to the next level and More ❯

for a highly skilled and motivated Snowflake Developer to join our client's team. The ideal candidate will have extensive experience with Snowflake and a strong background in data modeling, SQL, and Python. You will be responsible for designing, developing, and maintaining our data infrastructure to support various data-driven initiatives. Role: Snowflake Developer … Date: ASAP Note: This role does not provide any visa sponsorship. Looking for candidates who do not require any visa sponsorship. What You'll Do: Design and build data pipelines using Snowflake. Write and optimize complex SQL queries. Develop and manage Dimensional Data Models. Use Python for scripting and data automation. Collaborate with stakeholders … to deliver data-driven solutions. Required Skills: Snowflake ANSI-SQL Dimensional Data Modeling Python Experience with Gitlab Bonus Points: Knowledge of data science and machine learning Experience in the finance industry Familiarity with Power BI Knowledge of SQL Server or Oracle If you're ready to take your skills to the next level and More ❯

Machine Learning Engineer Salary: £55,00 - £60,000 Location: London - Hybrid - 2 days We are currently looking for a Machine Learning Engineer to join our client's data team. This is a hands-on role where you'll design and build robust data pipelines, transform ML prototypes into production-ready systems, and champion MLOps best practices … across the business. As a Machine Learning Engineer, you'll play a crucial role in ensuring our clients' data and AI strategy scales effectively, directly influencing the way millions of people engage with their products every day. The Opportunity This is a unique chance to combine data engineering with machine learning in a high-impact environment. … You'll work closely with analysts, data engineers and stakeholders, ensuring models are reliable, scalable, and production-ready. Unlike many roles in the tech sector, this Machine Learning Engineer role gives you the visibility of seeing your work applied at scale, powering decision-making and user experiences for a vast audience. Your day-to-day will include: Building More ❯

We are searching for a Data Analyst/GIS Analyst for an extremely exciting technology and data focused business. The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore need to live within a commutable distance of … that underpin various digital products and services. You will ensure the quality of these datasets and provide support to the wider business. You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success! Working as a Data Analyst/GIS … with the ability to plan, allocate and manage workloads for yourself and other team members. You will also have the following: - A qualification in either a GIS or Data related discipline or equivalent professional experience. Practical experience of working in a data analysis role, a data curation role or a data focused More ❯

table creation SAS Studio V and SAS RTENG to build the SA registration network SAS Viya 3.5 tools for risk assessment of new SA registrations. The POC leveraged data from 20 different sources, most of which were already housed in the Minerva Oracle database. Previously, some data had to be transferred manually. However, the automated file … transfers described in this Solution Design Document (SDD) will now move that data to the SAS platform using approved Enterprise Architecture (EA) integration patterns, with the initial phase, targeted for delivery in April 2026. This role will form part of a new scrum team within Minerva Platfrom to develop and deliver the Ingestion and Risking within the SAS … Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support Business Intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile More ❯

Data Engineer - AI/ML | Leading Pharma | London (Hybrid) My client a leading pharmaceutical company is looking for a Data Engineer who thrives on solving complex challenges and building scalable data solutions that power scientific innovation. Key Responsibilities Build and maintain data pipelines using Python, Spark, SQL, BigQuery , and Google Cloud Collaborate … with scientists to meet research data needs Ensure high-quality, well-documented, and tested code Improve performance metrics and integrate data across teams Requirements Essential: Experience in data engineering Strong Python & SQL skills Experience with Google Cloud or similar Familiarity with unit testing , Git , and Agile Desirable: Experience with bioinformatics or scientific datasets Knowledge More ❯

Data Engineer - AI/ML | Leading Pharma | London (Hybrid) My client a leading pharmaceutical company is looking for a Data Engineer who thrives on solving complex challenges and building scalable data solutions that power scientific innovation. Key Responsibilities Build and maintain data pipelines using Python, Spark, SQL, BigQuery , and Google Cloud Collaborate … with scientists to meet research data needs Ensure high-quality, well-documented, and tested code Improve performance metrics and integrate data across teams Requirements Essential: Experience in data engineering Strong Python & SQL skills Experience with Google Cloud or similar Familiarity with unit testing , Git , and Agile Desirable: Experience with bioinformatics or scientific datasets Knowledge More ❯

Proven success scaling security operations across geographies Exceptional analytical and decision-making abilities during BAU and incidents. Strong technical ability to understand and manage security tooling, integrations, and data pipelines. Core Values Love what you do: We show up each day ready to take on the world. Our passion and intensity set us apart and makes the difference More ❯

per day inside ir35 Clearance Required: SC Duration: 6 months Location: Telford/hybrid (2days per week in the office) Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross … functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS for More ❯

per day inside ir35 Clearance Required: SC Duration: 6 months Location: Telford/hybrid (2days per week in the office) Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross … functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS for More ❯