201 to 225 of 1,010 Data Pipeline Jobs in the UK excluding London

Senior Data Engineer Hybrid - Birmingham (2 days per week in office) Salary: Up to £65k Permanent We are partnering with a forward-thinking, public sector organisation currently undergoing a major data and digital transformation. They are seeking a Senior Data Engineer to play a pivotal role in developing and maintaining a modern, cloud-based … data platform that underpins critical regulatory and strategic objectives. This is an exciting opportunity to work with cutting-edge Microsoft technologies and contribute to the creation of a secure, scalable, and insight-driven data ecosystem that supports the organisation’s mission to deliver better outcomes for customers, communities, and the environment. What You’ll Be Doing … As a Senior Data Engineer, you’ll take a hands-on role in building and optimising data services across both modern and legacy platforms. Key responsibilities include: Developing, maintaining, and optimising data pipelines and ELT processes using Microsoft Fabric, Azure Data Factory, Synapse, Purview, and Power BI. Designing and implementing scalable and More ❯

Senior Data Engineer Hybrid - Birmingham (2 days per week in office) Salary: Up to £65k Permanent We are partnering with a forward-thinking, public sector organisation currently undergoing a major data and digital transformation. They are seeking a Senior Data Engineer to play a pivotal role in developing and maintaining a modern, cloud … based data platform that underpins critical regulatory and strategic objectives. This is an exciting opportunity to work with cutting-edge Microsoft technologies and contribute to the creation of a secure, scalable, and insight-driven data ecosystem that supports the organisation s mission to deliver better outcomes for customers, communities, and the environment. What You ll Be … Doing: As a Senior Data Engineer, you ll take a hands-on role in building and optimising data services across both modern and legacy platforms. Key responsibilities include: Developing, maintaining, and optimising data pipelines and ELT processes using Microsoft Fabric, Azure Data Factory, Synapse, Purview, and Power BI. Designing and implementing scalable More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues … in data transformations and data loading processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues … in data transformations and data loading processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues … in data transformations and data loading processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform More ❯

Data EngineerLeicester£65,000 to £75,000Permanent I am currently looking for a Data Engineer to join a forward-thinking organisation, where you will play a pivotal role in building a modern, enterprise-scale data platform. Data Engineer - What will you be doing? * Designing and implementing modern data architectures including … lakehouse and medallion models using Azure and Databricks.* Developing, maintaining, and optimising data pipelines, quality validation tools, and lineage tracking systems to guarantee high-quality data outputs.* Manage MS SQL and Azure SQL databases efficiently while ensuring optimal performance across all environments.* Utilising Azure Data Factory, Python, and other tools to build efficient ETL … enterprise environments.* Power BI experience.* Deep understanding of SQL.* Experience with Azure and Databricks.* Proficient Python programming skills.* Demonstrated ability to design lakehouse architectures.* Experience implementing CI/CD pipeline management for reliable solution delivery. Robert Walters are proud to specialise in BI & Data recruitment across the UK, offering amazing opportunities on a permanent and interim basis. More ❯

Job Title: Senior Data Engineer Base Location: London OR Glasgow based (Hybrid – 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting edge solutions across … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There’s the buzz of … high-profile projects of a major corporate entity. Crucially, we also offer the benefit of clear career progression. What will you be doing? We are seeking a Senior Data Engineer with strong experience in Cloud data platforms, API integration, and modern data engineering tools to help deliver our Tax & Legal data and More ❯

Job Title: Senior Data Engineer Base Location: London OR Glasgow based (Hybrid – 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting edge solutions across … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There’s the buzz of … high-profile projects of a major corporate entity. Crucially, we also offer the benefit of clear career progression. What will you be doing? We are seeking a Senior Data Engineer with strong experience in Cloud data platforms, API integration, and modern data engineering tools to help deliver our Tax & Legal data and More ❯

Job Title: Senior Data Engineer Base Location: London OR Glasgow based (Hybrid – 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting edge solutions across … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There’s the buzz of … high-profile projects of a major corporate entity. Crucially, we also offer the benefit of clear career progression. What will you be doing? We are seeking a Senior Data Engineer with strong experience in Cloud data platforms, API integration, and modern data engineering tools to help deliver our Tax & Legal data and More ❯

Senior Data Engineer (Databricks) Location: London (Hybrid) Rate: Negotiable, depending on experience Duration: 6 months (initial)We’re looking for a Senior Data Engineer (Databricks) to join a world-leading energy organisation on a key transformation programme within their trading and supply division. This is an exciting opportunity to play a pivotal role in building modern … scalable data solutions using Azure cloud technologies. The Role As a Senior Data Engineer, you’ll be responsible for designing and developing robust data foundations and end-to-end solutions that drive value across the business. You’ll help shape and embed data-driven thinking across both technical and business teams, ensuring … the organisation continues to lead with insight and innovation.You’ll act as a subject matter expert, guiding technical decisions, mentoring junior engineers, and ensuring data engineering best practices are consistently applied. Key Responsibilities Design and build data solutions aligned with business and IT strategy. Lead development of scalable data pipelines and models using Azure More ❯

About Apexon: Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to … Sachs Asset Management and Everstone Capital, Apexon now has a global presence. About the Role We are seeking a highly motivated and experienced AI Engineer to join our Data and AI team . This role is ideal for someone who has a strong track record of designing, developing, and deploying AI/ML solutions in a business context … channels for our Financial Services client. Key Responsibilities End-to-End AI Solution Delivery: Lead AI/ML initiatives from conceptual design to production deployment, including problem scoping, data acquisition, model development, validation, deployment, and monitoring. AI-Driven Marketing Insights: Develop predictive and generative models to support audience segmentation, personalization, channel optimization, lead scoring, and campaign measurement. Collaborative More ❯

About Apexon: Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to … Sachs Asset Management and Everstone Capital, Apexon now has a global presence. About the Role We are seeking a highly motivated and experienced AI Engineer to join our Data and AI team . This role is ideal for someone who has a strong track record of designing, developing, and deploying AI/ML solutions in a business context … channels for our Financial Services client. Key Responsibilities End-to-End AI Solution Delivery: Lead AI/ML initiatives from conceptual design to production deployment, including problem scoping, data acquisition, model development, validation, deployment, and monitoring. AI-Driven Marketing Insights: Develop predictive and generative models to support audience segmentation, personalization, channel optimization, lead scoring, and campaign measurement. Collaborative More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting, and business intelligence initiatives, while influencing the evolution of the … organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with future opportunities to take on leadership and line management responsibilities as the team grows. Collaborate with technical and … business stakeholders to capture clear and actionable requirements using techniques such as data models, data flows, report specifications, and wireframes. Partner with the Data Engineering and BI teams to define and implement robust data pipelines, reporting solutions, and analytical models that support strategic decision-making and operational efficiency. Analyse data More ❯

A leading global investment firm is looking for a Data Support Engineer to join a high-impact team supporting quantitative researchers and traders. This is a fantastic opportunity to work in a fast-paced, data-driven environment where technology and research are at the heart of the business. You'll play a key role in ensuring … the smooth operation of data systems, supporting users across the business, and contributing to the ongoing development of a world-class data platform. Responsibilities Act as the first point of contact for researchers and traders needing support with data access, usage, and tooling. Troubleshoot and resolve data-related issues in collaboration with … data engineering teams. Onboard new users and provide training on internal data tools and best practices. Maintain and improve internal documentation to ensure clarity and consistency across the platform. Manage support workflows using tools like JIRA, ensuring timely resolution of requests. Contribute to expanding data coverage, including live data collection and historical More ❯

A leading global investment firm is looking for a Data Support Engineer to join a high-impact team supporting quantitative researchers and traders. This is a fantastic opportunity to work in a fast-paced, data-driven environment where technology and research are at the heart of the business. You'll play a key role in ensuring … the smooth operation of data systems, supporting users across the business, and contributing to the ongoing development of a world-class data platform. Responsibilities Act as the first point of contact for researchers and traders needing support with data access, usage, and tooling. Troubleshoot and resolve data-related issues in collaboration with … data engineering teams. Onboard new users and provide training on internal data tools and best practices. Maintain and improve internal documentation to ensure clarity and consistency across the platform. Manage support workflows using tools like JIRA, ensuring timely resolution of requests. Contribute to expanding data coverage, including live data collection and historical More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

Senior Data Scientists/Analysts – SC/DV Cleared – (Military/Veteran-Friendly) — Multiple Openings 🌳 Location: London (Remote & Hybrid options) 🌳 Employment: Permanent 🌳 Clearance: Current SC or DV required 🌳 Make sense of mission-critical data that actually drives decisions. 🌳 Areti Group is partnering with one of the UK’s fastest-growing Series A-funded tech start-ups … to hire multiple Senior Data Scientists & Data Analysts . You’ll help deliver secure, high-impact analytics platforms for Defence, National Security, and Government projects. 🌳 Perfect for ex-Forces engineers (RAF, Army, Navy) or civilians who’ve worked in high-trust, high-stakes environments and want to use data science at scale . 🌳 What … you’ll do 🌳 Build and deploy machine learning models to solve real-world problems. Design data pipelines, analytics APIs, and decision dashboards used by senior stakeholders. Apply modern data science, AI, and big data techniques to defence and security missions. Deliver secure-by-design, production-grade analytics platforms for sensitive environments. Collaborate across engineering More ❯

An established health and wellbeing organisation is expanding its data function and seeking a hands-on Data Engineer to help develop and maintain robust data infrastructure. Youll work on a wide range of projects supporting analytics, reporting and client delivery. Key responsibilities Design, build and maintain reliable data pipelines and integrations across … multiple systems. Develop and optimise data models to support reporting, dashboards and KPIs. Build and maintain Power BI dashboards and automated data flows. Collaborate with product, engineering and business teams to deliver high-quality, usable data. Support the development of a centralised data warehouse and data lake. Uphold data quality … governance and documentation standards. Tech environment SQL Server, Azure Data Platform, Power BI, Azure Fabric, Cosmos DB, APIs, and third-party integrations. Profile Strong SQL and data modelling experience. Proven background in data engineering within Microsoft-based environments. Comfortable interpreting and transforming large, complex data sets. Clear communicator who can explain data More ❯

Job Title: Airflow/AWS Data Engineer Location: Manchester Area (3 days per week in the office) Rate: Up to £400 per day inside IR35 Start Date: 03/11/2025 Contract Length: Until 31st December 2025 Job Type: Contract Company Introduction: An exciting opportunity has become available with one of our sector-leading financial services clients. … resource optimization for Airflow workers and AWS resources. Manage integrations with source control systems (GitHub, GitLab) and CI/CD pipelines. Collaborate with AWS teams and internal stakeholders for pipeline scalability and optimization. Design and implement process improvements, including automation, data delivery optimization, and infrastructure re-design. Develop ETL pipelines and data workflows using AWS … and tools like Jenkins, GitHub Actions, or GitLab CI. Solid understanding of containerization technologies (Docker, Kubernetes). Working knowledge of Python and SQL for automation and data pipeline development. Familiarity with monitoring and observability tools (Grafana, Prometheus, CloudWatch). Strong grasp of data architecture principles and ETL design patterns. Financial services or regulated industry experience More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and … build next-generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data … technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯