201 to 225 of 338 Data Pipeline Jobs in the UK excluding London

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

codebase. Key Responsibilities Lead the design, development, and testing of secure, scalable systems using Python or Java with modern front-end frameworks (e.g., React) Architect and maintain APIs, data pipelines, and cloud-native solutions (AWS, Azure, private cloud) Drive adoption of DevOps practices CI/CD, containers, infrastructure-as-code Guide and mentor engineers, promoting best practice, clean More ❯

codebase. Key Responsibilities Lead the design, development, and testing of secure, scalable systems using Python or Java with modern front-end frameworks (e.g., React) Architect and maintain APIs, data pipelines, and cloud-native solutions (AWS, Azure, private cloud) Drive adoption of DevOps practices CI/CD, containers, infrastructure-as-code Guide and mentor engineers, promoting best practice, clean More ❯

codebase. Key Responsibilities Lead the design, development, and testing of secure, scalable systems using Python or Java with modern front-end frameworks (e.g., React) Architect and maintain APIs, data pipelines, and cloud-native solutions (AWS, Azure, private cloud) Drive adoption of DevOps practices CI/CD, containers, infrastructure-as-code Guide and mentor engineers, promoting best practice, clean More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about … data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:**- Develop and maintain AWS data pipelines and infrastructure.- Collaborate with cross-functional teams to design data solutions.- Optimise existing data processes for efficiency and performance.- Ensure data quality and security standards are met.- Stay up … to-date with AWS developments and best practices.**Key Requirements:**- Proven experience with AWS services and tools.- Strong knowledge of data modeling and ETL processes.- Proficiency in programming languages such as Python or SQL.- Excellent problem-solving skills with a proactive approach.- Ability to communicate effectively within a team.If you are a skilled and driven AWS Data More ❯

in technical decision-making, mentoring, and shaping best practice within the engineering team. Key responsibilities Full stack development using Node.js, TypeScript and React Build and maintain APIs, microservices, data pipelines and integrations with third-party systems Develop React components with SSR (Next.js) and Storybook Architect solutions covering databases, cloud infrastructure and user-facing applications Optimise for speed, scalability More ❯

using FastAPI and integrate with external systems. Deploy scalable AI systems using AWS (Lambda, S3, SQS, EKS/ECS), CDK , and modern DevOps practices. Collaborate on infrastructure and data pipelines using SQLAlchemy, Boto3, Pandas, and Airflow . Contribute to real-time AI services , model versioning, and advanced fine-tuning (LoRA, QLoRA, etc.). AI Engineer requirements: Solid Python More ❯

OCR Leveraging frameworks like Hugging Face Transformers , PyTorch , YOLO , OpenCV , and Pillow Designing and deploying AI services via FastAPI , AWS Lambda , EKS/ECS , and S3 Creating scalable data pipelines with Pandas , NumPy , SQLAlchemy , and Airflow Supporting real-time model inference, edge deployments, and API integrations Working closely with a technical lead in a service-based and serverless More ❯

integration strategies across partner systems and data platforms. Ensure systems meet AML, KYC, and sanctions compliance standards. Provide leadership on upgrades, API integrations, and data pipeline enhancements. Mentor engineering teams and support vendor evaluations. Qualifications 10+ years of experience with compliance screening technologies (FIRCO, Prime Compliance Manager, Quantexa). Strong cloud expertise (Azure preferred) and … hybrid deployment knowledge. Proficiency in programming/scripting for integration and automation. Experience with DataBricks, Snowflake, or similar data platforms. Deep understanding of financial services compliance requirements. Preferred Advanced degree in Computer Science, Engineering, or related field. Cloud architecture certifications (Azure preferred). Background in regulatory reporting, API management, or performance tuning. More ❯

team on an initial 6-month contract. Key skills/knowledge required: Strong proficiency in Python-based testing frameworks (e.g., Behave, PyTest, unittest) Experience in automated testing of data pipelines and ETL processes Experience with data validation frameworks and testing data transformations across Snowflake and AWS environments Knowledge of API testing tools and frameworks … Postman, REST Assured, or similar) Hands-on experience testing OMS platform integrations (Aladdin, Murex, Charles River) and validating trade lifecycle data flows Experience integrating automated tests into CI/CD pipelines for continuous delivery Hands-on experience validating data accuracy and integrity across multiple systems Experience working embedded within cross-functional agile teams rather than separate … QA departments Strong problem-solving skills with ability to design effective test strategies for complex data workflows Ability to work collaboratively with engineers, delivery roles, and business stakeholders Knowledge of testing methodologies for data pipelines, APIs, and integrations Knowledge of data quality testing patterns and anomaly detection in capital markets data Understanding More ❯

We are searching for a Data Analyst/GIS Analyst for an extremely exciting technology and data focused business. The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore need to live within a commutable distance of … that underpin various digital products and services. You will ensure the quality of these datasets and provide support to the wider business. You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success! Working as a Data Analyst/GIS … with the ability to plan, allocate and manage workloads for yourself and other team members. You will also have the following: - A qualification in either a GIS or Data related discipline or equivalent professional experience. Practical experience of working in a data analysis role, a data curation role or a data focused More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

design, documentation (OpenAPI/Swagger), and integration with external partners Hands-on coding in C# .NET or Python (with opportunities to explore Node.js/Java) Building and optimising data pipelines and cloud applications CI/CD automation in a modern DevOps environment Opportunities to work with IoT and containerisation (Docker/Kubernetes) What's in it for you More ❯

projects for government and defence clients, using the latest tools and techniques to solve real-world problems. ?? What You'll Do: Design, build, and test powerful backend systems, data pipelines, and web apps. Work in small, agile teams using DevOps best practices. Deploy to cloud environments like AWS and Azure. Own the full software lifecycle-from concept to More ❯

projects for government and defence clients, using the latest tools and techniques to solve real-world problems. What You'll Do: Design, build, and test powerful backend systems, data pipelines, and web apps. Work in small, agile teams using DevOps best practices. Deploy to cloud environments like AWS and Azure. Own the full software lifecycle-from concept to More ❯

Robert Half has partners with a Financial Services Organisation in London and they are looking for a Data Engineer to join their IT team. This role is a great opportunity for someone who is in the early stages of their career looking to gain lots of experience and lots of progression. This will give you the ability to … gain experience in Data Engineering and Data Science. Role: They are looking to hire a Data Engineer with 1+ years experience inc: Data Pipelines Implementing solutions to engineering issues Python SQL Power BI Role: Data Engineer Salary: £35,000 - £50,000 plus bonus and benefits Location: London (3 days a … are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: gb/en/privacy-notice. More ❯

teams. Cloud Services: Experience with cloud platforms like AWS, GCP, or Azure. DevOps Tools: Familiarity with containerization (Docker) and infrastructure automation tools like Terraform or Ansible. Real-time Data Streaming: Experience with Apache Pulsar or similar systems for real-time messaging and stream processing is a plus. Data Engineering: Experience with Apache Spark, Databricks, or similar … big data platforms for processing large datasets, building data pipelines, and machine learning workflows. Workflow Orchestration: Familiarity with tools like Apache Airflow or Temporal for managing workflows and scheduling jobs in distributed systems. Stream Processing: Experience with Apache Flink or other stream processing frameworks is a plus. Desired Skills Asynchronous Programming: Familiarity with asynchronous programming tools More ❯

Job Title: Data Engineer Job Description We are seeking a skilled Data Engineer to join an existing Market Access project. You will play a key part in building scalable data solutions that empower market readiness. 3 months initial contract Remote working ( UK based) Inside IR35 Responsibilities Design, develop, and maintain data pipelines … using Palantir Foundry, PySpark, and TypeScript. Collaborate with cross-functional teams to integrate data sources and ensure data quality and consistency. Implement robust integration and unit testing strategies to validate data workflows. Engage with business stakeholders to understand requirements and translate them into technical solutions. Contribute to product-oriented thinking and help shape the … data engineering roadmap. Essential Skills Strong experience with Palantir Foundry. Proficiency in TypeScript and PySpark. Understanding of data integration and unit testing practices. Excellent communication skills and ability to work with non-technical stakeholders. Additional Skills & Qualifications Experience with OpenTelemetry is desired and beneficial but not needed Location Bracknell, UK Trading as TEKsystems. Allegis Group Limited More ❯

Technical Business Analyst, SC Cleared We are seeking a highly skilled Technical Business Analyst with over 8 years of experience to support the evolution of enterprise modern cloud data platform used for ingesting and processing large volumes of streaming and batch data sets to support analytically and AI use-case. As a key interface between the … technical and business stakeholders, you will be responsible for translating data engineering, architectural and analytically requirements into detailed, actionable user stories with clear audit tracking and version control. Key Responsibilities Collaborate with Data Architects, Engineering teams, Security, Product teams and business stakeholders to gather, analyse, and translate their needs into clear and technically sound requirements. Facilitate … with stakeholders to mitigate issues. Champion agile practices, facilitating sprint planning and retrospectives where needed. Key Skills 8+ years of experience as a Technical Business Analyst in complex, data-centric environments. Proven ability to write technical user stories for data pipelines, ETL processes, and analytics platforms. Strong understanding of data platforms, data More ❯