176 to 200 of 582 Data Pipeline Jobs in the UK

General/Usage VMWare General/Usage Technical Leadership & Design DevSecOps tooling and practices Application Security Testing SAFe (scaled agile) Processes Data Integration Focused Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3 … MinIO, LakeFS CI/CD Pipeline, Integration, ideally Azure DevOps Python Scripting API Management Solutions Automation Key Skills Experience in the Design/Configuration/Usage in a number of the following - Low-code Platforms, such as Power Platform, Appian, UiPath, Blue Prism RPA and Automation solutions Experience in Business Process Analysis Software, Applications, APIs Apps Design and Integration … Key Skills Experience in the Design/Configuration/Usage in a number of the following - Software/API/Web Design and Development Database Design and Data Modelling Architectural Patterns such as OO, Cloud-native and Microservices. Automated Test tooling, ideally Selenium/Robot Framework DevSecOps Key Skills Experience in the Design/Configuration/Usage in More ❯

leading lenders, brokers, and financial institutions make smarter decisions with data. Our reporting and MI products are at the centre of that mission, delivering the dashboards, insights, and data quality our customers rely on every day. We're looking for a Senior Product Owner - Data & Reporting to drive efficient and effective delivery of our MI and … You'll work hand-in-hand with engineers and analysts to prioritise, scope, and deliver reporting features that meet customer and internal needs. With your strong background in data and MI, you'll ensure reporting requirements are clearly defined, data quality is assured, and delivery stays on track. This role is all about turning requirements into … analysts and engineers are working to clear goals and delivery milestones. Work closely with internal stakeholders (commercial, product, analytics) to refine requirements, manage expectations, and communicate progress. Oversee data validation and quality checks, ensuring delivered dashboards and reports are accurate and reliable. Support analysts and engineers by removing blockers, clarifying requirements, and making delivery decisions quickly. Track progress More ❯

Lead Data Scientist - Regulatory Scanning Initiative This is a unique opportunity to lead a high-impact team, mentor junior talent, and drive innovation in a fast-growing company. You'll work alongside industry experts, collaborate with cross-functional teams, and have the freedom to explore new technologies and methodologies. At Vixio, we're on a mission to revolutionize … how businesses manage regulatory obligations through cutting-edge RegTech solutions combined with our human expertise. Join us as our Lead Data Scientist and play a pivotal role in shaping the future of regulatory intelligence. About the role: As our Lead Data Scientist , you will play a pivotal role in shaping and delivering data-driven … solutions that power our regulatory scanning, analytics, and generative AI capabilities. You'll take ownership of complex data science problems end-to-end, from framing business challenges with stakeholders, to deploying production-ready solutions. We're looking for someone who thrives in fast-moving environments, takes initiative, and delivers measurable results. Working closely with the Head of Regulatory More ❯

Datadog, Miro, Webflow, and Facebook. Role Overview Synthesia is building a modern, AI-powered back office. We are hiring a full-stack engineer to design and run the data layer that powers Finance ensuring data from finance systems land securely in a data warehouse and is easily consumed via Copilot (LLM) and Omni dashboards. … ll be a cornerstone in our shift to modern finance workflows. Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines to ingest, transform, and securely store data from NetSuite and other finance systems into Snowflake, ensuring data integrity, compliance, and security best practices (e.g., encryption, access controls, and auditing). Collaborate with finance and … data teams to define data models, schemas, and governance policies that support modern finance workflows, including automated reporting, forecasting, and anomaly detection. Implement data retrieval mechanisms optimized for LLM-based querying via Co-pilot and/or similar tools, enabling natural language access to financial data while maintaining accuracy and contextual relevance. More ❯

Data Engineer - London/Nationwide (Hybrid) - SC Eligible - £60,000 A leading digital consultancy is looking to hire a Data Engineer to support the expansion of its Data & AI team. This is an excellent opportunity for someone with up to 3 years of experience (or a strong academic background) to gain hands-on exposure … to cloud technologies and grow in a collaborative, fast-paced environment. What You'll Be Doing: Building and maintaining scalable data pipelines across Azure and GCP Working with tools such as Azure Data Factory, Snowflake, BigQuery, and Cloud Functions Supporting data warehousing and integration across diverse industry projects Collaborating with data professionals … and contributing to cross-functional delivery teams Assisting in reporting and data visualisation (Power BI/Looker - nice to have) What We're Looking For: 0-3 years of experience in a data engineering or similar role (graduates welcome) Proficiency in SQL and Python Exposure to any of the following: Azure Data Factory GCP More ❯

Analytics Engineer | £60-75K | London (5 days/week on-site) | Permanent Bridge the gap between data engineering and analytics A major logistics company is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. What you'll be doing: Build and maintain scalable data pipelines using … Azure Data Factory and Databricks Develop transformation workflows in dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems - linking issues to business impact Create reusable data assets and documentation to support self-serve analytics via Power BI Work with More ❯

Analytics Engineer | £60-75K | London (5 days/week on-site) | Permanent Bridge the gap between data engineering and analytics A major logistics company is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. What you'll be doing: Build and maintain scalable data pipelines using … Azure Data Factory and Databricks Develop transformation workflows in dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems - linking issues to business impact Create reusable data assets and documentation to support self-serve analytics via Power BI Work with More ❯

end Machine Learning pipelines and infrastructure that enable the seamless development, deployment, and monitoring of AI and ML models in production, including Large Language Models (LLMs). From data ingestion and model/LLM deployment, monitoring, and governance using Azure's AI ecosystem including Azure AI Foundry, Azure ML, and AKS. Responsibilities Design, build, and manage ML & LLM … Azure AI Foundry (e.g., GPT, Phi, LLaMA based, HuggingFace) using Azure AI services. Implement and manage Azure infrastructure necessary for ML workloads (e.g., Azure Machine Learning Workspaces, Compute, Data Stores) using ARM templates or Terraform. Implement CI/CD for ML/LLM workflows with Azure DevOps or GitHub Actions. Manage real time and batch deployments on Azure … Docker and containerized deployments. Familiarity with MLOps best practices - version control, reproducibility, monitoring. Good understanding of Responsible AI, model governance, and compliance frameworks. Solid SQL and data pipeline skills. Strong problem solving and collaboration skills. Nice to Have Skills: Experience with LangChain, Semantic Kernel, or Retrieval Augmented Generation (RAG) patterns in Azure. Knowledge of vector databases (Azure More ❯

Excellent opportunity for a veteran Data Engineer ready to take the lead on large-scale, data-driven projects. This is an exciting opportunity to step into a senior role where youll design and deliver innovative solutions, mentor teams, and shape the future of data engineering within a forward-thinking environment. What youll be doing … As a Lead Data Engineer, youll play a hands-on role in designing and developing data processing and persistence software components that handle data at scale. Youll work within agile teams, leading engineers, driving best practice, and ensuring robust, high-quality solutions that meet user needs. Your responsibilities will include: Designing, coding, testing, and … troubleshooting complex data components and subsystems. Leading development practices, ensuring performance, security, and operational readiness. Mentoring and coaching team members, helping them to grow and deliver to a high standard. Working closely with architects on data pipelines (ETL/ELT) and distributed data frameworks. Driving technical proposals, advising on effort estimates, and contributing to More ❯

as with our external partners such as Delivery Service Providers (DSP), Fleet Management Companies (FMC) and Original Equipment Manufacturers (OEM). We work with large amounts of novel data and provide insights that help deliver billions of packages to customers every year. We are looking for a Sr. Fleet Insights Manager who is ready to roll up their … sleeves and help us develop actionable, data-driven insights to support the Fleet Operations team automation and operational excellence projects/data asset development. In this role you will develop and lead new analytics solutions (dashboards, metrics, analytics) that supports critical process improvement automation. To be successful in this role, you'll need to be a … problem solver extraordinaire. You'll work on large, complex initiatives with a high degree of ambiguity, and you'll also advocate on behalf of customers. Candidates will use data and analytic engineering to drive changes across multiple organizations. Key responsibilities Developing and maintaining performance dashboards with key metrics for review with senior leadership and business teams; synthesizing large More ❯

BI Analyst Location: Bristol (Hybrid 2/3 days a week onsite) Salary: £35,000 - £45,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Executive Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk, Group Sales Director , providing strategic data and insight to support their decision … making. Design, build, and deliver group-wide reporting programmes , primarily using Tableau , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CPO Bespoke data More ❯

Senior Data Engineer - London (Hybrid 3 to 4 days) Type: Full-time Location: London, UK Help Build the Future of Data in Financial Services A leading financial services client is growing its data engineering team and is looking for experienced engineers who are passionate about building scalable, high-quality data systems. This … that values clean code, continuous learning, and strong engineering principles. What You'll Be Doing You'll be a key contributor to the development of a next-generation data platform, with responsibilities including: Designing and implementing scalable data pipelines using Python and Apache Spark Building and orchestrating workflows using AWS services such as Glue , Lambda , S3 … CI/CD , version control , automated testing , and modular design Supporting the development of a lakehouse architecture using Apache Iceberg Collaborating with product and business teams to deliver data-driven solutions Embedding observability and quality checks into data workflows Participating in code reviews, pair programming, and architectural discussions Gaining domain knowledge in financial data More ❯

Senior Data Engineer - London (Hybrid 3 to 4 days) Type: Full-time Location: London, UK Help Build the Future of Data in Financial Services A leading financial services client is growing its data engineering team and is looking for experienced engineers who are passionate about building scalable, high-quality data systems. This … that values clean code, continuous learning, and strong engineering principles. What You'll Be Doing You'll be a key contributor to the development of a next-generation data platform, with responsibilities including: Designing and implementing scalable data pipelines using Python and Apache Spark Building and orchestrating workflows using AWS services such as Glue , Lambda , S3 … CI/CD , version control , automated testing , and modular design Supporting the development of a lakehouse architecture using Apache Iceberg Collaborating with product and business teams to deliver data-driven solutions Embedding observability and quality checks into data workflows Participating in code reviews, pair programming, and architectural discussions Gaining domain knowledge in financial data More ❯

Role: Data Engineer Location: Cardiff (Hybrid - 3 days WFH) Salary: Up to £62,000 + 10% Bonus + Excellent Benefits The Role CPS Group are partnering with a leading organisation to hire an experienced Data Engineer. You'll design, build, and optimise data pipelines and integrations, supporting ERP migration projects and shaping a centralised … enterprise data platform. This is a key role ensuring reliable, high-quality data for business intelligence and decision-making. Key Responsibilities:* Build and maintain scalable data pipelines (SQL/Azure). * Support ERP migration and system integrations. * Ensure data quality, validation, and performance. * Collaborate with BI and Data teams to … insights. * Apply DataOps best practices (version control, CI/CD, documentation). Skills & Experience:* Strong SQL development and optimisation skills. * Experience with MS SQL Server, Azure SQL, Azure Data Factory. * Proven track record in data engineering, ETL/ELT, and system migrations. * Knowledge of data modelling, governance, and quality assurance. * Excellent communication and problem More ❯

Role: Data Engineer Location: Cardiff (Hybrid - 3 days WFH) Salary: Up to 62,000 + 10% Bonus + Excellent Benefits The Role CPS Group are partnering with a leading organisation to hire an experienced Data Engineer. You'll design, build, and optimise data pipelines and integrations, supporting ERP migration projects and shaping a centralised … enterprise data platform. This is a key role ensuring reliable, high-quality data for business intelligence and decision-making. Key Responsibilities: Build and maintain scalable data pipelines (SQL/Azure). Support ERP migration and system integrations. Ensure data quality, validation, and performance. Collaborate with BI and Data teams to … insights. Apply DataOps best practices (version control, CI/CD, documentation). Skills & Experience: Strong SQL development and optimisation skills. Experience with MS SQL Server, Azure SQL, Azure Data Factory. Proven track record in data engineering, ETL/ELT, and system migrations. Knowledge of data modelling, governance, and quality assurance. Excellent communication and problem More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯

Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯

Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯

Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯

Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯

What's the Opportunity Join our dynamic Digital Engineering team at Ridge as a Data Analyst/Engineer, where you'll play a pivotal role in transforming data into actionable insights that drive innovation across our projects. You'll work closely with multidisciplinary teams to develop and maintain robust data pipelines, implement advanced analytics … integration of digital tools that enhance design, delivery, and operational efficiency. This is a unique opportunity to contribute to cutting-edge engineering solutions while shaping the future of data-driven decision-making in the built environment. We operate an agile working policy, but please note this opportunity will require weekly attendance at a major project site on the … Bristol, Winchester, Reading, London, or Birmingham) subject to ability to travel to Oxford. What you need to do to be effective in this role Develop, maintain, and optimise data pipelines to support digital workflows across engineering and design projects. Collaborate with multidisciplinary teams to understand data requirements and deliver tailored analytical solutions. Clean, transform, and analyse More ❯

Data Engineer Snowflake 3 months + Remote (UK located) £400 per day Outside IR35 This is an excellent opportunity for someone keen to get involved in the early stages of strategic data projects and deliver robust data solutions. You must have experience working with Snowflake for this role. The company is a well-known … into a customer-centric, digitally driven business. Now is the perfect time to join them on this exciting journey as they look to drive forward innovation through meaningful data insights. As a Data Engineer you will join a newly established team as the embark on new business improvement projects. You will build scalable and reliable data pipelines to power analytics, reporting, and strategic decision making. As a Data Engineer you will have the opportunity to utilise cutting edge data tools to design and implement robust data solutions. Required Skills/Experience: At least 2 years' experience working with Snowflake At least 2 years experience working with Azure, AWS More ❯

MI & Data Integration Analyst (Azure/Databricks) Hybrid - Central London | £43,000 pro rata | 3-month FTC (potential to extend) We're looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great … opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work - helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity You'll be supporting a small, forward-thinking team to improve how they use data - helping them access accurate and timely MI … streamline processes, and migrate to a new Azure-based data environment. You'll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. More ❯

Senior Data Engineer - £65,000-£70,000 + Excellent Benefits Location: Leeds (Hybrid, 2 days on-site) Are you ready to take on large-scale data engineering challenges within a business that's investing heavily in cloud transformation, AI, and advanced analytics? This is a unique opportunity to join a rapidly growing, tech-driven organisation that … s modernising its entire data landscape and gearing up for a massive change and innovation portfolio in 2026. You'll play a pivotal role in designing and building scalable data platforms on AWS, supporting everything from cloud migrations and Salesforce integrations to AI-ready data pipelines and petabyte-scale projects. What You'll Be … Doing Designing and developing modern data architectures to support advanced analytics and automation. Leading end-to-end data migration projects from on-prem SQL Server to AWS cloud environments. Building and optimising data pipelines using Python, Lambda, and SQL, ensuring performance, quality, and scalability. Collaborating across DevOps, analytics, and engineering teams to deliver cloud More ❯