151 to 175 of 335 Data Pipeline Jobs in the UK excluding London

Contract Data Engineer – Up to £500 per day (Outside IR35) 6 months | 3 days per week on-site in Gloucester We’re supporting a leading organisation through a period of growth and transformation, seeking an experienced Data Engineer to join on a contract basis. This role sits within a global data team and will … focus on designing, developing, and maintaining data architecture and pipelines. You’ll be working with stakeholders across the business to ensure data is accessible, reliable, and driving actionable insight. The role: Design, build, and maintain data pipelines and warehouse solutions Administer and optimise Snowflake in line with best practice Build data models … using Kimball Dimensional Modelling Leverage dbt, Fivetran, and Power BI for data transformation and reporting Deliver dashboards and reports up to executive level Support data governance, quality, and compliance across multiple environments Collaborate with a global team and business stakeholders to ensure data strategy aligns with wider objectives Skills & experience required: Strong Data More ❯

team on a long-term contract. This role will focus on developing and maintaining ETL processes, supporting cloud migration initiatives, and ensuring the delivery of accurate and reliable data solutions. Key Responsibilities * Design, develop, and optimise ETL processes to extract, transform, and load data into data warehouses or data marts. * Support the … setup and cloud migration of Informatica IDMC. * Write efficient SQL queries, including joins and data comparisons across multiple tables. * Collaborate with business and technical teams to gather requirements and translate them into robust technical solutions. * Maintain and enhance existing ETL processes, ensuring accuracy, performance, and reliability. * Perform data quality checks and resolve issues across data pipelines. * Participate in code reviews and recommend improvements. * Document workflows and processes to ensure clarity and maintainability. * Apply and share best practices in ETL development and data integration. * Leverage scripting languages such as Python or Shell scripting (advantageous). Skills & Experience * Strong experience in Informatica development and IDMC cloud migration. * Solid understanding of data More ❯

team on a long-term contract. This role will focus on developing and maintaining ETL processes, supporting cloud migration initiatives, and ensuring the delivery of accurate and reliable data solutions. Key Responsibilities * Design, develop, and optimise ETL processes to extract, transform, and load data into data warehouses or data marts. * Support the … setup and cloud migration of Informatica IDMC. * Write efficient SQL queries, including joins and data comparisons across multiple tables. * Collaborate with business and technical teams to gather requirements and translate them into robust technical solutions. * Maintain and enhance existing ETL processes, ensuring accuracy, performance, and reliability. * Perform data quality checks and resolve issues across data pipelines. * Participate in code reviews and recommend improvements. * Document workflows and processes to ensure clarity and maintainability. * Apply and share best practices in ETL development and data integration. * Leverage scripting languages such as Python or Shell scripting (advantageous). Skills & Experience * Strong experience in Informatica development and IDMC cloud migration. * Solid understanding of data More ❯

team on a long-term contract. This role will focus on developing and maintaining ETL processes, supporting cloud migration initiatives, and ensuring the delivery of accurate and reliable data solutions. Key Responsibilities * Design, develop, and optimise ETL processes to extract, transform, and load data into data warehouses or data marts. * Support the … setup and cloud migration of Informatica IDMC. * Write efficient SQL queries, including joins and data comparisons across multiple tables. * Collaborate with business and technical teams to gather requirements and translate them into robust technical solutions. * Maintain and enhance existing ETL processes, ensuring accuracy, performance, and reliability. * Perform data quality checks and resolve issues across data pipelines. * Participate in code reviews and recommend improvements. * Document workflows and processes to ensure clarity and maintainability. * Apply and share best practices in ETL development and data integration. * Leverage scripting languages such as Python or Shell scripting (advantageous). Skills & Experience * Strong experience in Informatica development and IDMC cloud migration. * Solid understanding of data More ❯

assess, implement, and manage fraud detection tools and capabilities.Strong analytical skills with the ability to enrich, transform, and interpret large structured and unstructured datasets, including internal intelligence, external data sources, and fraud typologies.Solid understanding of cyber fraud attack vectors targeting the financial sector, including device and behavioural manipulation, location spoofing, identity fraud, and account takeover.Some other highly valued … skills may include:Escalate identified risks which may result in unacceptable fraud controls and losses, utilising data visualisation.Supervisory and mentorship experience, delegating responsibilities within financial services.Experience working with an industry leading digital identity, device, and behavioural profiling technology.Partner closely with governance and control teams to ensure proper documentation, risk ratings and controls in place for all rule and … model executions.Perform data analysis to identify areas of potential fraud risk and/or potential opportunity to improve fraud policies, strategies, controls and customer experience through SAS/SQL/Big data programming and statistical computing.You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and More ❯

We are hiring a Lead Data Engineer: Exciting role in the Financial Services Space Location: UK-based | Flexible/Hybrid Working Options Contract Type: Permanent/Full-Time Overview I'm currently recruiting on behalf of a prestigious UK financial services organisation that is expanding its Retail Data Operations team . Following a strategic internal merger … they are hiring three Lead Data Engineers to support the build-out of new data capabilities focused on retirement solutions. This is a fantastic opportunity to join a forward-thinking team working with cutting-edge technologies in a collaborative and inclusive environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using Snowflake, Azure … business and technical requirements Lead Agile delivery within Scrum teams, translating user stories into actionable engineering tasks Collaborate with architects, product owners, and stakeholders to deliver high-impact data solutions Drive continuous improvement in engineering standards and release management processes Mentor and support junior and mid-level engineers, fostering a culture of learning and excellence Ideal Candidate Profile More ❯

We are hiring a Lead Data Engineer: Exciting role in the Financial Services Space Location: UK-based | Flexible/Hybrid Working Options Contract Type: Permanent/Full-Time Overview I'm currently recruiting on behalf of a prestigious UK financial services organisation that is expanding its Retail Data Operations team . Following a strategic internal merger … they are hiring three Lead Data Engineers to support the build-out of new data capabilities focused on retirement solutions. This is a fantastic opportunity to join a forward-thinking team working with cutting-edge technologies in a collaborative and inclusive environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using Snowflake, Azure … business and technical requirements Lead Agile delivery within Scrum teams, translating user stories into actionable engineering tasks Collaborate with architects, product owners, and stakeholders to deliver high-impact data solutions Drive continuous improvement in engineering standards and release management processes Mentor and support junior and mid-level engineers, fostering a culture of learning and excellence Ideal Candidate Profile More ❯

Data Engineer - Azure & Databricks Location: Hebburn (Hybrid) Contract Length: 6 months (with potential to extend) (outside IR35 - to be confirmed) A leading organisation is seeking an experienced Data Engineer with strong expertise in the Azure Data Stack and Databricks to support a key data transformation initiative. This is a hands-on delivery … role, ideal for someone who thrives in a fast-paced environment and can work closely with stakeholders to build scalable, cloud-native data solutions. Key Details: * Onsite presence required at the Hebburn office - frequency to be confirmed with the client * Initial 6-month contract with strong potential for extension Required Skills: * Proven experience with the Azure Data Stack (Azure Data Factory, Azure Synapse, Azure SQL, ADLS Gen2) * Strong hands-on expertise with Databricks (Spark, Delta Lake, notebooks, orchestration) * Experience building and optimising data pipelines for analytics and reporting * Ability to work collaboratively with cross-functional teams and stakeholders * Strong communication and problem-solving skills Please send CV's over to (url More ❯

implement, and manage fraud detection tools and capabilities. Strong analytical skills with the ability to enrich, transform, and interpret large structured and unstructured datasets, including internal intelligence, external data sources, and fraud typologies. Solid understanding of cyber fraud attack vectors targeting the financial sector, including device and behavioural manipulation, location spoofing, identity fraud, and account takeover. Some other … highly valued skills may include: Escalate identified risks which may result in unacceptable fraud controls and losses, utilising data visualisation. Supervisory and mentorship experience, delegating responsibilities within financial services. Experience working with an industry leading digital identity, device, and behavioural profiling technology. Partner closely with governance and control teams to ensure proper documentation, risk ratings and controls in … place for all rule and model executions. Perform data analysis to identify areas of potential fraud risk and/or potential opportunity to improve fraud policies, strategies, controls and customer experience through SAS/SQL/Big data programming and statistical computing. You may be assessed on the key critical skills relevant for success in role More ❯

Senior Data Engineer Edinburgh 3 days per week on-site 6 months (likely extension) £550 - £615 per day outside IR35 Primus is partnering with a leading Financial Services client who are embarking on a greenfield data transformation programme. Their current processes offer limited digital customer interaction, and the vision is to modernise these processes by: Building … a modern data platform in Databricks Creating a single customer view across the organisation. Enabling new client-facing digital services through real-time and batch data pipelines. You will join a growing team of engineers and architects, with strong autonomy and ownership. This is a high-value greenfield initiative for the business, directly impacting customer experience … and long-term data strategy. Key Responsibilities: Design and build scalable data pipelines and transformation logic in Databricks Implement and maintain Delta Lake physical models and relational data models. Contribute to design and coding standards, working closely with architects. Develop and maintain Python packages and libraries to support engineering work. Build and run automated More ❯

About the role: We're looking for a Senior Data Engineer to join the Data & Analytics team at Holland & Barrett. This is a high-impact, mid-seniority role within our growing data function, where you'll design, build, and scale modern data solutions on AWS. You'll work closely with cross-functional … teams including Data Science, BI, and Product Analytics to develop cloud-native, scalable data infrastructure powering advanced analytics and machine learning. As a Senior Engineer, you'll not only deliver code — you'll take ownership, lead small teams, mentor others, and contribute to shaping our engineering culture and best practices. You'll join a team of … Data Engineers, reporting to the Senior Data Engineering Manager. You'll work alongside Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI More ❯

benefits Birmingham Role Summary We are seeking a skilled and motivated SQL Analyst. In this role, you will play a vital part in analysing, creating, implementing, and maintaining data infrastructure, ensuring the seamless operation of corporate IT systems. This is a unique opportunity to contribute to our journey of innovation, efficiency, and customer excellence. Core Duties Design, implement … and maintain on-prem and cloud data infrastructure to support IT services. Administer corporate databases, including maintenance, upgrades, and monitoring for resilience and efficiency. Develop and implement data pipelines for data warehousing and analytics requirements. Perform database administration tasks such as user management, backups, and transaction log management. Engage with end-user departments to … APIs and web services. Experience Required In-depth knowledge of Microsoft SQL Server (2017 and above), including SSMS, SSRS, SSAS, SSIS, and SQL scripting. Expertise in database development, data cubes, and data marts. Proficiency with data visualisation tools like Power BI, Tableau, or SAP BusinessObjects. Familiarity with cloud data services such as More ❯

As a Data Engineer , youll design, build, and maintain scalable pipelines and models that ensure data is accurate, accessible, and usable across the organisation. Youll partner closely with analysts, engineers, and business stakeholders, applying modern software development principles and promoting a DataOps culture of automation, reliability, and agility. Key Responsibilities Design, build, and optimise data pipelines across a modern data platform. Ingest, clean, and transform data using tools such as dbt, Snowflake, and Airflow . Collaborate with cross-functional teams to deliver data products aligned to business priorities. Develop scalable data models that support BI and analytics platforms including Tableau and Power BI. Apply robust … queries. Hands-on experience with dbt (including testing and layered modelling). Practical knowledge of Snowflake for loading, transforming, and exporting datasets. Experience building and managing Airflow DAGs for pipeline orchestration. Understanding of BI tool requirements (e.g., Tableau, Power BI) and related performance considerations. Advanced Excel capability, including pivot tables and complex formulas. Familiarity with data modelling More ❯

Data Consultant - ETL Projects UK - Remote | Permanent Up to £55,000 + Benefits Are you a Data Consultant with a strong background in hands-on ETL development and data transformation? Are you looking to lead technically complex data migration projects that genuinely impact digital services across Local Government? We're hiring for … an experienced Data Consultant to join a growing team delivering mission-critical data migration projects. You'll be part of an expert unit supporting onboarding for a new cloud platform - working directly with raw datasets from legacy systems and transforming them into future-ready digital infrastructure. What You'll Be Doing: Leading data migration … and ETL projects for UK public sector software implementations Analysing and mapping legacy database schemas (Oracle, SQL Server, Postgres) Extracting raw data from legacy systems, often with limited documentation Writing and executing SQL scripts and/or using ETL tools to build data pipelines Creating transformation logic and performing reconciliation and validation Working closely with customers More ❯

to join our Analytics Engineering team, with a focus on supporting our commercial team and data. This is an exciting opportunity to hone your skills with the modern data stack while working closely with sales, finance and data teams to deliver robust reporting and insights. You will play a key role in building scalable data pipelines, maintaining reliable reporting frameworks, and ensuring the accuracy of commercial data that powers decision-making across the business. This role would suit someone who is starting their career in Analytics Engineering and is keen to learn quickly from an experienced team and is not afraid to get their hands dirty. Key Responsibilities Be the first … point of contact for all Commercial data requests. Investigate these requests and either solve them or triage them. Contribute to building and maintaining a best-in-class Looker setup, supporting dashboards and Explores that drive adoption and value across the business. Partner with commercial stakeholders to understand reporting needs, translating them into effective Looker solutions that support sales More ❯

Role Title: Data Analyst/Engineer Duration: contract to run until 28/11/2025 Location: Sheffield … Hybrid 3 days per week onsite Rate: up to £271.97 p/d Umbrella inside IR35 Key Skills/requirements Tool integration & Configuration (Control management). Data Pipeline & Dashboard development. Reporting, Automation & Exception Tracking. Data mapping Any experience of Reporting solution use cases, wireframes, process design, data mapping, test case development and co More ❯

Data Scientist - Assistant Vice President Are you passionate about turning data into decisions? Our client, a large national Banking organisation, is looking for an experienced Data Scientist to join their dynamic analytics team. You’ll work at the intersection of data, strategy, and innovation—building models, uncovering insights, and driving impact across … the business. What You’ll Do Build and automate data pipelines from diverse sources Design predictive models and machine learning solutions Translate complex data into actionable insights for stakeholders Collaborate across teams to solve real-world business challenges Influence decision-making with evidence-based recommendations What We’re Looking For Advanced skills in data engineering, modeling, and analytics Experience with data warehousing, mining, and visualisation tools Strong communication and stakeholder engagement abilities Strategic mindset with a focus on risk, governance, and transformation Proven ability to lead projects and coach others Technical skills to include: Python or R Pyspark Experience of deploying models AWS cloud Experience of GenAi Experience of working More ❯

Marketing AdTech Data Analyst Location: London (hybrid 3 days per week onsite) Contract: 12 months, up to £425pd inside IR35 Our client is looking for a highly skilled Data Analyst to join a fast-paced ad-tech environment supporting data-driven marketing and advertising initiatives. This role is ideal for someone who thrives at … marketing strategy and technical execution, with strong hands-on experience in Tableau, SQL and Python. You'll work closely with global stakeholders across Marketing, Sales, Engineering and external data partners to deliver insights, optimise campaign performance and shape go-to-market strategies for digital advertising products. What You'll Do: Deliver custom insights and analytics to support marketing … KPIs, campaign performance and user engagement. Develop and maintain ETL pipelines using SQL and Python. Translate business needs into analytical requirements, communicating findings with clarity and impact. Conduct data analysis and A/B testing to measure the effectiveness of marketing initiatives. Contribute to scalable reporting solutions, data transformation and automation strategies. What You'll Bring More ❯

We're partnering with a Globally known Financial Services Giant as they grow out their analytics capability and are currently seeking to hire a new Data & Reporting Analyst to support their Customer Optimisation and Lifecycle Marketing programmes. This is a newly created role where you'll split your time between data management and reporting/analysis … helping to power experimentation and customer growth. Be part of a newly created role with room to shape how they work with data! Role Requirements: Manage data pipelines to ensure reliable, timely data availability for testing and campaigns. Write and run SQL queries, shaping and maintaining key datasets. Support experimentation by measuring outcomes, analysing … performance, and surfacing insights. Build clear dashboards and reports (Tableau/Qlik Sense) for stakeholders across the business. Balance work across 50% reporting/50% data management. Skills Needed: Strong SQL skills Hands-on experience with reporting tools (eg. Tableau or Qlik Sense). Exposure to data pipelines or data management AWS/data More ❯

Data Engineering Manager Hybrid | Brighton (Once Per Week) Up to £90k + Benefits Are you an experienced Data Engineering Manager with a passion for leading high-performing teams and shaping modern data infrastructure? I'm working with an exciting, fast-growing, private-equity-backed tech company that's on a mission to revolutionise how … people make confident buying decisions online - and they're looking for a hands-on leader to own a key part of their data platform. The Opportunity You'll take charge of a small, talented Data Engineering team, responsible for evolving and scaling the ingestion of customer product catalogues into internal systems. This is a hybrid role … up your sleeves when needed. They're entering an exciting growth phase with big ambitions, and this role will be pivotal in building scalable, cost-effective, and innovative data solutions to support that journey. What You'll Do Manage, mentor, and grow a small team of Data Engineers. Own the architecture and design of scalable data More ❯

days on-site) £40,000 £50,000 + benefits Were partnered with a fast-growing technology business that is undergoing a major transformation programme to modernise its data and analytics capabilities. Theyre looking for a Business Intelligence Developer who can play a key role in shaping the way data is used across the organisation. This is … an opportunity to get involved in a large-scale, complex data environment and make a tangible impact on how insights drive decision-making at a global level. What youll be doing Designing and developing Power BI dashboards and reports that provide meaningful insight and data storytelling for senior stakeholders. Working with large, complex datasets from multiple … sources, ensuring they are queried, modelled, and optimised for reporting. Collaborating with engineers and analysts to develop data pipelines and models that feed enterprise-level reporting solutions. Supporting the ongoing transformation programme , helping to break down legacy reporting structures and introduce modern BI practices. Partnering closely with commercial, finance, and operational teams to ensure reporting is aligned with More ❯

model? We are seeking a Senior Backend Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Senior Backend Developer you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we're building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you'll More ❯

model? We are seeking a Senior Backend Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Senior Backend Developer you won’t just write code - you’ll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we’re building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you’ll More ❯

Senior Data Engineer - Sought by Leading Commodities firm - Permanent - Hybrid - London Salary - Up to 135K + 20-30% Bonus About the role - We're looking for an experienced Data Engineer for the Surveillance IT team to develop ingestion pipelines and frameworks across the application portfolio, supporting Trade Surveillance analysts with strategy and decision-making. You should … be experienced in a data engineering role demonstrating a strong track record of designing, building, and maintaining data pipelines and data architectures. Required Skills - Proficiency in Python, Pyspark, SQL for data manipulation and querying. Experience with containerisation technologies, specifically Kubernetes and Docker. Proven experience in designing and implementing data pipelines … working with big data technologies and architectures. Proven experience of Financial Services - trade and financial concepts, particularly in relation to market data. Desired Skills - Experience working with Cloud Services, Familiarity with trade surveillance systems and methodologies. Understanding of operations or trading in the commodities context, particularly in Oil, Gas, Shipping, and related activities. More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO , we're on a mission to … our Senior Backend Python Developer, you wont just write code - youll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO , part of Modo25, were building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and youll be at More ❯