251 to 275 of 1,010 Data Pipeline Jobs in the UK excluding London

the best talent to strengthen our reputation as both a design practice and an employer of choice. We are seeking a motivated Junior BI Analyst to join our data analytics team. This role is perfect for an entry-level professional looking to build expertise in business intelligence, data management, and emerging AI technologies. The successful candidate … will support data-driven decision making across the organization while developing technical skills in data analysis and visualization. Key Responsibilities: Data Management & Quality Perform data cleansing, validation, and quality assurance processes Identify and resolve data inconsistencies and anomalies Document data sources, transformations, and cleansing procedures Monitor data pipelines and ensure timely data updates Business Intelligence & Reporting Develop and maintain standard business reports and dashboards Create ad-hoc reports based on stakeholder requirements Support the creation of KPIs and performance metrics Assist in data visualization best practices implementation AI Integration & Prompt Engineering Create and optimize AI prompts for various business applications Collaborate More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Data Architect to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making … across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using DBT, Delta Live Tables, and dimensional modelling to deliver consistent More ❯

the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Data Architect to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making … across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using DBT, Delta Live Tables, and dimensional modelling to deliver consistent More ❯

Senior Data Engineer – HealthTech/AI-Driven Data Platform Paddington, London £75,000 – £100,000 + Equity + Benefits We’re partnered with a fast-growing HealthTech company using data and AI to transform how healthcare organisations manage clinical and operational insights. Their platform integrates complex datasets from multiple health systems, enabling better decision … making, faster diagnosis, and measurable patient impact. As they scale their data capability, they’re hiring a Data Engineer to play a key role in designing and delivering the next generation of their data platform. What you’ll be doing Designing, developing, and optimising scalable data pipelines that power advanced analytics and … machine learning. Building and maintaining robust ETL/ELT workflows using Python, SQL, dbt, and cloud-native tools . Implementing data quality, observability, and governance frameworks to ensure reliability and compliance. Collaborating with data scientists, analysts, and clinicians to enable actionable insights through clean, well-modelled data. Driving technical decisions across Azure Databricks , GCP BigQuery , and More ❯

Senior Data Engineer – HealthTech/AI-Driven Data Platform Paddington, London £75,000 – £100,000 + Equity + Benefits We’re partnered with a fast-growing HealthTech company using data and AI to transform how healthcare organisations manage clinical and operational insights. Their platform integrates complex datasets from multiple health systems, enabling better decision … making, faster diagnosis, and measurable patient impact. As they scale their data capability, they’re hiring a Data Engineer to play a key role in designing and delivering the next generation of their data platform. What you’ll be doing Designing, developing, and optimising scalable data pipelines that power advanced analytics and … machine learning. Building and maintaining robust ETL/ELT workflows using Python, SQL, dbt, and cloud-native tools . Implementing data quality, observability, and governance frameworks to ensure reliability and compliance. Collaborating with data scientists, analysts, and clinicians to enable actionable insights through clean, well-modelled data. Driving technical decisions across Azure Databricks , GCP BigQuery , and More ❯

Senior Data Engineer – HealthTech/AI-Driven Data Platform Paddington, London £75,000 – £100,000 + Equity + Benefits We’re partnered with a fast-growing HealthTech company using data and AI to transform how healthcare organisations manage clinical and operational insights. Their platform integrates complex datasets from multiple health systems, enabling better decision … making, faster diagnosis, and measurable patient impact. As they scale their data capability, they’re hiring a Data Engineer to play a key role in designing and delivering the next generation of their data platform. What you’ll be doing Designing, developing, and optimising scalable data pipelines that power advanced analytics and … machine learning. Building and maintaining robust ETL/ELT workflows using Python, SQL, dbt, and cloud-native tools . Implementing data quality, observability, and governance frameworks to ensure reliability and compliance. Collaborating with data scientists, analysts, and clinicians to enable actionable insights through clean, well-modelled data. Driving technical decisions across Azure Databricks , GCP BigQuery , and More ❯

Senior Data Engineer – SC Cleared We are seeking a hands-on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines . The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake . … This role also involves close collaboration with hyperscalers and data platform vendors to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging with senior stakeholders across the organisation. Key Responsibilities: Design, develop, and maintain streaming and batch data pipelines using modern data engineering tools and frameworks. Work … with large volumes of structured and unstructured data , ensuring high performance and scalability. Collaborate with cloud providers and data platform vendors (e.g., AWS, Microsoft Azure, Databricks, IBM, Snowflake) to conduct PoCs for data platform solutions. Evaluate PoC outcomes and provide comprehensive documentation including architecture, performance benchmarks, and recommendations. Engage with key stakeholders including Heads More ❯

Data Engineer Location: Stevenage (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Data Engineer Location: Stevenage (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Data Engineer Location: Stevenage (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Lead Data Engineer, based Waltham Abbey (Hybrid role). Salary £60-80k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to lead a team and be hands on in replacing old tech systems and create ETL pipelines. We’re a small high … in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Lead Data Engineer This role sits within our IT team. Success measures will include project delivery and impact, data quality and management, innovation and technology, stakeholder engagement, financial impact … key responsibilities: Backend Development : Design, build, and maintain serverless and traditional backend architectures using best practices. (We build on AWS using Lambdas and ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

Contract Role: Snowflake Data Architect/Consultant Location: London or Manchester (Hybrid – 2/3 days onsite pw) Duration: 6 months initial (poss extensions) Engagement: Outside IR35 Overview We’re seeking a highly capable Snowflake Data Architect/Consultant to help design, optimise, and embed modern cloud data architectures. The role will blend strategic … input, hands-on delivery, and technical leadership across data modelling, integration, and platform enablement. Key Responsibilities Platform Architecture Design and implement scalable data environments on Snowflake , ensuring performance, security, and reusability. Establish integration patterns between Snowflake and wider ecosystems including ETL/ELT tools , BI platforms, and cloud services (AWS, Azure, GCP). Delivery & Optimisation Lead … and analytics teams to embed Snowflake best practices. Create documentation and reusable assets that support long-term client self-sufficiency. Strategic Advisory Contribute to the definition of enterprise data roadmaps, covering topics such as data mesh , data sharing , and AI/ML enablement . Collaborate with platform partners and stakeholders to align delivery with More ❯

Contract Role: Snowflake Data Architect/Consultant Location: London or Manchester (Hybrid – 2/3 days onsite pw) Duration: 6 months initial (poss extensions) Engagement: Outside IR35 Overview We’re seeking a highly capable Snowflake Data Architect/Consultant to help design, optimise, and embed modern cloud data architectures. The role will blend strategic … input, hands-on delivery, and technical leadership across data modelling, integration, and platform enablement. Key Responsibilities Platform Architecture Design and implement scalable data environments on Snowflake , ensuring performance, security, and reusability. Establish integration patterns between Snowflake and wider ecosystems including ETL/ELT tools , BI platforms, and cloud services (AWS, Azure, GCP). Delivery & Optimisation Lead … and analytics teams to embed Snowflake best practices. Create documentation and reusable assets that support long-term client self-sufficiency. Strategic Advisory Contribute to the definition of enterprise data roadmaps, covering topics such as data mesh , data sharing , and AI/ML enablement . Collaborate with platform partners and stakeholders to align delivery with More ❯

Contract Role: Snowflake Data Architect/Consultant Location: London or Manchester (Hybrid – 2/3 days onsite pw) Duration: 6 months initial (poss extensions) Engagement: Outside IR35 Overview We’re seeking a highly capable Snowflake Data Architect/Consultant to help design, optimise, and embed modern cloud data architectures. The role will blend strategic … input, hands-on delivery, and technical leadership across data modelling, integration, and platform enablement. Key Responsibilities Platform Architecture Design and implement scalable data environments on Snowflake , ensuring performance, security, and reusability. Establish integration patterns between Snowflake and wider ecosystems including ETL/ELT tools , BI platforms, and cloud services (AWS, Azure, GCP). Delivery & Optimisation Lead … and analytics teams to embed Snowflake best practices. Create documentation and reusable assets that support long-term client self-sufficiency. Strategic Advisory Contribute to the definition of enterprise data roadmaps, covering topics such as data mesh , data sharing , and AI/ML enablement . Collaborate with platform partners and stakeholders to align delivery with More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯