1 to 25 of 38 Permanent Data Pipeline Jobs in the South West

energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE … growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

We are searching for an experienced GIS Data Specialist/Geospatial Data Specialist for an extremely exciting technology focused business, someone who has extensive experience of working with and managing Geospatial Data and Geodata . This role is offered on a hybrid or remote working basis. You MUST however be able to attend team … will need to live within a commutable distance of one of the above offices, either Reading or Exeter. We are searching for someone who is very passionate about data, automation, and driving change through smart processes. You will be leading the way with regards to transforming how data is managed, processed and delivered across our client … s business. You will take ownership of complex ETL workflows, you will be developing automation tools, and you will ensure data is accurate, delivered in a timely fashion whilst making sure it is fit for purpose. Key Duties: - Lead and maintain ETL processes, improving automation and data quality. Use tools like Power BI/Excel or More ❯

New Contract Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – full time on site when required Must hold active Enhanced DV Clearance (West) Circa £600 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Data Engineer be Doing? You will develop mission … critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client's National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Lead Data Engineer be Doing? You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Lead Data Engineer be Doing? You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing More ❯

Data Engineer Gloucester | up to £54,500 + benefits | Hybrid: 2 days on site We’re supporting a Gloucester-based organisation as they continue to invest in their data capability. They’ve recently implemented Microsoft Fabric, creating an opportunity for a Data Engineer to join at the start of the journey and help shape … how the platform evolves. The role Build and maintain data pipelines using Azure Data Services (Data Factory, Synapse, Databricks). Work in a newly implemented Fabric environment, with the chance to learn and influence best practice from the outset. Collaborate with analysts and business teams to deliver clean, reliable data for reporting … and insight. Contribute to the design and development of the wider data platform. About you Experience with Azure Data Services (Data Factory, Synapse, Databricks or similar). An interest in or exposure to Microsoft Fabric. Strong SQL skills and experience building data pipelines. Comfortable working with stakeholders to understand requirements and deliver More ❯

DV Cleared Data Engineers – Bristol – AWS or Azure – All levels We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in Bristol. If you hold active DV clearance and want to work on cutting-edge … mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. They are considering all levels from Junior Data Engineers to Principal - as long as you hold DV Clearance!! What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

Analytics Engineer London (onsite) | Full-Time, Permanent We're on an exciting data transformation journey and are looking for a skilled Analytics Engineer to join our growing data team. In this role, you'll help design and implement scalable, high-performance data infrastructure using the modern data stack, including Azure Databricks , Azure … Data Factory , dbt , SQL , Python , and Power BI . You'll act as the bridge between data engineering and analytics-building robust data models, automated pipelines, and self-service tools that drive decision-making across the business. This is a hands-on technical role with real impact. You'll collaborate with engineers, analysts, and … stakeholders to deliver clean, trusted, and accessible data. Key Responsibilities: Develop and maintain data pipelines using Databricks and ADF Create dimensional models and transformation workflows using dbt Implement automated data quality checks and monitoring systems Empower business users through self-service analytics using Power BI Document technical processes and uphold coding standards Collaborate with cross-functional More ❯

BI Analyst Location: Bristol (Hybrid 2/3 days a week onsite) Salary: £35,000 - £45,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Executive Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk, Group Sales Director , providing strategic data and insight to support their decision … making. Design, build, and deliver group-wide reporting programmes , primarily using Tableau , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CPO Bespoke data More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Summary: We are looking for a highly skilled Senior Data Engineering Developer with strong hands-on experience in Azure Data Factory , SQL development , and ETL tools . The ideal candidate will design and implement data pipelines, optimize performance, and collaborate with stakeholders in an Agile environment to deliver robust data solutions. … Key Responsibilities: Design and Develop Pipelines: Build and maintain Azure Data Factory pipelines and implement CI/CD processes for automated deployments. SQL Development: Write and optimize complex stored procedures , functions , and queries for high-performance data processing. Agile Delivery: Work in an Agile model , participate in sprint planning, and ensure timely delivery of data … . Familiarity with Agile methodologies . Understanding of cloud concepts and data warehouse design . Preferred Qualifications: Experience with SAP BODS . Knowledge of Azure DevOps for pipeline automation. Strong problem-solving and communication skills. More ❯

Senior Data Engineer Salary: £70,000 Location: Wiltshire (2 Days a Week in Office) Step into a leadership role where your technical expertise fuels strategic decision-making across multiple regions. Own the evolution of a resilient, scalable data ecosystem built on Azure and next-gen analytics tools The Opportunity This is an exciting opportunity to join … a forward-thinking organisation that's putting data at the heart of its strategy and decision-making. You'll play a key role in shaping and managing a modern, cloud-based data infrastructure that supports operations across the UK, Ireland, and North America. As a senior leader within a collaborative data and analytics team … you'll have the freedom to innovate, implement new technologies, and influence how data drives business growth. You'll lead cloud migration initiatives, enhance system performance, and ensure data quality and security at scale. If you're looking to make a measurable impact and take ownership of a global data ecosystem, this role offers More ❯

Senior Data Engineer Location: Trowbridge (Hybrid, 2 days in office) Salary: £70,000 Be part of a forward-thinking data and analytics team shaping the future of our client's operations across the UK, Ireland, and North America. This is a fantastic opportunity to lead data infrastructure projects, including a major cloud migration to … Azure, and support strategic analytics initiatives for both B2C and B2B businesses. Key Responsibilities: Manage and optimize cloud-based data infrastructure (Azure). Lead the migration of data environments to Azure. Maintain high-quality, secure data pipelines with a strong focus on governance. Mentor and support a Data Engineer apprentice. Collaborate across … teams to enhance reporting, analytics, and business intelligence solutions. What You Bring: 5+ years of experience in SQL production environments and data engineering. Strong expertise in SQL, T-SQL, Azure, DataBricks, and SSIS. Experience with data integration, modeling, and performance optimization. Problem-solving mindset and a collaborative approach. Desirable: Experience handling data from APIs More ❯