1 to 25 of 42 Permanent Data Pipeline Jobs in the South West

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … scaling fast and now looking for their very first Data Engineer. You’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. You’ll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, you’ll be the go-to person. You More ❯

Senior Data Engineer Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest … theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, youll be the go-to person. You'll More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Location: Worcester Duration: 6 month initial contract Rate: (Outside IR35) Security: Active DV clearance required Role details: We are looking for 3 x Data Engineers to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi … These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache More ❯

Job Description: Senior Data Engineer £450 - Inside IR35 Remote Working 3-6 Months (very likely to be extended) We are seeking a highly skilled Senior Data Engineer to join a dynamic public sector organisation at the forefront of data-driven transformation. This is a key role within our data and technology team … helping to design and deliver robust, scalable data solutions that support mission-critical services across the UK. As a Senior Data Engineer, you will take ownership of building and optimising our ETL pipelines, managing large-scale datasets, and implementing cutting-edge data engineering practices using Python and modern Big Data technologies. As … a Data Engineer you will be responsible for: Design, build, and maintain robust ETL/ELT pipelines across multiple data sources and formats Develop and optimise scalable data solutions using Python and distributed computing tools Work with structured and unstructured data across on-prem and cloud-based data platforms Support More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're … looking for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from … across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

Principal Data Engineer - Bristol (hybrid 50:50) - Up to £80,000 (+bonus and great package) Our client are creating a new data platform to be the engine-room of their new digital products and tools. They need a hands on, talented Principal Data Engineer who can demonstrate versatility and has a broad of skills … from designing, implementing, and maintaining data pipelines, developing data solutions, configuring cloud environments, establishing new processes and adhering to strong governance. The successful candidate will be an experienced data engineering professional with 5+ years’ experience. The position is very likely to grow into a 'head of' role over time. You will scope, design and … Git for source code management and collaboration in a development environment o Experience using CI/CD best practices and tools like Azure DevOps to automate data pipeline deployment. o Experience with scripting languages like Python, particularly in data engineering tasks like data processing, automation, and integrating with external systems (e.g., APIs, databases More ❯

Are you a Data Engineer who would like to work with Microsoft Fabric supporting a companys digital transformation by building robust and scalable data infrastructure? Our client will move from legacy to Microsoft Fabric with OneLake, Azure Data Factory and Azure Data Lake and you can be a key part of this … move. THE OPPORTUNITY In this role of Data Engineer, youll ensure data is efficiently collected, transformed, and made available for analytics and decision-making across the business. To do this role, youll: Liaise with the business to understand data requirements and define data needs. Identify the data then design and … maintain data pipelines using Microsoft Fabric (OneLake etc) and Azure Data Factory that integrate to other applications including ERP. This data will be provided to a BI Analyst to create dashboards etc with Power BI. Integrate data from various applications such as ERP, IoT devices and external sources Implement data More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

If you're someone who thrives on solving real-world problems with clean, scalable code, we want to hear from you. We're looking for a hands-on Data Engineer to help us shape the future of data in a fast-paced FinTech business who are evolving their data strategy. Working closely with the … data is managed and deliver to customers. Why this role? Major voice in shaping how we build and scale our data products Involved in automation, pipeline design, and machine learning projects High-impact role … in a small, agile team with real ownership You'll need: Strong Python and SQL Solid AWS experience (Glue, Lambda, SQS, S3, etc.) Experience building/maintaining ETL pipelines Data modelling and warehousing knowledge (PostgreSQL, Redshift, Snowflake etc.) Self-starter mindset, you'll get stuck in and find answers independently to bring back to the team Drive to More ❯

Like data and love solving problems? Want to work on a number of new and exciting data projects and help deliver a BI & Data strategy for a growing organisation? You're probably looking for a role that challenges you daily, a role where your efforts aren't focused mostly on maintenance and support. You … want to be working on varied data projects and utilising the full set of your technology skills whilst driving new areas like Azure/cloud, and all the new tools to play with - Azure Data Factory, Azure Databricks - what about AI? In this predominantly remote you will help create, mature, and grow, a data … Azure data solution to release the power and potential of the data across the organisation. We need a few basics from you: Data pipeline creation Strong ETL development experience with Azure Data Factory Datawarehouse and data storage concepts - star schema/snowflake/Kimball Azure Databricks and AI Power More ❯

Data Scientist - Hybrid (Bristol-based) £40,000 - £45,000 (up to £50,000 for exceptional candidates) Hybrid Working | Python & Pandas Are you passionate about data and ready to make a real impact in the world of cyber risk? We're working with a forward-thinking company that's pioneering cyber risk modelling using advanced stochastic techniques … and they're on the lookout for a skilled Data Scientist to join their growing team. This is a brilliant opportunity for someone with a sharp analytical mind and solid Python skills, who enjoys building efficient data pipelines and uncovering insights from complex datasets. The Role You'll play a key role in cleaning, enriching, and … preparing insurance portfolio data that feeds into cutting-edge risk models. From day one, you'll work closely with modellers, data scientists, and engineering experts to ensure high data quality and process efficiency. The work you do will directly influence insights into cyber exposure and risk trends. Key Responsibilities Clean, validate, and standardise large More ❯