1 to 25 of 48 Data Pipeline Jobs in the South West

Senior Data Engineer Location : Gloucester - 2 days/3 days WFH per week Salary : Up to £85,000 Benefits : Excellent benefits package, career development and the opportunity to shape a growing data platform. Our client, a leading engineering and manufacturing organisation, is looking to appoint … Senior Data Engineer to play a key role in the evolution of its enterprise data platform. This is an opportunity to influence data strategy, own critical data engineering initiatives, and work with modern cloud technologies to deliver trusted, high-quality data ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … document, row‐based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event‐driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners ...

Location: Warminster, Wiltshire Position Role Type: Hybrid Job Title: Data Architect Function: Engineering Duration: Permanent Hours: Full Time (37 hours per week) Location(s): Warminster Security Clearance: Must be eligible to obtain or currently hold an SC Clearance The role This is more than … ready to fight and win. You’ll work in a matrix organisation and report operationally through OMNIA Training and functionally to the Data Lead. Ultimately, you’ll work for the British Army, championing innovation, and helping shape the future of military collective training. Key Responsibilities Design our scalable ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing … Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data ...

Data Engineer - £500-£550 per day - Inside IR35 - Primarily remote with occasional travel in the south of England - 6 months initial contract. Our client is looking for an experienced Data Engineer to join their growing data team, helping to build and develop a modern … Microsoft Fabric data platform. This is an excellent opportunity to work with the latest Microsoft data technologies, delivering scalable data pipelines, lakehouse solutions and analytics-ready datasets that support reporting, business intelligence and future AI initiatives. The role sits within a People Development function ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

needs Help define and shape forward looking integration and API patterns that scale across the organisation Translate business objectives into pragmatic integrations and data solutions, ensuring delivery is value‐led rather than purely technology‐driven Influence integration architecture decisions by balancing strategic direction, delivery feasibility, and measurable business … with Snowflake data modelling, optimisation, and cost‐aware design Understanding of data quality, lineage, and observability concepts CI/CD pipeline implementation for applications, infrastructure, and data workloads Strong focus on test automation and engineering quality Ability to operate production systems, including incident ...

Lead Data Engineer The Role As a Lead Data Engineer, you will play a key role in building and enhancing a secure, scalable data platform for a high-profile government programme. You will work with both batch and real-time data, leveraging … modern cloud technologies and frameworks. This role involves ingesting data from multiple sources, transforming it into the correct formats, ensuring alignment with defined data models and enabling reliable access for downstream users. Key Responsibilities Design, develop, test and document data pipelines aligned to business ...

Senior Data Engineer Ledbury/Malvern/Gloucester/Cheltenham Area On-site - 5 Days Per Week Up to £85,000 + Benefits Security Clearance: Active SC Clearance Required Methods Business and Digital Technology is a £100M+ IT Services Consultancy delivering complex digital transformation programmes across government … regulated sectors. We are seeking an experienced Senior Data Engineer to join a growing team supporting the delivery of secure, mission-critical data platforms. This role requires an individual who is comfortable operating across hybrid environments, combining on-premises infrastructure with Azure cloud technologies to deliver ...

impressive multinational firm is looking for an accomplished Azure Data Engineer to join its team. Please note the role is hybrid you will work from the office 3 days per week with 2 from home. In this role, you will be responsible for designing, developing, and maintaining scalable … data solutions that provide clean, structured, and accessible data to internal teams, stakeholders, and external partners. Working closely with developers, analysts, and business teams, you will help deliver cloud-based data platforms that support reporting, analytics, and data-driven innovation. In order ...

Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to 500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting high-profile government programmes, is hiring a DV Cleared Data Engineer … join a critical, secure environment. This role involves designing, building, and maintaining robust data pipelines and platforms to enable advanced analytics and intelligence operations. What you'll be doing: Develop, optimise, and support scalable data pipelines (batch and streaming) within secure environments. Manage ETL/ ...

will be joining a fast growing consultancy at the forefront of secure data and cloud infrastructure, building AI-ready platforms for high-impact projects. You'll help build and maintain a secure batch and real-time data platform for a government client. You'll work with … modern commercial and open-source tools to ingest, transform, and deliver data to support analytics and decision-making. Build, test, and maintain data pipelines Design logical and physical data models Support the growth of the data platform to meet new use cases ...

Data EngineerBristol | Hybrid (3 Days Onsite) Salary + Benefits – £60,000 to £71,000 + 10% bonus, 33 days holiday, pension, healthCareer Progression + Modern Tech StackPyspark | ML | AI | Databricks | Kafka | AWSAre you a Data Engineer with strong Python, SQL and PySpark skills who is looking … opportunity to step up and accelerate your career We're partnering with a market-leading technology business that is investing heavily in its data platform and is at the forefront of innovation within the smart housing sector. Processing billions of sensor readings every month, they're looking ...

Join SoftServe as a Data Engineer Apprentice! Kickstart your career designing, building and maintaining data solutions that help organisations make better decisions. You will gain practical experience while working alongside experienced engineers. Role Build and maintain data pipelines to collect, process and transform data. … Assist with ETL development for reporting and analytics. Support integration between business systems and BI platforms. Improve manual data processes through automation. Create reusable datasets for reporting. Monitor and improve data quality. Use SQL and scripting languages to extract and transform data. Support dashboard and report ...

Data Governance & QA Lead Day Rate: £535/day (Inside IR35) Location: Hybrid 1 day/week on site (Corsham) Clearance: DV Clearance or DV eligible required Sector: Public Sector We are seeking an experienced Data Governance & QA Lead to support a cyber security-focused data programme. The role will involve working across a modern Data Lakehouse environment , ensuring data quality, integrity, security, and reliability across end-to-end data pipelines. This is a highly collaborative, client-facing role working closely with technical and business stakeholders to define ...

Data Engineer (MOD DV) Salary: Approx £50,000 - £70,000 per annum (DOE) Locations: Corsham - hybrid depending on project requirements) CPS Group are working with a well-established technology consultancy delivering complex digital and infrastructure solutions into the UK Defence sector. As a Data Engineer … responsible for building and maintaining robust data pipelines, including ETL pipelines, improving data quality, and supporting the delivery of analytics and operational solutions. You'll work across the full project lifecycle, collaborating with technical teams and stakeholders to shape data strategies and deliver meaningful ...

glue' between the company's hardware and cloud intelligence, transforming raw telemetry into cost-saving insights and predictive maintenance through robust data engineering and modern software practices. The focus of this role is to integrate existing and open-source software and hardware to deliver these innovative services. This … includes building and maintaining automated data pipelines, managing cloud infrastructure and creating digital applications using modern analytics and software engineering practices. What We're Looking For Minimum 2 years' experience in Full Stack activities including but not limited to ingestion and storage of data, data ...

Senior Software Engineer - National Security (Data Systems) About the role You'll design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher level ...

Fabric Platform Engineer| Outside IR35 | £400 - £450 | Hybrid We are seeking a Fabric Platform Engineer to join a growing data and analytics team. This role will play a key part in designing, building, and maintaining a modern data platform using Microsoft Fabric, enabling the business … make data-driven decisions at scale. Key Responsibilities Build, maintain, and optimise data solutions within Microsoft Fabric. Build and support data pipelines, integrations, and Lakehouse environments. Ensure platform performance, security, and reliability. Work with stakeholders to deliver data and analytics requirements. Troubleshoot ...

design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential requirements British national only, active SC, and eligible for higher level ...

looking for Data Engineers to help deliver secure, mission-critical solutions for customers across the National Security sector. Working as part of a collaborative engineering team, you'll design and develop scalable data platforms, build robust data pipelines and transform complex datasets into meaningful … insights. You'll have the opportunity to work with modern cloud technologies, distributed systems and large-scale data environments on projects that have real-world impact. Key Responsibilities * Design and develop scalable data pipelines and ingestion frameworks * Integrate, process and enrich data from multiple ...

Senior Software Engineer - National Security (Data Systems) About the role You'll design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems. Essential... WKCL1_UKTJ ...

Senior Software Engineer - National Security (Data Systems) About the role You'll design and deliver scalable data processing solutions … customers operating in highly sensitive, demanding environments. This is hands-on technical work: you'll architect cloud-native systems, lead data pipeline development, and work directly with technical stakeholders to solve complex, real-world problems click apply for full job details ...