1 to 25 of 84 Data Pipeline Jobs in the South West

summary We are seeking an experienced Senior Data Engineer to provide technical leadership and hands-on expertise within the Southwest Secure Data Environment (SWSDE). SWSDE enables secure use of health and care data for research, innovation, service improvement and transformation. Working with … processing activities. Strong problem-solving skills and ability to work effectively in complex, ambiguous and rapidly changing environments. Desirable Experience analysing platform performance, pipeline performance, data quality metrics or cloud based engineering workloads. Experience applying analytical techniques to support data validation, optimisation and continuous ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you're an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … with organizational standards. Implement CI/CD practices and support deployment automation using Azure DevOps. Monitor, troubleshoot, and resolve data platform and pipeline issues. Collaborate with business stakeholders, analysts, and developers to deliver data-driven solutions. Create and maintain technical documentation, data dictionaries ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

Data Pipeline Manager Vacancy Type: Full Time, Permanent Location: Stratford-upon-Avon (Hybrid) Salary: Competitive + Up to 10% Bonus and Benefits Why choose Valpak? Valpak has created a friendly and supportive working environment that enables our team to perform to the best of their abilities, with … improve accuracy and utilise the data to improve knowledge within the sector. What will I be doing? As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £72,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS … across financial, operational, and leasing functions, providing a single source of truth for asset, fund, and portfolio performance. Key Responsibilities Data Pipeline Development Data Platform Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some ...

Vacancy# Data Engineer* Nuclear* Permanent/Digital* Bristol* United Kingdom* 23/01/26* On site* Share## Job Description **The Job Mission**The **Data Engineer** is responsible for designing, building, testing, and operating robust data products that underpin Assystem’s analytics and reporting … reliability through optimisation, monitoring, and continuous improvement* Support troubleshooting and resolution of data quality or performance issues across the data pipeline **Contextual Information**The Data Engineer operates within an **Information Management Pod**, delivering technical solutions based on architectures defined by the **Data ...

operations run reliably at scale. As a Multimodal Data Capture Manager, you will own the end-to-end data acquisition pipeline for Reach Industries’s AI systems. You will work closely with AI engineers, product leaders, scientists, and external partners to ensure we are consistently … internal teams, contractors, partners, and customers. Build repeatable, well‐documented processes that allow data capture to scale without chaos. Data Pipeline Ownership Own the pipeline from raw data capture through storage, validation, and delivery to downstream teams. Work with engineering to ensure ...

next Data Engineer, you'll be managing and developing data pipelines that transform raw data into valuable insights for Roke's National Security customers, enabling downstream analytics and reporting. You'll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets. What You'll Do * Data pipeline development - Data ingestion and pipeline orchestration design and tooling. * Database schema design/database modelling * Data integration - Integrating ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … document, row‐based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event‐driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners ...

client is a global investment management company. Job Title Data Engineering Technical Lead The Role The Data Engineering Technical Lead will play a critical role in shaping and delivering our Europe's data and analytics capabilities. Working within the Chief Data & Analytics … Office (CDAO), this role will lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful ...

deliver enduring results, enabling you to build a lasting career. Isn't it time you joined us? Job DescriptionAs a Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data … document, row-based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners ...

site travel as well. Opportunity to condense the hours of work. This role is inside IR35. What you will do as a Senior Data Engineer Design, build and maintain secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop … engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with parquet and S3-compatible object storage. Experience with REST API integration. Experience ...

Lead Data Engineer – Databricks Up to £75,000 | Permanent | Huddersfield | 4 days onsite Want to build the data platform rather than just maintain one? This is an opportunity for a hands‐on Lead Data Engineer to play a key role in a major data transformation – moving a complex, multi‐site UK organisation away from fragmented legacy data and manual processes towards a modern Databricks environment . There's plenty to build, plenty to improve and a genuine opportunity to influence how Data Engineering is done. We're looking ...

Valpak, the UK’s leading provider of environmental compliance, invites applications for a Data Pipeline Manager on a permanent basis. This role offers primarily remote working, with occasional travel to our Stratford-upon-Avon office, typically quarterly. As Data Pipeline Manager, you will lead … person team building and maintaining scalable data pipelines, overseeing Talend-based workflows, and ensuring high data quality across systems such as Qlik and central databases to support reporting #J-18808-Ljbffr ...

Data Engineer Clearance Required: Active SC Clearance (Mandatory) The Opportunity We're looking for a talented Data Engineer to join a growing team delivering secure, large-scale data solutions for government and public sector customers. This is an exciting opportunity to work on complex … data platforms that support critical decision-making and operational outcomes. You'll play a key role in building and enhancing secure batch and real-time data processing capabilities, working with modern cloud technologies and industry-leading open-source tools. As part of a collaborative Agile team ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

client is a public sector technology consultancy. Description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain … these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Your role at our client As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands ...

client is a geospatial and data technology company. Join the Growth Story at our client Our client operates at the heart of the UKs most sensitive and high-profile operations. Our approach is entirely mission-focused, enabling customers to see more, decide faster, and act with confidence across … complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. Our solutions are secure-by-design, built ...

Senior Data Engineer Location: Wiltshire Contract: 2 months Pay: Up to 62.50p/h Inside IR35 (DOE) Due to the nature of the work, we require candidates who already hold active MOD DV clearance . Responsibilities: Design, build and maintain secure, scalable data solutions across … engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST API integration. Experience ...

Senior Data Engineer Location: Wiltshire Contract: 2 months Pay: Up to£62.50p/h Inside IR35 (DOE) Due to the nature of the work, we require candidates who already hold active MOD DV clearance . Responsibilities: Design, build and maintain secure, scalable data solutions across … engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST API integration. Experience ...

infrastructure that underpins Watson-Marlow’s connected products and industrial IoT capabilities. The role will initially focus on DevOps, cloud platform operations, IoT data flows, deployment automation, environment management, monitoring, and secure integration between connected devices, cloud services, data platforms, and engineering teams. … capability matures, the role will provide a clear development path into MLOps and ML platform engineering, supporting model deployment, model lifecycle controls, ML pipeline automation, and governed promotion of machine learning solutions from development into production. Key Responsibilities DevOps, cloud operations and platform reliability Build, maintain and improve automation ...

engineering, project management and digital solutions. Job Description Overview Working on a major nuclear power plant project with experience in Databricks, the Data Engineer will be responsible for designing, developing, testing, and supporting data products that underpin reporting, analytics, and operational decision-making across the project … programme. Working within a multidisciplinary Data & Analytics team, the successful candidate will use Databricks, SQL, Python, and Microsoft technologies to deliver robust, scalable, and maintainable data solutions. They will collaborate closely with Data Architects and Performance Analysts to transform business requirements into high-quality ...

Data Engineering Lead - Databricks Bristol (Hybrid - 3 Days per Week Onsite) Up to £75,000 - £90,000 + Bonus + Excellent Benefits We're partnering with a well-established, highly successful UK organisation undergoing a significant data transformation programme. As part of their continued investment … data and technology, they're seeking aData Engineering Leadto drive technical excellence, mentor a talented team, and play a key role in the evolution of their cloud-based data landscape. Data Engineering Lead- The Opportunity This is an exciting leadership role where ...