1 to 25 of 77 Data Pipeline Jobs in the South West

Title: Data Engineer Location: UK Job Type: Full-time About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services … Science, Architecture, etc.) to identify emerging and cross-community issues affecting your role and escalate as necessary. Describe technical, data, pipeline, and production issues to colleagues of different specialisms. Communicate within the team and across teams to monitor expectations around delivery of data ...

Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … looking to expand our multi‐disciplinary team with people from diverse backgrounds who bring data architecture expertise to the digital transformation of our stakeholders' technology landscapes and ways of working. You may currently be a data architect, data engineer, analytics consultant, solution architect ...

from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose … modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

Data Architect Up to £120,000 We are seeking a Data Architect to act as a subject matter expert in building and scaling modern data platforms within the Environmental Services sector. This is a high-impact role focused on designing, evolving and delivering enterprise … patterns, including federated architectures and data-as-a-product concepts Experience with large-scale data processing and data pipeline development What's on Offer Salary up to £120,000 Remote first working - occasional visits to HQ for workshops (on average once per month ...

medical cover, digital GP services, enhanced family‐friendly policies, employee assistance programmes, and reimbursement for professional development. Key Responsibilities Define and maintain enterprise data architecture, including principles, policies, standards, and reference models aligned with JSP453 and Defence‐wide integration frameworks. Develop architecture artefacts including conceptual, logical, and physical … data models, data flows, and architecture blueprints. Translate business and operational needs into data architecture designs, ensuring alignment between enterprise strategy and system‐level implementation. Design data integration patterns and approaches (e.g. APIs, data pipelines, event‐driven architectures) to enable ...

strategic expertise we develop solutions that address our client’s critical challenges supporting digitalisation and security. Key Responsibilities Define and maintain enterprise data architecture, including principles, policies, standards, and reference models aligned with JSP 453 and Defence‐wide integration frameworks. Develop architecture artefacts including conceptual, logical, and physical … data models, data flows, and architecture blueprints. Translate business and operational needs into data architecture designs, ensuring alignment between enterprise strategy and system‐level implementation. Design data integration patterns and approaches (e.g. APIs, data pipelines, event‐driven architectures) to enable ...

engineering squads, leveraging both UK engineering resource and RecoTek (Reconomy’s near-shore technology scaling hub based in Bucharest), focused on delivering innovative data‐centric products for Valpak and the wider Reconomy business. Reporting to the Chief Technology Officer (Comply) and being an active member of the Comply … Comply division and the wider Reconomy organisation. This senior leadership role will be responsible for defining and driving the delivery of a modern data platform for Valpak and Comply, contributing to and aligning with the wider Reconomy Data Strategy; using Azure Cloud technologies, overseeing the development ...

About The Role Team Data and Information Services Working Pattern - Hybrid 2days per week in the Vitality Bournemouth or London Office.Full time hours per week. We are happy to discuss flexible working! Top 3 skills needed for this role: Proven delivery of scalable data solutions Demonstrated … expertise in modern data engineering practices Established capability in stakeholder engagement and cross-team collaboration What this role is all about: Were looking for a Senior Data Engineer whos passionate about using data to make a positive impact. Youll take ownership of building scalable ...

Business Intelligence/Data Engineer (AWS/AI Exposure) Swindon or London - Hybrid (Once per month onsite) £530 PD – Inside IR 35 – 3 months (likely extension) – Start ASAP. Our trusted client, that operates within the public sector and helps millions of people in the UK with funding investment … Data-based solutions and engineering stack (e.g. Glue, S3, Lambda, Redshift, Athena) SQL (advanced level) Python (for data processing and pipeline development) Infrastructure and tooling exposure (e.g. Terraform, APIs, CI/CD) AI/ML Exposure (Key Requirement): Practical exposure to AI/ML, such ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … following essential criteria and additionally have some experience (or a genuine interest in learning) from the preferred criteria. Essential Data pipeline development using data processing technologies and frameworks Agile or other rapid application development methods Data modelling and understanding of different data ...

Data Engineer - Defence ££60,000 - £90,000 GBP Hybrid WORKING Location: Manchester;Bristol;London;Newcaslte , Manchester, North West - United Kingdom Type: Permanent Data Engineer Newcastle | Manchester | Bristol | London | Hybrid | Permanent Our client is a specialist technology consultancy delivering high-impact engineering across defence and complex environments … engineering within defence and secure environments Modern cloud-based data platforms and distributed systems End-to-end data pipeline design and optimisation High-assurance, real-world engineering challenges Embedded delivery within client environments Why Join: Work on mission-critical data systems ...

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data … ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time ...

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data … ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time ...

Data Platform Engineer -Contract - Outside IR35 -Remote first -ASAP Start Currently recruiting for seasoned Data Platform Engineer to join our market-leading client, through a period of growth and innovation. They are seeking a seasoned Data Platform Engineer with a blend … data retention policies/data management AWS experience (core AWS platform) Ability to automate processes Appreciation of Python software engineering (pipeline patterns + ingestion frameworks) Terraform/Infrastructure as Code beneficial Comfortable working in fast-moving squads Collaborative in nature The above is not exhaustive. ...

Data Engineer – Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions data ...

people across the globe. Join us on this journey to redefine resource management—and change lives along the way. The Role As a Data Analyst at Air Apps, you will be responsible for analyzing and interpreting data to drive business insights and optimize product performance. … Experience working with large datasets and cloud-based data warehouses (BigQuery, Redshift, Snowflake). Familiarity with ETL processes and data pipeline optimization is a plus. Ability to work in a fast-paced, data-driven environment and manage multiple projects. What benefits ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte’s Fastest 50, you’ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you’ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

Senior Data Engineer - Greater Manchester An exciting opportunity has arisen for a Senior Data Engineer to join my client’s dynamic and growing data team. In this role, you will work across the full data lifecycle—streaming, enrichment, and curation—within … cloud-based environment. You will be responsible for ensuring data quality, integrating key data sets, and supporting the insights and data science teams. As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access ...

Senior Data Engineer - Greater Manchester An exciting opportunity has arisen for a Senior Data Engineer to join my client’s dynamic and growing data team. In this role, you will work across the full data lifecycle—streaming, enrichment, and curation—within … cloud-based environment. You will be responsible for ensuring data quality, integrating key data sets, and supporting the insights and data science teams. As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access ...

Data Architect - Contract 6 months initial Outside IR35 - £600-700pd South Coast - Hybrid 2 days This is a customer and rewards data initiative focused on data mapping and bringing together multiple data domains across points, partners, customer engagement, and redemption journeys. … work involves integrating and aligning data across a complex mix of legacy and modern systems to create a consistent end-to-end view of the platform. The environment includes strong engineering capability across microservices, cloud, AI, and data-driven services, alongside complex integration across an existing ...

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible … business value. This is not a role for someone just moving data from A to B with Python — it’s for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. ...

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible … business value. This is not a role for someone just moving data from A to B with Python — it’s for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. ...

Data and AI Engineers & Architects | Cheltenham | £80,000 - £140,000 About the Opportunity Sanderson G&D are partnering exclusively with a fast-growing data consultancy specialising in designing, building, and operating AI-ready data infrastructure for some of the UK's most complex … maintain secure batch and real-time data pipelines for government clients. You'll work across data ingestion, modelling, and pipeline development, ensuring data is available, reliable, and aligned to target architectures. What We're Looking For Across all three roles, the following experience ...