1 to 25 of 67 Data Pipeline Jobs in the South West

Data Pipeline Engineer (On prem to AWS migration)UtilitiesPredominantly remote: occasional travel to Bristol6 months+£700 - £750 per day In short: We require 3 Data Engineers to join a large on prem to AWS migration programme in replicating data pipelines in readiness … data engineering lifecycle, delivering robust, scalable, and cost-effective solutions on time and within budget. Monitor and drive data pipeline lifecycle, from design and implementation through to optimisation and post-deployment performance analysis. Support operational resilience, ensuring data solutions are maintainable, supportable ...

Data Pipeline Engineer (On prem to AWS migration) Utilities Predominantly remote: occasional travel to Bristol 6 months+ £700 - £750 per day In short: We require 3 Data Engineers to join a large on prem to AWS migration programme in replicating data pipelines … data engineering lifecycle, delivering robust, scalable, and cost-effective solutions on time and within budget. Monitor and drive data pipeline lifecycle, from design and implementation through to optimisation and post-deployment performance analysis. Support operational resilience, ensuring data solutions are maintainable, supportable ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Role: Consulting Data Engineer Location: Bristol , UK Hybrid 2 Day in a week at Onsite RoleType: Permanent/Full time Job Salary: Depends on experience Role Summary: As a Consulting Data Engineer, youll help design, build and maintain data pipelines and platforms that enable … unlock the value in their data. Are you comfortable working in an ambiguous environment, where you build strong working relationships, and use data to understand client problems? Are you inquisitive and comfortable with questioning and challenge constructively? Sometimes youll work with experienced engineers and data scientists ...

year 25 days annual leave plus bank holidays Strong company pension scheme And many more Role and Responsibilities Data Pipeline Development: Design and implement scalable ETL (Extract, Transform, Load) processes to ingest, clean, and transform structured and unstructured data from multiple sources. Ensure pipelines … exchange between systems. Data Quality & Monitoring: Implement validation, error handling, and health checks to maintain data integrity. Schedule and monitor pipeline workflows using orchestration tools. Platform Engineering: Contribute to the design and maintenance of data platforms that support analytics and machine learning workloads. ...

Chief Data Office (CDO) sits within our Chief Technology Office (CTO) and ensures data is managed as one of the organisation’s most valuable assets. As an apprentice in this area, you’ll be exposed to data governance and quality, data management … analytics and insight, regulation and compliance, data culture. Role The Data Engineering and Analytics Apprenticeship Programme within our CTO Function is a 12-month programme and offers an excellent grounding in the fundamental principles of data in one of the UK’s largest wealth ...

description S.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers. Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored … clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer, you may play one or more roles according to their clients' needs. The role ...

Contract Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – full time on site when required Must hold active Enhanced DV Clearance (West) Circa £700 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services. They make sure they provide … maximum value to data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands-on and you'll support as a senior contributor ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team in London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across our clients EMEA banking and securities entities. This is a hands ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

Lead Data Platform Engineer A fast-growing financial technology business is expanding its data capability and is looking for an experienced data professional to help shape and scale its analytics platform. This role is ideal for someone who enjoys building robust data foundations and wants greater exposure to solution design and platform architecture. Youll be instrumental in evolving a cloud-based data environment, enabling reliable reporting, analytics, and downstream decision-making across the organisation. Working alongside product teams, engineers, and business users, youll translate complex requirements into resilient ...

Data Architect – Utilities Industry Location: Bath Hybrid (2 days in the office) Salary - £71k to £85k+ 10% Bonus, combined contribution of 20% pension, Health care, Life Insurance Azure | CI/CD | AI/ML Are you a Data Architect passionate about designing modern data … enable AI and advanced analytics? Do you thrive in enterprise environments where you can lead from the front and shape the future of data architecture? If so, we have an exciting opportunity in the utilities sector. What you’ll do As a Data Architect ...

Senior Data Engineer Bristol 12-Month Contract Paying up to £79p/h (Outside IR35) Role Overview: Our client, a large Aerospace company, is looking for an experienced Senior Data Engineer to assist with building and managing data pipelines using the Elastic Stack (Elasticsearch … Logstash, Kibana) and Apache NiFi Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects ...

About this opportunity : Join our Personalised Experiences and Communications Platform as a Principal Data Engineer. You'll work within multi-functional product engineering teams to deliver top-quality data capabilities, demonstrating your engineering expertise and cloud opportunities What you'll be doing: Architect and implement scalable … resilient, low-latency data systems. Ensure systems meet performance and reliability standards. Collaborate with engineering leadership and stakeholders. Set technical strategy and best practices for data engineering. Deliver solutions for multiple entities within the group. Ensure alignment with business needs and cloud opportunities. Promote secure, high ...

looking for an experienced IT Project Manager to help stand up a new project management function within our expanding technology and data client This is a key role where you’ll shape delivery frameworks, implement best-practice standards, and oversee a portfolio of high-impact projects across … cloud, DevOps, and data. You will manage multiple concurrent projects, working closely with stakeholders across engineering, data, product, and business teams. Key Responsibilities: - Establish and mature a new project management function, including governance, reporting standards, and delivery frameworks. - Lead end-to-end delivery of a variety ...

believe great technology starts with great people - and great decisions start with great data. From managing stock and inventory to understanding our customers, data drives everything we do. We're looking for a Data Engineer to help shape how we collect, structure, and use data … high-quality datasets that power smarter, faster decisions every day. This is a hands-on role where you'll design and maintain the data pipelines, integrations, and platforms that keep Neptune's data accurate, accessible, and secure. Your Key Responsibilities Design, build, and maintain robust ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern’s Digital team, you’ll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that’s curious, collaborative and ready to learn in a fast-moving digital ...

Data Engineer Salary: £50,000 - £70,000 I am working with a leading organisation that is delivering innovative data solutions to support complex, high-impact projects. This role offers the opportunity to work on challenging and rewarding assignments where you will design and build scalable data … Python or similar programming languages. Awareness of APIs for data retrieval and integration. Experience in stakeholder management and requirements gathering. Understanding of pipeline scheduling and health checks. Some of the package/role details include: Salary up to £70,000 £5,000 annual professional development budget Wellness ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This … includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple ...

delivering a unified, trusted view of customer data. We're seeking a highly skilled Lead Databricks Engineer to design and implement scalable data pipelines that form the backbone of our Lakehouse platform, enabling accurate analytics, reporting, and regulatory compliance. You'll work with cutting-edge technologies including Databricks … PySpark , and Azure Data Factory , applying best practices in data engineering and governance to support this critical programme. Lead Databricks Engineer: Key Responsibilities Build and maintain Databricks pipelines (batch and incremental) using PySpark and SQL. Orchestrate end-to-end workflows with Azure Data Factory ...

Role Overview We are looking for a capable and motivated GIS Developer to build, optimise and maintain the council's spatial data systems, helping us to make better decisions and deliver high-value services for residents. You will play a key technical role within the GIS and Data function - designing mapping tools, managing spatial data pipelines, and delivering clear, functional geospatial solutions used across planning, highways, environment, housing and wider council services. This position suits someone who enjoys solving problems, working with code, and turning spatial data into Practical intelligence. Key Responsibilities ...

Role Overview We are looking for a capable and motivated GIS Developer to build, optimise and maintain the council's spatial data systems, helping us to make better decisions and deliver high-value services for residents. You will play a key technical role within the GIS and Data function - designing mapping tools, managing spatial data pipelines, and delivering clear, functional geospatial solutions used across planning, highways, environment, housing and wider council services. This position suits someone who enjoys solving problems, working with code, and turning spatial data into Practical intelligence. Key Responsibilities ...