1 to 25 of 34 Data Pipeline Jobs in the South West

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Senior Data Engineer Location : Bristol, Swansea, Leeds, Nottingham, Newcastle, Oldham, Birmingham and Yeading. Salary : Up to £58,997 Job summary A DVSA Senior Data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and BI systems. DVSA Senior Data Engineers: lead the build of data streaming systems optimize the code to ensure processes perform optimally lead work on database management recognize and share opportunities to re-use existing data flows coordinate project teams ...

Role: Consulting Data Engineer Location: Bristol , UK Hybrid 2 Day in a week at Onsite RoleType: Permanent/Full time Job Salary: Depends on experience Role Summary: As a Consulting Data Engineer, youll help design, build and maintain data pipelines and platforms that enable … unlock the value in their data. Are you comfortable working in an ambiguous environment, where you build strong working relationships, and use data to understand client problems? Are you inquisitive and comfortable with questioning and challenge constructively? Sometimes youll work with experienced engineers and data scientists ...

Chief Data Office (CDO) sits within our Chief Technology Office (CTO) and ensures data is managed as one of the organisation’s most valuable assets. As an apprentice in this area, you’ll be exposed to data governance and quality, data management … analytics and insight, regulation and compliance, data culture. Role The Data Engineering and Analytics Apprenticeship Programme within our CTO Function is a 12-month programme and offers an excellent grounding in the fundamental principles of data in one of the UK’s largest wealth ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team in London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across our clients EMEA banking and securities entities. This is a hands ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

Lead Data Platform Engineer A fast-growing financial technology business is expanding its data capability and is looking for an experienced data professional to help shape and scale its analytics platform. This role is ideal for someone who enjoys building robust data foundations and wants greater exposure to solution design and platform architecture. Youll be instrumental in evolving a cloud-based data environment, enabling reliable reporting, analytics, and downstream decision-making across the organisation. Working alongside product teams, engineers, and business users, youll translate complex requirements into resilient ...

looking for an experienced IT Project Manager to help stand up a new project management function within our expanding technology and data client This is a key role where you’ll shape delivery frameworks, implement best-practice standards, and oversee a portfolio of high-impact projects across … cloud, DevOps, and data. You will manage multiple concurrent projects, working closely with stakeholders across engineering, data, product, and business teams. Key Responsibilities: - Establish and mature a new project management function, including governance, reporting standards, and delivery frameworks. - Lead end-to-end delivery of a variety ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

believe great technology starts with great people - and great decisions start with great data. From managing stock and inventory to understanding our customers, data drives everything we do. We're looking for a Data Engineer to help shape how we collect, structure, and use data … high-quality datasets that power smarter, faster decisions every day. This is a hands-on role where you'll design and maintain the data pipelines, integrations, and platforms that keep Neptune's data accurate, accessible, and secure. Your Key Responsibilities Design, build, and maintain robust ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern’s Digital team, you’ll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that’s curious, collaborative and ready to learn in a fast-moving digital ...

Data Engineer Salary: £50,000 - £70,000 I am working with a leading organisation that is delivering innovative data solutions to support complex, high-impact projects. This role offers the opportunity to work on challenging and rewarding assignments where you will design and build scalable data … Python or similar programming languages. Awareness of APIs for data retrieval and integration. Experience in stakeholder management and requirements gathering. Understanding of pipeline scheduling and health checks. Some of the package/role details include: Salary up to £70,000 £5,000 annual professional development budget Wellness ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This … includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple ...

delivering a unified, trusted view of customer data. We're seeking a highly skilled Lead Databricks Engineer to design and implement scalable data pipelines that form the backbone of our Lakehouse platform, enabling accurate analytics, reporting, and regulatory compliance. You'll work with cutting-edge technologies including Databricks … PySpark , and Azure Data Factory , applying best practices in data engineering and governance to support this critical programme. Lead Databricks Engineer: Key Responsibilities Build and maintain Databricks pipelines (batch and incremental) using PySpark and SQL. Orchestrate end-to-end workflows with Azure Data Factory ...

Role Overview We are looking for a capable and motivated GIS Developer to build, optimise and maintain the council's spatial data systems, helping us to make better decisions and deliver high-value services for residents. You will play a key technical role within the GIS and Data function - designing mapping tools, managing spatial data pipelines, and delivering clear, functional geospatial solutions used across planning, highways, environment, housing and wider council services. This position suits someone who enjoys solving problems, working with code, and turning spatial data into Practical intelligence. Key Responsibilities ...

Data Science & AI Graduate Scheme (Bristol) Your AI era starts now At Lloyds Banking Group, data isnt just something we store in the cloud. Its the juice that keeps ideas flowing, decisions sharper, and progress unstoppable. Our Chief Data & Analytics Office has one mission … weave data, analytics and AI into every decision we make. The goal? Simple. Every choice, everywhere, driven by data. As a Data Science & AI Graduate, you wont be on the sidelines watching the algorithms run the show. Youll be training models, crafting algorithms, deploying scalable solutions ...

searching for a Data Analyst/GIS Analyst for an extremely exciting technology and data focused business. The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore … services. You will ensure the quality of these datasets and provide support to the wider business. You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success! Working as a Data ...

data ingestion and scheduling processes via Azure Data Factory Reverse-engineer, document, and communicate existing data flows and pipeline structures for handover to internal teams Requirements: Strong hands-on experience with Databricks , including notebooks, Delta Lake, and Genie bots Proven background in designing … maintaining ETL pipelines , including debugging and optimisation Advanced Python skills for transformation, automation, and pipeline development Solid SQL proficiency for querying, validation, and performance tuning Experience using GitHub for version control, collaboration, and code management At Venn Group, we endeavour to respond to all applications However ...

Data Science and AI Industrial Placement (Bristol) Your AI era starts now At Lloyds Banking Group, data isnt just something we store in the cloud. Its the juice that keeps ideas flowing, decisions sharper, and progress unstoppable. Our Chief Data & Analytics Office … mission: weave data, analytics and AI into every decision we make. The goal? Simple. Every choice, everywhere, driven by data. On our Data Science & AI Industrial Placement, you wont be on the sidelines watching the algorithms run the show. Youll be training models, crafting algorithms, deploying ...

managing technical roadmaps and stakeholder expectations. Confident working with cloud services (e.g., AWS, Azure) and CI/CD pipelines. Familiarity with reporting systems, data pipelines, and system configuration tools. Exposure to frontend frameworks such as Vue.js or React. Prior involvement in system re-architecture or platform migration projects. ...

with global AI teams in Canada and France as well as local engineering stakeholders in Gloucester. This is not a research or deep data science role — instead, you will apply software engineering fundamentals , support the integration and deployment of AI-based tools, and help uplift engineering capability through … that integrate AI/ML functionality. Build robust, high-quality Python applications used within engineering workflows. Contribute to the design and implementation of data pipelines and data storage solutions. Support troubleshooting, optimisation, and ongoing maintenance of AI-enabled systems. Lightweight AI/ML Integration Prototype ...

Data Engineer Location: 70 Redcliff Street, BS1 6AL Start Date: ASAP Contract Duration: 3+ months Working Hours: Mon – Fri, 09:00 – 17:00, 37 Hours per week Pay Rate: £ 200.00 per day Job Ref: (phone number removed) Job Responsibilities Analyze and document existing data pipelines, including … debug ETL pipelines. Use SQL for querying, validation, and optimization in the Lakehouse environment. Person Specifications Must Have Advanced skills in Python for ETL pipeline development. Strong experience with Databricks and related tools. Proven ability to design and optimize ETL pipelines. Strong SQL skills. Nice to Have Experience with ...