1 to 25 of 26 Permanent Data Pipeline Jobs in the South West

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Senior Data Engineer Location : Bristol, Swansea, Leeds, Nottingham, Newcastle, Oldham, Birmingham and Yeading. Salary : Up to £58,997 Job summary A DVSA Senior Data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and BI systems. DVSA Senior Data Engineers: lead the build of data streaming systems optimize the code to ensure processes perform optimally lead work on database management recognize and share opportunities to re-use existing data flows coordinate project teams ...

Role: Consulting Data Engineer Location: Bristol , UK Hybrid 2 Day in a week at Onsite RoleType: Permanent/Full time Job Salary: Depends on experience Role Summary: As a Consulting Data Engineer, youll help design, build and maintain data pipelines and platforms that enable … unlock the value in their data. Are you comfortable working in an ambiguous environment, where you build strong working relationships, and use data to understand client problems? Are you inquisitive and comfortable with questioning and challenge constructively? Sometimes youll work with experienced engineers and data scientists ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team in London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across our clients EMEA banking and securities entities. This is a hands ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

Lead Data Platform Engineer A fast-growing financial technology business is expanding its data capability and is looking for an experienced data professional to help shape and scale its analytics platform. This role is ideal for someone who enjoys building robust data foundations and wants greater exposure to solution design and platform architecture. Youll be instrumental in evolving a cloud-based data environment, enabling reliable reporting, analytics, and downstream decision-making across the organisation. Working alongside product teams, engineers, and business users, youll translate complex requirements into resilient ...

looking for an experienced IT Project Manager to help stand up a new project management function within our expanding technology and data client This is a key role where you’ll shape delivery frameworks, implement best-practice standards, and oversee a portfolio of high-impact projects across … cloud, DevOps, and data. You will manage multiple concurrent projects, working closely with stakeholders across engineering, data, product, and business teams. Key Responsibilities: - Establish and mature a new project management function, including governance, reporting standards, and delivery frameworks. - Lead end-to-end delivery of a variety ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

believe great technology starts with great people - and great decisions start with great data. From managing stock and inventory to understanding our customers, data drives everything we do. We're looking for a Data Engineer to help shape how we collect, structure, and use data … high-quality datasets that power smarter, faster decisions every day. This is a hands-on role where you'll design and maintain the data pipelines, integrations, and platforms that keep Neptune's data accurate, accessible, and secure. Your Key Responsibilities Design, build, and maintain robust ...

translate your vision of a modern marketing function - embracing the latest ideas, methodologies and technologies - into a high performing reality. About the Data Analyst Role As a Data Analyst in Modern’s Digital team, you’ll support the development and delivery of our reporting, measurement … data systems, helping translate raw data into insights that drive client success through our proprietary platform. This is a great fit for someone a year or two into their data career that’s curious, collaborative and ready to learn in a fast-moving digital ...

Data Engineer Salary: £50,000 - £70,000 I am working with a leading organisation that is delivering innovative data solutions to support complex, high-impact projects. This role offers the opportunity to work on challenging and rewarding assignments where you will design and build scalable data … Python or similar programming languages. Awareness of APIs for data retrieval and integration. Experience in stakeholder management and requirements gathering. Understanding of pipeline scheduling and health checks. Some of the package/role details include: Salary up to £70,000 £5,000 annual professional development budget Wellness ...

Role As a Data Engineer, you'll be responsible for designing, building, and maintaining robust data pipelines and architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This … includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently. Key Responsibilities Develop and maintain data ingestion pipelines and orchestration workflows Design database schemas and data models Integrate and enrich data from multiple ...

delivering a unified, trusted view of customer data. We're seeking a highly skilled Lead Databricks Engineer to design and implement scalable data pipelines that form the backbone of our Lakehouse platform, enabling accurate analytics, reporting, and regulatory compliance. You'll work with cutting-edge technologies including Databricks … PySpark , and Azure Data Factory , applying best practices in data engineering and governance to support this critical programme. Lead Databricks Engineer: Key Responsibilities Build and maintain Databricks pipelines (batch and incremental) using PySpark and SQL. Orchestrate end-to-end workflows with Azure Data Factory ...

searching for a Data Analyst/GIS Analyst for an extremely exciting technology and data focused business. The role is offered on a hybrid basis - you will be required to attend meetings and work at the clients Exeter office as and when required. You will therefore … services. You will ensure the quality of these datasets and provide support to the wider business. You will be identifying and implementing data improvements whilst performing maintenance activities on the datasets - collaborating with colleagues and sharing ideas and experiences in vital to success! Working as a Data ...

managing technical roadmaps and stakeholder expectations. Confident working with cloud services (e.g., AWS, Azure) and CI/CD pipelines. Familiarity with reporting systems, data pipelines, and system configuration tools. Exposure to frontend frameworks such as Vue.js or React. Prior involvement in system re-architecture or platform migration projects. ...

works. You will help us automate manual tasks, connect AI agents to our CRM and ERP systems, strengthen customer interactions with data-driven “proof packages,” and explore new AI-enabled capabilities that strengthen our position as a UK leader in custom battery technology. This role is ideal … documentation, production forecasting). Create AI workflows that integrate with our CRM and ERP systems (including IFS Cloud), enabling smarter insights, rapid data retrieval, and improved traceability. Maintain AI agents that support internal teams, including text-analysis bots, report generators, and knowledge-retrieval tools. Data engineering ...

Role Summary We are seeking a highly skilled Data Engineer with strong AIML (LLMs, Generative AI, Agentic AI) and Python expertise to design, develop, and implement AI/ML-driven solutions for Test Automation within the Securities Processing domain. The ideal candidate will work on building innovative AIML … copilots, autonomous AI agents, and MCP-based systems. Build, train, fine-tune, and evaluate AIML models for automation use cases. Develop Python-based data pipelines and algorithms using NLTK, NumPy, Scikit-learn, Pandas. Collaborate with cross-functional teams in an Agile setup (sprint planning, refinement, retrospectives). Integrate ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier ...

Role: Consulting Data Engineer Location: Bristol , UK Hybrid 2 Day in a week at Onsite RoleType: Permanent/Full time Job Salary: Depends on experience Role Summary: As a Consulting Data Engineer, youll help design, build and maintain data pipelines and platforms that enable … clients to unlock the value in their data click apply for full job details ...

Responsibilities Technical Leadership & System Expertise Become the CST technical authority on the MDA system, including (not exhaustive): GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data ...