1 to 25 of 317 Data Pipeline Jobs in the UK excluding London

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Morgan Hunt are working with a housing association in London to recruit an Azure Data Engineer on a permanent basis. The purpose of the role is to lead the implementation of data flows to connect operational systems, data for analytics and BI systems. … Integrate various data platforms and tools to create a cohesive and robust data ecosystem Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services Collaboration: Work closely with data scientists, analysts and other stakeholders ...

Details Role/Job Title: Data Architect Work Location: Warwick Mode of Working (Hybrid/Office-based): Hybrid If Hybrid, how many days are required in office? 3 day in week Role Overview The Principal Data Architect is responsible for defining enterprise-grade data … migrations from enterprise source systems Data security, RBAC, access controls, and compliance frameworks (SoX, GDPR) Troubleshooting complex data pipeline and platform issues Qualifications Essential Significant professional experience in data architecture, data engineering, or data management disciplines Desirable ...

Data Pipeline Engineer (On prem to AWS migration)UtilitiesPredominantly remote: occasional travel to Bristol6 months+£700 - £750 per day In short: We require 3 Data Engineers to join a large on prem to AWS migration programme in replicating data pipelines in readiness … data engineering lifecycle, delivering robust, scalable, and cost-effective solutions on time and within budget. Monitor and drive data pipeline lifecycle, from design and implementation through to optimisation and post-deployment performance analysis. Support operational resilience, ensuring data solutions are maintainable, supportable ...

Implementation: Implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions.• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … data integrity. Azure Services • Utilise Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer.• Ensure the scalability and reliability of data solutions using Azure ...

Business. As the Data & Analytics Engineer, you will be responsible for the foundation of our data stack platform and pipeline architecture to data modelling. You will act as the technical counterpart to the Business Systems team, ensuring that they have clean, governed … users. Process Automation: Eliminate manual interventions in reporting and transformation. Implement continuous ingestion/delivery pipelines to automate testing, version control and code deployment. Pipeline Orchestration: Architect reliable data workflows (using platform-native schedulers) to manage complex dependencies and ensure timely data delivery. Data ...

Title: Senior Data Lead Location: Central London (Hybrid 1-2 days on site) Salary: £80,000 - £90,000 + benefits Overview We are partnering with a fast-growing FinTech startup building a modern, cloud-native banking and financial services platform. They are looking for an experienced Senior Data Lead to take full ownership of data strategy, data delivery, and data migration initiatives across complex internal and client-facing programmes. This is a senior, hands-on leadership role, suited to someone with 5-10 years' experience who combines strong data ...

Snowflake Data Architect - £550 Inside IR35 - Hybrid We are seeking an experienced Data Architect to design, build, and maintain scalable, secure, and high-performing data platforms. The ideal candidate will have strong expertise in Azure-based data solutions, Snowflake, and modern data engineering tools, and will play a key role in shaping our enterprise data architecture to support analytics, reporting, and advanced data use cases. Key Responsibilities* Design and implement end-to-end data architectures using Azure cloud services* Architect and optimize data ...

Security cleared Data Architect PROJECT DESCRIPTION The Data Architect is responsible for designing, creating, deploying, and managing an organization’s data architecture. This role ensures that data across systems is accurate, accessible, secure, and supports business objectives. As a Data Architect, you will have extensive experience in development of data intensive systems. This should include working with customers to derive requirements and design solutions to meet their needs. The successful applicant will be expected to have seen a project through from inception to delivery. To succeed ...

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

Title: Senior Data Engineer Salary: £75,000 - £85,000 Location: London (Hybrid - 2 days on-site) Overview We are seeking a Data Engineer to join a data and analytics function within the energy and environmental services sector. This is a highly impactful … role focused on designing, building, and embedding modern data platforms that support operational insight, business intelligence, and strategic decision-making. Operating in a low data-maturity environment, this role will play a key part in shaping the organisation's data foundations, architecture, and governance. ...

Data Architect (SC Cleared) Location: Edinburgh or Newcastle preferred Other locations considered: Luton, Bristol, Southampton (Hybrid – predominantly onsite ) Contract: 6 months initially (potential to extend) Rate: Up to £69.44 per hour umbrella ( rate may be negotiable ) Clearance: Active SC clearance required Nationality: UK Eyes Only – sole British nationality … required The Opportunity We are seeking an experienced Data Architect to support a high-profile, security-critical programme within a UK government/defence environment. This role focuses on the design, implementation and governance of enterprise-level data architectures , ensuring data is accurate, secure ...

Data Engineer Remote with adhoc travel - Nottingham Up to £60,000 Why apply? Fruition are working with a leading player in its industry, committed to delivering data-driven insights that enhance business performance. With a strong focus on innovation, the company leverages cutting-edge technology … pipelines, managing data warehousing, and ensuring high-quality data is available for business decision-making. Responsibilities: Data Pipeline Development: Design, build, and maintain ETL (Extract, Transform, Load) processes to enable efficient data ingestion and transformation. Database Management: Support and optimise ...

Role: Data Architect Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Rate: £550 - £650 per day Security Clearance: Active SC Clearance required Project Description We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise-scale … data architectures within a secure environment. You will be responsible for ensuring data across systems is accurate, accessible, secure, and aligned to business and technical objectives. The role requires extensive experience delivering data-intensive systems end-to-end, from initial requirements capture through architecture ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data Engineer role focused on designing and delivering modern data platforms using Microsoft technologies. As a Senior Data Engineer , you will work across a varied client base, taking ownership of data solutions from initial scoping through to build and delivery. The Role – Senior ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms ...

pipelines using Python and distributed data processing frameworks. Develop and support multi-tenant data processing systems and data pipeline architecture. Integrate data platforms with cloud services including storage, messaging, monitoring, and security tools. Monitor data quality, performance, and reliability … engineering best practices. Experience working within a cloud environment, ideally Azure (ADF, Storage, Service Bus, Monitor). Solid understanding of data pipeline orchestration, data validation patterns, and ELT/ETL processes. Background in containerisation, CI/CD, and DevOps practices. If youre ready ...

Role: Data Engineer (Automation) Location: Milton Keynes (Hybrid 3 Days In-Office Weekly) Salary: £45,000 - £55,000 Network IT are supporting a large, enterprise-scale organisation as they continue to evolve and modernise their Data Analytics and Automation Platform ; were looking for an experienced Data Engineer to design, build, and optimise secure, automated data pipelines that enable scalable analytics, business intelligence, and data-driven decision-making across multiple business units. This is a highly technical role with strong exposure to cloud and on-prem data platforms , automation ...

ABOUT DIGIMASTERS Digimasters Ltd was founded in 2017 as a digital transformation consultancy focused on technology, business process optimisation and data analytics. Digimasters works across all industries and provides experience in organisations of all sizes. Primarily based in London, UK, we work in many regions including … Architecture, Engineering, and Construction (AEC), as well as other sectors, we have several roles supporting the delivery of technology, business change, and data programmes. THE ROLE We are looking for an experienced Data Engineer to join our delivery team on a contract basis, with a specific ...

sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Architects to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Note, active SC clearance required! Key Responsibilities: Design and implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define ...

recruiting a D2C Data & Business Intelligence Manager to join our D2C Insights team; the team that drives customer-focused, data-led decision making across our direct-to-consumer strategy, product, PR & content, and business development teams. The team are responsible for insights across customer research, customer … write complex queries and repeatable stored procedures. Experience in low-code solutions like DBT is highly desirable Experience of developing data pipeline and automations, for example via Python Data integration using APIs Ownership of systems critical data and string experience of maintenance, development ...

seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve and communicate the existing … enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster and aligned decision ...

Role: Data Engineer Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Security Clearance: Active SC Clearance required Rate: £500 - £600 per day - inside IR35 Project Description We are seeking an experienced Data Engineer to design, build, deploy, and maintain robust data platforms and pipelines within a secure environment. You will be responsible for the end-to-end data engineering lifecycle, transforming raw data into high-quality, consumable datasets that support analytics, reporting, and advanced modelling. You will own and optimise the data operations ...

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...