1 to 25 of 344 Data Pipeline Jobs in the UK excluding London

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

summary The Head of Data Platforms, Data Quality and Engineering provides senior strategic and technical leadership for MPFT's enterprise data platforms, cloud technologies, data quality frameworks, and engineering functions. As the Trust's senior accountable officer for data quality … senior accountable officer for data quality by design, ensuring national datasets (MHSDS, CSDS, etc.) are robust, welldocumented and accurate, and that pipeline failures, data anomalies and submission risks are proactively mitigated.This aligns directly with the below objectives to: consolidate leadership roles, address benchmarking variation, strengthen ...

governance, security and accessibility across data platforms Develop scalable data transformation logic using Python, SQL and Spark-based frameworks Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency Work closely with data scientists, analysts and engineering teams … initiatives Implement best practices for data modelling, metadata management and data lineage Produce technical documentation including data architecture, pipeline design and data flow diagrams Support continuous improvement of data platforms through optimisation, automation and performance tuning Qualifications and experience ...

Write and optimise SQL queries and data models Develop data processing logic using Python Debug and troubleshoot data pipeline issues Ensure data quality and reliability across pipelines Integrate multiple data sources into Azure environment Support analytics and reporting data … Factory (ADF) knowledge Experience with Snowflake data platform Databricks experience Strong SQL skills Python for data engineering Data pipeline debugging and optimisation Experience building ETL/ELT pipelines Good communication skills Hands-on delivery experience Desirable Experience 6–8 years Data ...

summary What you'll lead Working as part of BrisDoc's Business Transformation team, the Senior Data Engineer will take a lead role in developing and building our cloud architecture, data lake and warehousing, and data pipelines to support the organisation's service development … hours urgent care services during an important time of change and development in NHS care, with a shift to more digitised, technological and data-driven services that support the delivery of excellent healthcare services. The role will work across BrisDoc and its clinical, operational and back-office services ...

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience Contract Type: Permanent We're looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production ...

Data Architect 6 month contract Glasgow 2-3 days per week £700 per day We are seeking an experienced Data Architect who can define, govern, and deliver GDPR compliant enterprise data architectures across relational (Oracle), NoSQL, unstructured data platforms, and Data Warehouse. The ideal candidate will possess strong expertise in data integration, migration, and centralisation initiatives, ensuring privacy by design across complex, distributed data landscapes. Key Responsibilities: Data Architecture & Modelling: - Define enterprise data architecture aligned with GDPR and organisational data ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Warwick (Hybrid Working) Contract: 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead … develop, and maintain ETL/ELT processes utilising tools such as Matillion. Create and maintain optimal data flows and data pipeline architectures. Develop and manage data warehouse objects, including tables, views, and security roles in Snowflake. Extract data from diverse sources ...

analytics teams. Design architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data … transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability ...

Data Engineer Location: Warwick, UK (office based) Day Rate: Market rate (Inside IR35) Duration: 6 months Role description This role is for an experienced Azure Data Engineer to support the design, development and optimisation of data solutions within a modern cloud-based environment. … Python for data engineering tasks Strong SQL knowledge and experience working with relational databases Experience in debugging and resolving data pipeline issues Understanding of data architecture and best practices in data engineering Good communication skills with the ability to work collaboratively ...

High-Growth Technology Consultancy | Hybrid (UK) Ready to work on complex, high-impact data challenges across industries like Private Capital Clients and Financial Services? We’re a fast-growing technology consultancy delivering advanced engineering solutions in highly demanding environments. Our model focuses on deploying top-tier engineers into … mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid working with flexibility Collaborate with ...

Company description: SGB Job description: Data Engineer Location: Milton Keynes Working Hours: Monday to Friday (8.45am – 5pm) Salary: From £60,000 plus excellent benefits package, including: Hybrid working Eligibility to annual bonus scheme Access to a fantastic loan car scheme 25 days annual leave plus bank holidays Competitive … platform Data Quality & Monitoring Implement data quality checks, validation rules and monitoring processes Develop alerting and logging mechanisms for pipeline failures and data issues Identify, troubleshoot and resolve data inconsistencies and failures Work with upstream system owners to improve data ...

core part of HDI's data transformation agenda, enabling improved decision-making, automation, and analytics maturity. Key accountabilities Data Pipeline Engineering & Integration Design, develop, and maintain end to end ingestion pipelines into appropriate data technologies such as Snowflake from internal systems (policy admin … sizing, storage costs, and compute efficiency. Implement workload separation, time travel optimisation, clustering, and pruning strategies. Documentation & Knowledge Sharing Produce comprehensive documentation for pipelines, data models, data flows, and architecture components. Provide technical guidance to junior team members and evangelise engineering best practices. Skills & experience Technical ...

arriving from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team.Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. * Ensure Silver and Gold layer data products are fit for purpose … modelling - conceptual, logical and physical. Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata ...

Location: Hessle Salary: £50,000–£60,000 depending on experience Contract Type: Permanent We're looking for a Data Engineer with experience in Business Intelligence to join a forward-thinking organisation modernising its data ecosystem. This role is ideally suited to someone operating at a strong … level, looking to deepen their technical capability while gaining exposure to more advanced data engineering and architectural concepts. As a Data Engineer, you'll work with data from systems such as SAP, Salesforce and production environments, helping to ensure it is connected, structured ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … Summary: The Senior data engineer role will have a specific focus on data and integration, ensuring that they drive single version of the truth by developing and maintaining reliable solutions to store and manage key data. The role will source, model, and provide data ...

Raytheon UK is searching for a Data Engineer to join our OMNIA Training team. As a Data Engineer, you will be critical to the successful delivery of the programme, collaborating within matrix organisation, with multi-disciplinary teams within Engineering. The role: This is more than … British Army is ready to fight and win. Key Responsibilities: Collaborate with engineering, simulation, customer, third party and training teams to ensure seamless data management and integration across military training environments. Ensuring the security and compliance of data environments through the implementation of appropriate security controls ...

Description We’re looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. You’ll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. You’ll work closely … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Head of Data & AI Permanent Opportunity Ipswich, UK (Hybrid 3 days in office) Visa Sponsorship not available We are partnering with a well-established organisation based in Ipswich, UK , undergoing a major data and AI transformation. They are seeking a highly skilled and visionary Head … Architecture, Platforms & Engineering Lead transition to modern, scalable, and resilient data platforms. Oversee secure, reliable, and scalable data pipeline architecture. Ensure robust implementation and operation of secure data infrastructure. Data Governance Implement strong governance frameworks covering stewardship, metadata ...

role , operating close to production systems, data flows, and operational processes, in collaboration with Data Architects, service managers, and Healthcare pipeline SMEs. Key Responsibilities 1. Critical Pipeline Operation & Stabilisation Develop and understanding of day‐to‐day operation of critical data engineering pipelines … . Investigate and resolve pipeline failures, data issues, and processing delays. Identify and address: Fragility in pipeline execution Manual or error‐prone operational steps Recurrent failure patterns Contribute directly to ensuring operational continuity for high‐risk pipelines. 2. Pipeline Analysis & Technical Understanding Deeply understand ...

passionate about data and eager to advance your career in a dynamic environment? Join our client as a Data Engineer and drive the growth and efficiency of the Data Warehouse and Data Pipelines alongside a talented team. This role is perfect … models using dbt Core and VS Code. Data Source Integration : Integrate new data sources into the Data Pipeline and Data Warehouse. Essential Skills and Experience : SQL : Proficiency in PostgreSQL or Snowflake SQL. dbt Experience : Preferably with dbt Core. Business Process ...

Technical Data Product Manager/Technical Data Product Owner/Head of Data Product/Senior Data Product Owner/Senior Data Product Manager We're looking for a number of Technical Data Product owners … conduit between the Data engineering and Platform team and our clients business stakeholders. You will be instrumental in ensuring the requirements are detailed and thorough, to enable the Data team to build and deliver effectively and efficiently. The role will be circa 40% working with ...

Senior Data Engineer Northwest/Remote (UK-based) £65,000-£75,000 We are partnering with a leading organisation to recruit an experienced Senior Data Engineer to play a key role in the design, development, and optimisation of modern data platforms. This position sits … change initiatives and driving adoption of new technologies Skills & Qualifications Strong expertise in data modelling, database design, and data pipeline development Experience with both SQL and NoSQL technologies Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with ...

deploying top-tier engineers into mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid … working with flexibility Collaborate with high-performing engineering teams Exposure to modern data stacks and cloud technologies Clear progression in a growing consultancy The Role You’ll design, build, and optimise data pipelines and systems that support critical business decisions. Key Responsibilities Build and maintain data ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...