1 to 25 of 455 Permanent Data Pipeline Jobs in the UK

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Morgan Hunt are working with a housing association in London to recruit an Azure Data Engineer on a permanent basis. The purpose of the role is to lead the implementation of data flows to connect operational systems, data for analytics and BI systems. … Integrate various data platforms and tools to create a cohesive and robust data ecosystem Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services Collaboration: Work closely with data scientists, analysts and other stakeholders ...

Product Manager – Data & Data Science Remote (UK) Up to £90,000 + Benefits About the Company Our client is an award-winning search intelligence platform that helps global brands, marketers, and agencies gain an unparalleled understanding of the paid search landscape. Powered by patented AI technology … intelligence for over a decade. In 2024, they secured multiple industry awards including Best AI Search Software Solution , Best Use of AI for Data , and Best PPC Management Software Suite . You’ll be joining a business that combines the maturity and stability of an established company with ...

Implementation: Implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions.• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … data integrity. Azure Services • Utilise Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer.• Ensure the scalability and reliability of data solutions using Azure ...

Business. As the Data & Analytics Engineer, you will be responsible for the foundation of our data stack platform and pipeline architecture to data modelling. You will act as the technical counterpart to the Business Systems team, ensuring that they have clean, governed … users. Process Automation: Eliminate manual interventions in reporting and transformation. Implement continuous ingestion/delivery pipelines to automate testing, version control and code deployment. Pipeline Orchestration: Architect reliable data workflows (using platform-native schedulers) to manage complex dependencies and ensure timely data delivery. Data ...

Title: Senior Data Lead Location: Central London (Hybrid 1-2 days on site) Salary: £80,000 - £90,000 + benefits Overview We are partnering with a fast-growing FinTech startup building a modern, cloud-native banking and financial services platform. They are looking for an experienced Senior Data Lead to take full ownership of data strategy, data delivery, and data migration initiatives across complex internal and client-facing programmes. This is a senior, hands-on leadership role, suited to someone with 5-10 years' experience who combines strong data ...

Security cleared Data Architect PROJECT DESCRIPTION The Data Architect is responsible for designing, creating, deploying, and managing an organization’s data architecture. This role ensures that data across systems is accurate, accessible, secure, and supports business objectives. As a Data Architect, you will have extensive experience in development of data intensive systems. This should include working with customers to derive requirements and design solutions to meet their needs. The successful applicant will be expected to have seen a project through from inception to delivery. To succeed ...

Title: Senior Data Engineer Salary: £75,000 - £85,000 Location: London (Hybrid - 2 days on-site) Overview We are seeking a Data Engineer to join a data and analytics function within the energy and environmental services sector. This is a highly impactful … role focused on designing, building, and embedding modern data platforms that support operational insight, business intelligence, and strategic decision-making. Operating in a low data-maturity environment, this role will play a key part in shaping the organisation's data foundations, architecture, and governance. ...

Data Engineer Remote with adhoc travel - Nottingham Up to £60,000 Why apply? Fruition are working with a leading player in its industry, committed to delivering data-driven insights that enhance business performance. With a strong focus on innovation, the company leverages cutting-edge technology … pipelines, managing data warehousing, and ensuring high-quality data is available for business decision-making. Responsibilities: Data Pipeline Development: Design, build, and maintain ETL (Extract, Transform, Load) processes to enable efficient data ingestion and transformation. Database Management: Support and optimise ...

passionate and dedicated insurance and software professionals on a mission to upgrade the insurance industry from the inside out. RESPONSIBILITIES The Full Stack Data Engineer is responsible for integrating data engineering, analytics, and data science to drive business intelligence and data-driven … related field. • Proficient in Python, including libraries like Pandas, NumPy, PySpark, and Scikit-learn. • Strong experience with SQL, ETL processes, and data pipeline development. • Expertise in Tableau BI for data visualization and dashboarding. • Hands-on experience with AWS services (S3, Redshift, Lambda, Glue, Athena, etc. ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data Engineer role focused on designing and delivering modern data platforms using Microsoft technologies. As a Senior Data Engineer , you will work across a varied client base, taking ownership of data solutions from initial scoping through to build and delivery. The Role – Senior ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … This role plays a key part in modernising our data infrastructure, optimising data pipelines, and ensuring the integrity, availability, and performance of the critical data assets. You will collaborate closely with architects, analysts, and business stakeholders to build cloud-native data platforms ...

pipelines using Python and distributed data processing frameworks. Develop and support multi-tenant data processing systems and data pipeline architecture. Integrate data platforms with cloud services including storage, messaging, monitoring, and security tools. Monitor data quality, performance, and reliability … engineering best practices. Experience working within a cloud environment, ideally Azure (ADF, Storage, Service Bus, Monitor). Solid understanding of data pipeline orchestration, data validation patterns, and ELT/ETL processes. Background in containerisation, CI/CD, and DevOps practices. If youre ready ...

Role: Data Engineer (Automation) Location: Milton Keynes (Hybrid 3 Days In-Office Weekly) Salary: £45,000 - £55,000 Network IT are supporting a large, enterprise-scale organisation as they continue to evolve and modernise their Data Analytics and Automation Platform ; were looking for an experienced Data Engineer to design, build, and optimise secure, automated data pipelines that enable scalable analytics, business intelligence, and data-driven decision-making across multiple business units. This is a highly technical role with strong exposure to cloud and on-prem data platforms , automation ...

Azure Data Engineer X3 UK Wide - 90% Remote Salary: £65-85,000 Per Annum + Permanent Benefits About the Role We are looking for experienced Azure Data Engineers to design, build, and optimise scalable data platforms in Microsoft Azure. You will play … role in delivering reliable, high-quality data solutions that support analytics, reporting, and data-driven decision-making across the business. Working closely with data analysts, data scientists, and stakeholders, you'll help shape our modern data architecture and ensure best ...

recruiting a D2C Data & Business Intelligence Manager to join our D2C Insights team; the team that drives customer-focused, data-led decision making across our direct-to-consumer strategy, product, PR & content, and business development teams. The team are responsible for insights across customer research, customer … write complex queries and repeatable stored procedures. Experience in low-code solutions like DBT is highly desirable Experience of developing data pipeline and automations, for example via Python Data integration using APIs Ownership of systems critical data and string experience of maintenance, development ...

seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve and communicate the existing … enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster and aligned decision ...

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management … data analytics, development, and technical support, giving you the chance to shape a dynamic, next-gen digital infrastructure. You’ll be integral to our mission of crafting a seamless, powerful platform that empowers the public sector with the talent to navigate an evolving digital landscape. Role As part ...

Data Engineer Salary: £80,000 - £90,000 + 10% Bonus (Uncapped) Location: Wigan (Hybrid - 3 days in the office/2 days at home; flexible if candidates are further afield 1-2 days in the office) Sellick Partnership are proud to be partnered with a well-established industrial … Responsibilities Design and build a modern Azure-based data platform, including: Azure Data Lake Data ingestion pipelines Data modelling and transformation Automate ingestion of data from: Bespoke operational systems ERP systems High-volume transactional sources (1,000+ transactions per hour ...

Senior Data Engineer to join our Anti-Piracy team who will be responsible for expanding and optimizing our data pipeline as well as optimizing data flow and collection within the Anti-Piracy Team The Senior Data Engineer will be responsible … designing, building, and scaling the data infrastructure that powers our anti-piracy operations and intelligence capabilities. You'll develop and maintain data pipelines, architect data storage solutions, and help shape data standards and governance across the org. You'll partner closely with ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years … products Powering systems that help the government monitor and reduce greenhouse gas emissions from commercial transport Role Summary Triad is seeking a Senior Data Engineer to play a key role in delivering high-quality data solutions across a range of client assignments, primarily within ...

looking for a skilled mid-Level Data Engineer with a passion for building reliable and scalable data pipelines to power cutting-edge genAI products. The ideal person would have strong commercial experience in real-time data engineering and cloud technologies, and be able … self-service tooling to provide clean, efficient results. Develop automated tests and monitoring to ensure data quality and data pipeline reliability. Implement best practices in data governance through documentation, observability and controls. Using version control and contributing to code reviews. Supporting the adoption ...

Senior Data Engineer, you will play a pivotal role in maintaining and expanding the Data Warehouse and Data Pipeline, working closely with a dedicated team of Data Engineers and Analysts. Imagine a role where your technical expertise is not just valued … Data Stack, identifying and resolving issues, and integrating new data sources to enhance the functionality of the Data Pipeline and Data Warehouse. Managing a small team to deliver key objectives Qualifications Strong foundation in SQL, preferably PostgreSQL or Snowflake SQL within ...