1 to 25 of 557 Data Pipeline Jobs in England

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

summary The Head of Data Platforms, Data Quality and Engineering provides senior strategic and technical leadership for MPFT's enterprise data platforms, cloud technologies, data quality frameworks, and engineering functions. As the Trust's senior accountable officer for data quality … senior accountable officer for data quality by design, ensuring national datasets (MHSDS, CSDS, etc.) are robust, welldocumented and accurate, and that pipeline failures, data anomalies and submission risks are proactively mitigated.This aligns directly with the below objectives to: consolidate leadership roles, address benchmarking variation, strengthen ...

governance, security and accessibility across data platforms Develop scalable data transformation logic using Python, SQL and Spark-based frameworks Monitor pipeline performance and troubleshoot data workflows to ensure reliability and efficiency Work closely with data scientists, analysts and engineering teams … initiatives Implement best practices for data modelling, metadata management and data lineage Produce technical documentation including data architecture, pipeline design and data flow diagrams Support continuous improvement of data platforms through optimisation, automation and performance tuning Qualifications and experience ...

summary What you'll lead Working as part of BrisDoc's Business Transformation team, the Senior Data Engineer will take a lead role in developing and building our cloud architecture, data lake and warehousing, and data pipelines to support the organisation's service development … hours urgent care services during an important time of change and development in NHS care, with a shift to more digitised, technological and data-driven services that support the delivery of excellent healthcare services. The role will work across BrisDoc and its clinical, operational and back-office services ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into ...

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience Contract Type: Permanent We're looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production ...

Advisory : Combining architectural assessments with platform selection guidance, providing vendor-independent recommendations for optimal data ecosystem design. Data Migration, Integration & Pipeline Support : Providing strategic guidance on data migration and integration approaches, logical pipeline design, and data flow orchestration, based … understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Warwick (Hybrid Working) Contract: 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead … develop, and maintain ETL/ELT processes utilising tools such as Matillion. Create and maintain optimal data flows and data pipeline architectures. Develop and manage data warehouse objects, including tables, views, and security roles in Snowflake. Extract data from diverse sources ...

analytics teams. Design architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data … transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability ...

analytics teams. Design architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data … transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability ...

Data Engineer Location: Warwick, UK (office based) Day Rate: Market rate (Inside IR35) Duration: 6 months Role description This role is for an experienced Azure Data Engineer to support the design, development and optimisation of data solutions within a modern cloud-based environment. … Python for data engineering tasks Strong SQL knowledge and experience working with relational databases Experience in debugging and resolving data pipeline issues Understanding of data architecture and best practices in data engineering Good communication skills with the ability to work collaboratively ...

HEAD OF ERP DATA MAT COVER LONDON (HYBRID) UP TO £90,000 This is a standout opportunity to lead a data function through a major ERP transformation while shaping the future of product data, governance, and analytics in a consumer‐driven environment. You will … play a pivotal role in stabilising and optimising a new data ecosystem, guiding a growing team, and embedding high‐quality data foundations across the business. The Company The client is a global consumer brand undergoing significant digital and data transformation. With ...

High-Growth Technology Consultancy | Hybrid (UK) Ready to work on complex, high-impact data challenges across industries like Private Capital Clients and Financial Services? We’re a fast-growing technology consultancy delivering advanced engineering solutions in highly demanding environments. Our model focuses on deploying top-tier engineers into … mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid working with flexibility Collaborate with ...

stage by reading the complete job description and applying promptly. High-Growth Technology Consultancy | Hybrid (UK) Ready to work on complex, high-impact data challenges across industries like Private Capital Clients and Financial Services? We’re a fast-growing technology consultancy delivering advanced engineering solutions in highly demanding … deploying top-tier engineers into mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid ...

Overview We are looking for a Consultant to join SmartCo with a focus on Data and AI. This is a billable, client-facing role, sitting at the intersection of advisory and delivery. The role is split across two core areas: Supporting clients with data strategy, data architecture, data migration and data-led transformation programmes. Helping SmartCo build and mature its internal data capability, including reporting, dashboards and insight across core platforms (CMAP, Sage Intacct, Pipedrive). In parallel, this role will play a key part in shaping ...

week and supports a global asset and investment management client offering diverse investment solutions. Key Responsibilities Lead technical delivery across MDM, data pipeline, Salesforce integration, historical data migration, and reporting workstreams Coordinate sprint planning and manage dependencies across a multi-workstream programme Review data models, data pipeline designs, and mapping documents before build commences Drive the Operational Readiness Review (ORR) process through to production sign-off Act as primary liaison between technical teams and business stakeholders Oversee QA, SIT, and UAT promotions and coordinate business sign-off at each ...

Company description: SGB Job description: Data Engineer Location: Milton Keynes Working Hours: Monday to Friday (8.45am – 5pm) Salary: From £60,000 plus excellent benefits package, including: Hybrid working Eligibility to annual bonus scheme Access to a fantastic loan car scheme 25 days annual leave plus bank holidays Competitive … platform Data Quality & Monitoring Implement data quality checks, validation rules and monitoring processes Develop alerting and logging mechanisms for pipeline failures and data issues Identify, troubleshoot and resolve data inconsistencies and failures Work with upstream system owners to improve data ...

core part of HDI's data transformation agenda, enabling improved decision-making, automation, and analytics maturity. Key accountabilities Data Pipeline Engineering & Integration Design, develop, and maintain end to end ingestion pipelines into appropriate data technologies such as Snowflake from internal systems (policy admin … sizing, storage costs, and compute efficiency. Implement workload separation, time travel optimisation, clustering, and pruning strategies. Documentation & Knowledge Sharing Produce comprehensive documentation for pipelines, data models, data flows, and architecture components. Provide technical guidance to junior team members and evangelise engineering best practices. Skills & experience Technical ...

Data Architect/Enterprise Data Architecture Defence/MOD JSP 453, CADMID, TOGAF, NIST, ISO 27001 Data Architect Bristol/Cardiff Hybrid Security Clearance or eligibility is required for this opportunity. Our client is a global leader in engineering, project and programme management … solutions integration as well as a recognised partner across major UK Government and commercial programmes. They currently have an exciting opportunity for a Data Architect to join their growing team of IT professionals to work on a range of projects for our diverse client portfolio that covers Critical ...

arriving from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team.Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. * Ensure Silver and Gold layer data products are fit for purpose … modelling - conceptual, logical and physical. Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata ...

Location: Hessle Salary: £50,000–£60,000 depending on experience Contract Type: Permanent We're looking for a Data Engineer with experience in Business Intelligence to join a forward-thinking organisation modernising its data ecosystem. This role is ideally suited to someone operating at a strong … level, looking to deepen their technical capability while gaining exposure to more advanced data engineering and architectural concepts. As a Data Engineer, you'll work with data from systems such as SAP, Salesforce and production environments, helping to ensure it is connected, structured ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … Summary: The Senior data engineer role will have a specific focus on data and integration, ensuring that they drive single version of the truth by developing and maintaining reliable solutions to store and manage key data. The role will source, model, and provide data ...

Raytheon UK is searching for a Data Engineer to join our OMNIA Training team. As a Data Engineer, you will be critical to the successful delivery of the programme, collaborating within matrix organisation, with multi-disciplinary teams within Engineering. The role: This is more than … British Army is ready to fight and win. Key Responsibilities: Collaborate with engineering, simulation, customer, third party and training teams to ensure seamless data management and integration across military training environments. Ensuring the security and compliance of data environments through the implementation of appropriate security controls ...

Description We’re looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. You’ll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. You’ll work closely … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...