1 to 25 of 59 Temporary Data Pipeline Jobs in the UK

Data Architect (Senior/Principal) Location: Remote, with occasional travel to Blandford, Dorset Security Clearance: SC required Why Apply? An opportunity for a Senior or Principal Data Architect to shape the design and strategy of complex data platforms within an Army Digital environment. This … Engineering into architecture and strategy. Strong experience in data platform architecture, data integration, data modelling and complex pipeline design. Knowledge of data governance, assurance frameworks and data migration. Experience delivering data capabilities associated with ...

Join Microlise as a Senior AWS Data Engineer on a 12-month fixed term contract and help build the data foundations behind the next generation of customer-facing analytics and AI products. This is a hands-on engineering role in a major cloud data platform programme, where you'll help turn operational, telematics, customer and third-party data into trusted, reusable data products that power dashboards, APIs, self-service analytics, machine learning and future generative AI services. You'll work with modern AWS managed services, lakehouse architecture, Data ...

design, implement and optimise SAP solutions that drive measurable business outcomes. You could find yourself working on SAP integration projects, data pipeline initiatives and process improvements that support finance reporting and operational delivery across regulated environments. Typical role overview Location: London, Greater London, England - hybrid, with flexibility … stakeholders across finance, operations and IT functions Supporting SAP system optimisation initiatives, identifying process improvements and enhancing system performance Contributing to data pipeline design and data quality assurance within SAP environments Assisting with stakeholder collaboration, translating business requirements into technical SAP solutions Supporting financial analysis ...

BPMN and UML Developing SAP integration strategies using modern approaches: APIs, microservices, CI/CD pipelines and containerisation (Docker, Kubernetes) Supporting data pipeline design and data quality initiatives to ensure enterprise information integrity Contributing to technology decisions around cloud platforms (Azure, AWS, GCP), infrastructure … containerisation (Docker, Kubernetes) and infrastructure as code principles Experience across multiple cloud platforms (Azure, AWS, and/or GCP) Understanding of data pipeline design, data quality frameworks and enterprise data governance Proficiency with SQL and scripting (Bash, Python or similar) Familiarity with ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will … focus on common IDs, Golden Records, entity resolution, data quality, governance, and cross-platform data integration . Key Responsibilities · Design and implement MDM solutions , including common IDs, Golden Records, entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks ...

Experience: 6–10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern … Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity resolution, data quality, governance, and cross-platform data integration . Key Responsibilities · Design and implement MDM solutions , including common IDs, Golden Records, entity matching, deduplication, and survivorship rules. Integrate data from multiple ...

Lead Data Engineer (AI & Data Platforms) | Must Be DV Clearable | 5 Days Onsite Hands-on technical leadership building data and AI systems that actually work We're looking for a Lead Data Engineer to join a growing enterprise data and AI capability, playing a critical role in designing, building, and operating production-grade data platforms and AI-enabled solutions. This is not a line-management role . Instead, it is a senior, hands-on technical leadership position for someone with deep data engineering ...

Data Engineer — AWS, Python & Airflow Rate: £550 per day, outside IR35 Location: Remote Duration: Initial 6-month contract, with a further 12-month extension planned Clearance: Active SC clearance, used within the last 12 months Nationality: Sole British nationals only; dual citizenship is not permitted The opportunity … scheduling and monitoring data workflows with Apache Airflow. Integrating data from multiple sources and preparing it for downstream use. Improving pipeline reliability, performance and data quality. Investigating data processing issues and implementing robust solutions. Working with technical colleagues and stakeholders ...

looking to register interest in future Data Systems Architect opportunities. These roles could involve designing scalable data infrastructure that supports modern business intelligence and analytics initiatives, working with cloud platforms, microservices and distributed systems to enable organisations to make data-driven decisions at scale. … architectural challenges across distributed, enterprise environments Collaboration with talented data, engineering and analytics teams Potential to shape data quality and pipeline standards across the organisation Professional development opportunities in cloud platforms, data architecture and emerging technologies The flexibility and autonomy often associated with ...

Data Engineer Location: Belfast – Hybrid (2 days per week in the office) Salary: £50,000- £60,000 Our client is an established financial services business operating within the venture capital and investment space. Working in an investment-led environment, they combine financial expertise with a focus on delivering … value for their clients. The Role You'll play a key role in building and maintaining scalable data pipelines and infrastructure that support reporting, analytics and business decision-making. Working closely with Power BI analysts, data scientists and business stakeholders, you'll help ensure data ...

environment. This large-scale initiative will require technical expertise across multiple aspects of product migration, alongside the development and testing of new pipeline technologies through Alpha and Beta phases. You will play a key role in designing and implementing an Alpha deployment of Databricks within the new AWS environment … helping to establish the foundations for modern, scalable data pipeline technology. Key Responsibilities Design and implement an Alpha deployment of Databricks in a new AWS environment. Provide technical input and support across multiple aspects of the product estate migration. Support the migration of the government body ...

distributed systems and scaling applications across cloud environments. You could be working on projects that span API development, containerised deployments and data pipeline solutions, partnering with experienced teams to deliver robust, maintainable code. Typical role overview Location: London, Greater London, England Type: Contract • Full-time Rate … .NET, ASP.NET, React, Java and Spring Boot frameworks Building and optimising microservices and APIs that integrate across business systems Contributing to CI/CD pipeline design and implementation using containerisation (Docker, Kubernetes) Writing and optimising SQL queries and managing data quality within data pipelines Collaborating ...

including architects, business analysts and QA specialists Contributing to code quality and system resilience through adherence to ISO 9001 standards Supporting data pipeline development and data quality initiatives Troubleshooting and optimizing system performance and integration workflows What you could bring Most roles of this type … certification Experience with Azure, AWS or GCP cloud platforms Knowledge of BPMN, UML or other system design methodologies Exposure to data pipeline tools, ETL processes or Power BI Linux or Windows system administration fundamentals Exposure to infrastructure-as-code tools such as Terraform What roles of this ...

This is an opportunity to register your interest in future Business Intelligence Consultant roles focused on translating data into actionable insights for business stakeholders. Roles of this type work at the intersection of data, analytics and business strategy, supporting organisations to make informed decisions through quality … Business or related field Experience in data requirements gathering and stakeholder engagement Demonstrated understanding of data quality analysis and pipeline assessment Familiarity with business intelligence tools and methodologies Strong communication and analytical skills Ability to translate business needs into data specifications Nice ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop and maintain data pipelines using Azure services. - Ingest, transform, and model data from diverse sources. - Optimise data flows ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: - Develop and maintain data pipelines using Azure services. - Ingest, transform, and model data from diverse sources. - Optimise data flows ...

/05/2027 Location: Sheffield, hybrid 60% office 40% home You will design and implement robust ETL/ELT pipelines, develop data models for management information (MI) reporting, and create dashboards that provide actionable insights for operational, risk, and compliance stakeholders. Key Responsibilities · Design, build, and maintain … scalable ETL/ELT pipelines to ingest and process log and event data from AI platform components. · Develop and optimize data models for aggregation, reporting, and analytics to support MI and governance requirements. · Collaborate with platform, DevOps, and security teams to ensure comprehensive data ...

month contract with scope to extend Central London - 3x days a week We're seeking a Test Automation Engineer to automate testing for data pipelines, ETL processes and cloud platforms, ensuring data quality and reliability. Clearance: Active SC Clearance is highly desirable. Otherwise, candidates must … obtain it. Key Responsibilities Develop automated tests using Python and pytest, supporting BDD (Behave) and TDD in Agile teams. Validate and reconcile data, managing test data for ETL and data warehouse testing. Build reusable automation frameworks and embed shift-left testing with developers ...

Principal Data Engineer 12 Month Contract Inside IR35 - Up to £1000 per day (DOE) Manchester, UK - Hybrid - 4 days a week onsite Morson Edge are partnered with a leading investment management firm who are looking for an experienced Principal Data Engineer to join their established Data … Strong experience with: Snowflake - Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end-to-end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake-optimised SQL. ...

Title: Lead Data Engineer Location: London/Hybrid Position Type: 6 Month Contract - Outside IR35 About We're working with a major financial services organisation undergoing a large-scale data transformation programme. They are looking for a hands-on Lead Data Engineer to help … build and scale an enterprise data platform, working closely with senior architects and engineering teams to deliver modern data capabilities across a complex environment. Key Responsibilities Lead the design and build of scalable data engineering solutions using Snowflake and dbt. * Develop data ...

assurance processes Collaborating with infrastructure and cloud teams on deployment approaches-cloud (Azure, AWS, GCP), on-premise or hybrid configurations Supporting CI/CD pipeline design and containerisation strategies (Docker, Kubernetes) aligned with SAP deployments Mentoring technical teams on architectural best practice, distributed systems design and data quality frameworks Advising on data pipeline architecture, ETL processes and reporting solutions (Power BI) Contributing to process design and business process modelling (BPMN, UML) alongside business stakeholders What you could bring Most roles of this type require the following: Must-have Proven experience ...

England, in partnership with Inspire People, is recruiting experienced Lead Solution Architects to design and deliver complex, cloud-based solutions across its regulatory data services. Hybrid working from London or Leeds, salary up to £90,360 plus an 8% cash benefits allowance, 10-25% discretionary annual bonus … monetary and financial stability. As part of its ongoing technology modernisation, the Bank is investing in platforms that improve how regulatory data is collected, processed, integrated and used across the organisation. These programmes include modernising the collection of regulatory submissions from banks and insurers, alongside developing internal data ...

England, in partnership with Inspire People, is recruiting experienced Lead Solution Architects to design and deliver complex, cloud-based solutions across its regulatory data services. Hybrid working from London or Leeds, salary up to £90,360 plus an 8% cash benefits allowance, 10-25% discretionary annual bonus … monetary and financial stability. As part of its ongoing technology modernisation, the Bank is investing in platforms that improve how regulatory data is collected, processed, integrated and used across the organisation. These programmes include modernising the collection of regulatory submissions from banks and insurers, alongside developing internal data ...

control system implementations Working with cloud platforms such as Azure, AWS or GCP to build scalable, reliable automation solutions Collaborating on CI/CD pipeline development to improve deployment efficiency and system reliability Contributing to system testing, validation and troubleshooting across development and production environments Supporting documentation and adherence … Familiarity with version control, CI/CD practices and modern development workflows Understanding of data quality, SQL and basic data pipeline concepts Ability to work effectively in collaborative, cross-functional teams Strong problem-solving skills and attention to technical detail Nice-to-have skills include ...

deliver robust, well-tested code and contribute to architectural decisions Optimizing application performance and data handling through SQL and data pipeline design Contributing to code quality initiatives and working within established development standards and processes What you could bring Most roles of this type require … stack expertise across front-end frameworks and back-end services Exposure to enterprise platforms such as SAP environments Knowledge of monitoring, observability and data quality practices What roles of this type could offer Most roles of this type offer the following, dependent on the industry and seniority ...