1 to 25 of 54 Contract Data Pipeline Jobs in London

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start asap ideally in October 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the Central … London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing data … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. ETL/ELT pipeline development : experience in designing, building, and maintaining robust, automated data pipelines. You should be comfortable with both the theory and practical application of extracting, transforming, and loading More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. ETL/ELT pipeline development : experience in designing, building, and maintaining robust, automated data pipelines. You should be comfortable with both the theory and practical application of extracting, transforming, and loading More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Data Engineer (Azure, Snowflake, DBT) | Insurance | London (Hybrid) Robert Half International (an S&P 500 global staffing provider) is supporting a global consulting firm in sourcing an experienced Data Engineer to join a major insurance client engagement.The role focuses on building out a Snowflake Data Warehouse established last year and scaling it to support … multiple new data use cases across the business. Assignment Details Initial Duration: 6-12 months (until March 2026, likely extension given scope) Location: Hybrid - minimum of 2 days per week in London Day Rate: £450 PAYE (plus 12.07% holiday pay - PAYE with employer's NI & Tax deducted at source, unlike umbrella companies and no umbrella company admin fees … modular data modelling, testing, documentation, and CI/CD integration. Skilled in Azure Data Factory, Synapse, and Databricks for end-to-end data pipeline orchestration. Excellent SQL engineering capability; experience designing data models for analytics and operational reporting. Proven track record in the insurance or wider financial services sector , ideally with More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based. Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to fulfil their … data requirements and support their work. Collect and process datasets from various sources, ensuring data quality and … integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions … of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, real-time data pipelines that power analytics, machine learning, and operational systems across the business. You … ll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and … excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance … and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of More ❯

Part-Time Data Engineer/Power BI Developer (Fully Remote) 3-Month Contract | 3 Days per Week | Outside IR35 We’re looking for a hands-on Data Engineer/Power BI Developer to deliver a new Azure-based reporting solution for a London-based organisation. This is a part-time contract (3 days per week) and … can be completed fully remotely. The Project You’ll be building an end-to-end data reporting solution on Azure, pulling data from multiple third-party systems (initially Sona) into an Azure SQL environment, transforming it with Azure Data Factory, and surfacing insights through Power BI dashboards. This setup will evolve into a full … Looking For Proven experience with Azure SQL, Azure Data Factory, and Power BI (integration + dashboard design). Strong understanding of end-to-end data pipeline development. Experience automating and streamlining reporting workflows. Able to work independently and deliver remotely with minimal supervision. If you’re a self-sufficient Data Engineer/Power More ❯

Data Engineer £500 - £560 per day London - 1 day per week in office We're working with a leading global healthcare technology company who are building out their next-generation data platform, with a strong emphasis on automation, testing, and cloud-native engineering, and are looking for an experienced Data Engineer to join their … team. The Role You'll be part of a modern data engineering function that's implementing best-in-class data practices across ingestion, transformation, and orchestration layers. The environment is highly technical, collaborative, and fast-paced, giving you the opportunity to work across a wide variety of data sources and tools. Day-to-day … responsibilities include: Designing and developing DBT models and Airflow pipelines within a modern data stack. Building robust data ingestion pipelines across multiple sources - including external partners, internal platforms, and APIs. Implementing automated testing and CI/CD pipelines for data workflows. Performing data extraction and enrichment, including web scraping and parsing of More ❯

Senior Data Engineer (Databricks) Location: London (Hybrid) Rate: Negotiable, depending on experience Duration: 6 months (initial)We’re looking for a Senior Data Engineer (Databricks) to join a world-leading energy organisation on a key transformation programme within their trading and supply division. This is an exciting opportunity to play a pivotal role in building modern … scalable data solutions using Azure cloud technologies. The Role As a Senior Data Engineer, you’ll be responsible for designing and developing robust data foundations and end-to-end solutions that drive value across the business. You’ll help shape and embed data-driven thinking across both technical and business teams, ensuring … the organisation continues to lead with insight and innovation.You’ll act as a subject matter expert, guiding technical decisions, mentoring junior engineers, and ensuring data engineering best practices are consistently applied. Key Responsibilities Design and build data solutions aligned with business and IT strategy. Lead development of scalable data pipelines and models using Azure More ❯

Robert Half Technology are assisting a market-leading pharmaceuticals organisation to recruit a Data Engineer on a contract basis. Outside IR35. Hybrid working - London based (one day per week on site). Role * The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance.* Collaborate with data scientists, analysts, and business stakeholders to fulfil their data requirements and support their work.* Collect, process, and transform datasets from various sources, ensuring data quality and integrity.* Optimise and maintain the organisation's Snowflake infrastructure, providing performance tuning, enhancements, and regular "MOT" checks.* Develop and maintain DBT pipelines, mainly on Snowflake, to enable … efficient transformation and modelling of data.* Implement efficient data models and schemes for storage and retrieval, optimising processes for improved performance.* Troubleshoot and resolve data pipeline and infrastructure issues swiftly and effectively.* Keep abreast of industry trends and emerging technologies in data engineering and cloud infrastructure, continuously improving skills and knowledge. Profile * The More ❯

Robert Half have partnered with one of our Pharmaceutical manufacturing organisations to help them recruit for an experience Snowflake Data Engineer on an initial 6 months experienced based out of their London office. You will play a key role in designing and managing our Snowflake data warehouse and leveraging dbt (Data Build Tool) to … transform raw data into reliable, analysis-ready datasets that support regulatory compliance, operational efficiency, and innovation. Responsibilities: Design, develop, and maintain scalable data pipelines to support manufacturing, quality, and supply chain data workflows. Implement and manage data transformation models using dbt to standardise and validate datasets. Optimise and monitor performance of Snowflake … data warehouse environments. Collaborate with cross-functional teams (Data Scientists, Quality, Manufacturing, IT) to define data requirements and deliver reliable data solutions. Develop and maintain ETL/ELT workflows using modern orchestration and integration tools (e.g., Airflow, Fivetran, or similar). Implement data governance, lineage, and documentation best practices. Support More ❯

Akkodis is partnering with a reputable client in Finance and they are looking for a Data Engineer with strong Databricks experience to expand their IT Team. They are currently improving their CX transformation programme and making changes to their institutional reporting suite. Job title: Data Engineer - Data BricksSTART :ASAPLocation: Liverpool Street - 3 days a … eek (NON Negotiable), the rest WFHDuration: 3 months rolling contractType of contract : Freelance, Inside IR35Level: mid-Senior Duties and Tasks: Develop and optimize data pipelines using Databricks and Spark.Design and implement data models and ETL processes in Snowflake.Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, and security across platforms.Monitor and troubleshoot data workflows and performance issues. Requirements: Proven experience with Databricks and Snowflake.Strong proficiency in SQL and Python.Extract Load Transform procedures, Data Lineage & Analysis.Familiarity with cloud platforms (e.g., Azure, AWS, or GCP).Experience with CI/CD and version control tools (e.g., Git).Excellent problem-solving and More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure … Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating … experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics Proficiency in SQL and Python for data transformation and pipeline logic Please note: you will be working in a US time zone. Please contract/01676545407 to discuss in more detail. ECS Recruitment Group Ltd is acting as an More ❯

Senior Data Engineer – SC Cleared We are seeking a hands-on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines . The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake . … This role also involves close collaboration with hyperscalers and data platform vendors to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging with senior stakeholders across the organisation. Key Responsibilities: Design, develop, and maintain streaming and batch data pipelines using modern data engineering tools and frameworks. Work … with large volumes of structured and unstructured data , ensuring high performance and scalability. Collaborate with cloud providers and data platform vendors (e.g., AWS, Microsoft Azure, Databricks, IBM, Snowflake) to conduct PoCs for data platform solutions. Evaluate PoC outcomes and provide comprehensive documentation including architecture, performance benchmarks, and recommendations. Engage with key stakeholders including Heads More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

Robert Half Technology are assisting a cutting edge AI organisation to recruit a Data Engineer on a contract basis - remote working - UK based A Junior Data Engineer who's excited to help build the data foundations that power cutting-edge AI solutions. You'll join a high-impact team working at the intersection of … data, analytics, and machine learning - designing pipelines and infrastructure that make innovation possible at scale. Role Design, build, and maintain scalable data pipelines that fuel AI and analytics initiatives. Partner closely with data scientists, analysts, and engineers to deliver clean, structured, and reliable data. Develop robust data transformations in Python and SQL … Engineer will ideally have 2-5 years of experience in data engineering or a similar role. Strong Python skills for data processing and pipeline development. Proven experience writing complex and efficient SQL. Hands-on Snowflake experience (data modelling, performance tuning, pipelines). Familiarity with orchestration tools (e.g., Airflow, dbt) is a More ❯

MI & Data Integration Analyst (Azure/Databricks) Hybrid - Central London | £43,000 pro rata | 3-month FTC (potential to extend) We're looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great … opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work - helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity You'll be supporting a small, forward-thinking team to improve how they use data - helping them access accurate and timely MI … streamline processes, and migrate to a new Azure-based data environment. You'll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. More ❯

Data Engineer - GCP £750 - £800 per day 2 days in London We're working with a global healthcare and life sciences leader that's pioneering the use of AI and Machine Learning to develop advanced therapies for both existing and emerging diseases. Their mission is to make personalised treatments faster, more effective, and more accessible - and this role … is key to that vision. The team is building cutting-edge data infrastructure to power scientific and ML applications, and they're seeking a Data Engineer with strong experience developing scalable, high-quality data pipelines in the cloud. The Role You'll join a team of data scientists, bioinformaticians, and engineers working … at the intersection of healthcare and AI. Your focus will be on designing and maintaining the data pipelines that feed large-scale ML and research workflows. Day-to-day responsibilities include: Building and maintaining data pipelines using Python, SQL, Spark, and Google Cloud technologies (BigQuery, Cloud Storage). Ensuring pipelines are robust, reliable, and optimised for More ❯

required: SC Cleared IR35 Status: Outside IR35 Start date: 01/12/2025 Pay rate: 400-500/d Front-End Developer We are forming a new Data Team to deliver a unified, user-friendly interface that consolidates dashboards, reports, and analytical outputs from across the organisation. This "single pane of glass" will serve as the central … hub for stakeholders to explore data, monitor performance, and make informed decisions. As the Front-End Developer , you will play a pivotal role in designing and building this interface from the ground up. You'll work closely with Data Analysts, Data Scientists, Engineers, and Business Analysts to understand their outputs and translate them into … intuitive, dynamic visual experiences. Your work will directly influence how data is consumed and acted upon across the organisation. Responsibilities Design and develop a unified front-end interface that integrates dashboards, reports, models, and data pipelines into a single, intuitive view Ensure the interface adheres to accessibility standards (e.g. WCAG 2.2), enabling inclusive access for all More ❯

Contract Data Engineer - Google Cloud | Scientific Data | Research-Focused Organisation London (2-3 days a week onsite) £750 per day (Inside IR35) | 6-month contract The Company Harnham is partnering with a leading research and technology organisation that's leveraging data and AI to accelerate scientific innovation. They're looking for an experienced Data Engineer to join on a 6-month contract and help build and optimise data pipelines supporting large-scale scientific and R&D initiatives. The Role You'll be responsible for designing, developing, and maintaining robust data pipelines on Google Cloud. Working closely with other engineers and scientists, you'll ensure the delivery of clean … scalable data solutions that power high-impact research. Key Responsibilities Build and maintain data pipelines using modern tools on Google Cloud, including Python, Spark, SQL, BigQuery, and Cloud Storage. Ensure data pipelines meet the analytical and scientific needs of key applications. Deliver high-quality, production-grade code with testing and documentation. Develop, measure, and More ❯