23 of 23 DemandTrendContract Data Pipeline Jobs in the South East

Role: Senior Data Engineer Salary/Rate: £600-700 per day inside IR35 Location: hybrid multiple locations available, 2 days on siteContract Duration: 4 months, potential to extend We are currently looking for a Senior Data Engineer for our government client. This Senior Data Engineer role is hybrid, based between 2 days per week … on site and the remainder of the week working remotely. Office locations include most major towns, with London being a preference. The contract for the Senior Data Engineer position is for 4-months with potential to extend, operating inside IR35. Security Clearance: Security Check ("SC Clearance") This role is inside IR35 - Due to the service of the role … it will now be based on an Umbrella solution. Essential skills/experience required: Strong experience designing, building and maintaining data pipelines using modern, cloud-based tools and practices Proficiency in Python and SQL for data engineering tasks Experience with DBT and a good understanding of data modelling approaches (e.g. star schema, dimensional modelling More ❯

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting through … cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … platform Explore new technologies to improve data ingestion and self-service Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance More ❯

Your new company Working for a globally renowned legal firm. Your new role Joining an exciting data strategy programme of work and are looking for a talented Data Engineer to join the team. You will play a crucial role in building and managing data pipelines and implementing data engineering/architectural solutions … that enable efficient and reliable data integration, transformation and delivery for all data users across the EMEA (Europe, the Middle East, and Africa ) Region.You will be implementing a foundational architecture via Telephonica (dealing with 3rd party suppliers and vendors). Looking at architecture and build out reporting layers to the global team. Building out data pipelines/pushing them through medallion architecture (through bronze/silver layers). What you'll need to succeed Proficiency in the design and implementation of modern data architectures - Microsoft Fabric/Data Factory and modern data warehouse technologies - Databricks a must! Experience in data management disciplines, including data More ❯

Job Title: Oracle Data Warehouse Architect Pay Rate: £415.16 PWD via Umbrella Location: London Hybrid model: 3:2 - Office: Home Length of Contract: 6 Months About Client: Headquartered in Tokyo, this banking group is Japan's second largest and a globally recognized financial institution with around US?$2 trillion in assets. Operating in nearly 40 countries with over … drives major green and social initiatives while embracing digital innovation, including AI tools, to enhance efficiency and client experience. About the Role: We are seeking an experienced Oracle Data Warehouse Architect AVP to design, optimize, and maintain high-performance, scalable Oracle-based data warehouse solutions. This role is integral to supporting business intelligence and analytics initiatives … and optimize complex SQL and PL/SQL scripts. Provide guidance on data modelling, indexing, and partitioning strategies. Troubleshoot and resolve performance, ETL, and data pipeline issues while maintaining data quality. Support .NET development teams with day-to-day database issues and liaise with global DBA teams. Follow Change Management Control procedures for More ❯

An exciting digital agency in London is looking for a Data Engineer to support their growing data and analytics function on a part-time contract basis. Location: London Office policy: 1 day per week in London, remote otherwise Contract length: 3 months initially Start date: ASAP, first round interviews this week Day rate: £390pd Outside IR35 … Working pattern: 3 days per week The Job Build and maintain scalable data pipelines and a centralised Data Warehouse Develop and optimise Looker dashboards for client reporting Leverage Supermetrics Intelligence Cloud for data blending and integrations Work with Google APIs and other connectors to streamline data flows Partner closely with clients to … members in south Africa You Strong experience as a Data Engineer or Data Analyst, ideally from an agency background Hands-on with data pipeline design, warehousing, and dashboarding tools Skilled with Looker, Supermetrics, and Google APIs Confident managing clients and balancing multiple accounts Comfortable working part-time, but committed to contributing fully to More ❯

We're looking for a technical steward of enterprise metadata assets , ensuring governance, quality, and regulatory compliance across complex data landscapes. You will be the subject matter expert for data cataloguing, metadata synchronisation, and stewardship best practices. helping us build a trusted foundation for AI, analytics, and digital transformation. What You'll Do Metadata Curation & Governance … Define and implement enterprise metadata standards, business glossaries, and classification schemas. Establish data quality KPIs, SLAs, and governance metrics. Build automated discovery workflows to enable self-service analytics. Champion adoption of governed data assets across business and technical teams. Technical Stewardship Configure cross-platform metadata synchronisation between Alation, Databricks (Unity Catalog) , and downstream systems. Implement schema … BI spaces. Hands-on with data quality tools such as Great Expectations, Ataccama, Monte Carlo (or similar). Experience with metadata orchestration and modern data pipeline tools. More ❯

Role: Senior Data Engineer Rate : £700 per day inside IR35 Duration : 4 months + Ext Location : National - London travel required (hybrid) Clearance : Active SC clearance requiredAre you a Senior Data Engineer with experience in modern, cloud-native data platforms and a drive to shape performance-led digital delivery? We are hiring on behalf of … a central government programme undergoing a transformative journey to enhance data-driven decision-making at scale. The Opportunity - Senior Data Engineer The Senior Data Engineer will join a multi-disciplinary team working to redefine how performance is measured and managed across a large, national directorate. The team has already delivered an MVP dashboard using … fully automated, code-first approach. This is more than a dashboard project - it's a strategic initiative to improve organisational health, leadership alignment, and delivery effectiveness through better data foundations. The Senior Data Engineer play a key role in transforming manual pipelines into scalable, automated solutions within a modern analytics platform, while embedding AI-native tools More ❯

great opportunity for an Azure Databricks Engineer to join a renewable energy firm based in London. You'll play a hands-on role in developing and optimising modern data lakehouse solutions on Azure, while supporting critical analytics and data delivery systems. The environment encourages technical ownership, collaboration, and the chance to tackle complex cloud-native engineering … challenges. THE COMPANY This is a leading organisation within the renewable energy sector, dedicated to sustainable innovation and data-driven operations. The business is undergoing rapid digital transformation, investing in cloud-based technologies to optimise performance, forecasting, and environmental impact. With operations across multiple regions, their data initiatives play a key role in supporting clean energy … and efficient data platforms on Microsoft Azure. Your work will directly support migration initiatives, analytics enablement, and platform reliability. You'll be responsible for data pipeline development, resource deployment, and ongoing optimisation of cloud-native systems. Your responsibilities will include: Designing and implementing scalable data lakehouse architectures using Databricks on Azure. Building efficient More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines … and integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows More ❯

per day Outside IR35 6 - months Remote Company A well-established investment and asset management organisation is looking for a Platform Engineer to undertake a large-scale data transformation, building out a new cloud-native data platform to support decision-making across the business. The firm is part-way through the development of a greenfield cloud … architect. As the work progresses into its next phase, the business is hiring a Platform Engineer to join the build effort, with a particular focus on infrastructure, automation and pipeline orchestration. This Platform Engineer will sit within the central finance and planning function and work closely with senior stakeholders, including programme sponsors and business leads. Key responsibilities - Platform Engineer … standards. There is potential for future responsibility in mentoring or overseeing junior team members. Required experience Hands-on experience working with Snowflake, including schema development and data pipeline integration. Familiarity with Azure services, including resource provisioning and identity setup. Experience using Terraform for infrastructure deployment (ideally with cloud data services). Strong working knowledge of More ❯

My Financial Services client is seeking to recruit an Oracle Data Warehouse Architect on an initial 6 month contract for a Financial Services client based in London. It is hybrid and will require 3x days onsite per week. You will design, optimize, and maintain Oracle-based data warehouse solutions to ensure high performance, scalability, and alignment … with business intelligence and analytics needs. This role requires the individual to design and optimize Oracle-based data warehouse systems, ensuring they are scalable, high-performing, and aligned with business analytics needs. They will collaborate closely with the head of the data team and .NET developers, applying advanced data modelling, performance tuning, and problem … insights into clear, actionable recommendations for both technical and non-technical stakeholders. Skills Required: Strong experience in designing and developing efficient ETL processes to support enterprise-scale Oracle Data Warehouse environments. Proven ability to optimize and tune complex SQL and PL/SQL scripts for performance, while guiding development teams on best practices for data modelling More ❯

Data Scientist - GCP 500- 550 per day (Inside IR35) 2 Days Onsite - Isleworth, West London 6-Month Contract (Extendable) 83zero are partnered with a global leader in media and broadcasting, looking for an experienced Data Scientist to support a business-critical project. You'll be joining a collaborative team of data scientists and engineers … to build and refine machine learning models that deliver genuine commercial impact. What You'll Be Doing: Work closely with fellow data scientists to explore how AI/ML can unlock insights and improve decision-making. Perform advanced analysis on large, complex datasets using statistical and modelling techniques. Build, test, and tune ML models (especially NLP or computer … ML libraries, all within Google Cloud Platform (GCP) . Optimise models for accuracy and performance, ready for product integration. Stay up-to-date with the latest developments in data science and AI to drive innovation. Present insights, results, and model performance clearly to both technical and non-technical stakeholders. Ensure your workflows are reproducible and well-documented, including More ❯

Principal Data Engineer (Contract) Hybrid (London-based) | £450-£650/day A leading scientific and cultural institution is seeking a Principal Data Engineer to design and scale cloud-native data infrastructure powering biodiversity research, digitisation, and AI workflows. Key Responsibilities Architect and build scalable data pipelines for ingestion, transformation, enrichment, and publication. … Integrate AI/ML workflows, including training data pipelines and inference outputs. Lead AWS-based data engineering using services like S3, Lambda, Glue, and Athena. Ensure interoperability with global research infrastructures (e.g. DiSSCo UK, RECODE, DToL). Define best practices in data quality, metadata, and reproducibility. Collaborate with cross-functional teams (science, software, product … . Mentor engineers and contribute to institutional data strategy and standards. Tech Requirements Strong Python skills; experience with Airflow, Luigi, or Spark. Proven track record building robust, scalable ETL/ELT systems. Experience with scientific, semi-structured, or biodiversity data. Familiarity with semantic web standards (e.g. Darwin Core, JSON-LD, Linked Data). Knowledge of NoSQL More ❯

FDM is a global business and technology consultancy seeking a Senior Data Scientist to work for our client within the energy sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role based in London. Our client is seeking a Senior Data Scientist to join their Fundamentals Modelling … markets Develop and maintain fundamental balance and pricing models, leveraging advanced statistical techniques and industry best practices Engage closely with traders, analysts, and market strategists to translate complex data into actionable insights that drive trading performance Identify and automate repetitive processes, creating scalable, reusable modules across analytics projects Monitor developments in internal statistical techniques and external market dynamics … sharing knowledge and building capability across the trading analytics community Present analysis and recommendations to stakeholders, influencing high-impact commercial decisions Requirements Minimum of 3 years’ experience in data science, ideally within a commercial or trading environment Proficiency in time series analysis, regression modelling, and forecasting techniques Strong experience with Python and core libraries for data More ❯

solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include: Manage both scheduled and ad hoc data harvesting processes. Write efficient regular expressions to extract data from raw HTML, JSON, and XML. Clean and validate harvested data using automated processes. Troubleshoot and … resolve complex data processing issues. Maintain and enhance existing data pipelines and services. Improve automation for data processing and delivery. Core Requirements: Solid understanding of HTTP protocols and request/response architecture. Proficiency in writing Regular Expressions for data extraction. Working knowledge of Python, SQL, and either C# or Java. Strong problem … solving and debugging skills. Effective communication skills for understanding project needs and working with the team. Advantageous: Experience with automated data harvesting using Python, C#, or Java. Familiarity with front-end technologies (JavaScript, React). Experience with cloud platforms like AWS or GCP (especially BigQuery). Exposure to Big Data tools such as Elasticsearch. Background in More ❯

remote. Key Requirements: Strong experience with Server-Side Tag Management Google Tag Manager (GTM) - Server-Side essential Google Meridian - MUST HAVE Google Cloud Platform (GCP) Experience setting up data pipelines, event tracking, and tag execution environments Bonus Experience: Experience working with travel or airline clients (huge plus) eCommerce or Shopify knowledge is an advantage Timeline: Start Date: September More ❯

Job Title: Software Engineer – (AI Automation & LLM ) Location: London- Hybrid role Duration: 31st December 2025- possible extension Role: We're looking for a skilled Data Engineer/Software Engineer to support a pioneering AI research project focused on Large Language Model (LLM) agents and intelligent automation. You’ll play a central role in preparing and filtering text, image … and video datasets used to train advanced AI systems, helping to ensure data quality, relevance, and safety.. Key Responsibilities Data Onboarding: Convert raw datasets into structured formats suitable for automated processing. Filtering: Apply data … cleaning, quality checks, and filtering pipelines to identify and mitigate risks in datasets. Post-Processing: Integrate filtering results to modify original datasets, repackage them, and prepare for re-ingestion. Pipeline Engineering: Design, build, and maintain scalable and efficient data pipelines. Collaboration: Work closely with researchers and technical teams to refine processes and contribute to ongoing AI automation More ❯

working £300 to £350 a day A top timer global consultancy firm is looking for an experienced Hadoop Engineer to join their team and contribute to large big data projects. The position requires a professional with a strong background in developing and managing scalable data pipelines, specifically using the Hadoop ecosystem and related tools. The role … will focus on designing, building and maintaining scalable data pipelines using big data hadoop ecosystems and apache spark for large datasets. A key responsibility is to analyse infrastructure logs and operational data to derive insights, demonstrating a strong understanding of both data processing and the underlying systems. The successful … candidate should have the following key skills Experience with Open Data Platform Hands on experience with Python for Scripting Apache Spark Prior experience of building ETL pipelines Data Modelling 6 Months Contract - Remote Working - £300 to £350 a day Inside IR35 If you are an experienced Hadoop engineer looking for a new role then this is More ❯

Overview: We are looking for a skilled Mobile Developer with strong SQL/data processing experience to enhance an internal employee app. The app provides employees with performance insights (e.g., punctuality, recognition, and feedback) through gamified ranking and scoring. Currently, the scoring system lacks transparency, and we want to improve it with more statistics, better visualisation, and meaningful … insights. You will work closely with both technical and non-technical team members to evaluate existing functionality, identify areas for improvement, and implement data-driven enhancements. Responsibilities: Work with the existing development team to understand the current app and its components. Enhance the app's features with additional statistics, visualisation, and gamification elements . Build and optimise data pipelines for pulling and processing data from Teradata/SQL into AWS S3 buckets . Perform SQL data manipulation, transformation, and processing to support analytics and app features. Collaborate with business users and managers to gather feedback and refine app functionality. Communicate findings clearly to both technical and non-technical stakeholders. Identify what's More ❯

financial organisation you will be decommissioning a legacy commodities platform and then become part of new platform team! What you'll need to succeed Great experience as a Data Engineer and strong recent Financial Services or Insurance experience - working in regulated environments. You must be an expert with Databricks - Databricks certification (desirable). Experience with architecting and engineering … Databricks solutions from scratch. Strong experience with Python or Spark Expertise with modern data pipelines and running into production. Fantastic communication skills - Consultative/stakeholder management experience - you will help stakeholders use the platform. What you'll get in return Flexible working options available. What you need to do now If you're interested in this role, click More ❯

for a Power BI Developer to support the end-to-end rebuild of a client-facing reporting suite. The current setup is outdated and based on a legacy data warehouse being decommissioned - this role will be critical to designing and delivering a modern, secure, and user-friendly reporting solution using Microsoft Fabric. Key Responsibilities Build interactive, user-friendly … Power BI dashboards for external reporting Use Microsoft Fabric to develop data pipelines and code in notebooks Incorporate new data sources and apply row-level security where needed Work alongside a BA to define reporting needs and document processes Redesign reports to meet modern design and UX expectations Ensure full documentation and governance of reporting assets … Required Skills & Experience Proven experience developing in Power BI Strong grasp of Microsoft Fabric, Power Query, and notebooks Understanding of data security, modelling, and documentation Strong focus on dashboard usability and design best practices Preferred Background Experience with client-facing reports Projects involving decommissioning or rebuilding reporting infrastructure Confident working in fast-paced, delivery-focused environments More ❯

from foot traffic and vehicle flow to energy consumption and city-wide systems performance.We’re looking for a Software Engineer with strong Python skills and experience working alongside data scientists to optimise and productionise ML models . The core simulation engine is built in C++ , so any experience with C++ in high-performance environments is a major plus. … Key Responsibilities: Work with data science teams to optimise predictive models and deploy them at scale Build robust, scalable services in Python , with performance-critical elements in C++ Contribute to the development of a digital twin platform to simulate and forecast city infrastructure outcomes Collaborate across simulation, data, and software teams to turn prototypes into production … ready solutions (Bonus) Integrate streaming data pipelines using Kafka to support real-time modelling Experience: Strong commercial experience in Python engineering Exposure to C++ , especially in simulation, modelling, or high-performance systems Proven track record working closely with data scientists to bring models into production Background in simulation-heavy domains (e.g. finance, oil & gas, energy, transport More ❯

as well as software to support and assist the manufacturing process. The successful candidate will join the development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real-time data … delivery capabilities. Responsibilities: Design and develop real-time test and capture software on Linux systems using C++. Integrate and interface with high-speed SFPDP cards across multi-channel data pipelines. Architect and implement robust, scalable, and maintainable multi-threaded applications. Define and implement data sequencing and synchronisation logic to support deterministic capture and replay. Work with … required: Extensive experience in C++ development in a Linux environment. Proficiency in C# for tooling, test interfaces, or Windows components as needed. Proven experience working with real-time data systems, preferably involving SFPDP or other high-speed digital protocols. Demonstrable skills in multi-threaded and concurrent programming. Experience with low-level I/O, DMA, or driver-level More ❯