Data Pipeline Contract Job Trends in London

Data Pipelines
England > London

The table below provides summary statistics and contractor rates for jobs advertised in London requiring Data Pipeline skills. It covers contract job vacancies from the 6 months leading up to 18 March 2026, with comparisons to the same periods in the previous two years.

6 months to
18 Mar 2026
Same period 2025 Same period 2024
Rank 62 118 143
Rank change year-on-year +56 +25 +87
Contract jobs citing Data Pipeline 680 302 304
As % of all contract jobs in London 4.14% 2.36% 1.67%
As % of the Processes & Methodologies category 4.61% 2.59% 1.89%
Number of daily rates quoted 474 215 237
10th Percentile £375 £400 £406
25th Percentile £450 £450 £461
Median daily rate (50th Percentile) £525 £525 £530
Median % change year-on-year - -0.94% -5.99%
75th Percentile £650 £650 £665
90th Percentile £750 £800 £750
England median daily rate £513 £500 £525
% change year-on-year +2.50% -4.76% -4.55%
Number of hourly rates quoted 2 3 2
10th Percentile £61.63 £58.00 £40.54
25th Percentile £62.19 £60.63 £41.57
Median hourly rate £66.25 £65.00 £45.35
Median % change year-on-year +1.92% +43.35% -37.46%
75th Percentile £72.19 - £48.82
90th Percentile £73.88 - £49.68
England median hourly rate £67.50 £65.00 £62.50
% change year-on-year +3.85% +4.00% -11.03%

All Process & Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring process or methodology skills in London.

Contract vacancies with a requirement for process or methodology skills 14,745 11,676 16,083
As % of all contract IT jobs advertised in London 89.75% 91.09% 88.19%
Number of daily rates quoted 9,877 7,820 11,502
10th Percentile £350 £350 £340
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £550 £550
Median % change year-on-year -4.55% - -6.78%
75th Percentile £650 £681 £675
90th Percentile £750 £800 £788
England median daily rate £503 £525 £525
% change year-on-year -4.29% - -4.55%
Number of hourly rates quoted 235 162 343
10th Percentile £18.14 £20.05 £16.00
25th Percentile £22.00 £24.66 £19.57
Median hourly rate £35.50 £35.70 £30.16
Median % change year-on-year -0.55% +18.35% -18.49%
75th Percentile £56.98 £53.75 £49.94
90th Percentile £71.50 £77.25 £69.35
England median hourly rate £31.00 £33.11 £32.50
% change year-on-year -6.37% +1.88% -11.33%

Data Pipeline
Job Vacancy Trend in London

Historical trend showing the proportion of contract IT job postings citing Data Pipeline relative to all contract IT jobs advertised in London.

Data Pipeline job vacancy trend in London

Data Pipeline
Daily Rate Trend in London

Contractor daily rate distribution trend for jobs in London citing Data Pipeline.

Contractor daily rate distribution trend for jobs in London citing Data Pipeline

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 18 March 2026.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Hourly Rate Trend in London

Contractor hourly rate distribution trend for jobs in London citing Data Pipeline.

Contractor hourly rate distribution trend for jobs in London citing Data Pipeline

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 18 March 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +52 101 £513 -2.15% 101
West London - 21 £600 - 7
South London -11 10 £500 +2.56% 1
East London 0 3 £450 - 6
Data Pipeline
England

Data Pipeline
Co-Occurring Skills & Capabilities in London by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 110 (16.18%) Apache Spark
2 98 (14.41%) Apache Airflow
3 41 (6.03%) Apache
4 10 (1.47%) Palantir Foundry
5 8 (1.18%) Appian
6 7 (1.03%) SAS
7 6 (0.88%) Microsoft Exchange
8 5 (0.74%) Confluence
9 3 (0.44%) Jupyter
10 2 (0.29%) OpenROAD
10 2 (0.29%) SharePoint
11 1 (0.15%) Apache Superset
11 1 (0.15%) ArcGIS
11 1 (0.15%) Camunda
11 1 (0.15%) GeoServer
11 1 (0.15%) Luigi
11 1 (0.15%) Oracle SOA Suite
11 1 (0.15%) Oracle Workflow
11 1 (0.15%) Tomcat
11 1 (0.15%) WebSphere
Applications
1 21 (3.09%) Microsoft Excel
2 6 (0.88%) Microsoft Office
2 6 (0.88%) Microsoft PowerPoint
3 4 (0.59%) Chatbot
4 3 (0.44%) Microsoft Project
4 3 (0.44%) Trello
Business Applications
1 3 (0.44%) Aladdin
1 3 (0.44%) BambooHR
1 3 (0.44%) SAP BPC
2 1 (0.15%) Actimize
2 1 (0.15%) Dynamics CRM
2 1 (0.15%) Misys Midas
2 1 (0.15%) Oracle General Ledger
2 1 (0.15%) Oracle Payables
2 1 (0.15%) Oracle Procure-to-Pay
2 1 (0.15%) Oracle Receivables
2 1 (0.15%) Oracle Subledger Accounting
2 1 (0.15%) Salesforce CRM
Cloud Services
1 346 (50.88%) Azure
2 265 (38.97%) AWS
3 127 (18.68%) Azure Data Factory
4 124 (18.24%) Power Platform
5 118 (17.35%) GCP
6 90 (13.24%) GitHub
7 86 (12.65%) Snowflake
8 79 (11.62%) Azure Synapse Analytics
9 75 (11.03%) Serverless
10 73 (10.74%) Azure DevOps
11 65 (9.56%) Amazon S3
12 63 (9.26%) dbt
13 61 (8.97%) AWS Lambda
14 49 (7.21%) GitHub Actions
15 24 (3.53%) AWS Step Functions
16 23 (3.38%) AWS CloudFormation
17 22 (3.24%) Amazon Kinesis
18 21 (3.09%) Dagster
19 20 (2.94%) Amazon SageMaker
20 18 (2.65%) Azure AI
Communications & Networking
1 4 (0.59%) Cisco IPT
2 3 (0.44%) Firewall
2 3 (0.44%) Network Security
2 3 (0.44%) VPN
3 2 (0.29%) InfiniBand
3 2 (0.29%) Kerberos
4 1 (0.15%) 4G
4 1 (0.15%) 5G
4 1 (0.15%) HTTP
4 1 (0.15%) WireGuard
Database & Business Intelligence
1 160 (23.53%) Data Warehouse
2 113 (16.62%) Data Lake
3 110 (16.18%) Power BI
4 62 (9.12%) Metadata
5 56 (8.24%) Azure SQL Database
6 55 (8.09%) Delta Lake
6 55 (8.09%) SQL Server
7 49 (7.21%) NoSQL
8 43 (6.32%) Big Data
9 41 (6.03%) BigQuery
10 39 (5.74%) Amazon Redshift
10 39 (5.74%) Tableau
11 32 (4.71%) Snowflake Schema
12 27 (3.97%) Relational Database
13 22 (3.24%) Amazon Athena
13 22 (3.24%) PostgreSQL
14 19 (2.79%) Spark SQL
14 19 (2.79%) SQL Server Integration Services
15 15 (2.21%) Data Vault
15 15 (2.21%) Star Schema
Development Applications
1 109 (16.03%) Git
2 34 (5.00%) MLflow
3 26 (3.82%) Jenkins
4 25 (3.68%) GitLab
5 21 (3.09%) JIRA
6 4 (0.59%) SonarQube
7 3 (0.44%) ERwin
7 3 (0.44%) Terragrunt
7 3 (0.44%) Visual Studio
8 2 (0.29%) Cypress.io
8 2 (0.29%) Selenium
8 2 (0.29%) Sonatype Nexus
8 2 (0.29%) SpecFlow
8 2 (0.29%) TeamCity
9 1 (0.15%) Gradle
9 1 (0.15%) Liquibase
9 1 (0.15%) Postman
9 1 (0.15%) Team Foundation Server
9 1 (0.15%) Visual Studio Code
9 1 (0.15%) Visual Studio Coded UI
General
1 193 (28.38%) Finance
2 159 (23.38%) Social Skills
3 99 (14.56%) Analytical Skills
4 51 (7.50%) Banking
5 44 (6.47%) Public Sector
6 22 (3.24%) Front Office
6 22 (3.24%) Inclusion and Diversity
7 18 (2.65%) Investment Banking
8 15 (2.21%) Legal
9 12 (1.76%) Pharmaceutical
10 11 (1.62%) Documentation Skills
10 11 (1.62%) Financial Institution
11 10 (1.47%) Retail
12 9 (1.32%) Back Office
13 8 (1.18%) Electronics
13 8 (1.18%) Marketing
13 8 (1.18%) Telecoms
14 7 (1.03%) Influencing Skills
15 4 (0.59%) Publishing
16 3 (0.44%) Military
Job Titles
1 326 (47.94%) Data Engineer
2 93 (13.68%) Senior
3 69 (10.15%) Developer
4 66 (9.71%) Senior Data Engineer
5 57 (8.38%) Azure Engineer
6 53 (7.79%) Architect
7 51 (7.50%) Azure Data Engineer
8 49 (7.21%) Lead
9 38 (5.59%) Data Scientist
10 35 (5.15%) Python Engineer
11 31 (4.56%) Snowflake Engineer
12 28 (4.12%) Artificial Intelligence Engineer
13 27 (3.97%) Snowflake Data Engineer
14 23 (3.38%) Analyst
14 23 (3.38%) AWS Engineer
15 22 (3.24%) Data Architect
16 21 (3.09%) Lead Data Engineer
17 20 (2.94%) Consultant
17 20 (2.94%) Python Data Engineer
18 18 (2.65%) AWS Data Engineer
Libraries, Frameworks & Software Standards
1 126 (18.53%) PySpark
2 72 (10.59%) Kafka
3 57 (8.38%) Pandas
4 46 (6.76%) PyTorch
5 44 (6.47%) scikit-learn
6 42 (6.18%) TensorFlow
7 40 (5.88%) NumPy
8 27 (3.97%) REST
9 21 (3.09%) FastAPI
10 20 (2.94%) pytest
11 19 (2.79%) React
12 17 (2.50%) Hugging Face
12 17 (2.50%) JSON
13 16 (2.35%) .NET
13 16 (2.35%) Flask
14 14 (2.06%) LangChain
14 14 (2.06%) RESTful
15 13 (1.91%) YAML
16 12 (1.76%) Django
16 12 (1.76%) Node.js
Miscellaneous
1 90 (13.24%) Cloud Native
2 29 (4.26%) Algorithms
2 29 (4.26%) Distributed Systems
3 27 (3.97%) Data Structures
4 25 (3.68%) Distributed Computing
5 20 (2.94%) Legacy Systems
6 19 (2.79%) AI Agents
6 19 (2.79%) Equities
7 18 (2.65%) Derivative
8 17 (2.50%) Fixed Income
8 17 (2.50%) Product Ownership
9 13 (1.91%) Hedge funds
10 9 (1.32%) Data Protection Act
10 9 (1.32%) Equity Derivative
10 9 (1.32%) Self-Motivation
11 8 (1.18%) Foreign Exchange (FX)
11 8 (1.18%) Greenfield Project
11 8 (1.18%) Low-Code
11 8 (1.18%) Reinsurance
12 7 (1.03%) Life Science
Operating Systems
1 19 (2.79%) Linux
2 8 (1.18%) Unix
3 3 (0.44%) Windows
4 2 (0.29%) Ubuntu
5 1 (0.15%) Alpine Linux
5 1 (0.15%) CentOS
5 1 (0.15%) Red Hat Enterprise Linux
5 1 (0.15%) zOS
Processes & Methodologies
1 314 (46.18%) Data Engineering
2 290 (42.65%) Analytics
3 268 (39.41%) ETL
4 264 (38.82%) Data Modelling
5 255 (37.50%) CI/CD
6 202 (29.71%) AI
7 179 (26.32%) Agile
7 179 (26.32%) DevOps
7 179 (26.32%) Machine Learning
8 165 (24.26%) Data Science
9 163 (23.97%) Data Governance
10 134 (19.71%) Business Intelligence
11 108 (15.88%) Problem-Solving
12 97 (14.26%) Data Architecture
13 90 (13.24%) Data Integration
14 89 (13.09%) Validation
15 85 (12.50%) Infrastructure as Code
16 81 (11.91%) Decision-Making
17 78 (11.47%) Use Case
18 68 (10.00%) Visualisation
Programming Languages
1 456 (67.06%) Python
2 402 (59.12%) SQL
3 74 (10.88%) Scala
4 54 (7.94%) Java
5 23 (3.38%) C#
6 21 (3.09%) Data Analysis Expressions
7 20 (2.94%) JavaScript
8 16 (2.35%) Bicep
9 15 (2.21%) T-SQL
10 13 (1.91%) R
11 11 (1.62%) C++
11 11 (1.62%) TypeScript
12 9 (1.32%) Bash
12 9 (1.32%) PowerShell
13 8 (1.18%) Korn
13 8 (1.18%) Shell Script
14 7 (1.03%) PL/SQL
15 3 (0.44%) SAS Macro
16 2 (0.29%) Ruby
17 1 (0.15%) C
Qualifications
1 132 (19.41%) Security Cleared
2 114 (16.76%) SC Cleared
3 53 (7.79%) Degree
4 23 (3.38%) Master's Degree
5 22 (3.24%) Azure Certification
6 11 (1.62%) AWS Certification
6 11 (1.62%) Computer Science Degree
6 11 (1.62%) DV Cleared
6 11 (1.62%) PhD
7 9 (1.32%) Numerate Degree
8 8 (1.18%) BPSS Clearance
9 5 (0.74%) Microsoft Certified Professional
10 3 (0.44%) DBS Check
10 3 (0.44%) SnowPro
11 2 (0.29%) Postgraduate
12 1 (0.15%) AWS Certified Solutions Architect
12 1 (0.15%) HP APS
12 1 (0.15%) PMI Certification
12 1 (0.15%) PMP
Quality Assurance & Compliance
1 223 (32.79%) Data Quality
2 39 (5.74%) GDPR
3 28 (4.12%) QA
4 11 (1.62%) Accessibility
5 9 (1.32%) PERC
6 7 (1.03%) Sarbanes-Oxley
7 5 (0.74%) PCI DSS
8 4 (0.59%) NIST
9 3 (0.44%) Actionable Recommendations
9 3 (0.44%) HIPAA
9 3 (0.44%) ISO/IEC 27001
10 2 (0.29%) Dodd-Frank
10 2 (0.29%) EMIR
10 2 (0.29%) EU AI Act
10 2 (0.29%) GRC
10 2 (0.29%) MiFID
10 2 (0.29%) PMO
10 2 (0.29%) SLA
10 2 (0.29%) WCAG
11 1 (0.15%) IFRS 17
System Software
1 92 (13.53%) Docker
2 3 (0.44%) Active Directory
3 2 (0.29%) Ceph
3 2 (0.29%) Firmware
3 2 (0.29%) HDFS
3 2 (0.29%) Lustre
3 2 (0.29%) Slurm Workload Manager
4 1 (0.15%) Oracle RAC
4 1 (0.15%) Virtual Machines
4 1 (0.15%) zsh
Systems Management
1 91 (13.38%) Terraform
2 78 (11.47%) Kubernetes
3 4 (0.59%) Prometheus
4 3 (0.44%) ITRS Geneos
4 3 (0.44%) Kibana
4 3 (0.44%) Kubeflow
4 3 (0.44%) Single Sign-On
5 2 (0.29%) Control-M
5 2 (0.29%) Grafana
5 2 (0.29%) Istio
5 2 (0.29%) logstash
6 1 (0.15%) Ansible
6 1 (0.15%) HP ALM
6 1 (0.15%) Microsoft Intune
6 1 (0.15%) SCCM
Vendors
1 220 (32.35%) Databricks
2 106 (15.59%) Microsoft
3 34 (5.00%) Google
4 31 (4.56%) OpenAI
5 26 (3.82%) Informatica
6 21 (3.09%) Oracle
7 16 (2.35%) Foundry
8 10 (1.47%) Palantir
8 10 (1.47%) Salesforce
9 9 (1.32%) SAP
9 9 (1.32%) UiPath
10 8 (1.18%) Automation Anywhere
11 7 (1.03%) Cloudera
12 6 (0.88%) Dynatrace
13 5 (0.74%) Adobe
13 5 (0.74%) mParticle
13 5 (0.74%) NVIDIA
13 5 (0.74%) Tealium
14 4 (0.59%) Splunk
14 4 (0.59%) Talend