Data Pipeline Contracts in London

Data Pipelines
England > London

The table below provides summary statistics for contract job vacancies advertised in London requiring Data Pipeline skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Data Pipeline over the 6 months leading up to 30 May 2025, comparing them to the same period in the previous two years.

6 months to
30 May 2025
Same period 2024 Same period 2023
Rank 104 140 217
Rank change year-on-year +36 +77 +13
Contract jobs citing Data Pipeline 328 321 295
As % of all contract jobs advertised in London 2.70% 1.84% 1.16%
As % of the Processes & Methodologies category 2.92% 2.08% 1.28%
Number of daily rates quoted 244 245 195
10th Percentile £407 £389 £450
25th Percentile £450 £463 £500
Median daily rate (50th Percentile) £550 £560 £565
Median % change year-on-year -1.79% -0.88% -9.60%
75th Percentile £666 £680 £688
90th Percentile £800 £764 £765
England median daily rate £500 £550 £550
% change year-on-year -9.09% - -8.33%
Number of hourly rates quoted 3 1 3
10th Percentile £43.53 - £67.50
25th Percentile £46.42 £46.75 £71.25
Median hourly rate £52.50 £48.50 £80.00
Median % change year-on-year +8.25% -39.38% +137.04%
75th Percentile £53.75 £50.25 £86.25
90th Percentile - - £88.50
England median hourly rate £52.50 £62.50 £75.50
% change year-on-year -16.00% -17.22% +123.70%

All Process and Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring process or methodology skills in London.

Contract vacancies with a requirement for process or methodology skills 11,225 15,457 23,121
As % of all contract IT jobs advertised in London 92.24% 88.42% 90.86%
Number of daily rates quoted 7,536 11,093 16,726
10th Percentile £350 £340 £375
25th Percentile £431 £450 £475
Median daily rate (50th Percentile) £550 £550 £590
Median % change year-on-year - -6.78% +2.61%
75th Percentile £688 £675 £700
90th Percentile £800 £800 £800
England median daily rate £525 £525 £550
% change year-on-year - -4.55% +1.85%
Number of hourly rates quoted 189 316 265
10th Percentile £16.50 £15.50 £18.20
25th Percentile £23.80 £20.00 £22.50
Median hourly rate £31.35 £28.00 £39.42
Median % change year-on-year +11.95% -28.97% +12.39%
75th Percentile £49.75 £48.75 £64.50
90th Percentile £63.05 £66.88 £82.50
England median hourly rate £28.17 £37.50 £37.50
% change year-on-year -24.89% - +50.00%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 30 May 2025.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 30 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +14 53 £550 - 21
South London +3 3 £475 +5.56% 2
West London +12 2 £512 -2.48% 75
East London +20 1 - - 2
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 63 (19.21%) Apache Spark
2 46 (14.02%) Apache
3 41 (12.50%) Apache Airflow
4 12 (3.66%) Jupyter
5 7 (2.13%) Confluence
6 4 (1.22%) SAS
7 1 (0.30%) nginx
Applications
1 11 (3.35%) Microsoft Excel
2 2 (0.61%) Chatbot
2 2 (0.61%) MS Visio
Business Applications
1 6 (1.83%) Aladdin
2 1 (0.30%) Dynamics CRM
2 1 (0.30%) Endur
2 1 (0.30%) Sparx Enterprise Architect
Cloud Services
1 144 (43.90%) Azure
2 129 (39.33%) AWS
3 58 (17.68%) GCP
4 56 (17.07%) Power Platform
5 46 (14.02%) Azure Data Factory
6 45 (13.72%) Snowflake
7 44 (13.41%) dbt
8 34 (10.37%) Azure Synapse Analytics
9 29 (8.84%) GitHub
10 28 (8.54%) Amazon S3
10 28 (8.54%) Serverless
11 21 (6.40%) AWS Lambda
12 20 (6.10%) GitHub Actions
13 15 (4.57%) Azure DevOps
14 9 (2.74%) Azure Machine Learning
15 8 (2.44%) Amazon CloudWatch
15 8 (2.44%) Amazon EC2
15 8 (2.44%) Amazon SageMaker
15 8 (2.44%) AWS Step Functions
16 7 (2.13%) Cloud Computing
Communications & Networking
1 6 (1.83%) SSH
Database & Business Intelligence
1 74 (22.56%) Data Warehouse
2 55 (16.77%) Power BI
3 54 (16.46%) Data Lake
4 46 (14.02%) Big Data
5 29 (8.84%) NoSQL
6 28 (8.54%) BigQuery
7 25 (7.62%) SQL Server
7 25 (7.62%) Tableau
8 23 (7.01%) Hadoop
9 21 (6.40%) PostgreSQL
9 21 (6.40%) Snowflake Schema
10 20 (6.10%) Amazon Redshift
11 19 (5.79%) Metadata
12 18 (5.49%) Amazon RDS
13 16 (4.88%) Delta Lake
14 15 (4.57%) Apache Hive
14 15 (4.57%) Relational Database
15 14 (4.27%) DynamoDB
16 13 (3.96%) Amazon Athena
16 13 (3.96%) Azure SQL Database
Development Applications
1 39 (11.89%) Git
2 16 (4.88%) JIRA
3 14 (4.27%) Jenkins
4 10 (3.05%) GitLab
5 8 (2.44%) ERwin
6 7 (2.13%) MLflow
7 6 (1.83%) RStudio
8 5 (1.52%) Terragrunt
9 3 (0.91%) ER Studio
9 3 (0.91%) Liquibase
10 2 (0.61%) MagicDraw
10 2 (0.61%) Postman
10 2 (0.61%) Selenium
11 1 (0.30%) IBM UrbanCode
11 1 (0.30%) JMeter
11 1 (0.30%) JUnit
11 1 (0.30%) Locust
11 1 (0.30%) Mockito
11 1 (0.30%) Robot Framework
11 1 (0.30%) Subversion
General
1 86 (26.22%) Finance
2 75 (22.87%) Social Skills
3 54 (16.46%) Analytical Skills
4 29 (8.84%) Banking
5 27 (8.23%) Public Sector
6 18 (5.49%) Investment Banking
7 15 (4.57%) Retail
8 9 (2.74%) Inclusion and Diversity
9 8 (2.44%) Retail Banking
10 6 (1.83%) Presentation Skills
11 5 (1.52%) Corporate Banking
11 5 (1.52%) Telecoms
12 4 (1.22%) Documentation Skills
12 4 (1.22%) Local Government
12 4 (1.22%) Marketing
12 4 (1.22%) Police
13 3 (0.91%) Front Office
13 3 (0.91%) Manufacturing
13 3 (0.91%) Organisational Skills
14 2 (0.61%) Influencing Skills
Job Titles
1 149 (45.43%) Data Engineer
2 57 (17.38%) Developer
3 41 (12.50%) Senior
4 28 (8.54%) Architect
5 25 (7.62%) Senior Data Engineer
6 23 (7.01%) Azure Engineer
6 23 (7.01%) Lead
7 21 (6.40%) AWS Data Engineer
7 21 (6.40%) AWS Engineer
7 21 (6.40%) Azure Data Engineer
8 20 (6.10%) Analyst
9 18 (5.49%) Data Architect
10 16 (4.88%) Python Engineer
11 13 (3.96%) Lead Data Engineer
11 13 (3.96%) Python Developer
12 12 (3.66%) Python Data Engineer
13 11 (3.35%) Data Analyst
13 11 (3.35%) GCP Engineer
14 10 (3.05%) Quantitative Developer
15 9 (2.74%) Java Developer
Libraries, Frameworks & Software Standards
1 47 (14.33%) PySpark
2 40 (12.20%) Kafka
3 18 (5.49%) pytest
4 11 (3.35%) JSON
4 11 (3.35%) Pandas
4 11 (3.35%) pydantic
4 11 (3.35%) Spark Streaming
5 10 (3.05%) FastAPI
5 10 (3.05%) YAML
6 9 (2.74%) NumPy
7 8 (2.44%) PyTorch
7 8 (2.44%) TensorFlow
8 6 (1.83%) .NET
8 6 (1.83%) Apache Avro
8 6 (1.83%) LangChain
8 6 (1.83%) OpenTelemetry
8 6 (1.83%) React
8 6 (1.83%) RESTful
8 6 (1.83%) scikit-learn
9 5 (1.52%) SQLAlchemy
Miscellaneous
1 20 (6.10%) Distributed Systems
2 17 (5.18%) Data Structures
3 15 (4.57%) Distributed Computing
3 15 (4.57%) Legacy Systems
4 14 (4.27%) Derivative
5 11 (3.35%) Cloud Native
6 10 (3.05%) Market Risk
7 9 (2.74%) Analytical Mindset
7 9 (2.74%) Reference Data
8 8 (2.44%) Algorithms
8 8 (2.44%) Equities
8 8 (2.44%) Equity Derivative
8 8 (2.44%) Product Ownership
9 7 (2.13%) Linux Command Line
10 6 (1.83%) Clustering
10 6 (1.83%) Renewable Energy
11 5 (1.52%) Self-Motivation
12 4 (1.22%) Housing Association
12 4 (1.22%) Virtual Team
13 3 (0.91%) Greenfield Project
Operating Systems
1 24 (7.32%) Linux
2 7 (2.13%) Unix
Processes & Methodologies
1 130 (39.63%) ETL
2 117 (35.67%) Analytics
3 113 (34.45%) Data Modelling
4 106 (32.32%) Data Engineering
5 102 (31.10%) CI/CD
6 86 (26.22%) Problem-Solving
7 66 (20.12%) Data Science
8 65 (19.82%) Agile
8 65 (19.82%) Machine Learning
9 58 (17.68%) Data Integration
10 55 (16.77%) Artificial Intelligence
11 54 (16.46%) Business Intelligence
11 54 (16.46%) Decision-Making
12 53 (16.16%) Data Governance
13 51 (15.55%) DevOps
14 44 (13.41%) Visualisation
15 34 (10.37%) Actionable Insight
15 34 (10.37%) Migration
16 33 (10.06%) Data Ingestion
17 32 (9.76%) Data Transformation
Programming Languages
1 210 (64.02%) Python
2 175 (53.35%) SQL
3 30 (9.15%) Java
4 25 (7.62%) Scala
5 17 (5.18%) C++
6 12 (3.66%) R
7 10 (3.05%) Bash
8 9 (2.74%) Data Analysis Expressions
9 7 (2.13%) C#
10 6 (1.83%) JavaScript
11 5 (1.52%) Shell Script
12 3 (0.91%) T-SQL
13 2 (0.61%) Go
13 2 (0.61%) Lua
13 2 (0.61%) Perl
13 2 (0.61%) PHP
13 2 (0.61%) PowerShell
13 2 (0.61%) SAS Macro
13 2 (0.61%) SPARQL
13 2 (0.61%) TypeScript
Qualifications
1 52 (15.85%) Security Cleared
2 41 (12.50%) SC Cleared
3 26 (7.93%) Degree
4 9 (2.74%) AWS Certification
4 9 (2.74%) Computer Science Degree
5 8 (2.44%) Numerate Degree
6 7 (2.13%) Master's Degree
7 6 (1.83%) DV Cleared
7 6 (1.83%) PMI Certification
7 6 (1.83%) PMP
8 5 (1.52%) Azure Certification
9 4 (1.22%) BPSS Clearance
10 2 (0.61%) AWS Certified Solutions Architect
10 2 (0.61%) Microsoft Certification
10 2 (0.61%) SnowPro
10 2 (0.61%) Tableau Certification
11 1 (0.30%) BC Cleared
11 1 (0.30%) ISTQB
11 1 (0.30%) PhD
Quality Assurance & Compliance
1 67 (20.43%) Data Quality
2 20 (6.10%) QA
3 15 (4.57%) GDPR
4 11 (3.35%) Accessibility
5 2 (0.61%) Actionable Recommendations
5 2 (0.61%) Solvency II
6 1 (0.30%) GxP
6 1 (0.30%) HL7
System Software
1 39 (11.89%) Docker
2 1 (0.30%) Active Directory
2 1 (0.30%) Tivoli Workload Scheduler
Systems Management
1 43 (13.11%) Kubernetes
2 41 (12.50%) Terraform
3 4 (1.22%) Kibana
4 3 (0.91%) Grafana
4 3 (0.91%) Prometheus
5 2 (0.61%) Kubeflow
5 2 (0.61%) logstash
6 1 (0.30%) Ansible
6 1 (0.30%) ITRS Geneos
6 1 (0.30%) Tivoli
Vendors
1 77 (23.48%) Databricks
2 26 (7.93%) Microsoft
3 21 (6.40%) Google
4 14 (4.27%) Oracle
5 12 (3.66%) Informatica
6 7 (2.13%) Palantir
7 5 (1.52%) Dataiku
7 5 (1.52%) DataRobot
7 5 (1.52%) MicroStrategy
7 5 (1.52%) Talend
8 4 (1.22%) SAP
9 3 (0.91%) Foundry
9 3 (0.91%) OpenAI
9 3 (0.91%) Sparx
9 3 (0.91%) Splunk
10 2 (0.61%) Aareon
10 2 (0.61%) Civica
10 2 (0.61%) Duck Creek
10 2 (0.61%) Guidewire
10 2 (0.61%) Northgate