Data Pipeline Contracts in London

Data Pipelines
England > London

The table below provides summary statistics for contract job vacancies advertised in London requiring Data Pipeline skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Data Pipeline over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 110 139 214
Rank change year-on-year +29 +75 +13
Contract jobs citing Data Pipeline 324 310 328
As % of all contract jobs advertised in London 2.58% 1.74% 1.21%
As % of the Processes & Methodologies category 2.80% 1.96% 1.33%
Number of daily rates quoted 237 242 221
10th Percentile £400 £413 £450
25th Percentile £449 £463 £500
Median daily rate (50th Percentile) £525 £575 £565
Median % change year-on-year -8.70% +1.77% -9.60%
75th Percentile £650 £675 £675
90th Percentile £800 £750 £775
England median daily rate £500 £550 £550
% change year-on-year -9.09% - -8.33%
Number of hourly rates quoted 5 1 4
10th Percentile £45.46 - -
25th Percentile £51.25 £46.75 £65.00
Median hourly rate £52.50 £48.50 £72.50
Median % change year-on-year +8.25% -33.10% +114.81%
75th Percentile £65.00 £50.25 £84.38
90th Percentile - - £87.75
England median hourly rate £58.75 £62.50 £70.25
% change year-on-year -6.00% -11.03% +133.20%

All Process and Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring process or methodology skills in London.

Contract vacancies with a requirement for process or methodology skills 11,564 15,790 24,631
As % of all contract IT jobs advertised in London 92.16% 88.55% 91.11%
Number of daily rates quoted 7,847 11,316 17,711
10th Percentile £350 £338 £375
25th Percentile £440 £450 £475
Median daily rate (50th Percentile) £550 £550 £590
Median % change year-on-year - -6.78% +2.61%
75th Percentile £688 £675 £700
90th Percentile £813 £800 £800
England median daily rate £525 £525 £550
% change year-on-year - -4.55% +2.33%
Number of hourly rates quoted 166 324 278
10th Percentile £16.17 £16.00 £18.59
25th Percentile £22.68 £20.00 £22.53
Median hourly rate £31.67 £29.50 £38.13
Median % change year-on-year +7.36% -22.62% +5.90%
75th Percentile £50.75 £47.56 £62.64
90th Percentile £63.75 £65.93 £76.78
England median hourly rate £29.07 £36.00 £37.50
% change year-on-year -19.25% -4.00% +53.06%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 1 May 2025.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Data Pipeline in London over the 6 months to 1 May 2025.

Hourly rate histogram for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London -1 43 £538 -4.44% 17
South London +5 4 £481 +6.94% 3
East London +16 2 - - 1
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 65 (20.06%) Apache Spark
2 47 (14.51%) Apache
3 40 (12.35%) Apache Airflow
4 10 (3.09%) Jupyter
5 4 (1.23%) Confluence
5 4 (1.23%) SAS
6 1 (0.31%) nginx
Applications
1 7 (2.16%) Microsoft Excel
2 2 (0.62%) Chatbot
3 1 (0.31%) MS Visio
Business Applications
1 6 (1.85%) Aladdin
2 3 (0.93%) Dynamics CRM
3 1 (0.31%) Endur
Cloud Services
1 134 (41.36%) AWS
2 131 (40.43%) Azure
3 56 (17.28%) GCP
4 51 (15.74%) Power Platform
5 49 (15.12%) Snowflake
6 46 (14.20%) dbt
7 45 (13.89%) Azure Data Factory
8 37 (11.42%) Amazon S3
9 34 (10.49%) Azure Synapse Analytics
10 30 (9.26%) Serverless
11 27 (8.33%) GitHub
12 23 (7.10%) AWS Lambda
13 18 (5.56%) GitHub Actions
14 14 (4.32%) AWS CloudFormation
14 14 (4.32%) Azure DevOps
15 11 (3.40%) Amazon Kinesis
16 10 (3.09%) Amazon EC2
16 10 (3.09%) Azure Machine Learning
17 9 (2.78%) Amazon CloudWatch
17 9 (2.78%) Cloud Computing
Communications & Networking
1 6 (1.85%) SSH
Database & Business Intelligence
1 80 (24.69%) Data Warehouse
2 57 (17.59%) Data Lake
3 50 (15.43%) Power BI
4 48 (14.81%) Big Data
5 31 (9.57%) Amazon Redshift
6 27 (8.33%) NoSQL
7 26 (8.02%) BigQuery
7 26 (8.02%) Tableau
8 25 (7.72%) Hadoop
9 20 (6.17%) Snowflake Schema
9 20 (6.17%) SQL Server
10 19 (5.86%) Amazon RDS
10 19 (5.86%) PostgreSQL
11 16 (4.94%) Apache Hive
11 16 (4.94%) Relational Database
12 14 (4.32%) Amazon Athena
13 13 (4.01%) Azure SQL Database
13 13 (4.01%) DynamoDB
14 12 (3.70%) Delta Lake
14 12 (3.70%) Flink
Development Applications
1 33 (10.19%) Git
2 14 (4.32%) Jenkins
3 12 (3.70%) JIRA
4 6 (1.85%) GitLab
4 6 (1.85%) MLflow
4 6 (1.85%) RStudio
5 5 (1.54%) ERwin
6 4 (1.23%) Terragrunt
7 2 (0.62%) Liquibase
7 2 (0.62%) MagicDraw
7 2 (0.62%) Postman
7 2 (0.62%) Selenium
7 2 (0.62%) Visual Studio
8 1 (0.31%) Artifactory
8 1 (0.31%) JMeter
8 1 (0.31%) JUnit
8 1 (0.31%) Locust
8 1 (0.31%) Mockito
8 1 (0.31%) Robot Framework
8 1 (0.31%) Subversion
General
1 80 (24.69%) Finance
2 70 (21.60%) Social Skills
3 61 (18.83%) Analytical Skills
4 33 (10.19%) Public Sector
5 29 (8.95%) Banking
6 19 (5.86%) Retail
7 18 (5.56%) Investment Banking
8 8 (2.47%) Inclusion and Diversity
9 7 (2.16%) Retail Banking
10 5 (1.54%) Presentation Skills
11 4 (1.23%) Corporate Banking
11 4 (1.23%) Front Office
11 4 (1.23%) Local Government
11 4 (1.23%) Manufacturing
12 3 (0.93%) Documentation Skills
13 2 (0.62%) Influencing Skills
13 2 (0.62%) Marketing
13 2 (0.62%) Police
13 2 (0.62%) Telecoms
14 1 (0.31%) Multimedia
Job Titles
1 166 (51.23%) Data Engineer
2 48 (14.81%) Developer
3 42 (12.96%) Senior
4 29 (8.95%) AWS Engineer
5 28 (8.64%) AWS Data Engineer
6 26 (8.02%) Architect
6 26 (8.02%) Senior Data Engineer
7 21 (6.48%) Lead
8 19 (5.86%) Analyst
9 18 (5.56%) Azure Engineer
10 17 (5.25%) Data Architect
11 16 (4.94%) Azure Data Engineer
11 16 (4.94%) Python Engineer
12 13 (4.01%) Lead Data Engineer
13 12 (3.70%) Python Developer
14 11 (3.40%) Data Analyst
14 11 (3.40%) Python Data Engineer
15 10 (3.09%) GCP Engineer
15 10 (3.09%) Snowflake Engineer
16 9 (2.78%) Snowflake Data Engineer
Libraries, Frameworks & Software Standards
1 56 (17.28%) PySpark
2 42 (12.96%) Kafka
3 19 (5.86%) pytest
4 11 (3.40%) JSON
4 11 (3.40%) Spark Streaming
5 10 (3.09%) Pandas
5 10 (3.09%) pydantic
5 10 (3.09%) YAML
6 9 (2.78%) FastAPI
6 9 (2.78%) PyTorch
7 8 (2.47%) NumPy
7 8 (2.47%) React
7 8 (2.47%) scikit-learn
7 8 (2.47%) TensorFlow
8 6 (1.85%) Apache Avro
8 6 (1.85%) Plotly
9 5 (1.54%) Jinja
9 5 (1.54%) LangChain
9 5 (1.54%) OpenTelemetry
9 5 (1.54%) REST
Miscellaneous
1 17 (5.25%) Data Structures
2 16 (4.94%) Distributed Computing
3 14 (4.32%) Distributed Systems
4 13 (4.01%) Legacy Systems
5 12 (3.70%) Derivative
6 10 (3.09%) Market Risk
7 9 (2.78%) Analytical Mindset
7 9 (2.78%) Cloud Native
7 9 (2.78%) Reference Data
8 7 (2.16%) Algorithms
8 7 (2.16%) Linux Command Line
9 6 (1.85%) Clustering
9 6 (1.85%) Equity Derivative
10 5 (1.54%) Product Ownership
10 5 (1.54%) Renewable Energy
10 5 (1.54%) Virtual Team
11 4 (1.23%) Equities
11 4 (1.23%) Housing Association
12 3 (0.93%) Greenfield Project
13 2 (0.62%) Hybrid Cloud
Operating Systems
1 22 (6.79%) Linux
2 7 (2.16%) Unix
Processes & Methodologies
1 128 (39.51%) ETL
2 111 (34.26%) Data Engineering
3 109 (33.64%) Analytics
4 101 (31.17%) Data Modelling
5 96 (29.63%) CI/CD
6 87 (26.85%) Problem-Solving
7 63 (19.44%) Data Science
8 62 (19.14%) Machine Learning
9 57 (17.59%) Data Integration
10 52 (16.05%) Agile
11 50 (15.43%) Decision-Making
12 49 (15.12%) Business Intelligence
12 49 (15.12%) Visualisation
13 48 (14.81%) DevOps
14 47 (14.51%) Artificial Intelligence
15 42 (12.96%) Data Governance
16 35 (10.80%) Data Transformation
17 34 (10.49%) Migration
18 32 (9.88%) Data Architecture
18 32 (9.88%) Data Visualisation
Programming Languages
1 213 (65.74%) Python
2 184 (56.79%) SQL
3 32 (9.88%) Java
4 23 (7.10%) Scala
5 15 (4.63%) C++
6 14 (4.32%) R
7 10 (3.09%) Bash
8 9 (2.78%) JavaScript
9 5 (1.54%) C#
9 5 (1.54%) Data Analysis Expressions
9 5 (1.54%) T-SQL
10 4 (1.23%) Shell Script
11 2 (0.62%) Lua
11 2 (0.62%) Perl
11 2 (0.62%) PHP
11 2 (0.62%) PL/SQL
11 2 (0.62%) Rust
11 2 (0.62%) SAS Macro
11 2 (0.62%) SPARQL
11 2 (0.62%) TypeScript
Qualifications
1 53 (16.36%) Security Cleared
2 44 (13.58%) SC Cleared
3 24 (7.41%) Degree
4 11 (3.40%) Computer Science Degree
5 9 (2.78%) AWS Certification
6 8 (2.47%) Master's Degree
7 6 (1.85%) DV Cleared
7 6 (1.85%) Numerate Degree
8 4 (1.23%) AWS Certified Solutions Architect
8 4 (1.23%) BPSS Clearance
8 4 (1.23%) PMI Certification
8 4 (1.23%) PMP
9 3 (0.93%) Azure Certification
10 2 (0.62%) Microsoft Certification
10 2 (0.62%) PhD
10 2 (0.62%) SnowPro
10 2 (0.62%) Tableau Certification
11 1 (0.31%) BC Cleared
11 1 (0.31%) ISTQB
Quality Assurance & Compliance
1 77 (23.77%) Data Quality
2 18 (5.56%) QA
3 13 (4.01%) Accessibility
4 11 (3.40%) GDPR
5 3 (0.93%) Actionable Recommendations
6 1 (0.31%) HL7
System Software
1 38 (11.73%) Docker
2 2 (0.62%) HDFS
3 1 (0.31%) Active Directory
3 1 (0.31%) Tivoli Workload Scheduler
Systems Management
1 42 (12.96%) Terraform
2 39 (12.04%) Kubernetes
3 2 (0.62%) Kubeflow
4 1 (0.31%) Ansible
4 1 (0.31%) Grafana
4 1 (0.31%) Kibana
4 1 (0.31%) logstash
4 1 (0.31%) Prometheus
4 1 (0.31%) Tivoli
Vendors
1 67 (20.68%) Databricks
2 22 (6.79%) Microsoft
3 21 (6.48%) Google
4 14 (4.32%) Oracle
5 13 (4.01%) Informatica
6 5 (1.54%) MicroStrategy
6 5 (1.54%) Palantir
6 5 (1.54%) Splunk
7 4 (1.23%) SAP
7 4 (1.23%) Talend
8 3 (0.93%) Dataiku
8 3 (0.93%) DataRobot
8 3 (0.93%) OpenAI
9 2 (0.62%) Aareon
9 2 (0.62%) Civica
9 2 (0.62%) New Relic
9 2 (0.62%) Northgate
10 1 (0.31%) Alteryx
10 1 (0.31%) CA Agile Central
10 1 (0.31%) ServiceNow