Data Pipeline Contracts in London

Data Pipelines
England > London

The table below provides summary statistics for contract job vacancies advertised in London requiring Data Pipeline skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Data Pipeline over the 6 months leading up to 19 June 2024, comparing them to the same period in the previous two years.

6 months to
19 Jun 2024
Same period 2023 Same period 2022
Rank 134 231 226
Rank change year-on-year +97 -5 -32
Contract jobs citing Data Pipeline 334 284 506
As % of all contract jobs advertised in London 1.89% 1.13% 1.31%
As % of the Processes & Methodologies category 2.14% 1.24% 1.43%
Number of daily rates quoted 255 187 352
10th Percentile £400 £433 £469
25th Percentile £459 £500 £525
Median daily rate (50th Percentile) £550 £565 £628
Median % change year-on-year -2.65% -9.96% +14.09%
75th Percentile £678 £688 £750
90th Percentile £758 £775 £838
England median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +14.29%
Number of hourly rates quoted 1 3 8
10th Percentile - £67.50 £27.30
25th Percentile £46.75 £71.25 £28.88
Median hourly rate £48.50 £80.00 £33.75
Median % change year-on-year -39.38% +137.04% -17.68%
75th Percentile £50.25 £86.25 £60.00
90th Percentile - £88.50 £82.40
England median hourly rate £62.50 £75.50 £33.75
% change year-on-year -17.22% +123.70% -10.00%

All Process and Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring process or methodology skills in London.

Contract vacancies with a requirement for process or methodology skills 15,607 22,862 35,495
As % of all contract IT jobs advertised in London 88.27% 90.90% 92.19%
Number of daily rates quoted 11,159 16,574 26,061
10th Percentile £340 £375 £394
25th Percentile £445 £475 £475
Median daily rate (50th Percentile) £550 £588 £575
Median % change year-on-year -6.38% +2.17% +9.52%
75th Percentile £675 £700 £688
90th Percentile £800 £800 £780
England median daily rate £525 £550 £550
% change year-on-year -4.55% - +10.00%
Number of hourly rates quoted 315 267 388
10th Percentile £15.50 £18.00 £17.09
25th Percentile £20.00 £22.50 £23.91
Median hourly rate £30.00 £39.42 £36.00
Median % change year-on-year -23.90% +9.50% +9.59%
75th Percentile £48.75 £64.50 £50.83
90th Percentile £67.60 £82.50 £67.50
England median hourly rate £37.50 £36.00 £25.68
% change year-on-year +4.17% +40.19% +14.13%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 19 June 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 19 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +47 52 £525 -12.50% 26
South London - 4 £450 -
West London +12 2 £525 -8.70% 5
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 65 (19.46%) Apache Spark
2 41 (12.28%) Apache
3 36 (10.78%) Apache Airflow
4 4 (1.20%) Luigi
5 3 (0.90%) SharePoint
6 2 (0.60%) Confluence
Applications
1 7 (2.10%) Microsoft Excel
2 2 (0.60%) Microsoft Office
Business Applications
1 2 (0.60%) Dynamics CRM
Cloud Services
1 157 (47.01%) Azure
2 143 (42.81%) AWS
3 54 (16.17%) Serverless
4 43 (12.87%) GCP
5 42 (12.57%) Amazon S3
5 42 (12.57%) Azure Data Factory
6 40 (11.98%) AWS Lambda
7 30 (8.98%) Azure Synapse Analytics
8 24 (7.19%) Azure DevOps
8 24 (7.19%) Power Platform
9 23 (6.89%) GitHub
10 21 (6.29%) Snowflake
11 19 (5.69%) Amazon Kinesis
11 19 (5.69%) AWS Step Functions
12 18 (5.39%) Amazon EMR
13 17 (5.09%) Amazon EC2
14 16 (4.79%) dbt
15 13 (3.89%) Azure Logic Apps
16 12 (3.59%) Amazon MSK
17 8 (2.40%) Dagster
Communications & Networking
1 2 (0.60%) Firewall
2 1 (0.30%) DAB
Database & Business Intelligence
1 110 (32.93%) Data Warehouse
2 71 (21.26%) Big Data
3 68 (20.36%) Data Lake
4 40 (11.98%) NoSQL
5 33 (9.88%) Amazon Redshift
6 24 (7.19%) Power BI
7 22 (6.59%) Parquet
8 21 (6.29%) Relational Database
9 18 (5.39%) Azure SQL Database
9 18 (5.39%) SQL Server
10 17 (5.09%) BigQuery
11 14 (4.19%) DynamoDB
12 13 (3.89%) Amazon RDS
12 13 (3.89%) Flink
13 12 (3.59%) Delta Lake
13 12 (3.59%) PostgreSQL
14 11 (3.29%) Tableau
15 10 (2.99%) Amazon Athena
16 9 (2.69%) Hadoop
17 8 (2.40%) Spark SQL
Development Applications
1 26 (7.78%) Git
2 11 (3.29%) Jenkins
3 8 (2.40%) JIRA
3 8 (2.40%) MLflow
4 7 (2.10%) GitLab
5 4 (1.20%) Deequ
6 2 (0.60%) Bugzilla
6 2 (0.60%) ER Studio
6 2 (0.60%) ERwin
6 2 (0.60%) JMeter
6 2 (0.60%) JUnit
6 2 (0.60%) kappa
6 2 (0.60%) Selenium
6 2 (0.60%) TestNG
6 2 (0.60%) TestRail
6 2 (0.60%) Travis CI
7 1 (0.30%) GoCD
7 1 (0.30%) IBM UrbanCode
7 1 (0.30%) TeamCity
7 1 (0.30%) webpack
General
1 91 (27.25%) Social Skills
2 66 (19.76%) Finance
3 59 (17.66%) Analytical Skills
4 22 (6.59%) Banking
5 21 (6.29%) Public Sector
6 14 (4.19%) Front Office
7 11 (3.29%) Presentation Skills
8 7 (2.10%) Marketing
9 6 (1.80%) Investment Banking
10 4 (1.20%) Inclusion and Diversity
10 4 (1.20%) Retail
11 3 (0.90%) Czech Language
11 3 (0.90%) Financial Institution
11 3 (0.90%) Pharmaceutical
12 2 (0.60%) Legal
13 1 (0.30%) Games
13 1 (0.30%) Influencing Skills
13 1 (0.30%) Local Government
13 1 (0.30%) Organisational Skills
Job Titles
1 175 (52.40%) Data Engineer
2 66 (19.76%) Senior
3 42 (12.57%) Developer
4 39 (11.68%) Azure Engineer
5 37 (11.08%) Azure Data Engineer
6 36 (10.78%) Senior Data Engineer
7 31 (9.28%) AWS Engineer
8 29 (8.68%) Architect
9 26 (7.78%) AWS Data Engineer
10 24 (7.19%) Lead
11 21 (6.29%) Data Scientist
12 14 (4.19%) Lead Data Engineer
13 13 (3.89%) Analyst
13 13 (3.89%) Senior Developer
14 12 (3.59%) Python Developer
14 12 (3.59%) Python Engineer
15 10 (2.99%) Data Architect
15 10 (2.99%) Quantitative Developer
16 9 (2.69%) Python Data Engineer
17 8 (2.40%) GCP Engineer
Libraries, Frameworks & Software Standards
1 55 (16.47%) PySpark
2 51 (15.27%) Kafka
3 26 (7.78%) Pandas
4 19 (5.69%) Apache Avro
4 19 (5.69%) JSON
5 17 (5.09%) NumPy
6 12 (3.59%) SciPy
7 9 (2.69%) scikit-learn
7 9 (2.69%) TensorFlow
8 7 (2.10%) REST
9 5 (1.50%) Great Expectations
9 5 (1.50%) JSON Schema
10 4 (1.20%) .NET
10 4 (1.20%) ARM Templates
10 4 (1.20%) GraphQL
10 4 (1.20%) PyTorch
10 4 (1.20%) RESTful
10 4 (1.20%) Spark Streaming
10 4 (1.20%) YAML
11 3 (0.90%) SOAP
Miscellaneous
1 24 (7.19%) Algorithms
2 18 (5.39%) Derivative
3 13 (3.89%) Data Structures
4 10 (2.99%) Distributed Systems
4 10 (2.99%) Greenfield Project
4 10 (2.99%) Self-Motivation
5 8 (2.40%) Management Information System
6 6 (1.80%) Hedge funds
7 5 (1.50%) Renewable Energy
8 4 (1.20%) Analytical Mindset
8 4 (1.20%) Distributed Computing
8 4 (1.20%) Security Posture
9 3 (0.90%) Cloud Native
9 3 (0.90%) Grid Computing
9 3 (0.90%) Legacy Systems
9 3 (0.90%) Life Science
9 3 (0.90%) Virtual Team
10 2 (0.60%) Data Protection Act
10 2 (0.60%) Tandem
10 2 (0.60%) Wiki
Operating Systems
1 12 (3.59%) Linux
2 2 (0.60%) Unix
2 2 (0.60%) Windows
2 2 (0.60%) Windows Server
3 1 (0.30%) VMS
Processes & Methodologies
1 145 (43.41%) ETL
2 121 (36.23%) Analytics
3 115 (34.43%) Data Modelling
4 95 (28.44%) Data Engineering
5 89 (26.65%) CI/CD
6 75 (22.46%) Problem-Solving
7 68 (20.36%) Agile
8 67 (20.06%) Data Science
9 66 (19.76%) DevOps
10 51 (15.27%) Data Integration
11 48 (14.37%) Machine Learning
12 46 (13.77%) Computer Science
13 43 (12.87%) Business Intelligence
14 41 (12.28%) Data Ingestion
15 34 (10.18%) Continuous Integration
16 32 (9.58%) Data Analytics
16 32 (9.58%) Data Governance
16 32 (9.58%) Data Transformation
17 30 (8.98%) Test Automation
18 26 (7.78%) Infrastructure as Code
Programming Languages
1 228 (68.26%) Python
2 198 (59.28%) SQL
3 41 (12.28%) Java
4 39 (11.68%) Scala
5 18 (5.39%) C++
6 13 (3.89%) JavaScript
7 12 (3.59%) Rust
8 10 (2.99%) C#
8 10 (2.99%) T-SQL
9 7 (2.10%) Bash
9 7 (2.10%) TypeScript
10 6 (1.80%) Bicep
10 6 (1.80%) Go
11 5 (1.50%) VBA
12 4 (1.20%) PowerShell
12 4 (1.20%) R
13 2 (0.60%) Data Analysis Expressions
13 2 (0.60%) Lua
13 2 (0.60%) Shell Script
13 2 (0.60%) VB
Qualifications
1 63 (18.86%) Security Cleared
2 62 (18.56%) SC Cleared
3 46 (13.77%) Degree
4 30 (8.98%) Computer Science Degree
5 13 (3.89%) Master's Degree
6 10 (2.99%) Azure Certification
7 6 (1.80%) CISSP
8 4 (1.20%) AWS Certification
9 3 (0.90%) CISA
9 3 (0.90%) CRISC
9 3 (0.90%) Microsoft Certification
10 2 (0.60%) BPSS Clearance
10 2 (0.60%) Numerate Degree
11 1 (0.30%) (ISC)2 CCSP
11 1 (0.30%) AWS Certified Solutions Architect
11 1 (0.30%) Cisco Certification
11 1 (0.30%) CSSLP
11 1 (0.30%) DV Cleared
11 1 (0.30%) PhD
11 1 (0.30%) SnowPro
Quality Assurance & Compliance
1 69 (20.66%) Data Quality
2 5 (1.50%) QA
3 4 (1.20%) Accessibility
3 4 (1.20%) GDPR
4 1 (0.30%) NIST
System Software
1 25 (7.49%) Docker
2 3 (0.90%) HDFS
3 2 (0.60%) Virtual Machines
4 1 (0.30%) Active Directory
Systems Management
1 34 (10.18%) Terraform
2 21 (6.29%) Kubernetes
3 5 (1.50%) Ansible
4 4 (1.20%) Argo
5 1 (0.30%) Kubeflow
5 1 (0.30%) Microsoft Intune
5 1 (0.30%) Progress Chef
Vendors
1 88 (26.35%) Databricks
2 27 (8.08%) Microsoft
3 19 (5.69%) Google
4 12 (3.59%) Oracle
5 7 (2.10%) Informatica
5 7 (2.10%) Palantir
6 6 (1.80%) Foundry
7 4 (1.20%) IBM
7 4 (1.20%) TIBCO
8 3 (0.90%) Alteryx
8 3 (0.90%) Cloudera
8 3 (0.90%) Salesforce
8 3 (0.90%) SAP
8 3 (0.90%) Splunk
9 2 (0.60%) Ab Initio
9 2 (0.60%) Dataiku
9 2 (0.60%) Dynatrace
9 2 (0.60%) OpenAI
9 2 (0.60%) SnapLogic
9 2 (0.60%) Workday