Data Pipeline Contracts in the UK excluding London

Data Pipelines
UK > UK excluding London

The following table provides summary statistics for contract job vacancies advertised in the UK excluding London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 17 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
17 May 2024
Same period 2023 Same period 2022
Rank 241 303 327
Rank change year-on-year +62 +24 -21
Contract jobs citing Data Pipeline 147 144 184
As % of all contract jobs advertised in the UK excluding London 0.72% 0.63% 0.60%
As % of the Processes & Methodologies category 0.86% 0.70% 0.68%
Number of daily rates quoted 104 103 89
10th Percentile £363 £405 £411
25th Percentile £423 £458 £470
Median daily rate (50th Percentile) £510 £525 £550
Median % change year-on-year -2.86% -4.55% +10.00%
75th Percentile £588 £638 £673
90th Percentile £638 £700 £738
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 6 2 0
10th Percentile £24.74 £40.15 -
25th Percentile £35.50 £46.00 -
Median hourly rate £62.50 £55.88 -
Median % change year-on-year +11.86% - -
75th Percentile £66.25 £65.88 -
90th Percentile £67.50 £71.80 -
UK median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -21.95%

All Process and Methodology Skills
UK excluding London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the UK excluding London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 17,140 20,557 27,119
As % of all contract IT jobs advertised in the UK excluding London 84.34% 89.47% 89.11%
Number of daily rates quoted 10,220 14,177 18,943
10th Percentile £250 £256 £238
25th Percentile £381 £400 £388
Median daily rate (50th Percentile) £500 £500 £480
Median % change year-on-year - +4.17% +9.43%
75th Percentile £600 £600 £575
90th Percentile £688 £688 £655
UK median daily rate £525 £550 £530
% change year-on-year -4.55% +3.77% +8.16%
Number of hourly rates quoted 2,064 1,258 1,350
10th Percentile £12.35 £10.63 £12.25
25th Percentile £15.25 £15.25 £14.25
Median hourly rate £37.50 £35.00 £20.00
Median % change year-on-year +7.14% +75.00% -6.54%
75th Percentile £61.30 £65.00 £47.25
90th Percentile £72.50 £73.72 £61.52
UK median hourly rate £36.05 £35.65 £25.68
% change year-on-year +1.11% +38.82% +5.90%

Data Pipeline
Job Vacancy Trend in the UK excluding London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Data Pipeline in the UK excluding London

Data Pipeline
Contractor Daily Rate Trend in the UK excluding London

3-month moving average daily rate quoted in jobs citing Data Pipeline in the UK excluding London.

Daily rate trend for Data Pipeline in the UK excluding London

Data Pipeline
Daily Rate Histogram in the UK excluding London

Daily rate distribution for jobs citing Data Pipeline in the UK excluding London over the 6 months to 17 May 2024.

Daily rate histogram for Data Pipeline in the UK excluding London

Data Pipeline
Contractor Hourly Rate Trend in the UK excluding London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in the UK excluding London.

Hourly rate trend for Data Pipeline in the UK excluding London

Data Pipeline
Hourly Rate Histogram in the UK excluding London

Hourly rate distribution of jobs citing Data Pipeline in the UK excluding London over the 6 months to 17 May 2024.

Hourly rate histogram for Data Pipeline in the UK excluding London

Data Pipeline
Contract Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the UK excluding London region over the 6 months to 17 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
North of England +43 51 £500 -6.98% 36
Midlands +50 43 £550 - 22
West Midlands +40 36 £550 +0.92% 18
North West +13 27 £500 +2.56% 16
Yorkshire +33 24 £563 -13.46% 16
South East -14 19 £475 -9.52% 37
Scotland +41 12 £453 +6.59% 17
South West -4 12 £550 -18.52% 22
East of England +16 8 £538 +2.38% 10
East Midlands +18 7 £413 -38.89% 4
Wales +19 1 £500 - 5
Northern Ireland - 1 £425 - 9
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 22 (14.97%) Apache Spark
2 21 (14.29%) Apache Airflow
3 19 (12.93%) Apache
4 1 (0.68%) Jupyter
Applications
1 6 (4.08%) Microsoft Excel
2 4 (2.72%) Microsoft Office
2 4 (2.72%) Microsoft PowerPoint
2 4 (2.72%) Microsoft Project
2 4 (2.72%) MS Visio
3 2 (1.36%) Sketch
Cloud Services
1 52 (35.37%) Azure
2 44 (29.93%) AWS
3 24 (16.33%) Snowflake
4 23 (15.65%) Azure Data Factory
5 15 (10.20%) GCP
5 15 (10.20%) Power Platform
6 12 (8.16%) Amazon S3
7 9 (6.12%) AWS Lambda
7 9 (6.12%) Serverless
8 8 (5.44%) Azure Synapse Analytics
9 7 (4.76%) Amazon EMR
10 6 (4.08%) Amazon EC2
10 6 (4.08%) Cloud Computing
11 5 (3.40%) Amazon SQS
12 4 (2.72%) iPaaS
13 3 (2.04%) dbt
13 3 (2.04%) Vertex AI
14 2 (1.36%) Amazon SageMaker
14 2 (1.36%) AWS Step Functions
14 2 (1.36%) Matillion
Communications & Networking
1 14 (9.52%) Intrusion Detection
1 14 (9.52%) Network Security
2 5 (3.40%) FTP
3 2 (1.36%) SAN
4 1 (0.68%) HTTP
4 1 (0.68%) SSL
Database & Business Intelligence
1 31 (21.09%) Big Data
2 30 (20.41%) Data Warehouse
3 22 (14.97%) Data Lake
4 15 (10.20%) Power BI
5 12 (8.16%) Relational Database
6 11 (7.48%) Amazon Redshift
6 11 (7.48%) Hadoop
6 11 (7.48%) SQL Server
7 10 (6.80%) BigQuery
7 10 (6.80%) Tableau
8 9 (6.12%) Flink
9 8 (5.44%) Elasticsearch
10 7 (4.76%) SQL Server Integration Services
11 6 (4.08%) NoSQL
12 5 (3.40%) Amazon Athena
12 5 (3.40%) Apache Hive
13 4 (2.72%) MySQL
14 3 (2.04%) Apache Cassandra
14 3 (2.04%) Microsoft Analysis Services
14 3 (2.04%) SQL Server Analysis Services
Development Applications
1 18 (12.24%) Git
2 9 (6.12%) JIRA
3 4 (2.72%) Mercurial
4 2 (1.36%) Jenkins
5 1 (0.68%) ERwin
5 1 (0.68%) JMeter
5 1 (0.68%) Postman
5 1 (0.68%) TestRail
General
1 31 (21.09%) Analytical Skills
2 27 (18.37%) Social Skills
3 11 (7.48%) Public Sector
4 10 (6.80%) Finance
5 8 (5.44%) Pharmaceutical
6 7 (4.76%) Manufacturing
7 4 (2.72%) Multimedia
7 4 (2.72%) Presentation Skills
8 3 (2.04%) Back Office
8 3 (2.04%) Banking
9 2 (1.36%) Health Technology
9 2 (1.36%) Police
10 1 (0.68%) Advertising
10 1 (0.68%) Fire and Rescue
10 1 (0.68%) Marketing
10 1 (0.68%) Military
10 1 (0.68%) Retail
Job Titles
1 66 (44.90%) Data Engineer
2 16 (10.88%) Developer
2 16 (10.88%) Senior
3 13 (8.84%) Azure Engineer
4 12 (8.16%) AWS Engineer
5 11 (7.48%) Azure Data Engineer
6 10 (6.80%) Architect
6 10 (6.80%) Senior Data Engineer
6 10 (6.80%) Snowflake Data Engineer
7 8 (5.44%) Analyst
7 8 (5.44%) Platform Engineer
7 8 (5.44%) SIEM Engineer
8 7 (4.76%) AWS Data Engineer
8 7 (4.76%) Data Analyst
8 7 (4.76%) Python Developer
9 6 (4.08%) AWS Platform Engineer
9 6 (4.08%) Cloud Platform Engineer
10 5 (3.40%) Cybersecurity Engineer
10 5 (3.40%) Lead
10 5 (3.40%) Security Engineer
Libraries, Frameworks & Software Standards
1 14 (9.52%) Apache NiFi
2 9 (6.12%) Kafka
2 9 (6.12%) PySpark
3 8 (5.44%) Elastic Stack
4 7 (4.76%) Flask
5 6 (4.08%) FastAPI
5 6 (4.08%) JSON
5 6 (4.08%) Pandas
5 6 (4.08%) React
5 6 (4.08%) XML
6 5 (3.40%) NumPy
7 4 (2.72%) SciPy
8 2 (1.36%) CSS
8 2 (1.36%) HTML
8 2 (1.36%) REST
8 2 (1.36%) TensorFlow
9 1 (0.68%) .NET
9 1 (0.68%) Apache Beam
9 1 (0.68%) ARM Templates
9 1 (0.68%) SQLAlchemy
Miscellaneous
1 16 (10.88%) Distributed Applications
2 15 (10.20%) Cyber Defence
2 15 (10.20%) Distributed Systems
3 14 (9.52%) Management Information System
4 8 (5.44%) Linux Command Line
5 6 (4.08%) Onboarding
6 5 (3.40%) Algorithms
7 4 (2.72%) Distributed Computing
7 4 (2.72%) Self-Motivation
7 4 (2.72%) Social Media
8 3 (2.04%) Biopharmaceutical
8 3 (2.04%) Data Structures
8 3 (2.04%) NHS
8 3 (2.04%) Security Operations Centre
9 2 (1.36%) Data Centre
10 1 (0.68%) Cloud Native
10 1 (0.68%) FMCG
10 1 (0.68%) Legacy Applications
10 1 (0.68%) Low-Code
10 1 (0.68%) Virtual Team
Operating Systems
1 26 (17.69%) Windows
2 22 (14.97%) Linux
3 12 (8.16%) Android
3 12 (8.16%) Apple iOS
3 12 (8.16%) Unix
4 8 (5.44%) Ubuntu
5 1 (0.68%) Mac OS
Processes & Methodologies
1 63 (42.86%) Data Engineering
2 52 (35.37%) Data Modelling
3 49 (33.33%) ETL
4 47 (31.97%) Analytics
5 31 (21.09%) Business Intelligence
5 31 (21.09%) Data Management
6 24 (16.33%) SIEM
7 23 (15.65%) Data Integration
7 23 (15.65%) DevOps
8 22 (14.97%) CI/CD
8 22 (14.97%) Data Governance
9 21 (14.29%) Computer Science
10 20 (13.61%) Problem-Solving
11 19 (12.93%) Visualisation
12 18 (12.24%) Actionable Insight
12 18 (12.24%) Data Analysis
12 18 (12.24%) DataOps
13 16 (10.88%) Cybersecurity
14 15 (10.20%) Agile
14 15 (10.20%) Machine Learning
Programming Languages
1 74 (50.34%) Python
2 57 (38.78%) SQL
3 32 (21.77%) Java
4 20 (13.61%) Scala
5 11 (7.48%) R
6 9 (6.12%) C#
7 7 (4.76%) T-SQL
8 6 (4.08%) JavaScript
9 2 (1.36%) MATLAB
9 2 (1.36%) Perl
9 2 (1.36%) PL/SQL
10 1 (0.68%) Data Analysis Expressions
10 1 (0.68%) PowerShell
Qualifications
1 28 (19.05%) Security Cleared
2 17 (11.56%) DV Cleared
3 12 (8.16%) Degree
4 10 (6.80%) Computer Science Degree
4 10 (6.80%) SC Cleared
5 3 (2.04%) BPSS Clearance
6 2 (1.36%) AWS Certification
6 2 (1.36%) Master's Degree
6 2 (1.36%) PhD
7 1 (0.68%) CTC Cleared
Quality Assurance & Compliance
1 25 (17.01%) Data Quality
2 14 (9.52%) Actionable Recommendations
3 6 (4.08%) QA
4 3 (2.04%) GDPR
5 2 (1.36%) PCI DSS
6 1 (0.68%) Accessibility
6 1 (0.68%) California Consumer Privacy Act
6 1 (0.68%) JSP 440
6 1 (0.68%) NCSC
System Software
1 22 (14.97%) Docker
2 8 (5.44%) Active Directory
2 8 (5.44%) iptables
3 4 (2.72%) HDFS
4 2 (1.36%) VMware Infrastructure
Systems Management
1 21 (14.29%) Kubernetes
2 17 (11.56%) Terraform
3 8 (5.44%) Kibana
3 8 (5.44%) logstash
4 1 (0.68%) Control-M
4 1 (0.68%) Hadoop YARN
Vendors
1 31 (21.09%) Databricks
2 11 (7.48%) Red Hat
3 10 (6.80%) Microsoft
4 9 (6.12%) Google
4 9 (6.12%) Informatica
5 8 (5.44%) SAP
6 5 (3.40%) Talend
7 4 (2.72%) IFS
8 2 (1.36%) Cloudera
8 2 (1.36%) JD Edwards
8 2 (1.36%) QAD
8 2 (1.36%) VMware
9 1 (0.68%) Atlassian
9 1 (0.68%) Brio
9 1 (0.68%) Facebook
9 1 (0.68%) Oracle
9 1 (0.68%) Palantir
9 1 (0.68%) Sage
9 1 (0.68%) Teradata
9 1 (0.68%) Twitter