Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 27 January 2022

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 27 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
27 Jan 2022		 Same period 2021 Same period 2020
Rank 124 110 99
Rank change year-on-year -14 -11 -3
Contract jobs citing Big Data 1,820 960 1,729
As % of all contract jobs advertised in the UK 2.07% 2.26% 2.42%
As % of the Database & Business Intelligence category 9.79% 10.37% 11.25%
Number of daily rates quoted 1,208 675 1,196
10th Percentile £438 £381 £400
25th Percentile £513 £461 £469
Median daily rate (50th Percentile) £600 £550 £550
Median % change year-on-year +9.09% - -
75th Percentile £700 £614 £638
90th Percentile £775 £688 £725
UK excluding London median daily rate £575 £513 £530
% change year-on-year +12.20% -3.30% +2.91%
Number of hourly rates quoted 7 8 0
10th Percentile £42.59 £18.73 -
25th Percentile £55.88 £20.00 -
Median hourly rate £65.00 £23.37 -
Median % change year-on-year +178.10% - -
75th Percentile £67.50 £57.88 -
90th Percentile £78.36 £67.55 -
UK excluding London median hourly rate £48.87 £23.00 -
% change year-on-year +112.46% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 18,586 9,261 15,368
As % of all contract IT jobs advertised in the UK 21.16% 21.81% 21.48%
Number of daily rates quoted 13,235 6,383 10,469
10th Percentile £363 £313 £315
25th Percentile £438 £393 £400
Median daily rate (50th Percentile) £525 £488 £475
Median % change year-on-year +7.69% +2.63% -
75th Percentile £638 £588 £575
90th Percentile £725 £663 £663
UK excluding London median daily rate £475 £425 £440
% change year-on-year +11.76% -3.41% +3.53%
Number of hourly rates quoted 203 188 213
10th Percentile £17.30 £13.88 £12.81
25th Percentile £24.50 £19.44 £17.83
Median hourly rate £43.75 £26.73 £26.00
Median % change year-on-year +63.67% +2.81% -5.45%
75th Percentile £62.08 £47.81 £42.50
90th Percentile £72.40 £61.83 £54.75
UK excluding London median hourly rate £42.92 £23.75 £22.55
% change year-on-year +80.74% +5.32% -13.46%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 27 January 2022.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 27 January 2022.

Hourly rate histogram for Big Data in the UK

Big Data
Top 18 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 27 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Jobs
England -16 1,434 £600 +9.09% 448
London -2 1,023 £613 +11.36% 238
Work from Home -12 595 £600 +9.09% 99
UK excluding London -56 376 £575 +12.20% 244
South East -4 137 £570 +11.22% 46
North of England -50 78 £585 +6.36% 75
Yorkshire +1 53 £600 +8.11% 24
Scotland -35 46 £525 +31.25% 24
Midlands -48 37 £575 +48.39% 28
South West -65 34 £600 +26.32% 26
West Midlands -28 29 £575 +15.00% 17
East of England -53 26 £550 +7.32% 33
North West -81 18 £575 +4.55% 40
Wales -12 14 £450 - 7
North East +1 7 £585 -16.43% 11
East Midlands -35 7 £550 +44.93% 11
Northern Ireland -5 4 £485 +21.25% 6
Isle of Man - 1 £350 -

For the 6 months to 27 January 2022, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 693 (38.08%) Agile Software Development
2 676 (37.14%) Apache Spark
3 651 (35.77%) Analytics
3 651 (35.77%) Python
4 615 (33.79%) AWS
5 597 (32.80%) SQL
6 581 (31.92%) Azure
7 488 (26.81%) Hadoop
8 475 (26.10%) DevOps
9 447 (24.56%) Social Skills
10 445 (24.45%) Data Modelling
11 433 (23.79%) Kafka
12 431 (23.68%) Data Warehouse
13 430 (23.63%) ETL
14 425 (23.35%) Finance
15 387 (21.26%) Java
16 349 (19.18%) Business Intelligence
17 346 (19.01%) CI/CD
18 333 (18.30%) Data Lake
19 297 (16.32%) Data Engineering
20 272 (14.95%) Scala
21 260 (14.29%) Apache Hive
22 257 (14.12%) GCP
23 250 (13.74%) Scrum
24 248 (13.63%) NoSQL
25 245 (13.46%) Banking
25 245 (13.46%) Data Science
26 243 (13.35%) Databricks
27 228 (12.53%) Machine Learning
27 228 (12.53%) Kubernetes

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 676 (37.14%) Apache Spark
2 147 (8.08%) Apache
3 76 (4.18%) Confluence
4 75 (4.12%) Apache Airflow
5 61 (3.35%) Elasticsearch
6 23 (1.26%) SAS
7 18 (0.99%) Luigi
8 14 (0.77%) Camunda
9 13 (0.71%) nginx
10 12 (0.66%) Apache Pulsar
11 11 (0.60%) Jupyter
12 10 (0.55%) SharePoint
13 9 (0.49%) OpenStack
13 9 (0.49%) Tomcat
14 5 (0.27%) Apache Pig
15 3 (0.16%) Moodle
16 2 (0.11%) Adobe Experience Manager
16 2 (0.11%) IIS
16 2 (0.11%) Oracle Coherence
16 2 (0.11%) Skype for Business
Applications
1 48 (2.64%) Microsoft Excel
2 10 (0.55%) Microsoft PowerPoint
3 8 (0.44%) Spreadsheet
4 5 (0.27%) MS Visio
5 3 (0.16%) Chatbot
6 2 (0.11%) Microsoft Office
6 2 (0.11%) Microsoft Project
7 1 (0.055%) Sketch
7 1 (0.055%) SPSS
7 1 (0.055%) Stata
Business Applications
1 9 (0.49%) Sparx Enterprise Architect
2 6 (0.33%) Oracle EBS
2 6 (0.33%) SAP Oil and Gas
2 6 (0.33%) Workday HCM
3 5 (0.27%) Dynamics CRM
4 4 (0.22%) Dynamics AX
4 4 (0.22%) SAP S/4HANA
5 3 (0.16%) Oracle Financials
6 2 (0.11%) Primavera
6 2 (0.11%) Salesforce.com CRM
7 1 (0.055%) Adobe Campaign
7 1 (0.055%) IBM Planning Analytics
7 1 (0.055%) Oracle BPM
7 1 (0.055%) SAP PLM
7 1 (0.055%) SAP R/3
Cloud Services
1 615 (33.79%) AWS
2 581 (31.92%) Azure
3 257 (14.12%) GCP
4 192 (10.55%) Serverless
5 178 (9.78%) Power Platform
6 130 (7.14%) Azure Data Factory
7 114 (6.26%) Amazon S3
8 108 (5.93%) Amazon EMR
9 106 (5.82%) AWS Lambda
10 100 (5.49%) Azure Synapse Analytics
11 95 (5.22%) GitHub
12 94 (5.16%) Snowflake
13 58 (3.19%) PaaS
14 52 (2.86%) AWS CloudFormation
15 50 (2.75%) Azure Cosmos DB
16 46 (2.53%) Amazon Kinesis
17 40 (2.20%) Cloud Computing
18 39 (2.14%) Azure Functions
19 30 (1.65%) Azure Monitor
19 30 (1.65%) IaaS
Communications & Networking
1 14 (0.77%) Firewall
2 11 (0.60%) FTP
3 10 (0.55%) HTTP
3 10 (0.55%) Kerberos
4 6 (0.33%) Cisco IPT
5 5 (0.27%) Broadband
5 5 (0.27%) Ethernet
5 5 (0.27%) Radio Access Network
6 4 (0.22%) Multicast
6 4 (0.22%) Network Security
6 4 (0.22%) SAN
6 4 (0.22%) VPN
7 3 (0.16%) 5G
7 3 (0.16%) DOCSIS
7 3 (0.16%) Intrusion Detection
7 3 (0.16%) Remote Desktop
7 3 (0.16%) SSH
7 3 (0.16%) Wi-Fi
8 2 (0.11%) EIGRP
8 2 (0.11%) Internet
Database & Business Intelligence
1 488 (26.81%) Hadoop
2 431 (23.68%) Data Warehouse
3 333 (18.30%) Data Lake
4 260 (14.29%) Apache Hive
5 248 (13.63%) NoSQL
6 174 (9.56%) Power BI
7 169 (9.29%) Metadata
8 164 (9.01%) Relational Database
8 164 (9.01%) Tableau
9 139 (7.64%) Amazon Redshift
10 123 (6.76%) HBase
11 115 (6.32%) SQL Server
12 103 (5.66%) MongoDB
13 89 (4.89%) BigQuery
14 87 (4.78%) Apache Cassandra
14 87 (4.78%) PostgreSQL
15 82 (4.51%) RDBMS
16 75 (4.12%) Amazon Athena
17 73 (4.01%) Amazon RDS
18 71 (3.90%) Pentaho
Development Applications
1 211 (11.59%) Git (software)
2 190 (10.44%) Jenkins
3 151 (8.30%) JIRA
4 87 (4.78%) GitLab
5 56 (3.08%) PowerDesigner
6 53 (2.91%) Maven
7 42 (2.31%) TeamCity
8 31 (1.70%) ERwin
9 28 (1.54%) kappa
10 24 (1.32%) Gradle
11 18 (0.99%) SonarQube
12 17 (0.93%) Atlassian Bamboo
12 17 (0.93%) JUnit
12 17 (0.93%) Subversion
13 15 (0.82%) ER Studio
14 14 (0.77%) Hudson
15 12 (0.66%) RStudio
16 10 (0.55%) Cucumber
16 10 (0.55%) IntelliJ
16 10 (0.55%) Sonatype Nexus
General
1 447 (24.56%) Social Skills
2 425 (23.35%) Finance
3 245 (13.46%) Banking
4 224 (12.31%) Analytical Skills
5 98 (5.38%) Investment Banking
6 88 (4.84%) Presentation Skills
7 86 (4.73%) Public Sector
8 66 (3.63%) Retail
9 59 (3.24%) Marketing
10 57 (3.13%) Legal
11 50 (2.75%) Financial Institution
12 39 (2.14%) Influencing Skills
13 30 (1.65%) Telecoms
14 27 (1.48%) Documentation Skills
15 26 (1.43%) Front Office
16 19 (1.04%) Games
16 19 (1.04%) Manufacturing
17 17 (0.93%) Pharmaceutical
17 17 (0.93%) Publishing
18 14 (0.77%) Law
Job Titles
1 479 (26.32%) Data Engineer
2 381 (20.93%) Architect
3 317 (17.42%) Developer
4 222 (12.20%) Data Architect
5 144 (7.91%) Solutions Architect
6 122 (6.70%) Big Data Engineer
7 115 (6.32%) DevOps Engineer
8 94 (5.16%) Analyst
9 86 (4.73%) Azure Engineer
10 83 (4.56%) Java Developer
11 71 (3.90%) Cloud Engineer
12 70 (3.85%) AWS Engineer
13 61 (3.35%) Big Data Developer
14 60 (3.30%) Azure Architect
15 53 (2.91%) Senior Data Engineer
16 51 (2.80%) Data Modeller
17 49 (2.69%) Data Analyst
18 47 (2.58%) Data Manager
18 47 (2.58%) Data Scientist
19 46 (2.53%) Senior Developer
Libraries, Frameworks & Software Standards
1 433 (23.79%) Kafka
2 126 (6.92%) PySpark
3 68 (3.74%) Spark Streaming
4 54 (2.97%) .NET
5 52 (2.86%) REST
6 49 (2.69%) JSON
7 48 (2.64%) RESTful
8 47 (2.58%) Spring
9 44 (2.42%) XML
10 41 (2.25%) Apache NiFi
11 33 (1.81%) TensorFlow
11 33 (1.81%) Web Services
12 32 (1.76%) Elastic Stack
13 30 (1.65%) Apache Avro
14 29 (1.59%) Pandas
14 29 (1.59%) React
15 27 (1.48%) HTML
16 23 (1.26%) Keras
17 22 (1.21%) NumPy
18 20 (1.10%) Node.js
Miscellaneous
1 73 (4.01%) Data Structures
2 60 (3.30%) Algorithms
3 56 (3.08%) Cloud Native
4 55 (3.02%) Public Cloud
5 46 (2.53%) Enterprise Software
6 44 (2.42%) Data Protection Act
7 40 (2.20%) Greenfield Project
8 38 (2.09%) User Experience
9 37 (2.03%) Self-Motivation
10 35 (1.92%) Virtual Team
11 34 (1.87%) Hedge funds
12 27 (1.48%) Reference Data
13 26 (1.43%) Data Centre
13 26 (1.43%) Management Information System
14 22 (1.21%) Hybrid Cloud
15 17 (0.93%) iPad
16 13 (0.71%) NHS
17 9 (0.49%) Foreign Exchange (FX)
17 9 (0.49%) Legacy Applications
17 9 (0.49%) NVMe
Operating Systems
1 187 (10.27%) Linux
2 71 (3.90%) Unix
3 34 (1.87%) Windows
4 12 (0.66%) Red Hat Enterprise Linux
5 4 (0.22%) VMS
6 3 (0.16%) Apple iOS
7 2 (0.11%) Windows Server
8 1 (0.055%) Android
8 1 (0.055%) CentOS
8 1 (0.055%) Windows 10
Processes & Methodologies
1 693 (38.08%) Agile Software Development
2 651 (35.77%) Analytics
3 475 (26.10%) DevOps
4 445 (24.45%) Data Modelling
5 430 (23.63%) ETL
6 349 (19.18%) Business Intelligence
7 346 (19.01%) CI/CD
8 297 (16.32%) Data Engineering
9 250 (13.74%) Scrum
10 245 (13.46%) Data Science
11 228 (12.53%) Machine Learning
12 227 (12.47%) Data Management
13 222 (12.20%) Data Pipeline
14 216 (11.87%) Data Architecture
15 209 (11.48%) Data Analytics
16 199 (10.93%) Data Integration
17 188 (10.33%) Visualisation
18 181 (9.95%) Microservices
19 176 (9.67%) Data Analysis
20 168 (9.23%) Migration
Programming Languages
1 651 (35.77%) Python
2 597 (32.80%) SQL
3 387 (21.26%) Java
4 272 (14.95%) Scala
5 96 (5.27%) R
6 79 (4.34%) C#
7 71 (3.90%) JavaScript
8 61 (3.35%) Bash
8 61 (3.35%) PowerShell
9 50 (2.75%) Shell Script
10 39 (2.14%) Go
11 29 (1.59%) PL/SQL
12 25 (1.37%) C
13 24 (1.32%) C++
14 19 (1.04%) T-SQL
15 18 (0.99%) Java 8
16 14 (0.77%) Groovy
17 11 (0.60%) Ruby
18 9 (0.49%) Perl
18 9 (0.49%) TypeScript
Qualifications
1 215 (11.81%) Security Cleared
2 177 (9.73%) SC Cleared
3 100 (5.49%) Degree
4 44 (2.42%) DV Cleared
5 42 (2.31%) Computer Science Degree
6 30 (1.65%) AWS Certification
7 22 (1.21%) BPSS Clearance
8 15 (0.82%) Master's Degree
9 14 (0.77%) PMP
10 13 (0.71%) PMI Certification
11 12 (0.66%) ISTQB
12 11 (0.60%) CISSP
12 11 (0.60%) Microsoft Certification
13 10 (0.55%) ISEB
14 8 (0.44%) PhD
15 6 (0.33%) (ISC)2 CCSP
15 6 (0.33%) Cisco Certification
16 5 (0.27%) ISTQB Foundation Certification
17 4 (0.22%) TOGAF Certification
18 3 (0.16%) Numerate Degree
Quality Assurance & Compliance
1 171 (9.40%) Data Quality
2 57 (3.13%) GDPR
3 46 (2.53%) QA
4 17 (0.93%) SLA
5 16 (0.88%) Accessibility
5 16 (0.88%) PMO
6 10 (0.55%) NCSC
7 7 (0.38%) IFRS
7 7 (0.38%) Sarbanes-Oxley
8 4 (0.22%) ISO/IEC 27001
9 3 (0.16%) ISO 20022
10 2 (0.11%) Actionable Recommendations
10 2 (0.11%) Disclosure Scotland
10 2 (0.11%) IFRS 9
10 2 (0.11%) PCI DSS
11 1 (0.055%) COREP
11 1 (0.055%) FINREP
11 1 (0.055%) MiFID
System Software
1 227 (12.47%) Docker
2 81 (4.45%) HDFS
3 27 (1.48%) Active Directory
4 20 (1.10%) Apache Flume
5 9 (0.49%) Virtual Machines
6 6 (0.33%) Apache ZooKeeper
7 5 (0.27%) VMware Infrastructure
8 4 (0.22%) Active Directory Lightweight Directory Services
8 4 (0.22%) Oracle RAC
9 3 (0.16%) VMware NSX
10 2 (0.11%) NFS
11 1 (0.055%) SRDF
11 1 (0.055%) VMware ESXi
11 1 (0.055%) vSphere
Systems Management
1 228 (12.53%) Kubernetes
2 208 (11.43%) Terraform
3 150 (8.24%) Ansible
4 33 (1.81%) Kibana
5 25 (1.37%) Hadoop YARN
6 23 (1.26%) Grafana
7 22 (1.21%) Prometheus
8 16 (0.88%) Puppet
9 14 (0.77%) logstash
10 13 (0.71%) Opscode Chef
11 12 (0.66%) Oozie
12 7 (0.38%) Istio
13 5 (0.27%) HP ALM
14 4 (0.22%) Ambari
14 4 (0.22%) Consul
14 4 (0.22%) Control-M
14 4 (0.22%) Microsoft Intune
14 4 (0.22%) Rancher
14 4 (0.22%) SCCM
14 4 (0.22%) Single Sign-On
Vendors
1 243 (13.35%) Databricks
2 197 (10.82%) Microsoft
3 146 (8.02%) Cloudera
4 136 (7.47%) Google
5 127 (6.98%) Oracle
6 114 (6.26%) Talend
7 78 (4.29%) Hortonworks
8 63 (3.46%) Informatica
9 58 (3.19%) Teradata
10 54 (2.97%) SAP
11 50 (2.75%) BiZZdesign
11 50 (2.75%) Salesforce.com
12 36 (1.98%) Ab Initio
12 36 (1.98%) Red Hat
13 27 (1.48%) IBM
14 25 (1.37%) StreamSets
15 24 (1.32%) Splunk
16 22 (1.21%) Alteryx
17 20 (1.10%) MapR
17 20 (1.10%) MuleSoft
524 Big Data job vacancies Nationwide