Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 25 July 2021

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 25 July 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
25 Jul 2021		 Same period 2020 Same period 2019
Rank 102 90 76
Rank change year-on-year -12 -14 +6
Contract jobs citing Big Data 1,662 953 2,905
As % of all contract jobs advertised in the UK 2.35% 2.54% 3.16%
As % of the Database & Business Intelligence category 11.03% 11.51% 13.96%
Number of daily rates quoted 1,127 684 2,070
10th Percentile £425 £400 £413
25th Percentile £488 £463 £475
Median daily rate (50th Percentile) £575 £550 £550
Median % change year-on-year +4.55% - -
75th Percentile £675 £650 £625
90th Percentile £750 £725 £710
UK excluding London median daily rate £550 £550 £525
% change year-on-year - +4.76% +5.00%
Number of hourly rates quoted 13 8 14
10th Percentile £23.75 £9.75 £21.33
25th Percentile £27.00 £15.56 £43.57
Median hourly rate £41.00 £29.25 £49.93
Median % change year-on-year +40.17% -41.42% +13.48%
75th Percentile £50.00 £47.81 £53.39
90th Percentile £53.15 £51.98 £59.00
UK excluding London median hourly rate £24.50 £20.00 £52.50
% change year-on-year +22.50% -61.90% +19.32%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 15,072 8,278 20,804
As % of all contract IT jobs advertised in the UK 21.30% 22.06% 22.65%
Number of daily rates quoted 10,344 5,730 14,380
10th Percentile £338 £325 £325
25th Percentile £413 £406 £400
Median daily rate (50th Percentile) £500 £500 £475
Median % change year-on-year - +5.26% +2.70%
75th Percentile £611 £600 £575
90th Percentile £700 £688 £650
UK excluding London median daily rate £450 £450 £433
% change year-on-year - +3.93% +4.40%
Number of hourly rates quoted 217 114 257
10th Percentile £11.71 £12.63 £13.45
25th Percentile £19.00 £17.77 £17.63
Median hourly rate £27.00 £22.50 £30.00
Median % change year-on-year +20.00% -25.00% -
75th Percentile £45.18 £43.12 £50.00
90th Percentile £62.00 £63.79 £60.00
UK excluding London median hourly rate £26.00 £21.57 £30.00
% change year-on-year +20.54% -28.10% +4.35%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 25 July 2021.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 25 July 2021.

Hourly rate histogram for Big Data in the UK

Big Data
Top 18 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 25 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -15 1,380 £575 +4.55% 436
London -8 940 £599 +8.91% 269
Work from Home -41 436 £600 +9.09% 88
UK excluding London -35 415 £550 - 183
South East -65 91 £550 +4.76% 38
North of England -55 88 £575 -3.77% 48
South West +41 74 £550 - 30
Scotland -2 65 £475 +5.56% 15
Midlands -4 54 £550 - 21
North West -61 46 £588 +0.21% 25
West Midlands -7 39 £490 +8.89% 15
Yorkshire -14 34 £600 +9.09% 18
East of England -7 27 £551 -4.13% 22
East Midlands -3 15 £725 +31.82% 6
North East +5 9 £565 -33.53% 5
Northern Ireland +5 9 £475 - 5
Wales -27 8 £475 -5.00% 4
Isle of Man - 1 £750 -

For the 6 months to 25 July 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 556 (33.45%) Python
1 556 (33.45%) AWS
2 547 (32.91%) Agile Software Development
3 532 (32.01%) SQL
4 506 (30.45%) Apache Spark
5 484 (29.12%) Azure
6 471 (28.34%) Hadoop
7 453 (27.26%) Analytics
8 436 (26.23%) Finance
9 428 (25.75%) DevOps
10 382 (22.98%) Java
11 363 (21.84%) Social Skills
12 358 (21.54%) Kafka
13 340 (20.46%) Data Warehouse
14 313 (18.83%) Data Modelling
15 287 (17.27%) Scala
16 280 (16.85%) ETL
17 274 (16.49%) Kubernetes
18 264 (15.88%) GCP
19 262 (15.76%) Docker
20 255 (15.34%) Apache Hive
21 247 (14.86%) Business Intelligence
22 235 (14.14%) Linux
23 214 (12.88%) Terraform
24 209 (12.58%) Oracle
25 208 (12.52%) Data Pipeline
26 205 (12.33%) Banking
27 204 (12.27%) Data Lake
28 199 (11.97%) Analytical Skills
29 198 (11.91%) Software Engineering

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 506 (30.45%) Apache Spark
2 163 (9.81%) Apache
3 91 (5.48%) Apache Airflow
4 61 (3.67%) Confluence
5 54 (3.25%) Elasticsearch
6 34 (2.05%) SAS
7 30 (1.81%) Luigi
8 27 (1.62%) Oracle Coherence
9 19 (1.14%) SharePoint
10 10 (0.60%) Apache Pig
10 10 (0.60%) Tomcat
11 7 (0.42%) Apache Solr
12 6 (0.36%) Apache Pulsar
12 6 (0.36%) Oracle Workflow
13 5 (0.30%) BizTalk Server
13 5 (0.30%) nginx
14 4 (0.24%) CMS
14 4 (0.24%) Jupyter
14 4 (0.24%) OpenStack
15 3 (0.18%) WebLogic
Applications
1 12 (0.72%) Microsoft Excel
2 8 (0.48%) Microsoft Office
3 6 (0.36%) Spreadsheet
3 6 (0.36%) SPSS
4 2 (0.12%) Microsoft PowerPoint
4 2 (0.12%) Microsoft Project
4 2 (0.12%) MS Visio
5 1 (0.060%) Chatbot
Business Applications
1 16 (0.96%) Dynamics CRM
2 7 (0.42%) Dynamics AX
3 4 (0.24%) Oracle EBS
4 2 (0.12%) NetSuite
4 2 (0.12%) Oracle BPM
4 2 (0.12%) SAP R/3
5 1 (0.060%) Adobe Campaign
5 1 (0.060%) Eloqua
5 1 (0.060%) Oracle ERP
5 1 (0.060%) Oracle Payables
5 1 (0.060%) Oracle Procure-to-Pay
5 1 (0.060%) Oracle Receivables
5 1 (0.060%) Salesforce.com CRM
5 1 (0.060%) SAP ERP
5 1 (0.060%) SAP Hybris
5 1 (0.060%) SAP MDG
5 1 (0.060%) SAP MDM
5 1 (0.060%) Sentinel
5 1 (0.060%) Temenos T24
Cloud Services
1 556 (33.45%) AWS
2 484 (29.12%) Azure
3 264 (15.88%) GCP
4 182 (10.95%) Serverless
5 105 (6.32%) PaaS
6 102 (6.14%) Power Platform
7 95 (5.72%) IaaS
8 93 (5.60%) AWS Lambda
9 75 (4.51%) Amazon S3
10 69 (4.15%) Snowflake
11 65 (3.91%) Azure Data Factory
12 60 (3.61%) GitHub
13 51 (3.07%) Amazon EMR
14 47 (2.83%) Cloud Computing
15 46 (2.77%) Azure Synapse Analytics
16 43 (2.59%) Azure Cosmos DB
17 36 (2.17%) Azure Functions
18 30 (1.81%) Amazon EC2
19 28 (1.68%) OpenShift
20 22 (1.32%) Amazon Kinesis
Communications & Networking
1 29 (1.74%) Firewall
2 23 (1.38%) HTTP
3 10 (0.60%) Internet
4 9 (0.54%) FTP
5 6 (0.36%) Network Security
5 6 (0.36%) SAN
5 6 (0.36%) SSL
6 5 (0.30%) Intrusion Detection
6 5 (0.30%) Kerberos
6 5 (0.30%) TCP/IP
7 4 (0.24%) Remote Desktop
8 3 (0.18%) SSH
8 3 (0.18%) VLAN
8 3 (0.18%) Wireless
9 2 (0.12%) Cisco IOS
9 2 (0.12%) DNS
9 2 (0.12%) SMTP
9 2 (0.12%) Unified Communications
9 2 (0.12%) Wireshark
10 1 (0.060%) tcpdump
Database & Business Intelligence
1 471 (28.34%) Hadoop
2 340 (20.46%) Data Warehouse
3 255 (15.34%) Apache Hive
4 204 (12.27%) Data Lake
5 189 (11.37%) NoSQL
6 161 (9.69%) Relational Database
7 122 (7.34%) PostgreSQL
8 115 (6.92%) Metadata
9 112 (6.74%) MongoDB
10 96 (5.78%) Power BI
10 96 (5.78%) SQL Server
11 95 (5.72%) HBase
12 94 (5.66%) BigQuery
13 79 (4.75%) Tableau
14 66 (3.97%) Apache Cassandra
15 60 (3.61%) Impala
16 55 (3.31%) Amazon Redshift
17 49 (2.95%) Data Mining
18 44 (2.65%) RDBMS
19 41 (2.47%) Amazon Athena
Development Applications
1 158 (9.51%) Jenkins
2 140 (8.42%) Git (software)
3 107 (6.44%) JIRA
4 79 (4.75%) GitLab
5 58 (3.49%) Maven
6 39 (2.35%) PowerDesigner
7 32 (1.93%) Artifactory
8 29 (1.74%) Bitbucket
9 28 (1.68%) Sonatype Nexus
10 26 (1.56%) TeamCity
11 21 (1.26%) kappa
12 19 (1.14%) IBM UrbanCode
13 18 (1.08%) Visual Studio Team System
14 17 (1.02%) Cucumber
14 17 (1.02%) ERwin
14 17 (1.02%) Subversion
15 15 (0.90%) Gradle
16 14 (0.84%) IntelliJ
17 13 (0.78%) JUnit
17 13 (0.78%) Selenium
General
1 436 (26.23%) Finance
2 363 (21.84%) Social Skills
3 205 (12.33%) Banking
4 199 (11.97%) Analytical Skills
5 61 (3.67%) Presentation Skills
5 61 (3.67%) Public Sector
6 56 (3.37%) Investment Banking
7 41 (2.47%) Retail
8 38 (2.29%) Marketing
9 30 (1.81%) Documentation Skills
10 25 (1.50%) Telecoms
11 23 (1.38%) Legal
12 22 (1.32%) Front Office
13 19 (1.14%) Influencing Skills
14 12 (0.72%) Games
15 10 (0.60%) Financial Institution
16 9 (0.54%) Retail Banking
17 8 (0.48%) Multimedia
18 7 (0.42%) Electronics
18 7 (0.42%) French Language
Job Titles
1 375 (22.56%) Data Engineer
2 341 (20.52%) Architect
3 303 (18.23%) Developer
4 195 (11.73%) Data Architect
5 133 (8.00%) DevOps Engineer
6 129 (7.76%) Big Data Engineer
7 117 (7.04%) Solutions Architect
8 116 (6.98%) AWS Engineer
9 71 (4.27%) Analyst
9 71 (4.27%) Scala Developer
10 69 (4.15%) Cloud Architect
11 66 (3.97%) AWS DevOps
12 64 (3.85%) Software Engineer
13 62 (3.73%) Java Developer
14 60 (3.61%) Azure Architect
14 60 (3.61%) Azure Engineer
15 57 (3.43%) AWS DevOps Engineer
16 51 (3.07%) Big Data Developer
16 51 (3.07%) Cloud Engineer
17 48 (2.89%) Senior Developer
Libraries, Frameworks & Software Standards
1 358 (21.54%) Kafka
2 102 (6.14%) PySpark
3 84 (5.05%) Web Services
4 66 (3.97%) Apache NiFi
5 64 (3.85%) JSON
6 55 (3.31%) Spring
7 52 (3.13%) RESTful
8 51 (3.07%) .NET
9 42 (2.53%) Node.js
10 35 (2.11%) REST
11 34 (2.05%) React
12 31 (1.87%) Spark Streaming
13 30 (1.81%) Apache Avro
14 29 (1.74%) XML
15 28 (1.68%) HTML
16 27 (1.62%) Velocity
16 27 (1.62%) YAML
17 24 (1.44%) Akka
18 23 (1.38%) AngularJS
19 22 (1.32%) Spring Boot
Miscellaneous
1 89 (5.35%) Data Structures
2 55 (3.31%) Algorithms
3 47 (2.83%) Public Cloud
4 42 (2.53%) Data Protection Act
4 42 (2.53%) Virtual Team
5 37 (2.23%) Data Centre
6 36 (2.17%) Cloud Native
7 33 (1.99%) Market Risk
8 32 (1.93%) Self-Motivation
9 28 (1.68%) Greenfield Project
10 26 (1.56%) Linux Command Line
11 25 (1.50%) Management Information System
12 23 (1.38%) Hybrid Cloud
13 22 (1.32%) Legacy Systems
14 19 (1.14%) Legacy Applications
15 18 (1.08%) Enterprise Software
15 18 (1.08%) Grid Computing
15 18 (1.08%) iPad
16 17 (1.02%) Reference Data
17 13 (0.78%) User Experience
Operating Systems
1 235 (14.14%) Linux
2 90 (5.42%) Unix
3 48 (2.89%) Windows
4 19 (1.14%) VMS
5 17 (1.02%) Red Hat Enterprise Linux
6 16 (0.96%) CoreOS
7 10 (0.60%) AIX
8 4 (0.24%) Android
9 3 (0.18%) Apple iOS
9 3 (0.18%) Ubuntu
10 2 (0.12%) HPUX
10 2 (0.12%) Solaris
10 2 (0.12%) SUSE Linux Enterprise Server
11 1 (0.060%) Mac OS X
11 1 (0.060%) MVS
Processes & Methodologies
1 547 (32.91%) Agile Software Development
2 453 (27.26%) Analytics
3 428 (25.75%) DevOps
4 313 (18.83%) Data Modelling
5 280 (16.85%) ETL
6 247 (14.86%) Business Intelligence
7 208 (12.52%) Data Pipeline
8 198 (11.91%) Software Engineering
9 190 (11.43%) Migration
10 181 (10.89%) Data Architecture
11 177 (10.65%) Data Engineering
12 176 (10.59%) Data Science
13 169 (10.17%) Scrum
14 162 (9.75%) Data Management
15 151 (9.09%) Microservices
16 143 (8.60%) Problem-Solving
17 139 (8.36%) Machine Learning
18 132 (7.94%) Data Analytics
19 124 (7.46%) Artificial Intelligence
19 124 (7.46%) SDLC
Programming Languages
1 556 (33.45%) Python
2 532 (32.01%) SQL
3 382 (22.98%) Java
4 287 (17.27%) Scala
5 78 (4.69%) R
6 60 (3.61%) JavaScript
7 55 (3.31%) C#
8 49 (2.95%) Shell Script
9 48 (2.89%) Bash Shell
10 39 (2.35%) Groovy
11 31 (1.87%) Go
12 30 (1.81%) PL/SQL
12 30 (1.81%) PowerShell
13 26 (1.56%) C++
14 25 (1.50%) C
15 22 (1.32%) Ruby
16 21 (1.26%) Java 8
17 19 (1.14%) PHP
18 15 (0.90%) T-SQL
19 14 (0.84%) TypeScript
Qualifications
1 188 (11.31%) Security Cleared
2 142 (8.54%) SC Cleared
3 112 (6.74%) Degree
4 67 (4.03%) DV Cleared
5 44 (2.65%) Computer Science Degree
6 12 (0.72%) AWS Certification
7 10 (0.60%) Master's Degree
8 9 (0.54%) TOGAF Certification
9 8 (0.48%) CISM
9 8 (0.48%) CISSP
10 7 (0.42%) BPSS Clearance
10 7 (0.42%) CCA
11 6 (0.36%) Microsoft Certification
12 5 (0.30%) PhD
13 4 (0.24%) BC Cleared
13 4 (0.24%) Cisco Certification
13 4 (0.24%) SAS Certification
14 3 (0.18%) (ISC)2 CCSP
14 3 (0.18%) OCP
14 3 (0.18%) Oracle Certification
Quality Assurance & Compliance
1 117 (7.04%) Data Quality
2 55 (3.31%) QA
3 38 (2.29%) GDPR
4 12 (0.72%) IFRS
4 12 (0.72%) PMO
5 10 (0.60%) SLA
6 9 (0.54%) Sarbanes-Oxley
7 6 (0.36%) NCSC
8 4 (0.24%) IFRS 9
9 3 (0.18%) ISO 20022
9 3 (0.18%) ISO/IEC 27001
9 3 (0.18%) MiFID
10 2 (0.12%) COBIT
10 2 (0.12%) NIST
10 2 (0.12%) PCI DSS
10 2 (0.12%) SOC 1
10 2 (0.12%) SOC 2
11 1 (0.060%) Actionable Recommendations
11 1 (0.060%) Dodd-Frank
11 1 (0.060%) EMIR
System Software
1 262 (15.76%) Docker
2 81 (4.87%) HDFS
3 40 (2.41%) Active Directory
4 18 (1.08%) Apache ZooKeeper
5 14 (0.84%) Apache Flume
6 12 (0.72%) VMware Infrastructure
7 4 (0.24%) Oracle RAC
8 3 (0.18%) Virtual Machines
9 2 (0.12%) Platform Symphony
9 2 (0.12%) VMware NSX
Systems Management
1 274 (16.49%) Kubernetes
2 214 (12.88%) Terraform
3 165 (9.93%) Ansible
4 43 (2.59%) Oozie
5 31 (1.87%) Puppet
6 25 (1.50%) Hadoop YARN
7 14 (0.84%) Kibana
8 13 (0.78%) Opscode Chef
9 12 (0.72%) Control-M
9 12 (0.72%) Prometheus
10 11 (0.66%) Ambari
10 11 (0.66%) Grafana
11 9 (0.54%) Single Sign-On
12 8 (0.48%) Rancher
13 7 (0.42%) Docker Swarm
13 7 (0.42%) logstash
14 4 (0.24%) Active Directory Federation Services
14 4 (0.24%) Istio
14 4 (0.24%) Mesos
14 4 (0.24%) WebInspect
Vendors
1 209 (12.58%) Oracle
2 161 (9.69%) Cloudera
2 161 (9.69%) Databricks
2 161 (9.69%) Google
3 133 (8.00%) Microsoft
4 71 (4.27%) Informatica
5 52 (3.13%) Hortonworks
6 50 (3.01%) SAP
7 39 (2.35%) IBM
7 39 (2.35%) Salesforce.com
8 36 (2.17%) BiZZdesign
9 35 (2.11%) Teradata
10 25 (1.50%) Talend
11 24 (1.44%) MuleSoft
11 24 (1.44%) StreamSets
11 24 (1.44%) VMware
12 20 (1.20%) ServiceNow
13 17 (1.02%) Ab Initio
14 16 (0.96%) Alteryx
15 15 (0.90%) Red Hat
497 Big Data job vacancies Nationwide