Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 1 April 2020

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 1 April 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
1 Apr 2020		 Same period 2019 Same period 2018
Rank 97 84 87
Rank change year-on-year -13 +3 0
Contract jobs citing Big Data 1,480 2,847 2,855
As % of all contract jobs advertised in the UK 2.38% 2.95% 2.81%
As % of the Database & Business Intelligence category 11.43% 13.26% 12.72%
Number of daily rates quoted 1,069 2,004 1,958
Median daily rate £550 £550 £538
Median daily rate % change year-on-year - +2.33% +2.38%
10th Percentile £405 £413 £392
90th Percentile £725 £713 £675
UK excluding London median daily rate £550 £525 £488
% change year-on-year +4.76% +7.69% -
Number of hourly rates quoted 5 7 9
Median hourly rate £35.00 £45.00 £30.50
Median hourly rate % change year-on-year -22.22% +47.54% -32.22%
UK excluding London median hourly rate - £45.00 £30.50
% change year-on-year - +47.54% -32.22%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 12,946 21,467 22,448
As % of all contract IT jobs advertised in the UK 20.84% 22.27% 22.12%
Number of daily rates quoted 8,489 14,774 15,539
Median daily rate £475 £475 £470
Median daily rate % change year-on-year - +1.06% +7.43%
10th Percentile £320 £325 £310
90th Percentile £675 £650 £625
UK excluding London median daily rate £450 £425 £413
% change year-on-year +5.88% +3.03% +3.13%
Number of hourly rates quoted 230 248 247
Median hourly rate £35.00 £35.00 £35.00
10th Percentile £14.76 £13.56 £14.43
90th Percentile £55.25 £56.80 £53.20
Median hourly rate £25.60 £35.00 £40.00
% change year-on-year -26.87% -12.50% +57.54%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 1 April 2020.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 1 April 2020.

Hourly rate histogram for Big Data in the UK

Big Data
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 1 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -9 1,399 £550 - 464
London -8 822 £575 +4.55% 225
UK excluding London -20 636 £550 +4.76% 269
South East -11 206 £500 - 95
North of England +20 197 £554 +0.68% 49
North West +30 114 £563 -6.25% 27
South West -12 82 £563 +5.39% 36
Yorkshire -11 64 £525 +10.53% 14
Midlands +28 45 £525 +3.96% 23
Scotland -32 41 £575 +20.42% 18
East of England +2 39 £431 -18.63% 37
Work from Home +1 37 £625 +15.74% 31
West Midlands +36 33 £488 -18.75% 15
Wales +23 24 £500 -11.89% 12
North East +13 17 £688 +37.50% 8
East Midlands +11 11 £550 +22.22% 8
Northern Ireland +13 2 - -

For the 6 months to 1 April 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 555 (37.50%) Python
2 497 (33.58%) Agile Software Development
3 487 (32.91%) Hadoop
4 482 (32.57%) Apache Spark
5 467 (31.55%) AWS
6 460 (31.08%) SQL
7 418 (28.24%) Analytics
8 391 (26.42%) Azure
9 329 (22.23%) Java
10 319 (21.55%) DevOps
11 274 (18.51%) Finance
12 265 (17.91%) Data Science
13 251 (16.96%) Kafka
14 250 (16.89%) Machine Learning
15 248 (16.76%) Data Modelling
16 238 (16.08%) Data Warehouse
17 234 (15.81%) Scala
18 231 (15.61%) GCP
19 220 (14.86%) ETL
20 216 (14.59%) Business Intelligence
21 215 (14.53%) Docker
22 211 (14.26%) NoSQL
23 209 (14.12%) Apache Hive
24 206 (13.92%) Kubernetes
25 177 (11.96%) Analytical Skills
26 175 (11.82%) Data Lake
27 167 (11.28%) Jenkins
28 165 (11.15%) Linux
29 150 (10.14%) Microsoft
30 148 (10.00%) Cloudera

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 482 (32.57%) Apache Spark
2 107 (7.23%) Apache
3 40 (2.70%) Apache Airflow
4 36 (2.43%) Elasticsearch
5 32 (2.16%) SAS
6 29 (1.96%) Confluence
7 15 (1.01%) Apache Pig
7 15 (1.01%) Jupyter
8 12 (0.81%) OpenStack
8 12 (0.81%) Tomcat
9 7 (0.47%) Luigi
10 6 (0.41%) DNN
10 6 (0.41%) SharePoint
10 6 (0.41%) WebSphere
11 4 (0.27%) nginx
12 3 (0.20%) ArcGIS
12 3 (0.20%) Oracle Workflow
12 3 (0.20%) WebLogic
13 2 (0.14%) IBM Domino
13 2 (0.14%) IIS
Applications
1 23 (1.55%) Microsoft Excel
2 7 (0.47%) Spreadsheet
3 6 (0.41%) Microsoft Project
3 6 (0.41%) SPSS
4 5 (0.34%) MS Visio
5 3 (0.20%) Microsoft Office
5 3 (0.20%) Microsoft PowerPoint
5 3 (0.20%) Stata
6 1 (0.068%) Chatbot
6 1 (0.068%) Maya
Business Applications
1 8 (0.54%) SAP ERP
2 7 (0.47%) Dynamics CRM
3 6 (0.41%) SAP Oil and Gas
4 5 (0.34%) Distributed Ledger
4 5 (0.34%) Oracle EBS
4 5 (0.34%) SAP CRM
4 5 (0.34%) SAP IS-U
5 4 (0.27%) Sparx Enterprise Architect
6 3 (0.20%) Oracle Payroll
7 2 (0.14%) Aligne
7 2 (0.14%) NetSuite
7 2 (0.14%) Oracle Applications
8 1 (0.068%) BusinessWorks
8 1 (0.068%) FINCAD Analytics
8 1 (0.068%) Markit EDM
8 1 (0.068%) PolarLake
8 1 (0.068%) SAP LE
8 1 (0.068%) SAP MDM
8 1 (0.068%) Shopify
Cloud Services
1 467 (31.55%) AWS
2 391 (26.42%) Azure
3 231 (15.61%) GCP
4 110 (7.43%) Power Platform
5 62 (4.19%) Serverless
6 61 (4.12%) Amazon S3
7 52 (3.51%) AWS Lambda
8 50 (3.38%) Amazon EMR
9 49 (3.31%) Amazon Kinesis
10 39 (2.64%) GitHub
11 37 (2.50%) Amazon EC2
12 31 (2.09%) Cloud Computing
13 29 (1.96%) Azure Data Factory
14 28 (1.89%) Amazon CloudWatch
14 28 (1.89%) AWS CloudFormation
15 25 (1.69%) SaaS
16 21 (1.42%) OpenShift
17 15 (1.01%) Amazon Cognito
17 15 (1.01%) PaaS
18 14 (0.95%) IaaS
Communications & Networking
1 28 (1.89%) Kerberos
2 18 (1.22%) DNS
3 15 (1.01%) 5G
4 14 (0.95%) Firewall
4 14 (0.95%) Internet
5 12 (0.81%) SSL
6 11 (0.74%) 4G
6 11 (0.74%) HTTP
7 10 (0.68%) 3G
8 9 (0.61%) TCP/IP
9 8 (0.54%) RTMP
10 7 (0.47%) Network Security
11 6 (0.41%) VPN
12 5 (0.34%) HTTPS
12 5 (0.34%) MQTT
13 4 (0.27%) PuTTY
14 3 (0.20%) IPsec
14 3 (0.20%) Software-Defined Networking
14 3 (0.20%) WAN
14 3 (0.20%) Wireshark
Database & Business Intelligence
1 487 (32.91%) Hadoop
2 238 (16.08%) Data Warehouse
3 211 (14.26%) NoSQL
4 209 (14.12%) Apache Hive
5 175 (11.82%) Data Lake
6 124 (8.38%) SQL Server
7 122 (8.24%) HBase
8 104 (7.03%) Power BI
9 103 (6.96%) Relational Database
10 95 (6.42%) MongoDB
11 83 (5.61%) Impala
12 69 (4.66%) Apache Cassandra
13 61 (4.12%) Amazon Redshift
14 51 (3.45%) SQL Server Integration Services
15 50 (3.38%) PostgreSQL
16 49 (3.31%) Amazon Athena
17 47 (3.18%) BigQuery
18 42 (2.84%) Spark SQL
19 40 (2.70%) Flink
20 32 (2.16%) Data Mining
Development Applications
1 167 (11.28%) Jenkins
2 139 (9.39%) Git (software)
3 74 (5.00%) JIRA
4 51 (3.45%) Maven
5 49 (3.31%) GitLab
6 27 (1.82%) Selenium
7 22 (1.49%) Bitbucket
8 20 (1.35%) Sonatype Nexus
9 19 (1.28%) Team Foundation Server
10 17 (1.15%) Artifactory
11 16 (1.08%) IBM UrbanCode
12 15 (1.01%) Visual Studio
13 14 (0.95%) ERwin
13 14 (0.95%) Visual Studio Team System
14 13 (0.88%) JUnit
15 12 (0.81%) Cucumber
15 12 (0.81%) SonarQube
15 12 (0.81%) Subversion
16 11 (0.74%) CircleCI
17 10 (0.68%) Gradle
General
1 274 (18.51%) Finance
2 121 (8.18%) Banking
3 94 (6.35%) Public Sector
4 70 (4.73%) Retail
5 63 (4.26%) Telecoms
6 44 (2.97%) Marketing
7 41 (2.77%) Investment Banking
8 33 (2.23%) Manufacturing
9 28 (1.89%) Front Office
10 25 (1.69%) Legal
11 12 (0.81%) Billing
12 11 (0.74%) Pharmaceutical
13 9 (0.61%) Games
14 7 (0.47%) Financial Institution
15 4 (0.27%) Music Industry
15 4 (0.27%) Retail Banking
16 3 (0.20%) Advertising
16 3 (0.20%) Automotive
16 3 (0.20%) International Banking
16 3 (0.20%) Publishing
Job Titles
1 306 (20.68%) Data Engineer
2 285 (19.26%) Developer
3 240 (16.22%) Architect
4 157 (10.61%) Big Data Engineer
5 133 (8.99%) Data Architect
6 119 (8.04%) Data Scientist
7 111 (7.50%) Analyst
8 87 (5.88%) DevOps Engineer
9 72 (4.86%) AWS Engineer
10 59 (3.99%) Java Developer
11 52 (3.51%) Consultant
11 52 (3.51%) Python Engineer
12 50 (3.38%) Big Data Architect
13 46 (3.11%) Big Data Developer
14 42 (2.84%) Cloud Engineer
15 40 (2.70%) Senior Data Scientist
15 40 (2.70%) Solutions Architect
16 38 (2.57%) Data Analyst
17 37 (2.50%) Scala Developer
17 37 (2.50%) Senior Developer
Libraries, Frameworks & Software Standards
1 251 (16.96%) Kafka
2 100 (6.76%) Web Services
3 90 (6.08%) PySpark
4 69 (4.66%) TensorFlow
5 57 (3.85%) Node.js
5 57 (3.85%) React
6 56 (3.78%) REST
7 53 (3.58%) .NET
8 47 (3.18%) Pandas
8 47 (3.18%) Spring
9 46 (3.11%) RESTful
10 41 (2.77%) Natural Language Processing
11 40 (2.70%) HTML
12 39 (2.64%) XML
13 38 (2.57%) JSON
14 30 (2.03%) scikit-learn
15 29 (1.96%) SciPy
16 28 (1.89%) NumPy
17 27 (1.82%) AngularJS
17 27 (1.82%) MLlib
Miscellaneous
1 177 (11.96%) Analytical Skills
2 92 (6.22%) Algorithms
3 60 (4.05%) Greenfield Project
4 45 (3.04%) Data Structures
5 37 (2.50%) Public Cloud
6 36 (2.43%) User Experience
7 34 (2.30%) Management Information System
8 31 (2.09%) Self-Motivation
9 20 (1.35%) Credit Risk
10 17 (1.15%) Data Centre
11 13 (0.88%) Enterprise Software
11 13 (0.88%) Hybrid Cloud
11 13 (0.88%) Social Media
12 12 (0.81%) Cloud Native
13 11 (0.74%) Clustering
14 10 (0.68%) Foreign Exchange (FX)
15 9 (0.61%) Hedge funds
15 9 (0.61%) Mainframe
15 9 (0.61%) Mobile App
16 8 (0.54%) Market Risk
Operating Systems
1 165 (11.15%) Linux
2 65 (4.39%) Unix
3 28 (1.89%) Windows
4 20 (1.35%) Red Hat Enterprise Linux
5 18 (1.22%) CentOS
6 15 (1.01%) VMS
7 10 (0.68%) Ubuntu
8 9 (0.61%) Debian
9 8 (0.54%) Windows Server
10 5 (0.34%) Android
11 4 (0.27%) Apple iOS
12 3 (0.20%) Mac OS X
13 2 (0.14%) Embedded Linux
13 2 (0.14%) Fedora
13 2 (0.14%) Windows Server 2016
14 1 (0.068%) AIX
14 1 (0.068%) DC/OS
14 1 (0.068%) Solaris
14 1 (0.068%) VME
14 1 (0.068%) Windows 10
Processes & Methodologies
1 497 (33.58%) Agile Software Development
2 418 (28.24%) Analytics
3 319 (21.55%) DevOps
4 265 (17.91%) Data Science
5 250 (16.89%) Machine Learning
6 248 (16.76%) Data Modelling
7 220 (14.86%) ETL
8 216 (14.59%) Business Intelligence
9 146 (9.86%) Artificial Intelligence
10 136 (9.19%) Scrum
11 134 (9.05%) Data Engineering
12 132 (8.92%) Data Analytics
12 132 (8.92%) Software Engineering
13 131 (8.85%) Microservices
14 130 (8.78%) Data Architecture
15 121 (8.18%) Continuous Integration
16 118 (7.97%) Computer Science
17 110 (7.43%) Visualisation
18 103 (6.96%) Stakeholder Management
19 96 (6.49%) Use Case
Programming Languages
1 555 (37.50%) Python
2 460 (31.08%) SQL
3 329 (22.23%) Java
4 234 (15.81%) Scala
5 102 (6.89%) C#
6 101 (6.82%) JavaScript
7 68 (4.59%) R
8 52 (3.51%) Bash Shell
9 43 (2.91%) C
10 41 (2.77%) Go
11 38 (2.57%) PowerShell
12 35 (2.36%) Shell Script
13 34 (2.30%) Ruby
14 31 (2.09%) C++
15 25 (1.69%) PL/SQL
16 22 (1.49%) Java 8
17 19 (1.28%) T-SQL
18 16 (1.08%) Groovy
18 16 (1.08%) Perl
19 15 (1.01%) TypeScript
Qualifications
1 148 (10.00%) Security Cleared
2 141 (9.53%) Degree
3 88 (5.95%) SC Cleared
4 49 (3.31%) Computer Science Degree
5 48 (3.24%) DV Cleared
6 26 (1.76%) PhD
7 25 (1.69%) AWS Certification
8 24 (1.62%) Master's Degree
9 18 (1.22%) CCA
10 9 (0.61%) CISSP
10 9 (0.61%) Microsoft Certification
10 9 (0.61%) Numerate Degree
11 8 (0.54%) Cisco Certification
12 7 (0.47%) CCNA
12 7 (0.47%) PMI Certification
13 6 (0.41%) BPSS Clearance
13 6 (0.41%) ISEB
14 4 (0.27%) CESG Certified Professional
14 4 (0.27%) CompTIA Security+
14 4 (0.27%) SANS
Quality Assurance & Compliance
1 39 (2.64%) Data Quality
2 38 (2.57%) QA
3 11 (0.74%) GDPR
4 8 (0.54%) PCI DSS
5 4 (0.27%) Basel III
5 4 (0.27%) COBIT
5 4 (0.27%) PMO
6 3 (0.20%) MiFID
7 2 (0.14%) IFRS
7 2 (0.14%) ISO/IEC 27001
7 2 (0.14%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.14%) Sarbanes-Oxley
7 2 (0.14%) SLA
8 1 (0.068%) IFRS 9
System Software
1 215 (14.53%) Docker
2 106 (7.16%) HDFS
3 15 (1.01%) Active Directory
4 12 (0.81%) Apache Flume
5 6 (0.41%) VMware ESXi
6 5 (0.34%) Apache ZooKeeper
6 5 (0.34%) VMware Infrastructure
7 4 (0.27%) vSphere
8 3 (0.20%) Virtual Desktop
8 3 (0.20%) Virtual Machines
8 3 (0.20%) Virtual Servers
9 2 (0.14%) BusyBox
9 2 (0.14%) NFS
9 2 (0.14%) Samba
9 2 (0.14%) VirtualBox
9 2 (0.14%) Xen
10 1 (0.068%) Hyper-V
10 1 (0.068%) Oracle Clusterware
10 1 (0.068%) Oracle RAC
Systems Management
1 206 (13.92%) Kubernetes
2 138 (9.32%) Terraform
3 107 (7.23%) Ansible
4 51 (3.45%) Hadoop YARN
5 40 (2.70%) Puppet
6 26 (1.76%) Oozie
7 19 (1.28%) Opscode Chef
8 16 (1.08%) Kibana
9 13 (0.88%) ITRS Geneos
9 13 (0.88%) logstash
9 13 (0.88%) Nagios
10 11 (0.74%) Packer
11 10 (0.68%) Grafana
12 9 (0.61%) Ambari
13 7 (0.47%) Single Sign-On
14 5 (0.34%) CFEngine
14 5 (0.34%) HP SiteScope
14 5 (0.34%) Prometheus
14 5 (0.34%) SCCM
15 4 (0.27%) Docker Swarm
Vendors
1 150 (10.14%) Microsoft
2 148 (10.00%) Cloudera
3 125 (8.45%) Google
4 84 (5.68%) Tableau
5 82 (5.54%) Hortonworks
6 81 (5.47%) Oracle
7 55 (3.72%) Databricks
8 50 (3.38%) Informatica
9 45 (3.04%) SAP
10 38 (2.57%) Talend
11 34 (2.30%) Splunk
12 28 (1.89%) MapR
13 20 (1.35%) StreamSets
14 16 (1.08%) Red Hat
15 14 (0.95%) Teradata
16 13 (0.88%) Ab Initio
17 12 (0.81%) IBM
18 10 (0.68%) Atlassian
19 8 (0.54%) Palantir
19 8 (0.54%) VMware
494 Big Data job vacancies Nationwide