Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 22 January 2020

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
22 Jan 2020		 Same period 2019 Same period 2018
Rank 98 92 90
Rank change year-on-year -6 -2 +2
Contract jobs citing Big Data 1,751 2,652 2,668
As % of all contract IT jobs advertised in the UK 2.41% 2.66% 2.68%
As % of the Database & Business Intelligence category 11.48% 11.85% 12.19%
Number of daily rates quoted 1,201 1,838 1,847
UK median daily rate £550 £550 £550
10th Percentile £400 £413 £396
90th Percentile £725 £713 £675
UK excluding London median daily rate £530 £519 £500
% change year-on-year +2.17% +3.75% +2.56%
Number of hourly rates quoted 1 9 15
UK median hourly rate £52.50 £45.00 £30.50
Median hourly rate % change year-on-year +16.67% +47.54% -32.22%
10th Percentile £51.25 £32.50 £17.72
90th Percentile £53.75 £58.00 £64.24
UK excluding London median hourly rate - £45.00 £30.50
% change year-on-year - +47.54% -30.68%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 15,251 22,379 21,890
As % of all contract IT jobs advertised in the UK 20.99% 22.45% 21.97%
Number of daily rates quoted 10,167 15,425 15,233
UK median daily rate £475 £475 £455
Median daily rate % change year-on-year - +4.40% +7.06%
10th Percentile £319 £319 £310
90th Percentile £663 £644 £625
UK excluding London median daily rate £438 £425 £400
% change year-on-year +2.94% +6.25% +3.23%
Number of hourly rates quoted 242 244 252
UK median hourly rate £31.00 £32.75 £30.50
Median hourly rate % change year-on-year -5.34% +7.38% +8.23%
10th Percentile £12.78 £13.38 £14.54
90th Percentile £53.75 £56.93 £55.54
UK excluding London median hourly rate £26.50 £32.75 £35.00
% change year-on-year -19.08% -6.43% +32.08%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 22 January 2020.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 22 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -7 1,634 £550 - 587
London -5 938 £575 +4.55% 325
UK excluding London +8 790 £530 +2.17% 303
South East -17 251 £500 -4.76% 94
North of England +36 194 £550 +4.76% 57
South West -1 132 £557 +6.10% 34
North West +38 120 £550 -8.33% 35
Scotland +45 77 £550 +15.79% 21
East of England +25 60 £500 +2.56% 40
Yorkshire +18 56 £534 +12.37% 15
Midlands +19 55 £475 -2.26% 37
West Midlands +44 35 £460 -10.68% 30
East Midlands +7 20 £525 +16.67% 7
North East +14 19 £675 +35.00% 7
Wales +2 13 £500 -5.66% 17
Northern Ireland +10 8 £600 +33.33% 1

For the 6 months to 22 January 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 626 (35.75%) Hadoop
2 620 (35.41%) Python
3 591 (33.75%) Agile Software Development
4 573 (32.72%) Apache Spark
5 541 (30.90%) SQL
6 529 (30.21%) AWS
7 486 (27.76%) Analytics
8 457 (26.10%) Azure
9 436 (24.90%) Java
10 363 (20.73%) Finance
11 330 (18.85%) DevOps
12 304 (17.36%) Kafka
13 279 (15.93%) Data Warehouse
14 276 (15.76%) ETL
15 268 (15.31%) Scala
16 253 (14.45%) Apache Hive
16 253 (14.45%) Data Science
17 251 (14.33%) Data Modelling
18 243 (13.88%) Business Intelligence
19 239 (13.65%) Linux
20 226 (12.91%) GCP
21 224 (12.79%) Machine Learning
22 213 (12.16%) Data Lake
23 208 (11.88%) NoSQL
24 206 (11.76%) Cloudera
25 203 (11.59%) Jenkins
26 202 (11.54%) Docker
27 191 (10.91%) Analytical Skills
28 187 (10.68%) Kubernetes
29 185 (10.57%) Data Engineering

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 573 (32.72%) Apache Spark
2 120 (6.85%) Apache
3 43 (2.46%) SAS
4 41 (2.34%) Elasticsearch
5 35 (2.00%) Apache Airflow
6 25 (1.43%) Jupyter
7 14 (0.80%) Apache Pig
8 13 (0.74%) Confluence
8 13 (0.74%) OpenStack
9 11 (0.63%) Tomcat
10 9 (0.51%) SharePoint
11 6 (0.34%) JBoss
11 6 (0.34%) Luigi
11 6 (0.34%) WebSphere
12 5 (0.29%) ArcGIS
12 5 (0.29%) DNN
13 3 (0.17%) IBM Domino
13 3 (0.17%) Moodle
13 3 (0.17%) Oracle HTTP Server
13 3 (0.17%) WebLogic
Applications
1 36 (2.06%) Microsoft Excel
2 12 (0.69%) MS Visio
3 10 (0.57%) Microsoft Project
4 8 (0.46%) Microsoft PowerPoint
5 5 (0.29%) Spreadsheet
6 4 (0.23%) SPSS
7 2 (0.11%) InVision
7 2 (0.11%) Microsoft Office
7 2 (0.11%) Sketch
8 1 (0.057%) Adobe Creative Suite
8 1 (0.057%) AutoCAD
8 1 (0.057%) Chatbot
8 1 (0.057%) Maya
8 1 (0.057%) Zeplin
Business Applications
1 10 (0.57%) Dynamics CRM
2 7 (0.40%) SAP ERP
3 4 (0.23%) FINCAD Analytics
3 4 (0.23%) SAP CRM
3 4 (0.23%) SAP IS-U
3 4 (0.23%) SAP Oil and Gas
4 3 (0.17%) Distributed Ledger
4 3 (0.17%) Oracle BPM
5 2 (0.11%) Adobe Campaign
5 2 (0.11%) Aligne
5 2 (0.11%) NetSuite
5 2 (0.11%) PolarLake
5 2 (0.11%) SAP S/4HANA
5 2 (0.11%) Sparx Enterprise Architect
6 1 (0.057%) Actimize
6 1 (0.057%) Cognos Business Intelligence
6 1 (0.057%) Oracle Applications
6 1 (0.057%) Oracle EBS
6 1 (0.057%) SAP MDM
6 1 (0.057%) SAP Retail
Cloud Services
1 529 (30.21%) AWS
2 457 (26.10%) Azure
3 226 (12.91%) GCP
4 130 (7.42%) Power Platform
5 66 (3.77%) Amazon EMR
6 52 (2.97%) Amazon S3
6 52 (2.97%) GitHub
6 52 (2.97%) Serverless
7 42 (2.40%) Amazon Kinesis
8 39 (2.23%) AWS Lambda
9 35 (2.00%) Azure Data Factory
10 32 (1.83%) Cloud Computing
10 32 (1.83%) OpenShift
11 29 (1.66%) Data Lake Analytics
12 27 (1.54%) AWS CloudFormation
13 20 (1.14%) Amazon EC2
13 20 (1.14%) SaaS
14 18 (1.03%) PaaS
15 17 (0.97%) IaaS
16 16 (0.91%) Amazon CloudWatch
Communications & Networking
1 42 (2.40%) Kerberos
2 22 (1.26%) DNS
3 19 (1.09%) Firewall
4 18 (1.03%) SSL
5 15 (0.86%) HTTP
6 13 (0.74%) SAN
7 12 (0.69%) Internet
8 7 (0.40%) 5G
8 7 (0.40%) TCP/IP
8 7 (0.40%) VPN
9 6 (0.34%) 3G
9 6 (0.34%) 4G
9 6 (0.34%) Network Security
10 5 (0.29%) NetScaler
10 5 (0.29%) PuTTY
10 5 (0.29%) Wi-Fi
11 4 (0.23%) F5 BIG-IP GTM
11 4 (0.23%) F5 BIG-IP LTM
11 4 (0.23%) HTTPS
11 4 (0.23%) Software-Defined Networking
Database & Business Intelligence
1 626 (35.75%) Hadoop
2 279 (15.93%) Data Warehouse
3 253 (14.45%) Apache Hive
4 213 (12.16%) Data Lake
5 208 (11.88%) NoSQL
6 152 (8.68%) SQL Server
7 130 (7.42%) Power BI
7 130 (7.42%) Relational Database
8 123 (7.02%) HBase
9 121 (6.91%) Impala
10 97 (5.54%) MongoDB
11 88 (5.03%) Amazon Redshift
12 69 (3.94%) PostgreSQL
13 67 (3.83%) SQL Server Integration Services
14 62 (3.54%) Spark SQL
15 56 (3.20%) MySQL
16 54 (3.08%) Amazon Athena
17 52 (2.97%) Apache Cassandra
18 47 (2.68%) BigQuery
19 45 (2.57%) RDBMS
Development Applications
1 203 (11.59%) Jenkins
2 149 (8.51%) Git (software)
3 79 (4.51%) JIRA
4 47 (2.68%) Maven
5 44 (2.51%) Selenium
6 33 (1.88%) Visual Studio
6 33 (1.88%) Visual Studio Team System
7 30 (1.71%) GitLab
8 27 (1.54%) Cucumber
9 26 (1.48%) Artifactory
9 26 (1.48%) Team Foundation Server
10 24 (1.37%) Sonatype Nexus
11 20 (1.14%) Atlassian Bamboo
12 15 (0.86%) Subversion
13 14 (0.80%) Gradle
14 13 (0.74%) ERwin
14 13 (0.74%) SonarQube
14 13 (0.74%) TeamCity
15 12 (0.69%) IBM UrbanCode
15 12 (0.69%) JUnit
General
1 363 (20.73%) Finance
2 145 (8.28%) Banking
3 110 (6.28%) Public Sector
4 95 (5.43%) Retail
5 72 (4.11%) Telecoms
6 48 (2.74%) Manufacturing
7 43 (2.46%) Investment Banking
8 42 (2.40%) Marketing
9 32 (1.83%) Front Office
10 17 (0.97%) Legal
11 13 (0.74%) Pharmaceutical
12 10 (0.57%) Advertising
12 10 (0.57%) Retail Banking
13 9 (0.51%) Games
14 8 (0.46%) Financial Institution
15 7 (0.40%) Billing
16 6 (0.34%) Automotive
17 4 (0.23%) International Banking
17 4 (0.23%) Music Industry
18 3 (0.17%) Local Government
Job Titles
1 356 (20.33%) Data Engineer
2 340 (19.42%) Developer
3 300 (17.13%) Architect
4 183 (10.45%) Big Data Engineer
5 159 (9.08%) Analyst
6 150 (8.57%) Data Architect
7 104 (5.94%) Data Scientist
8 96 (5.48%) DevOps Engineer
9 74 (4.23%) Java Developer
10 72 (4.11%) Big Data Developer
11 69 (3.94%) Python Developer
12 64 (3.66%) Python Engineer
13 63 (3.60%) Data Analyst
14 61 (3.48%) Solutions Architect
15 59 (3.37%) Consultant
16 58 (3.31%) Software Engineer
17 57 (3.26%) AWS Engineer
18 55 (3.14%) Big Data Architect
19 54 (3.08%) Business Analyst
20 52 (2.97%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 304 (17.36%) Kafka
2 108 (6.17%) Web Services
3 87 (4.97%) PySpark
4 64 (3.66%) .NET
5 61 (3.48%) React
6 60 (3.43%) JSON
7 52 (2.97%) RESTful
8 51 (2.91%) XML
9 50 (2.86%) REST
10 47 (2.68%) Spring
11 44 (2.51%) TensorFlow
12 43 (2.46%) Pandas
13 41 (2.34%) Node.js
14 35 (2.00%) scikit-learn
15 33 (1.88%) Apache NiFi
16 28 (1.60%) AngularJS
16 28 (1.60%) NumPy
17 27 (1.54%) Natural Language Processing
18 25 (1.43%) Middleware
19 24 (1.37%) HTML
Miscellaneous
1 191 (10.91%) Analytical Skills
2 97 (5.54%) Algorithms
3 82 (4.68%) Greenfield Project
4 42 (2.40%) Data Structures
5 40 (2.28%) User Experience
6 36 (2.06%) Management Information System
7 35 (2.00%) Public Cloud
8 34 (1.94%) Self-Motivation
9 28 (1.60%) Data Centre
10 21 (1.20%) Clustering
11 17 (0.97%) Cloud Native
12 16 (0.91%) Replication
13 13 (0.74%) Credit Risk
13 13 (0.74%) Cyberthreat
13 13 (0.74%) Derivative
13 13 (0.74%) Linux Command Line
14 12 (0.69%) Hybrid Cloud
14 12 (0.69%) PKI
15 11 (0.63%) Fixed Income
16 10 (0.57%) Mainframe
Operating Systems
1 239 (13.65%) Linux
2 77 (4.40%) Unix
3 53 (3.03%) Windows
4 49 (2.80%) Red Hat Enterprise Linux
5 31 (1.77%) CentOS
6 21 (1.20%) Windows Server
7 13 (0.74%) VMS
8 10 (0.57%) Apple iOS
9 9 (0.51%) Solaris
9 9 (0.51%) Ubuntu
10 8 (0.46%) Android
10 8 (0.46%) Debian
11 6 (0.34%) Windows 10
12 3 (0.17%) Mac OS X
12 3 (0.17%) Windows Server 2012
13 2 (0.11%) AIX
13 2 (0.11%) Embedded Linux
14 1 (0.057%) Oracle Linux
14 1 (0.057%) VME
Processes & Methodologies
1 591 (33.75%) Agile Software Development
2 486 (27.76%) Analytics
3 330 (18.85%) DevOps
4 276 (15.76%) ETL
5 253 (14.45%) Data Science
6 251 (14.33%) Data Modelling
7 243 (13.88%) Business Intelligence
8 224 (12.79%) Machine Learning
9 185 (10.57%) Data Engineering
10 179 (10.22%) Data Analytics
11 178 (10.17%) Scrum
12 169 (9.65%) Migration
13 143 (8.17%) Data Architecture
14 142 (8.11%) Continuous Integration
15 141 (8.05%) Software Engineering
16 139 (7.94%) Computer Science
17 138 (7.88%) Microservices
18 136 (7.77%) Problem-Solving
19 131 (7.48%) Stakeholder Management
20 129 (7.37%) Visualisation
Programming Languages
1 620 (35.41%) Python
2 541 (30.90%) SQL
3 436 (24.90%) Java
4 268 (15.31%) Scala
5 98 (5.60%) C#
6 90 (5.14%) R
7 89 (5.08%) JavaScript
8 65 (3.71%) Bash Shell
9 55 (3.14%) PowerShell
10 44 (2.51%) Shell Script
11 39 (2.23%) C
11 39 (2.23%) C++
12 27 (1.54%) PL/SQL
12 27 (1.54%) Ruby
13 25 (1.43%) Go
14 21 (1.20%) Java 8
15 19 (1.09%) T-SQL
16 17 (0.97%) Groovy
17 16 (0.91%) Perl
18 12 (0.69%) PHP
Qualifications
1 163 (9.31%) Security Cleared
2 150 (8.57%) Degree
3 95 (5.43%) SC Cleared
4 52 (2.97%) Computer Science Degree
5 48 (2.74%) DV Cleared
6 29 (1.66%) PhD
7 22 (1.26%) Master's Degree
8 19 (1.09%) AWS Certification
9 11 (0.63%) CCA
10 10 (0.57%) Cisco Certification
10 10 (0.57%) CISSP
11 8 (0.46%) BPSS Clearance
12 7 (0.40%) Microsoft Certification
13 6 (0.34%) CCIE
13 6 (0.34%) ISEB
14 5 (0.29%) CCNP
14 5 (0.29%) Numerate Degree
14 5 (0.29%) PMI Certification
14 5 (0.29%) TOGAF Certification
15 4 (0.23%) DBS Check
Quality Assurance & Compliance
1 61 (3.48%) QA
2 48 (2.74%) Data Quality
3 20 (1.14%) GDPR
4 12 (0.69%) PCI DSS
5 9 (0.51%) PMO
6 6 (0.34%) Sarbanes-Oxley
7 5 (0.29%) ISO/IEC 27001
8 4 (0.23%) Disclosure Scotland
9 3 (0.17%) COBIT
9 3 (0.17%) SLA
10 2 (0.11%) ISO 9000
11 1 (0.057%) Basel III
11 1 (0.057%) EMIR
11 1 (0.057%) GLBA
11 1 (0.057%) HIPAA
11 1 (0.057%) IFRS
11 1 (0.057%) IFRS 9
11 1 (0.057%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
11 1 (0.057%) MiFID
11 1 (0.057%) NIST
System Software
1 202 (11.54%) Docker
2 120 (6.85%) HDFS
3 32 (1.83%) Active Directory
4 17 (0.97%) Virtual Desktop
5 10 (0.57%) Virtual Servers
6 9 (0.51%) Apache Flume
7 8 (0.46%) Apache ZooKeeper
8 7 (0.40%) Microsoft App-V
8 7 (0.40%) VMware Infrastructure
8 7 (0.40%) XenApp
8 7 (0.40%) XenDesktop
9 4 (0.23%) Oracle RAC
10 3 (0.17%) vSphere
11 2 (0.11%) BusyBox
11 2 (0.11%) Hyper-V
11 2 (0.11%) Virtual Machines
11 2 (0.11%) VMware ESXi
12 1 (0.057%) NFS
12 1 (0.057%) Oracle Clusterware
Systems Management
1 187 (10.68%) Kubernetes
2 144 (8.22%) Ansible
3 138 (7.88%) Terraform
4 68 (3.88%) Hadoop YARN
5 50 (2.86%) Puppet
6 36 (2.06%) Oozie
7 26 (1.48%) Opscode Chef
8 19 (1.09%) Kibana
9 13 (0.74%) logstash
9 13 (0.74%) Packer
9 13 (0.74%) SCCM
10 12 (0.69%) ITRS Geneos
11 10 (0.57%) Nagios
12 9 (0.51%) Prometheus
13 7 (0.40%) Ambari
13 7 (0.40%) Grafana
13 7 (0.40%) HP ALM
13 7 (0.40%) Istio
13 7 (0.40%) Single Sign-On
14 5 (0.29%) Microsoft Intune
Vendors
1 206 (11.76%) Cloudera
2 184 (10.51%) Microsoft
3 143 (8.17%) Google
4 140 (8.00%) Oracle
5 107 (6.11%) Tableau
6 96 (5.48%) Hortonworks
7 67 (3.83%) Databricks
8 51 (2.91%) Talend
9 42 (2.40%) Informatica
10 40 (2.28%) SAP
11 36 (2.06%) Red Hat
12 33 (1.88%) Splunk
13 31 (1.77%) Teradata
14 28 (1.60%) StreamSets
15 23 (1.31%) MapR
16 17 (0.97%) Cisco
17 16 (0.91%) Ab Initio
17 16 (0.91%) Alteryx
18 14 (0.80%) Palantir
19 13 (0.74%) VMware
632 Big Data job vacancies Nationwide