Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 26 October 2020

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 26 October 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
26 Oct 2020		 Same period 2019 Same period 2018
Rank 108 85 95
Rank change year-on-year -23 +10 -3
Contract jobs citing Big Data 754 2,294 2,719
As % of all contract jobs advertised in the UK 2.34% 2.72% 2.63%
As % of the Database & Business Intelligence category 10.36% 12.47% 11.51%
Number of daily rates quoted 585 1,671 1,919
Median daily rate £550 £550 £545
Median daily rate % change year-on-year - +0.92% -
10th Percentile £355 £413 £400
90th Percentile £675 £725 £700
UK excluding London median daily rate £520 £525 £500
% change year-on-year -0.95% +5.00% +5.26%
Number of hourly rates quoted 25 14 13
Median hourly rate £35.00 £42.50 £40.00
Median hourly rate % change year-on-year -17.65% +6.25% +14.29%
10th Percentile £16.45 £35.00 £15.60
90th Percentile £47.00 £53.75 £59.50
UK excluding London median hourly rate £35.00 £44.25 £40.00
% change year-on-year -20.90% +10.63% +14.29%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 7,276 18,403 23,616
As % of all contract IT jobs advertised in the UK 22.62% 21.82% 22.82%
Number of daily rates quoted 4,640 12,536 16,480
Median daily rate £481 £475 £475
Median daily rate % change year-on-year +1.21% - +5.56%
10th Percentile £313 £320 £313
90th Percentile £665 £656 £638
UK excluding London median daily rate £435 £438 £425
% change year-on-year -0.57% +2.94% +6.25%
Number of hourly rates quoted 156 267 231
Median hourly rate £35.00 £31.00 £28.00
Median hourly rate % change year-on-year +12.90% +10.71% -6.67%
10th Percentile £14.00 £12.70 £12.46
90th Percentile £51.75 £60.00 £56.00
Median hourly rate £31.25 £30.00 £32.00
% change year-on-year +4.17% -6.25% -4.48%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 26 October 2020.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 26 October 2020.

Hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 26 October 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -19 663 £550 - 318
London -20 415 £550 -4.35% 181
UK excluding London -7 238 £520 -0.95% 158
Work from Home -6 156 £550 - 58
North of England +23 75 £550 +4.76% 34
North West +36 70 £550 +4.76% 25
South East +17 60 £504 -0.49% 31
East of England +56 30 £488 -7.14% 27
Midlands +55 27 £389 -25.89% 25
South West +18 23 £431 -21.59% 15
East Midlands +29 16 £388 -26.13% 11
Scotland -20 15 £351 -26.21% 14
West Midlands +43 11 £475 -2.56% 14
Wales +47 10 £500 -2.44% 11
Yorkshire +15 4 £401 -19.80% 5
Northern Ireland -10 3 £390 -26.42% 2

For the 6 months to 26 October 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 308 (40.85%) Python
2 250 (33.16%) Hadoop
3 244 (32.36%) Apache Spark
4 233 (30.90%) SQL
5 218 (28.91%) Azure
6 213 (28.25%) Agile Software Development
7 196 (25.99%) AWS
8 184 (24.40%) DevOps
9 181 (24.01%) Analytics
9 181 (24.01%) Java
10 158 (20.95%) ETL
11 143 (18.97%) Kafka
12 133 (17.64%) Docker
12 133 (17.64%) Finance
12 133 (17.64%) Security Cleared
13 120 (15.92%) Data Modelling
13 120 (15.92%) Data Science
14 119 (15.78%) Apache Hive
15 114 (15.12%) SC Cleared
16 111 (14.72%) Cloudera
17 108 (14.32%) Business Intelligence
18 104 (13.79%) Machine Learning
19 98 (13.00%) Analytical Skills
20 97 (12.86%) Kubernetes
21 95 (12.60%) Scala
22 93 (12.33%) Jenkins
23 90 (11.94%) Data Engineering
24 87 (11.54%) Terraform
25 86 (11.41%) Linux
26 82 (10.88%) Data Warehouse

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 244 (32.36%) Apache Spark
2 43 (5.70%) Apache
3 22 (2.92%) Elasticsearch
4 21 (2.79%) Tomcat
5 20 (2.65%) SAS
6 16 (2.12%) Apache Airflow
7 14 (1.86%) Confluence
8 9 (1.19%) SharePoint
9 5 (0.66%) Tornado
10 4 (0.53%) BizTalk Server
11 3 (0.40%) CMS
11 3 (0.40%) Jupyter
11 3 (0.40%) Skype for Business
11 3 (0.40%) WebLogic
12 2 (0.27%) Apache Pig
12 2 (0.27%) IIS
12 2 (0.27%) Luigi
13 1 (0.13%) Cloud Foundry
13 1 (0.13%) Exchange Server 2013
13 1 (0.13%) Oracle Coherence
Applications
1 7 (0.93%) Microsoft Excel
2 5 (0.66%) Chatbot
2 5 (0.66%) Microsoft Office
2 5 (0.66%) Microsoft PowerPoint
3 3 (0.40%) SPSS
4 2 (0.27%) MS Visio
5 1 (0.13%) Microsoft Project
5 1 (0.13%) Spreadsheet
5 1 (0.13%) Stata
Business Applications
1 6 (0.80%) Sparx Enterprise Architect
2 4 (0.53%) Dynamics AX
2 4 (0.53%) Dynamics CRM
3 2 (0.27%) Cognos Business Intelligence
3 2 (0.27%) PeopleSoft HCM
4 1 (0.13%) BusinessWorks
4 1 (0.13%) Dynamics NAV
4 1 (0.13%) NetSuite
4 1 (0.13%) Oracle Payroll
4 1 (0.13%) Oracle Procure-to-Pay
4 1 (0.13%) SAP IS-U
4 1 (0.13%) SAP S/4HANA
Cloud Services
1 218 (28.91%) Azure
2 196 (25.99%) AWS
3 72 (9.55%) GCP
4 43 (5.70%) Serverless
5 30 (3.98%) Amazon EMR
5 30 (3.98%) Amazon S3
5 30 (3.98%) AWS Lambda
6 28 (3.71%) Power Platform
7 26 (3.45%) Azure Data Factory
8 24 (3.18%) PaaS
9 23 (3.05%) GitHub
10 18 (2.39%) Datadog
11 17 (2.25%) Amazon CloudWatch
12 16 (2.12%) SaaS
13 15 (1.99%) Amazon EC2
14 14 (1.86%) Cloud Computing
14 14 (1.86%) IaaS
14 14 (1.86%) Virtual Private Cloud
15 13 (1.72%) Amazon EKS
16 11 (1.46%) Amazon Kinesis
Communications & Networking
1 15 (1.99%) Firewall
2 7 (0.93%) HTTP
2 7 (0.93%) Kerberos
2 7 (0.93%) SSL
3 6 (0.80%) Internet
4 5 (0.66%) DNS
4 5 (0.66%) Skype
5 3 (0.40%) 5G
5 3 (0.40%) Unified Communications
5 3 (0.40%) VPN
6 2 (0.27%) 3G
6 2 (0.27%) 4G
6 2 (0.27%) Network Security
7 1 (0.13%) 2G
7 1 (0.13%) Cisco IPT
7 1 (0.13%) LTE
7 1 (0.13%) PuTTY
7 1 (0.13%) Radio Access Network
7 1 (0.13%) VoLTE
7 1 (0.13%) Wi-Fi
Database & Business Intelligence
1 250 (33.16%) Hadoop
2 119 (15.78%) Apache Hive
3 82 (10.88%) Data Warehouse
4 80 (10.61%) Data Lake
5 75 (9.95%) NoSQL
6 54 (7.16%) Impala
6 54 (7.16%) Tableau
7 51 (6.76%) Relational Database
8 35 (4.64%) MySQL
9 29 (3.85%) Apache Cassandra
10 28 (3.71%) HBase
11 27 (3.58%) Amazon Redshift
11 27 (3.58%) Power BI
12 25 (3.32%) BigQuery
13 22 (2.92%) PostgreSQL
14 20 (2.65%) MongoDB
15 19 (2.52%) Data Mining
15 19 (2.52%) SQL Server
16 18 (2.39%) Spark SQL
17 16 (2.12%) Azure SQL Database
Development Applications
1 93 (12.33%) Jenkins
2 58 (7.69%) Git (software)
3 43 (5.70%) GitLab
4 22 (2.92%) JIRA
5 9 (1.19%) kappa
6 8 (1.06%) Maven
7 7 (0.93%) ProC
8 6 (0.80%) Selenium
9 5 (0.66%) Hudson
9 5 (0.66%) Sonatype Nexus
10 4 (0.53%) Eclipse
10 4 (0.53%) LoadRunner
10 4 (0.53%) PowerDesigner
10 4 (0.53%) SoapUI
10 4 (0.53%) Visual Studio Team System
11 3 (0.40%) Ant
11 3 (0.40%) Toad
12 2 (0.27%) Artifactory
12 2 (0.27%) ERwin
12 2 (0.27%) Gradle
General
1 133 (17.64%) Finance
2 73 (9.68%) Banking
3 52 (6.90%) Public Sector
4 40 (5.31%) Marketing
5 31 (4.11%) Telecoms
6 29 (3.85%) Retail
7 27 (3.58%) Manufacturing
8 19 (2.52%) Front Office
9 15 (1.99%) Investment Banking
9 15 (1.99%) Legal
10 11 (1.46%) Electronics
11 9 (1.19%) Law
11 9 (1.19%) Pharmaceutical
12 5 (0.66%) Games
13 4 (0.53%) Aerospace
14 3 (0.40%) Financial Institution
15 2 (0.27%) Automotive
15 2 (0.27%) General Ledger
15 2 (0.27%) Military
15 2 (0.27%) Publishing
Job Titles
1 158 (20.95%) Developer
2 141 (18.70%) Data Engineer
3 130 (17.24%) Architect
4 83 (11.01%) Data Architect
5 76 (10.08%) Big Data Engineer
6 70 (9.28%) DevOps Engineer
7 43 (5.70%) Azure Engineer
8 38 (5.04%) AWS Engineer
9 36 (4.77%) Analyst
10 35 (4.64%) Data Scientist
11 34 (4.51%) Python Engineer
12 30 (3.98%) Big Data Developer
12 30 (3.98%) Cloud Engineer
13 29 (3.85%) Python Developer
13 29 (3.85%) Senior Developer
14 28 (3.71%) AWS DevOps
15 26 (3.45%) Azure Developer
15 26 (3.45%) Solutions Architect
16 25 (3.32%) Azure DevOps Engineer
16 25 (3.32%) Cloud Architect
Libraries, Frameworks & Software Standards
1 143 (18.97%) Kafka
2 43 (5.70%) Web Services
3 39 (5.17%) .NET
3 39 (5.17%) PySpark
4 35 (4.64%) HTML
5 27 (3.58%) HTML5
6 25 (3.32%) scikit-learn
7 24 (3.18%) TensorFlow
8 21 (2.79%) RESTful
9 20 (2.65%) JSON
9 20 (2.65%) REST
10 19 (2.52%) Akka
10 19 (2.52%) LAMP
10 19 (2.52%) NumPy
10 19 (2.52%) Pandas
10 19 (2.52%) Spring
11 17 (2.25%) Velocity
11 17 (2.25%) XML
12 16 (2.12%) CSS
12 16 (2.12%) Sensu
Miscellaneous
1 98 (13.00%) Analytical Skills
2 39 (5.17%) Greenfield Project
3 37 (4.91%) Algorithms
4 27 (3.58%) Data Structures
5 17 (2.25%) Cloud Native
5 17 (2.25%) Virtual Team
6 16 (2.12%) Data Centre
7 15 (1.99%) Linux Command Line
7 15 (1.99%) Public Cloud
8 14 (1.86%) Self-Motivation
9 13 (1.72%) FMCG
9 13 (1.72%) Foreign Exchange (FX)
10 11 (1.46%) Analytical Mindset
11 10 (1.33%) Credit Risk
11 10 (1.33%) Reference Data
11 10 (1.33%) User Experience
11 10 (1.33%) Video Conferencing
12 8 (1.06%) Renewable Energy
12 8 (1.06%) Smart City
13 6 (0.80%) Hybrid Cloud
Operating Systems
1 86 (11.41%) Linux
2 51 (6.76%) Unix
3 9 (1.19%) Windows
4 4 (0.53%) Solaris
5 3 (0.40%) Windows Server
6 2 (0.27%) Android
6 2 (0.27%) Apple iOS
7 1 (0.13%) Amazon Linux
7 1 (0.13%) CentOS
7 1 (0.13%) VMS
Processes & Methodologies
1 213 (28.25%) Agile Software Development
2 184 (24.40%) DevOps
3 181 (24.01%) Analytics
4 158 (20.95%) ETL
5 120 (15.92%) Data Modelling
5 120 (15.92%) Data Science
6 108 (14.32%) Business Intelligence
7 104 (13.79%) Machine Learning
8 90 (11.94%) Data Engineering
9 79 (10.48%) Scrum
10 74 (9.81%) Test Automation
11 70 (9.28%) Microservices
12 62 (8.22%) Computer Science
13 60 (7.96%) Data Architecture
13 60 (7.96%) Software Engineering
14 59 (7.82%) Visualisation
15 56 (7.43%) Data Analytics
16 54 (7.16%) Problem-Solving
17 51 (6.76%) Migration
18 50 (6.63%) Stakeholder Management
Programming Languages
1 308 (40.85%) Python
2 233 (30.90%) SQL
3 181 (24.01%) Java
4 95 (12.60%) Scala
5 48 (6.37%) Bash Shell
6 46 (6.10%) C#
7 42 (5.57%) R
8 31 (4.11%) C++
8 31 (4.11%) JavaScript
8 31 (4.11%) Shell Script
9 29 (3.85%) PowerShell
9 29 (3.85%) Ruby
10 13 (1.72%) Haskell
11 10 (1.33%) Go
11 10 (1.33%) Perl
12 8 (1.06%) Groovy
12 8 (1.06%) Java 8
13 5 (0.66%) C
14 4 (0.53%) PL/SQL
15 3 (0.40%) T-SQL
Qualifications
1 133 (17.64%) Security Cleared
2 114 (15.12%) SC Cleared
3 71 (9.42%) Degree
4 30 (3.98%) Master's Degree
5 21 (2.79%) Computer Science Degree
6 19 (2.52%) DV Cleared
6 19 (2.52%) Numerate Degree
7 14 (1.86%) CCA
8 12 (1.59%) TOGAF Certification
9 9 (1.19%) AWS Certification
9 9 (1.19%) Microsoft Certification
10 6 (0.80%) PhD
11 4 (0.53%) CISSP
12 2 (0.27%) CISM
13 1 (0.13%) BPSS Clearance
13 1 (0.13%) CGEIT
13 1 (0.13%) CISA
13 1 (0.13%) DBS Check
13 1 (0.13%) ISEB
13 1 (0.13%) Postgraduate
Quality Assurance & Compliance
1 43 (5.70%) QA
2 35 (4.64%) Data Quality
3 10 (1.33%) MiFID
3 10 (1.33%) SLA
4 8 (1.06%) PCI DSS
5 5 (0.66%) GxP
6 3 (0.40%) GDPR
7 2 (0.27%) ISO/IEC 20000
7 2 (0.27%) Sarbanes-Oxley
7 2 (0.27%) Section 508
7 2 (0.27%) WAI
8 1 (0.13%) CDISC
8 1 (0.13%) Government Security Classifications
8 1 (0.13%) IFRS
8 1 (0.13%) ISO/IEC 27001
8 1 (0.13%) Solvency II
System Software
1 133 (17.64%) Docker
2 52 (6.90%) HDFS
3 20 (2.65%) Apache ZooKeeper
4 10 (1.33%) Active Directory
4 10 (1.33%) Apache Flume
5 3 (0.40%) Active Directory Lightweight Directory Services
5 3 (0.40%) Virtual Machines
5 3 (0.40%) VMware Infrastructure
Systems Management
1 97 (12.86%) Kubernetes
2 87 (11.54%) Terraform
3 78 (10.34%) Ansible
4 28 (3.71%) Puppet
5 22 (2.92%) Opscode Chef
6 20 (2.65%) Nagios
7 13 (1.72%) Packer
8 10 (1.33%) Hadoop YARN
9 7 (0.93%) Oozie
10 6 (0.80%) Kibana
11 2 (0.27%) Argo
11 2 (0.27%) Kubeflow
11 2 (0.27%) logstash
12 1 (0.13%) Ambari
12 1 (0.13%) Docker Swarm
12 1 (0.13%) Istio
12 1 (0.13%) Knative
Vendors
1 111 (14.72%) Cloudera
2 76 (10.08%) Databricks
3 74 (9.81%) Microsoft
4 72 (9.55%) Oracle
5 46 (6.10%) Hortonworks
6 41 (5.44%) Google
7 32 (4.24%) StreamSets
8 28 (3.71%) Teradata
9 26 (3.45%) Splunk
10 23 (3.05%) Informatica
11 22 (2.92%) SAP
12 19 (2.52%) Talend
13 18 (2.39%) Ab Initio
13 18 (2.39%) IBM
14 10 (1.33%) Sparx
15 9 (1.19%) NetApp
16 8 (1.06%) Cisco
17 7 (0.93%) Dell
18 6 (0.80%) TIBCO
19 5 (0.66%) VMware
352 Big Data job vacancies Nationwide