Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 5 April 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 5 April 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
5 Apr 2020		 Same period 2019 Same period 2018
Rank 92 80 83
Rank change year-on-year -12 +3 +1
Contract jobs citing Big Data 1,381 2,758 2,777
As % of all contract jobs advertised in England 2.49% 3.11% 2.98%
As % of the Database & Business Intelligence category 11.81% 13.84% 13.33%
Number of daily rates quoted 996 1,961 1,924
Median daily rate £550 £550 £550
10th Percentile £404 £413 £400
90th Percentile £725 £713 £675
UK median daily rate £550 £550 £543
% change year-on-year - +1.38% +3.33%
Number of hourly rates quoted 5 7 9
Median hourly rate £35.00 £45.00 £30.50
Median hourly rate % change year-on-year -22.22% +47.54% -31.46%
UK median hourly rate £35.00 £45.00 £30.50
% change year-on-year -22.22% +47.54% -31.46%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 11,696 19,932 20,833
As % of all contract IT jobs advertised in England 21.10% 22.49% 22.32%
Number of daily rates quoted 7,759 13,846 14,559
Median daily rate £488 £488 £475
Median daily rate % change year-on-year - +2.63% +5.56%
10th Percentile £325 £325 £313
90th Percentile £675 £650 £637
UK median daily rate £475 £475 £470
% change year-on-year - +1.06% +7.43%
Number of hourly rates quoted 209 225 226
Median hourly rate £35.00 £35.00 £32.50
Median hourly rate % change year-on-year - +7.69% +18.18%
10th Percentile £14.95 £14.70 £14.57
90th Percentile £55.60 £57.50 £53.63
Median hourly rate £35.00 £35.00 £33.00
% change year-on-year - +6.06% +20.00%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 5 April 2020.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 5 April 2020.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 5 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -7 811 £575 +4.55% 219
South East -13 200 £500 - 85
North of England +18 196 £558 +1.36% 47
North West +27 113 £563 -6.25% 29
South West -15 81 £563 +4.65% 27
Yorkshire +5 64 £525 +10.53% 12
Midlands +16 45 £525 +2.64% 22
East of England -1 40 £438 -19.72% 35
West Midlands +39 33 £488 -18.75% 14
North East +23 17 £688 +34.15% 6
East Midlands +1 11 £550 +22.22% 8
Big Data
UK

For the 6 months to 5 April 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 521 (37.73%) Python
2 487 (35.26%) Agile Software Development
3 449 (32.51%) AWS
4 431 (31.21%) Apache Spark
5 428 (30.99%) Hadoop
6 425 (30.77%) SQL
7 396 (28.67%) Analytics
8 373 (27.01%) Azure
9 318 (23.03%) Java
10 315 (22.81%) DevOps
11 258 (18.68%) Finance
12 249 (18.03%) Data Science
13 240 (17.38%) Machine Learning
14 228 (16.51%) Data Modelling
15 226 (16.36%) GCP
16 221 (16.00%) Data Warehouse
17 218 (15.79%) Kafka
18 211 (15.28%) Docker
19 205 (14.84%) NoSQL
20 204 (14.77%) Kubernetes
21 201 (14.55%) Business Intelligence
22 195 (14.12%) Scala
23 192 (13.90%) ETL
24 170 (12.31%) Apache Hive
25 165 (11.95%) Analytical Skills
26 162 (11.73%) Data Lake
27 158 (11.44%) Jenkins
27 158 (11.44%) Linux
28 145 (10.50%) Microsoft
29 143 (10.35%) Security Cleared

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 431 (31.21%) Apache Spark
2 105 (7.60%) Apache
3 38 (2.75%) Apache Airflow
4 36 (2.61%) Elasticsearch
5 29 (2.10%) Confluence
6 27 (1.96%) SAS
7 15 (1.09%) Apache Pig
8 12 (0.87%) Jupyter
8 12 (0.87%) OpenStack
9 11 (0.80%) Tomcat
10 6 (0.43%) DNN
10 6 (0.43%) Luigi
10 6 (0.43%) WebSphere
11 5 (0.36%) SharePoint
12 4 (0.29%) nginx
13 3 (0.22%) ArcGIS
13 3 (0.22%) Oracle Workflow
13 3 (0.22%) WebLogic
14 2 (0.14%) IBM Domino
14 2 (0.14%) Tornado
Applications
1 23 (1.67%) Microsoft Excel
2 7 (0.51%) Spreadsheet
3 6 (0.43%) Microsoft Project
4 5 (0.36%) MS Visio
5 4 (0.29%) SPSS
6 3 (0.22%) Microsoft Office
6 3 (0.22%) Microsoft PowerPoint
6 3 (0.22%) Stata
7 1 (0.072%) Chatbot
7 1 (0.072%) Maya
Business Applications
1 8 (0.58%) SAP ERP
2 6 (0.43%) Dynamics CRM
2 6 (0.43%) SAP Oil and Gas
3 5 (0.36%) Oracle EBS
3 5 (0.36%) SAP CRM
3 5 (0.36%) SAP IS-U
4 4 (0.29%) Distributed Ledger
4 4 (0.29%) Sparx Enterprise Architect
5 3 (0.22%) Oracle Payroll
6 2 (0.14%) Aligne
6 2 (0.14%) NetSuite
6 2 (0.14%) Oracle Applications
7 1 (0.072%) FINCAD Analytics
7 1 (0.072%) Markit EDM
7 1 (0.072%) PolarLake
7 1 (0.072%) SAP LE
7 1 (0.072%) SAP MDM
7 1 (0.072%) Shopify
Cloud Services
1 449 (32.51%) AWS
2 373 (27.01%) Azure
3 226 (16.36%) GCP
4 105 (7.60%) Power Platform
5 61 (4.42%) Amazon S3
6 60 (4.34%) Serverless
7 51 (3.69%) AWS Lambda
8 49 (3.55%) Amazon EMR
9 48 (3.48%) Amazon Kinesis
10 38 (2.75%) GitHub
11 37 (2.68%) Amazon EC2
12 28 (2.03%) Amazon CloudWatch
12 28 (2.03%) Azure Data Factory
12 28 (2.03%) Cloud Computing
13 27 (1.96%) AWS CloudFormation
14 26 (1.88%) SaaS
15 20 (1.45%) OpenShift
16 15 (1.09%) Amazon Cognito
16 15 (1.09%) PaaS
17 14 (1.01%) Virtual Private Cloud
Communications & Networking
1 27 (1.96%) Kerberos
2 18 (1.30%) DNS
3 15 (1.09%) 5G
4 13 (0.94%) Firewall
4 13 (0.94%) Internet
5 12 (0.87%) SSL
6 11 (0.80%) 4G
6 11 (0.80%) HTTP
7 10 (0.72%) 3G
8 8 (0.58%) RTMP
8 8 (0.58%) TCP/IP
9 6 (0.43%) Network Security
9 6 (0.43%) VPN
10 5 (0.36%) HTTPS
10 5 (0.36%) MQTT
11 4 (0.29%) PuTTY
12 3 (0.22%) DHCP
12 3 (0.22%) Intranet
12 3 (0.22%) Software-Defined Networking
12 3 (0.22%) WAN
Database & Business Intelligence
1 428 (30.99%) Hadoop
2 221 (16.00%) Data Warehouse
3 205 (14.84%) NoSQL
4 170 (12.31%) Apache Hive
5 162 (11.73%) Data Lake
6 120 (8.69%) SQL Server
7 99 (7.17%) HBase
7 99 (7.17%) Power BI
8 93 (6.73%) Relational Database
9 90 (6.52%) MongoDB
10 67 (4.85%) Apache Cassandra
11 59 (4.27%) Amazon Redshift
12 49 (3.55%) Amazon Athena
13 48 (3.48%) PostgreSQL
13 48 (3.48%) SQL Server Integration Services
14 46 (3.33%) BigQuery
14 46 (3.33%) Impala
15 39 (2.82%) Flink
16 33 (2.39%) Data Mining
17 27 (1.96%) Amazon DynamoDB
Development Applications
1 158 (11.44%) Jenkins
2 130 (9.41%) Git (software)
3 70 (5.07%) JIRA
4 50 (3.62%) GitLab
5 49 (3.55%) Maven
6 25 (1.81%) Selenium
7 22 (1.59%) Bitbucket
8 20 (1.45%) Sonatype Nexus
9 18 (1.30%) Artifactory
10 16 (1.16%) IBM UrbanCode
10 16 (1.16%) Team Foundation Server
11 14 (1.01%) ERwin
12 13 (0.94%) JUnit
12 13 (0.94%) Visual Studio
12 13 (0.94%) Visual Studio Team System
13 12 (0.87%) SonarQube
14 11 (0.80%) CircleCI
14 11 (0.80%) Cucumber
15 10 (0.72%) Atlassian Bamboo
15 10 (0.72%) Gradle
General
1 258 (18.68%) Finance
2 104 (7.53%) Banking
3 90 (6.52%) Public Sector
4 69 (5.00%) Retail
5 61 (4.42%) Telecoms
6 43 (3.11%) Marketing
7 31 (2.24%) Manufacturing
8 30 (2.17%) Investment Banking
9 27 (1.96%) Front Office
10 23 (1.67%) Legal
11 12 (0.87%) Billing
12 11 (0.80%) Pharmaceutical
13 9 (0.65%) Games
14 8 (0.58%) Financial Institution
15 4 (0.29%) Music Industry
15 4 (0.29%) Retail Banking
16 3 (0.22%) Advertising
16 3 (0.22%) Automotive
16 3 (0.22%) Law
16 3 (0.22%) Publishing
Job Titles
1 283 (20.49%) Data Engineer
2 250 (18.10%) Developer
3 221 (16.00%) Architect
4 148 (10.72%) Big Data Engineer
5 125 (9.05%) Data Architect
6 116 (8.40%) Data Scientist
7 107 (7.75%) Analyst
8 87 (6.30%) DevOps Engineer
9 72 (5.21%) AWS Engineer
10 58 (4.20%) Java Developer
11 49 (3.55%) Consultant
11 49 (3.55%) Python Engineer
12 46 (3.33%) Big Data Architect
13 41 (2.97%) Big Data Developer
14 40 (2.90%) Senior Data Scientist
15 39 (2.82%) Cloud Engineer
16 36 (2.61%) Data Analyst
16 36 (2.61%) Software Engineer
17 34 (2.46%) Senior Developer
17 34 (2.46%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 218 (15.79%) Kafka
2 100 (7.24%) Web Services
3 88 (6.37%) PySpark
4 67 (4.85%) TensorFlow
5 55 (3.98%) Node.js
6 54 (3.91%) .NET
6 54 (3.91%) REST
7 48 (3.48%) React
8 45 (3.26%) Pandas
8 45 (3.26%) Spring
9 40 (2.90%) RESTful
10 39 (2.82%) HTML
11 38 (2.75%) XML
12 37 (2.68%) Natural Language Processing
13 32 (2.32%) JSON
14 29 (2.10%) SciPy
15 27 (1.96%) AngularJS
15 27 (1.96%) MLlib
15 27 (1.96%) scikit-learn
16 26 (1.88%) NumPy
Miscellaneous
1 165 (11.95%) Analytical Skills
2 88 (6.37%) Algorithms
3 56 (4.06%) Greenfield Project
4 42 (3.04%) Data Structures
5 36 (2.61%) Public Cloud
6 35 (2.53%) Management Information System
7 34 (2.46%) User Experience
8 31 (2.24%) Self-Motivation
9 18 (1.30%) Credit Risk
10 17 (1.23%) Data Centre
11 15 (1.09%) Enterprise Software
12 13 (0.94%) Cloud Native
12 13 (0.94%) Social Media
13 12 (0.87%) Hybrid Cloud
14 10 (0.72%) Clustering
14 10 (0.72%) Foreign Exchange (FX)
15 9 (0.65%) Hedge funds
15 9 (0.65%) Mainframe
16 8 (0.58%) Mobile App
17 7 (0.51%) Internet of Things
Operating Systems
1 158 (11.44%) Linux
2 62 (4.49%) Unix
3 24 (1.74%) Windows
4 15 (1.09%) Red Hat Enterprise Linux
5 14 (1.01%) CentOS
5 14 (1.01%) VMS
6 10 (0.72%) Ubuntu
7 9 (0.65%) Debian
8 5 (0.36%) Windows Server
9 3 (0.22%) Android
9 3 (0.22%) Apple iOS
10 2 (0.14%) Embedded Linux
10 2 (0.14%) Fedora
10 2 (0.14%) Mac OS X
10 2 (0.14%) Windows Server 2016
11 1 (0.072%) AIX
11 1 (0.072%) DC/OS
11 1 (0.072%) Solaris
11 1 (0.072%) VME
11 1 (0.072%) Windows 10
Processes & Methodologies
1 487 (35.26%) Agile Software Development
2 396 (28.67%) Analytics
3 315 (22.81%) DevOps
4 249 (18.03%) Data Science
5 240 (17.38%) Machine Learning
6 228 (16.51%) Data Modelling
7 201 (14.55%) Business Intelligence
8 192 (13.90%) ETL
9 139 (10.07%) Artificial Intelligence
10 135 (9.78%) Scrum
11 128 (9.27%) Microservices
12 121 (8.76%) Data Analytics
12 121 (8.76%) Software Engineering
13 117 (8.47%) Data Architecture
14 115 (8.33%) Continuous Integration
15 114 (8.25%) Data Engineering
16 111 (8.04%) Computer Science
17 105 (7.60%) Visualisation
18 97 (7.02%) Stakeholder Management
19 95 (6.88%) Use Case
Programming Languages
1 521 (37.73%) Python
2 425 (30.77%) SQL
3 318 (23.03%) Java
4 195 (14.12%) Scala
5 104 (7.53%) C#
6 93 (6.73%) JavaScript
7 60 (4.34%) R
8 51 (3.69%) Bash Shell
9 42 (3.04%) C
10 41 (2.97%) Go
11 38 (2.75%) PowerShell
12 35 (2.53%) Shell Script
13 33 (2.39%) Ruby
14 29 (2.10%) C++
15 25 (1.81%) PL/SQL
16 21 (1.52%) Java 8
17 19 (1.38%) T-SQL
18 16 (1.16%) Groovy
18 16 (1.16%) Perl
19 15 (1.09%) TypeScript
Qualifications
1 143 (10.35%) Security Cleared
2 135 (9.78%) Degree
3 83 (6.01%) SC Cleared
4 48 (3.48%) Computer Science Degree
4 48 (3.48%) DV Cleared
5 24 (1.74%) AWS Certification
5 24 (1.74%) PhD
6 23 (1.67%) Master's Degree
7 18 (1.30%) CCA
8 10 (0.72%) Microsoft Certification
9 9 (0.65%) CISSP
9 9 (0.65%) PMI Certification
10 8 (0.58%) Cisco Certification
10 8 (0.58%) Numerate Degree
11 7 (0.51%) CCNA
12 6 (0.43%) BPSS Clearance
12 6 (0.43%) ISEB
13 4 (0.29%) CESG Certified Professional
13 4 (0.29%) CompTIA Security+
13 4 (0.29%) SANS
Quality Assurance & Compliance
1 37 (2.68%) QA
2 32 (2.32%) Data Quality
3 9 (0.65%) GDPR
4 7 (0.51%) PCI DSS
5 4 (0.29%) Basel III
5 4 (0.29%) PMO
6 3 (0.22%) MiFID
7 2 (0.14%) IFRS
8 1 (0.072%) COBIT
8 1 (0.072%) IFRS 9
8 1 (0.072%) ISO/IEC 27001
8 1 (0.072%) Sarbanes-Oxley
8 1 (0.072%) SLA
System Software
1 211 (15.28%) Docker
2 78 (5.65%) HDFS
3 15 (1.09%) Active Directory
4 12 (0.87%) Apache Flume
5 6 (0.43%) VMware ESXi
6 5 (0.36%) Apache ZooKeeper
6 5 (0.36%) VMware Infrastructure
7 4 (0.29%) vSphere
8 3 (0.22%) Virtual Machines
9 2 (0.14%) BusyBox
9 2 (0.14%) NFS
9 2 (0.14%) Samba
9 2 (0.14%) VirtualBox
9 2 (0.14%) Xen
10 1 (0.072%) Hyper-V
10 1 (0.072%) Oracle Clusterware
10 1 (0.072%) Oracle RAC
Systems Management
1 204 (14.77%) Kubernetes
2 137 (9.92%) Terraform
3 106 (7.68%) Ansible
4 52 (3.77%) Hadoop YARN
5 40 (2.90%) Puppet
6 24 (1.74%) Oozie
7 18 (1.30%) Opscode Chef
8 16 (1.16%) Kibana
9 13 (0.94%) logstash
10 12 (0.87%) ITRS Geneos
10 12 (0.87%) Nagios
11 11 (0.80%) Packer
12 10 (0.72%) Grafana
13 9 (0.65%) Ambari
14 6 (0.43%) Single Sign-On
15 5 (0.36%) CFEngine
15 5 (0.36%) HP SiteScope
15 5 (0.36%) Prometheus
15 5 (0.36%) SCCM
16 4 (0.29%) Docker Swarm
Vendors
1 145 (10.50%) Microsoft
2 134 (9.70%) Cloudera
3 121 (8.76%) Google
4 80 (5.79%) Tableau
5 78 (5.65%) Hortonworks
6 70 (5.07%) Oracle
7 52 (3.77%) Databricks
8 49 (3.55%) Informatica
9 44 (3.19%) SAP
10 38 (2.75%) Talend
11 31 (2.24%) Splunk
12 26 (1.88%) MapR
13 17 (1.23%) StreamSets
14 13 (0.94%) Ab Initio
14 13 (0.94%) Red Hat
15 11 (0.80%) IBM
16 10 (0.72%) Atlassian
16 10 (0.72%) Teradata
17 8 (0.58%) Palantir
17 8 (0.58%) VMware