Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 19 February 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 February 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
19 Feb 2020		 Same period 2019 Same period 2018
Rank 90 87 90
Rank change year-on-year -3 +3 -3
Contract jobs citing Big Data 1,583 2,570 2,590
As % of all contract IT jobs advertised in England 2.54% 2.83% 2.80%
As % of the Database & Business Intelligence category 11.82% 12.58% 12.82%
Number of daily rates quoted 1,106 1,818 1,770
England median daily rate £550 £550 £550
10th Percentile £400 £413 £400
90th Percentile £725 £713 £675
UK median daily rate £550 £550 £538
% change year-on-year - +2.33% +2.38%
Number of hourly rates quoted 2 9 13
England median hourly rate £45.50 £45.00 £31.31
Median hourly rate % change year-on-year +1.11% +43.72% -30.42%
10th Percentile £39.10 £32.50 £19.34
90th Percentile £52.30 £58.00 £67.12
UK median hourly rate £45.50 £45.00 £31.31
% change year-on-year +1.11% +43.72% -30.42%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 13,387 20,425 20,198
As % of all contract IT jobs advertised in England 21.45% 22.48% 21.84%
Number of daily rates quoted 8,971 14,200 14,229
England median daily rate £488 £488 £475
Median daily rate % change year-on-year - +2.63% +8.57%
10th Percentile £323 £325 £313
90th Percentile £675 £650 £635
UK median daily rate £475 £475 £463
% change year-on-year - +2.70% +8.82%
Number of hourly rates quoted 218 228 227
England median hourly rate £31.25 £35.00 £35.00
Median hourly rate % change year-on-year -10.71% - +34.90%
10th Percentile £14.00 £14.00 £15.25
90th Percentile £58.10 £56.40 £58.00
UK median hourly rate £31.00 £34.00 £34.25
% change year-on-year -8.82% -0.73% +29.25%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in England.

Contractor daily rate trend for Big Data in England

Big Data
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data in England over the 6 months to 19 February 2020.

Contractor daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in England.

Contractor hourly rate trend for Big Data in England

Big Data
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Big Data in England over the 6 months to 19 February 2020.

Contractor hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 19 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London +1 934 £575 +4.55% 317
South East -14 233 £476 -7.07% 112
North of England +36 187 £550 - 57
North West +53 118 £550 -8.33% 29
South West +6 115 £554 +10.70% 34
Midlands +20 54 £450 -9.00% 30
East of England +12 54 £525 - 26
Yorkshire +17 51 £513 +7.89% 17
West Midlands +43 42 £450 -14.29% 21
North East +20 19 £675 +28.57% 13
East Midlands -1 12 £513 +13.89% 9
Big Data
UK

For the 6 months to 19 February 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 590 (37.27%) Python
2 548 (34.62%) Hadoop
3 546 (34.49%) Agile Software Development
4 525 (33.16%) Apache Spark
5 490 (30.95%) AWS
6 489 (30.89%) SQL
7 452 (28.55%) Analytics
8 436 (27.54%) Azure
9 394 (24.89%) Java
10 328 (20.72%) Finance
11 327 (20.66%) DevOps
12 268 (16.93%) Kafka
13 258 (16.30%) Data Warehouse
14 247 (15.60%) Data Science
15 246 (15.54%) ETL
16 243 (15.35%) Data Modelling
17 238 (15.03%) Scala
18 237 (14.97%) Machine Learning
19 229 (14.47%) GCP
20 227 (14.34%) Business Intelligence
21 219 (13.83%) Apache Hive
22 215 (13.58%) Docker
23 211 (13.33%) Linux
24 210 (13.27%) Kubernetes
25 204 (12.89%) Data Lake
26 203 (12.82%) NoSQL
27 192 (12.13%) Jenkins
28 183 (11.56%) Cloudera
29 178 (11.24%) Analytical Skills
29 178 (11.24%) Microsoft

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 525 (33.16%) Apache Spark
2 118 (7.45%) Apache
3 42 (2.65%) Apache Airflow
4 40 (2.53%) SAS
5 38 (2.40%) Elasticsearch
6 24 (1.52%) Confluence
7 19 (1.20%) Jupyter
8 16 (1.01%) Apache Pig
9 15 (0.95%) Tomcat
10 13 (0.82%) OpenStack
11 8 (0.51%) SharePoint
12 6 (0.38%) DNN
12 6 (0.38%) Luigi
12 6 (0.38%) WebLogic
12 6 (0.38%) WebSphere
13 5 (0.32%) JBoss
14 3 (0.19%) ArcGIS
14 3 (0.19%) IBM Domino
14 3 (0.19%) Oracle HTTP Server
14 3 (0.19%) Oracle Workflow
Applications
1 37 (2.34%) Microsoft Excel
2 10 (0.63%) Microsoft Project
3 8 (0.51%) MS Visio
4 6 (0.38%) Microsoft PowerPoint
5 5 (0.32%) Spreadsheet
5 5 (0.32%) SPSS
6 4 (0.25%) Microsoft Office
7 2 (0.13%) Stata
8 1 (0.063%) Chatbot
8 1 (0.063%) Maya
Business Applications
1 10 (0.63%) Dynamics CRM
2 7 (0.44%) SAP ERP
3 5 (0.32%) SAP Oil and Gas
4 4 (0.25%) FINCAD Analytics
4 4 (0.25%) SAP CRM
4 4 (0.25%) SAP IS-U
5 3 (0.19%) Distributed Ledger
5 3 (0.19%) Oracle BPM
5 3 (0.19%) Oracle EBS
5 3 (0.19%) Sparx Enterprise Architect
6 2 (0.13%) Adobe Campaign
6 2 (0.13%) Aligne
6 2 (0.13%) NetSuite
6 2 (0.13%) Oracle Applications
6 2 (0.13%) Oracle Payroll
7 1 (0.063%) Markit EDM
7 1 (0.063%) PolarLake
7 1 (0.063%) SAP LE
7 1 (0.063%) SAP MDM
7 1 (0.063%) SAP Retail
Cloud Services
1 490 (30.95%) AWS
2 436 (27.54%) Azure
3 229 (14.47%) GCP
4 130 (8.21%) Power Platform
5 57 (3.60%) Amazon Kinesis
6 56 (3.54%) Amazon EMR
7 54 (3.41%) Serverless
8 52 (3.28%) Amazon S3
9 48 (3.03%) GitHub
10 44 (2.78%) AWS Lambda
11 32 (2.02%) OpenShift
12 31 (1.96%) Azure Data Factory
12 31 (1.96%) Cloud Computing
13 29 (1.83%) Data Lake Analytics
14 27 (1.71%) Amazon EC2
15 25 (1.58%) AWS CloudFormation
16 20 (1.26%) SaaS
17 17 (1.07%) Amazon CloudWatch
18 16 (1.01%) IaaS
18 16 (1.01%) PaaS
Communications & Networking
1 39 (2.46%) Kerberos
2 22 (1.39%) DNS
3 17 (1.07%) SSL
4 16 (1.01%) Firewall
5 15 (0.95%) Internet
6 12 (0.76%) HTTP
7 9 (0.57%) TCP/IP
8 8 (0.51%) Network Security
9 7 (0.44%) 5G
9 7 (0.44%) VPN
10 6 (0.38%) 3G
10 6 (0.38%) 4G
11 5 (0.32%) PuTTY
11 5 (0.32%) Software-Defined Networking
11 5 (0.32%) Wi-Fi
11 5 (0.32%) Wireshark
12 4 (0.25%) HTTPS
12 4 (0.25%) MQTT
12 4 (0.25%) SAN
12 4 (0.25%) SSH
Database & Business Intelligence
1 548 (34.62%) Hadoop
2 258 (16.30%) Data Warehouse
3 219 (13.83%) Apache Hive
4 204 (12.89%) Data Lake
5 203 (12.82%) NoSQL
6 130 (8.21%) SQL Server
7 125 (7.90%) Power BI
8 107 (6.76%) HBase
9 97 (6.13%) Relational Database
10 92 (5.81%) MongoDB
11 85 (5.37%) Impala
12 81 (5.12%) Amazon Redshift
13 67 (4.23%) PostgreSQL
14 62 (3.92%) Apache Cassandra
15 59 (3.73%) SQL Server Integration Services
16 56 (3.54%) Amazon Athena
17 47 (2.97%) MySQL
18 42 (2.65%) BigQuery
19 40 (2.53%) Spark SQL
20 38 (2.40%) Flink
Development Applications
1 192 (12.13%) Jenkins
2 137 (8.65%) Git (software)
3 77 (4.86%) JIRA
4 50 (3.16%) Maven
5 35 (2.21%) Selenium
6 32 (2.02%) Visual Studio
6 32 (2.02%) Visual Studio Team System
7 30 (1.90%) GitLab
8 25 (1.58%) Team Foundation Server
9 24 (1.52%) Artifactory
10 22 (1.39%) Sonatype Nexus
11 21 (1.33%) Cucumber
12 17 (1.07%) Atlassian Bamboo
12 17 (1.07%) IBM UrbanCode
13 13 (0.82%) SonarQube
14 12 (0.76%) ERwin
14 12 (0.76%) Mercurial
14 12 (0.76%) TeamCity
15 10 (0.63%) JUnit
16 9 (0.57%) IntelliJ
General
1 328 (20.72%) Finance
2 115 (7.26%) Banking
3 101 (6.38%) Public Sector
4 90 (5.69%) Retail
5 67 (4.23%) Telecoms
6 45 (2.84%) Manufacturing
7 44 (2.78%) Marketing
8 34 (2.15%) Front Office
9 25 (1.58%) Investment Banking
10 22 (1.39%) Legal
11 10 (0.63%) Pharmaceutical
12 9 (0.57%) Advertising
12 9 (0.57%) Financial Institution
12 9 (0.57%) Games
13 8 (0.51%) Billing
14 4 (0.25%) Music Industry
14 4 (0.25%) Retail Banking
15 3 (0.19%) Automotive
16 2 (0.13%) Aerospace
16 2 (0.13%) Law
Job Titles
1 338 (21.35%) Data Engineer
2 288 (18.19%) Developer
3 253 (15.98%) Architect
4 183 (11.56%) Big Data Engineer
5 141 (8.91%) Analyst
6 133 (8.40%) Data Architect
7 109 (6.89%) Data Scientist
8 87 (5.50%) DevOps Engineer
9 74 (4.67%) Java Developer
10 73 (4.61%) Python Engineer
11 68 (4.30%) AWS Engineer
12 64 (4.04%) Python Developer
13 57 (3.60%) Big Data Architect
14 56 (3.54%) Big Data Developer
15 54 (3.41%) Software Engineer
16 52 (3.28%) Consultant
17 51 (3.22%) Business Analyst
18 48 (3.03%) Cloud Engineer
19 45 (2.84%) Solutions Architect
20 43 (2.72%) Senior Developer
Libraries, Frameworks & Software Standards
1 268 (16.93%) Kafka
2 101 (6.38%) Web Services
3 80 (5.05%) PySpark
4 59 (3.73%) .NET
5 57 (3.60%) REST
6 52 (3.28%) JSON
6 52 (3.28%) TensorFlow
7 49 (3.10%) Spring
8 48 (3.03%) XML
9 47 (2.97%) React
10 45 (2.84%) Pandas
11 39 (2.46%) Node.js
12 38 (2.40%) RESTful
13 35 (2.21%) Natural Language Processing
14 34 (2.15%) scikit-learn
15 31 (1.96%) NumPy
16 30 (1.90%) HTML
17 28 (1.77%) Apache NiFi
18 25 (1.58%) Spark Streaming
19 24 (1.52%) SciPy
Miscellaneous
1 178 (11.24%) Analytical Skills
2 100 (6.32%) Algorithms
3 70 (4.42%) Greenfield Project
4 49 (3.10%) Data Structures
5 39 (2.46%) Public Cloud
6 38 (2.40%) User Experience
7 33 (2.08%) Management Information System
8 31 (1.96%) Self-Motivation
9 19 (1.20%) Data Centre
10 14 (0.88%) Clustering
10 14 (0.88%) Credit Risk
10 14 (0.88%) Linux Command Line
11 13 (0.82%) Cloud Native
11 13 (0.82%) Hybrid Cloud
11 13 (0.82%) PKI
12 12 (0.76%) Social Media
13 11 (0.69%) Mainframe
14 10 (0.63%) Hedge funds
15 9 (0.57%) Derivative
15 9 (0.57%) Fixed Income
Operating Systems
1 211 (13.33%) Linux
2 73 (4.61%) Unix
3 39 (2.46%) Windows
4 34 (2.15%) Red Hat Enterprise Linux
5 24 (1.52%) CentOS
6 14 (0.88%) Windows Server
7 12 (0.76%) Ubuntu
8 9 (0.57%) Debian
9 8 (0.51%) VMS
10 6 (0.38%) Solaris
11 5 (0.32%) Android
11 5 (0.32%) Apple iOS
12 4 (0.25%) Windows 10
13 3 (0.19%) Mac OS X
14 2 (0.13%) AIX
14 2 (0.13%) Embedded Linux
14 2 (0.13%) Fedora
14 2 (0.13%) Windows Server 2012
15 1 (0.063%) DC/OS
15 1 (0.063%) VME
Processes & Methodologies
1 546 (34.49%) Agile Software Development
2 452 (28.55%) Analytics
3 327 (20.66%) DevOps
4 247 (15.60%) Data Science
5 246 (15.54%) ETL
6 243 (15.35%) Data Modelling
7 237 (14.97%) Machine Learning
8 227 (14.34%) Business Intelligence
9 159 (10.04%) Data Engineering
10 158 (9.98%) Scrum
11 151 (9.54%) Data Analytics
12 143 (9.03%) Software Engineering
13 142 (8.97%) Continuous Integration
14 139 (8.78%) Computer Science
15 138 (8.72%) Microservices
16 135 (8.53%) Artificial Intelligence
17 124 (7.83%) Migration
18 122 (7.71%) Visualisation
19 119 (7.52%) Data Architecture
20 115 (7.26%) Stakeholder Management
Programming Languages
1 590 (37.27%) Python
2 489 (30.89%) SQL
3 394 (24.89%) Java
4 238 (15.03%) Scala
5 102 (6.44%) C#
6 82 (5.18%) R
7 78 (4.93%) JavaScript
8 58 (3.66%) PowerShell
9 57 (3.60%) Bash Shell
10 47 (2.97%) C
11 42 (2.65%) Shell Script
12 39 (2.46%) C++
13 28 (1.77%) Ruby
14 24 (1.52%) Go
14 24 (1.52%) PL/SQL
15 21 (1.33%) Java 8
16 16 (1.01%) Groovy
17 15 (0.95%) T-SQL
18 14 (0.88%) Perl
19 13 (0.82%) PHP
Qualifications
1 154 (9.73%) Security Cleared
2 146 (9.22%) Degree
3 85 (5.37%) SC Cleared
4 58 (3.66%) Computer Science Degree
5 52 (3.28%) DV Cleared
6 30 (1.90%) PhD
7 25 (1.58%) Master's Degree
8 20 (1.26%) AWS Certification
9 13 (0.82%) CCA
10 10 (0.63%) Cisco Certification
11 9 (0.57%) Microsoft Certification
12 8 (0.51%) CISSP
12 8 (0.51%) ISEB
12 8 (0.51%) Numerate Degree
13 6 (0.38%) BPSS Clearance
13 6 (0.38%) CCNA
14 5 (0.32%) GIAC
14 5 (0.32%) PMI Certification
14 5 (0.32%) SANS
15 4 (0.25%) CompTIA Security+
Quality Assurance & Compliance
1 55 (3.47%) QA
2 37 (2.34%) Data Quality
3 14 (0.88%) GDPR
4 11 (0.69%) PCI DSS
5 9 (0.57%) PMO
6 3 (0.19%) COBIT
6 3 (0.19%) Sarbanes-Oxley
7 2 (0.13%) Basel III
7 2 (0.13%) Disclosure Scotland
7 2 (0.13%) IFRS
7 2 (0.13%) ISO 9000
7 2 (0.13%) ISO/IEC 27001
7 2 (0.13%) MiFID
8 1 (0.063%) GLBA
8 1 (0.063%) HIPAA
8 1 (0.063%) IFRS 9
8 1 (0.063%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
8 1 (0.063%) NIST
8 1 (0.063%) SLA
System Software
1 215 (13.58%) Docker
2 96 (6.06%) HDFS
3 28 (1.77%) Active Directory
4 12 (0.76%) Apache Flume
5 7 (0.44%) Virtual Desktop
6 6 (0.38%) Apache ZooKeeper
6 6 (0.38%) VMware ESXi
6 6 (0.38%) VMware Infrastructure
7 5 (0.32%) vSphere
8 4 (0.25%) Virtual Servers
9 3 (0.19%) Microsoft App-V
9 3 (0.19%) NFS
9 3 (0.19%) Virtual Machines
9 3 (0.19%) XenApp
9 3 (0.19%) XenDesktop
10 2 (0.13%) BusyBox
10 2 (0.13%) Hyper-V
10 2 (0.13%) Samba
10 2 (0.13%) VirtualBox
10 2 (0.13%) Xen
Systems Management
1 210 (13.27%) Kubernetes
2 140 (8.84%) Terraform
3 136 (8.59%) Ansible
4 67 (4.23%) Hadoop YARN
5 44 (2.78%) Puppet
6 26 (1.64%) Oozie
7 18 (1.14%) Opscode Chef
8 17 (1.07%) Kibana
9 16 (1.01%) Nagios
10 14 (0.88%) Packer
11 13 (0.82%) logstash
12 11 (0.69%) ITRS Geneos
13 8 (0.51%) Prometheus
13 8 (0.51%) SCCM
14 7 (0.44%) Ambari
14 7 (0.44%) Grafana
15 6 (0.38%) HP ALM
15 6 (0.38%) Single Sign-On
16 5 (0.32%) CFEngine
16 5 (0.32%) HP SiteScope
Vendors
1 183 (11.56%) Cloudera
2 178 (11.24%) Microsoft
3 133 (8.40%) Google
4 114 (7.20%) Oracle
5 101 (6.38%) Tableau
6 91 (5.75%) Hortonworks
7 62 (3.92%) Databricks
8 52 (3.28%) Informatica
8 52 (3.28%) Talend
9 41 (2.59%) SAP
10 33 (2.08%) Splunk
11 30 (1.90%) Red Hat
12 23 (1.45%) MapR
13 22 (1.39%) StreamSets
14 17 (1.07%) Ab Initio
14 17 (1.07%) Teradata
15 15 (0.95%) Palantir
16 14 (0.88%) Alteryx
17 13 (0.82%) Salesforce.com
18 12 (0.76%) VMware