Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 14 November 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 14 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
14 Nov 2018		 Same period 2017 Same period 2016
Rank 90 89 104
Rank change year-on-year -1 +15 +67
Contract jobs citing Big Data 2,560 2,629 2,271
As % of all contract IT jobs advertised in England 2.68% 2.78% 2.31%
As % of the Database & Business Intelligence category 11.87% 12.57% 10.24%
Number of daily rates quoted 1,782 1,865 1,474
England median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% +0.96%
10th Percentile £406 £400 £368
90th Percentile £700 £688 £700
UK median daily rate £550 £550 £525
% change year-on-year - +4.76% +0.96%
Number of hourly rates quoted 15 17 15
England median hourly rate £40.00 £35.00 £43.00
Median hourly rate % change year-on-year +14.29% -18.60% -7.53%
10th Percentile £15.95 £16.64 £42.10
90th Percentile £53.50 £61.36 £84.70
UK median hourly rate £42.25 £35.00 £42.92
% change year-on-year +20.71% -18.45% -7.70%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 21,576 20,912 22,182
As % of all contract IT jobs advertised in England 22.62% 22.08% 22.61%
Number of daily rates quoted 15,187 14,449 14,879
England median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +3.03%
10th Percentile £319 £312 £288
90th Percentile £644 £638 £600
UK median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 224 259 326
England median hourly rate £33.50 £31.31 £28.00
Median hourly rate % change year-on-year +6.99% +11.82% +0.79%
10th Percentile £14.00 £14.25 £11.25
90th Percentile £56.94 £54.00 £48.75
UK median hourly rate £32.50 £30.88 £28.18
% change year-on-year +5.26% +9.56% -1.12%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in England.

Contractor daily rate trend for Big Data in England

Big Data
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data in England over the 6 months to 14 November 2018.

Contractor daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in England.

Contractor hourly rate trend for Big Data in England

Big Data
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Big Data in England over the 6 months to 14 November 2018.

Contractor hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 14 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -10 1,574 £565 +2.73% 451
South East +9 439 £500 - 115
North of England -5 196 £523 +13.59% 72
South West +43 153 £525 +5.00% 56
North West -8 100 £534 -2.95% 35
East of England +43 96 £500 +2.56% 48
Midlands -11 90 £475 - 39
Yorkshire -17 84 £500 +8.23% 18
East Midlands +21 46 £463 -11.90% 16
West Midlands -38 43 £475 +5.56% 23
North East -10 15 £625 +47.06% 21
South Coast - 1 - -
Big Data
UK

For the 6 months to 14 November 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 1,238 (48.36%) Hadoop
2 951 (37.15%) Agile Software Development
3 938 (36.64%) Apache Spark
4 896 (35.00%) Java
5 866 (33.83%) Python
6 736 (28.75%) SQL
7 723 (28.24%) Kafka
8 718 (28.05%) Analytics
9 626 (24.45%) Finance
10 601 (23.48%) Amazon AWS
11 567 (22.15%) Apache Hive
12 457 (17.85%) Linux
13 442 (17.27%) Scala
14 441 (17.23%) Data Science
15 405 (15.82%) DevOps
16 397 (15.51%) NoSQL
17 393 (15.35%) ETL
18 381 (14.88%) Jenkins
19 363 (14.18%) Business Intelligence
20 355 (13.87%) Data Warehouse
21 348 (13.59%) Microsoft Azure
22 342 (13.36%) Scrum
23 340 (13.28%) HBase
24 337 (13.16%) Docker
25 328 (12.81%) TDD
26 315 (12.30%) Machine Learning
27 304 (11.88%) Data Modelling
28 284 (11.09%) Analytical Skills
29 271 (10.59%) HDFS
30 270 (10.55%) SQL Server

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 938 (36.64%) Apache Spark
2 252 (9.84%) Apache
3 246 (9.61%) Elasticsearch
4 87 (3.40%) Confluence
5 84 (3.28%) Apache Pig
5 84 (3.28%) SAS
6 65 (2.54%) Apache Solr
7 22 (0.86%) Apache Airflow
8 21 (0.82%) Oracle SOA Suite
9 17 (0.66%) Tomcat
10 15 (0.59%) Cloud Foundry
10 15 (0.59%) nginx
11 14 (0.55%) Oracle Coherence
11 14 (0.55%) SharePoint
12 11 (0.43%) Jupyter
12 11 (0.43%) OpenStack
13 10 (0.39%) Luigi
14 9 (0.35%) GemFire
15 7 (0.27%) JBoss
15 7 (0.27%) WebLogic
Applications
1 63 (2.46%) Microsoft Excel
2 49 (1.91%) MS Visio
3 16 (0.63%) Microsoft Office
4 10 (0.39%) SPSS
5 7 (0.27%) Microsoft PowerPoint
6 5 (0.20%) Chatbot
7 4 (0.16%) Spreadsheet
8 2 (0.078%) GNU Octave
8 2 (0.078%) Microsoft Project
9 1 (0.039%) Open Workbench
9 1 (0.039%) Shockwave
9 1 (0.039%) Stata
Business Applications
1 20 (0.78%) SAP Oil and Gas
2 12 (0.47%) SAP MM
3 9 (0.35%) Dynamics CRM
4 8 (0.31%) SAP APO
5 6 (0.23%) Oracle BPM
5 6 (0.23%) SAP MDM
6 5 (0.20%) Dynamics AX
6 5 (0.20%) Payment Gateway
7 4 (0.16%) Distributed Ledger
7 4 (0.16%) IBM Operational Decision Manager
7 4 (0.16%) SAP ERP
7 4 (0.16%) SAP R/3
8 2 (0.078%) Markit EDM
8 2 (0.078%) PolarLake
8 2 (0.078%) Remedy ITSM
8 2 (0.078%) Unica
9 1 (0.039%) Dynamics NAV
9 1 (0.039%) NetSuite
9 1 (0.039%) Oracle Financials
9 1 (0.039%) SAP CRM
Cloud Services
1 601 (23.48%) Amazon AWS
2 348 (13.59%) Microsoft Azure
3 137 (5.35%) Google Cloud Platform
4 127 (4.96%) Amazon S3
5 91 (3.55%) Amazon EMR
6 83 (3.24%) Amazon EC2
7 66 (2.58%) GitHub
8 63 (2.46%) Amazon Kinesis
9 60 (2.34%) PaaS
10 54 (2.11%) Serverless
11 52 (2.03%) Virtual Private Cloud
12 51 (1.99%) Cloud Computing
13 49 (1.91%) SaaS
14 45 (1.76%) IaaS
15 36 (1.41%) Azure Data Factory
16 32 (1.25%) AWS Lambda
17 25 (0.98%) AWS CloudFormation
18 15 (0.59%) Data Lake Analytics
18 15 (0.59%) Office 365
18 15 (0.59%) OpenShift
Communications & Networking
1 59 (2.30%) Kerberos
2 56 (2.19%) HTTP
3 50 (1.95%) Firewall
4 49 (1.91%) TCP/IP
5 43 (1.68%) Internet
6 39 (1.52%) DNS
7 32 (1.25%) SSL
8 23 (0.90%) LAN
8 23 (0.90%) VPN
9 21 (0.82%) SSH
10 19 (0.74%) WAN
11 16 (0.63%) Network Security
11 16 (0.63%) SAN
12 14 (0.55%) FTP
13 11 (0.43%) NAS
14 10 (0.39%) HTTPS
14 10 (0.39%) RTMP
15 7 (0.27%) SMS
16 4 (0.16%) SNA
16 4 (0.16%) SNMP
Database & Business Intelligence
1 1,238 (48.36%) Hadoop
2 567 (22.15%) Apache Hive
3 397 (15.51%) NoSQL
4 355 (13.87%) Data Warehouse
5 340 (13.28%) HBase
6 270 (10.55%) SQL Server
7 228 (8.91%) MongoDB
8 221 (8.63%) Apache Cassandra
8 221 (8.63%) Relational Database
9 209 (8.16%) Data Lake
10 181 (7.07%) Impala
11 159 (6.21%) Sqoop
12 136 (5.31%) PostgreSQL
13 133 (5.20%) Power BI
14 102 (3.98%) Amazon Redshift
15 99 (3.87%) SQL Server Integration Services
16 96 (3.75%) MySQL
17 79 (3.09%) RDBMS
18 66 (2.58%) OLAP
19 53 (2.07%) SQL Server Reporting Services
Development Applications
1 381 (14.88%) Jenkins
2 252 (9.84%) Git (software)
3 174 (6.80%) JIRA
4 96 (3.75%) Maven
5 51 (1.99%) Gradle
6 50 (1.95%) Bitbucket
7 46 (1.80%) Cucumber
8 44 (1.72%) Visual Studio Team System
9 40 (1.56%) Artifactory
10 36 (1.41%) IntelliJ
11 33 (1.29%) Selenium
12 30 (1.17%) JUnit
13 29 (1.13%) Visual Studio
14 28 (1.09%) GitLab
14 28 (1.09%) Sonatype Nexus
15 25 (0.98%) TeamCity
16 22 (0.86%) Eclipse
17 18 (0.70%) Atlassian Bamboo
18 17 (0.66%) gulp
19 16 (0.63%) Ant
General
1 626 (24.45%) Finance
2 177 (6.91%) Banking
3 145 (5.66%) Retail
4 80 (3.13%) Telecoms
5 72 (2.81%) Marketing
6 69 (2.70%) Legal
7 48 (1.88%) Front Office
8 40 (1.56%) Investment Banking
9 36 (1.41%) Manufacturing
10 30 (1.17%) Publishing
11 25 (0.98%) Financial Institution
12 22 (0.86%) Advertising
12 22 (0.86%) Games
13 13 (0.51%) Pharmaceutical
13 13 (0.51%) Retail Banking
14 7 (0.27%) Law
15 6 (0.23%) Automotive
15 6 (0.23%) Back Office
15 6 (0.23%) Electronics
16 4 (0.16%) Aerospace
Job Titles
1 775 (30.27%) Developer
2 469 (18.32%) Data Engineer
3 365 (14.26%) Architect
4 358 (13.98%) Big Data Engineer
5 307 (11.99%) Java Developer
6 232 (9.06%) Big Data Developer
7 200 (7.81%) Data Architect
8 136 (5.31%) Analyst
9 131 (5.12%) DevOps Engineer
10 123 (4.80%) Hadoop Engineer
11 112 (4.38%) Senior Developer
12 106 (4.14%) Big Data Architect
13 104 (4.06%) Data Scientist
14 99 (3.87%) Consultant
15 91 (3.55%) Apache Spark Developer
16 85 (3.32%) Solutions Architect
17 83 (3.24%) Software Engineer
18 80 (3.13%) Java Engineer
19 72 (2.81%) Python Engineer
20 70 (2.73%) Scala Developer
Libraries, Frameworks & Software Standards
1 723 (28.24%) Kafka
2 203 (7.93%) REST
3 195 (7.62%) Spring
4 130 (5.08%) JSON
5 125 (4.88%) Spring Boot
6 122 (4.77%) Web Services
7 112 (4.38%) RESTful
8 111 (4.34%) Spark Streaming
9 110 (4.30%) AngularJS
10 101 (3.95%) .NET
10 101 (3.95%) RabbitMQ
11 94 (3.67%) HTML
12 81 (3.16%) Node.js
13 76 (2.97%) Middleware
14 69 (2.70%) React
15 68 (2.66%) J2EE
16 67 (2.62%) CSS
17 59 (2.30%) Elastic Stack
18 56 (2.19%) XML
19 52 (2.03%) HTML5
Miscellaneous
1 284 (11.09%) Analytical Skills
2 173 (6.76%) Greenfield Project
3 154 (6.02%) Algorithms
4 137 (5.35%) Computer Science
5 59 (2.30%) Fintech
6 54 (2.11%) Data Structures
7 51 (1.99%) Self-Motivation
8 48 (1.88%) Wiki
9 47 (1.84%) User Experience
10 43 (1.68%) Data Centre
11 33 (1.29%) Management Information System
12 32 (1.25%) Virtual Team
13 21 (0.82%) Mobile App
14 20 (0.78%) Linux Command Line
14 20 (0.78%) Market Risk
15 19 (0.74%) Enterprise Software
16 17 (0.66%) PKI
17 16 (0.63%) Foreign Exchange (FX)
17 16 (0.63%) Public Cloud
18 14 (0.55%) HoloLens
Operating Systems
1 457 (17.85%) Linux
2 269 (10.51%) Unix
3 114 (4.45%) Windows
4 46 (1.80%) Red Hat Enterprise Linux
5 17 (0.66%) CentOS
6 16 (0.63%) Ubuntu
7 13 (0.51%) Android
8 11 (0.43%) Windows Server
9 8 (0.31%) Apple iOS
10 4 (0.16%) CoreOS
10 4 (0.16%) Mesosphere
10 4 (0.16%) Windows 10
11 3 (0.12%) AIX
11 3 (0.12%) DC/OS
11 3 (0.12%) Mac OS X
11 3 (0.12%) VMS
12 1 (0.039%) Fedora
12 1 (0.039%) HPUX
12 1 (0.039%) Solaris
12 1 (0.039%) zOS
Processes & Methodologies
1 951 (37.15%) Agile Software Development
2 718 (28.05%) Analytics
3 441 (17.23%) Data Science
4 405 (15.82%) DevOps
5 393 (15.35%) ETL
6 363 (14.18%) Business Intelligence
7 342 (13.36%) Scrum
8 328 (12.81%) TDD
9 315 (12.30%) Machine Learning
10 304 (11.88%) Data Modelling
11 257 (10.04%) Data Analytics
12 246 (9.61%) Open Source
13 228 (8.91%) Visualisation
14 219 (8.55%) Microservices
15 207 (8.09%) Continuous Integration
16 198 (7.73%) BDD
17 187 (7.30%) Software Engineering
18 182 (7.11%) Test Automation
19 180 (7.03%) Data Architecture
20 156 (6.09%) Problem-Solving
Programming Languages
1 896 (35.00%) Java
2 866 (33.83%) Python
3 736 (28.75%) SQL
4 442 (17.27%) Scala
5 212 (8.28%) JavaScript
6 177 (6.91%) R
7 171 (6.68%) Java 8
8 144 (5.63%) Bash Shell
9 123 (4.80%) Shell Script
10 121 (4.73%) C#
11 95 (3.71%) PowerShell
12 73 (2.85%) C++
13 62 (2.42%) T-SQL
14 61 (2.38%) Groovy
15 46 (1.80%) Korn
16 42 (1.64%) Ruby
17 35 (1.37%) MATLAB
18 33 (1.29%) TypeScript
19 30 (1.17%) C
19 30 (1.17%) Perl
Qualifications
1 225 (8.79%) Security Cleared
2 178 (6.95%) SC Cleared
3 157 (6.13%) Degree
4 61 (2.38%) Computer Science Degree
5 33 (1.29%) PhD
6 27 (1.05%) DV Cleared
7 25 (0.98%) Master's Degree
8 20 (0.78%) CISSP
9 15 (0.59%) Microsoft Certification
10 14 (0.55%) AWS Certification
11 13 (0.51%) BPSS Clearance
11 13 (0.51%) CISM
12 8 (0.31%) BC Cleared
12 8 (0.31%) CEH
12 8 (0.31%) ISEB
12 8 (0.31%) ISTQB
12 8 (0.31%) MCSE
12 8 (0.31%) Numerate Degree
12 8 (0.31%) PMI Certification
12 8 (0.31%) SANS
Quality Assurance & Compliance
1 122 (4.77%) Data Quality
2 75 (2.93%) QA
3 50 (1.95%) GDPR
4 18 (0.70%) SLA
5 10 (0.39%) PMO
6 8 (0.31%) ISO/IEC 27001
6 8 (0.31%) PCI DSS
7 5 (0.20%) ISO 9001
8 4 (0.16%) IFRS
8 4 (0.16%) IFRS 9
8 4 (0.16%) PA-DSS
8 4 (0.16%) PSD2
9 3 (0.12%) MiFID
9 3 (0.12%) Sarbanes-Oxley
10 2 (0.078%) COBIT
10 2 (0.078%) EMIR
10 2 (0.078%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 337 (13.16%) Docker
2 271 (10.59%) HDFS
3 95 (3.71%) Apache Flume
4 80 (3.13%) Apache ZooKeeper
5 21 (0.82%) Active Directory
6 16 (0.63%) Oracle RAC
7 12 (0.47%) VMware Infrastructure
8 9 (0.35%) Virtual Machines
9 6 (0.23%) Hyper-V
10 4 (0.16%) vSphere
11 2 (0.078%) etcd
11 2 (0.078%) flannel
11 2 (0.078%) LXC
11 2 (0.078%) VMware ESXi
11 2 (0.078%) XenApp
12 1 (0.039%) OpenDJ
12 1 (0.039%) OpenIDM
12 1 (0.039%) vCloud
12 1 (0.039%) Virtual Desktop
12 1 (0.039%) XenDesktop
Systems Management
1 252 (9.84%) Ansible
2 222 (8.67%) Kubernetes
3 174 (6.80%) Hadoop YARN
4 145 (5.66%) Oozie
5 143 (5.59%) Puppet
6 137 (5.35%) Terraform
7 100 (3.91%) Opscode Chef
8 45 (1.76%) Kibana
9 29 (1.13%) logstash
10 25 (0.98%) Mesos
11 23 (0.90%) Ambari
12 21 (0.82%) Prometheus
13 18 (0.70%) Docker Swarm
13 18 (0.70%) Grafana
14 14 (0.55%) Nagios
15 11 (0.43%) Salt
16 10 (0.39%) Graylog
16 10 (0.39%) Packer
17 9 (0.35%) HP ALM
17 9 (0.35%) ZABBIX
Vendors
1 242 (9.45%) Cloudera
2 240 (9.38%) Oracle
3 178 (6.95%) Microsoft
4 175 (6.84%) Tableau
5 157 (6.13%) Hortonworks
6 144 (5.63%) Google
7 85 (3.32%) Informatica
8 78 (3.05%) Splunk
9 71 (2.77%) Talend
10 70 (2.73%) SAP
11 49 (1.91%) MapR
12 48 (1.88%) Teradata
13 43 (1.68%) Red Hat
14 41 (1.60%) IBM
15 39 (1.52%) Alteryx
16 30 (1.17%) Ab Initio
17 28 (1.09%) VMware
18 26 (1.02%) HP
19 25 (0.98%) Databricks
20 24 (0.94%) Sybase