Period
to 17 November 2017

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
17 Nov 2017
Same period 2016 Same period 2015
Rank 88 104 182
Rank change year-on-year +16 +78 +88
Contract jobs citing Big Data 2761 2408 1629
As % of all contract IT jobs advertised in the UK 2.69% 2.27% 1.42%
As % of the Database & Business Intelligence category 12.16% 10.04% 6.08%
Number of daily rates quoted 1930 1555 1104
UK median daily rate £550 £525 £520
Median daily rate % change year-on-year +4.76% +0.96% +1.96%
10th Percentile £387 £363 £363
90th Percentile £678 £700 £675
UK excluding London median daily rate £475 £470 £475
% change year-on-year +1.06% -1.05% +5.56%
Number of hourly rates quoted 18 16 5
UK median hourly rate £30.91 £42.92 £46.50
Median hourly rate % change year-on-year -27.99% -7.70% +55.00%
10th Percentile £16.64 £30.63 £24.50
90th Percentile £59.92 £78.38 £58.25
UK excluding London median hourly rate £30.91 £42.84 £48.25
% change year-on-year -27.86% -11.21% +35.92%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 22701 23988 26782
As % of all contract IT jobs advertised in the UK 22.08% 22.64% 23.30%
Number of daily rates quoted 15494 15920 17628
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +1.27%
10th Percentile £310 £285 £269
90th Percentile £625 £600 £575
UK excluding London median daily rate £400 £375 £375
% change year-on-year +6.67% - +7.14%
Number of hourly rates quoted 286 371 405
UK median hourly rate £31.23 £28.18 £28.50
Median hourly rate % change year-on-year +10.82% -1.12% +16.33%
10th Percentile £14.00 £10.00 £12.00
90th Percentile £57.81 £52.17 £52.47
UK excluding London median hourly rate £35.00 £28.09 £29.75
% change year-on-year +24.60% -5.58% +32.22%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 17 November 2017.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 17 November 2017.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 17 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +14 2632 £550 +4.76% 295
London +8 1810 £550 - 185
UK excluding London +49 924 £475 +1.06% 121
South East +54 393 £500 +5.26% 33
North of England +82 192 £462 -2.74% 34
Midlands +47 101 £475 -1.55% 12
North West +36 98 £550 +15.79% 23
Yorkshire +57 94 £462 -2.74% 10
Scotland +14 77 £400 -11.11% 6
South West -19 73 £500 +17.65% 11
East of England -37 63 £488 +30.00% 20
West Midlands +18 55 £450 -6.74% 8
East Midlands +30 44 £525 +10.53% 4
Northern Ireland -21 22 £410 -
North East +77 21 £425 -5.56% 1
Wales 0 15 £375 -26.83% 5

For the 6 months to 17 November 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Big Data.

1 1562 (56.57%) Hadoop
2 1156 (41.87%) Apache Spark
3 1139 (41.25%) Java
4 1047 (37.92%) Agile Software Development
5 817 (29.59%) Python
6 715 (25.90%) Analytics
7 713 (25.82%) SQL
8 669 (24.23%) Finance
9 657 (23.80%) Kafka
10 597 (21.62%) Apache Hive
11 520 (18.83%) Scala
12 503 (18.22%) TDD
13 502 (18.18%) Amazon AWS
14 500 (18.11%) HBase
15 455 (16.48%) Linux
16 445 (16.12%) Banking
17 417 (15.10%) Scrum
18 393 (14.23%) ETL
19 392 (14.20%) DevOps
20 386 (13.98%) HDFS
21 385 (13.94%) Business Intelligence
22 362 (13.11%) NoSQL
23 341 (12.35%) Analytical Skills
24 335 (12.13%) Data Modelling
25 329 (11.92%) Machine Learning
26 321 (11.63%) Docker
27 313 (11.34%) BDD
28 302 (10.94%) MapReduce
29 297 (10.76%) Security Cleared
30 290 (10.50%) Data Warehouse

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1156 (41.87%) Apache Spark
2 259 (9.38%) Apache
3 142 (5.14%) Apache Pig
4 131 (4.74%) Elasticsearch
5 130 (4.71%) Apache Solr
6 128 (4.64%) Confluence
7 116 (4.20%) SAS
8 51 (1.85%) Tomcat
9 38 (1.38%) JBoss
10 36 (1.30%) OpenStack
11 28 (1.01%) nginx
11 28 (1.01%) WebSphere
12 23 (0.83%) Cloud Foundry
13 20 (0.72%) SharePoint
14 17 (0.62%) Oracle SOA Suite
15 16 (0.58%) Apache Airflow
16 12 (0.43%) GemFire
17 11 (0.40%) ArcGIS
17 11 (0.40%) GlassFish
17 11 (0.40%) WildFly
Applications
1 52 (1.88%) Microsoft Excel
2 19 (0.69%) Microsoft PowerPoint
2 19 (0.69%) SPSS
3 15 (0.54%) Microsoft Office
4 14 (0.51%) MS Visio
5 10 (0.36%) Pipeline Pilot
6 9 (0.33%) Stata
7 8 (0.29%) Microsoft Project
8 4 (0.14%) Spreadsheet
9 2 (0.072%) Mingle
9 2 (0.072%) Photoshop
9 2 (0.072%) Weka
10 1 (0.036%) Chatbot
10 1 (0.036%) EViews
10 1 (0.036%) Gephi
10 1 (0.036%) GNU Octave
Business Applications
1 11 (0.40%) Actimize
1 11 (0.40%) Payment Gateway
2 7 (0.25%) WebTrends
3 4 (0.14%) Oracle BPM
3 4 (0.14%) SAP CO
3 4 (0.14%) SAP FI
3 4 (0.14%) SAP FI/CO
4 3 (0.11%) Bloomberg TOMS
4 3 (0.11%) Eagle PACE
5 2 (0.072%) Dynamics CRM
5 2 (0.072%) Hyperion Planning
5 2 (0.072%) Markit EDM
5 2 (0.072%) SAP BPC
5 2 (0.072%) SAP CRM
6 1 (0.036%) Cognos Business Intelligence
6 1 (0.036%) Oracle EBS R12
6 1 (0.036%) Oracle General Ledger
6 1 (0.036%) Oracle Payables
6 1 (0.036%) Oracle Receivables
6 1 (0.036%) SAP FSCM
Cloud Services
1 502 (18.18%) Amazon AWS
2 151 (5.47%) Microsoft Azure
3 145 (5.25%) GitHub
4 84 (3.04%) Google Cloud Platform
5 62 (2.25%) PaaS
6 60 (2.17%) SaaS
7 52 (1.88%) Amazon S3
8 50 (1.81%) Amazon EC2
9 43 (1.56%) IBM Cloud
10 40 (1.45%) Bluemix
11 39 (1.41%) Cloud Computing
12 38 (1.38%) Amazon EMR
12 38 (1.38%) IaaS
13 34 (1.23%) Serverless
14 33 (1.20%) Virtual Private Cloud
15 22 (0.80%) Google Analytics
16 21 (0.76%) AWS CloudFormation
17 18 (0.65%) Amazon CloudWatch
17 18 (0.65%) AWS Lambda
18 14 (0.51%) Amazon Kinesis
Communications & Networking
1 135 (4.89%) Kerberos
2 39 (1.41%) Firewall
3 34 (1.23%) Network Security
4 33 (1.20%) LAN
4 33 (1.20%) WAN
5 30 (1.09%) Internet
6 26 (0.94%) HTTP
7 22 (0.80%) SSL
7 22 (0.80%) VPN
8 20 (0.72%) DNS
9 15 (0.54%) 4G
10 14 (0.51%) 3G
10 14 (0.51%) TCP/IP
10 14 (0.51%) Wi-Fi
11 13 (0.47%) 5G
11 13 (0.47%) Bluetooth
11 13 (0.47%) RFID
11 13 (0.47%) ZigBee
11 13 (0.47%) Z-Wave
12 11 (0.40%) DSL
Database & Business Intelligence
1 1562 (56.57%) Hadoop
2 597 (21.62%) Apache Hive
3 500 (18.11%) HBase
4 362 (13.11%) NoSQL
5 290 (10.50%) Data Warehouse
6 246 (8.91%) MongoDB
7 212 (7.68%) Apache Cassandra
8 205 (7.42%) PostgreSQL
9 192 (6.95%) Impala
10 179 (6.48%) Relational Database
11 174 (6.30%) SQL Server
12 171 (6.19%) Sqoop
13 99 (3.59%) Data Lake
14 79 (2.86%) MySQL
15 78 (2.83%) RDBMS
16 75 (2.72%) Data Mining
17 67 (2.43%) SQL Server Integration Services
18 66 (2.39%) BusinessObjects
19 55 (1.99%) Amazon Redshift
20 45 (1.63%) Power BI
Development Applications
1 274 (9.92%) Jenkins
2 267 (9.67%) Git (software)
3 265 (9.60%) JIRA
4 138 (5.00%) Cucumber
5 72 (2.61%) Maven
6 55 (1.99%) JUnit
7 45 (1.63%) Gradle
8 40 (1.45%) IntelliJ
9 37 (1.34%) GitLab
10 35 (1.27%) Selenium
11 34 (1.23%) Subversion
12 33 (1.20%) Team Foundation Server
13 32 (1.16%) Talend Open Studio
14 31 (1.12%) Sonatype Nexus
15 30 (1.09%) TeamCity
16 27 (0.98%) Ant
17 25 (0.91%) Visual Studio
18 22 (0.80%) NUnit
19 21 (0.76%) Mockito
20 20 (0.72%) Vagrant
General
1 669 (24.23%) Finance
2 445 (16.12%) Banking
3 154 (5.58%) Telecoms
4 139 (5.03%) Marketing
5 121 (4.38%) Retail
6 119 (4.31%) Investment Banking
7 89 (3.22%) Front Office
8 81 (2.93%) Manufacturing
9 67 (2.43%) Electronics
10 37 (1.34%) Publishing
11 32 (1.16%) Retail Banking
12 28 (1.01%) Legal
13 23 (0.83%) Financial Institution
14 21 (0.76%) Games
15 15 (0.54%) Advertising
16 14 (0.51%) French Language
17 10 (0.36%) Law
17 10 (0.36%) Pharmaceutical
18 9 (0.33%) Back Office
19 6 (0.22%) Wholesale Banking
Job Titles
1 929 (33.65%) Developer
2 414 (14.99%) Data Engineer
3 399 (14.45%) Architect
4 344 (12.46%) Big Data Developer
5 334 (12.10%) Big Data Engineer
6 314 (11.37%) Java Developer
7 240 (8.69%) Data Architect
8 226 (8.19%) Analyst
9 156 (5.65%) Scala Developer
10 152 (5.51%) Hadoop Engineer
11 148 (5.36%) Big Data Architect
12 132 (4.78%) Hadoop Developer
13 130 (4.71%) Consultant
14 123 (4.45%) Data Scientist
15 111 (4.02%) DevOps Engineer
16 103 (3.73%) Senior Developer
17 96 (3.48%) Apache Spark Developer
18 90 (3.26%) Data Analyst
18 90 (3.26%) Java Engineer
19 86 (3.11%) Business Analyst
Libraries, Frameworks & Software Standards
1 657 (23.80%) Kafka
2 280 (10.14%) REST
3 261 (9.45%) Spring
4 224 (8.11%) JSON
4 224 (8.11%) Web Services
5 192 (6.95%) RESTful
6 151 (5.47%) Spring Boot
7 137 (4.96%) HTML
8 118 (4.27%) XML
9 117 (4.24%) AngularJS
10 109 (3.95%) HTML5
11 106 (3.84%) CSS
12 99 (3.59%) Spark Streaming
13 86 (3.11%) PySpark
14 84 (3.04%) React
15 82 (2.97%) Drools
16 81 (2.93%) Akka
16 81 (2.93%) Apache Camel
17 76 (2.75%) .NET
17 76 (2.75%) Node.js
Miscellaneous
1 341 (12.35%) Analytical Skills
2 175 (6.34%) Algorithms
3 121 (4.38%) Computer Science
4 83 (3.01%) Greenfield Project
5 75 (2.72%) User Experience
6 56 (2.03%) Data Structures
7 54 (1.96%) Fintech
8 52 (1.88%) Market Risk
9 49 (1.77%) Enterprise Software
10 46 (1.67%) Management Information System
11 43 (1.56%) Data Centre
12 40 (1.45%) Reference Data
13 39 (1.41%) Foreign Exchange (FX)
14 38 (1.38%) Virtual Team
15 35 (1.27%) Mobile App
16 32 (1.16%) Linux Command Line
17 29 (1.05%) Replication
18 25 (0.91%) Credit Risk
18 25 (0.91%) Equities
18 25 (0.91%) Semantic Web
Operating Systems
1 455 (16.48%) Linux
2 248 (8.98%) Unix
3 64 (2.32%) Windows
4 42 (1.52%) Red Hat Enterprise Linux
5 36 (1.30%) CentOS
6 31 (1.12%) Ubuntu
7 27 (0.98%) Apple iOS
8 26 (0.94%) Android
9 10 (0.36%) AIX
10 9 (0.33%) Solaris
11 5 (0.18%) Windows Vista
12 4 (0.14%) Mac OS X
12 4 (0.14%) Windows Server
13 2 (0.072%) Windows Server 2003
14 1 (0.036%) Debian
14 1 (0.036%) HPUX
14 1 (0.036%) MVS
14 1 (0.036%) Windows Server 2008
Processes & Methodologies
1 1047 (37.92%) Agile Software Development
2 715 (25.90%) Analytics
3 503 (18.22%) TDD
4 417 (15.10%) Scrum
5 393 (14.23%) ETL
6 392 (14.20%) DevOps
7 385 (13.94%) Business Intelligence
8 335 (12.13%) Data Modelling
9 329 (11.92%) Machine Learning
10 313 (11.34%) BDD
11 302 (10.94%) MapReduce
12 267 (9.67%) Continuous Integration
13 261 (9.45%) Open Source
14 253 (9.16%) Data Architecture
15 236 (8.55%) Microservices
16 216 (7.82%) Data Analytics
17 215 (7.79%) Visualisation
18 195 (7.06%) Test Automation
19 178 (6.45%) Software Engineering
20 151 (5.47%) Kanban
Programming Languages
1 1139 (41.25%) Java
2 817 (29.59%) Python
3 713 (25.82%) SQL
4 520 (18.83%) Scala
5 248 (8.98%) JavaScript
6 216 (7.82%) R
7 141 (5.11%) Shell Script
8 124 (4.49%) C#
9 93 (3.37%) Bash Shell
10 76 (2.75%) Ruby
11 65 (2.35%) PL/SQL
12 60 (2.17%) Perl
13 56 (2.03%) C++
14 41 (1.48%) C
14 41 (1.48%) Groovy
15 35 (1.27%) T-SQL
16 31 (1.12%) Go
17 25 (0.91%) MATLAB
17 25 (0.91%) SPARQL
18 24 (0.87%) PHP
Qualifications
1 297 (10.76%) Security Cleared
2 209 (7.57%) Degree
2 209 (7.57%) SC Cleared
3 60 (2.17%) DV Cleared
4 41 (1.48%) Computer Science Degree
5 34 (1.23%) PhD
6 26 (0.94%) Numerate Degree
7 20 (0.72%) CISSP
8 17 (0.62%) Master's Degree
9 14 (0.51%) SANS
10 12 (0.43%) CEH
10 12 (0.43%) Postgraduate
11 10 (0.36%) BPSS Clearance
12 9 (0.33%) DBS Check
13 8 (0.29%) ISTQB
14 7 (0.25%) CCNA
14 7 (0.25%) CESG Certified Professional
14 7 (0.25%) Cisco Certification
14 7 (0.25%) CLAS
15 6 (0.22%) Microsoft Certification
Quality Assurance & Compliance
1 140 (5.07%) QA
2 139 (5.03%) Data Quality
3 39 (1.41%) GDPR
4 23 (0.83%) MiFID
5 20 (0.72%) GCP
6 11 (0.40%) PMO
7 8 (0.29%) Actionable Recommendations
7 8 (0.29%) Dodd-Frank
8 7 (0.25%) JSP 440
9 6 (0.22%) IFRS
10 5 (0.18%) EMIR
10 5 (0.18%) IFRS 9
10 5 (0.18%) SLA
11 3 (0.11%) ISO/IEC 20000
11 3 (0.11%) PCI DSS
12 2 (0.072%) COBIT
12 2 (0.072%) Disclosure Scotland
12 2 (0.072%) ISO/IEC 27001
12 2 (0.072%) PSD2
12 2 (0.072%) RosettaNet
System Software
1 386 (13.98%) HDFS
2 321 (11.63%) Docker
3 229 (8.29%) Apache Flume
4 112 (4.06%) Apache ZooKeeper
5 23 (0.83%) VMware Infrastructure
6 21 (0.76%) Active Directory
7 19 (0.69%) Oracle RAC
8 17 (0.62%) Oracle Clusterware
9 14 (0.51%) vCloud
9 14 (0.51%) Virtual Machines
10 9 (0.33%) Hyper-V
11 2 (0.072%) OpenAM
11 2 (0.072%) OpenDJ
11 2 (0.072%) OpenIDM
11 2 (0.072%) VMware ESXi
12 1 (0.036%) Firmware
12 1 (0.036%) PowerHA
12 1 (0.036%) Snort
12 1 (0.036%) Virtual Servers
Systems Management
1 223 (8.08%) Ansible
2 167 (6.05%) Oozie
3 147 (5.32%) Hadoop YARN
4 144 (5.22%) Kubernetes
5 131 (4.74%) Terraform
6 113 (4.09%) Puppet
7 92 (3.33%) Ambari
8 66 (2.39%) Opscode Chef
9 47 (1.70%) Mesos
10 19 (0.69%) Data Guard
10 19 (0.69%) Kibana
11 18 (0.65%) Prometheus
12 17 (0.62%) Graphite
12 17 (0.62%) Oracle Flashback
12 17 (0.62%) Oracle RMAN
13 16 (0.58%) ITRS Geneos
14 15 (0.54%) Control-M
15 13 (0.47%) logstash
16 11 (0.40%) Nagios
17 10 (0.36%) Rsyslog
Vendors
1 284 (10.29%) Cloudera
2 267 (9.67%) Oracle
3 183 (6.63%) Tableau
4 149 (5.40%) Hortonworks
5 129 (4.67%) Microsoft
6 128 (4.64%) SAP
7 124 (4.49%) Google
8 107 (3.88%) Splunk
9 95 (3.44%) IBM
10 76 (2.75%) Informatica
11 75 (2.72%) Teradata
12 61 (2.21%) Red Hat
13 44 (1.59%) Salesforce.com
14 42 (1.52%) MapR
15 36 (1.30%) VMware
16 32 (1.16%) Talend
17 27 (0.98%) TIBCO
18 20 (0.72%) HP
18 20 (0.72%) SaltStack
19 18 (0.65%) AppDynamics