Period
to 19 January 2018

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 January 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
19 Jan 2018
Same period 2017 Same period 2016
Rank 88 88 151
Rank change year-on-year 0 +63 +86
Contract jobs citing Big Data 2,664 2,534 1,763
As % of all contract IT jobs advertised in the UK 2.66% 2.61% 1.63%
As % of the Database & Business Intelligence category 12.09% 11.59% 7.06%
Number of daily rates quoted 1,834 1,662 1,226
UK median daily rate £550 £525 £520
Median daily rate % change year-on-year +4.76% +0.96% +4.00%
10th Percentile £394 £369 £363
90th Percentile £675 £700 £675
UK excluding London median daily rate £500 £488 £470
% change year-on-year +2.56% +3.72% -1.05%
Number of hourly rates quoted 15 13 7
UK median hourly rate £30.50 £45.00 £37.50
Median hourly rate % change year-on-year -32.22% +20.00% +25.00%
10th Percentile £17.72 £23.80 £19.41
90th Percentile £64.24 £97.35 £55.50
UK excluding London median hourly rate £30.50 £44.00 £48.25
% change year-on-year -30.68% -8.81% +28.67%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 22,032 21,865 24,986
As % of all contract IT jobs advertised in the UK 21.98% 22.56% 23.08%
Number of daily rates quoted 15,330 14,569 16,643
UK median daily rate £450 £425 £415
Median daily rate % change year-on-year +5.88% +2.41% +3.75%
10th Percentile £310 £288 £275
90th Percentile £625 £600 £588
UK excluding London median daily rate £400 £388 £375
% change year-on-year +3.23% +3.33% +7.14%
Number of hourly rates quoted 252 319 430
UK median hourly rate £30.95 £28.18 £30.00
Median hourly rate % change year-on-year +9.83% -6.07% +4.57%
10th Percentile £14.58 £10.40 £12.00
90th Percentile £55.54 £48.75 £52.50
UK excluding London median hourly rate £35.00 £26.94 £29.50
% change year-on-year +29.93% -8.69% +5.00%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 19 January 2018.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 19 January 2018.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 19 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -4 2,559 £550 +4.76% 868
London -14 1,704 £550 - 552
UK excluding London +27 932 £500 +2.56% 361
South East +46 445 £500 - 107
North of England +37 167 £500 +4.17% 75
Midlands +39 101 £475 - 44
North West +12 101 £550 +10.00% 45
South West -8 86 £500 +2.56% 44
Yorkshire +31 66 £475 +1.06% 22
East Midlands +43 59 £500 -6.98% 27
East of England -31 58 £488 +16.07% 42
Scotland -6 57 £400 -11.11% 23
West Midlands 0 42 £475 +5.56% 17
North East +60 17 £425 -5.56% 8
Wales -3 17 £435 -15.12% 22
Northern Ireland -19 9 - - 4

For the 6 months to 19 January 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Big Data.

1 1,446 (54.28%) Hadoop
2 1,115 (41.85%) Apache Spark
3 1,041 (39.08%) Java
4 964 (36.19%) Agile Software Development
5 787 (29.54%) Python
6 728 (27.33%) Analytics
7 687 (25.79%) SQL
8 637 (23.91%) Kafka
9 627 (23.54%) Finance
10 571 (21.43%) Apache Hive
11 537 (20.16%) Scala
12 471 (17.68%) Amazon AWS
13 454 (17.04%) Linux
14 444 (16.67%) HBase
15 409 (15.35%) ETL
16 407 (15.28%) Banking
17 399 (14.98%) TDD
18 384 (14.41%) Business Intelligence
19 380 (14.26%) HDFS
20 369 (13.85%) DevOps
21 349 (13.10%) NoSQL
22 332 (12.46%) Data Warehouse
23 314 (11.79%) Data Modelling
24 313 (11.75%) Scrum
25 311 (11.67%) Machine Learning
26 307 (11.52%) Analytical Skills
27 304 (11.41%) Docker
28 300 (11.26%) Jenkins
29 290 (10.89%) Cloudera
30 276 (10.36%) Oracle

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,115 (41.85%) Apache Spark
2 259 (9.72%) Apache
3 134 (5.03%) Apache Pig
4 115 (4.32%) Elasticsearch
5 102 (3.83%) SAS
6 95 (3.57%) Confluence
7 69 (2.59%) Apache Solr
8 57 (2.14%) Tomcat
9 33 (1.24%) nginx
10 28 (1.05%) SharePoint
11 24 (0.90%) Cloud Foundry
12 22 (0.83%) JBoss
12 22 (0.83%) WebSphere
13 18 (0.68%) OpenStack
14 17 (0.64%) Apache Airflow
15 13 (0.49%) GemFire
16 11 (0.41%) Oracle Coherence
17 10 (0.38%) ArcGIS
17 10 (0.38%) Luigi
17 10 (0.38%) WebSphere Application Server
Applications
1 56 (2.10%) Microsoft Excel
2 19 (0.71%) SPSS
3 18 (0.68%) Microsoft PowerPoint
4 16 (0.60%) MS Visio
5 13 (0.49%) Microsoft Office
6 10 (0.38%) Microsoft Project
6 10 (0.38%) Pipeline Pilot
7 9 (0.34%) Spreadsheet
8 7 (0.26%) Stata
9 1 (0.038%) Chatbot
9 1 (0.038%) EViews
9 1 (0.038%) Gephi
9 1 (0.038%) GNU Octave
9 1 (0.038%) HipChat
9 1 (0.038%) Mingle
9 1 (0.038%) Weka
Business Applications
1 13 (0.49%) Payment Gateway
2 11 (0.41%) Distributed Ledger
3 5 (0.19%) Actimize
3 5 (0.19%) SAP APO
3 5 (0.19%) SAP ERP
4 4 (0.15%) Oracle Retail
4 4 (0.15%) SAP CO
4 4 (0.15%) SAP FI
4 4 (0.15%) SAP FI/CO
4 4 (0.15%) SAP Oil and Gas
5 3 (0.11%) Dynamics CRM
5 3 (0.11%) Oracle BPM
5 3 (0.11%) WebTrends
6 2 (0.075%) HiPortfolio
6 2 (0.075%) Hyperion Planning
6 2 (0.075%) SAP BPC
6 2 (0.075%) SAP CRM
6 2 (0.075%) Summit
7 1 (0.038%) Oracle EBS
7 1 (0.038%) SAP MM
Cloud Services
1 471 (17.68%) Amazon AWS
2 184 (6.91%) Microsoft Azure
3 118 (4.43%) GitHub
4 99 (3.72%) Google Cloud Platform
5 65 (2.44%) PaaS
6 58 (2.18%) SaaS
7 42 (1.58%) Amazon EC2
7 42 (1.58%) Amazon S3
8 38 (1.43%) Bluemix
8 38 (1.43%) IBM Cloud
9 34 (1.28%) Cloud Computing
10 33 (1.24%) IaaS
11 30 (1.13%) Amazon EMR
12 29 (1.09%) Amazon Kinesis
13 26 (0.98%) Virtual Private Cloud
14 25 (0.94%) Serverless
15 23 (0.86%) Google Analytics
16 19 (0.71%) Google Tag Manager
17 18 (0.68%) Amazon CloudWatch
18 15 (0.56%) Slack
Communications & Networking
1 112 (4.20%) Kerberos
2 36 (1.35%) Internet
3 28 (1.05%) Firewall
4 26 (0.98%) Network Security
5 20 (0.75%) SSL
6 17 (0.64%) HTTP
7 16 (0.60%) DNS
8 13 (0.49%) TCP/IP
9 10 (0.38%) WAN
10 9 (0.34%) LAN
11 8 (0.30%) 4G
11 8 (0.30%) HTTPS
11 8 (0.30%) Wi-Fi
12 7 (0.26%) 3G
12 7 (0.26%) 5G
12 7 (0.26%) DSL
12 7 (0.26%) RFID
12 7 (0.26%) VPN
12 7 (0.26%) ZigBee
12 7 (0.26%) Z-Wave
Database & Business Intelligence
1 1,446 (54.28%) Hadoop
2 571 (21.43%) Apache Hive
3 444 (16.67%) HBase
4 349 (13.10%) NoSQL
5 332 (12.46%) Data Warehouse
6 214 (8.03%) MongoDB
7 193 (7.24%) Sqoop
8 192 (7.21%) SQL Server
9 186 (6.98%) Relational Database
10 182 (6.83%) PostgreSQL
11 177 (6.64%) Impala
12 164 (6.16%) Apache Cassandra
13 154 (5.78%) Data Lake
14 82 (3.08%) Data Mining
15 76 (2.85%) RDBMS
16 69 (2.59%) Amazon Redshift
17 67 (2.52%) MySQL
17 67 (2.52%) SQL Server Integration Services
18 58 (2.18%) BusinessObjects
19 56 (2.10%) Power BI
Development Applications
1 300 (11.26%) Jenkins
2 263 (9.87%) Git (software)
3 215 (8.07%) JIRA
4 88 (3.30%) Cucumber
5 64 (2.40%) Maven
6 51 (1.91%) Gradle
7 45 (1.69%) JUnit
8 43 (1.61%) TeamCity
9 42 (1.58%) Selenium
10 35 (1.31%) Subversion
11 34 (1.28%) Team Foundation Server
12 33 (1.24%) Visual Studio
13 29 (1.09%) GitLab
14 27 (1.01%) IntelliJ
14 27 (1.01%) Sonatype Nexus
15 22 (0.83%) WebDriver
16 21 (0.79%) NUnit
16 21 (0.79%) Vagrant
17 18 (0.68%) Ant
18 16 (0.60%) ERwin
General
1 627 (23.54%) Finance
2 407 (15.28%) Banking
3 138 (5.18%) Telecoms
4 134 (5.03%) Retail
5 123 (4.62%) Marketing
6 105 (3.94%) Investment Banking
7 85 (3.19%) Manufacturing
8 53 (1.99%) Front Office
9 51 (1.91%) Electronics
10 39 (1.46%) Retail Banking
11 38 (1.43%) Publishing
12 32 (1.20%) Games
13 25 (0.94%) Financial Institution
14 23 (0.86%) Legal
15 18 (0.68%) French Language
16 16 (0.60%) Law
17 14 (0.53%) Advertising
18 12 (0.45%) Automotive
19 9 (0.34%) Back Office
20 7 (0.26%) Pharmaceutical
Job Titles
1 839 (31.49%) Developer
2 400 (15.02%) Data Engineer
3 390 (14.64%) Architect
4 314 (11.79%) Big Data Engineer
5 305 (11.45%) Big Data Developer
6 272 (10.21%) Java Developer
7 231 (8.67%) Data Architect
8 217 (8.15%) Analyst
9 141 (5.29%) Big Data Architect
10 140 (5.26%) Hadoop Engineer
11 134 (5.03%) Consultant
12 131 (4.92%) Scala Developer
13 124 (4.65%) Data Scientist
14 112 (4.20%) Hadoop Developer
15 106 (3.98%) DevOps Engineer
16 100 (3.75%) Senior Developer
17 89 (3.34%) Data Analyst
18 88 (3.30%) Apache Spark Developer
19 82 (3.08%) Solutions Architect
20 78 (2.93%) Business Analyst
Libraries, Frameworks & Software Standards
1 637 (23.91%) Kafka
2 228 (8.56%) Web Services
3 204 (7.66%) REST
4 200 (7.51%) Spring
5 196 (7.36%) RESTful
6 180 (6.76%) JSON
7 118 (4.43%) XML
8 105 (3.94%) Spring Boot
9 103 (3.87%) HTML
10 101 (3.79%) AngularJS
11 95 (3.57%) React
12 93 (3.49%) Spark Streaming
13 90 (3.38%) PySpark
14 86 (3.23%) CSS
15 85 (3.19%) .NET
16 79 (2.97%) Node.js
17 76 (2.85%) HTML5
18 73 (2.74%) J2EE
19 69 (2.59%) Akka
20 65 (2.44%) Middleware
Miscellaneous
1 307 (11.52%) Analytical Skills
2 149 (5.59%) Computer Science
3 129 (4.84%) Algorithms
4 110 (4.13%) Greenfield Project
5 65 (2.44%) User Experience
6 61 (2.29%) Data Structures
7 49 (1.84%) Management Information System
8 48 (1.80%) Virtual Team
9 45 (1.69%) Fintech
10 41 (1.54%) Linux Command Line
11 38 (1.43%) Data Centre
11 38 (1.43%) Enterprise Software
12 36 (1.35%) Foreign Exchange (FX)
13 33 (1.24%) Market Risk
14 30 (1.13%) Mobile App
14 30 (1.13%) Reference Data
15 27 (1.01%) Replication
16 20 (0.75%) Semantic Web
17 18 (0.68%) Equities
17 18 (0.68%) Life Science
Operating Systems
1 454 (17.04%) Linux
2 238 (8.93%) Unix
3 60 (2.25%) Windows
4 51 (1.91%) Red Hat Enterprise Linux
5 43 (1.61%) CentOS
6 34 (1.28%) Ubuntu
7 13 (0.49%) Apple iOS
8 12 (0.45%) Android
9 9 (0.34%) Windows Server
10 6 (0.23%) AIX
11 4 (0.15%) Windows 10
12 3 (0.11%) Debian
12 3 (0.11%) Mac OS X
12 3 (0.11%) Windows Server 2003
12 3 (0.11%) Windows Server 2008
12 3 (0.11%) Windows Vista
13 2 (0.075%) Mesosphere
14 1 (0.038%) Solaris
14 1 (0.038%) Windows 7
14 1 (0.038%) Windows 8
Processes & Methodologies
1 964 (36.19%) Agile Software Development
2 728 (27.33%) Analytics
3 409 (15.35%) ETL
4 399 (14.98%) TDD
5 384 (14.41%) Business Intelligence
6 369 (13.85%) DevOps
7 314 (11.79%) Data Modelling
8 313 (11.75%) Scrum
9 311 (11.67%) Machine Learning
10 251 (9.42%) Continuous Integration
11 248 (9.31%) MapReduce
12 247 (9.27%) BDD
13 241 (9.05%) Open Source
14 235 (8.82%) Data Analytics
15 231 (8.67%) Visualisation
16 199 (7.47%) Test Automation
17 193 (7.24%) Data Architecture
18 186 (6.98%) Microservices
19 173 (6.49%) Migration
20 158 (5.93%) Data Analysis
Programming Languages
1 1,041 (39.08%) Java
2 787 (29.54%) Python
3 687 (25.79%) SQL
4 537 (20.16%) Scala
5 237 (8.90%) JavaScript
6 220 (8.26%) R
7 139 (5.22%) C#
8 120 (4.50%) Shell Script
9 97 (3.64%) Bash Shell
10 73 (2.74%) Ruby
11 70 (2.63%) PL/SQL
12 65 (2.44%) Perl
13 60 (2.25%) C++
14 50 (1.88%) C
15 42 (1.58%) Groovy
16 40 (1.50%) Go
17 31 (1.16%) T-SQL
18 23 (0.86%) Gremlin
19 22 (0.83%) VBA
20 21 (0.79%) MATLAB
Qualifications
1 255 (9.57%) Security Cleared
2 210 (7.88%) Degree
3 168 (6.31%) SC Cleared
4 59 (2.21%) DV Cleared
5 48 (1.80%) Computer Science Degree
6 37 (1.39%) PhD
7 27 (1.01%) Numerate Degree
8 21 (0.79%) CISSP
9 18 (0.68%) Master's Degree
10 10 (0.38%) BPSS Clearance
10 10 (0.38%) SANS
11 9 (0.34%) CEH
12 8 (0.30%) CTC Cleared
13 7 (0.26%) Microsoft Certification
14 6 (0.23%) CESG Certified Professional
14 6 (0.23%) CLAS
14 6 (0.23%) Postgraduate
15 5 (0.19%) CCNA
15 5 (0.19%) DBS Check
15 5 (0.19%) ISTQB
Quality Assurance & Compliance
1 164 (6.16%) Data Quality
2 134 (5.03%) QA
3 51 (1.91%) GDPR
4 28 (1.05%) GCP
5 18 (0.68%) MiFID
6 10 (0.38%) PMO
7 9 (0.34%) IFRS
8 8 (0.30%) IFRS 9
9 7 (0.26%) JSP 440
9 7 (0.26%) RMADS
10 6 (0.23%) Dodd-Frank
11 5 (0.19%) Disclosure Scotland
11 5 (0.19%) EMIR
11 5 (0.19%) ISO/IEC 20000
12 4 (0.15%) Actionable Recommendations
12 4 (0.15%) GAAP
12 4 (0.15%) Sarbanes-Oxley
12 4 (0.15%) SLA
13 2 (0.075%) PSD2
13 2 (0.075%) RosettaNet
System Software
1 380 (14.26%) HDFS
2 304 (11.41%) Docker
3 228 (8.56%) Apache Flume
4 99 (3.72%) Apache ZooKeeper
5 22 (0.83%) Active Directory
6 18 (0.68%) VMware Infrastructure
7 17 (0.64%) Oracle Clusterware
7 17 (0.64%) Oracle RAC
7 17 (0.64%) Virtual Machines
8 11 (0.41%) vCloud
9 5 (0.19%) Hyper-V
10 2 (0.075%) NFS
10 2 (0.075%) OpenDJ
10 2 (0.075%) OpenIDM
10 2 (0.075%) Virtual Servers
11 1 (0.038%) BitLocker
11 1 (0.038%) VMware ESXi
Systems Management
1 198 (7.43%) Oozie
2 185 (6.94%) Ansible
3 169 (6.34%) Hadoop YARN
4 123 (4.62%) Kubernetes
5 99 (3.72%) Puppet
6 91 (3.42%) Ambari
7 90 (3.38%) Terraform
8 63 (2.36%) Opscode Chef
9 47 (1.76%) Mesos
10 19 (0.71%) Data Guard
11 18 (0.68%) ITRS Geneos
11 18 (0.68%) Salt
12 17 (0.64%) Oracle Flashback
12 17 (0.64%) Oracle RMAN
13 13 (0.49%) Kibana
14 12 (0.45%) Rancher
15 10 (0.38%) Control-M
16 8 (0.30%) HP Quality Center
16 8 (0.30%) logstash
17 7 (0.26%) Rsyslog
Vendors
1 290 (10.89%) Cloudera
2 276 (10.36%) Oracle
3 200 (7.51%) Tableau
4 191 (7.17%) Hortonworks
5 149 (5.59%) Google
6 143 (5.37%) Microsoft
7 134 (5.03%) SAP
8 87 (3.27%) IBM
9 80 (3.00%) Informatica
10 79 (2.97%) Splunk
11 63 (2.36%) Teradata
12 62 (2.33%) Salesforce.com
13 59 (2.21%) MapR
14 57 (2.14%) Red Hat
15 42 (1.58%) Talend
16 29 (1.09%) VMware
17 24 (0.90%) Ab Initio
17 24 (0.90%) SaltStack
18 19 (0.71%) AppDynamics
19 18 (0.68%) Atlassian