Period
to 21 January 2018

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 21 January 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
21 Jan 2018
Same period 2017 Same period 2016
Rank 88 87 153
Rank change year-on-year -1 +66 +85
Contract jobs citing Big Data 2,641 2,515 1,755
As % of all contract IT jobs advertised in the UK 2.67% 2.62% 1.63%
As % of the Database & Business Intelligence category 12.17% 11.60% 7.06%
Number of daily rates quoted 1,826 1,649 1,216
UK median daily rate £550 £525 £520
Median daily rate % change year-on-year +4.76% +0.96% +4.00%
10th Percentile £396 £374 £363
90th Percentile £675 £700 £675
UK excluding London median daily rate £495 £488 £470
% change year-on-year +1.54% +3.72% -1.05%
Number of hourly rates quoted 15 13 9
UK median hourly rate £30.50 £45.00 £37.50
Median hourly rate % change year-on-year -32.22% +20.00% +14.50%
10th Percentile £17.72 £23.80 £20.18
90th Percentile £64.24 £97.35 £52.75
UK excluding London median hourly rate £30.50 £44.00 £46.50
% change year-on-year -30.68% -5.38% +24.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 21,709 21,676 24,865
As % of all contract IT jobs advertised in the UK 21.99% 22.57% 23.03%
Number of daily rates quoted 15,106 14,450 16,593
UK median daily rate £450 £425 £415
Median daily rate % change year-on-year +5.88% +2.41% +3.75%
10th Percentile £310 £288 £275
90th Percentile £625 £600 £588
UK excluding London median daily rate £400 £388 £375
% change year-on-year +3.23% +3.33% +7.14%
Number of hourly rates quoted 250 313 428
UK median hourly rate £30.63 £28.00 £30.00
Median hourly rate % change year-on-year +9.38% -6.67% +9.09%
10th Percentile £14.54 £10.00 £12.00
90th Percentile £55.72 £48.30 £52.50
UK excluding London median hourly rate £35.00 £26.50 £29.00
% change year-on-year +32.08% -8.62% +9.43%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 21 January 2018.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 21 January 2018.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 21 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -1 2,539 £550 +4.76% 895
London -15 1,693 £550 - 563
UK excluding London +42 920 £495 +1.54% 374
South East +48 437 £500 - 113
North of England +52 167 £500 +4.17% 81
Midlands +40 101 £475 - 48
North West +17 101 £550 +10.00% 50
South West -8 86 £500 +2.56% 38
Yorkshire +32 66 £475 +1.06% 23
East Midlands +46 60 £500 -6.98% 26
East of England -34 57 £488 +16.07% 48
Scotland -8 56 £400 -11.11% 22
West Midlands +10 41 £475 +5.56% 22
North East +56 17 £425 -5.56% 8
Wales +2 16 £435 -15.12% 20
Northern Ireland -16 8 - - 4

For the 6 months to 21 January 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Big Data.

1 1,436 (54.37%) Hadoop
2 1,112 (42.11%) Apache Spark
3 1,029 (38.96%) Java
4 948 (35.90%) Agile Software Development
5 779 (29.50%) Python
6 722 (27.34%) Analytics
7 684 (25.90%) SQL
8 635 (24.04%) Kafka
9 618 (23.40%) Finance
10 567 (21.47%) Apache Hive
11 537 (20.33%) Scala
12 467 (17.68%) Amazon AWS
13 450 (17.04%) Linux
14 444 (16.81%) HBase
15 406 (15.37%) ETL
16 399 (15.11%) Banking
17 389 (14.73%) TDD
18 381 (14.43%) Business Intelligence
19 380 (14.39%) HDFS
20 367 (13.90%) DevOps
21 348 (13.18%) NoSQL
22 331 (12.53%) Data Warehouse
23 313 (11.85%) Data Modelling
24 310 (11.74%) Scrum
25 309 (11.70%) Machine Learning
26 302 (11.44%) Analytical Skills
27 301 (11.40%) Docker
28 292 (11.06%) Jenkins
28 292 (11.06%) Cloudera
29 274 (10.37%) Oracle

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,112 (42.11%) Apache Spark
2 257 (9.73%) Apache
3 132 (5.00%) Apache Pig
4 113 (4.28%) Elasticsearch
5 102 (3.86%) SAS
6 94 (3.56%) Confluence
7 68 (2.57%) Apache Solr
8 57 (2.16%) Tomcat
9 33 (1.25%) nginx
10 28 (1.06%) SharePoint
11 24 (0.91%) Cloud Foundry
12 22 (0.83%) JBoss
12 22 (0.83%) WebSphere
13 18 (0.68%) OpenStack
14 17 (0.64%) Apache Airflow
15 13 (0.49%) GemFire
16 11 (0.42%) Oracle Coherence
17 10 (0.38%) ArcGIS
17 10 (0.38%) Luigi
17 10 (0.38%) WebSphere Application Server
Applications
1 56 (2.12%) Microsoft Excel
2 19 (0.72%) SPSS
3 18 (0.68%) Microsoft PowerPoint
4 16 (0.61%) MS Visio
5 13 (0.49%) Microsoft Office
6 10 (0.38%) Microsoft Project
6 10 (0.38%) Pipeline Pilot
7 9 (0.34%) Spreadsheet
8 7 (0.27%) Stata
9 1 (0.038%) Chatbot
9 1 (0.038%) EViews
9 1 (0.038%) Gephi
9 1 (0.038%) GNU Octave
9 1 (0.038%) HipChat
9 1 (0.038%) Mingle
9 1 (0.038%) Weka
Business Applications
1 13 (0.49%) Payment Gateway
2 10 (0.38%) Distributed Ledger
3 5 (0.19%) SAP APO
3 5 (0.19%) SAP ERP
4 4 (0.15%) Actimize
4 4 (0.15%) Oracle Retail
4 4 (0.15%) SAP CO
4 4 (0.15%) SAP FI
4 4 (0.15%) SAP FI/CO
4 4 (0.15%) SAP Oil and Gas
5 3 (0.11%) Dynamics CRM
5 3 (0.11%) Oracle BPM
5 3 (0.11%) WebTrends
6 2 (0.076%) HiPortfolio
6 2 (0.076%) Hyperion Planning
6 2 (0.076%) SAP BPC
6 2 (0.076%) SAP CRM
6 2 (0.076%) Summit
7 1 (0.038%) Oracle EBS R12
7 1 (0.038%) Oracle General Ledger
Cloud Services
1 467 (17.68%) Amazon AWS
2 184 (6.97%) Microsoft Azure
3 118 (4.47%) GitHub
4 99 (3.75%) Google Cloud Platform
5 65 (2.46%) PaaS
6 58 (2.20%) SaaS
7 41 (1.55%) Amazon EC2
7 41 (1.55%) Amazon S3
8 38 (1.44%) Bluemix
8 38 (1.44%) IBM Cloud
9 34 (1.29%) Cloud Computing
10 33 (1.25%) IaaS
11 30 (1.14%) Amazon EMR
12 29 (1.10%) Amazon Kinesis
13 25 (0.95%) Serverless
14 24 (0.91%) Virtual Private Cloud
15 23 (0.87%) Google Analytics
16 20 (0.76%) Google Tag Manager
17 17 (0.64%) Amazon CloudWatch
18 15 (0.57%) Azure Machine Learning
Communications & Networking
1 112 (4.24%) Kerberos
2 36 (1.36%) Internet
3 28 (1.06%) Firewall
4 26 (0.98%) Network Security
5 20 (0.76%) SSL
6 16 (0.61%) DNS
6 16 (0.61%) HTTP
7 13 (0.49%) TCP/IP
8 10 (0.38%) WAN
9 9 (0.34%) LAN
10 8 (0.30%) 4G
10 8 (0.30%) HTTPS
10 8 (0.30%) Wi-Fi
11 7 (0.27%) 3G
11 7 (0.27%) 5G
11 7 (0.27%) Bluetooth
11 7 (0.27%) RFID
11 7 (0.27%) VPN
11 7 (0.27%) ZigBee
11 7 (0.27%) Z-Wave
Database & Business Intelligence
1 1,436 (54.37%) Hadoop
2 567 (21.47%) Apache Hive
3 444 (16.81%) HBase
4 348 (13.18%) NoSQL
5 331 (12.53%) Data Warehouse
6 213 (8.07%) MongoDB
7 196 (7.42%) Sqoop
8 191 (7.23%) SQL Server
9 184 (6.97%) Relational Database
10 183 (6.93%) PostgreSQL
11 178 (6.74%) Impala
12 162 (6.13%) Apache Cassandra
13 153 (5.79%) Data Lake
14 82 (3.10%) Data Mining
15 74 (2.80%) RDBMS
16 69 (2.61%) Amazon Redshift
17 66 (2.50%) MySQL
18 65 (2.46%) SQL Server Integration Services
19 58 (2.20%) BusinessObjects
20 55 (2.08%) Power BI
Development Applications
1 292 (11.06%) Jenkins
2 256 (9.69%) Git (software)
3 210 (7.95%) JIRA
4 87 (3.29%) Cucumber
5 64 (2.42%) Maven
6 51 (1.93%) Gradle
7 45 (1.70%) JUnit
8 43 (1.63%) TeamCity
9 42 (1.59%) Selenium
10 35 (1.33%) Subversion
11 34 (1.29%) Team Foundation Server
12 32 (1.21%) Visual Studio
13 29 (1.10%) GitLab
14 27 (1.02%) IntelliJ
14 27 (1.02%) Sonatype Nexus
15 22 (0.83%) WebDriver
16 21 (0.80%) NUnit
16 21 (0.80%) Vagrant
17 18 (0.68%) Ant
18 17 (0.64%) SonarQube
General
1 618 (23.40%) Finance
2 399 (15.11%) Banking
3 138 (5.23%) Telecoms
4 132 (5.00%) Retail
5 122 (4.62%) Marketing
6 102 (3.86%) Investment Banking
7 85 (3.22%) Manufacturing
8 52 (1.97%) Front Office
9 51 (1.93%) Electronics
10 39 (1.48%) Retail Banking
11 38 (1.44%) Publishing
12 32 (1.21%) Games
13 24 (0.91%) Financial Institution
14 23 (0.87%) Legal
15 18 (0.68%) French Language
16 16 (0.61%) Law
17 14 (0.53%) Advertising
18 12 (0.45%) Automotive
19 9 (0.34%) Back Office
20 7 (0.27%) Pharmaceutical
Job Titles
1 831 (31.47%) Developer
2 400 (15.15%) Data Engineer
3 387 (14.65%) Architect
4 314 (11.89%) Big Data Engineer
5 303 (11.47%) Big Data Developer
6 269 (10.19%) Java Developer
7 232 (8.78%) Data Architect
8 212 (8.03%) Analyst
9 141 (5.34%) Big Data Architect
10 140 (5.30%) Hadoop Engineer
11 133 (5.04%) Consultant
12 130 (4.92%) Scala Developer
13 122 (4.62%) Data Scientist
14 112 (4.24%) Hadoop Developer
15 105 (3.98%) DevOps Engineer
16 99 (3.75%) Senior Developer
17 88 (3.33%) Apache Spark Developer
17 88 (3.33%) Data Analyst
18 82 (3.10%) Solutions Architect
19 76 (2.88%) Business Analyst
Libraries, Frameworks & Software Standards
1 635 (24.04%) Kafka
2 228 (8.63%) Web Services
3 202 (7.65%) REST
4 199 (7.54%) Spring
5 193 (7.31%) RESTful
6 179 (6.78%) JSON
7 118 (4.47%) XML
8 104 (3.94%) Spring Boot
9 103 (3.90%) HTML
10 101 (3.82%) AngularJS
11 95 (3.60%) React
12 93 (3.52%) Spark Streaming
13 91 (3.45%) PySpark
14 86 (3.26%) CSS
15 84 (3.18%) .NET
16 79 (2.99%) Node.js
17 76 (2.88%) HTML5
18 72 (2.73%) J2EE
19 68 (2.57%) Akka
20 64 (2.42%) Middleware
Miscellaneous
1 302 (11.44%) Analytical Skills
2 147 (5.57%) Computer Science
3 127 (4.81%) Algorithms
4 111 (4.20%) Greenfield Project
5 65 (2.46%) User Experience
6 61 (2.31%) Data Structures
7 49 (1.86%) Management Information System
8 47 (1.78%) Virtual Team
9 45 (1.70%) Fintech
10 41 (1.55%) Linux Command Line
11 38 (1.44%) Data Centre
11 38 (1.44%) Enterprise Software
12 35 (1.33%) Foreign Exchange (FX)
13 32 (1.21%) Market Risk
14 29 (1.10%) Mobile App
14 29 (1.10%) Reference Data
15 27 (1.02%) Replication
16 19 (0.72%) Semantic Web
17 18 (0.68%) Equities
17 18 (0.68%) Life Science
Operating Systems
1 450 (17.04%) Linux
2 234 (8.86%) Unix
3 60 (2.27%) Windows
4 51 (1.93%) Red Hat Enterprise Linux
5 44 (1.67%) CentOS
6 34 (1.29%) Ubuntu
7 13 (0.49%) Apple iOS
8 12 (0.45%) Android
9 9 (0.34%) Windows Server
10 6 (0.23%) AIX
11 4 (0.15%) Windows 10
12 3 (0.11%) Debian
12 3 (0.11%) Mac OS X
12 3 (0.11%) Windows Server 2003
12 3 (0.11%) Windows Server 2008
12 3 (0.11%) Windows Vista
13 2 (0.076%) Mesosphere
14 1 (0.038%) Solaris
14 1 (0.038%) Windows 7
14 1 (0.038%) Windows 8
Processes & Methodologies
1 948 (35.90%) Agile Software Development
2 722 (27.34%) Analytics
3 406 (15.37%) ETL
4 389 (14.73%) TDD
5 381 (14.43%) Business Intelligence
6 367 (13.90%) DevOps
7 313 (11.85%) Data Modelling
8 310 (11.74%) Scrum
9 309 (11.70%) Machine Learning
10 246 (9.31%) Continuous Integration
10 246 (9.31%) MapReduce
11 241 (9.13%) Open Source
12 239 (9.05%) BDD
13 231 (8.75%) Data Analytics
13 231 (8.75%) Visualisation
14 192 (7.27%) Test Automation
15 191 (7.23%) Data Architecture
16 184 (6.97%) Microservices
17 173 (6.55%) Migration
18 158 (5.98%) Data Analysis
Programming Languages
1 1,029 (38.96%) Java
2 779 (29.50%) Python
3 684 (25.90%) SQL
4 537 (20.33%) Scala
5 234 (8.86%) JavaScript
6 217 (8.22%) R
7 138 (5.23%) C#
8 120 (4.54%) Shell Script
9 97 (3.67%) Bash Shell
10 70 (2.65%) PL/SQL
10 70 (2.65%) Ruby
11 65 (2.46%) Perl
12 60 (2.27%) C++
13 50 (1.89%) C
14 42 (1.59%) Groovy
15 39 (1.48%) Go
16 30 (1.14%) T-SQL
17 23 (0.87%) Gremlin
18 21 (0.80%) VBA
19 20 (0.76%) PHP
Qualifications
1 255 (9.66%) Security Cleared
2 207 (7.84%) Degree
3 168 (6.36%) SC Cleared
4 59 (2.23%) DV Cleared
5 48 (1.82%) Computer Science Degree
6 37 (1.40%) PhD
7 27 (1.02%) Numerate Degree
8 21 (0.80%) CISSP
9 18 (0.68%) Master's Degree
10 10 (0.38%) BPSS Clearance
10 10 (0.38%) SANS
11 9 (0.34%) CEH
12 8 (0.30%) CTC Cleared
13 7 (0.27%) Microsoft Certification
14 6 (0.23%) CESG Certified Professional
14 6 (0.23%) CLAS
14 6 (0.23%) Postgraduate
15 5 (0.19%) Cisco Certification
15 5 (0.19%) DBS Check
15 5 (0.19%) PMP
Quality Assurance & Compliance
1 164 (6.21%) Data Quality
2 130 (4.92%) QA
3 51 (1.93%) GDPR
4 28 (1.06%) GCP
5 16 (0.61%) MiFID
6 10 (0.38%) PMO
7 9 (0.34%) IFRS
8 8 (0.30%) IFRS 9
9 7 (0.27%) JSP 440
9 7 (0.27%) RMADS
10 5 (0.19%) Disclosure Scotland
10 5 (0.19%) Dodd-Frank
10 5 (0.19%) ISO/IEC 20000
11 4 (0.15%) Actionable Recommendations
11 4 (0.15%) EMIR
11 4 (0.15%) GAAP
11 4 (0.15%) Sarbanes-Oxley
11 4 (0.15%) SLA
12 2 (0.076%) PSD2
12 2 (0.076%) RosettaNet
System Software
1 380 (14.39%) HDFS
2 301 (11.40%) Docker
3 229 (8.67%) Apache Flume
4 97 (3.67%) Apache ZooKeeper
5 22 (0.83%) Active Directory
6 18 (0.68%) VMware Infrastructure
7 17 (0.64%) Oracle Clusterware
7 17 (0.64%) Oracle RAC
7 17 (0.64%) Virtual Machines
8 11 (0.42%) vCloud
9 5 (0.19%) Hyper-V
10 2 (0.076%) NFS
10 2 (0.076%) OpenDJ
10 2 (0.076%) OpenIDM
10 2 (0.076%) Virtual Servers
11 1 (0.038%) BitLocker
11 1 (0.038%) VMware ESXi
Systems Management
1 198 (7.50%) Oozie
2 185 (7.00%) Ansible
3 169 (6.40%) Hadoop YARN
4 122 (4.62%) Kubernetes
5 98 (3.71%) Puppet
6 90 (3.41%) Ambari
7 88 (3.33%) Terraform
8 63 (2.39%) Opscode Chef
9 47 (1.78%) Mesos
10 19 (0.72%) Data Guard
11 18 (0.68%) Salt
12 17 (0.64%) ITRS Geneos
12 17 (0.64%) Oracle Flashback
12 17 (0.64%) Oracle RMAN
13 13 (0.49%) Kibana
14 12 (0.45%) Rancher
15 10 (0.38%) Control-M
16 8 (0.30%) HP Quality Center
16 8 (0.30%) logstash
17 6 (0.23%) Rsyslog
Vendors
1 292 (11.06%) Cloudera
2 274 (10.37%) Oracle
3 199 (7.54%) Tableau
4 191 (7.23%) Hortonworks
5 149 (5.64%) Google
6 143 (5.41%) Microsoft
7 133 (5.04%) SAP
8 86 (3.26%) IBM
9 80 (3.03%) Informatica
10 77 (2.92%) Splunk
11 63 (2.39%) Teradata
12 62 (2.35%) Salesforce.com
13 59 (2.23%) MapR
14 57 (2.16%) Red Hat
15 43 (1.63%) Talend
16 29 (1.10%) VMware
17 24 (0.91%) Ab Initio
17 24 (0.91%) SaltStack
18 18 (0.68%) AppDynamics
18 18 (0.68%) Tealium