Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 25 September 2017

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 25 September 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
25 Sep 2017		 Same period 2016 Same period 2015
Rank 91 133 196
Rank change year-on-year +42 +63 +77
Contract jobs citing Big Data 2600 2011 1491
As % of all contract IT jobs advertised in the UK 2.65% 1.90% 1.31%
As % of the Database & Business Intelligence category 11.82% 8.52% 5.63%
Number of daily rates quoted 1795 1339 1036
UK median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% - -
10th Percentile £370 £363 £363
90th Percentile £675 £700 £700
UK excluding London median daily rate £463 £450 £475
% change year-on-year +2.78% -5.26% +5.56%
Number of hourly rates quoted 13 12 4
UK median hourly rate £40.00 £42.84 £27.08
Median hourly rate % change year-on-year -6.63% +58.20% -9.73%
10th Percentile £16.64 £21.55 £15.50
90th Percentile £54.88 £46.00 £46.63
UK excluding London median hourly rate £40.00 £42.84 £16.66
% change year-on-year -6.63% +157.14% -18.73%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 21990 23596 26474
As % of all contract IT jobs advertised in the UK 22.39% 22.27% 23.22%
Number of daily rates quoted 14676 15790 17425
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +3.23%
10th Percentile £305 £281 £263
90th Percentile £625 £600 £575
UK excluding London median daily rate £400 £375 £375
% change year-on-year +6.67% - +7.14%
Number of hourly rates quoted 276 384 385
UK median hourly rate £29.56 £30.10 £29.50
Median hourly rate % change year-on-year -1.80% +2.04% +11.32%
10th Percentile £12.50 £11.25 £13.85
90th Percentile £53.75 £48.64 £52.35
UK excluding London median hourly rate £31.00 £29.76 £30.00
% change year-on-year +4.16% -0.79% +20.00%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 25 September 2017.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 25 September 2017.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 25 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +37 2466 £550 +4.76% 251
London +24 1737 £550 - 162
UK excluding London +67 839 £463 +2.78% 101
South East +44 353 £478 +1.78% 27
North of England +72 160 £460 -0.54% 27
North West +39 89 £575 +29.94% 23
Midlands +43 78 £450 -10.00% 11
Scotland +41 76 £400 -11.11% 9
East of England -10 70 £488 +34.48% 14
Yorkshire +54 69 £470 -6.00% 4
South West -14 63 £520 +34.19% 10
West Midlands +29 44 £450 -10.00% 6
Northern Ireland -20 35 £405 - 1
East Midlands +17 32 £463 +5.71% 5
North East +72 15 £610 +35.56%
Wales -6 12 £525 +40.00% 2

For the 6 months to 25 September 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Big Data.

1 1460 (56.15%) Hadoop
2 1089 (41.88%) Java
3 1030 (39.62%) Apache Spark
4 1023 (39.35%) Agile Software Development
5 763 (29.35%) Python
6 730 (28.08%) Analytics
7 694 (26.69%) Finance
8 675 (25.96%) SQL
9 581 (22.35%) Apache Hive
10 558 (21.46%) Kafka
11 505 (19.42%) Scala
12 488 (18.77%) TDD
13 446 (17.15%) HBase
14 443 (17.04%) Banking
15 436 (16.77%) Linux
16 424 (16.31%) Amazon AWS
17 400 (15.38%) Scrum
18 390 (15.00%) ETL
19 370 (14.23%) Business Intelligence
20 367 (14.12%) DevOps
21 356 (13.69%) NoSQL
22 322 (12.38%) Analytical Skills
23 318 (12.23%) MapReduce
24 316 (12.15%) HDFS
25 303 (11.65%) Data Modelling
26 299 (11.50%) Machine Learning
27 287 (11.04%) BDD
28 282 (10.85%) Git (software)
29 280 (10.77%) Data Warehouse
29 280 (10.77%) Jenkins

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1030 (39.62%) Apache Spark
2 250 (9.62%) Apache
3 155 (5.96%) Apache Pig
4 129 (4.96%) Elasticsearch
5 125 (4.81%) Apache Solr
6 117 (4.50%) SAS
7 114 (4.38%) Confluence
8 40 (1.54%) Tomcat
9 37 (1.42%) OpenStack
10 31 (1.19%) JBoss
11 22 (0.85%) WebSphere
12 21 (0.81%) nginx
13 17 (0.65%) Oracle SOA Suite
14 15 (0.58%) Cloud Foundry
15 11 (0.42%) Apache Airflow
15 11 (0.42%) GlassFish
15 11 (0.42%) WildFly
16 10 (0.38%) SharePoint
17 9 (0.35%) ArcGIS
17 9 (0.35%) WebLogic
Applications
1 51 (1.96%) Microsoft Excel
2 26 (1.00%) SPSS
3 19 (0.73%) Microsoft PowerPoint
4 12 (0.46%) Microsoft Office
5 11 (0.42%) Stata
6 9 (0.35%) MS Visio
7 6 (0.23%) Microsoft Project
7 6 (0.23%) Photoshop
8 5 (0.19%) Pipeline Pilot
8 5 (0.19%) Spreadsheet
9 3 (0.12%) Mingle
10 2 (0.077%) InVision
10 2 (0.077%) S-PLUS
11 1 (0.038%) EViews
11 1 (0.038%) GNU Octave
11 1 (0.038%) Weka
Business Applications
1 12 (0.46%) Actimize
2 7 (0.27%) WebTrends
3 4 (0.15%) Oracle BPM
4 3 (0.12%) Bloomberg TOMS
4 3 (0.12%) Eagle PACE
5 2 (0.077%) Cognos Business Intelligence
5 2 (0.077%) Hyperion Planning
5 2 (0.077%) Markit EDM
6 1 (0.038%) Cognos TM1
6 1 (0.038%) Dynamics NAV
6 1 (0.038%) HFM
6 1 (0.038%) Hyperion Enterprise
6 1 (0.038%) NetSuite
6 1 (0.038%) Oracle EBS
6 1 (0.038%) Oracle General Ledger
6 1 (0.038%) Oracle Payables
6 1 (0.038%) Oracle Receivables
6 1 (0.038%) SAP CRM
6 1 (0.038%) SessionCam
6 1 (0.038%) Social Studio
Cloud Services
1 424 (16.31%) Amazon AWS
2 144 (5.54%) Microsoft Azure
3 119 (4.58%) GitHub
4 71 (2.73%) Google Cloud Platform
5 47 (1.81%) Amazon EC2
6 45 (1.73%) IBM Cloud
7 43 (1.65%) SaaS
8 41 (1.58%) Cloud Computing
8 41 (1.58%) PaaS
9 39 (1.50%) Amazon S3
9 39 (1.50%) Virtual Private Cloud
10 38 (1.46%) Bluemix
11 31 (1.19%) Amazon EMR
12 28 (1.08%) Google Analytics
13 26 (1.00%) IaaS
14 21 (0.81%) AWS CloudFormation
15 20 (0.77%) AWS Lambda
16 17 (0.65%) Office 365
17 16 (0.62%) Amazon CloudWatch
18 10 (0.38%) Route 53
Communications & Networking
1 99 (3.81%) Kerberos
2 42 (1.62%) Firewall
3 35 (1.35%) WAN
4 31 (1.19%) LAN
5 25 (0.96%) HTTP
6 22 (0.85%) Internet
7 20 (0.77%) Network Security
8 19 (0.73%) VPN
9 17 (0.65%) DNS
10 16 (0.62%) LDAP
10 16 (0.62%) SSL
11 15 (0.58%) 4G
12 14 (0.54%) 3G
13 12 (0.46%) SAN
13 12 (0.46%) Wi-Fi
14 11 (0.42%) 5G
14 11 (0.42%) Bluetooth
14 11 (0.42%) RFID
14 11 (0.42%) ZigBee
15 10 (0.38%) NAS
Database & Business Intelligence
1 1460 (56.15%) Hadoop
2 581 (22.35%) Apache Hive
3 446 (17.15%) HBase
4 356 (13.69%) NoSQL
5 280 (10.77%) Data Warehouse
6 270 (10.38%) MongoDB
7 240 (9.23%) Apache Cassandra
8 193 (7.42%) SQL Server
9 188 (7.23%) Impala
10 176 (6.77%) PostgreSQL
11 174 (6.69%) Sqoop
12 168 (6.46%) Relational Database
13 86 (3.31%) MySQL
14 84 (3.23%) Data Lake
15 68 (2.62%) Data Mining
15 68 (2.62%) RDBMS
15 68 (2.62%) SQL Server Integration Services
16 52 (2.00%) Amazon Redshift
17 51 (1.96%) BusinessObjects
18 42 (1.62%) SQL Server Reporting Services
Development Applications
1 282 (10.85%) Git (software)
2 280 (10.77%) Jenkins
3 271 (10.42%) JIRA
4 121 (4.65%) Cucumber
5 74 (2.85%) Maven
6 52 (2.00%) JUnit
7 51 (1.96%) Gradle
8 44 (1.69%) Talend Open Studio
9 42 (1.62%) Team Foundation Server
10 37 (1.42%) NUnit
10 37 (1.42%) Subversion
11 35 (1.35%) Mockito
12 34 (1.31%) Vagrant
13 33 (1.27%) GitLab
13 33 (1.27%) IntelliJ
14 32 (1.23%) Selenium
14 32 (1.23%) TeamCity
15 31 (1.19%) Visual Studio
16 28 (1.08%) Ant
16 28 (1.08%) Eclipse
General
1 694 (26.69%) Finance
2 443 (17.04%) Banking
3 145 (5.58%) Investment Banking
4 144 (5.54%) Marketing
5 133 (5.12%) Telecoms
6 105 (4.04%) Retail
7 99 (3.81%) Front Office
8 62 (2.38%) Manufacturing
9 60 (2.31%) Electronics
10 26 (1.00%) Legal
11 22 (0.85%) Financial Institution
11 22 (0.85%) Retail Banking
12 20 (0.77%) Games
13 18 (0.69%) Advertising
14 16 (0.62%) Publishing
15 14 (0.54%) Back Office
16 11 (0.42%) French Language
17 9 (0.35%) Law
18 8 (0.31%) Pharmaceutical
19 7 (0.27%) Corporate Banking
Job Titles
1 917 (35.27%) Developer
2 379 (14.58%) Architect
3 366 (14.08%) Data Engineer
4 343 (13.19%) Big Data Developer
5 327 (12.58%) Java Developer
6 304 (11.69%) Big Data Engineer
7 223 (8.58%) Analyst
8 219 (8.42%) Data Architect
9 148 (5.69%) Scala Developer
10 137 (5.27%) Hadoop Engineer
11 133 (5.12%) Hadoop Developer
12 125 (4.81%) Big Data Architect
13 107 (4.12%) Consultant
14 97 (3.73%) Data Scientist
15 96 (3.69%) Senior Developer
16 94 (3.62%) DevOps Engineer
17 93 (3.58%) Data Analyst
18 91 (3.50%) Java Engineer
19 86 (3.31%) Business Analyst
20 84 (3.23%) Apache Spark Developer
Libraries, Frameworks & Software Standards
1 558 (21.46%) Kafka
2 267 (10.27%) REST
3 250 (9.62%) Spring
4 223 (8.58%) Web Services
5 195 (7.50%) JSON
6 163 (6.27%) RESTful
7 144 (5.54%) HTML
8 139 (5.35%) Spring Boot
9 127 (4.88%) AngularJS
10 115 (4.42%) HTML5
11 112 (4.31%) CSS
12 104 (4.00%) .NET
13 94 (3.62%) Spark Streaming
14 87 (3.35%) Akka
15 85 (3.27%) XML
16 78 (3.00%) Drools
17 69 (2.65%) Apache Camel
18 63 (2.42%) Hibernate
19 60 (2.31%) React
20 57 (2.19%) Node.js
Miscellaneous
1 322 (12.38%) Analytical Skills
2 153 (5.88%) Algorithms
3 109 (4.19%) Computer Science
4 90 (3.46%) Greenfield Project
5 57 (2.19%) User Experience
6 55 (2.12%) Market Risk
7 53 (2.04%) Foreign Exchange (FX)
8 50 (1.92%) Data Structures
9 41 (1.58%) Enterprise Software
9 41 (1.58%) Management Information System
10 40 (1.54%) Virtual Team
11 39 (1.50%) Linux Command Line
12 38 (1.46%) Fintech
12 38 (1.46%) Reference Data
13 34 (1.31%) Data Centre
14 32 (1.23%) Mobile App
15 29 (1.12%) Credit Risk
16 27 (1.04%) Equities
17 23 (0.88%) Replication
18 21 (0.81%) Derivative
Operating Systems
1 436 (16.77%) Linux
2 264 (10.15%) Unix
3 87 (3.35%) Windows
4 40 (1.54%) Red Hat Enterprise Linux
5 39 (1.50%) CentOS
6 31 (1.19%) Ubuntu
7 21 (0.81%) Android
7 21 (0.81%) Apple iOS
8 17 (0.65%) Solaris
9 10 (0.38%) AIX
10 8 (0.31%) Windows Server
10 8 (0.31%) Windows Vista
11 4 (0.15%) Mac OS X
11 4 (0.15%) Windows Server 2003
12 2 (0.077%) Debian
12 2 (0.077%) Windows Server 2008
13 1 (0.038%) Fedora
13 1 (0.038%) MVS
13 1 (0.038%) Windows 2000 Server
13 1 (0.038%) Windows Server 2012
Processes & Methodologies
1 1023 (39.35%) Agile Software Development
2 730 (28.08%) Analytics
3 488 (18.77%) TDD
4 400 (15.38%) Scrum
5 390 (15.00%) ETL
6 370 (14.23%) Business Intelligence
7 367 (14.12%) DevOps
8 318 (12.23%) MapReduce
9 303 (11.65%) Data Modelling
10 299 (11.50%) Machine Learning
11 287 (11.04%) BDD
12 257 (9.88%) Data Analytics
12 257 (9.88%) Open Source
13 246 (9.46%) Continuous Integration
14 237 (9.12%) Microservices
15 224 (8.62%) Data Architecture
16 194 (7.46%) Visualisation
17 172 (6.62%) Software Engineering
18 170 (6.54%) Test Automation
19 144 (5.54%) Big Data Analytics
Programming Languages
1 1089 (41.88%) Java
2 763 (29.35%) Python
3 675 (25.96%) SQL
4 505 (19.42%) Scala
5 220 (8.46%) JavaScript
6 199 (7.65%) R
7 141 (5.42%) C#
8 136 (5.23%) Shell Script
9 97 (3.73%) Bash Shell
10 63 (2.42%) Perl
11 51 (1.96%) Ruby
12 45 (1.73%) C++
13 41 (1.58%) T-SQL
14 40 (1.54%) TypeScript
15 34 (1.31%) PowerShell
16 32 (1.23%) C
16 32 (1.23%) MATLAB
17 30 (1.15%) Go
18 29 (1.12%) Groovy
19 27 (1.04%) PL/SQL
Qualifications
1 237 (9.12%) Security Cleared
2 178 (6.85%) Degree
3 164 (6.31%) SC Cleared
4 42 (1.62%) DV Cleared
5 39 (1.50%) Computer Science Degree
6 27 (1.04%) PhD
7 23 (0.88%) CISSP
8 18 (0.69%) Numerate Degree
9 16 (0.62%) Master's Degree
10 14 (0.54%) SANS
11 13 (0.50%) CEH
12 10 (0.38%) Cisco Certification
13 9 (0.35%) CCNA
13 9 (0.35%) Microsoft Certification
14 8 (0.31%) BPSS Clearance
14 8 (0.31%) MCITP
14 8 (0.31%) MCSE
14 8 (0.31%) Postgraduate
15 7 (0.27%) CESG Certified Professional
15 7 (0.27%) CLAS
Quality Assurance & Compliance
1 140 (5.38%) QA
2 122 (4.69%) Data Quality
3 27 (1.04%) GDPR
4 24 (0.92%) MiFID
5 15 (0.58%) GCP
6 9 (0.35%) Actionable Recommendations
6 9 (0.35%) Dodd-Frank
7 7 (0.27%) EMIR
7 7 (0.27%) JSP 440
7 7 (0.27%) PMO
8 5 (0.19%) IFRS
8 5 (0.19%) IFRS 9
8 5 (0.19%) ISO/IEC 27001
8 5 (0.19%) SLA
9 3 (0.12%) ISAE 3402
9 3 (0.12%) PCI DSS
9 3 (0.12%) SSAE 16
10 2 (0.077%) CDISC
10 2 (0.077%) COBIT
10 2 (0.077%) ISO/IEC 20000
System Software
1 316 (12.15%) HDFS
2 246 (9.46%) Docker
3 211 (8.12%) Apache Flume
4 101 (3.88%) Apache ZooKeeper
5 25 (0.96%) Active Directory
6 22 (0.85%) VMware Infrastructure
7 15 (0.58%) Hyper-V
8 11 (0.42%) Virtual Machines
9 7 (0.27%) OpenAM
10 5 (0.19%) vCloud
11 3 (0.12%) Oracle RAC
12 2 (0.077%) NFS
12 2 (0.077%) OpenDJ
12 2 (0.077%) OpenIDM
12 2 (0.077%) VMware ESXi
12 2 (0.077%) vSphere
12 2 (0.077%) Xen
13 1 (0.038%) OpenSSH
13 1 (0.038%) PowerHA
13 1 (0.038%) Virtual Servers
Systems Management
1 180 (6.92%) Ansible
2 156 (6.00%) Hadoop YARN
3 136 (5.23%) Oozie
4 112 (4.31%) Kubernetes
4 112 (4.31%) Terraform
5 105 (4.04%) Puppet
6 70 (2.69%) Ambari
7 61 (2.35%) Opscode Chef
8 23 (0.88%) Mesos
9 17 (0.65%) Graphite
9 17 (0.65%) Prometheus
10 16 (0.62%) Kibana
11 15 (0.58%) Control-M
12 14 (0.54%) Rsyslog
13 12 (0.46%) Nagios
13 12 (0.46%) SCCM
14 11 (0.42%) logstash
14 11 (0.42%) SCOM
15 10 (0.38%) ITRS Geneos
16 8 (0.31%) Microsoft Clustering
Vendors
1 260 (10.00%) Cloudera
2 234 (9.00%) Oracle
3 173 (6.65%) Tableau
4 123 (4.73%) Microsoft
5 120 (4.62%) Google
6 116 (4.46%) Hortonworks
7 109 (4.19%) SAP
8 103 (3.96%) Splunk
9 100 (3.85%) IBM
10 84 (3.23%) Teradata
11 75 (2.88%) Informatica
12 60 (2.31%) Red Hat
13 44 (1.69%) Talend
14 40 (1.54%) MapR
15 36 (1.38%) VMware
16 29 (1.12%) Salesforce.com
17 25 (0.96%) Ab Initio
17 25 (0.96%) TIBCO
18 22 (0.85%) HP
19 16 (0.62%) SaltStack