Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 24 May 2018

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 24 May 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
24 May 2018		 Same period 2017 Same period 2016
Rank 81 89 171
Rank change year-on-year +8 +82 +49
Contract jobs citing Big Data 2,941 2,344 1,679
As % of all contract IT jobs advertised in the UK 2.92% 2.59% 1.59%
As % of the Database & Business Intelligence category 13.01% 11.51% 7.22%
Number of daily rates quoted 2,036 1,614 1,204
UK median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% - -
10th Percentile £400 £350 £363
90th Percentile £688 £675 £681
UK excluding London median daily rate £498 £475 £470
% change year-on-year +4.74% +1.06% -5.76%
Number of hourly rates quoted 8 6 6
UK median hourly rate £46.25 £47.00 £24.25
Median hourly rate % change year-on-year -1.60% +93.81% -11.22%
10th Percentile £22.25 £32.50 £20.33
90th Percentile £73.75 £50.00 £38.26
UK excluding London median hourly rate £44.00 £47.00 £33.06
% change year-on-year -6.38% +42.19% +30.91%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 22,607 20,370 23,255
As % of all contract IT jobs advertised in the UK 22.43% 22.55% 22.02%
Number of daily rates quoted 15,754 13,609 15,715
UK median daily rate £473 £437 £425
Median daily rate % change year-on-year +8.12% +2.82% +6.25%
10th Percentile £313 £295 £276
90th Percentile £625 £613 £600
UK excluding London median daily rate £415 £390 £375
% change year-on-year +6.34% +4.00% +2.74%
Number of hourly rates quoted 230 251 378
UK median hourly rate £33.00 £30.00 £27.75
Median hourly rate % change year-on-year +10.00% +8.11% -3.28%
10th Percentile £13.98 £9.25 £12.14
90th Percentile £53.53 £50.00 £52.58
UK excluding London median hourly rate £33.50 £29.50 £27.00
% change year-on-year +13.56% +9.26% +1.89%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 24 May 2018.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 24 May 2018.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 24 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +9 2,815 £550 +4.76% 882
London -9 1,768 £560 +1.82% 570
UK excluding London +53 1,133 £498 +4.74% 377
South East +44 513 £500 +5.26% 102
North of England +63 258 £500 +5.26% 86
Yorkshire +74 138 £475 - 28
North West +3 110 £550 +15.79% 50
Midlands +40 97 £475 +11.76% 42
South West +21 93 £474 -5.25% 41
East of England 0 78 £450 - 41
East Midlands +39 71 £475 +18.75% 16
Scotland 0 67 £430 +7.50% 50
West Midlands -7 26 £475 +8.57% 26
Northern Ireland +10 19 £432 +5.24% 7
North East +8 12 £625 +56.25% 8
Wales -23 11 £465 -9.27% 8

For the 6 months to 24 May 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 1,488 (50.60%) Hadoop
2 1,127 (38.32%) Agile Software Development
3 1,125 (38.25%) Apache Spark
4 1,031 (35.06%) Java
5 988 (33.59%) Python
6 915 (31.11%) Analytics
7 808 (27.47%) SQL
8 754 (25.64%) Kafka
9 716 (24.35%) Finance
10 661 (22.48%) Apache Hive
11 614 (20.88%) Scala
12 594 (20.20%) Amazon AWS
13 559 (19.01%) Linux
14 507 (17.24%) Data Warehouse
15 490 (16.66%) ETL
16 471 (16.01%) DevOps
17 464 (15.78%) NoSQL
18 436 (14.82%) Business Intelligence
19 435 (14.79%) Data Science
20 422 (14.35%) HBase
21 403 (13.70%) Data Modelling
22 401 (13.63%) Machine Learning
23 387 (13.16%) Scrum
24 365 (12.41%) SQL Server
25 359 (12.21%) Microsoft Azure
26 357 (12.14%) Jenkins
27 350 (11.90%) TDD
28 330 (11.22%) Cloudera
29 327 (11.12%) Docker
30 322 (10.95%) Analytical Skills

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,125 (38.25%) Apache Spark
2 322 (10.95%) Apache
3 171 (5.81%) Elasticsearch
4 164 (5.58%) Apache Pig
5 94 (3.20%) SAS
6 87 (2.96%) Confluence
7 59 (2.01%) Apache Solr
8 46 (1.56%) Tomcat
9 43 (1.46%) nginx
10 34 (1.16%) Cloud Foundry
11 23 (0.78%) OpenStack
12 21 (0.71%) Apache Airflow
13 20 (0.68%) SharePoint
14 14 (0.48%) JBoss
14 14 (0.48%) Oracle SOA Suite
14 14 (0.48%) WebSphere
15 10 (0.34%) Luigi
16 9 (0.31%) CMS
16 9 (0.31%) GemFire
16 9 (0.31%) IIS
Applications
1 76 (2.58%) Microsoft Excel
2 28 (0.95%) Microsoft PowerPoint
3 20 (0.68%) MS Visio
4 13 (0.44%) Microsoft Office
4 13 (0.44%) SPSS
5 8 (0.27%) HipChat
6 7 (0.24%) Spreadsheet
7 6 (0.20%) Chatbot
8 4 (0.14%) Microsoft Project
9 3 (0.10%) Adobe Illustrator
9 3 (0.10%) InVision
10 2 (0.068%) Stata
11 1 (0.034%) GIMP
11 1 (0.034%) Photoshop
11 1 (0.034%) Shockwave
Business Applications
1 22 (0.75%) SAP Oil and Gas
2 5 (0.17%) Markit EDM
2 5 (0.17%) SAP APO
2 5 (0.17%) SAP ERP
3 4 (0.14%) Distributed Ledger
3 4 (0.14%) HiPortfolio
3 4 (0.14%) Oracle Financials
3 4 (0.14%) Oracle Retail
3 4 (0.14%) Summit
4 3 (0.10%) Eloqua
4 3 (0.10%) ION MarketView
5 2 (0.068%) Actimize
5 2 (0.068%) Adobe Campaign
5 2 (0.068%) Dynamics CRM
5 2 (0.068%) FastStats
5 2 (0.068%) Payment Gateway
5 2 (0.068%) Relativity
5 2 (0.068%) Salesforce.com CRM
5 2 (0.068%) Unica
6 1 (0.034%) FLEXCUBE
Cloud Services
1 594 (20.20%) Amazon AWS
2 359 (12.21%) Microsoft Azure
3 122 (4.15%) Google Cloud Platform
4 87 (2.96%) GitHub
5 71 (2.41%) Amazon S3
6 68 (2.31%) Amazon Kinesis
7 64 (2.18%) Serverless
8 59 (2.01%) Amazon EMR
9 58 (1.97%) PaaS
10 55 (1.87%) Azure Data Factory
11 50 (1.70%) Amazon EC2
12 38 (1.29%) Cloud Computing
13 33 (1.12%) SaaS
14 32 (1.09%) AWS Lambda
15 31 (1.05%) Virtual Private Cloud
16 28 (0.95%) Google Analytics
17 25 (0.85%) AWS CloudFormation
18 23 (0.78%) Azure Machine Learning
18 23 (0.78%) Google Tag Manager
19 21 (0.71%) Data Lake Analytics
Communications & Networking
1 90 (3.06%) Kerberos
2 52 (1.77%) HTTP
3 40 (1.36%) Firewall
4 31 (1.05%) SSL
5 24 (0.82%) DNS
6 22 (0.75%) VPN
7 21 (0.71%) Internet
8 20 (0.68%) TCP/IP
9 15 (0.51%) Network Security
10 9 (0.31%) WAN
11 8 (0.27%) Intrusion Detection
12 7 (0.24%) SMS
13 6 (0.20%) ICMP
14 5 (0.17%) FTP
14 5 (0.17%) SAN
14 5 (0.17%) SMTP
14 5 (0.17%) SSH
15 4 (0.14%) LAN
15 4 (0.14%) NAS
15 4 (0.14%) Reverse Proxy
Database & Business Intelligence
1 1,488 (50.60%) Hadoop
2 661 (22.48%) Apache Hive
3 507 (17.24%) Data Warehouse
4 464 (15.78%) NoSQL
5 422 (14.35%) HBase
6 365 (12.41%) SQL Server
7 272 (9.25%) Data Lake
8 266 (9.04%) MongoDB
9 258 (8.77%) Relational Database
10 249 (8.47%) Apache Cassandra
11 223 (7.58%) PostgreSQL
12 207 (7.04%) Impala
13 168 (5.71%) Sqoop
14 155 (5.27%) MySQL
15 129 (4.39%) Amazon Redshift
16 125 (4.25%) Power BI
17 102 (3.47%) RDBMS
18 98 (3.33%) SQL Server Integration Services
19 86 (2.92%) OLAP
20 80 (2.72%) Enterprise Data Warehouse
Development Applications
1 357 (12.14%) Jenkins
2 288 (9.79%) Git (software)
3 180 (6.12%) JIRA
4 80 (2.72%) Maven
5 69 (2.35%) Cucumber
6 53 (1.80%) JUnit
7 51 (1.73%) Team Foundation Server
8 47 (1.60%) Selenium
9 46 (1.56%) Visual Studio Team System
10 43 (1.46%) Visual Studio
11 42 (1.43%) Artifactory
11 42 (1.43%) Sonatype Nexus
12 41 (1.39%) GitLab
13 37 (1.26%) TeamCity
14 35 (1.19%) Gradle
15 32 (1.09%) Subversion
16 22 (0.75%) SpecFlow
17 21 (0.71%) Vagrant
18 19 (0.65%) Bitbucket
18 19 (0.65%) Jasmine
General
1 716 (24.35%) Finance
2 312 (10.61%) Banking
3 164 (5.58%) Retail
4 125 (4.25%) Marketing
5 107 (3.64%) Manufacturing
6 104 (3.54%) Telecoms
7 80 (2.72%) Investment Banking
8 55 (1.87%) Games
9 35 (1.19%) Front Office
10 34 (1.16%) Electronics
11 27 (0.92%) Retail Banking
12 18 (0.61%) Law
12 18 (0.61%) Legal
13 13 (0.44%) Financial Institution
14 12 (0.41%) Advertising
15 11 (0.37%) Automotive
15 11 (0.37%) Back Office
15 11 (0.37%) Publishing
16 10 (0.34%) French Language
17 7 (0.24%) Pharmaceutical
Job Titles
1 914 (31.08%) Developer
2 506 (17.21%) Data Engineer
3 422 (14.35%) Architect
4 354 (12.04%) Big Data Engineer
5 337 (11.46%) Big Data Developer
6 289 (9.83%) Java Developer
7 253 (8.60%) Data Architect
8 212 (7.21%) Analyst
9 158 (5.37%) Hadoop Engineer
10 151 (5.13%) DevOps Engineer
11 142 (4.83%) Big Data Architect
12 131 (4.45%) Consultant
13 121 (4.11%) Data Scientist
14 111 (3.77%) Senior Developer
15 110 (3.74%) Hadoop Developer
16 106 (3.60%) Scala Developer
17 98 (3.33%) Solutions Architect
18 90 (3.06%) Apache Spark Developer
18 90 (3.06%) AWS Engineer
19 84 (2.86%) Data Analyst
Libraries, Frameworks & Software Standards
1 754 (25.64%) Kafka
2 218 (7.41%) REST
3 198 (6.73%) Spring
4 185 (6.29%) Web Services
5 170 (5.78%) JSON
6 166 (5.64%) RESTful
7 143 (4.86%) AngularJS
8 132 (4.49%) RabbitMQ
9 130 (4.42%) Spark Streaming
10 116 (3.94%) HTML
11 115 (3.91%) Spring Boot
12 109 (3.71%) Node.js
13 101 (3.43%) .NET
14 88 (2.99%) Middleware
14 88 (2.99%) React
15 80 (2.72%) SOAP
16 78 (2.65%) J2EE
17 76 (2.58%) CSS
18 75 (2.55%) XML
19 72 (2.45%) HTML5
Miscellaneous
1 322 (10.95%) Analytical Skills
2 164 (5.58%) Computer Science
3 157 (5.34%) Greenfield Project
4 130 (4.42%) Algorithms
5 81 (2.75%) Data Structures
6 68 (2.31%) User Experience
7 67 (2.28%) Linux Command Line
8 52 (1.77%) Fintech
9 47 (1.60%) Self-Motivation
10 46 (1.56%) Virtual Team
11 44 (1.50%) Management Information System
12 40 (1.36%) Data Centre
13 36 (1.22%) Enterprise Software
14 32 (1.09%) Public Cloud
15 27 (0.92%) Mobile App
16 24 (0.82%) Clustering
16 24 (0.82%) NHS
17 22 (0.75%) Hedge funds
18 21 (0.71%) Derivative
19 20 (0.68%) Cyberthreat
Operating Systems
1 559 (19.01%) Linux
2 244 (8.30%) Unix
3 126 (4.28%) Windows
4 58 (1.97%) Red Hat Enterprise Linux
5 53 (1.80%) CentOS
6 31 (1.05%) Ubuntu
7 22 (0.75%) Android
8 19 (0.65%) Windows Server
9 16 (0.54%) Apple iOS
10 11 (0.37%) CoreOS
10 11 (0.37%) Windows Server 2008
11 8 (0.27%) Debian
11 8 (0.27%) VMS
12 6 (0.20%) DC/OS
13 4 (0.14%) Windows 10
13 4 (0.14%) Windows Server 2003
14 3 (0.10%) Mesosphere
14 3 (0.10%) Windows Server 2012
14 3 (0.10%) Windows Vista
15 2 (0.068%) Windows 7
Processes & Methodologies
1 1,127 (38.32%) Agile Software Development
2 915 (31.11%) Analytics
3 490 (16.66%) ETL
4 471 (16.01%) DevOps
5 436 (14.82%) Business Intelligence
6 435 (14.79%) Data Science
7 403 (13.70%) Data Modelling
8 401 (13.63%) Machine Learning
9 387 (13.16%) Scrum
10 350 (11.90%) TDD
11 321 (10.91%) Continuous Integration
12 320 (10.88%) Data Analytics
13 274 (9.32%) Visualisation
14 251 (8.53%) Microservices
15 248 (8.43%) Open Source
16 230 (7.82%) Problem-Solving
17 220 (7.48%) Test Automation
18 189 (6.43%) Data Engineering
19 188 (6.39%) Stakeholder Management
20 187 (6.36%) Data Architecture
Programming Languages
1 1,031 (35.06%) Java
2 988 (33.59%) Python
3 808 (27.47%) SQL
4 614 (20.88%) Scala
5 291 (9.89%) JavaScript
6 231 (7.85%) R
7 170 (5.78%) C#
8 165 (5.61%) Bash Shell
9 147 (5.00%) Java 8
10 121 (4.11%) Shell Script
11 77 (2.62%) C++
11 77 (2.62%) Perl
12 75 (2.55%) PowerShell
13 71 (2.41%) Ruby
14 61 (2.07%) Go
15 52 (1.77%) C
16 46 (1.56%) T-SQL
17 40 (1.36%) Groovy
18 35 (1.19%) PHP
19 33 (1.12%) Korn
Qualifications
1 273 (9.28%) Security Cleared
2 221 (7.51%) Degree
3 219 (7.45%) SC Cleared
4 64 (2.18%) Computer Science Degree
5 38 (1.29%) DV Cleared
6 35 (1.19%) Numerate Degree
7 30 (1.02%) PhD
8 18 (0.61%) Microsoft Certification
9 17 (0.58%) Master's Degree
10 15 (0.51%) BPSS Clearance
10 15 (0.51%) CISSP
11 13 (0.44%) BC Cleared
12 9 (0.31%) MCSE
13 8 (0.27%) CTC Cleared
14 7 (0.24%) TOGAF Certification
15 6 (0.20%) AWS Certification
15 6 (0.20%) CESG Certified Professional
15 6 (0.20%) CISM
15 6 (0.20%) CLAS
16 5 (0.17%) ISTQB
Quality Assurance & Compliance
1 225 (7.65%) Data Quality
2 118 (4.01%) QA
3 67 (2.28%) GDPR
4 55 (1.87%) GCP
5 20 (0.68%) PMO
6 14 (0.48%) MiFID
7 10 (0.34%) Sarbanes-Oxley
8 8 (0.27%) IFRS
8 8 (0.27%) IFRS 9
8 8 (0.27%) SLA
9 7 (0.24%) PCI DSS
10 6 (0.20%) EMIR
10 6 (0.20%) ISO/IEC 27001
10 6 (0.20%) JSP 440
10 6 (0.20%) RMADS
11 5 (0.17%) Dodd-Frank
12 4 (0.14%) Disclosure Scotland
12 4 (0.14%) GAAP
12 4 (0.14%) ISO/IEC 20000
13 2 (0.068%) NIST 800
System Software
1 327 (11.12%) Docker
2 273 (9.28%) HDFS
3 185 (6.29%) Apache Flume
4 128 (4.35%) Apache ZooKeeper
5 43 (1.46%) Active Directory
6 23 (0.78%) VMware Infrastructure
7 20 (0.68%) Virtual Machines
8 13 (0.44%) Hyper-V
9 9 (0.31%) Virtual Servers
10 7 (0.24%) Ceph
11 4 (0.14%) Lustre
11 4 (0.14%) NFS
12 3 (0.10%) KVM
12 3 (0.10%) OpenDJ
12 3 (0.10%) OpenIDM
12 3 (0.10%) vCloud
12 3 (0.10%) Xen
13 2 (0.068%) VMware NSX
13 2 (0.068%) vSphere
14 1 (0.034%) XenServer
Systems Management
1 234 (7.96%) Ansible
2 208 (7.07%) Oozie
3 168 (5.71%) Hadoop YARN
4 152 (5.17%) Kubernetes
5 142 (4.83%) Puppet
6 107 (3.64%) Terraform
7 86 (2.92%) Opscode Chef
8 42 (1.43%) Mesos
9 30 (1.02%) Kibana
10 27 (0.92%) Ambari
11 23 (0.78%) Salt
12 20 (0.68%) Grafana
13 17 (0.58%) Graylog
14 15 (0.51%) Consul
14 15 (0.51%) Nagios
15 10 (0.34%) Docker Swarm
15 10 (0.34%) logstash
15 10 (0.34%) Packer
15 10 (0.34%) Prometheus
15 10 (0.34%) Rancher
Vendors
1 330 (11.22%) Cloudera
2 284 (9.66%) Oracle
3 247 (8.40%) Microsoft
4 191 (6.49%) Hortonworks
5 176 (5.98%) Tableau
6 159 (5.41%) Google
7 131 (4.45%) SAP
8 118 (4.01%) Informatica
9 115 (3.91%) Talend
10 108 (3.67%) Splunk
11 84 (2.86%) MapR
12 54 (1.84%) IBM
13 51 (1.73%) Red Hat
13 51 (1.73%) Salesforce.com
14 46 (1.56%) Teradata
15 43 (1.46%) Alteryx
16 36 (1.22%) Atlassian
16 36 (1.22%) SaltStack
17 28 (0.95%) Ab Initio
17 28 (0.95%) VMware
954 Big Data job vacancies Nationwide