Period
to 26 July 2017

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 26 July 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
26 Jul 2017
Same period 2016 Same period 2015
Rank 96 151 208
Rank change year-on-year +55 +57 +69
Contract jobs citing Big Data 2456 1843 1309
As % of all contract IT jobs advertised in the UK 2.58% 1.68% 1.16%
As % of the Database & Business Intelligence category 11.48% 7.60% 5.04%
Number of daily rates quoted 1691 1259 938
UK median daily rate £525 £525 £525
10th Percentile £363 £363 £360
90th Percentile £675 £688 £713
UK excluding London median daily rate £463 £450 £475
% change year-on-year +2.94% -5.26% +5.56%
Number of hourly rates quoted 7 9 9
UK median hourly rate £40.00 £45.00 £27.32
Median hourly rate % change year-on-year -11.11% +64.74% -8.95%
10th Percentile £22.25 £37.72 £15.00
90th Percentile £50.00 £46.15 £49.05
UK excluding London median hourly rate £41.00 £45.00 £25.25
% change year-on-year -8.89% +78.22% +23.17%

Big Data is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database and business intelligence skills.

Contract Database & Business Intelligence Skills
UK
Contract job vacancies with a requirement for database and business intelligence skills 21394 24256 25991
As % of all contract IT job vacancies advertised in the UK 22.46% 22.08% 23.04%
Number of daily rates quoted 14249 16255 16834
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +5.26%
10th Percentile £300 £280 £263
90th Percentile £620 £600 £575
UK excluding London median daily rate £400 £375 £363
% change year-on-year +6.67% +3.45% +3.57%
Number of hourly rates quoted 269 383 351
UK median hourly rate £31.00 £30.00 £25.00
Median hourly rate % change year-on-year +3.33% +20.00% -13.42%
10th Percentile £11.18 £11.52 £14.00
90th Percentile £52.50 £51.00 £53.75
UK excluding London median hourly rate £32.25 £31.50 £25.00
% change year-on-year +2.38% +26.00% -12.66%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 26 July 2017.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 26 July 2017.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 26 July 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +49 2322 £528 +0.48% 422
London +36 1646 £550 - 266
UK excluding London +75 775 £463 +2.94% 176
South East +57 317 £488 +8.33% 52
North of England +79 153 £450 -5.26% 45
North West +64 83 £450 +2.27% 26
East of England +19 77 £475 +26.67% 21
Midlands +22 72 £450 -4.26% 12
Yorkshire +36 60 £465 -7.00% 16
Scotland +60 58 £388 -11.43% 20
South West -21 52 £463 +8.82% 24
West Midlands +4 36 £450 -5.76% 9
East Midlands +10 34 £413 -8.33% 3
Northern Ireland -22 29 £400 - 1
Wales +23 24 £525 +40.00% 1
North East +54 15 £516 +3.10% 3

For the 6 months to 26 July 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Big Data.

1 1344 (54.72%) Hadoop
2 980 (39.90%) Java
3 950 (38.68%) Agile Software Development
4 880 (35.83%) Apache Spark
5 762 (31.03%) Python
6 660 (26.87%) Analytics
7 632 (25.73%) SQL
8 591 (24.06%) Finance
9 497 (20.24%) Apache Hive
10 489 (19.91%) Scala
11 439 (17.87%) Linux
12 420 (17.10%) TDD
13 412 (16.78%) Kafka
14 411 (16.73%) DevOps
15 395 (16.08%) Banking
16 377 (15.35%) HBase
17 371 (15.11%) Scrum
18 360 (14.66%) Business Intelligence
19 353 (14.37%) Amazon AWS
20 346 (14.09%) ETL
21 331 (13.48%) NoSQL
22 280 (11.40%) Analytical Skills
23 262 (10.67%) Data Warehouse
24 261 (10.63%) Machine Learning
25 260 (10.59%) Data Analytics
26 252 (10.26%) Apache Cassandra
26 252 (10.26%) Data Modelling
27 246 (10.02%) Oracle
27 246 (10.02%) Cloudera
28 245 (9.98%) Apache

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 880 (35.83%) Apache Spark
2 245 (9.98%) Apache
3 165 (6.72%) Apache Pig
4 146 (5.94%) SAS
5 113 (4.60%) Elasticsearch
6 102 (4.15%) Apache Solr
7 97 (3.95%) Confluence
8 36 (1.47%) OpenStack
9 31 (1.26%) JBoss
10 25 (1.02%) Tomcat
11 20 (0.81%) nginx
12 18 (0.73%) Oracle SOA Suite
12 18 (0.73%) WebSphere
13 13 (0.53%) Cloud Foundry
14 11 (0.45%) GlassFish
14 11 (0.45%) SharePoint
14 11 (0.45%) WildFly
15 10 (0.41%) WebLogic
16 8 (0.33%) Facebook Platform
16 8 (0.33%) MS Exchange
Applications
1 48 (1.95%) Microsoft Excel
2 26 (1.06%) SPSS
3 18 (0.73%) Microsoft Office
4 16 (0.65%) Microsoft PowerPoint
5 12 (0.49%) MS Visio
5 12 (0.49%) Stata
6 9 (0.37%) Spreadsheet
7 6 (0.24%) Photoshop
8 4 (0.16%) Mingle
9 3 (0.12%) Microsoft Project
10 2 (0.081%) InVision
10 2 (0.081%) S-PLUS
11 1 (0.041%) GNU Octave
11 1 (0.041%) Mathematica
11 1 (0.041%) Weka
Business Applications
1 10 (0.41%) Actimize
2 4 (0.16%) Adobe Campaign
2 4 (0.16%) Oracle BPM
2 4 (0.16%) WebTrends
3 3 (0.12%) Bloomberg TOMS
3 3 (0.12%) Eagle PACE
3 3 (0.12%) NetSuite
3 3 (0.12%) Oracle Applications
4 2 (0.081%) Markit EDM
5 1 (0.041%) Cognos Business Intelligence
5 1 (0.041%) Dynamics NAV
5 1 (0.041%) Eloqua
5 1 (0.041%) Hyperion Enterprise
5 1 (0.041%) Hyperion Planning
5 1 (0.041%) Oracle EBS
5 1 (0.041%) Oracle ERP
5 1 (0.041%) Oracle Receivables
5 1 (0.041%) SessionCam
5 1 (0.041%) Social Studio
5 1 (0.041%) thinkFolio
Cloud Services
1 353 (14.37%) Amazon AWS
2 137 (5.58%) Microsoft Azure
3 68 (2.77%) GitHub
4 46 (1.87%) SaaS
5 45 (1.83%) Google Cloud Platform
6 44 (1.79%) Cloud Computing
7 43 (1.75%) Virtual Private Cloud
8 42 (1.71%) Amazon EC2
8 42 (1.71%) Amazon S3
9 41 (1.67%) PaaS
10 33 (1.34%) IaaS
11 31 (1.26%) Amazon EMR
12 22 (0.90%) AWS CloudFormation
12 22 (0.90%) AWS Lambda
12 22 (0.90%) Office 365
13 18 (0.73%) Amazon CloudWatch
13 18 (0.73%) Google Analytics
14 14 (0.57%) IBM Cloud
15 12 (0.49%) Adobe Analytics
16 11 (0.45%) Azure Data Factory
Communications & Networking
1 76 (3.09%) Kerberos
2 40 (1.63%) HTTP
3 35 (1.43%) Firewall
4 34 (1.38%) WAN
5 28 (1.14%) LAN
6 26 (1.06%) LDAP
7 22 (0.90%) Network Security
7 22 (0.90%) SSL
8 20 (0.81%) VPN
9 16 (0.65%) TCP/IP
10 14 (0.57%) DNS
11 13 (0.53%) Internet
11 13 (0.53%) SSH
12 10 (0.41%) 3G
12 10 (0.41%) 4G
12 10 (0.41%) NAS
12 10 (0.41%) SAN
13 7 (0.29%) DSL
13 7 (0.29%) FIX Connectivity
13 7 (0.29%) Wi-Fi
Database & Business Intelligence
1 1344 (54.72%) Hadoop
2 497 (20.24%) Apache Hive
3 377 (15.35%) HBase
4 331 (13.48%) NoSQL
5 262 (10.67%) Data Warehouse
6 252 (10.26%) Apache Cassandra
7 241 (9.81%) MongoDB
8 222 (9.04%) SQL Server
9 158 (6.43%) Impala
10 150 (6.11%) Relational Database
11 125 (5.09%) Sqoop
12 124 (5.05%) PostgreSQL
13 88 (3.58%) MySQL
14 70 (2.85%) RDBMS
15 67 (2.73%) SQL Server Integration Services
16 66 (2.69%) Data Lake
17 64 (2.61%) QlikView
18 62 (2.52%) Data Mining
19 46 (1.87%) BusinessObjects
20 45 (1.83%) Power BI
Development Applications
1 244 (9.93%) Git (software)
2 234 (9.53%) Jenkins
3 226 (9.20%) JIRA
4 86 (3.50%) Cucumber
5 82 (3.34%) Maven
6 55 (2.24%) JUnit
7 52 (2.12%) Talend Open Studio
8 40 (1.63%) Team Foundation Server
9 39 (1.59%) Gradle
10 38 (1.55%) Vagrant
11 33 (1.34%) Mockito
11 33 (1.34%) Subversion
12 31 (1.26%) GitLab
13 28 (1.14%) Eclipse
14 25 (1.02%) Visual Studio
15 24 (0.98%) NUnit
16 23 (0.94%) Ant
16 23 (0.94%) Selenium
17 22 (0.90%) Hudson
17 22 (0.90%) TeamCity
General
1 591 (24.06%) Finance
2 395 (16.08%) Banking
3 147 (5.99%) Marketing
4 128 (5.21%) Investment Banking
5 98 (3.99%) Telecoms
6 97 (3.95%) Front Office
7 92 (3.75%) Retail
8 48 (1.95%) Manufacturing
9 47 (1.91%) Electronics
10 24 (0.98%) Legal
11 21 (0.86%) Advertising
11 21 (0.86%) Publishing
12 19 (0.77%) Games
13 18 (0.73%) Financial Institution
13 18 (0.73%) Retail Banking
14 13 (0.53%) Back Office
15 8 (0.33%) Billing
15 8 (0.33%) Corporate Banking
15 8 (0.33%) Law
15 8 (0.33%) Pharmaceutical
Job Titles
1 895 (36.44%) Developer
2 340 (13.84%) Architect
3 315 (12.83%) Java Developer
4 310 (12.62%) Big Data Developer
5 291 (11.85%) Data Engineer
6 243 (9.89%) Analyst
7 241 (9.81%) Big Data Engineer
8 184 (7.49%) Data Architect
9 144 (5.86%) Scala Developer
10 135 (5.50%) Hadoop Developer
11 124 (5.05%) Senior Developer
12 121 (4.93%) DevOps Engineer
13 117 (4.76%) Consultant
14 110 (4.48%) Data Analyst
15 108 (4.40%) Big Data Architect
16 107 (4.36%) Hadoop Engineer
17 97 (3.95%) Data Scientist
18 93 (3.79%) Business Analyst
19 79 (3.22%) Python Developer
20 72 (2.93%) Apache Spark Developer
Libraries, Frameworks & Software Standards
1 412 (16.78%) Kafka
2 225 (9.16%) Spring
3 208 (8.47%) REST
4 166 (6.76%) Web Services
5 155 (6.31%) HTML
6 147 (5.99%) JSON
7 125 (5.09%) AngularJS
8 119 (4.85%) CSS
9 115 (4.68%) HTML5
10 114 (4.64%) .NET
10 114 (4.64%) RESTful
11 98 (3.99%) Spring Boot
12 77 (3.14%) Spark Streaming
13 67 (2.73%) Akka
13 67 (2.73%) XML
14 64 (2.61%) Node.js
15 62 (2.52%) J2EE
16 58 (2.36%) CSS3
16 58 (2.36%) Hibernate
17 53 (2.16%) Apache Camel
Miscellaneous
1 280 (11.40%) Analytical Skills
2 159 (6.47%) Algorithms
3 111 (4.52%) Computer Science
4 89 (3.62%) Greenfield Project
5 57 (2.32%) Data Structures
5 57 (2.32%) Market Risk
6 52 (2.12%) Foreign Exchange (FX)
6 52 (2.12%) User Experience
7 49 (2.00%) Data Centre
8 45 (1.83%) Enterprise Software
9 43 (1.75%) Management Information System
10 38 (1.55%) Credit Risk
10 38 (1.55%) Fintech
11 37 (1.51%) Reference Data
12 34 (1.38%) Linux Command Line
13 31 (1.26%) Mobile App
13 31 (1.26%) Virtual Team
14 30 (1.22%) Derivative
15 27 (1.10%) Equities
16 26 (1.06%) Client/Server
Operating Systems
1 439 (17.87%) Linux
2 243 (9.89%) Unix
3 98 (3.99%) Windows
4 41 (1.67%) Red Hat Enterprise Linux
5 37 (1.51%) CentOS
6 27 (1.10%) Ubuntu
7 21 (0.86%) Android
7 21 (0.86%) Apple iOS
8 20 (0.81%) Solaris
9 12 (0.49%) Windows Server
10 11 (0.45%) Windows Vista
11 7 (0.29%) AIX
11 7 (0.29%) Debian
12 6 (0.24%) VMS
13 4 (0.16%) Windows Server 2003
13 4 (0.16%) Windows Server 2008
14 3 (0.12%) Mac OS X
14 3 (0.12%) MVS
14 3 (0.12%) Windows 10
15 2 (0.081%) Windows 8
Processes & Methodologies
1 950 (38.68%) Agile Software Development
2 660 (26.87%) Analytics
3 420 (17.10%) TDD
4 411 (16.73%) DevOps
5 371 (15.11%) Scrum
6 360 (14.66%) Business Intelligence
7 346 (14.09%) ETL
8 261 (10.63%) Machine Learning
9 260 (10.59%) Data Analytics
10 252 (10.26%) Data Modelling
11 243 (9.89%) MapReduce
12 239 (9.73%) Open Source
13 222 (9.04%) Continuous Integration
14 219 (8.92%) BDD
15 190 (7.74%) Data Architecture
16 177 (7.21%) Visualisation
17 176 (7.17%) Microservices
18 158 (6.43%) Software Engineering
19 146 (5.94%) Data Analysis
20 143 (5.82%) Stakeholder Management
Programming Languages
1 980 (39.90%) Java
2 762 (31.03%) Python
3 632 (25.73%) SQL
4 489 (19.91%) Scala
5 222 (9.04%) R
6 206 (8.39%) JavaScript
7 134 (5.46%) Shell Script
8 129 (5.25%) C#
9 112 (4.56%) Bash Shell
10 66 (2.69%) C++
11 63 (2.57%) Perl
12 58 (2.36%) Ruby
13 43 (1.75%) T-SQL
14 38 (1.55%) TypeScript
15 35 (1.43%) PowerShell
16 33 (1.34%) MATLAB
17 31 (1.26%) C
18 26 (1.06%) PL/SQL
19 24 (0.98%) Go
19 24 (0.98%) Groovy
Qualifications
1 201 (8.18%) Degree
2 190 (7.74%) Security Cleared
3 143 (5.82%) SC Cleared
4 43 (1.75%) Computer Science Degree
5 30 (1.22%) DV Cleared
6 27 (1.10%) PhD
7 21 (0.86%) Numerate Degree
8 17 (0.69%) CISSP
9 14 (0.57%) Master's Degree
10 12 (0.49%) BPSS Clearance
11 10 (0.41%) PMI Certification
11 10 (0.41%) PMP
12 9 (0.37%) Postgraduate
13 8 (0.33%) CESG Certified Professional
13 8 (0.33%) Cisco Certification
13 8 (0.33%) ISTQB
13 8 (0.33%) MCITP
13 8 (0.33%) MCSE
13 8 (0.33%) Microsoft Certification
14 7 (0.29%) CLAS
Quality Assurance & Compliance
1 110 (4.48%) QA
2 86 (3.50%) Data Quality
3 26 (1.06%) MiFID
4 12 (0.49%) GDPR
5 9 (0.37%) Dodd-Frank
5 9 (0.37%) SLA
6 8 (0.33%) EMIR
7 6 (0.24%) JSP 440
7 6 (0.24%) PMO
8 5 (0.20%) Actionable Recommendations
8 5 (0.20%) ISO/IEC 27001
9 4 (0.16%) Disclosure Scotland
10 3 (0.12%) ISAE 3402
10 3 (0.12%) PCI DSS
10 3 (0.12%) SSAE 16
11 2 (0.081%) CDISC
11 2 (0.081%) COBIT
11 2 (0.081%) GCP
11 2 (0.081%) IFRS
11 2 (0.081%) Sarbanes-Oxley
System Software
1 235 (9.57%) HDFS
2 212 (8.63%) Docker
3 144 (5.86%) Apache Flume
4 92 (3.75%) Apache ZooKeeper
5 41 (1.67%) Active Directory
6 33 (1.34%) VMware Infrastructure
7 15 (0.61%) Hyper-V
8 14 (0.57%) vCloud
8 14 (0.57%) Virtual Machines
9 11 (0.45%) OpenAM
10 9 (0.37%) OpenDJ
10 9 (0.37%) OpenIDM
11 6 (0.24%) Oracle RAC
12 5 (0.20%) NFS
13 4 (0.16%) vSphere
14 3 (0.12%) VMware ESXi
15 2 (0.081%) OpenSSH
15 2 (0.081%) Xen
16 1 (0.041%) Cronacle
16 1 (0.041%) Firmware
Systems Management
1 176 (7.17%) Ansible
2 136 (5.54%) Puppet
3 104 (4.23%) Hadoop YARN
4 96 (3.91%) Terraform
5 87 (3.54%) Opscode Chef
6 86 (3.50%) Kubernetes
7 79 (3.22%) Oozie
8 28 (1.14%) Mesos
9 21 (0.86%) Ambari
9 21 (0.86%) Nagios
10 18 (0.73%) Kibana
11 17 (0.69%) SCOM
12 16 (0.65%) Graphite
12 16 (0.65%) Prometheus
13 15 (0.61%) Rsyslog
14 13 (0.53%) SCCM
15 12 (0.49%) logstash
16 8 (0.33%) Microsoft Clustering
17 7 (0.29%) Rancher
18 6 (0.24%) Salt
Vendors
1 246 (10.02%) Cloudera
1 246 (10.02%) Oracle
2 138 (5.62%) Microsoft
3 131 (5.33%) Tableau
4 112 (4.56%) Hortonworks
5 95 (3.87%) Splunk
6 92 (3.75%) SAP
7 79 (3.22%) Google
8 78 (3.18%) Informatica
9 76 (3.09%) Teradata
10 56 (2.28%) IBM
11 53 (2.16%) Red Hat
12 52 (2.12%) Talend
13 47 (1.91%) VMware
14 42 (1.71%) MapR
15 27 (1.10%) Ab Initio
15 27 (1.10%) TIBCO
16 19 (0.77%) Adobe
17 16 (0.65%) HP
17 16 (0.65%) Sybase
City, London
TEKsystems
Rate: £600 - £700 per day
Posted: 3 hours ago
Buckinghamshire
Resource Group
Rate: £300 - £360 per day
Posted: 11 hours ago
London
Parallel Consulting
Rate: Excellent Rates of Pay - Experience Dependant
Posted: 10 hours ago
London
Spargonet Consulting Plc
Rate: £400 - £425 per day
Posted: 8 hours ago
City, London
Spargonet Consulting Plc
Rate: £500 - £600 per day
Posted: 9 hours ago
London
TEKsystems
Rate: £550 - £600 per day
Posted: Yesterday
London
Square One Resources
Rate: Unspecified Negotiable
Posted: 12 hours ago
Newbury, Berkshire
Venturi
Rate: £400 - £500 per day
Posted: Yesterday
City, London
Volt
Rate: From £510 to £560 per day
Posted: 6 hours ago
City, London
Oliver Bernard
Rate: £475 - £525 per day
Posted: 13 hours ago
London
Elevate Direct
Rate: From £550 to £750 per day
Posted: 4 hours ago
North London
Oliver Bernard
Rate: £500 - £550 per day
Posted: 2 days ago
City, London
Experis Ltd
Rate: £500 per day
Posted: Yesterday
Central London / West End
Evolution Recruitment Solutions
Posted: Yesterday
City, London
TEKsystems
Rate: £375 - £400 per day
Posted: Yesterday
Wiltshire
Rullion
Posted: Yesterday
City, London
LA International
Rate: Market Rate
Posted: 2 days ago
City, London
Oliver Bernard
Rate: £600 - £650 per day
Posted: 2 days ago
Swindon, Wiltshire
Montash
Rate: £600 - £700 per day + Negotiable
Posted: Yesterday
Wiltshire
Rullion
Posted: Yesterday
London
TEKsystems
Rate: £500 - £600 per day
Posted: 2 days ago
West Midlands
Lawrence Harvey
Rate: £600 - £700 per day
Posted: Yesterday
London
Talent International
Rate: £400 - £500 per day
Posted: 2 days ago
West London
Experis Ltd
Posted: 2 days ago
London
Careerwise UK Limited
Rate: £500 - £550 per day
Posted: 5 days ago
City, London
Software Personnel International Ltd
Rate: From £400 to £500 per annum £450.00 per day
Posted: 2 days ago
Newcastle-upon-Tyne, Tyne and Wear
Elevate Direct
Rate: From £400 to £450 per day
Posted: 2 days ago
Surrey
Lawrence Harvey
Rate: £500.00 - £600.00 per day
Posted: 2 days ago
Somerset
CDI Anders Elite Ltd
Rate: £0.00 per annum
Posted: 7 hours ago
London
Hays Finance Technology
Rate: £500.00 - £610.00 per day
Posted: Yesterday