Period
to 22 November 2017

The median contractor rate for a Big Data Developer was £550 per day in advertised job vacancies during the 6 months to 22 November 2017.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data Developer
UK
6 months to
22 Nov 2017
Same period 2016 Same period 2015
Rank 559 637 720
Rank change year-on-year +78 +83 +44
Contract jobs requiring a Big Data Developer 340 267 184
As % of all contract IT jobs advertised in the UK 0.33% 0.25% 0.16%
As % of the Job Titles category 0.35% 0.27% 0.17%
Number of daily rates quoted 253 183 135
UK median daily rate £550 £550 £550
10th Percentile £400 £413 £403
90th Percentile £725 £750 £675
UK excluding London median daily rate £475 £488 £450
% change year-on-year -2.56% +8.33% -
Number of hourly rates quoted 2 0 0
UK median hourly rate £70.00 - -
UK excluding London median hourly rate £70.00 - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 97824 99914 107019
% of contract IT jobs with a recognized job title 94.81% 94.76% 94.91%
Number of daily rates quoted 64542 65150 68083
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% -
10th Percentile £260 £250 £250
90th Percentile £625 £600 £588
UK excluding London median daily rate £400 £392 £375
% change year-on-year +2.04% +4.53% +3.45%
Number of hourly rates quoted 2932 3310 4089
UK median hourly rate £18.70 £18.00 £18.00
Median hourly rate % change year-on-year +3.88% - +9.09%
10th Percentile £10.96 £10.50 £10.50
90th Percentile £47.83 £47.50 £45.00
UK excluding London median hourly rate £17.50 £17.50 £17.77
% change year-on-year - -1.52% +9.96%

Big Data Developer
Job Vacancy Trend

Job postings that featured Big Data Developer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data Developer in the UK

Big Data Developer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data Developer.

Contractor daily rate trend for Big Data Developer in the UK

Big Data Developer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data Developer over the 6 months to 22 November 2017.

Contractor daily rate histogram for Big Data Developer in the UK

Big Data Developer
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Developer within the UK over the 6 months to 22 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +72 324 £550 - 30
London +32 263 £550 -4.35% 24
UK excluding London +36 70 £475 -2.56% 6
South East +29 53 £500 - 2
Northern Ireland - 6 £365 -
Midlands +24 3 - -
East of England -13 3 £363 -34.09% 3
East Midlands - 3 - -
North of England +69 2 £405 -12.43% 1
North West +13 2 £405 -22.86% 1
Scotland -15 2 £400 -28.25%
Wales +18 1 - -

Big Data Developer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 22 November 2017, Big Data Developer contract jobs required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads featuring Big Data Developer in the job title.

1 340 (100.00%) Big Data
2 275 (80.88%) Hadoop
3 246 (72.35%) Apache Spark
4 236 (69.41%) Java
5 153 (45.00%) Scala
6 148 (43.53%) Kafka
7 144 (42.35%) Agile Software Development
8 121 (35.59%) TDD
9 111 (32.65%) HBase
10 107 (31.47%) Python
11 97 (28.53%) SQL
11 97 (28.53%) Apache Hive
12 82 (24.12%) HDFS
13 80 (23.53%) Amazon AWS
13 80 (23.53%) Finance
14 72 (21.18%) Scrum
15 71 (20.88%) REST
16 67 (19.71%) Banking
17 66 (19.41%) NoSQL
18 60 (17.65%) Spring
19 55 (16.18%) BDD
20 52 (15.29%) ETL
20 52 (15.29%) Machine Learning
20 52 (15.29%) Cloudera
21 51 (15.00%) Apache Cassandra
21 51 (15.00%) Apache
21 51 (15.00%) Linux
22 48 (14.12%) MapReduce
22 48 (14.12%) Microservices
23 47 (13.82%) Security Cleared

Big Data Developer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 246 (72.35%) Apache Spark
2 51 (15.00%) Apache
3 37 (10.88%) Apache Solr
4 30 (8.82%) Elasticsearch
5 24 (7.06%) Apache Pig
6 19 (5.59%) Confluence
7 10 (2.94%) Tomcat
8 7 (2.06%) Cloud Foundry
8 7 (2.06%) GemFire
9 3 (0.88%) Jetty
10 2 (0.59%) JBoss
11 1 (0.29%) Apache Airflow
11 1 (0.29%) GeoServer
11 1 (0.29%) Luigi
11 1 (0.29%) nginx
11 1 (0.29%) OpenStack
11 1 (0.29%) SharePoint
11 1 (0.29%) WebSphere
Applications
1 1 (0.29%) Gephi
Business Applications
1 4 (1.18%) Actimize
Cloud Services
1 80 (23.53%) Amazon AWS
2 18 (5.29%) GitHub
3 16 (4.71%) Microsoft Azure
4 10 (2.94%) Amazon EC2
4 10 (2.94%) Amazon EMR
4 10 (2.94%) Amazon S3
5 8 (2.35%) Google Cloud Platform
6 7 (2.06%) PaaS
7 3 (0.88%) Amazon Kinesis
7 3 (0.88%) Cloud Computing
7 3 (0.88%) OpenShift
8 2 (0.59%) AWS CloudFormation
8 2 (0.59%) Route 53
9 1 (0.29%) Adobe Analytics
9 1 (0.29%) Azure Data Factory
9 1 (0.29%) Bluemix
9 1 (0.29%) Data Lake Analytics
9 1 (0.29%) Google Analytics
9 1 (0.29%) IBM Cloud
Communications & Networking
1 25 (7.35%) Kerberos
2 2 (0.59%) tcpdump
2 2 (0.59%) Wireshark
3 1 (0.29%) Internet
3 1 (0.29%) SSL
Database & Business Intelligence
1 340 (100.00%) Big Data
2 275 (80.88%) Hadoop
3 111 (32.65%) HBase
4 97 (28.53%) Apache Hive
5 66 (19.41%) NoSQL
6 51 (15.00%) Apache Cassandra
7 37 (10.88%) Impala
8 30 (8.82%) MongoDB
9 28 (8.24%) Relational Database
10 25 (7.35%) Data Warehouse
11 19 (5.59%) PostgreSQL
12 13 (3.82%) Blockchain
13 12 (3.53%) RDBMS
13 12 (3.53%) Riak
14 11 (3.24%) Data Mining
14 11 (3.24%) Parquet
14 11 (3.24%) SQL Server
14 11 (3.24%) Sqoop
15 10 (2.94%) DataStax
15 10 (2.94%) Flink
Development Applications
1 40 (11.76%) Git (software)
2 35 (10.29%) Jenkins
3 26 (7.65%) JIRA
4 21 (6.18%) JUnit
5 20 (5.88%) Cucumber
6 15 (4.41%) Gradle
6 15 (4.41%) IntelliJ
7 12 (3.53%) Maven
8 8 (2.35%) Mockito
8 8 (2.35%) Subversion
9 5 (1.47%) Ant
9 5 (1.47%) WebDriver
10 3 (0.88%) Apache Ivy
10 3 (0.88%) Bitbucket
10 3 (0.88%) GitLab
10 3 (0.88%) Selenium
10 3 (0.88%) Visual Studio
11 2 (0.59%) ClearCase
11 2 (0.59%) Mercurial
11 2 (0.59%) Team Foundation Server
General
1 80 (23.53%) Finance
2 67 (19.71%) Banking
3 20 (5.88%) Investment Banking
4 15 (4.41%) Front Office
5 13 (3.82%) Games
6 7 (2.06%) Marketing
6 7 (2.06%) Publishing
7 6 (1.76%) Retail
8 5 (1.47%) Telecoms
9 4 (1.18%) Electronics
9 4 (1.18%) Manufacturing
10 2 (0.59%) Advertising
10 2 (0.59%) Back Office
10 2 (0.59%) Private Banking
11 1 (0.29%) Financial Institution
11 1 (0.29%) Law
11 1 (0.29%) Retail Banking
11 1 (0.29%) Spanish Language
Libraries, Frameworks & Software Standards
1 148 (43.53%) Kafka
2 71 (20.88%) REST
3 60 (17.65%) Spring
4 45 (13.24%) JSON
5 38 (11.18%) Web Services
6 35 (10.29%) Spring Boot
7 31 (9.12%) Akka
8 27 (7.94%) Samza
9 24 (7.06%) Spark Streaming
10 22 (6.47%) Apache Avro
11 21 (6.18%) Apache Camel
12 20 (5.88%) RESTful
13 17 (5.00%) XML
14 16 (4.71%) Drools
14 16 (4.71%) JMS
15 14 (4.12%) Hibernate
15 14 (4.12%) Natural Language Processing
16 13 (3.82%) Lucene
16 13 (3.82%) Play Framework
17 12 (3.53%) Middleware
Miscellaneous
1 30 (8.82%) Algorithms
2 22 (6.47%) Analytical Skills
3 19 (5.59%) Linux Command Line
3 19 (5.59%) Replication
4 15 (4.41%) Greenfield Project
5 14 (4.12%) Market Risk
6 12 (3.53%) Virtual Team
7 10 (2.94%) Fintech
8 8 (2.35%) Computer Science
8 8 (2.35%) Data Structures
9 7 (2.06%) Semantic Web
10 6 (1.76%) Equities
11 5 (1.47%) User Experience
12 4 (1.18%) Derivative
12 4 (1.18%) Foreign Exchange (FX)
12 4 (1.18%) Linked Data
13 3 (0.88%) Online Games
14 2 (0.59%) Credit Risk
14 2 (0.59%) FMCG
14 2 (0.59%) Reference Data
Operating Systems
1 51 (15.00%) Linux
2 44 (12.94%) Unix
3 17 (5.00%) Red Hat Enterprise Linux
4 11 (3.24%) CentOS
5 3 (0.88%) Windows
Processes & Methodologies
1 144 (42.35%) Agile Software Development
2 121 (35.59%) TDD
3 72 (21.18%) Scrum
4 55 (16.18%) BDD
5 52 (15.29%) ETL
5 52 (15.29%) Machine Learning
6 48 (14.12%) MapReduce
6 48 (14.12%) Microservices
7 36 (10.59%) Analytics
7 36 (10.59%) Software Engineering
8 35 (10.29%) Pair Programming
9 34 (10.00%) Data Architecture
10 33 (9.71%) Continuous Integration
11 32 (9.41%) DevOps
12 31 (9.12%) OO
12 31 (9.12%) Unit Testing
13 28 (8.24%) Data Modelling
14 27 (7.94%) Open Source
15 25 (7.35%) Visualisation
16 23 (6.76%) Business Intelligence
Programming Languages
1 236 (69.41%) Java
2 153 (45.00%) Scala
3 107 (31.47%) Python
4 97 (28.53%) SQL
5 19 (5.59%) Shell Script
6 18 (5.29%) JavaScript
7 17 (5.00%) C#
8 15 (4.41%) Bash Shell
9 13 (3.82%) R
10 10 (2.94%) Perl
11 7 (2.06%) SPARQL
12 6 (1.76%) Groovy
13 3 (0.88%) C++
13 3 (0.88%) Clojure
13 3 (0.88%) T-SQL
14 2 (0.59%) PL/SQL
14 2 (0.59%) VBA
15 1 (0.29%) C
15 1 (0.29%) PowerShell
15 1 (0.29%) Ruby
Qualifications
1 47 (13.82%) Security Cleared
2 36 (10.59%) SC Cleared
3 25 (7.35%) Degree
4 9 (2.65%) Computer Science Degree
5 7 (2.06%) DV Cleared
6 2 (0.59%) CTC Cleared
6 2 (0.59%) Numerate Degree
7 1 (0.29%) BPSS Clearance
7 1 (0.29%) DBS Check
Quality Assurance & Compliance
1 21 (6.18%) QA
2 10 (2.94%) Data Quality
3 6 (1.76%) GDPR
4 3 (0.88%) GCP
4 3 (0.88%) MiFID
System Software
1 82 (24.12%) HDFS
2 36 (10.59%) Docker
3 31 (9.12%) Apache ZooKeeper
4 18 (5.29%) Apache Flume
Systems Management
1 43 (12.65%) Hadoop YARN
2 23 (6.76%) Ansible
3 22 (6.47%) Oozie
4 14 (4.12%) Kubernetes
5 12 (3.53%) Terraform
6 11 (3.24%) Mesos
7 7 (2.06%) Ambari
8 6 (1.76%) Opscode Chef
8 6 (1.76%) Puppet
9 5 (1.47%) Kibana
10 3 (0.88%) logstash
10 3 (0.88%) Salt
11 2 (0.59%) Apache Slider
11 2 (0.59%) Grafana
11 2 (0.59%) Graphite
12 1 (0.29%) Packer
Vendors
1 52 (15.29%) Cloudera
2 30 (8.82%) Hortonworks
3 16 (4.71%) Oracle
4 9 (2.65%) Google
5 7 (2.06%) Red Hat
5 7 (2.06%) Tableau
6 6 (1.76%) Microsoft
7 4 (1.18%) Atlassian
7 4 (1.18%) SAP
8 3 (0.88%) IBM
8 3 (0.88%) SaltStack
9 2 (0.59%) Ab Initio
9 2 (0.59%) Sybase
9 2 (0.59%) Teradata
10 1 (0.29%) Adobe
10 1 (0.29%) Cognizant
10 1 (0.29%) Facebook
10 1 (0.29%) Reuters
10 1 (0.29%) Splunk
10 1 (0.29%) TIBCO