Period
to 22 May 2018

The median contractor rate for a Big Data Developer was £525 per day in advertised job vacancies in England during the 6 months to 22 May 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data Developer
UK > England
6 months to
22 May 2018
Same period 2017 Same period 2016
Rank 543 519 609
Rank change year-on-year -24 +90 +118
Contract jobs requiring a Big Data Developer 331 285 242
As % of all contract IT jobs advertised in England 0.36% 0.34% 0.25%
As % of the Job Titles category 0.38% 0.36% 0.26%
Number of daily rates quoted 214 226 185
England median daily rate £525 £538 £525
Median daily rate % change year-on-year -2.33% +2.38% -4.55%
10th Percentile £425 £400 £375
90th Percentile £664 £738 £650
UK median daily rate £525 £537 £525
% change year-on-year -2.14% +2.19% -4.55%
Number of hourly rates quoted 0 0 0
England median hourly rate - - -
UK median hourly rate - - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
England
Contract vacancies in England with a recognized job title 87,269 79,093 92,503
% of contract IT jobs with a recognized job title 94.81% 94.89% 95.22%
Number of daily rates quoted 57,766 51,651 60,737
England median daily rate £450 £430 £425
Median daily rate % change year-on-year +4.65% +1.18% +6.25%
10th Percentile £270 £263 £256
90th Percentile £638 £623 £600
UK median daily rate £450 £425 £420
% change year-on-year +5.88% +1.19% +5.00%
Number of hourly rates quoted 2,728 2,649 2,895
England median hourly rate £18.50 £19.00 £19.42
Median hourly rate % change year-on-year -2.63% -2.16% +10.97%
10th Percentile £11.00 £10.75 £10.50
90th Percentile £48.00 £48.75 £47.88
UK median hourly rate £18.00 £18.75 £20.00
% change year-on-year -3.97% -6.28% +14.29%

Big Data Developer
Job Vacancy Trend in England

Job postings that featured Big Data Developer in the job title as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data Developer in England

Big Data Developer
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data Developer in England.

Contractor daily rate trend for Big Data Developer in England

Big Data Developer
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data Developer in England over the 6 months to 22 May 2018.

Contractor daily rate histogram for Big Data Developer in England

Big Data Developer
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Developer within the England region over the 6 months to 22 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -100 182 £575 - 21
South East +37 92 £500 +25.00% 5
North of England +16 30 £475 +4.68% 1
Yorkshire - 25 £475 -
Midlands 0 17 £500 -1.23% 1
East Midlands +14 16 £500 -1.23%
South West +9 8 £600 +17.07%
North West -21 5 £550 +21.21% 1
East of England -3 2 £575 +43.75%
West Midlands - 1 £500 - 1
Big Data Developer
UK

Big Data Developer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 22 May 2018, Big Data Developer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region featuring Big Data Developer in the job title.

1 331 (100.00%) Big Data
2 255 (77.04%) Hadoop
3 243 (73.41%) Apache Spark
4 184 (55.59%) Java
5 168 (50.76%) Kafka
6 147 (44.41%) Agile Software Development
7 139 (41.99%) Scala
8 118 (35.65%) Apache Hive
9 106 (32.02%) Apache
10 104 (31.42%) Linux
11 102 (30.82%) TDD
12 99 (29.91%) HBase
13 85 (25.68%) Python
14 76 (22.96%) Finance
15 72 (21.75%) Hadoop YARN
15 72 (21.75%) HDFS
16 71 (21.45%) Cloudera
17 70 (21.15%) Jenkins
18 66 (19.94%) Amazon AWS
19 64 (19.34%) NoSQL
19 64 (19.34%) SQL
19 64 (19.34%) Spark Streaming
20 63 (19.03%) Spring
21 62 (18.73%) REST
22 56 (16.92%) Unix
23 55 (16.62%) Sqoop
24 54 (16.31%) Impala
25 53 (16.01%) Apache ZooKeeper
26 52 (15.71%) Git (software)
27 51 (15.41%) JSON

Big Data Developer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 243 (73.41%) Apache Spark
2 106 (32.02%) Apache
3 29 (8.76%) Elasticsearch
4 23 (6.95%) Apache Pig
5 20 (6.04%) Apache Solr
6 12 (3.63%) Cloud Foundry
6 12 (3.63%) JBoss
7 5 (1.51%) Confluence
8 2 (0.60%) IPython
8 2 (0.60%) Jupyter
8 2 (0.60%) Tomcat
9 1 (0.30%) Apache Airflow
9 1 (0.30%) SAS
9 1 (0.30%) WebSphere
Applications
1 2 (0.60%) SPSS
Cloud Services
1 66 (19.94%) Amazon AWS
2 28 (8.46%) GitHub
3 25 (7.55%) Microsoft Azure
4 11 (3.32%) Amazon S3
4 11 (3.32%) Google Cloud Platform
5 7 (2.11%) Amazon Kinesis
6 6 (1.81%) Serverless
7 5 (1.51%) AWS Lambda
7 5 (1.51%) Cloud Computing
8 4 (1.21%) Azure Data Factory
9 3 (0.91%) Amazon EMR
9 3 (0.91%) Cortana Intelligence Suite
10 2 (0.60%) Yarn
11 1 (0.30%) Amazon EC2
11 1 (0.30%) Data Lake Analytics
11 1 (0.30%) IaaS
11 1 (0.30%) npm
11 1 (0.30%) OpenShift
11 1 (0.30%) PaaS
11 1 (0.30%) SaaS
Communications & Networking
1 18 (5.44%) Kerberos
2 9 (2.72%) HTTP
3 5 (1.51%) SSL
4 4 (1.21%) VPN
5 2 (0.60%) SNA
Database & Business Intelligence
1 331 (100.00%) Big Data
2 255 (77.04%) Hadoop
3 118 (35.65%) Apache Hive
4 99 (29.91%) HBase
5 64 (19.34%) NoSQL
6 55 (16.62%) Sqoop
7 54 (16.31%) Impala
8 37 (11.18%) Relational Database
9 35 (10.57%) SQL Server
10 33 (9.97%) Apache Cassandra
11 32 (9.67%) Data Lake
12 31 (9.37%) Parquet
13 27 (8.16%) Cloudera CDH
14 26 (7.85%) Data Warehouse
15 17 (5.14%) MongoDB
16 14 (4.23%) Amazon Redshift
17 13 (3.93%) PostgreSQL
18 10 (3.02%) Apache Kudu
18 10 (3.02%) Power BI
19 9 (2.72%) Flink
Development Applications
1 70 (21.15%) Jenkins
2 52 (15.71%) Git (software)
3 23 (6.95%) Gradle
4 21 (6.34%) Team Foundation Server
5 15 (4.53%) Maven
6 12 (3.63%) JIRA
7 4 (1.21%) FishEye
7 4 (1.21%) Visual Studio
8 3 (0.91%) GitLab
8 3 (0.91%) Subversion
8 3 (0.91%) TeamCity
9 2 (0.60%) GoCD
9 2 (0.60%) SonarQube
9 2 (0.60%) Sonatype Nexus
9 2 (0.60%) Vagrant
10 1 (0.30%) Gatling
10 1 (0.30%) gulp
10 1 (0.30%) JConsole
10 1 (0.30%) Visual Studio Team System
10 1 (0.30%) VisualVM
General
1 76 (22.96%) Finance
2 42 (12.69%) Banking
3 12 (3.63%) Investment Banking
4 9 (2.72%) Retail
5 6 (1.81%) Games
6 5 (1.51%) Telecoms
7 4 (1.21%) Automotive
8 3 (0.91%) Advertising
8 3 (0.91%) Front Office
8 3 (0.91%) Manufacturing
8 3 (0.91%) Marketing
8 3 (0.91%) Private Banking
9 2 (0.60%) Electronics
9 2 (0.60%) Legal
9 2 (0.60%) Publishing
10 1 (0.30%) Financial Institution
10 1 (0.30%) French Language
10 1 (0.30%) Law
10 1 (0.30%) Pharmaceutical
10 1 (0.30%) Retail Banking
Libraries, Frameworks & Software Standards
1 168 (50.76%) Kafka
2 64 (19.34%) Spark Streaming
3 63 (19.03%) Spring
4 62 (18.73%) REST
5 51 (15.41%) JSON
6 47 (14.20%) RabbitMQ
7 44 (13.29%) J2EE
8 41 (12.39%) Middleware
9 37 (11.18%) Spring Boot
10 28 (8.46%) Apache Avro
11 27 (8.16%) RESTful
12 19 (5.74%) SOAP
13 17 (5.14%) AngularJS
13 17 (5.14%) Web Services
14 14 (4.23%) XML
15 13 (3.93%) Drools
15 13 (3.93%) JMS
16 12 (3.63%) Play Framework
17 11 (3.32%) Akka
17 11 (3.32%) HTML
Miscellaneous
1 29 (8.76%) Greenfield Project
2 27 (8.16%) Linux Command Line
3 23 (6.95%) Virtual Team
4 18 (5.44%) Algorithms
5 16 (4.83%) Analytical Skills
6 6 (1.81%) NHS
7 5 (1.51%) Fintech
8 3 (0.91%) Data Structures
8 3 (0.91%) Derivative
8 3 (0.91%) Social Network
8 3 (0.91%) User Experience
9 2 (0.60%) Data Centre
9 2 (0.60%) Equity Derivative
9 2 (0.60%) Equity Risk
9 2 (0.60%) Grid Computing
9 2 (0.60%) Self-Motivation
10 1 (0.30%) Analytical Mindset
10 1 (0.30%) Hedge funds
10 1 (0.30%) Market Risk
10 1 (0.30%) Reference Data
Operating Systems
1 104 (31.42%) Linux
2 56 (16.92%) Unix
3 6 (1.81%) CentOS
4 4 (1.21%) Windows
5 2 (0.60%) Android
5 2 (0.60%) Apple iOS
5 2 (0.60%) Red Hat Enterprise Linux
6 1 (0.30%) Windows Server
6 1 (0.30%) Windows Server 2008
Processes & Methodologies
1 147 (44.41%) Agile Software Development
2 102 (30.82%) TDD
3 50 (15.11%) Continuous Integration
4 48 (14.50%) Scrum
5 45 (13.60%) Analytics
6 44 (13.29%) BDD
7 43 (12.99%) DevOps
8 42 (12.69%) MapReduce
9 41 (12.39%) Software Engineering
10 40 (12.08%) Microservices
11 35 (10.57%) ETL
12 34 (10.27%) Unit Testing
13 33 (9.97%) Data Science
14 29 (8.76%) System Testing
15 27 (8.16%) Business Intelligence
16 26 (7.85%) Machine Learning
17 24 (7.25%) E-Commerce
18 23 (6.95%) Benchmarking
18 23 (6.95%) Data Engineering
19 22 (6.65%) Data Modelling
Programming Languages
1 184 (55.59%) Java
2 139 (41.99%) Scala
3 85 (25.68%) Python
4 64 (19.34%) SQL
5 30 (9.06%) Java 8
6 24 (7.25%) Shell Script
7 20 (6.04%) JavaScript
8 16 (4.83%) Bash Shell
9 13 (3.93%) R
10 7 (2.11%) Perl
11 3 (0.91%) C#
11 3 (0.91%) C++
11 3 (0.91%) Groovy
11 3 (0.91%) PHP
12 2 (0.60%) C
13 1 (0.30%) ES6
13 1 (0.30%) Tcl
13 1 (0.30%) TypeScript
Qualifications
1 27 (8.16%) Degree
2 25 (7.55%) Security Cleared
3 18 (5.44%) SC Cleared
4 9 (2.72%) DV Cleared
5 6 (1.81%) CTC Cleared
6 3 (0.91%) Computer Science Degree
7 1 (0.30%) ACCA
Quality Assurance & Compliance
1 16 (4.83%) Data Quality
1 16 (4.83%) QA
2 5 (1.51%) PMO
3 3 (0.91%) SLA
4 2 (0.60%) GDPR
4 2 (0.60%) MiFID
5 1 (0.30%) GCP
System Software
1 72 (21.75%) HDFS
2 53 (16.01%) Apache ZooKeeper
3 31 (9.37%) Apache Flume
4 21 (6.34%) Docker
5 2 (0.60%) Virtual Machines
Systems Management
1 72 (21.75%) Hadoop YARN
2 25 (7.55%) Oozie
3 17 (5.14%) Ansible
4 16 (4.83%) Puppet
5 7 (2.11%) Terraform
6 4 (1.21%) Kibana
7 3 (0.91%) Ambari
7 3 (0.91%) Mesos
7 3 (0.91%) Opscode Chef
8 2 (0.60%) Kubernetes
8 2 (0.60%) Packer
9 1 (0.30%) Consul
9 1 (0.30%) Docker Swarm
9 1 (0.30%) Grafana
Vendors
1 71 (21.45%) Cloudera
2 34 (10.27%) Hortonworks
3 16 (4.83%) Tableau
4 15 (4.53%) Google
5 12 (3.63%) Microsoft
6 9 (2.72%) Oracle
6 9 (2.72%) Splunk
7 8 (2.42%) SAP
8 7 (2.11%) MapR
9 6 (1.81%) Atlassian
9 6 (1.81%) Databricks
9 6 (1.81%) Talend
10 4 (1.21%) Informatica
10 4 (1.21%) Teradata
11 3 (0.91%) Ab Initio
12 2 (0.60%) Sybase
12 2 (0.60%) Xamarin
13 1 (0.30%) Bloomberg
13 1 (0.30%) ION Trading
13 1 (0.30%) Reuters