Period
to 21 November 2017

The median contractor rate for a Big Data Developer was £550 per day in advertised job vacancies in London during the 6 months to 21 November 2017.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data Developer
England > London
6 months to
21 Nov 2017
Same period 2016 Same period 2015
Rank 378 422 484
Rank change year-on-year +44 +62 +41
Contract jobs requiring a Big Data Developer 266 195 126
As % of all contract IT jobs advertised in London 0.57% 0.43% 0.27%
As % of the Job Titles category 0.60% 0.46% 0.28%
Number of daily rates quoted 222 153 100
London median daily rate £550 £575 £600
Median daily rate % change year-on-year -4.35% -4.17% +9.09%
10th Percentile £450 £450 £448
90th Percentile £725 £770 £675
England median daily rate £550 £550 £550
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate £70.00 - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
London
Contract vacancies in London with a recognized job title 44629 42675 44230
% of contract IT jobs with a recognized job title 94.82% 94.99% 95.02%
Number of daily rates quoted 32318 30339 31174
London median daily rate £495 £460 £450
Median daily rate % change year-on-year +7.61% +2.22% +5.88%
10th Percentile £300 £288 £268
90th Percentile £663 £638 £638
England median daily rate £450 £425 £413
% change year-on-year +5.88% +3.03% +3.13%
Number of hourly rates quoted 553 554 685
London median hourly rate £20.44 £19.77 £19.00
Median hourly rate % change year-on-year +3.38% +4.04% +8.57%
10th Percentile £12.50 £11.50 £11.25
90th Percentile £47.83 £50.00 £47.83
England median hourly rate £18.50 £18.50 £18.00
% change year-on-year - +2.78% +9.09%

Big Data Developer
Job Vacancy Trend in London

Job postings that featured Big Data Developer in the job title as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data Developer in London

Big Data Developer
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data Developer in London.

Contractor daily rate trend for Big Data Developer in London

Big Data Developer
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data Developer in London over the 6 months to 21 November 2017.

Contractor daily rate histogram for Big Data Developer in London

Big Data Developer
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Developer within the London region over the 6 months to 21 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +1 48 £638 -1.92% 8
South London -3 28 £538 -20.07%
East London +5 9 £600 +9.09%
West London -7 2 £509 -3.10%
Big Data Developer
England

Big Data Developer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 21 November 2017, Big Data Developer contract jobs required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the London region featuring Big Data Developer in the job title.

1 266 (100.00%) Big Data
2 215 (80.83%) Hadoop
3 201 (75.56%) Apache Spark
4 200 (75.19%) Java
5 135 (50.75%) Scala
6 113 (42.48%) Kafka
7 102 (38.35%) Agile Software Development
8 96 (36.09%) HBase
9 89 (33.46%) TDD
10 84 (31.58%) Python
11 75 (28.20%) Apache Hive
12 73 (27.44%) SQL
13 71 (26.69%) Finance
14 66 (24.81%) HDFS
15 65 (24.44%) Amazon AWS
16 63 (23.68%) REST
17 52 (19.55%) NoSQL
18 51 (19.17%) Scrum
19 49 (18.42%) Spring
20 48 (18.05%) BDD
21 47 (17.67%) Microservices
22 46 (17.29%) Apache Cassandra
22 46 (17.29%) Machine Learning
22 46 (17.29%) Banking
23 42 (15.79%) Security Cleared
24 38 (14.29%) MapReduce
24 38 (14.29%) ETL
25 35 (13.16%) Hadoop YARN
26 34 (12.78%) Apache
26 34 (12.78%) Web Services

Big Data Developer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 201 (75.56%) Apache Spark
2 34 (12.78%) Apache
3 33 (12.41%) Apache Solr
4 25 (9.40%) Apache Pig
5 21 (7.89%) Elasticsearch
6 15 (5.64%) Confluence
7 3 (1.13%) Jetty
7 3 (1.13%) Tomcat
8 2 (0.75%) JBoss
9 1 (0.38%) Apache Airflow
9 1 (0.38%) Luigi
9 1 (0.38%) nginx
9 1 (0.38%) OpenStack
Applications
1 1 (0.38%) Gephi
Cloud Services
1 65 (24.44%) Amazon AWS
2 14 (5.26%) Microsoft Azure
3 10 (3.76%) Amazon EC2
3 10 (3.76%) Amazon EMR
3 10 (3.76%) Amazon S3
4 8 (3.01%) Google Cloud Platform
5 5 (1.88%) GitHub
6 3 (1.13%) Amazon Kinesis
6 3 (1.13%) OpenShift
7 2 (0.75%) AWS CloudFormation
7 2 (0.75%) Route 53
8 1 (0.38%) Adobe Analytics
8 1 (0.38%) Azure Data Factory
8 1 (0.38%) Bluemix
8 1 (0.38%) Data Lake Analytics
8 1 (0.38%) Google Analytics
8 1 (0.38%) IBM Cloud
Communications & Networking
1 25 (9.40%) Kerberos
2 1 (0.38%) Internet
2 1 (0.38%) SSL
Database & Business Intelligence
1 266 (100.00%) Big Data
2 215 (80.83%) Hadoop
3 96 (36.09%) HBase
4 75 (28.20%) Apache Hive
5 52 (19.55%) NoSQL
6 46 (17.29%) Apache Cassandra
7 29 (10.90%) Impala
8 26 (9.77%) MongoDB
9 25 (9.40%) Relational Database
10 21 (7.89%) Data Warehouse
11 18 (6.77%) PostgreSQL
12 13 (4.89%) Blockchain
13 12 (4.51%) Data Mining
13 12 (4.51%) RDBMS
13 12 (4.51%) Riak
14 10 (3.76%) Flink
15 9 (3.38%) Cloudera CDH
15 9 (3.38%) DataStax
15 9 (3.38%) MarkLogic
15 9 (3.38%) Presto
Development Applications
1 22 (8.27%) Git (software)
1 22 (8.27%) Jenkins
2 20 (7.52%) JIRA
3 19 (7.14%) Cucumber
4 11 (4.14%) JUnit
5 8 (3.01%) IntelliJ
5 8 (3.01%) Mockito
6 7 (2.63%) Maven
7 5 (1.88%) WebDriver
8 3 (1.13%) Eclipse
8 3 (1.13%) GitLab
8 3 (1.13%) Gradle
8 3 (1.13%) Selenium
8 3 (1.13%) Subversion
9 2 (0.75%) Mercurial
10 1 (0.38%) Mocha
10 1 (0.38%) Visual Studio
General
1 71 (26.69%) Finance
2 46 (17.29%) Banking
3 20 (7.52%) Investment Banking
4 16 (6.02%) Front Office
5 13 (4.89%) Games
6 6 (2.26%) Retail
7 5 (1.88%) Marketing
7 5 (1.88%) Telecoms
8 4 (1.50%) Electronics
8 4 (1.50%) Manufacturing
9 3 (1.13%) Publishing
10 2 (0.75%) Advertising
10 2 (0.75%) Private Banking
11 1 (0.38%) Financial Institution
11 1 (0.38%) Law
Libraries, Frameworks & Software Standards
1 113 (42.48%) Kafka
2 63 (23.68%) REST
3 49 (18.42%) Spring
4 34 (12.78%) Web Services
5 31 (11.65%) Akka
6 27 (10.15%) Samza
6 27 (10.15%) Spring Boot
7 24 (9.02%) JSON
8 16 (6.02%) Drools
8 16 (6.02%) JMS
9 15 (5.64%) Spark Streaming
10 14 (5.26%) Apache Camel
10 14 (5.26%) Hibernate
11 13 (4.89%) Lucene
11 13 (4.89%) Play Framework
12 11 (4.14%) Apache Avro
12 11 (4.14%) Natural Language Processing
13 9 (3.38%) RESTful
13 9 (3.38%) TinkerPop
13 9 (3.38%) XML
Miscellaneous
1 31 (11.65%) Algorithms
2 21 (7.89%) Analytical Skills
3 15 (5.64%) Greenfield Project
4 14 (5.26%) Market Risk
5 12 (4.51%) Replication
6 10 (3.76%) Fintech
7 7 (2.63%) Data Structures
8 5 (1.88%) Computer Science
8 5 (1.88%) Equities
8 5 (1.88%) User Experience
9 4 (1.50%) Derivative
9 4 (1.50%) Linked Data
9 4 (1.50%) Linux Command Line
9 4 (1.50%) Semantic Web
10 3 (1.13%) Foreign Exchange (FX)
10 3 (1.13%) Online Games
11 2 (0.75%) Credit Risk
11 2 (0.75%) FMCG
11 2 (0.75%) N-Tier
11 2 (0.75%) Reference Data
Operating Systems
1 32 (12.03%) Linux
2 26 (9.77%) Unix
3 11 (4.14%) CentOS
4 10 (3.76%) Red Hat Enterprise Linux
5 1 (0.38%) Windows
Processes & Methodologies
1 102 (38.35%) Agile Software Development
2 89 (33.46%) TDD
3 51 (19.17%) Scrum
4 48 (18.05%) BDD
5 47 (17.67%) Microservices
6 46 (17.29%) Machine Learning
7 38 (14.29%) ETL
7 38 (14.29%) MapReduce
8 32 (12.03%) Data Architecture
9 31 (11.65%) Software Engineering
10 29 (10.90%) Analytics
11 28 (10.53%) Continuous Integration
11 28 (10.53%) DevOps
12 25 (9.40%) Data Modelling
13 24 (9.02%) OO
13 24 (9.02%) Pair Programming
14 23 (8.65%) Open Source
14 23 (8.65%) Visualisation
15 20 (7.52%) Unit Testing
16 18 (6.77%) Mentoring
Programming Languages
1 200 (75.19%) Java
2 135 (50.75%) Scala
3 84 (31.58%) Python
4 73 (27.44%) SQL
5 17 (6.39%) Bash Shell
5 17 (6.39%) JavaScript
6 14 (5.26%) C#
6 14 (5.26%) R
7 10 (3.76%) Perl
8 6 (2.26%) Groovy
8 6 (2.26%) SPARQL
9 4 (1.50%) Shell Script
10 3 (1.13%) C++
10 3 (1.13%) Clojure
11 2 (0.75%) PL/SQL
12 1 (0.38%) C
12 1 (0.38%) Data Analysis Expressions (DAX)
12 1 (0.38%) PowerShell
12 1 (0.38%) Ruby
12 1 (0.38%) T-SQL
Qualifications
1 42 (15.79%) Security Cleared
2 34 (12.78%) SC Cleared
3 10 (3.76%) Degree
4 7 (2.63%) DV Cleared
5 6 (2.26%) Computer Science Degree
6 2 (0.75%) CTC Cleared
6 2 (0.75%) Numerate Degree
7 1 (0.38%) BPSS Clearance
7 1 (0.38%) DBS Check
Quality Assurance & Compliance
1 13 (4.89%) QA
2 8 (3.01%) Data Quality
3 3 (1.13%) GCP
3 3 (1.13%) MiFID
System Software
1 66 (24.81%) HDFS
2 24 (9.02%) Docker
3 18 (6.77%) Apache ZooKeeper
4 17 (6.39%) Apache Flume
Systems Management
1 35 (13.16%) Hadoop YARN
2 19 (7.14%) Oozie
3 18 (6.77%) Ansible
4 14 (5.26%) Kubernetes
5 11 (4.14%) Terraform
6 7 (2.63%) Ambari
7 6 (2.26%) Opscode Chef
7 6 (2.26%) Puppet
8 3 (1.13%) Salt
9 2 (0.75%) Apache Slider
10 1 (0.38%) Mesos
10 1 (0.38%) Packer
Vendors
1 33 (12.41%) Cloudera
2 28 (10.53%) Hortonworks
3 12 (4.51%) Oracle
4 9 (3.38%) Google
5 5 (1.88%) Tableau
6 4 (1.50%) SAP
7 3 (1.13%) SaltStack
8 2 (0.75%) IBM
8 2 (0.75%) Sybase
8 2 (0.75%) Teradata
9 1 (0.38%) Adobe
9 1 (0.38%) Bloomberg
9 1 (0.38%) Brandwatch
9 1 (0.38%) Cognizant
9 1 (0.38%) Facebook
9 1 (0.38%) MapR
9 1 (0.38%) Microsoft
9 1 (0.38%) Reuters
9 1 (0.38%) Splunk
9 1 (0.38%) TIBCO