Period
to 20 February 2018

The median contractor rate for a Big Data Developer was £545 per day in advertised job vacancies in England during the 6 months to 20 February 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data Developer
UK > England
6 months to
20 Feb 2018
Same period 2017 Same period 2016
Rank 571 531 624
Rank change year-on-year -40 +93 +101
Contract jobs requiring a Big Data Developer 298 287 232
As % of all contract IT jobs advertised in England 0.32% 0.32% 0.24%
As % of the Job Titles category 0.34% 0.34% 0.25%
Number of daily rates quoted 179 212 167
England median daily rate £545 £550 £525
Median daily rate % change year-on-year -0.91% +4.76% -4.55%
10th Percentile £425 £425 £388
90th Percentile £705 £750 £675
UK median daily rate £545 £550 £525
% change year-on-year -0.91% +4.76% -4.55%
Number of hourly rates quoted 2 0 0
England median hourly rate £70.00 - -
UK median hourly rate £70.00 - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
England
Contract vacancies in England with a recognized job title 88,307 83,676 93,592
% of contract IT jobs with a recognized job title 94.71% 94.74% 95.14%
Number of daily rates quoted 59,256 54,952 60,773
England median daily rate £450 £425 £420
Median daily rate % change year-on-year +5.88% +1.19% +5.00%
10th Percentile £263 £256 £255
90th Percentile £638 £613 £600
UK median daily rate £450 £425 £413
% change year-on-year +5.88% +3.03% +3.13%
Number of hourly rates quoted 2,620 2,935 3,448
England median hourly rate £18.70 £18.50 £18.50
Median hourly rate % change year-on-year +1.08% - +11.45%
10th Percentile £11.00 £10.61 £10.50
90th Percentile £48.01 £47.50 £47.50
UK median hourly rate £18.70 £18.00 £19.00
% change year-on-year +3.89% -5.26% +15.15%

Big Data Developer
Job Vacancy Trend in England

Job postings that featured Big Data Developer in the job title as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data Developer in England

Big Data Developer
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data Developer in England.

Contractor daily rate trend for Big Data Developer in England

Big Data Developer
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data Developer in England over the 6 months to 20 February 2018.

Contractor daily rate histogram for Big Data Developer in England

Big Data Developer
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Developer within the England region over the 6 months to 20 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -75 176 £550 -8.33% 42
South East +46 93 £500 +17.65% 12
Midlands +16 16 £500 +33.33% 2
East Midlands +16 15 £500 -6.98% 2
North of England +35 6 £500 -1.23% 2
South West +5 4 £650 +33.33% 3
Yorkshire - 4 £500 - 1
East of England -13 3 £525 +31.25% 1
North West +10 2 £550 +8.64% 1
West Midlands +7 1 £500 +33.33%
Big Data Developer
UK

Big Data Developer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 20 February 2018, Big Data Developer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region featuring Big Data Developer in the job title.

1 298 (100.00%) Big Data
2 255 (85.57%) Hadoop
3 216 (72.48%) Apache Spark
4 176 (59.06%) Java
5 140 (46.98%) Kafka
6 139 (46.64%) Scala
7 120 (40.27%) Agile Software Development
8 99 (33.22%) HBase
9 98 (32.89%) Apache Hive
10 92 (30.87%) TDD
11 81 (27.18%) Linux
12 76 (25.50%) Apache
13 72 (24.16%) Python
13 72 (24.16%) HDFS
14 71 (23.83%) SQL
15 64 (21.48%) Cloudera
16 59 (19.80%) Finance
17 58 (19.46%) Banking
17 58 (19.46%) Spring
18 53 (17.79%) REST
19 51 (17.11%) Jenkins
20 50 (16.78%) Impala
20 50 (16.78%) Hadoop YARN
20 50 (16.78%) Spark Streaming
21 49 (16.44%) NoSQL
22 48 (16.11%) Amazon AWS
23 47 (15.77%) Git (software)
24 44 (14.77%) Scrum
25 43 (14.43%) JSON
25 43 (14.43%) Apache ZooKeeper

Big Data Developer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 216 (72.48%) Apache Spark
2 76 (25.50%) Apache
3 17 (5.70%) Apache Pig
4 15 (5.03%) Apache Solr
5 14 (4.70%) Elasticsearch
6 12 (4.03%) Cloud Foundry
7 7 (2.35%) Tomcat
8 6 (2.01%) Confluence
8 6 (2.01%) GemFire
8 6 (2.01%) JBoss
9 2 (0.67%) IPython
9 2 (0.67%) Jetty
9 2 (0.67%) Jupyter
10 1 (0.34%) GeoServer
10 1 (0.34%) OpenStack
10 1 (0.34%) SharePoint
Applications
1 2 (0.67%) SPSS
2 1 (0.34%) Gephi
Cloud Services
1 48 (16.11%) Amazon AWS
2 34 (11.41%) GitHub
3 15 (5.03%) Microsoft Azure
4 8 (2.68%) Google Cloud Platform
5 7 (2.35%) PaaS
6 6 (2.01%) Amazon EC2
6 6 (2.01%) Amazon EMR
6 6 (2.01%) Amazon S3
7 3 (1.01%) Amazon Kinesis
7 3 (1.01%) Cloud Computing
8 2 (0.67%) AWS CloudFormation
8 2 (0.67%) OpenShift
8 2 (0.67%) Route 53
8 2 (0.67%) Serverless
9 1 (0.34%) AWS Lambda
9 1 (0.34%) Azure Data Factory
9 1 (0.34%) Bluemix
9 1 (0.34%) Data Lake Analytics
9 1 (0.34%) IaaS
9 1 (0.34%) IBM Cloud
Communications & Networking
1 13 (4.36%) Kerberos
2 1 (0.34%) Internet
2 1 (0.34%) SSL
Database & Business Intelligence
1 298 (100.00%) Big Data
2 255 (85.57%) Hadoop
3 99 (33.22%) HBase
4 98 (32.89%) Apache Hive
5 50 (16.78%) Impala
6 49 (16.44%) NoSQL
7 37 (12.42%) Sqoop
8 27 (9.06%) SQL Server
9 25 (8.39%) Apache Cassandra
9 25 (8.39%) Parquet
10 23 (7.72%) Cloudera CDH
11 21 (7.05%) Relational Database
12 20 (6.71%) Data Warehouse
13 18 (6.04%) Data Lake
14 15 (5.03%) MongoDB
15 14 (4.70%) Flink
16 12 (4.03%) PostgreSQL
17 10 (3.36%) Apache Kudu
18 8 (2.68%) Presto
19 7 (2.35%) Amazon Redshift
Development Applications
1 51 (17.11%) Jenkins
2 47 (15.77%) Git (software)
3 29 (9.73%) Gradle
4 17 (5.70%) JIRA
5 13 (4.36%) Team Foundation Server
6 11 (3.69%) IntelliJ
7 9 (3.02%) JUnit
7 9 (3.02%) Maven
8 7 (2.35%) Cucumber
9 4 (1.34%) GitLab
10 3 (1.01%) Subversion
10 3 (1.01%) WebDriver
11 2 (0.67%) GoCD
11 2 (0.67%) Mercurial
11 2 (0.67%) Vagrant
12 1 (0.34%) JConsole
12 1 (0.34%) SonarQube
12 1 (0.34%) Sonatype Nexus
12 1 (0.34%) TeamCity
12 1 (0.34%) VisualVM
General
1 59 (19.80%) Finance
2 58 (19.46%) Banking
3 12 (4.03%) Investment Banking
4 9 (3.02%) Publishing
5 8 (2.68%) Games
6 5 (1.68%) Advertising
7 4 (1.34%) Automotive
7 4 (1.34%) Retail
7 4 (1.34%) Telecoms
8 2 (0.67%) Financial Institution
8 2 (0.67%) Manufacturing
8 2 (0.67%) Private Banking
8 2 (0.67%) Retail Banking
9 1 (0.34%) Electronics
9 1 (0.34%) French Language
9 1 (0.34%) Front Office
9 1 (0.34%) Law
9 1 (0.34%) Marketing
9 1 (0.34%) Pharmaceutical
9 1 (0.34%) Spanish Language
Libraries, Frameworks & Software Standards
1 140 (46.98%) Kafka
2 58 (19.46%) Spring
3 53 (17.79%) REST
4 50 (16.78%) Spark Streaming
5 43 (14.43%) JSON
6 33 (11.07%) Middleware
7 30 (10.07%) Apache Avro
7 30 (10.07%) J2EE
8 29 (9.73%) RabbitMQ
8 29 (9.73%) Spring Boot
9 18 (6.04%) RESTful
9 18 (6.04%) Samza
9 18 (6.04%) Web Services
10 15 (5.03%) Akka
11 13 (4.36%) JMS
12 12 (4.03%) Apache Camel
13 11 (3.69%) Drools
14 10 (3.36%) XML
15 9 (3.02%) Hibernate
16 8 (2.68%) Lucene
Miscellaneous
1 27 (9.06%) Linux Command Line
1 27 (9.06%) Virtual Team
2 20 (6.71%) Algorithms
3 15 (5.03%) Greenfield Project
4 13 (4.36%) Analytical Skills
4 13 (4.36%) Replication
5 6 (2.01%) Data Structures
6 5 (1.68%) Market Risk
7 4 (1.34%) Fintech
7 4 (1.34%) User Experience
8 3 (1.01%) Derivative
8 3 (1.01%) Online Games
8 3 (1.01%) Semantic Web
9 2 (0.67%) Equities
9 2 (0.67%) Foreign Exchange (FX)
9 2 (0.67%) Grid Computing
10 1 (0.34%) Clustering
10 1 (0.34%) Credit Derivative
10 1 (0.34%) Fixed Income
10 1 (0.34%) NHS
Operating Systems
1 81 (27.18%) Linux
2 42 (14.09%) Unix
3 13 (4.36%) Red Hat Enterprise Linux
4 12 (4.03%) CentOS
5 2 (0.67%) Windows
6 1 (0.34%) Windows Server
6 1 (0.34%) Windows Server 2008
Processes & Methodologies
1 120 (40.27%) Agile Software Development
2 92 (30.87%) TDD
3 44 (14.77%) Scrum
4 42 (14.09%) MapReduce
5 41 (13.76%) BDD
6 40 (13.42%) Continuous Integration
7 39 (13.09%) Analytics
8 34 (11.41%) Data Science
9 33 (11.07%) ETL
10 32 (10.74%) Unit Testing
11 31 (10.40%) Software Engineering
12 27 (9.06%) Benchmarking
12 27 (9.06%) System Testing
13 24 (8.05%) Microservices
14 23 (7.72%) Machine Learning
15 20 (6.71%) DevOps
16 19 (6.38%) Data Ingestion
17 18 (6.04%) Data Engineering
17 18 (6.04%) Data Modelling
17 18 (6.04%) Visualisation
Programming Languages
1 176 (59.06%) Java
2 139 (46.64%) Scala
3 72 (24.16%) Python
4 71 (23.83%) SQL
5 29 (9.73%) Shell Script
6 12 (4.03%) Bash Shell
7 11 (3.69%) JavaScript
8 10 (3.36%) C#
8 10 (3.36%) R
9 5 (1.68%) Perl
10 4 (1.34%) Gremlin
11 1 (0.34%) C
11 1 (0.34%) Data Analysis Expressions (DAX)
11 1 (0.34%) ES6
11 1 (0.34%) Groovy
11 1 (0.34%) PowerShell
11 1 (0.34%) T-SQL
11 1 (0.34%) TypeScript
Qualifications
1 33 (11.07%) Security Cleared
2 32 (10.74%) Degree
3 24 (8.05%) SC Cleared
4 6 (2.01%) DV Cleared
5 3 (1.01%) Computer Science Degree
5 3 (1.01%) CTC Cleared
6 1 (0.34%) ACCA
6 1 (0.34%) BPSS Clearance
6 1 (0.34%) Numerate Degree
Quality Assurance & Compliance
1 15 (5.03%) QA
2 9 (3.02%) Data Quality
3 4 (1.34%) GDPR
4 3 (1.01%) GCP
5 2 (0.67%) MiFID
6 1 (0.34%) PMO
System Software
1 72 (24.16%) HDFS
2 43 (14.43%) Apache ZooKeeper
3 26 (8.72%) Apache Flume
4 21 (7.05%) Docker
5 1 (0.34%) Virtual Machines
Systems Management
1 50 (16.78%) Hadoop YARN
2 15 (5.03%) Oozie
3 14 (4.70%) Ansible
4 7 (2.35%) Mesos
5 6 (2.01%) Kubernetes
5 6 (2.01%) Puppet
6 5 (1.68%) Ambari
6 5 (1.68%) Kibana
6 5 (1.68%) Opscode Chef
7 3 (1.01%) logstash
7 3 (1.01%) Salt
7 3 (1.01%) Terraform
8 1 (0.34%) Apache Slider
8 1 (0.34%) Packer
Vendors
1 64 (21.48%) Cloudera
2 25 (8.39%) Hortonworks
3 11 (3.69%) Oracle
4 8 (2.68%) Google
4 8 (2.68%) Tableau
5 7 (2.35%) SAP
6 6 (2.01%) MapR
6 6 (2.01%) Microsoft
6 6 (2.01%) Red Hat
7 4 (1.34%) Ab Initio
7 4 (1.34%) Teradata
8 3 (1.01%) Splunk
9 2 (0.67%) Atlassian
9 2 (0.67%) IBM
10 1 (0.34%) Adobe
10 1 (0.34%) Brandwatch
10 1 (0.34%) Databricks
10 1 (0.34%) Informatica
10 1 (0.34%) Workday