Period
to 20 November 2018

The median contractor rate for a Big Data Developer was £550 per day in advertised job vacancies in England during the 6 months to 20 November 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data Developer
UK > England
6 months to
20 Nov 2018
Same period 2017 Same period 2016
Rank 626 539 637
Rank change year-on-year -87 +98 +63
Contract jobs requiring a Big Data Developer 231 325 247
As % of all contract IT jobs advertised in England 0.24% 0.35% 0.26%
As % of the Job Titles category 0.26% 0.36% 0.27%
Number of daily rates quoted 172 244 177
England median daily rate £550 £550 £550
10th Percentile £450 £416 £413
90th Percentile £688 £725 £743
UK median daily rate £550 £550 £550
Number of hourly rates quoted 0 2 0
England median hourly rate - £70.00 -
UK median hourly rate - £70.00 -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
England
Contract vacancies in England with a recognized job title 90,113 89,260 91,639
% of contract IT jobs with a recognized job title 94.74% 94.89% 94.84%
Number of daily rates quoted 60,258 59,454 60,363
England median daily rate £450 £450 £425
Median daily rate % change year-on-year - +5.88% +3.03%
10th Percentile £275 £263 £256
90th Percentile £638 £625 £600
UK median daily rate £450 £450 £425
% change year-on-year - +5.88% +6.25%
Number of hourly rates quoted 2,765 2,648 2,969
England median hourly rate £18.50 £18.67 £18.50
Median hourly rate % change year-on-year -0.92% +0.93% +2.78%
10th Percentile £11.17 £10.91 £10.50
90th Percentile £48.75 £48.00 £47.00
UK median hourly rate £18.00 £18.70 £18.00
% change year-on-year -3.74% +3.89% -

Big Data Developer
Job Vacancy Trend in England

Job postings that featured Big Data Developer in the job title as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data Developer in England

Big Data Developer
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data Developer in England.

Contractor daily rate trend for Big Data Developer in England

Big Data Developer
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data Developer in England over the 6 months to 20 November 2018.

Contractor daily rate histogram for Big Data Developer in England

Big Data Developer
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Developer within the England region over the 6 months to 20 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -111 141 £575 +4.55% 10
South East -6 66 £538 +7.50% 7
North of England -17 10 £538 +32.72%
North West -6 7 £550 +35.80%
Midlands +1 5 £600 -
East of England +4 4 £700 +93.10% 1
South West - 4 £588 - 2
West Midlands - 4 £600 -
Yorkshire - 3 £525 -
East Midlands +7 1 - -
Big Data Developer
UK

Big Data Developer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 20 November 2018, Big Data Developer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region featuring Big Data Developer in the job title.

1 231 (100.00%) Big Data
2 178 (77.06%) Apache Spark
3 167 (72.29%) Hadoop
4 146 (63.20%) Java
5 129 (55.84%) Kafka
6 94 (40.69%) Agile Software Development
7 83 (35.93%) Apache Hive
8 77 (33.33%) Finance
9 71 (30.74%) Python
10 65 (28.14%) Scala
11 61 (26.41%) HBase
12 60 (25.97%) TDD
13 57 (24.68%) SQL
13 57 (24.68%) HDFS
14 52 (22.51%) Spark Streaming
14 52 (22.51%) NoSQL
15 51 (22.08%) Spring
16 47 (20.35%) Jenkins
17 46 (19.91%) Hadoop YARN
18 43 (18.61%) Analytics
19 42 (18.18%) BDD
19 42 (18.18%) Linux
20 40 (17.32%) Apache
21 39 (16.88%) Apache Cassandra
21 39 (16.88%) Spring Boot
22 35 (15.15%) Java 8
22 35 (15.15%) Unix
23 33 (14.29%) ETL
23 33 (14.29%) Apache ZooKeeper
24 32 (13.85%) Scrum

Big Data Developer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 178 (77.06%) Apache Spark
2 40 (17.32%) Apache
3 27 (11.69%) Elasticsearch
4 16 (6.93%) Apache Pig
5 11 (4.76%) Apache Solr
6 8 (3.46%) Confluence
7 4 (1.73%) SAS
8 2 (0.87%) Cloud Foundry
8 2 (0.87%) GemFire
9 1 (0.43%) Oracle SOA Suite
Cloud Services
1 26 (11.26%) Amazon AWS
2 22 (9.52%) Microsoft Azure
3 15 (6.49%) GitHub
4 11 (4.76%) Google Cloud Platform
5 6 (2.60%) Amazon EMR
5 6 (2.60%) Amazon S3
6 5 (2.16%) Amazon Kinesis
7 3 (1.30%) PaaS
8 2 (0.87%) AWS Lambda
8 2 (0.87%) Azure Data Factory
8 2 (0.87%) Cloud Computing
8 2 (0.87%) Data Lake Analytics
8 2 (0.87%) Google Analytics
8 2 (0.87%) SaaS
8 2 (0.87%) Serverless
9 1 (0.43%) Amazon EC2
9 1 (0.43%) AWS CloudFormation
9 1 (0.43%) Cortana Intelligence Suite
9 1 (0.43%) npm
9 1 (0.43%) Yarn
Communications & Networking
1 14 (6.06%) SSH
2 13 (5.63%) Firewall
2 13 (5.63%) Internet
2 13 (5.63%) Kerberos
2 13 (5.63%) TCP/IP
3 3 (1.30%) SSL
3 3 (1.30%) VPN
4 2 (0.87%) HTTPS
4 2 (0.87%) SNA
Database & Business Intelligence
1 231 (100.00%) Big Data
2 167 (72.29%) Hadoop
3 83 (35.93%) Apache Hive
4 61 (26.41%) HBase
5 52 (22.51%) NoSQL
6 39 (16.88%) Apache Cassandra
7 26 (11.26%) Relational Database
8 21 (9.09%) MongoDB
9 20 (8.66%) Data Lake
10 18 (7.79%) Data Warehouse
11 17 (7.36%) Impala
11 17 (7.36%) Sqoop
12 13 (5.63%) Flink
13 9 (3.90%) Parquet
13 9 (3.90%) Power BI
14 7 (3.03%) Cosmos DB
14 7 (3.03%) PostgreSQL
14 7 (3.03%) SQL Server
15 6 (2.60%) Amazon Redshift
15 6 (2.60%) RDBMS
Development Applications
1 47 (20.35%) Jenkins
2 17 (7.36%) Git (software)
3 13 (5.63%) Maven
4 11 (4.76%) JIRA
5 8 (3.46%) IntelliJ
6 5 (2.16%) Cucumber
6 5 (2.16%) Gradle
7 4 (1.73%) Eclipse
7 4 (1.73%) GitLab
8 3 (1.30%) FishEye
8 3 (1.30%) Gatling
8 3 (1.30%) TeamCity
8 3 (1.30%) WebDriver
9 2 (0.87%) JUnit
9 2 (0.87%) Visual Studio
9 2 (0.87%) Visual Studio Team System
10 1 (0.43%) gulp
10 1 (0.43%) Log4j
10 1 (0.43%) RStudio
10 1 (0.43%) SoapUI
General
1 77 (33.33%) Finance
2 22 (9.52%) Banking
3 15 (6.49%) Legal
4 8 (3.46%) Investment Banking
5 3 (1.30%) Front Office
5 3 (1.30%) Games
6 2 (0.87%) Publishing
7 1 (0.43%) Dutch Language
7 1 (0.43%) French Language
7 1 (0.43%) Retail
7 1 (0.43%) Telecoms
Libraries, Frameworks & Software Standards
1 129 (55.84%) Kafka
2 52 (22.51%) Spark Streaming
3 51 (22.08%) Spring
4 39 (16.88%) Spring Boot
5 30 (12.99%) RabbitMQ
6 28 (12.12%) REST
7 26 (11.26%) J2EE
8 25 (10.82%) JSON
8 25 (10.82%) RESTful
9 24 (10.39%) Middleware
10 14 (6.06%) AngularJS
11 13 (5.63%) Samza
12 9 (3.90%) Apache Avro
13 8 (3.46%) HTML
14 7 (3.03%) Pandas
15 6 (2.60%) HTML5
15 6 (2.60%) Play Framework
15 6 (2.60%) React
15 6 (2.60%) Web Services
16 5 (2.16%) NumPy
Miscellaneous
1 27 (11.69%) Greenfield Project
2 24 (10.39%) Analytical Skills
3 12 (5.19%) Fintech
4 9 (3.90%) Algorithms
5 8 (3.46%) Computer Science
6 6 (2.60%) Data Structures
6 6 (2.60%) Linux Command Line
7 5 (2.16%) Virtual Team
8 4 (1.73%) Foreign Exchange (FX)
9 2 (0.87%) Enterprise Software
9 2 (0.87%) Replication
9 2 (0.87%) Social Network
10 1 (0.43%) Credit Risk
10 1 (0.43%) Derivative
10 1 (0.43%) Grid Computing
10 1 (0.43%) Hedge funds
10 1 (0.43%) Reference Data
10 1 (0.43%) Self-Motivation
10 1 (0.43%) Smart Meter
Operating Systems
1 42 (18.18%) Linux
2 35 (15.15%) Unix
3 1 (0.43%) Ubuntu
3 1 (0.43%) Windows
Processes & Methodologies
1 94 (40.69%) Agile Software Development
2 60 (25.97%) TDD
3 43 (18.61%) Analytics
4 42 (18.18%) BDD
5 33 (14.29%) ETL
6 32 (13.85%) Scrum
7 31 (13.42%) Data Analytics
8 28 (12.12%) DevOps
8 28 (12.12%) Unit Testing
9 25 (10.82%) Open Source
10 24 (10.39%) Data Ingestion
11 22 (9.52%) System Testing
12 21 (9.09%) Business Intelligence
13 19 (8.23%) Data Modelling
14 18 (7.79%) Big Data Analytics
15 17 (7.36%) Visualisation
16 16 (6.93%) Continuous Integration
16 16 (6.93%) E-Commerce
16 16 (6.93%) Microservices
16 16 (6.93%) Use Case
Programming Languages
1 146 (63.20%) Java
2 71 (30.74%) Python
3 65 (28.14%) Scala
4 57 (24.68%) SQL
5 35 (15.15%) Java 8
6 9 (3.90%) JavaScript
6 9 (3.90%) R
7 7 (3.03%) C#
7 7 (3.03%) Shell Script
8 5 (2.16%) Bash Shell
8 5 (2.16%) C++
9 4 (1.73%) Java 9
9 4 (1.73%) Perl
10 3 (1.30%) Groovy
10 3 (1.30%) TypeScript
11 2 (0.87%) Cypher
11 2 (0.87%) Haskell
12 1 (0.43%) Gremlin
12 1 (0.43%) PL/SQL
12 1 (0.43%) PowerShell
Qualifications
1 16 (6.93%) Degree
2 11 (4.76%) Security Cleared
3 10 (4.33%) SC Cleared
4 2 (0.87%) Computer Science Degree
5 1 (0.43%) BPSS Clearance
Quality Assurance & Compliance
1 5 (2.16%) QA
2 1 (0.43%) Data Quality
2 1 (0.43%) GDPR
2 1 (0.43%) SLA
System Software
1 57 (24.68%) HDFS
2 33 (14.29%) Apache ZooKeeper
3 16 (6.93%) Docker
4 13 (5.63%) Apache Flume
Systems Management
1 46 (19.91%) Hadoop YARN
2 15 (6.49%) Kubernetes
3 14 (6.06%) Oozie
4 9 (3.90%) Ansible
5 6 (2.60%) Terraform
6 2 (0.87%) Kibana
7 1 (0.43%) Ambari
7 1 (0.43%) Control-M
7 1 (0.43%) Docker Swarm
7 1 (0.43%) Ganglia
7 1 (0.43%) Grafana
7 1 (0.43%) ITRS Geneos
7 1 (0.43%) logstash
7 1 (0.43%) Nagios
7 1 (0.43%) Opscode Chef
7 1 (0.43%) Prometheus
7 1 (0.43%) Puppet
7 1 (0.43%) Tivoli
7 1 (0.43%) ZABBIX
Vendors
1 20 (8.66%) Cloudera
1 20 (8.66%) Hortonworks
2 12 (5.19%) Tableau
3 11 (4.76%) Oracle
4 10 (4.33%) Google
5 9 (3.90%) Microsoft
6 8 (3.46%) Informatica
7 5 (2.16%) Splunk
8 4 (1.73%) MapR
8 4 (1.73%) Talend
8 4 (1.73%) Teradata
9 3 (1.30%) Atlassian
10 2 (0.87%) Ab Initio
10 2 (0.87%) Databricks
10 2 (0.87%) Palantir
10 2 (0.87%) SAP
11 1 (0.43%) Alteryx
11 1 (0.43%) Cognos
11 1 (0.43%) Dataiku
11 1 (0.43%) Dynatrace