Period
to 10 December 2018

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 10 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
London > Central London
6 months to
10 Dec 2018
Same period 2017 Same period 2016
Rank 100 97 65
Rank change year-on-year -3 -32 +53
Contract jobs citing Hadoop 251 237 291
As % of all contract IT jobs advertised in Central London 2.69% 2.76% 3.71%
As % of the Database & Business Intelligence category 11.06% 11.22% 14.29%
Number of daily rates quoted 200 200 233
Central London median daily rate £575 £600 £580
Median daily rate % change year-on-year -4.17% +3.45% +0.87%
10th Percentile £499 £474 £428
90th Percentile £700 £725 £700
London median daily rate £575 £550 £550
% change year-on-year +4.55% - -4.35%
Number of hourly rates quoted 0 0 0
Central London median hourly rate - - -
London median hourly rate £55.00 - £100.00

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 2,270 2,113 2,037
As % of all contract IT jobs advertised in Central London 24.31% 24.60% 25.99%
Number of daily rates quoted 1,812 1,714 1,604
Central London median daily rate £525 £525 £475
Median daily rate % change year-on-year - +10.53% +2.70%
10th Percentile £370 £363 £325
90th Percentile £675 £688 £650
London median daily rate £525 £500 £475
% change year-on-year +5.00% +5.26% +5.56%
Number of hourly rates quoted 11 12 1
Central London median hourly rate £35.00 £27.50 £45.00
Median hourly rate % change year-on-year +27.27% -38.89% +91.59%
10th Percentile £19.50 £20.75 £42.50
90th Percentile £42.19 £33.25 £47.50
London median hourly rate £27.50 £27.50 £29.88
% change year-on-year - -7.97% +35.97%

Hadoop
Job Vacancy Trend in Central London

Job postings citing Hadoop as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Central London.

Contractor daily rate trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Hadoop in Central London over the 6 months to 10 December 2018.

Contractor daily rate histogram for Hadoop in Central London

Hadoop
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the Central London region over the 6 months to 10 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London -4 217 £575 -4.17% 72
Southwark -12 31 £550 +12.82%
West End of London -30 9 £525 +31.25% 9
City of Westminster -9 2 £525 -6.67%
Camden - 1 £600 -
Hadoop
London

For the 6 months to 10 December 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Hadoop.

1 177 (70.52%) Big Data
2 141 (56.18%) Apache Spark
3 129 (51.39%) Kafka
4 105 (41.83%) Python
5 100 (39.84%) Apache Hive
6 92 (36.65%) Java
7 87 (34.66%) Finance
8 82 (32.67%) SQL
9 69 (27.49%) Agile Software Development
9 69 (27.49%) Amazon AWS
10 67 (26.69%) Data Science
11 63 (25.10%) Analytics
12 54 (21.51%) Data Modelling
13 51 (20.32%) Java 8
14 49 (19.52%) Machine Learning
15 47 (18.73%) Linux
16 46 (18.33%) DevOps
17 44 (17.53%) ETL
18 41 (16.33%) Docker
19 40 (15.94%) SQL Server
20 39 (15.54%) Git (software)
21 38 (15.14%) Scala
21 38 (15.14%) Data Warehouse
21 38 (15.14%) MongoDB
22 37 (14.74%) Elasticsearch
22 37 (14.74%) Microsoft Azure
23 36 (14.34%) Oracle
23 36 (14.34%) HDFS
23 36 (14.34%) Kubernetes
24 35 (13.94%) Cloudera

Hadoop
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 141 (56.18%) Apache Spark
2 37 (14.74%) Elasticsearch
3 20 (7.97%) Apache
4 15 (5.98%) SAS
5 12 (4.78%) Confluence
6 6 (2.39%) Apache Pig
7 4 (1.59%) Apache Solr
8 3 (1.20%) Cloud Foundry
9 2 (0.80%) Apache Airflow
9 2 (0.80%) Luigi
10 1 (0.40%) SharePoint
Applications
1 12 (4.78%) Microsoft Excel
2 10 (3.98%) MS Visio
3 1 (0.40%) Spreadsheet
Business Applications
1 6 (2.39%) SAP Oil and Gas
2 1 (0.40%) Dynamics NAV
Cloud Services
1 69 (27.49%) Amazon AWS
2 37 (14.74%) Microsoft Azure
3 16 (6.37%) Heroku
4 14 (5.58%) Amazon S3
4 14 (5.58%) Google Cloud Platform
5 12 (4.78%) Amazon EC2
6 11 (4.38%) Amazon EMR
7 10 (3.98%) Virtual Private Cloud
8 6 (2.39%) Azure Data Factory
8 6 (2.39%) GitHub
8 6 (2.39%) IBM Cloud
9 5 (1.99%) Data Lake Analytics
10 2 (0.80%) Amazon Kinesis
10 2 (0.80%) AWS Lambda
10 2 (0.80%) Serverless
11 1 (0.40%) Adobe Analytics
11 1 (0.40%) Akamai
11 1 (0.40%) iPaaS
11 1 (0.40%) PaaS
Communications & Networking
1 20 (7.97%) HTTP
2 19 (7.57%) SSL
3 16 (6.37%) DNS
3 16 (6.37%) FTP
3 16 (6.37%) TCP/IP
4 9 (3.59%) Kerberos
5 2 (0.80%) Firewall
6 1 (0.40%) Internet
6 1 (0.40%) LAN
6 1 (0.40%) SNA
6 1 (0.40%) X.509
Database & Business Intelligence
1 177 (70.52%) Big Data
2 100 (39.84%) Apache Hive
3 40 (15.94%) SQL Server
4 38 (15.14%) Data Warehouse
4 38 (15.14%) MongoDB
5 33 (13.15%) Apache Cassandra
5 33 (13.15%) HBase
6 30 (11.95%) Impala
7 27 (10.76%) NoSQL
8 26 (10.36%) Data Lake
9 20 (7.97%) Data Mining
9 20 (7.97%) Enterprise Data Warehouse
9 20 (7.97%) OLAP
9 20 (7.97%) SQL Server Integration Services
9 20 (7.97%) Sqoop
10 19 (7.57%) OLAP Cube
10 19 (7.57%) Power BI
10 19 (7.57%) Star Schema
11 17 (6.77%) Relational Database
12 11 (4.38%) Spotfire
Development Applications
1 39 (15.54%) Git (software)
2 31 (12.35%) Jenkins
3 22 (8.76%) Maven
4 19 (7.57%) GitLab
5 18 (7.17%) JIRA
6 17 (6.77%) Gradle
7 16 (6.37%) gulp
8 10 (3.98%) Subversion
9 8 (3.19%) Cucumber
10 7 (2.79%) Atlassian Bamboo
10 7 (2.79%) FishEye
10 7 (2.79%) jMock
10 7 (2.79%) JUnit
11 5 (1.99%) Visual Studio Team System
12 4 (1.59%) Visual Studio
13 3 (1.20%) Artifactory
13 3 (1.20%) Sonatype Nexus
14 2 (0.80%) Octopus Deploy
14 2 (0.80%) TeamCity
14 2 (0.80%) Travis CI
General
1 87 (34.66%) Finance
2 20 (7.97%) Retail
3 13 (5.18%) Banking
4 12 (4.78%) Front Office
5 4 (1.59%) Publishing
6 3 (1.20%) Back Office
6 3 (1.20%) Legal
7 2 (0.80%) Advertising
7 2 (0.80%) Financial Institution
7 2 (0.80%) Marketing
7 2 (0.80%) Telecoms
8 1 (0.40%) Corporate Banking
8 1 (0.40%) Electronics
8 1 (0.40%) Investment Banking
Job Titles
1 80 (31.87%) Data Engineer
2 75 (29.88%) Developer
3 49 (19.52%) Big Data Engineer
4 43 (17.13%) Java Developer
5 41 (16.33%) Hadoop Engineer
6 25 (9.96%) Senior Developer
7 18 (7.17%) Big Data Developer
7 18 (7.17%) Lead Developer
7 18 (7.17%) Lead Java Developer
8 17 (6.77%) Data Scientist
8 17 (6.77%) Senior Java Developer
9 13 (5.18%) Java Engineer
9 13 (5.18%) Python Engineer
9 13 (5.18%) Senior Hadoop Engineer
9 13 (5.18%) Senior Java Engineer
9 13 (5.18%) Technical Leader
10 12 (4.78%) Apache Spark Developer
10 12 (4.78%) Elasticsearch Engineer
10 12 (4.78%) Technical Developer
11 11 (4.38%) Azure Engineer
Libraries, Frameworks & Software Standards
1 129 (51.39%) Kafka
2 32 (12.75%) AngularJS
3 29 (11.55%) REST
4 26 (10.36%) Spring
5 20 (7.97%) CSS
5 20 (7.97%) HTML
6 19 (7.57%) HTML5
7 18 (7.17%) OAuth
7 18 (7.17%) OAuth2
7 18 (7.17%) SOAP
7 18 (7.17%) Spring Boot
8 16 (6.37%) Dropwizard
8 16 (6.37%) Ember.js
8 16 (6.37%) Guice
8 16 (6.37%) Ratpack
9 11 (4.38%) Spark Streaming
10 9 (3.59%) PySpark
11 8 (3.19%) Natural Language Processing
12 7 (2.79%) JSON
13 6 (2.39%) LDAP
Miscellaneous
1 30 (11.95%) Algorithms
2 25 (9.96%) Greenfield Project
3 12 (4.78%) Analytical Skills
4 10 (3.98%) Wiki
5 6 (2.39%) Fintech
6 3 (1.20%) iPad
7 2 (0.80%) Data Centre
7 2 (0.80%) Management Information System
7 2 (0.80%) Private Cloud
7 2 (0.80%) User Experience
8 1 (0.40%) Cyberthreat
8 1 (0.40%) Data Structures
8 1 (0.40%) Derivative
8 1 (0.40%) Distributed Denial-of-Service
8 1 (0.40%) HoloLens
8 1 (0.40%) Media Streaming
8 1 (0.40%) PKI
8 1 (0.40%) Reference Data
8 1 (0.40%) Robotics
8 1 (0.40%) Self-Motivation
Operating Systems
1 47 (18.73%) Linux
2 23 (9.16%) Unix
3 10 (3.98%) Windows
4 8 (3.19%) Red Hat Enterprise Linux
5 2 (0.80%) Android
Processes & Methodologies
1 69 (27.49%) Agile Software Development
2 67 (26.69%) Data Science
3 63 (25.10%) Analytics
4 54 (21.51%) Data Modelling
5 49 (19.52%) Machine Learning
6 46 (18.33%) DevOps
7 44 (17.53%) ETL
8 32 (12.75%) Business Intelligence
9 28 (11.16%) Scrum
10 27 (10.76%) Microservices
10 27 (10.76%) Visualisation
11 22 (8.76%) Data Analysis
11 22 (8.76%) Data Integration
12 21 (8.37%) TDD
13 19 (7.57%) SQL Optimisation
14 17 (6.77%) Data Engineering
15 16 (6.37%) Continuous Integration
15 16 (6.37%) Domain-Driven Design
15 16 (6.37%) MapReduce
15 16 (6.37%) OWASP
Programming Languages
1 105 (41.83%) Python
2 92 (36.65%) Java
3 82 (32.67%) SQL
4 51 (20.32%) Java 8
5 38 (15.14%) Scala
6 30 (11.95%) JavaScript
7 26 (10.36%) R
8 17 (6.77%) Bash Shell
9 16 (6.37%) ES6
9 16 (6.37%) TypeScript
10 13 (5.18%) Shell Script
11 12 (4.78%) PowerShell
12 11 (4.38%) MATLAB
13 10 (3.98%) Korn
14 9 (3.59%) Groovy
15 8 (3.19%) C#
16 6 (2.39%) Java 9
17 3 (1.20%) Clojure
17 3 (1.20%) Kotlin
17 3 (1.20%) Perl
Qualifications
1 17 (6.77%) Degree
2 9 (3.59%) PhD
3 8 (3.19%) Security Cleared
4 7 (2.79%) Computer Science Degree
5 6 (2.39%) Master's Degree
6 1 (0.40%) DV Cleared
6 1 (0.40%) Numerate Degree
Quality Assurance & Compliance
1 24 (9.56%) Data Quality
2 5 (1.99%) QA
3 1 (0.40%) GDPR
3 1 (0.40%) SLA
System Software
1 41 (16.33%) Docker
2 36 (14.34%) HDFS
3 27 (10.76%) Apache Flume
4 6 (2.39%) Active Directory
5 4 (1.59%) Apache ZooKeeper
Systems Management
1 36 (14.34%) Kubernetes
2 29 (11.55%) Ansible
2 29 (11.55%) Hadoop YARN
3 28 (11.16%) Oozie
4 18 (7.17%) Puppet
5 17 (6.77%) Opscode Chef
6 16 (6.37%) Docker Swarm
7 15 (5.98%) Terraform
8 7 (2.79%) Ambari
9 3 (1.20%) ITRS Geneos
9 3 (1.20%) Tivoli
10 2 (0.80%) Apache Slider
10 2 (0.80%) Grafana
10 2 (0.80%) Kibana
10 2 (0.80%) logstash
10 2 (0.80%) Prometheus
11 1 (0.40%) Salt
Vendors
1 36 (14.34%) Oracle
2 35 (13.94%) Cloudera
3 29 (11.55%) Hortonworks
4 20 (7.97%) Tableau
4 20 (7.97%) Talend
5 15 (5.98%) Microsoft
6 14 (5.58%) Google
7 13 (5.18%) Alteryx
8 12 (4.78%) Informatica
9 7 (2.79%) Atlassian
9 7 (2.79%) SAP
9 7 (2.79%) Sybase
10 6 (2.39%) Databricks
10 6 (2.39%) IBM
10 6 (2.39%) MapR
10 6 (2.39%) Red Hat
11 3 (1.20%) Teradata
12 2 (0.80%) Ab Initio
13 1 (0.40%) ION Trading
13 1 (0.40%) RapidMiner