Period
to 23 October 2018

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 23 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Tower Hamlets > Canary Wharf
6 months to
23 Oct 2018
Same period 2017 Same period 2016
Rank 18 34 33
Rank change year-on-year +16 -1 +2
Contract jobs citing Hadoop 43 12 7
As % of all contract IT jobs advertised in Canary Wharf 12.91% 4.32% 2.34%
As % of the Database & Business Intelligence category 33.33% 17.65% 9.86%
Number of daily rates quoted 23 4 4
Canary Wharf median daily rate £575 £538 £438
Median daily rate % change year-on-year +6.98% +22.86% -10.26%
10th Percentile £500 £504 £330
90th Percentile £588 £603 £531
Tower Hamlets median daily rate £575 £529 £475
% change year-on-year +8.75% +11.32% -9.52%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Canary Wharf
Contract vacancies with a requirement for database or business intelligence skills 129 68 71
As % of all contract IT jobs advertised in Canary Wharf 38.74% 24.46% 23.75%
Number of daily rates quoted 88 43 54
Canary Wharf median daily rate £514 £625 £400
Median daily rate % change year-on-year -17.80% +56.25% -15.79%
10th Percentile £400 £451 £313
90th Percentile £600 £700 £625
Tower Hamlets median daily rate £514 £600 £400
% change year-on-year -14.38% +50.00% -23.81%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop
Job Vacancy Trend in Canary Wharf

Job postings citing Hadoop as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Canary Wharf.

Contractor daily rate trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Hadoop in Canary Wharf over the 6 months to 23 October 2018.

Contractor daily rate histogram for Hadoop in Canary Wharf

For the 6 months to 23 October 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Hadoop.

1 43 (100.00%) Python
2 30 (69.77%) Amazon AWS
3 29 (67.44%) SQL
4 26 (60.47%) Big Data
5 23 (53.49%) Ansible
6 21 (48.84%) SQL Server
6 21 (48.84%) Finance
6 21 (48.84%) Apache Spark
7 20 (46.51%) Data Science
8 19 (44.19%) Algorithms
9 18 (41.86%) Java
10 17 (39.53%) Analytics
10 17 (39.53%) Scala
10 17 (39.53%) DevOps
11 16 (37.21%) NoSQL
11 16 (37.21%) Relational Database
11 16 (37.21%) Agile Software Development
12 15 (34.88%) Git (software)
13 14 (32.56%) RESTful
13 14 (32.56%) Deep Learning
13 14 (32.56%) ETL
14 13 (30.23%) Greenfield Project
14 13 (30.23%) Microservices
14 13 (30.23%) Kubernetes
14 13 (30.23%) Terraform
14 13 (30.23%) RDBMS
14 13 (30.23%) Docker
15 12 (27.91%) Unity (Game Engine)
15 12 (27.91%) OpenCV
15 12 (27.91%) Visual Studio Team System

Hadoop
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 21 (48.84%) Apache Spark
2 4 (9.30%) SAS
3 3 (6.98%) Apache Solr
3 3 (6.98%) Confluence
3 3 (6.98%) Elasticsearch
3 3 (6.98%) SharePoint
4 1 (2.33%) Apache Pig
Applications
1 7 (16.28%) Microsoft Excel
1 7 (16.28%) MS Visio
2 1 (2.33%) Chatbot
Business Applications
1 2 (4.65%) SAP Oil and Gas
Cloud Services
1 30 (69.77%) Amazon AWS
2 10 (23.26%) Amazon S3
3 8 (18.60%) Microsoft Azure
4 7 (16.28%) Amazon EC2
4 7 (16.28%) Virtual Private Cloud
5 1 (2.33%) Azure Data Factory
5 1 (2.33%) Google Cloud Platform
Communications & Networking
1 3 (6.98%) Kerberos
1 3 (6.98%) SSL
1 3 (6.98%) VPN
Database & Business Intelligence
1 26 (60.47%) Big Data
2 21 (48.84%) SQL Server
3 16 (37.21%) NoSQL
3 16 (37.21%) Relational Database
4 13 (30.23%) RDBMS
5 12 (27.91%) Apache Hive
6 9 (20.93%) Power BI
7 7 (16.28%) Impala
7 7 (16.28%) Sqoop
8 6 (13.95%) HBase
8 6 (13.95%) Spotfire
9 5 (11.63%) Data Lake
10 4 (9.30%) Data Mining
10 4 (9.30%) Data Warehouse
11 3 (6.98%) Amazon Redshift
11 3 (6.98%) Apache Cassandra
11 3 (6.98%) HDInsight
11 3 (6.98%) Parquet
12 2 (4.65%) Cosmos DB
12 2 (4.65%) MongoDB
Development Applications
1 15 (34.88%) Git (software)
2 12 (27.91%) Visual Studio Team System
3 7 (16.28%) Jenkins
4 3 (6.98%) FishEye
4 3 (6.98%) JIRA
General
1 21 (48.84%) Finance
2 3 (6.98%) Games
3 1 (2.33%) Retail
Job Titles
1 14 (32.56%) Data Engineer
2 13 (30.23%) AWS DevOps
2 13 (30.23%) AWS DevOps Engineer
2 13 (30.23%) AWS Engineer
2 13 (30.23%) Big Data Engineer
2 13 (30.23%) DevOps Engineer
2 13 (30.23%) Hadoop Engineer
3 7 (16.28%) Platform Engineer
4 4 (9.30%) Data Scientist
5 3 (6.98%) Big Data Developer
5 3 (6.98%) Developer
5 3 (6.98%) Hadoop Developer
6 2 (4.65%) Analytics Consultant
6 2 (4.65%) Consultant
6 2 (4.65%) Python Engineer
7 1 (2.33%) Azure Consultant
7 1 (2.33%) Azure Engineer
7 1 (2.33%) Hadoop Consultant
7 1 (2.33%) Junior Data Scientist
7 1 (2.33%) MATLAB Engineer
Libraries, Frameworks & Software Standards
1 14 (32.56%) RESTful
2 12 (27.91%) OpenCV
2 12 (27.91%) Unity (Game Engine)
3 4 (9.30%) Kafka
3 4 (9.30%) Natural Language Processing
4 3 (6.98%) HTML
4 3 (6.98%) HTML5
4 3 (6.98%) Keras
4 3 (6.98%) Play Framework
4 3 (6.98%) React
4 3 (6.98%) TensorFlow
4 3 (6.98%) XML
5 2 (4.65%) Caffe
5 2 (4.65%) Theano
6 1 (2.33%) GraphX
6 1 (2.33%) PySpark
6 1 (2.33%) scikit-learn
Miscellaneous
1 19 (44.19%) Algorithms
2 13 (30.23%) Greenfield Project
3 12 (27.91%) HoloLens
4 7 (16.28%) Wiki
5 5 (11.63%) Analytical Skills
6 3 (6.98%) Computer Science
6 3 (6.98%) Fintech
Operating Systems
1 10 (23.26%) Unix
2 7 (16.28%) Windows
Processes & Methodologies
1 20 (46.51%) Data Science
2 17 (39.53%) Analytics
2 17 (39.53%) DevOps
3 16 (37.21%) Agile Software Development
4 14 (32.56%) Deep Learning
4 14 (32.56%) ETL
5 13 (30.23%) Microservices
6 12 (27.91%) Convolutional Neural Network
6 12 (27.91%) Open Source
7 11 (25.58%) Technical Architecture
8 10 (23.26%) Continuous Integration
8 10 (23.26%) Data Analysis
8 10 (23.26%) Visualisation
9 9 (20.93%) Scrum
10 8 (18.60%) Computer Vision
10 8 (18.60%) Data Engineering
10 8 (18.60%) Test Automation
11 7 (16.28%) Build Automation
11 7 (16.28%) Data Extraction
12 6 (13.95%) Machine Learning
Programming Languages
1 43 (100.00%) Python
2 29 (67.44%) SQL
3 18 (41.86%) Java
4 17 (39.53%) Scala
5 10 (23.26%) Bash Shell
6 8 (18.60%) MATLAB
7 7 (16.28%) Korn
7 7 (16.28%) PowerShell
7 7 (16.28%) R
7 7 (16.28%) Shell Script
8 4 (9.30%) JavaScript
8 4 (9.30%) Perl
9 1 (2.33%) C#
9 1 (2.33%) Ruby
Qualifications
1 3 (6.98%) Degree
2 2 (4.65%) Master's Degree
2 2 (4.65%) PhD
3 1 (2.33%) Computer Science Degree
Quality Assurance & Compliance
1 1 (2.33%) GDPR
1 1 (2.33%) QA
System Software
1 13 (30.23%) Docker
2 10 (23.26%) HDFS
3 1 (2.33%) Apache Flume
Systems Management
1 23 (53.49%) Ansible
2 13 (30.23%) Kubernetes
2 13 (30.23%) Terraform
3 11 (25.58%) Hadoop YARN
4 7 (16.28%) Opscode Chef
4 7 (16.28%) Puppet
5 1 (2.33%) Oozie
Vendors
1 11 (25.58%) Oracle
2 8 (18.60%) Cloudera
3 5 (11.63%) Alteryx
4 4 (9.30%) Databricks
4 4 (9.30%) Hortonworks
4 4 (9.30%) Microsoft
4 4 (9.30%) Tableau
5 3 (6.98%) Atlassian
6 2 (4.65%) Google
6 2 (4.65%) SAP
7 1 (2.33%) Informatica
7 1 (2.33%) Talend