Period
to 14 August 2018

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 14 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Tower Hamlets > Canary Wharf
6 months to
14 Aug 2018
Same period 2017 Same period 2016
Rank 14 32 33
Rank change year-on-year +18 +1 +6
Contract jobs citing Hadoop 47 10 7
As % of all contract IT jobs advertised in Canary Wharf 13.13% 3.94% 2.68%
As % of the Database & Business Intelligence category 29.94% 14.49% 10.61%
Number of daily rates quoted 20 5 5
Canary Wharf median daily rate £550 £500 £650
Median daily rate % change year-on-year +10.00% -23.08% +30.00%
10th Percentile £500 £463 £340
90th Percentile £552 £545 £675
Tower Hamlets median daily rate £550 £525 £638
% change year-on-year +4.76% -17.65% +27.50%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Canary Wharf
Contract vacancies with a requirement for database or business intelligence skills 157 69 66
As % of all contract IT jobs advertised in Canary Wharf 43.85% 27.17% 25.29%
Number of daily rates quoted 90 51 54
Canary Wharf median daily rate £500 £575 £448
Median daily rate % change year-on-year -13.04% +28.49% -5.79%
10th Percentile £400 £450 £314
90th Percentile £589 £750 £668
Tower Hamlets median daily rate £500 £575 £470
% change year-on-year -13.04% +22.34% -8.29%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop
Job Vacancy Trend in Canary Wharf

Job postings citing Hadoop as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Canary Wharf.

Contractor daily rate trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Hadoop in Canary Wharf over the 6 months to 14 August 2018.

Contractor daily rate histogram for Hadoop in Canary Wharf

For the 6 months to 14 August 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Hadoop.

1 47 (100.00%) Python
2 46 (97.87%) SQL
3 40 (85.11%) Finance
3 40 (85.11%) Apache Spark
4 38 (80.85%) Big Data
5 35 (74.47%) Data Science
6 34 (72.34%) Algorithms
7 33 (70.21%) Analytics
8 30 (63.83%) SQL Server
9 28 (59.57%) Scala
10 26 (55.32%) NoSQL
11 25 (53.19%) Relational Database
12 24 (51.06%) Amazon AWS
12 24 (51.06%) Git (software)
13 22 (46.81%) ETL
14 20 (42.55%) Deep Learning
14 20 (42.55%) Open Source
15 19 (40.43%) Visual Studio Team System
15 19 (40.43%) Technical Architecture
15 19 (40.43%) RDBMS
16 18 (38.30%) OpenCV
16 18 (38.30%) Unity (Game Engine)
16 18 (38.30%) Convolutional Neural Network
16 18 (38.30%) HoloLens
17 17 (36.17%) Visualisation
18 16 (34.04%) Agile Software Development
19 15 (31.91%) Oracle
19 15 (31.91%) R
19 15 (31.91%) Apache Hive
20 14 (29.79%) Scrum

Hadoop
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 40 (85.11%) Apache Spark
2 9 (19.15%) SAS
3 8 (17.02%) SharePoint
4 7 (14.89%) Apache Solr
5 5 (10.64%) Confluence
5 5 (10.64%) Elasticsearch
6 3 (6.38%) Apache Pig
7 1 (2.13%) Apache
Applications
1 6 (12.77%) Chatbot
1 6 (12.77%) Microsoft Excel
1 6 (12.77%) MS Visio
Business Applications
1 5 (10.64%) SAP Oil and Gas
Cloud Services
1 24 (51.06%) Amazon AWS
2 12 (25.53%) Amazon S3
2 12 (25.53%) Microsoft Azure
3 7 (14.89%) Amazon EC2
4 6 (12.77%) Virtual Private Cloud
5 1 (2.13%) Amazon EMR
5 1 (2.13%) Azure Data Factory
5 1 (2.13%) Google Cloud Platform
Communications & Networking
1 5 (10.64%) Kerberos
1 5 (10.64%) SSL
1 5 (10.64%) VPN
Database & Business Intelligence
1 38 (80.85%) Big Data
2 30 (63.83%) SQL Server
3 26 (55.32%) NoSQL
4 25 (53.19%) Relational Database
5 19 (40.43%) RDBMS
6 15 (31.91%) Apache Hive
7 14 (29.79%) Power BI
8 12 (25.53%) HBase
9 10 (21.28%) Data Lake
9 10 (21.28%) Spotfire
10 8 (17.02%) Data Warehouse
10 8 (17.02%) Impala
11 7 (14.89%) Apache Cassandra
11 7 (14.89%) Data Mining
11 7 (14.89%) MongoDB
12 6 (12.77%) HDInsight
12 6 (12.77%) Neo4j
12 6 (12.77%) Parquet
12 6 (12.77%) Sqoop
12 6 (12.77%) Text Mining
Development Applications
1 24 (51.06%) Git (software)
2 19 (40.43%) Visual Studio Team System
3 7 (14.89%) Jenkins
4 5 (10.64%) FishEye
4 5 (10.64%) JIRA
5 1 (2.13%) GitLab
5 1 (2.13%) Subversion
5 1 (2.13%) Visual Studio
General
1 40 (85.11%) Finance
2 6 (12.77%) Games
3 1 (2.13%) Marketing
3 1 (2.13%) Retail
Job Titles
1 21 (44.68%) Data Engineer
2 18 (38.30%) Big Data Engineer
3 6 (12.77%) Big Data Developer
3 6 (12.77%) Data Scientist
3 6 (12.77%) Developer
3 6 (12.77%) Hadoop Developer
3 6 (12.77%) Platform Engineer
4 3 (6.38%) Analytics Consultant
4 3 (6.38%) Consultant
5 2 (4.26%) Azure Consultant
5 2 (4.26%) Data Analytics Engineer
5 2 (4.26%) Hadoop Consultant
5 2 (4.26%) Hadoop Specialist
5 2 (4.26%) Report Specialist
5 2 (4.26%) SAP Consultant
5 2 (4.26%) SAP HANA Consultant
5 2 (4.26%) SAP HANA Specialist
6 1 (2.13%) Graduate
6 1 (2.13%) Junior
6 1 (2.13%) SAP CO Specialist
Libraries, Frameworks & Software Standards
1 18 (38.30%) OpenCV
1 18 (38.30%) Unity (Game Engine)
2 12 (25.53%) Natural Language Processing
3 8 (17.02%) Kafka
4 6 (12.77%) GraphX
4 6 (12.77%) Play Framework
4 6 (12.77%) XML
5 5 (10.64%) HTML
5 5 (10.64%) HTML5
5 5 (10.64%) React
6 4 (8.51%) TensorFlow
7 3 (6.38%) Keras
7 3 (6.38%) Theano
8 2 (4.26%) Lucene
9 1 (2.13%) Hibernate
9 1 (2.13%) JMS
9 1 (2.13%) JSON
9 1 (2.13%) RESTful
9 1 (2.13%) Spring
9 1 (2.13%) Velocity
Miscellaneous
1 34 (72.34%) Algorithms
2 18 (38.30%) HoloLens
3 13 (27.66%) Analytical Skills
4 6 (12.77%) Fintech
4 6 (12.77%) Wiki
5 4 (8.51%) Computer Science
6 1 (2.13%) Clustering
6 1 (2.13%) Management Information System
6 1 (2.13%) Replication
Operating Systems
1 12 (25.53%) Unix
2 6 (12.77%) Windows
3 1 (2.13%) CentOS
3 1 (2.13%) Linux
3 1 (2.13%) Red Hat Enterprise Linux
Processes & Methodologies
1 35 (74.47%) Data Science
2 33 (70.21%) Analytics
3 22 (46.81%) ETL
4 20 (42.55%) Deep Learning
4 20 (42.55%) Open Source
5 19 (40.43%) Technical Architecture
6 18 (38.30%) Convolutional Neural Network
7 17 (36.17%) Visualisation
8 16 (34.04%) Agile Software Development
9 14 (29.79%) Computer Vision
9 14 (29.79%) Scrum
10 12 (25.53%) Continuous Integration
10 12 (25.53%) Data Analysis
11 11 (23.40%) Business Intelligence
12 10 (21.28%) Machine Learning
13 9 (19.15%) Mathematics
13 9 (19.15%) Problem-Solving
14 8 (17.02%) Data Engineering
15 7 (14.89%) Data Visualisation
15 7 (14.89%) DevOps
Programming Languages
1 47 (100.00%) Python
2 46 (97.87%) SQL
3 28 (59.57%) Scala
4 15 (31.91%) R
5 13 (27.66%) MATLAB
6 12 (25.53%) Bash Shell
7 11 (23.40%) JavaScript
8 7 (14.89%) Java
8 7 (14.89%) Perl
9 6 (12.77%) Korn
9 6 (12.77%) PowerShell
9 6 (12.77%) Shell Script
10 1 (2.13%) C
10 1 (2.13%) C#
10 1 (2.13%) Ruby
Qualifications
1 4 (8.51%) Degree
2 3 (6.38%) Master's Degree
3 2 (4.26%) PhD
4 1 (2.13%) Computer Science Degree
Quality Assurance & Compliance
1 2 (4.26%) GDPR
2 1 (2.13%) GCP
System Software
1 12 (25.53%) HDFS
2 2 (4.26%) Apache Flume
3 1 (2.13%) Apache ZooKeeper
3 1 (2.13%) Docker
Systems Management
1 12 (25.53%) Hadoop YARN
2 11 (23.40%) Ansible
3 6 (12.77%) Opscode Chef
3 6 (12.77%) Puppet
4 1 (2.13%) Oozie
Vendors
1 15 (31.91%) Oracle
2 8 (17.02%) Microsoft
3 7 (14.89%) Cloudera
3 7 (14.89%) Tableau
4 6 (12.77%) Alteryx
5 5 (10.64%) Atlassian
5 5 (10.64%) Hortonworks
5 5 (10.64%) SAP
6 4 (8.51%) Databricks
7 3 (6.38%) Talend
8 2 (4.26%) Google
9 1 (2.13%) Informatica
9 1 (2.13%) Salesforce.com