Period
to 18 November 2018

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 18 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
Tower Hamlets > Canary Wharf
6 months to
18 Nov 2018
Same period 2017 Same period 2016
Rank 49 44 37
Rank change year-on-year -5 -7 +10
Contract jobs citing HDFS 8 1 3
As % of all contract IT jobs advertised in Canary Wharf 2.53% 0.37% 0.95%
As % of the System Software category 11.43% 3.33% 6.67%
Number of daily rates quoted 4 1 2
Canary Wharf median daily rate £450 £550 £475
Median daily rate % change year-on-year -18.18% +15.79% -26.92%
10th Percentile £433 £550 £415
90th Percentile £485 £550 £535
Tower Hamlets median daily rate £450 £541 £475
% change year-on-year -16.86% +13.95% -26.92%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for system software skills.

All System Software Skills
Canary Wharf
Contract vacancies with a requirement for system software skills 70 30 45
As % of all contract IT jobs advertised in Canary Wharf 22.15% 10.99% 14.24%
Number of daily rates quoted 60 24 36
Canary Wharf median daily rate £575 £461 £375
Median daily rate % change year-on-year +24.86% +22.80% -11.14%
10th Percentile £344 £263 £160
90th Percentile £600 £699 £580
Tower Hamlets median daily rate £575 £471 £375
% change year-on-year +22.08% +25.60% -11.18%
Number of hourly rates quoted 1 0 1
Canary Wharf median hourly rate £147.50 - £11.00
10th Percentile £138.75 - £10.50
90th Percentile £156.25 - £11.50
Tower Hamlets median hourly rate £147.50 - £11.00

HDFS
Job Vacancy Trend in Canary Wharf

Job postings citing HDFS as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for HDFS in Canary Wharf

HDFS
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in Canary Wharf.

Contractor daily rate trend for HDFS in Canary Wharf

For the 6 months to 18 November 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for HDFS.

1 8 (100.00%) Big Data
2 6 (75.00%) Continuous Integration
2 6 (75.00%) Amazon AWS
2 6 (75.00%) SQL
2 6 (75.00%) Python
2 6 (75.00%) Data Analysis
3 5 (62.50%) Java
4 4 (50.00%) JavaScript
4 4 (50.00%) SQL Server
4 4 (50.00%) Microsoft Excel
4 4 (50.00%) ETL
4 4 (50.00%) Technical Architecture
4 4 (50.00%) Unix
4 4 (50.00%) Finance
4 4 (50.00%) Scrum
4 4 (50.00%) Agile Software Development
4 4 (50.00%) Amazon S3
4 4 (50.00%) Test Automation
4 4 (50.00%) Apache Solr
4 4 (50.00%) Scala
4 4 (50.00%) Hadoop
4 4 (50.00%) Data Extraction
4 4 (50.00%) Wiki
4 4 (50.00%) Git (software)
4 4 (50.00%) Bash Shell
4 4 (50.00%) NoSQL
4 4 (50.00%) Apache Hive
4 4 (50.00%) Kafka
4 4 (50.00%) Analytics
4 4 (50.00%) Sqoop

HDFS
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (50.00%) Apache Solr
1 4 (50.00%) Apache Spark
1 4 (50.00%) Elasticsearch
2 2 (25.00%) Confluence
Applications
1 4 (50.00%) Microsoft Excel
2 2 (25.00%) MS Visio
2 2 (25.00%) Spreadsheet
Cloud Services
1 6 (75.00%) Amazon AWS
2 4 (50.00%) Amazon S3
3 2 (25.00%) Amazon EC2
3 2 (25.00%) Microsoft Azure
3 2 (25.00%) Virtual Private Cloud
Communications & Networking
1 2 (25.00%) Kerberos
1 2 (25.00%) SSL
1 2 (25.00%) VPN
Database & Business Intelligence
1 8 (100.00%) Big Data
2 4 (50.00%) Apache Hive
2 4 (50.00%) Hadoop
2 4 (50.00%) NoSQL
2 4 (50.00%) Relational Database
2 4 (50.00%) SQL Server
2 4 (50.00%) Sqoop
3 2 (25.00%) Amazon Aurora
3 2 (25.00%) Amazon RDS
3 2 (25.00%) Amazon Redshift
3 2 (25.00%) Apache Cassandra
3 2 (25.00%) Data Lake
3 2 (25.00%) Data Mining
3 2 (25.00%) Data Warehouse
3 2 (25.00%) HBase
3 2 (25.00%) Impala
3 2 (25.00%) Parquet
3 2 (25.00%) Power BI
3 2 (25.00%) RDBMS
Development Applications
1 4 (50.00%) Git (software)
2 2 (25.00%) FishEye
2 2 (25.00%) Jenkins
2 2 (25.00%) JIRA
2 2 (25.00%) Visual Studio Team System
General
1 4 (50.00%) Finance
2 2 (25.00%) Back Office
2 2 (25.00%) Games
Job Titles
1 4 (50.00%) Developer
2 2 (25.00%) Analytics Consultant
2 2 (25.00%) Big Data Consultant
2 2 (25.00%) Big Data Developer
2 2 (25.00%) Consultant
2 2 (25.00%) Data Consultant
2 2 (25.00%) Excel Developer
2 2 (25.00%) Hadoop Developer
2 2 (25.00%) Platform Engineer
3 1 (12.50%) Big Data Engineer
Libraries, Frameworks & Software Standards
1 4 (50.00%) Kafka
2 2 (25.00%) HTML
2 2 (25.00%) HTML5
2 2 (25.00%) Natural Language Processing
2 2 (25.00%) OpenCV
2 2 (25.00%) Play Framework
2 2 (25.00%) React
2 2 (25.00%) REST
2 2 (25.00%) Spark Streaming
2 2 (25.00%) TensorFlow
2 2 (25.00%) XML
Miscellaneous
1 4 (50.00%) Algorithms
1 4 (50.00%) Wiki
2 2 (25.00%) Analytical Skills
2 2 (25.00%) Fintech
2 2 (25.00%) Self-Motivation
2 2 (25.00%) User Experience
Operating Systems
1 4 (50.00%) Unix
2 2 (25.00%) Windows
Processes & Methodologies
1 6 (75.00%) Continuous Integration
1 6 (75.00%) Data Analysis
2 4 (50.00%) Agile Software Development
2 4 (50.00%) Analytics
2 4 (50.00%) Data Extraction
2 4 (50.00%) Data Science
2 4 (50.00%) DevOps
2 4 (50.00%) ETL
2 4 (50.00%) Scrum
2 4 (50.00%) Technical Architecture
2 4 (50.00%) Test Automation
3 3 (37.50%) Deployment Automation
4 2 (25.00%) Computer Vision
4 2 (25.00%) Convolutional Neural Network
4 2 (25.00%) Data Engineering
4 2 (25.00%) Disruptive Innovation
4 2 (25.00%) ETL Development
4 2 (25.00%) Exploratory Data Analysis
4 2 (25.00%) Mathematical Modelling
4 2 (25.00%) Problem-Solving
Programming Languages
1 6 (75.00%) Python
1 6 (75.00%) SQL
2 5 (62.50%) Java
3 4 (50.00%) Bash Shell
3 4 (50.00%) JavaScript
3 4 (50.00%) Scala
4 2 (25.00%) C#
4 2 (25.00%) Korn
4 2 (25.00%) Perl
4 2 (25.00%) PowerShell
4 2 (25.00%) R
4 2 (25.00%) Shell Script
4 2 (25.00%) VBA
System Software
1 2 (25.00%) Docker
Systems Management
1 4 (50.00%) Ansible
1 4 (50.00%) Hadoop YARN
2 2 (25.00%) Kubernetes
2 2 (25.00%) Opscode Chef
2 2 (25.00%) Puppet
Vendors
1 2 (25.00%) Atlassian
1 2 (25.00%) Cloudera
1 2 (25.00%) Databricks
1 2 (25.00%) Hortonworks
1 2 (25.00%) MuleSoft
1 2 (25.00%) Oracle
1 2 (25.00%) Tableau