Period
to 20 January 2020

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 20 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
Tower Hamlets > Canary Wharf
6 months to
20 Jan 2020
Same period 2019 Same period 2018
Rank 32 64 48
Rank change year-on-year +32 -16 -11
Contract jobs citing HDFS 3 5 1
As % of all contract IT jobs advertised in Canary Wharf 1.62% 1.30% 0.33%
As % of the System Software category 6.12% 5.43% 3.13%
Number of daily rates quoted 2 3 1
Canary Wharf median daily rate £507 £450 £550
Median daily rate % change year-on-year +12.67% -18.18% -
Tower Hamlets median daily rate £507 £450 £550
% change year-on-year +12.67% -18.18% -
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for system software skills.

All System Software Skills
Canary Wharf
Contract vacancies with a requirement for system software skills 49 92 32
As % of all contract IT jobs advertised in Canary Wharf 26.49% 23.90% 10.67%
Number of daily rates quoted 37 84 28
Canary Wharf median daily rate £550 £600 £475
Median daily rate % change year-on-year -8.33% +26.32% +11.76%
Tower Hamlets median daily rate £550 £600 £475
% change year-on-year -8.33% +26.32% +11.76%
Number of hourly rates quoted 0 1 0
Canary Wharf median hourly rate - £147.50 -
Tower Hamlets median hourly rate - £147.50 -

HDFS
Job Vacancy Trend in Canary Wharf

Job postings citing HDFS as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for HDFS in Canary Wharf

HDFS
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in Canary Wharf.

Contractor daily rate trend for HDFS in Canary Wharf

For the 6 months to 20 January 2020, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for HDFS.

1 3 (100.00%) Python
1 3 (100.00%) Agile Software Development
1 3 (100.00%) R
1 3 (100.00%) Kafka
1 3 (100.00%) DevOps
2 2 (66.67%) Impala
2 2 (66.67%) Apache Spark
2 2 (66.67%) Hadoop YARN
2 2 (66.67%) Amazon Kinesis
2 2 (66.67%) Palantir
2 2 (66.67%) Sqoop
2 2 (66.67%) Amazon EMR
2 2 (66.67%) Spark SQL
2 2 (66.67%) SDLC
2 2 (66.67%) Jupyter
2 2 (66.67%) Data Engineering
2 2 (66.67%) Big Data
2 2 (66.67%) Hortonworks
2 2 (66.67%) Cloudera
2 2 (66.67%) Power BI
2 2 (66.67%) Acceptance Criteria
2 2 (66.67%) Sprint Planning
2 2 (66.67%) Power Platform
2 2 (66.67%) Scrum
2 2 (66.67%) Data Visualisation
2 2 (66.67%) Tableau
2 2 (66.67%) AWS
2 2 (66.67%) Foundry
2 2 (66.67%) Apache Hive
2 2 (66.67%) Use Case

HDFS
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 2 (66.67%) Apache Spark
1 2 (66.67%) Jupyter
Applications
1 1 (33.33%) Microsoft Excel
Cloud Services
1 2 (66.67%) Amazon EMR
1 2 (66.67%) Amazon Kinesis
1 2 (66.67%) AWS
1 2 (66.67%) Power Platform
2 1 (33.33%) AWS Lambda
2 1 (33.33%) Azure
2 1 (33.33%) Serverless
Database & Business Intelligence
1 2 (66.67%) Apache Hive
1 2 (66.67%) Big Data
1 2 (66.67%) Hadoop
1 2 (66.67%) Impala
1 2 (66.67%) Power BI
1 2 (66.67%) Spark SQL
1 2 (66.67%) SQL Server
1 2 (66.67%) Sqoop
2 1 (33.33%) Data Lake
2 1 (33.33%) NoSQL
Development Applications
1 1 (33.33%) Jasmine
Job Titles
1 2 (66.67%) Big Data Engineer
1 2 (66.67%) Data Engineer
2 1 (33.33%) Python Engineer
2 1 (33.33%) Software Engineer
Libraries, Frameworks & Software Standards
1 3 (100.00%) Kafka
2 1 (33.33%) React
Operating Systems
1 1 (33.33%) Unix
Processes & Methodologies
1 3 (100.00%) Agile Software Development
1 3 (100.00%) DevOps
2 2 (66.67%) Acceptance Criteria
2 2 (66.67%) Continuous Integration
2 2 (66.67%) Data Analysis
2 2 (66.67%) Data Engineering
2 2 (66.67%) Data Visualisation
2 2 (66.67%) Performance Testing
2 2 (66.67%) Scrum
2 2 (66.67%) SDLC
2 2 (66.67%) Sprint Planning
2 2 (66.67%) Use Case
2 2 (66.67%) Visualisation
3 1 (33.33%) Artificial Intelligence
3 1 (33.33%) Data Architecture
3 1 (33.33%) Data Migration
3 1 (33.33%) Data Modelling
3 1 (33.33%) ETL
3 1 (33.33%) Migration
3 1 (33.33%) Software Engineering
Programming Languages
1 3 (100.00%) Python
1 3 (100.00%) R
2 2 (66.67%) Scala
2 2 (66.67%) SQL
3 1 (33.33%) C#
3 1 (33.33%) Java
3 1 (33.33%) JavaScript
Systems Management
1 2 (66.67%) Hadoop YARN
2 1 (33.33%) Grafana
2 1 (33.33%) Kubernetes
Vendors
1 2 (66.67%) Cloudera
1 2 (66.67%) Foundry
1 2 (66.67%) Hortonworks
1 2 (66.67%) Microsoft
1 2 (66.67%) Oracle
1 2 (66.67%) Palantir
1 2 (66.67%) Tableau
2 1 (33.33%) Splunk