Period
to 29 March 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 29 March 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
Central London > City of London
6 months to
29 Mar 2020
Same period 2019 Same period 2018
Rank 173 218 201
Rank change year-on-year +45 -17 -3
Contract jobs citing HDFS 10 27 58
As % of all contract jobs advertised in the City of London 0.23% 0.40% 0.82%
As % of the System Software category 1.71% 2.15% 5.95%
Number of daily rates quoted 10 25 50
Median daily rate £638 £650 £650
Median daily rate % change year-on-year -1.92% - +12.07%
10th Percentile £501 £563 £503
90th Percentile £700 £688 £703
Central London median daily rate £600 £650 £650
% change year-on-year -7.69% - +12.07%
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
Central London median hourly rate - - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for system software skills.

All System Software Skills
City of London
Contract vacancies with a requirement for system software skills 584 1,256 974
As % of all contract IT jobs advertised in the City of London 13.58% 18.45% 13.74%
Number of daily rates quoted 457 944 768
Median daily rate £515 £500 £500
Median daily rate % change year-on-year +3.00% - +8.11%
10th Percentile £200 £163 £247
90th Percentile £650 £650 £650
Central London median daily rate £500 £525 £500
% change year-on-year -4.76% +5.00% +11.11%
Number of hourly rates quoted 19 18 36
Median hourly rate £18.70 £16.30 £17.25
Median hourly rate % change year-on-year +14.72% -5.51% -18.82%
10th Percentile £12.42 £12.61 £10.88
90th Percentile £35.00 £23.58 £24.38
Median hourly rate £18.70 £18.70 £17.25
% change year-on-year - +8.41% -19.77%

HDFS
Job Vacancy Trend in the City of London

Job postings citing HDFS as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for HDFS in the City of London

HDFS
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing HDFS in the City of London.

Daily rate trend for HDFS in the City of London

HDFS
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing HDFS in the City of London over the 6 months to 29 March 2020.

Daily rate histogram for HDFS in the City of London

For the 6 months to 29 March 2020, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for HDFS.

1 10 (100.00%) Python
1 10 (100.00%) Hadoop
1 10 (100.00%) Apache Spark
2 8 (80.00%) HBase
3 7 (70.00%) Hadoop YARN
3 7 (70.00%) TDD
4 6 (60.00%) Java
4 6 (60.00%) Kafka
4 6 (60.00%) Jenkins
4 6 (60.00%) DevOps
5 5 (50.00%) GCP
5 5 (50.00%) SQL
5 5 (50.00%) Google
5 5 (50.00%) Scala
5 5 (50.00%) PySpark
6 4 (40.00%) Performance Optimisation
6 4 (40.00%) Linux Command Line
6 4 (40.00%) Apache Hive
6 4 (40.00%) Retail Banking
6 4 (40.00%) Spring
6 4 (40.00%) JIRA
6 4 (40.00%) Computer Science
6 4 (40.00%) Performance Testing
6 4 (40.00%) Unix
6 4 (40.00%) OOP
6 4 (40.00%) Finance
6 4 (40.00%) Agile Software Development
6 4 (40.00%) Functional Programming
6 4 (40.00%) Travis CI
6 4 (40.00%) Performance Tuning

HDFS
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (100.00%) Apache Spark
2 1 (10.00%) Apache Airflow
2 1 (10.00%) Apache Pig
2 1 (10.00%) Oracle Workflow
Cloud Services
1 5 (50.00%) GCP
2 3 (30.00%) Amazon Kinesis
2 3 (30.00%) AWS
3 2 (20.00%) Amazon CloudWatch
3 2 (20.00%) Serverless
Communications & Networking
1 2 (20.00%) TCP/IP
Database & Business Intelligence
1 10 (100.00%) Hadoop
2 8 (80.00%) HBase
3 4 (40.00%) Apache Hive
4 3 (30.00%) Big Data
4 3 (30.00%) Impala
4 3 (30.00%) NoSQL
5 1 (10.00%) Amazon Aurora
5 1 (10.00%) Amazon RDS
5 1 (10.00%) Apache Cassandra
5 1 (10.00%) Data Warehouse
5 1 (10.00%) MongoDB
5 1 (10.00%) Presto
5 1 (10.00%) Relational Database
Development Applications
1 6 (60.00%) Jenkins
2 4 (40.00%) JIRA
2 4 (40.00%) Travis CI
3 2 (20.00%) Atlassian Bamboo
3 2 (20.00%) TeamCity
General
1 4 (40.00%) Finance
1 4 (40.00%) Retail Banking
Job Titles
1 4 (40.00%) Data Engineer
1 4 (40.00%) Developer
1 4 (40.00%) Hadoop Developer
1 4 (40.00%) Java Developer
1 4 (40.00%) Java Hadoop Developer
2 2 (20.00%) AWS DevOps
2 2 (20.00%) AWS DevOps Engineer
2 2 (20.00%) AWS Engineer
2 2 (20.00%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 6 (60.00%) Kafka
2 5 (50.00%) PySpark
3 4 (40.00%) Spring
4 3 (30.00%) Spark Streaming
5 2 (20.00%) Elastic Stack
5 2 (20.00%) RESTful
6 1 (10.00%) Apache NiFi
Miscellaneous
1 4 (40.00%) Linux Command Line
Operating Systems
1 4 (40.00%) Unix
2 2 (20.00%) Linux
Processes & Methodologies
1 7 (70.00%) TDD
2 6 (60.00%) DevOps
3 4 (40.00%) Agile Software Development
3 4 (40.00%) Computer Science
3 4 (40.00%) Functional Programming
3 4 (40.00%) OOP
3 4 (40.00%) Performance Optimisation
3 4 (40.00%) Performance Testing
3 4 (40.00%) Performance Tuning
4 3 (30.00%) BDD
5 2 (20.00%) Configuration Management
5 2 (20.00%) Log Aggregation
5 2 (20.00%) Market Research
5 2 (20.00%) Microservices
5 2 (20.00%) Technical Architecture
6 1 (10.00%) Business Intelligence
6 1 (10.00%) ETL
6 1 (10.00%) MapReduce
6 1 (10.00%) Migration
6 1 (10.00%) Workflow
Programming Languages
1 10 (100.00%) Python
2 6 (60.00%) Java
3 5 (50.00%) Scala
3 5 (50.00%) SQL
4 4 (40.00%) R
5 2 (20.00%) Go
5 2 (20.00%) Ruby
System Software
1 3 (30.00%) Apache Flume
2 2 (20.00%) Docker
Systems Management
1 7 (70.00%) Hadoop YARN
2 2 (20.00%) Ansible
2 2 (20.00%) Kubernetes
2 2 (20.00%) Puppet
2 2 (20.00%) Terraform
Vendors
1 5 (50.00%) Google
2 2 (20.00%) New Relic
2 2 (20.00%) Splunk
3 1 (10.00%) Oracle