Period
to 18 April 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 18 April 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
Central London > City of London
6 months to
18 Apr 2019
Same period 2018 Same period 2017
Rank 219 206 195
Rank change year-on-year -13 -11 +22
Contract jobs citing HDFS 25 50 32
As % of all contract IT jobs advertised in the City of London 0.37% 0.71% 0.52%
As % of the System Software category 2.02% 5.10% 5.01%
Number of daily rates quoted 22 42 24
City of London median daily rate £650 £625 £580
Median daily rate % change year-on-year +4.00% +7.76% +36.47%
10th Percentile £563 £476 £503
90th Percentile £686 £698 £675
Central London median daily rate £650 £625 £580
% change year-on-year +4.00% +7.76% +45.00%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for system software skills.

All System Software Skills
City of London
Contract vacancies with a requirement for system software skills 1,236 981 639
As % of all contract IT jobs advertised in the City of London 18.28% 13.98% 10.36%
Number of daily rates quoted 932 770 510
City of London median daily rate £500 £500 £460
Median daily rate % change year-on-year - +8.70% +7.67%
10th Percentile £180 £230 £199
90th Percentile £675 £644 £625
Central London median daily rate £525 £500 £450
% change year-on-year +5.00% +11.11% +5.63%
Number of hourly rates quoted 16 37 14
City of London median hourly rate £17.15 £17.50 £21.75
Median hourly rate % change year-on-year -2.00% -19.54% +38.10%
10th Percentile £12.51 £10.95 £13.13
90th Percentile £22.38 £23.45 £55.00
Central London median hourly rate £18.75 £17.50 £21.75
% change year-on-year +7.14% -19.54% +46.22%

HDFS
Job Vacancy Trend in the City of London

Job postings citing HDFS as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for HDFS in the City of London

HDFS
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in the City of London.

Contractor daily rate trend for HDFS in the City of London

For the 6 months to 18 April 2019, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for HDFS.

1 24 (96.00%) Hadoop
2 18 (72.00%) Apache Spark
3 15 (60.00%) Linux
4 14 (56.00%) Apache Hive
4 14 (56.00%) HBase
5 13 (52.00%) Java
5 13 (52.00%) Impala
6 11 (44.00%) Agile Software Development
6 11 (44.00%) Hadoop YARN
7 10 (40.00%) BDD
7 10 (40.00%) TDD
7 10 (40.00%) Data Modelling
8 9 (36.00%) Oracle
8 9 (36.00%) Big Data
9 8 (32.00%) Relational Database
9 8 (32.00%) DevOps
9 8 (32.00%) SDLC
9 8 (32.00%) Apache Kudu
9 8 (32.00%) Kafka
9 8 (32.00%) SQL Server
9 8 (32.00%) Python
10 7 (28.00%) JUnit
10 7 (28.00%) UML
10 7 (28.00%) OO
10 7 (28.00%) Apache
10 7 (28.00%) Sybase
10 7 (28.00%) Unix
10 7 (28.00%) Business Intelligence
10 7 (28.00%) Front Office
10 7 (28.00%) Subversion

HDFS
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 18 (72.00%) Apache Spark
2 7 (28.00%) Apache
2 7 (28.00%) Confluence
3 4 (16.00%) Apache Solr
4 3 (12.00%) Apache Pig
5 2 (8.00%) Elasticsearch
5 2 (8.00%) Jupyter
Business Applications
1 1 (4.00%) Eloqua
Cloud Services
1 6 (24.00%) Google Cloud Platform
2 4 (16.00%) Amazon AWS
3 3 (12.00%) Amazon S3
4 2 (8.00%) Amazon EC2
4 2 (8.00%) Amazon EMR
5 1 (4.00%) Amazon Kinesis
5 1 (4.00%) AWS Lambda
5 1 (4.00%) Cloud Computing
5 1 (4.00%) Microsoft Azure
5 1 (4.00%) Serverless
Communications & Networking
1 5 (20.00%) Kerberos
Database & Business Intelligence
1 24 (96.00%) Hadoop
2 14 (56.00%) Apache Hive
2 14 (56.00%) HBase
3 13 (52.00%) Impala
4 9 (36.00%) Big Data
5 8 (32.00%) Apache Kudu
5 8 (32.00%) Relational Database
5 8 (32.00%) SQL Server
6 4 (16.00%) NoSQL
7 3 (12.00%) Apache Cassandra
7 3 (12.00%) MongoDB
8 2 (8.00%) Amazon Redshift
8 2 (8.00%) Data Lake
8 2 (8.00%) Data Warehouse
8 2 (8.00%) MySQL
9 1 (4.00%) Amazon Athena
9 1 (4.00%) Data Mining
9 1 (4.00%) OLTP
9 1 (4.00%) PostgreSQL
9 1 (4.00%) RDBMS
Development Applications
1 7 (28.00%) Atlassian Bamboo
1 7 (28.00%) Cucumber
1 7 (28.00%) FishEye
1 7 (28.00%) Git (software)
1 7 (28.00%) JIRA
1 7 (28.00%) jMock
1 7 (28.00%) JUnit
1 7 (28.00%) Maven
1 7 (28.00%) Subversion
2 1 (4.00%) ER Studio
General
1 7 (28.00%) Front Office
2 5 (20.00%) Banking
2 5 (20.00%) Finance
3 1 (4.00%) Marketing
3 1 (4.00%) Retail
Job Titles
1 9 (36.00%) Administrator
1 9 (36.00%) Hadoop Administrator
2 7 (28.00%) Apache Spark Developer
2 7 (28.00%) Developer
2 7 (28.00%) Java Developer
3 6 (24.00%) Data Engineer
4 3 (12.00%) Cloud Engineer
5 2 (8.00%) Big Data Engineer
6 1 (4.00%) Analyst
6 1 (4.00%) Architect
6 1 (4.00%) Big Data Architect
6 1 (4.00%) Data Analyst
6 1 (4.00%) Data Architect
6 1 (4.00%) Data Modeller
6 1 (4.00%) DBA
6 1 (4.00%) Digital Analyst
6 1 (4.00%) Digital Marketing Analyst
6 1 (4.00%) Marketing Analyst
6 1 (4.00%) Marketing Data Analyst
Libraries, Frameworks & Software Standards
1 8 (32.00%) Kafka
2 5 (20.00%) LDAP
3 3 (12.00%) Spark Streaming
4 2 (8.00%) Anaconda
4 2 (8.00%) Apache Tez
4 2 (8.00%) PySpark
4 2 (8.00%) Regular Expression
5 1 (4.00%) JSON
5 1 (4.00%) LAMP
5 1 (4.00%) XML
Miscellaneous
1 1 (4.00%) Data Structures
Operating Systems
1 15 (60.00%) Linux
2 7 (28.00%) Unix
3 2 (8.00%) Red Hat Enterprise Linux
Processes & Methodologies
1 11 (44.00%) Agile Software Development
2 10 (40.00%) BDD
2 10 (40.00%) Data Modelling
2 10 (40.00%) TDD
3 8 (32.00%) DevOps
3 8 (32.00%) SDLC
4 7 (28.00%) Business Intelligence
4 7 (28.00%) Change Control
4 7 (28.00%) Dimensional Modelling
4 7 (28.00%) Domain Models
4 7 (28.00%) Logical Data Model
4 7 (28.00%) OO
4 7 (28.00%) Physical Data Model
4 7 (28.00%) UML
4 7 (28.00%) Visualisation
5 3 (12.00%) Dashboard Development
5 3 (12.00%) Data Science
6 2 (8.00%) Kanban
6 2 (8.00%) MapReduce
6 2 (8.00%) Scrum
Programming Languages
1 13 (52.00%) Java
2 8 (32.00%) Python
3 7 (28.00%) Java 8
4 5 (20.00%) Scala
5 3 (12.00%) Shell Script
6 2 (8.00%) SQL
7 1 (4.00%) JavaScript
7 1 (4.00%) Pig Latin
7 1 (4.00%) Ruby
Quality Assurance & Compliance
1 1 (4.00%) GDPR
System Software
1 2 (8.00%) Apache Flume
Systems Management
1 11 (44.00%) Hadoop YARN
2 5 (20.00%) Tivoli
3 3 (12.00%) Ambari
3 3 (12.00%) Grafana
Vendors
1 9 (36.00%) Oracle
2 7 (28.00%) Atlassian
2 7 (28.00%) Google
2 7 (28.00%) Sybase
3 6 (24.00%) Hortonworks
4 2 (8.00%) Datameer
4 2 (8.00%) Teradata
5 1 (4.00%) Adobe
5 1 (4.00%) Cloudera
5 1 (4.00%) DoubleClick
5 1 (4.00%) Informatica
5 1 (4.00%) Marketo
5 1 (4.00%) SAP
5 1 (4.00%) Talend