Period
to 22 October 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 22 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
Central London > City of London
6 months to
22 Oct 2018
Same period 2017 Same period 2016
Rank 220 178 219
Rank change year-on-year -42 +41 +43
Contract jobs citing HDFS 38 69 29
As % of all contract IT jobs advertised in the City of London 0.54% 1.01% 0.44%
As % of the System Software category 3.10% 8.94% 4.07%
Number of daily rates quoted 35 63 19
City of London median daily rate £550 £625 £650
Median daily rate % change year-on-year -12.08% -3.85% +36.13%
10th Percentile £513 £525 £428
90th Percentile £650 £725 £765
Central London median daily rate £537 £625 £650
% change year-on-year -14.04% -3.85% +30.00%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for system software skills.

All System Software Skills
City of London
Contract vacancies with a requirement for system software skills 1,225 772 713
As % of all contract IT jobs advertised in the City of London 17.50% 11.26% 10.76%
Number of daily rates quoted 985 624 567
City of London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +9.09%
10th Percentile £166 £200 £238
90th Percentile £650 £638 £638
Central London median daily rate £500 £475 £450
% change year-on-year +5.26% +5.56% +9.09%
Number of hourly rates quoted 38 23 23
City of London median hourly rate £19.25 £17.00 £19.00
Median hourly rate % change year-on-year +13.24% -10.53% -3.18%
10th Percentile £13.31 £12.96 £11.25
90th Percentile £25.50 £29.20 £28.75
Central London median hourly rate £19.25 £18.69 £19.00
% change year-on-year +3.00% -1.63% +5.56%

HDFS
Job Vacancy Trend in the City of London

Job postings citing HDFS as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for HDFS in the City of London

HDFS
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in the City of London.

Contractor daily rate trend for HDFS in the City of London

HDFS
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing HDFS in the City of London over the 6 months to 22 October 2018.

Contractor daily rate histogram for HDFS in the City of London

HDFS
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the City of London region over the 6 months to 22 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 15 £525 -
HDFS
Central London

For the 6 months to 22 October 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for HDFS.

1 38 (100.00%) Hadoop
2 30 (78.95%) Apache Hive
3 28 (73.68%) Big Data
4 23 (60.53%) Apache Spark
5 20 (52.63%) Sqoop
5 20 (52.63%) SQL Server
5 20 (52.63%) Python
6 19 (50.00%) Amazon AWS
6 19 (50.00%) Hadoop YARN
6 19 (50.00%) Impala
7 18 (47.37%) Jenkins
7 18 (47.37%) Unix
7 18 (47.37%) ETL
7 18 (47.37%) Agile Software Development
8 17 (44.74%) Oracle
8 17 (44.74%) SQL
9 15 (39.47%) Continuous Integration
10 14 (36.84%) Ansible
10 14 (36.84%) Cloudera
10 14 (36.84%) Test Automation
11 13 (34.21%) Data Extraction
11 13 (34.21%) PowerShell
11 13 (34.21%) Amazon EC2
11 13 (34.21%) Amazon S3
11 13 (34.21%) Puppet
11 13 (34.21%) Bash Shell
11 13 (34.21%) Build Automation
11 13 (34.21%) Opscode Chef
11 13 (34.21%) Wiki
11 13 (34.21%) Korn

HDFS
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 23 (60.53%) Apache Spark
2 7 (18.42%) Apache Pig
3 4 (10.53%) Apache
3 4 (10.53%) Apache Solr
3 4 (10.53%) Confluence
4 1 (2.63%) Elasticsearch
Applications
1 13 (34.21%) Microsoft Excel
1 13 (34.21%) MS Visio
Cloud Services
1 19 (50.00%) Amazon AWS
2 13 (34.21%) Amazon EC2
2 13 (34.21%) Amazon S3
2 13 (34.21%) Virtual Private Cloud
3 5 (13.16%) Microsoft Azure
4 3 (7.89%) GitHub
4 3 (7.89%) IBM Cloud
5 1 (2.63%) Google Cloud Platform
Communications & Networking
1 3 (7.89%) Kerberos
1 3 (7.89%) SSL
Database & Business Intelligence
1 38 (100.00%) Hadoop
2 30 (78.95%) Apache Hive
3 28 (73.68%) Big Data
4 20 (52.63%) SQL Server
4 20 (52.63%) Sqoop
5 19 (50.00%) Impala
6 7 (18.42%) HBase
7 6 (15.79%) Relational Database
8 5 (13.16%) Apache Kudu
9 4 (10.53%) Apache Cassandra
9 4 (10.53%) PostgreSQL
10 3 (7.89%) Data Warehouse
10 3 (7.89%) MongoDB
10 3 (7.89%) SQL Server Integration Services
11 2 (5.26%) NoSQL
11 2 (5.26%) SQL Server 2008
11 2 (5.26%) SQL Server 2012
11 2 (5.26%) SQL Server 2014
12 1 (2.63%) Amazon Redshift
Development Applications
1 18 (47.37%) Jenkins
2 6 (15.79%) Git (software)
3 5 (13.16%) Cucumber
4 4 (10.53%) Atlassian Bamboo
4 4 (10.53%) FishEye
4 4 (10.53%) JIRA
4 4 (10.53%) jMock
4 4 (10.53%) JUnit
4 4 (10.53%) Maven
4 4 (10.53%) Subversion
5 1 (2.63%) Gerrit
5 1 (2.63%) JBehave
5 1 (2.63%) Selenium
General
1 4 (10.53%) Finance
1 4 (10.53%) Front Office
2 3 (7.89%) Banking
3 2 (5.26%) Marketing
4 1 (2.63%) Retail
Job Titles
1 13 (34.21%) Platform Engineer
2 10 (26.32%) Developer
3 8 (21.05%) Apache Spark Developer
3 8 (21.05%) Big Data Engineer
4 7 (18.42%) Data Engineer
5 5 (13.16%) Big Data Developer
5 5 (13.16%) Java Developer
6 4 (10.53%) AWS Developer
6 4 (10.53%) Senior Big Data Developer
6 4 (10.53%) Senior Developer
7 3 (7.89%) Consultant
7 3 (7.89%) Principal Consultant
8 2 (5.26%) Administrator
8 2 (5.26%) Database Engineer
8 2 (5.26%) Hadoop Administrator
8 2 (5.26%) Hadoop Consultant
8 2 (5.26%) Scala Developer
8 2 (5.26%) Senior Database Engineer
9 1 (2.63%) Hadoop Developer
9 1 (2.63%) Senior Scala Developer
Libraries, Frameworks & Software Standards
1 10 (26.32%) Kafka
2 3 (7.89%) PySpark
3 1 (2.63%) CSS
3 1 (2.63%) CSS3
3 1 (2.63%) Dask
3 1 (2.63%) Gherkin
3 1 (2.63%) HTML
3 1 (2.63%) HTML5
3 1 (2.63%) RabbitMQ
Miscellaneous
1 13 (34.21%) Wiki
2 4 (10.53%) Greenfield Project
3 2 (5.26%) Private Cloud
4 1 (2.63%) Algorithms
Operating Systems
1 18 (47.37%) Unix
2 13 (34.21%) Windows
3 10 (26.32%) Linux
4 5 (13.16%) Red Hat Enterprise Linux
5 1 (2.63%) DC/OS
Processes & Methodologies
1 18 (47.37%) Agile Software Development
1 18 (47.37%) ETL
2 15 (39.47%) Continuous Integration
3 14 (36.84%) Test Automation
4 13 (34.21%) Build Automation
4 13 (34.21%) Data Analysis
4 13 (34.21%) Data Extraction
4 13 (34.21%) Scrum
5 8 (21.05%) Data Engineering
5 8 (21.05%) MapReduce
6 7 (18.42%) Data Modelling
7 6 (15.79%) SDLC
8 5 (13.16%) BDD
8 5 (13.16%) Business Intelligence
8 5 (13.16%) Capacity Management
8 5 (13.16%) DevOps
8 5 (13.16%) TDD
9 4 (10.53%) E-Commerce
9 4 (10.53%) OO
9 4 (10.53%) UML
Programming Languages
1 20 (52.63%) Python
2 17 (44.74%) SQL
3 13 (34.21%) Bash Shell
3 13 (34.21%) Java
3 13 (34.21%) Korn
3 13 (34.21%) PowerShell
3 13 (34.21%) Shell Script
4 7 (18.42%) Scala
5 5 (13.16%) Java 8
6 3 (7.89%) T-SQL
7 2 (5.26%) JavaScript
8 1 (2.63%) Groovy
8 1 (2.63%) Ruby
Quality Assurance & Compliance
1 1 (2.63%) Data Quality
System Software
1 6 (15.79%) Apache Flume
2 4 (10.53%) Apache ZooKeeper
3 3 (7.89%) Active Directory
Systems Management
1 19 (50.00%) Hadoop YARN
2 14 (36.84%) Ansible
3 13 (34.21%) Opscode Chef
3 13 (34.21%) Puppet
4 10 (26.32%) Oozie
5 6 (15.79%) Ambari
6 3 (7.89%) Apache Slider
7 1 (2.63%) Kubernetes
7 1 (2.63%) Mesos
Vendors
1 17 (44.74%) Oracle
2 14 (36.84%) Cloudera
3 4 (10.53%) Atlassian
3 4 (10.53%) Hortonworks
3 4 (10.53%) Sybase
4 3 (7.89%) IBM
4 3 (7.89%) Informatica
4 3 (7.89%) Tableau
5 2 (5.26%) Red Hat
6 1 (2.63%) Google