Period
to 20 May 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 20 May 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
20 May 2018
Same period 2017 Same period 2016
Rank 535 539 712
Rank change year-on-year +4 +173 -13
Contract jobs citing HDFS 340 268 139
As % of all contract IT jobs advertised in England 0.37% 0.32% 0.14%
As % of the System Software category 2.75% 2.82% 1.28%
Number of daily rates quoted 221 183 102
England median daily rate £575 £550 £525
Median daily rate % change year-on-year +4.55% +4.76% -8.70%
10th Percentile £463 £376 £375
90th Percentile £675 £675 £675
UK median daily rate £575 £535 £525
% change year-on-year +7.48% +1.90% -8.70%
Number of hourly rates quoted 0 1 0
England median hourly rate - £50.00 -
UK median hourly rate - £50.00 -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Contract vacancies with a requirement for system software skills 12,364 9,513 10,881
As % of all contract IT jobs advertised in England 13.42% 11.33% 11.20%
Number of daily rates quoted 8,049 6,079 6,734
England median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +10.34%
10th Percentile £185 £167 £173
90th Percentile £625 £588 £575
UK median daily rate £450 £423 £400
% change year-on-year +6.51% +5.63% +12.68%
Number of hourly rates quoted 704 593 860
England median hourly rate £16.22 £16.00 £15.50
Median hourly rate % change year-on-year +1.34% +3.23% -3.13%
10th Percentile £10.75 £10.15 £10.25
90th Percentile £46.25 £43.75 £41.05
UK median hourly rate £15.86 £16.00 £15.50
% change year-on-year -0.88% +3.23% -1.59%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in England.

Contractor daily rate trend for HDFS in England

HDFS
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing HDFS in England over the 6 months to 20 May 2018.

Contractor daily rate histogram for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 6 months to 20 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -26 208 £575 - 20
South East +40 111 £575 +43.57% 9
East Midlands +3 7 £600 +14.29%
Midlands -8 7 £600 +14.29%
South West -1 6 £488 +21.88% 1
North of England -15 4 £588 +43.29% 6
East of England -3 3 £450 +12.50% 4
North West -14 3 £575 +85.48% 4
Yorkshire -19 1 £600 +39.53% 2
HDFS
UK

For the 6 months to 20 May 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for HDFS.

1 314 (92.35%) Hadoop
2 267 (78.53%) Big Data
3 251 (73.82%) Apache Spark
4 225 (66.18%) HBase
5 201 (59.12%) Java
6 196 (57.65%) Apache Hive
7 190 (55.88%) Kafka
8 187 (55.00%) Linux
9 145 (42.65%) Agile Software Development
10 126 (37.06%) Hadoop YARN
11 113 (33.24%) Python
12 111 (32.65%) Cloudera
13 105 (30.88%) Scala
14 102 (30.00%) Oozie
14 102 (30.00%) Apache ZooKeeper
15 101 (29.71%) Apache Flume
16 96 (28.24%) Hortonworks
16 96 (28.24%) SQL
17 93 (27.35%) Analytics
18 92 (27.06%) Amazon AWS
19 91 (26.76%) Unix
20 86 (25.29%) Sqoop
21 84 (24.71%) Finance
22 79 (23.24%) Jenkins
22 79 (23.24%) Apache
23 77 (22.65%) Continuous Integration
24 76 (22.35%) Shell Script
25 75 (22.06%) ETL
26 73 (21.47%) TDD
27 71 (20.88%) JSON

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 251 (73.82%) Apache Spark
2 79 (23.24%) Apache
3 52 (15.29%) Apache Solr
4 47 (13.82%) Apache Pig
5 29 (8.53%) Cloud Foundry
6 25 (7.35%) Elasticsearch
7 18 (5.29%) GemFire
8 15 (4.41%) Tomcat
9 12 (3.53%) Confluence
9 12 (3.53%) JBoss
9 12 (3.53%) nginx
10 4 (1.18%) WildFly
11 1 (0.29%) SAS
Applications
1 5 (1.47%) Microsoft Excel
1 5 (1.47%) MS Visio
Business Applications
1 2 (0.59%) Summit
Cloud Services
1 92 (27.06%) Amazon AWS
2 44 (12.94%) GitHub
3 26 (7.65%) PaaS
4 23 (6.76%) Amazon S3
5 20 (5.88%) Google Tag Manager
5 20 (5.88%) Microsoft Azure
6 15 (4.41%) Serverless
7 14 (4.12%) AWS Lambda
8 13 (3.82%) Amazon EMR
9 10 (2.94%) Amazon EC2
9 10 (2.94%) Virtual Private Cloud
10 6 (1.76%) Cloud Computing
10 6 (1.76%) IaaS
11 5 (1.47%) Amazon CloudWatch
11 5 (1.47%) Amazon ELB
11 5 (1.47%) Amazon Kinesis
11 5 (1.47%) AWS CloudTrail
12 3 (0.88%) Google Cloud Platform
13 2 (0.59%) Yarn
14 1 (0.29%) npm
Communications & Networking
1 61 (17.94%) Kerberos
2 27 (7.94%) SSL
3 13 (3.82%) HTTP
4 8 (2.35%) Internet
5 7 (2.06%) Network Security
6 6 (1.76%) Firewall
7 5 (1.47%) OpenLDAP
8 4 (1.18%) VPN
9 2 (0.59%) RTMP
10 1 (0.29%) FTP
10 1 (0.29%) Multicast
Database & Business Intelligence
1 314 (92.35%) Hadoop
2 267 (78.53%) Big Data
3 225 (66.18%) HBase
4 196 (57.65%) Apache Hive
5 86 (25.29%) Sqoop
6 70 (20.59%) Impala
7 67 (19.71%) NoSQL
8 66 (19.41%) Apache Cassandra
9 48 (14.12%) Data Lake
10 46 (13.53%) SQL Server
11 44 (12.94%) PostgreSQL
12 43 (12.65%) Data Warehouse
12 43 (12.65%) MongoDB
13 41 (12.06%) Parquet
14 23 (6.76%) Amazon Redshift
15 22 (6.47%) Relational Database
16 21 (6.18%) MySQL
17 14 (4.12%) Cloudera CDH
18 10 (2.94%) Enterprise Data Warehouse
18 10 (2.94%) RDBMS
Development Applications
1 79 (23.24%) Jenkins
2 65 (19.12%) Git (software)
3 32 (9.41%) Gradle
3 32 (9.41%) JUnit
4 23 (6.76%) Cucumber
5 17 (5.00%) JIRA
6 11 (3.24%) IntelliJ
6 11 (3.24%) TeamCity
7 10 (2.94%) Eclipse
7 10 (2.94%) Maven
7 10 (2.94%) Subversion
8 6 (1.76%) Sonatype Nexus
9 5 (1.47%) Artifactory
9 5 (1.47%) FishEye
9 5 (1.47%) GitLab
10 4 (1.18%) ER Studio
10 4 (1.18%) JBehave
10 4 (1.18%) VersionOne
11 2 (0.59%) Selenium
11 2 (0.59%) SonarQube
General
1 84 (24.71%) Finance
2 26 (7.65%) Banking
3 12 (3.53%) Investment Banking
3 12 (3.53%) Retail
4 10 (2.94%) Games
5 8 (2.35%) Telecoms
6 7 (2.06%) Front Office
7 5 (1.47%) Marketing
8 3 (0.88%) French Language
9 2 (0.59%) Back Office
10 1 (0.29%) Aerospace
10 1 (0.29%) Legal
10 1 (0.29%) Private Banking
10 1 (0.29%) Retail Banking
Job Titles
1 115 (33.82%) Developer
2 80 (23.53%) Data Engineer
3 70 (20.59%) Big Data Developer
4 50 (14.71%) Big Data Engineer
5 46 (13.53%) Java Developer
6 38 (11.18%) Architect
7 35 (10.29%) Hadoop Developer
8 30 (8.82%) Consultant
9 27 (7.94%) Data Architect
10 25 (7.35%) Hadoop Engineer
11 23 (6.76%) DevOps Engineer
12 22 (6.47%) Big Data Architect
13 19 (5.59%) Administrator
14 17 (5.00%) Java Engineer
15 16 (4.71%) Hadoop Administrator
15 16 (4.71%) Python Engineer
15 16 (4.71%) Senior Developer
16 15 (4.41%) Hadoop Consultant
17 13 (3.82%) AWS Engineer
17 13 (3.82%) Data Consultant
Libraries, Frameworks & Software Standards
1 190 (55.88%) Kafka
2 71 (20.88%) JSON
3 66 (19.41%) RabbitMQ
4 64 (18.82%) Spring
5 61 (17.94%) RESTful
6 45 (13.24%) Middleware
7 38 (11.18%) Apache Avro
7 38 (11.18%) Web Services
8 34 (10.00%) J2EE
8 34 (10.00%) REST
9 31 (9.12%) XML
10 23 (6.76%) SOAP
10 23 (6.76%) Spark Streaming
11 15 (4.41%) LDAP
12 14 (4.12%) Drools
13 12 (3.53%) JMS
13 12 (3.53%) LEMP Stack
14 10 (2.94%) Gherkin
14 10 (2.94%) Spring Cloud
15 9 (2.65%) AngularJS
Miscellaneous
1 64 (18.82%) Greenfield Project
2 40 (11.76%) Virtual Team
3 39 (11.47%) Linux Command Line
4 22 (6.47%) Computer Science
5 20 (5.88%) Analytical Skills
6 19 (5.59%) Algorithms
7 8 (2.35%) Data Structures
8 7 (2.06%) Derivative
9 6 (1.76%) Grid Computing
10 5 (1.47%) Wiki
11 4 (1.18%) Clustering
11 4 (1.18%) Fintech
11 4 (1.18%) Replication
12 3 (0.88%) MPEG
13 2 (0.59%) Data Centre
13 2 (0.59%) Equity Derivative
13 2 (0.59%) Interest Rate Derivative
13 2 (0.59%) Life Science
13 2 (0.59%) Management Information System
13 2 (0.59%) Media Streaming
Operating Systems
1 187 (55.00%) Linux
2 91 (26.76%) Unix
3 38 (11.18%) Red Hat Enterprise Linux
4 28 (8.24%) CentOS
5 16 (4.71%) Windows
6 7 (2.06%) Ubuntu
7 6 (1.76%) Windows Server
7 6 (1.76%) Windows Server 2008
8 5 (1.47%) CoreOS
9 4 (1.18%) DC/OS
10 3 (0.88%) Debian
11 2 (0.59%) SUSE Linux Enterprise Server
Processes & Methodologies
1 145 (42.65%) Agile Software Development
2 93 (27.35%) Analytics
3 77 (22.65%) Continuous Integration
4 75 (22.06%) ETL
5 73 (21.47%) TDD
6 69 (20.29%) DevOps
7 58 (17.06%) MapReduce
8 53 (15.59%) Scrum
9 49 (14.41%) BDD
10 35 (10.29%) Microservices
11 30 (8.82%) Data Modelling
11 30 (8.82%) Data Strategy
12 29 (8.53%) Business Intelligence
13 28 (8.24%) Benchmarking
14 27 (7.94%) Data Engineering
14 27 (7.94%) Problem-Solving
15 26 (7.65%) Data Science
15 26 (7.65%) Software Engineering
15 26 (7.65%) Test Automation
16 24 (7.06%) Visualisation
Programming Languages
1 201 (59.12%) Java
2 113 (33.24%) Python
3 105 (30.88%) Scala
4 96 (28.24%) SQL
5 76 (22.35%) Shell Script
6 60 (17.65%) Bash Shell
7 22 (6.47%) Java 8
8 18 (5.29%) R
9 13 (3.82%) Perl
9 13 (3.82%) Ruby
10 8 (2.35%) JavaScript
11 6 (1.76%) C++
12 5 (1.47%) C#
12 5 (1.47%) Go
12 5 (1.47%) Groovy
12 5 (1.47%) Korn
12 5 (1.47%) PowerShell
13 4 (1.18%) PL/SQL
13 4 (1.18%) T-SQL
14 3 (0.88%) C
Qualifications
1 42 (12.35%) Degree
2 26 (7.65%) Security Cleared
3 18 (5.29%) SC Cleared
4 17 (5.00%) Computer Science Degree
5 11 (3.24%) Numerate Degree
6 7 (2.06%) ISTQB
7 4 (1.18%) DV Cleared
8 2 (0.59%) OCA
8 2 (0.59%) Oracle Certification
9 1 (0.29%) PhD
9 1 (0.29%) PRINCE2 Certification
Quality Assurance & Compliance
1 18 (5.29%) QA
2 6 (1.76%) MiFID
3 4 (1.18%) Data Quality
3 4 (1.18%) Dodd-Frank
3 4 (1.18%) EMIR
3 4 (1.18%) ISO/IEC 20000
3 4 (1.18%) Sarbanes-Oxley
System Software
1 102 (30.00%) Apache ZooKeeper
2 101 (29.71%) Apache Flume
3 27 (7.94%) Docker
4 21 (6.18%) Active Directory
5 5 (1.47%) Squid
6 2 (0.59%) Virtual Machines
7 1 (0.29%) etcd
Systems Management
1 126 (37.06%) Hadoop YARN
2 102 (30.00%) Oozie
3 35 (10.29%) Ansible
4 25 (7.35%) Ambari
5 20 (5.88%) Kubernetes
5 20 (5.88%) Puppet
6 18 (5.29%) Apache Slider
7 11 (3.24%) Terraform
8 10 (2.94%) Mesos
8 10 (2.94%) Opscode Chef
9 9 (2.65%) Kibana
10 7 (2.06%) Packer
10 7 (2.06%) Salt
11 6 (1.76%) Consul
11 6 (1.76%) Nagios
11 6 (1.76%) Prometheus
12 5 (1.47%) logstash
12 5 (1.47%) rkt
12 5 (1.47%) Sysdig
12 5 (1.47%) ZABBIX
Vendors
1 111 (32.65%) Cloudera
2 96 (28.24%) Hortonworks
3 46 (13.53%) MapR
4 37 (10.88%) Tableau
5 30 (8.82%) Talend
6 28 (8.24%) Salesforce.com
7 25 (7.35%) Google
8 20 (5.88%) Tealium
9 19 (5.59%) Oracle
10 9 (2.65%) Atlassian
10 9 (2.65%) Microsoft
11 8 (2.35%) Informatica
11 8 (2.35%) Red Hat
11 8 (2.35%) SaltStack
11 8 (2.35%) SAP
12 5 (1.47%) ForgeRock
13 4 (1.18%) Ab Initio
13 4 (1.18%) Teradata
14 2 (0.59%) Murex
14 2 (0.59%) Sybase