Period
to 19 February 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 19 February 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
19 Feb 2018
Same period 2017 Same period 2016
Rank 478 526 695
Rank change year-on-year +48 +169 +47
Contract jobs citing HDFS 380 300 147
As % of all contract IT jobs advertised in England 0.41% 0.34% 0.15%
As % of the System Software category 3.19% 2.83% 1.46%
Number of daily rates quoted 265 180 94
England median daily rate £575 £575 £600
Median daily rate % change year-on-year - -4.17% -0.41%
10th Percentile £409 £405 £382
90th Percentile £675 £713 £675
UK median daily rate £575 £575 £600
% change year-on-year - -4.17% -0.41%
Number of hourly rates quoted 0 0 1
England median hourly rate - - £37.50
UK median hourly rate - - £37.50

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Contract vacancies with a requirement for system software skills 11,914 10,619 10,037
As % of all contract IT jobs advertised in England 12.89% 12.12% 10.12%
Number of daily rates quoted 7,840 6,671 5,947
England median daily rate £450 £418 £388
Median daily rate % change year-on-year +7.78% +7.74% +7.64%
10th Percentile £163 £165 £158
90th Percentile £625 £588 £563
UK median daily rate £450 £405 £375
% change year-on-year +11.11% +8.00% +7.14%
Number of hourly rates quoted 637 749 1,060
England median hourly rate £16.41 £16.00 £15.00
Median hourly rate % change year-on-year +2.53% +6.67% -3.23%
10th Percentile £10.50 £10.25 £10.00
90th Percentile £46.10 £43.75 £40.25
UK median hourly rate £16.00 £16.00 £15.00
% change year-on-year - +6.67% -2.57%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in England.

Contractor daily rate trend for HDFS in England

HDFS
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing HDFS in England over the 6 months to 19 February 2018.

Contractor daily rate histogram for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 6 months to 19 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -37 246 £575 - 30
South East +58 110 £575 +6.88% 12
North of England +26 6 £588 +23.68% 4
South West +12 6 £488 +21.88%
East of England -12 6 £488 +21.88% 1
East Midlands +5 5 £600 -
Midlands +3 5 £600 - 1
North West +16 3 £575 - 2
Yorkshire -12 3 £600 +29.73% 2
HDFS
UK

For the 6 months to 19 February 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for HDFS.

1 365 (96.05%) Hadoop
2 321 (84.47%) Big Data
3 288 (75.79%) Apache Spark
4 232 (61.05%) HBase
5 229 (60.26%) Java
6 220 (57.89%) Kafka
7 209 (55.00%) Apache Hive
8 168 (44.21%) Linux
9 152 (40.00%) Apache Flume
10 127 (33.42%) Hadoop YARN
11 126 (33.16%) Oozie
12 120 (31.58%) Agile Software Development
13 116 (30.53%) Python
14 109 (28.68%) Hortonworks
14 109 (28.68%) Sqoop
15 107 (28.16%) MapReduce
16 101 (26.58%) Cloudera
17 100 (26.32%) Analytics
18 99 (26.05%) SQL
19 97 (25.53%) Scala
20 86 (22.63%) DevOps
21 84 (22.11%) PostgreSQL
22 82 (21.58%) Apache ZooKeeper
23 81 (21.32%) Spring
24 80 (21.05%) Jenkins
25 79 (20.79%) TDD
25 79 (20.79%) Shell Script
25 79 (20.79%) Apache
26 69 (18.16%) Finance
27 68 (17.89%) ETL

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 288 (75.79%) Apache Spark
2 79 (20.79%) Apache
3 49 (12.89%) Apache Solr
4 48 (12.63%) Apache Pig
5 28 (7.37%) Elasticsearch
6 17 (4.47%) Tomcat
7 15 (3.95%) Cloud Foundry
8 11 (2.89%) Confluence
9 10 (2.63%) GemFire
10 8 (2.11%) nginx
11 6 (1.58%) JBoss
12 4 (1.05%) SAS
13 3 (0.79%) Jetty
13 3 (0.79%) Oracle Coherence
14 1 (0.26%) OpenStack
Business Applications
1 2 (0.53%) SAP CRM
2 1 (0.26%) Summit
Cloud Services
1 68 (17.89%) Amazon AWS
2 65 (17.11%) GitHub
3 23 (6.05%) Bluemix
3 23 (6.05%) IBM Cloud
4 21 (5.53%) Google Tag Manager
5 15 (3.95%) PaaS
6 13 (3.42%) Amazon S3
6 13 (3.42%) Microsoft Azure
7 11 (2.89%) Amazon EMR
8 10 (2.63%) AWS Lambda
8 10 (2.63%) Serverless
9 8 (2.11%) Amazon EC2
10 7 (1.84%) IaaS
11 5 (1.32%) Amazon CloudWatch
11 5 (1.32%) Amazon ELB
11 5 (1.32%) AWS CloudTrail
11 5 (1.32%) Virtual Private Cloud
12 4 (1.05%) Amazon Kinesis
12 4 (1.05%) Google Analytics
12 4 (1.05%) Google Cloud Platform
Communications & Networking
1 61 (16.05%) Kerberos
2 19 (5.00%) SSL
3 14 (3.68%) Internet
4 6 (1.58%) OpenLDAP
5 5 (1.32%) HTTP
6 3 (0.79%) Network Security
7 2 (0.53%) Firewall
8 1 (0.26%) DNS
8 1 (0.26%) FTP
8 1 (0.26%) Multicast
Database & Business Intelligence
1 365 (96.05%) Hadoop
2 321 (84.47%) Big Data
3 232 (61.05%) HBase
4 209 (55.00%) Apache Hive
5 109 (28.68%) Sqoop
6 84 (22.11%) PostgreSQL
7 64 (16.84%) Apache Cassandra
8 60 (15.79%) Impala
9 58 (15.26%) NoSQL
10 43 (11.32%) Data Warehouse
11 42 (11.05%) MongoDB
12 41 (10.79%) SQL Server
13 38 (10.00%) Data Lake
14 31 (8.16%) Parquet
14 31 (8.16%) Relational Database
15 26 (6.84%) RDBMS
16 16 (4.21%) Oracle Database
17 14 (3.68%) SAP BW
17 14 (3.68%) SAP Data Services
18 12 (3.16%) Amazon Redshift
Development Applications
1 80 (21.05%) Jenkins
2 68 (17.89%) Git (software)
3 38 (10.00%) Gradle
4 25 (6.58%) JUnit
5 20 (5.26%) Cucumber
6 17 (4.47%) JIRA
7 12 (3.16%) IntelliJ
7 12 (3.16%) TeamCity
8 10 (2.63%) Maven
9 7 (1.84%) Sonatype Nexus
10 5 (1.32%) Artifactory
10 5 (1.32%) GitLab
10 5 (1.32%) Subversion
11 4 (1.05%) SonarQube
12 3 (0.79%) ERwin
12 3 (0.79%) Mercurial
12 3 (0.79%) VersionOne
13 2 (0.53%) JBehave
14 1 (0.26%) Grunt
14 1 (0.26%) Vagrant
General
1 69 (18.16%) Finance
2 24 (6.32%) Banking
3 12 (3.16%) Retail
4 10 (2.63%) Telecoms
5 7 (1.84%) Front Office
6 6 (1.58%) Retail Banking
7 5 (1.32%) Investment Banking
8 3 (0.79%) French Language
8 3 (0.79%) Marketing
9 2 (0.53%) Games
9 2 (0.53%) Legal
9 2 (0.53%) Pharmaceutical
10 1 (0.26%) Back Office
Job Titles
1 115 (30.26%) Developer
2 81 (21.32%) Data Engineer
3 71 (18.68%) Big Data Developer
4 59 (15.53%) Architect
5 58 (15.26%) Big Data Engineer
6 56 (14.74%) Java Developer
7 44 (11.58%) Data Architect
8 42 (11.05%) Hadoop Engineer
9 36 (9.47%) Big Data Architect
10 26 (6.84%) Consultant
11 23 (6.05%) Hadoop Developer
12 21 (5.53%) DevOps Engineer
13 17 (4.47%) Administrator
14 16 (4.21%) Hadoop Consultant
15 15 (3.95%) Senior Developer
16 14 (3.68%) Hadoop Architect
17 13 (3.42%) Hadoop Administrator
17 13 (3.42%) Senior Java Developer
18 11 (2.89%) Java Engineer
18 11 (2.89%) NoSQL Developer
Libraries, Frameworks & Software Standards
1 220 (57.89%) Kafka
2 81 (21.32%) Spring
3 59 (15.53%) RESTful
4 51 (13.42%) REST
5 47 (12.37%) JSON
5 47 (12.37%) Web Services
6 44 (11.58%) RabbitMQ
7 43 (11.32%) PySpark
8 42 (11.05%) Apache Avro
9 37 (9.74%) Middleware
9 37 (9.74%) Spring Boot
10 35 (9.21%) J2EE
11 29 (7.63%) SOAP
12 26 (6.84%) Spark Streaming
13 19 (5.00%) XML
14 18 (4.74%) Drools
15 16 (4.21%) JMS
16 14 (3.68%) Apache Camel
17 12 (3.16%) AngularJS
17 12 (3.16%) Hibernate
Miscellaneous
1 43 (11.32%) Greenfield Project
2 34 (8.95%) Virtual Team
3 33 (8.68%) Linux Command Line
4 27 (7.11%) Algorithms
5 21 (5.53%) Analytical Skills
6 20 (5.26%) Computer Science
7 11 (2.89%) Replication
8 9 (2.37%) Derivative
9 7 (1.84%) Market Risk
10 4 (1.05%) Interest Rate Derivative
11 3 (0.79%) Credit Risk
11 3 (0.79%) Data Centre
12 2 (0.53%) Enterprise Software
12 2 (0.53%) Life Science
12 2 (0.53%) Management Information System
12 2 (0.53%) Media Streaming
12 2 (0.53%) Mobile App
12 2 (0.53%) MPEG
12 2 (0.53%) Over-the-Top Content
13 1 (0.26%) Foreign Exchange (FX)
Operating Systems
1 168 (44.21%) Linux
2 64 (16.84%) Unix
3 41 (10.79%) Red Hat Enterprise Linux
4 33 (8.68%) CentOS
5 7 (1.84%) Windows
6 6 (1.58%) CoreOS
7 5 (1.32%) Ubuntu
8 3 (0.79%) DC/OS
8 3 (0.79%) Debian
9 1 (0.26%) Windows Server
9 1 (0.26%) Windows Server 2008
Processes & Methodologies
1 120 (31.58%) Agile Software Development
2 107 (28.16%) MapReduce
3 100 (26.32%) Analytics
4 86 (22.63%) DevOps
5 79 (20.79%) TDD
6 68 (17.89%) ETL
7 61 (16.05%) Continuous Integration
8 51 (13.42%) BDD
8 51 (13.42%) Data Engineering
9 45 (11.84%) Open Source
10 44 (11.58%) Scrum
11 39 (10.26%) Data Science
12 37 (9.74%) Data Architecture
13 35 (9.21%) Benchmarking
14 32 (8.42%) Business Intelligence
14 32 (8.42%) Data Strategy
15 30 (7.89%) Microservices
16 28 (7.37%) Data Analytics
17 27 (7.11%) Unit Testing
18 25 (6.58%) System Testing
Programming Languages
1 229 (60.26%) Java
2 116 (30.53%) Python
3 99 (26.05%) SQL
4 97 (25.53%) Scala
5 79 (20.79%) Shell Script
6 47 (12.37%) Bash Shell
7 21 (5.53%) PL/SQL
8 12 (3.16%) R
9 8 (2.11%) Ruby
10 6 (1.58%) C#
10 6 (1.58%) Go
10 6 (1.58%) Perl
11 5 (1.32%) C++
12 4 (1.05%) Gremlin
13 2 (0.53%) C
13 2 (0.53%) T-SQL
13 2 (0.53%) XPath
14 1 (0.26%) JavaScript
14 1 (0.26%) Julia
14 1 (0.26%) PHP
Qualifications
1 55 (14.47%) Security Cleared
2 50 (13.16%) Degree
3 48 (12.63%) SC Cleared
4 15 (3.95%) Computer Science Degree
5 12 (3.16%) Numerate Degree
6 3 (0.79%) DV Cleared
7 2 (0.53%) DBS Check
8 1 (0.26%) ISTQB
8 1 (0.26%) Master's Degree
8 1 (0.26%) PRINCE2 Certification
Quality Assurance & Compliance
1 17 (4.47%) QA
2 5 (1.32%) Data Quality
2 5 (1.32%) MiFID
3 4 (1.05%) ISO/IEC 20000
3 4 (1.05%) Sarbanes-Oxley
4 3 (0.79%) Dodd-Frank
4 3 (0.79%) EMIR
System Software
1 152 (40.00%) Apache Flume
2 82 (21.58%) Apache ZooKeeper
3 45 (11.84%) Docker
4 17 (4.47%) Active Directory
5 10 (2.63%) VMware Infrastructure
6 9 (2.37%) vCloud
7 5 (1.32%) Squid
8 1 (0.26%) etcd
8 1 (0.26%) Virtual Machines
8 1 (0.26%) VirtualBox
Systems Management
1 127 (33.42%) Hadoop YARN
2 126 (33.16%) Oozie
3 63 (16.58%) Ambari
4 36 (9.47%) Kubernetes
5 31 (8.16%) Puppet
6 26 (6.84%) Ansible
7 16 (4.21%) Terraform
8 14 (3.68%) Apache Slider
8 14 (3.68%) Opscode Chef
9 11 (2.89%) Mesos
10 8 (2.11%) Kibana
11 7 (1.84%) Nagios
12 6 (1.58%) Consul
12 6 (1.58%) Packer
12 6 (1.58%) Prometheus
12 6 (1.58%) Salt
12 6 (1.58%) ZABBIX
13 5 (1.32%) logstash
13 5 (1.32%) rkt
13 5 (1.32%) Sysdig
Vendors
1 109 (28.68%) Hortonworks
2 101 (26.58%) Cloudera
3 48 (12.63%) Oracle
4 44 (11.58%) MapR
5 40 (10.53%) Tableau
6 29 (7.63%) Google
7 27 (7.11%) IBM
7 27 (7.11%) Salesforce.com
8 26 (6.84%) Talend
9 21 (5.53%) Tealium
10 18 (4.74%) Red Hat
11 17 (4.47%) SAP
12 10 (2.63%) VMware
13 8 (2.11%) Microsoft
14 6 (1.58%) Atlassian
14 6 (1.58%) Informatica
14 6 (1.58%) Teradata
15 5 (1.32%) ForgeRock
16 4 (1.05%) Ab Initio
16 4 (1.05%) SaltStack