Period
to 18 August 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 18 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
18 Aug 2018
Same period 2017 Same period 2016
Rank 533 480 707
Rank change year-on-year -53 +227 +27
Contract jobs citing HDFS 341 359 167
As % of all contract IT jobs advertised in England 0.36% 0.40% 0.17%
As % of the System Software category 2.52% 3.39% 1.38%
Number of daily rates quoted 235 250 123
England median daily rate £525 £525 £550
Median daily rate % change year-on-year - -4.55% -4.35%
10th Percentile £443 £350 £386
90th Percentile £675 £700 £675
UK median daily rate £525 £525 £550
% change year-on-year - -4.55% -4.35%
Number of hourly rates quoted 3 2 0
England median hourly rate £22.00 £50.00 -
Median hourly rate % change year-on-year -56.00% - -
UK median hourly rate £22.00 £50.00 -
% change year-on-year -56.00% - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Contract vacancies with a requirement for system software skills 13,542 10,598 12,142
As % of all contract IT jobs advertised in England 14.39% 11.92% 12.08%
Number of daily rates quoted 8,821 6,845 7,739
England median daily rate £450 £425 £410
Median daily rate % change year-on-year +5.88% +3.66% +17.14%
10th Percentile £185 £175 £181
90th Percentile £625 £594 £575
UK median daily rate £450 £425 £400
% change year-on-year +5.88% +6.25% +14.29%
Number of hourly rates quoted 806 602 802
England median hourly rate £16.50 £16.00 £15.86
Median hourly rate % change year-on-year +3.13% +0.91% -3.91%
10th Percentile £11.09 £10.34 £10.50
90th Percentile £45.19 £45.25 £38.00
UK median hourly rate £16.36 £16.00 £16.50
% change year-on-year +2.23% -3.03% +3.13%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in England.

Contractor daily rate trend for HDFS in England

HDFS
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing HDFS in England over the 6 months to 18 August 2018.

Contractor daily rate histogram for HDFS in England

HDFS
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing HDFS in England.

Contractor hourly rate trend for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 6 months to 18 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -34 232 £550 - 16
South East 0 84 £500 +24.84% 6
North of England -18 8 £500 +19.05% 1
East of England -8 7 £588 +20.51% 2
North West -8 5 £500 +25.00%
Midlands -8 4 £425 -19.05%
South West -23 4 £519 +29.69%
East Midlands -1 3 - -
Yorkshire -6 3 £425 -10.53% 1
West Midlands - 1 £425 -
HDFS
UK

For the 6 months to 18 August 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for HDFS.

1 310 (90.91%) Hadoop
2 274 (80.35%) Big Data
3 248 (72.73%) Apache Spark
4 206 (60.41%) Apache Hive
4 206 (60.41%) Java
5 189 (55.43%) HBase
6 180 (52.79%) Kafka
7 170 (49.85%) Agile Software Development
8 139 (40.76%) Python
9 136 (39.88%) Linux
10 119 (34.90%) SQL
11 118 (34.60%) Unix
12 114 (33.43%) Amazon AWS
13 109 (31.96%) Hadoop YARN
14 104 (30.50%) Finance
15 99 (29.03%) Scala
16 97 (28.45%) Scrum
17 95 (27.86%) Jenkins
18 91 (26.69%) Sqoop
19 89 (26.10%) Impala
20 88 (25.81%) ETL
21 87 (25.51%) Cloudera
22 83 (24.34%) Continuous Integration
23 81 (23.75%) DevOps
24 79 (23.17%) NoSQL
25 77 (22.58%) TDD
26 73 (21.41%) Oozie
27 72 (21.11%) Apache ZooKeeper
28 71 (20.82%) Shell Script
29 69 (20.23%) Ansible

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 248 (72.73%) Apache Spark
2 65 (19.06%) Apache
3 55 (16.13%) Apache Solr
4 35 (10.26%) Apache Pig
5 27 (7.92%) Cloud Foundry
6 24 (7.04%) Elasticsearch
6 24 (7.04%) GemFire
7 22 (6.45%) Confluence
8 7 (2.05%) Tomcat
9 6 (1.76%) JBoss
10 5 (1.47%) nginx
10 5 (1.47%) SAS
11 4 (1.17%) WildFly
12 1 (0.29%) Apache Airflow
12 1 (0.29%) WebLogic
Applications
1 35 (10.26%) Microsoft Excel
2 33 (9.68%) MS Visio
3 2 (0.59%) Spreadsheet
Business Applications
1 1 (0.29%) Summit
Cloud Services
1 114 (33.43%) Amazon AWS
2 53 (15.54%) Amazon S3
3 35 (10.26%) GitHub
4 34 (9.97%) Amazon EC2
5 33 (9.68%) Virtual Private Cloud
6 30 (8.80%) PaaS
7 25 (7.33%) Microsoft Azure
8 16 (4.69%) Amazon EMR
9 9 (2.64%) Cloud Computing
9 9 (2.64%) Google Cloud Platform
10 8 (2.35%) Amazon Kinesis
11 6 (1.76%) IaaS
12 5 (1.47%) Serverless
13 4 (1.17%) AWS Lambda
14 3 (0.88%) IBM Cloud
15 2 (0.59%) AWS Elastic Beanstalk
15 2 (0.59%) SaaS
15 2 (0.59%) Yarn
16 1 (0.29%) Azure Data Factory
16 1 (0.29%) npm
Communications & Networking
1 55 (16.13%) Kerberos
2 20 (5.87%) SSL
3 16 (4.69%) HTTP
4 10 (2.93%) VPN
5 8 (2.35%) Firewall
6 7 (2.05%) RTMP
7 6 (1.76%) Network Security
8 4 (1.17%) HTTPS
9 1 (0.29%) Internet
9 1 (0.29%) Multicast
Database & Business Intelligence
1 310 (90.91%) Hadoop
2 274 (80.35%) Big Data
3 206 (60.41%) Apache Hive
4 189 (55.43%) HBase
5 91 (26.69%) Sqoop
6 89 (26.10%) Impala
7 79 (23.17%) NoSQL
8 66 (19.35%) SQL Server
9 52 (15.25%) Apache Cassandra
10 51 (14.96%) MongoDB
11 38 (11.14%) Data Warehouse
12 35 (10.26%) Parquet
13 33 (9.68%) Relational Database
14 31 (9.09%) Data Lake
15 25 (7.33%) PostgreSQL
16 23 (6.74%) Amazon Redshift
17 15 (4.40%) MySQL
18 13 (3.81%) Apache Zeppelin
18 13 (3.81%) OLTP
19 11 (3.23%) Cloudera CDH
Development Applications
1 95 (27.86%) Jenkins
2 52 (15.25%) Git (software)
3 37 (10.85%) Cucumber
4 28 (8.21%) IntelliJ
5 26 (7.62%) JIRA
6 22 (6.45%) JUnit
7 19 (5.57%) Eclipse
8 17 (4.99%) Maven
9 15 (4.40%) Gradle
10 8 (2.35%) GitLab
10 8 (2.35%) Subversion
11 7 (2.05%) FishEye
11 7 (2.05%) JBehave
12 6 (1.76%) Selenium
12 6 (1.76%) TeamCity
13 4 (1.17%) Gatling
13 4 (1.17%) Jasmine
13 4 (1.17%) Sonatype Nexus
13 4 (1.17%) Visual Studio Team System
14 3 (0.88%) Ant
General
1 104 (30.50%) Finance
2 30 (8.80%) Banking
3 17 (4.99%) Investment Banking
4 10 (2.93%) Games
4 10 (2.93%) Legal
5 8 (2.35%) Front Office
6 6 (1.76%) Marketing
6 6 (1.76%) Retail
7 3 (0.88%) Back Office
8 2 (0.59%) Telecoms
9 1 (0.29%) Aerospace
9 1 (0.29%) French Language
9 1 (0.29%) Manufacturing
9 1 (0.29%) Private Banking
9 1 (0.29%) Retail Banking
Job Titles
1 134 (39.30%) Developer
2 81 (23.75%) Data Engineer
3 68 (19.94%) Big Data Developer
4 61 (17.89%) Big Data Engineer
5 50 (14.66%) Java Developer
6 39 (11.44%) Hadoop Developer
7 33 (9.68%) Platform Engineer
8 29 (8.50%) Architect
9 25 (7.33%) Hadoop Engineer
10 23 (6.74%) Apache Spark Developer
10 23 (6.74%) Big Data Architect
10 23 (6.74%) Data Architect
11 17 (4.99%) Consultant
12 16 (4.69%) Java Engineer
13 15 (4.40%) AWS Engineer
13 15 (4.40%) DevOps Engineer
14 14 (4.11%) Java Hadoop Developer
14 14 (4.11%) Senior Data Engineer
14 14 (4.11%) Senior Developer
15 12 (3.52%) Python Engineer
Libraries, Frameworks & Software Standards
1 180 (52.79%) Kafka
2 57 (16.72%) JSON
3 55 (16.13%) RabbitMQ
4 52 (15.25%) Spring
5 41 (12.02%) Spark Streaming
6 37 (10.85%) RESTful
7 32 (9.38%) Middleware
8 31 (9.09%) J2EE
9 30 (8.80%) XML
10 27 (7.92%) REST
11 21 (6.16%) Apache Avro
12 17 (4.99%) Spring Boot
13 16 (4.69%) Drools
14 15 (4.40%) HTML
15 13 (3.81%) Node.js
16 12 (3.52%) LDAP
17 11 (3.23%) Ruby on Rails
18 10 (2.93%) AngularJS
18 10 (2.93%) Gherkin
18 10 (2.93%) Spring Cloud
Miscellaneous
1 54 (15.84%) Greenfield Project
2 37 (10.85%) Analytical Skills
3 36 (10.56%) Algorithms
3 36 (10.56%) Wiki
4 26 (7.62%) Virtual Team
5 23 (6.74%) Linux Command Line
6 19 (5.57%) Computer Science
7 17 (4.99%) Data Structures
8 10 (2.93%) Self-Motivation
9 9 (2.64%) Fintech
9 9 (2.64%) User Experience
10 8 (2.35%) Derivative
11 7 (2.05%) Equity Derivative
12 5 (1.47%) Clustering
12 5 (1.47%) Data Centre
12 5 (1.47%) Grid Computing
13 4 (1.17%) Replication
14 3 (0.88%) Management Information System
15 2 (0.59%) Cyber Defence
15 2 (0.59%) Cyberthreat
Operating Systems
1 136 (39.88%) Linux
2 118 (34.60%) Unix
3 42 (12.32%) Windows
4 11 (3.23%) Red Hat Enterprise Linux
5 5 (1.47%) Windows Server
5 5 (1.47%) Windows Server 2008
6 4 (1.17%) Ubuntu
7 3 (0.88%) DC/OS
8 2 (0.59%) SUSE Linux Enterprise Server
9 1 (0.29%) CentOS
Processes & Methodologies
1 170 (49.85%) Agile Software Development
2 97 (28.45%) Scrum
3 88 (25.81%) ETL
4 83 (24.34%) Continuous Integration
5 81 (23.75%) DevOps
6 77 (22.58%) TDD
7 68 (19.94%) Analytics
8 64 (18.77%) Test Automation
9 58 (17.01%) BDD
10 56 (16.42%) Data Analysis
11 46 (13.49%) Business Intelligence
12 44 (12.90%) MapReduce
12 44 (12.90%) Problem-Solving
13 41 (12.02%) Microservices
14 40 (11.73%) Data Modelling
15 39 (11.44%) Data Science
16 38 (11.14%) Data Extraction
17 37 (10.85%) Build Automation
18 31 (9.09%) Software Engineering
19 27 (7.92%) Visualisation
Programming Languages
1 206 (60.41%) Java
2 139 (40.76%) Python
3 119 (34.90%) SQL
4 99 (29.03%) Scala
5 71 (20.82%) Shell Script
6 57 (16.72%) Bash Shell
7 33 (9.68%) Java 8
7 33 (9.68%) Korn
7 33 (9.68%) PowerShell
8 18 (5.28%) JavaScript
9 15 (4.40%) R
10 14 (4.11%) Ruby
11 11 (3.23%) Perl
12 9 (2.64%) T-SQL
13 8 (2.35%) TypeScript
14 7 (2.05%) C#
15 6 (1.76%) Groovy
16 5 (1.47%) C++
17 3 (0.88%) Go
18 2 (0.59%) VBA
Qualifications
1 30 (8.80%) Degree
2 22 (6.45%) Security Cleared
3 17 (4.99%) SC Cleared
4 12 (3.52%) Computer Science Degree
5 10 (2.93%) ISTQB
6 5 (1.47%) Numerate Degree
7 3 (0.88%) DV Cleared
8 2 (0.59%) OCA
8 2 (0.59%) Oracle Certification
8 2 (0.59%) PhD
8 2 (0.59%) Sun Certification
9 1 (0.29%) BPSS Clearance
9 1 (0.29%) CISSP
9 1 (0.29%) ISEB
9 1 (0.29%) ISTQB Foundation Certification
Quality Assurance & Compliance
1 15 (4.40%) QA
2 8 (2.35%) GDPR
3 5 (1.47%) Data Quality
4 4 (1.17%) ISO/IEC 27001
5 1 (0.29%) Dodd-Frank
5 1 (0.29%) EMIR
5 1 (0.29%) MiFID
System Software
1 72 (21.11%) Apache ZooKeeper
2 44 (12.90%) Apache Flume
3 30 (8.80%) Docker
4 7 (2.05%) Active Directory
5 1 (0.29%) etcd
5 1 (0.29%) Virtual Machines
Systems Management
1 109 (31.96%) Hadoop YARN
2 73 (21.41%) Oozie
3 69 (20.23%) Ansible
4 37 (10.85%) Puppet
5 35 (10.26%) Opscode Chef
6 25 (7.33%) Kubernetes
7 18 (5.28%) Terraform
8 15 (4.40%) Ambari
9 7 (2.05%) Apache Slider
9 7 (2.05%) Mesos
10 5 (1.47%) Kibana
10 5 (1.47%) Salt
11 4 (1.17%) Single Sign-On
12 2 (0.59%) FreeIPA
12 2 (0.59%) Packer
13 1 (0.29%) Apache Brooklyn
13 1 (0.29%) Consul
13 1 (0.29%) Marathon
13 1 (0.29%) Prometheus
Vendors
1 87 (25.51%) Cloudera
2 49 (14.37%) Tableau
3 48 (14.08%) Hortonworks
3 48 (14.08%) Oracle
4 16 (4.69%) MapR
5 13 (3.81%) Google
6 12 (3.52%) Talend
7 10 (2.93%) Informatica
8 9 (2.64%) Atlassian
8 9 (2.64%) Salesforce.com
9 6 (1.76%) Alteryx
9 6 (1.76%) RapidMiner
9 6 (1.76%) Splunk
10 5 (1.47%) Cognos
10 5 (1.47%) SaltStack
10 5 (1.47%) SAP
11 4 (1.17%) Databricks
11 4 (1.17%) IBM
12 3 (0.88%) Teradata
13 2 (0.59%) Sun