Period
to 18 November 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 18 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
18 Nov 2018
Same period 2017 Same period 2016
Rank 540 470 629
Rank change year-on-year -70 +159 +80
Contract jobs citing HDFS 322 422 260
As % of all contract IT jobs advertised in England 0.34% 0.45% 0.26%
As % of the System Software category 2.23% 3.53% 2.15%
Number of daily rates quoted 220 305 149
England median daily rate £525 £550 £550
Median daily rate % change year-on-year -4.55% - -10.20%
10th Percentile £449 £387 £408
90th Percentile £700 £700 £715
UK median daily rate £525 £550 £550
% change year-on-year -4.55% - -10.20%
Number of hourly rates quoted 3 1 0
England median hourly rate £22.00 £50.00 -
Median hourly rate % change year-on-year -56.00% - -
UK median hourly rate £22.00 £50.00 -
% change year-on-year -56.00% - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Contract vacancies with a requirement for system software skills 14,416 11,956 12,104
As % of all contract IT jobs advertised in England 15.40% 12.73% 12.33%
Number of daily rates quoted 9,469 7,823 7,664
England median daily rate £453 £425 £410
Median daily rate % change year-on-year +6.47% +3.66% +9.33%
10th Percentile £187 £163 £175
90th Percentile £626 £613 £575
UK median daily rate £450 £425 £400
% change year-on-year +5.88% +6.25% +8.11%
Number of hourly rates quoted 784 657 815
England median hourly rate £16.00 £16.50 £15.75
Median hourly rate % change year-on-year -3.03% +4.76% -1.56%
10th Percentile £10.50 £10.40 £10.50
90th Percentile £43.75 £47.25 £39.13
UK median hourly rate £16.00 £16.50 £15.88
% change year-on-year -3.03% +3.94% -0.78%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in England.

Contractor daily rate trend for HDFS in England

HDFS
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing HDFS in England over the 6 months to 18 November 2018.

Contractor daily rate histogram for HDFS in England

HDFS
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing HDFS in England.

Contractor hourly rate trend for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 6 months to 18 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -74 212 £550 - 23
South East -15 74 £519 +3.75% 6
North of England -9 22 £520 +9.47% 3
North West -4 13 £510 +25.93% 3
East of England +6 8 £594 +21.79% 3
Yorkshire -7 5 £510 +7.37%
North East - 4 £525 -
South West -39 2 - - 2
Midlands - 2 £425 - 2
East Midlands - 1 - - 2
West Midlands - 1 £425 -
HDFS
UK

For the 6 months to 18 November 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for HDFS.

1 290 (90.06%) Hadoop
2 268 (83.23%) Big Data
3 204 (63.35%) Apache Spark
4 190 (59.01%) Apache Hive
5 189 (58.70%) Java
6 171 (53.11%) Agile Software Development
7 166 (51.55%) Kafka
8 161 (50.00%) HBase
9 123 (38.20%) Python
10 121 (37.58%) Sqoop
11 116 (36.02%) Hadoop YARN
12 111 (34.47%) Unix
13 108 (33.54%) SQL
14 105 (32.61%) Linux
15 104 (32.30%) Jenkins
16 101 (31.37%) Impala
17 87 (27.02%) Continuous Integration
18 85 (26.40%) Amazon AWS
19 83 (25.78%) SQL Server
20 79 (24.53%) ETL
21 78 (24.22%) TDD
21 78 (24.22%) Oozie
22 76 (23.60%) Cloudera
22 76 (23.60%) Scrum
23 75 (23.29%) Ansible
24 74 (22.98%) Oracle
25 72 (22.36%) Scala
26 71 (22.05%) Git (software)
26 71 (22.05%) Shell Script
27 67 (20.81%) Finance

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 204 (63.35%) Apache Spark
2 67 (20.81%) Apache
3 35 (10.87%) Apache Pig
4 34 (10.56%) Confluence
5 33 (10.25%) Apache Solr
6 22 (6.83%) Elasticsearch
7 10 (3.11%) SAS
8 9 (2.80%) GemFire
9 5 (1.55%) Cloud Foundry
10 1 (0.31%) Apache Airflow
10 1 (0.31%) WebLogic
Applications
1 42 (13.04%) Microsoft Excel
2 40 (12.42%) MS Visio
3 2 (0.62%) Spreadsheet
Business Applications
1 1 (0.31%) Summit
Cloud Services
1 85 (26.40%) Amazon AWS
2 50 (15.53%) Amazon S3
3 41 (12.73%) Amazon EC2
4 40 (12.42%) Virtual Private Cloud
5 38 (11.80%) Microsoft Azure
6 36 (11.18%) GitHub
7 18 (5.59%) Google Cloud Platform
8 12 (3.73%) PaaS
9 11 (3.42%) IaaS
10 9 (2.80%) Amazon EMR
11 6 (1.86%) Cloud Computing
12 5 (1.55%) Amazon Kinesis
13 4 (1.24%) AWS Elastic Beanstalk
14 3 (0.93%) IBM Cloud
15 1 (0.31%) SaaS
Communications & Networking
1 40 (12.42%) Kerberos
2 11 (3.42%) SSL
3 10 (3.11%) VPN
4 8 (2.48%) Firewall
4 8 (2.48%) HTTP
4 8 (2.48%) HTTPS
5 5 (1.55%) LAN
5 5 (1.55%) RTMP
5 5 (1.55%) WAN
6 2 (0.62%) Network Security
7 1 (0.31%) SSH
Database & Business Intelligence
1 290 (90.06%) Hadoop
2 268 (83.23%) Big Data
3 190 (59.01%) Apache Hive
4 161 (50.00%) HBase
5 121 (37.58%) Sqoop
6 101 (31.37%) Impala
7 83 (25.78%) SQL Server
8 67 (20.81%) NoSQL
9 46 (14.29%) MongoDB
10 43 (13.35%) Parquet
11 40 (12.42%) Relational Database
12 36 (11.18%) Apache Cassandra
13 33 (10.25%) Data Lake
14 31 (9.63%) Data Warehouse
15 20 (6.21%) PostgreSQL
16 19 (5.90%) Apache Kudu
17 18 (5.59%) MySQL
18 15 (4.66%) OLTP
19 12 (3.73%) RDBMS
20 11 (3.42%) Apache Zeppelin
Development Applications
1 104 (32.30%) Jenkins
2 71 (22.05%) Git (software)
3 37 (11.49%) JIRA
4 35 (10.87%) Cucumber
5 22 (6.83%) IntelliJ
6 21 (6.52%) Gradle
7 17 (5.28%) Maven
8 15 (4.66%) JUnit
9 11 (3.42%) JBehave
9 11 (3.42%) Selenium
10 9 (2.80%) Eclipse
11 8 (2.48%) FishEye
12 7 (2.17%) GitLab
13 6 (1.86%) Atlassian Bamboo
13 6 (1.86%) Gerrit
13 6 (1.86%) jMock
13 6 (1.86%) Subversion
13 6 (1.86%) Visual Studio Team System
14 5 (1.55%) Ant
14 5 (1.55%) Sonatype Nexus
General
1 67 (20.81%) Finance
2 27 (8.39%) Banking
3 16 (4.97%) Legal
4 14 (4.35%) Front Office
5 10 (3.11%) Investment Banking
6 9 (2.80%) Retail
7 5 (1.55%) Games
8 4 (1.24%) Marketing
9 3 (0.93%) Back Office
10 2 (0.62%) Advertising
10 2 (0.62%) Telecoms
11 1 (0.31%) French Language
11 1 (0.31%) Manufacturing
11 1 (0.31%) Retail Banking
Job Titles
1 134 (41.61%) Developer
2 74 (22.98%) Java Developer
3 69 (21.43%) Data Engineer
4 60 (18.63%) Big Data Engineer
5 55 (17.08%) Big Data Developer
6 40 (12.42%) Platform Engineer
7 33 (10.25%) Apache Spark Developer
8 31 (9.63%) Hadoop Developer
9 26 (8.07%) Architect
10 21 (6.52%) Hadoop Engineer
11 19 (5.90%) Data Architect
12 18 (5.59%) Big Data Architect
13 17 (5.28%) DevOps Engineer
14 14 (4.35%) Java Hadoop Developer
15 10 (3.11%) Senior Data Engineer
15 10 (3.11%) Software Engineer
16 9 (2.80%) Consultant
16 9 (2.80%) SC Cleared Java Developer
16 9 (2.80%) Scala Developer
17 8 (2.48%) Big Data Software Engineer
Libraries, Frameworks & Software Standards
1 166 (51.55%) Kafka
2 48 (14.91%) Spring
3 43 (13.35%) RabbitMQ
4 40 (12.42%) Spark Streaming
5 38 (11.80%) JSON
6 32 (9.94%) Apache Avro
6 32 (9.94%) REST
7 28 (8.70%) Middleware
8 26 (8.07%) J2EE
9 16 (4.97%) Spring Boot
10 13 (4.04%) RESTful
11 11 (3.42%) XML
12 10 (3.11%) Node.js
13 9 (2.80%) Apache Camel
13 9 (2.80%) Drools
13 9 (2.80%) HTML
14 8 (2.48%) .NET
15 7 (2.17%) LDAP
15 7 (2.17%) MLlib
15 7 (2.17%) OAuth
Miscellaneous
1 43 (13.35%) Wiki
2 34 (10.56%) Analytical Skills
3 29 (9.01%) Algorithms
3 29 (9.01%) Greenfield Project
4 27 (8.39%) Virtual Team
5 22 (6.83%) Linux Command Line
6 18 (5.59%) Data Structures
7 17 (5.28%) Computer Science
8 9 (2.80%) Fintech
8 9 (2.80%) Self-Motivation
9 7 (2.17%) User Experience
10 6 (1.86%) Management Information System
11 5 (1.55%) Data Centre
11 5 (1.55%) Derivative
11 5 (1.55%) Equity Derivative
12 2 (0.62%) Cyber Defence
12 2 (0.62%) Cyberthreat
12 2 (0.62%) Enterprise Software
12 2 (0.62%) Private Cloud
13 1 (0.31%) Taxonomies
Operating Systems
1 111 (34.47%) Unix
2 105 (32.61%) Linux
3 45 (13.98%) Windows
4 5 (1.55%) Red Hat Enterprise Linux
5 3 (0.93%) DC/OS
6 2 (0.62%) CoreOS
7 1 (0.31%) CentOS
7 1 (0.31%) Ubuntu
Processes & Methodologies
1 171 (53.11%) Agile Software Development
2 87 (27.02%) Continuous Integration
3 79 (24.53%) ETL
4 78 (24.22%) TDD
5 76 (23.60%) Scrum
6 65 (20.19%) Data Analysis
7 63 (19.57%) BDD
8 62 (19.25%) Test Automation
9 60 (18.63%) Analytics
10 58 (18.01%) DevOps
11 57 (17.70%) Business Intelligence
12 49 (15.22%) Data Extraction
13 43 (13.35%) Data Modelling
13 43 (13.35%) MapReduce
14 40 (12.42%) Build Automation
15 35 (10.87%) Data Science
16 34 (10.56%) Open Source
17 29 (9.01%) Problem-Solving
18 26 (8.07%) Visualisation
19 25 (7.76%) Software Engineering
Programming Languages
1 189 (58.70%) Java
2 123 (38.20%) Python
3 108 (33.54%) SQL
4 72 (22.36%) Scala
5 71 (22.05%) Shell Script
6 58 (18.01%) Bash Shell
7 40 (12.42%) Korn
7 40 (12.42%) PowerShell
8 31 (9.63%) Java 8
9 16 (4.97%) JavaScript
10 15 (4.66%) Ruby
11 11 (3.42%) R
12 9 (2.80%) C++
12 9 (2.80%) Groovy
13 6 (1.86%) C
13 6 (1.86%) C#
13 6 (1.86%) T-SQL
14 5 (1.55%) TypeScript
15 4 (1.24%) Perl
16 3 (0.93%) Go
Qualifications
1 33 (10.25%) Degree
2 23 (7.14%) Security Cleared
3 21 (6.52%) SC Cleared
4 8 (2.48%) Computer Science Degree
5 4 (1.24%) ISTQB
6 3 (0.93%) PhD
7 2 (0.62%) DV Cleared
7 2 (0.62%) Sun Certification
8 1 (0.31%) BPSS Clearance
8 1 (0.31%) CISSP
8 1 (0.31%) ISEB
8 1 (0.31%) ISTQB Foundation Certification
8 1 (0.31%) SAS Certification
Quality Assurance & Compliance
1 15 (4.66%) Data Quality
2 11 (3.42%) GDPR
3 8 (2.48%) QA
4 6 (1.86%) ISO/IEC 27001
5 5 (1.55%) SLA
6 1 (0.31%) Dodd-Frank
6 1 (0.31%) EMIR
6 1 (0.31%) MiFID
System Software
1 57 (17.70%) Apache ZooKeeper
2 39 (12.11%) Apache Flume
3 37 (11.49%) Docker
4 5 (1.55%) Oracle RAC
5 3 (0.93%) Active Directory
6 2 (0.62%) etcd
6 2 (0.62%) flannel
7 1 (0.31%) Cronacle
Systems Management
1 116 (36.02%) Hadoop YARN
2 78 (24.22%) Oozie
3 75 (23.29%) Ansible
4 47 (14.60%) Puppet
5 41 (12.73%) Opscode Chef
6 33 (10.25%) Kubernetes
7 22 (6.83%) Ambari
8 16 (4.97%) Terraform
9 6 (1.86%) Single Sign-On
10 5 (1.55%) Kibana
11 4 (1.24%) Mesos
12 3 (0.93%) Apache Slider
13 2 (0.62%) Apache Brooklyn
13 2 (0.62%) Grafana
13 2 (0.62%) logstash
13 2 (0.62%) Marathon
13 2 (0.62%) rkt
13 2 (0.62%) Tivoli
14 1 (0.31%) Control-M
14 1 (0.31%) ZABBIX
Vendors
1 76 (23.60%) Cloudera
2 74 (22.98%) Oracle
3 43 (13.35%) Hortonworks
4 32 (9.94%) Tableau
5 22 (6.83%) Google
6 15 (4.66%) Talend
7 14 (4.35%) MapR
8 11 (3.42%) Informatica
9 9 (2.80%) Atlassian
10 8 (2.48%) Splunk
11 7 (2.17%) Cognos
11 7 (2.17%) SAP
11 7 (2.17%) Sybase
12 5 (1.55%) Alteryx
12 5 (1.55%) Cisco
12 5 (1.55%) IBM
12 5 (1.55%) RapidMiner
13 4 (1.24%) Databricks
14 3 (0.93%) Red Hat
14 3 (0.93%) Salesforce.com