Period
to 4 June 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 4 June 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
4 Jun 2020
Same period 2019 Same period 2018
Rank 494 563 530
Rank change year-on-year +69 -33 +48
Contract jobs citing HDFS 89 257 337
As % of all contract jobs advertised in England 0.22% 0.31% 0.37%
As % of the System Software category 1.42% 2.00% 2.71%
Number of daily rates quoted 56 159 222
Median daily rate £600 £600 £553
Median daily rate % change year-on-year - +8.60% +5.24%
10th Percentile £405 £475 £450
90th Percentile £688 £700 £673
UK median daily rate £575 £575 £550
% change year-on-year - +4.55% +4.76%
Number of hourly rates quoted 8 0 3
Median hourly rate £35.00 - £22.00
UK median hourly rate £35.00 - £22.00

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Contract vacancies with a requirement for system software skills 6,266 12,873 12,451
As % of all contract IT jobs advertised in England 15.60% 15.67% 13.58%
Number of daily rates quoted 4,052 8,650 8,101
Median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £185 £190 £185
90th Percentile £644 £638 £625
UK median daily rate £470 £475 £450
% change year-on-year -1.05% +5.56% +7.14%
Number of hourly rates quoted 331 522 722
Median hourly rate £18.70 £17.00 £16.29
Median hourly rate % change year-on-year +10.00% +4.37% +1.80%
10th Percentile £11.30 £11.00 £11.00
90th Percentile £44.51 £47.82 £45.87
Median hourly rate £19.00 £16.74 £15.86
% change year-on-year +13.48% +5.56% -0.88%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a proportion of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing HDFS in England.

Daily rate trend for HDFS in England

HDFS
Daily Rate Histogram in England

Daily rate distribution for jobs citing HDFS in England over the 6 months to 4 June 2020.

Daily rate histogram for HDFS in England

HDFS
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing HDFS in England.

Hourly rate trend for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 6 months to 4 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +62 41 £600 -
South East +94 25 £550 +3.53% 2
South West +64 15 £528 -5.80%
Midlands +81 3 £360 -20.00% 2
North of England +75 3 £650 +13.04% 1
West Midlands - 3 £360 - 2
North West +51 2 £650 - 1
Yorkshire +65 1 - -
East of England +60 1 - - 1
HDFS
UK

For the 6 months to 4 June 2020, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for HDFS.

1 79 (88.76%) Hadoop
2 73 (82.02%) Apache Spark
3 61 (68.54%) Big Data
4 58 (65.17%) Apache Hive
5 53 (59.55%) HBase
6 43 (48.31%) Kafka
6 43 (48.31%) SQL
7 42 (47.19%) Java
8 39 (43.82%) Agile Software Development
9 37 (41.57%) Python
9 37 (41.57%) Analytics
10 33 (37.08%) Scala
11 32 (35.96%) Cloudera
12 29 (32.58%) Hadoop YARN
12 29 (32.58%) ETL
13 26 (29.21%) Finance
14 25 (28.09%) NoSQL
15 24 (26.97%) DevOps
15 24 (26.97%) Impala
16 22 (24.72%) Jenkins
17 21 (23.60%) Scrum
17 21 (23.60%) Use Case
17 21 (23.60%) Apache
18 20 (22.47%) Business Intelligence
18 20 (22.47%) Sqoop
18 20 (22.47%) AWS
19 19 (21.35%) Git (software)
19 19 (21.35%) Continuous Integration
19 19 (21.35%) MongoDB
19 19 (21.35%) Hortonworks

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 73 (82.02%) Apache Spark
2 21 (23.60%) Apache
3 9 (10.11%) WebLogic
4 6 (6.74%) Tomcat
5 5 (5.62%) Apache Pig
6 4 (4.49%) Apache Airflow
6 4 (4.49%) Confluence
6 4 (4.49%) Jupyter
6 4 (4.49%) SAS
7 3 (3.37%) Apache Pulsar
7 3 (3.37%) Oracle Workflow
8 2 (2.25%) Elasticsearch
9 1 (1.12%) Apache Solr
9 1 (1.12%) Luigi
9 1 (1.12%) SharePoint
Applications
1 3 (3.37%) Microsoft Excel
2 1 (1.12%) Chatbot
2 1 (1.12%) MS Visio
Business Applications
1 6 (6.74%) Oracle Applications
2 3 (3.37%) SAP FI-CA
2 3 (3.37%) SAP PSCD
Cloud Services
1 20 (22.47%) AWS
2 11 (12.36%) Azure
3 8 (8.99%) GCP
4 6 (6.74%) Amazon Kinesis
5 4 (4.49%) IaaS
5 4 (4.49%) PaaS
5 4 (4.49%) Serverless
6 3 (3.37%) Amazon EC2
6 3 (3.37%) Amazon S3
6 3 (3.37%) Azure Data Factory
6 3 (3.37%) Virtual Private Cloud
7 2 (2.25%) Amazon CloudWatch
7 2 (2.25%) AWS CloudTrail
7 2 (2.25%) AWS Lambda
8 1 (1.12%) Amazon SQS
8 1 (1.12%) AWS CloudFormation
8 1 (1.12%) Cloud Computing
8 1 (1.12%) GitHub
Communications & Networking
1 11 (12.36%) Kerberos
2 6 (6.74%) VPN
3 5 (5.62%) SSL
4 4 (4.49%) HTTP
4 4 (4.49%) HTTPS
5 3 (3.37%) Firewall
6 2 (2.25%) TCP/IP
Database & Business Intelligence
1 79 (88.76%) Hadoop
2 61 (68.54%) Big Data
3 58 (65.17%) Apache Hive
4 53 (59.55%) HBase
5 25 (28.09%) NoSQL
6 24 (26.97%) Impala
7 20 (22.47%) Sqoop
8 19 (21.35%) MongoDB
9 17 (19.10%) Apache Cassandra
10 12 (13.48%) Data Warehouse
11 11 (12.36%) Relational Database
12 6 (6.74%) Oracle Database
13 4 (4.49%) SQL Server
14 3 (3.37%) Amazon Aurora
14 3 (3.37%) Amazon RDS
14 3 (3.37%) DB2
14 3 (3.37%) MemSQL
14 3 (3.37%) Presto
14 3 (3.37%) Spark SQL
15 2 (2.25%) Apache Kudu
Development Applications
1 22 (24.72%) Jenkins
2 19 (21.35%) Git (software)
3 11 (12.36%) IBM UrbanCode
3 11 (12.36%) Maven
3 11 (12.36%) Sonatype Nexus
4 7 (7.87%) Cucumber
4 7 (7.87%) JIRA
5 5 (5.62%) Selenium
6 4 (4.49%) Artifactory
6 4 (4.49%) GitLab
7 3 (3.37%) Postman
7 3 (3.37%) SoapUI
7 3 (3.37%) Toad
7 3 (3.37%) Travis CI
8 2 (2.25%) Atlassian Bamboo
8 2 (2.25%) Oracle APEX
8 2 (2.25%) TeamCity
9 1 (1.12%) Bitbucket
9 1 (1.12%) JBehave
9 1 (1.12%) JUnit
General
1 26 (29.21%) Finance
2 13 (14.61%) Banking
3 4 (4.49%) Public Sector
4 3 (3.37%) Retail Banking
5 2 (2.25%) Investment Banking
5 2 (2.25%) Legal
6 1 (1.12%) Front Office
6 1 (1.12%) Games
6 1 (1.12%) Manufacturing
6 1 (1.12%) Pharmaceutical
6 1 (1.12%) Retail
Job Titles
1 40 (44.94%) Data Engineer
2 25 (28.09%) Big Data Engineer
3 18 (20.22%) Developer
4 13 (14.61%) Architect
5 10 (11.24%) Big Data Architect
5 10 (11.24%) Data Architect
6 9 (10.11%) DevOps Engineer
6 9 (10.11%) Hadoop Architect
7 7 (7.87%) Hadoop Developer
7 7 (7.87%) Hadoop Engineer
8 6 (6.74%) Analyst
8 6 (6.74%) Big Data Developer
9 5 (5.62%) Cloud Engineer
9 5 (5.62%) Java Engineer
9 5 (5.62%) Scala Developer
10 4 (4.49%) Cloud Architect
10 4 (4.49%) Infrastructure Architect
10 4 (4.49%) Java Developer
10 4 (4.49%) Oracle Developer
10 4 (4.49%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 43 (48.31%) Kafka
2 16 (17.98%) Spark Streaming
3 13 (14.61%) PySpark
4 11 (12.36%) OAuth
5 7 (7.87%) HTML
5 7 (7.87%) LDAP
6 6 (6.74%) SAML
6 6 (6.74%) XSLT
7 5 (5.62%) ADO
7 5 (5.62%) Elastic Stack
7 5 (5.62%) OAuth2
7 5 (5.62%) RESTful
8 4 (4.49%) Apache NiFi
8 4 (4.49%) RabbitMQ
8 4 (4.49%) Spring
8 4 (4.49%) XML
9 3 (3.37%) JSON
9 3 (3.37%) Spring Boot
10 2 (2.25%) pytest
10 2 (2.25%) React
Miscellaneous
1 12 (13.48%) Analytical Skills
2 8 (8.99%) Management Information System
3 5 (5.62%) Data Centre
4 4 (4.49%) Enterprise Software
4 4 (4.49%) PMI
4 4 (4.49%) Reference Data
5 3 (3.37%) Algorithms
5 3 (3.37%) Data Structures
5 3 (3.37%) Derivative
5 3 (3.37%) Linux Command Line
5 3 (3.37%) User Experience
6 2 (2.25%) Credit Risk
6 2 (2.25%) Market Risk
7 1 (1.12%) Analytical Mindset
7 1 (1.12%) Greenfield Project
7 1 (1.12%) Self-Motivation
7 1 (1.12%) Wiki
Operating Systems
1 18 (20.22%) Linux
2 12 (13.48%) Unix
3 3 (3.37%) Windows
4 2 (2.25%) Oracle Linux
5 1 (1.12%) DC/OS
Processes & Methodologies
1 39 (43.82%) Agile Software Development
2 37 (41.57%) Analytics
3 29 (32.58%) ETL
4 24 (26.97%) DevOps
5 21 (23.60%) Scrum
5 21 (23.60%) Use Case
6 20 (22.47%) Business Intelligence
7 19 (21.35%) Continuous Integration
7 19 (21.35%) Data Modelling
7 19 (21.35%) TDD
8 17 (19.10%) BDD
8 17 (19.10%) Software Engineering
9 16 (17.98%) Computer Science
9 16 (17.98%) Microservices
10 14 (15.73%) Functional Programming
10 14 (15.73%) MapReduce
11 13 (14.61%) Data Engineering
11 13 (14.61%) User Stories
12 12 (13.48%) Data Management
13 11 (12.36%) Migration
Programming Languages
1 43 (48.31%) SQL
2 42 (47.19%) Java
3 37 (41.57%) Python
4 33 (37.08%) Scala
5 10 (11.24%) Ruby
6 8 (8.99%) Bash Shell
6 8 (8.99%) JavaScript
7 7 (7.87%) C
7 7 (7.87%) PL/SQL
8 6 (6.74%) Shell Script
9 5 (5.62%) Go
9 5 (5.62%) R
10 1 (1.12%) Java 8
10 1 (1.12%) PowerShell
Qualifications
1 13 (14.61%) Security Cleared
2 12 (13.48%) Computer Science Degree
2 12 (13.48%) SC Cleared
3 11 (12.36%) Degree
4 4 (4.49%) PMI Certification
5 3 (3.37%) ISEB
5 3 (3.37%) ISTQB
5 3 (3.37%) ISTQB Foundation Certification
6 1 (1.12%) Numerate Degree
Quality Assurance & Compliance
1 3 (3.37%) Data Quality
2 2 (2.25%) SLA
3 1 (1.12%) ISO/IEC 27001
System Software
1 11 (12.36%) Apache Flume
2 5 (5.62%) Docker
3 4 (4.49%) Apache ZooKeeper
Systems Management
1 29 (32.58%) Hadoop YARN
2 17 (19.10%) Oozie
3 7 (7.87%) Ambari
4 6 (6.74%) Single Sign-On
5 5 (5.62%) Ansible
5 5 (5.62%) Kubernetes
5 5 (5.62%) Puppet
5 5 (5.62%) Terraform
6 2 (2.25%) Kibana
7 1 (1.12%) Apache Brooklyn
7 1 (1.12%) Docker Swarm
7 1 (1.12%) Marathon
7 1 (1.12%) Mesos
7 1 (1.12%) Opscode Chef
Vendors
1 32 (35.96%) Cloudera
2 19 (21.35%) Hortonworks
3 14 (15.73%) Oracle
4 7 (7.87%) MapR
5 6 (6.74%) Ab Initio
5 6 (6.74%) Google
6 4 (4.49%) Splunk
6 4 (4.49%) StreamSets
7 3 (3.37%) Databricks
7 3 (3.37%) Microsoft
7 3 (3.37%) SAP
7 3 (3.37%) Sybase
7 3 (3.37%) webMethods
8 2 (2.25%) New Relic
8 2 (2.25%) Talend
9 1 (1.12%) Confluent
9 1 (1.12%) Foundry
9 1 (1.12%) Palantir