Period
to 21 September 2019

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 21 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
England > South East
6 months to
21 Sep 2019
Same period 2018 Same period 2017
Rank 311 297 290
Rank change year-on-year -14 -7 +68
Contract jobs citing HDFS 46 78 80
As % of all contract IT jobs advertised in the South East 0.32% 0.47% 0.49%
As % of the System Software category 2.01% 3.20% 3.50%
Number of daily rates quoted 16 46 53
South East median daily rate £523 £500 £401
Median daily rate % change year-on-year +4.60% +24.84% -19.90%
10th Percentile £416 £413 £250
90th Percentile £631 £588 £588
England median daily rate £575 £525 £550
% change year-on-year +9.52% -4.55% -
Number of hourly rates quoted 0 2 2
South East median hourly rate - £22.25 £50.00
Median hourly rate % change year-on-year - -55.50% -
England median hourly rate - £22.00 £50.00
% change year-on-year - -56.00% -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for system software skills.

All System Software Skills
South East
Contract vacancies with a requirement for system software skills 2,291 2,438 2,285
As % of all contract IT jobs advertised in the South East 15.98% 14.74% 13.95%
Number of daily rates quoted 1,422 1,392 1,369
South East median daily rate £425 £425 £400
Median daily rate % change year-on-year - +6.25% +3.23%
10th Percentile £191 £195 £150
90th Percentile £600 £574 £538
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +3.03%
Number of hourly rates quoted 147 195 172
South East median hourly rate £17.00 £16.50 £17.49
Median hourly rate % change year-on-year +3.03% -5.66% +14.69%
10th Percentile £10.92 £10.50 £10.40
90th Percentile £51.20 £44.20 £43.68
England median hourly rate £16.50 £16.50 £16.50

HDFS
Job Vacancy Trend in the South East

Job postings citing HDFS as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for HDFS in the South East

HDFS
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in the South East.

Contractor daily rate trend for HDFS in the South East

HDFS
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing HDFS in the South East over the 6 months to 21 September 2019.

Contractor daily rate histogram for HDFS in the South East

HDFS
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the South East region over the 6 months to 21 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Hampshire -4 23 £575 +15.00% 3
Thames Valley +11 13 £413 -15.38% 2
Buckinghamshire +24 11 - - 2
Surrey +21 5 £575 +13.58% 1
West Sussex - 5 £515 -
Berkshire -12 2 £413 -28.26%
HDFS
England

For the 6 months to 21 September 2019, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for HDFS.

1 36 (78.26%) Hadoop
2 35 (76.09%) Big Data
3 33 (71.74%) Linux
4 32 (69.57%) HBase
5 26 (56.52%) Kafka
6 25 (54.35%) Apache Spark
7 18 (39.13%) Java
7 18 (39.13%) Unix
8 16 (34.78%) Apache Hive
8 16 (34.78%) Continuous Integration
9 15 (32.61%) Agile Software Development
10 12 (26.09%) NoSQL
10 12 (26.09%) Apache ZooKeeper
10 12 (26.09%) Docker
11 11 (23.91%) GitHub
11 11 (23.91%) Use Case
11 11 (23.91%) TDD
11 11 (23.91%) Apache
12 10 (21.74%) Benchmarking
12 10 (21.74%) Jenkins
12 10 (21.74%) MapReduce
12 10 (21.74%) Greenfield Project
13 9 (19.57%) Case Management
13 9 (19.57%) Elasticsearch
13 9 (19.57%) Hadoop YARN
13 9 (19.57%) RabbitMQ
13 9 (19.57%) Gradle
13 9 (19.57%) JSON
13 9 (19.57%) Git (software)
13 9 (19.57%) Security Cleared

HDFS
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 25 (54.35%) Apache Spark
2 11 (23.91%) Apache
3 9 (19.57%) Elasticsearch
4 5 (10.87%) Apache Pig
5 2 (4.35%) Apache Airflow
Cloud Services
1 11 (23.91%) GitHub
2 7 (15.22%) AWS
3 5 (10.87%) Amazon ECS
4 4 (8.70%) Amazon Glacier
5 3 (6.52%) Serverless
6 2 (4.35%) Amazon EC2
6 2 (4.35%) Amazon EMR
6 2 (4.35%) AWS Lambda
7 1 (2.17%) Azure
7 1 (2.17%) Azure Machine Learning
7 1 (2.17%) Data Lake Analytics
Communications & Networking
1 2 (4.35%) 2.5G
1 2 (4.35%) 2G
1 2 (4.35%) 3G
1 2 (4.35%) 4G
1 2 (4.35%) 5G
1 2 (4.35%) DSL
2 1 (2.17%) Kerberos
Database & Business Intelligence
1 36 (78.26%) Hadoop
2 35 (76.09%) Big Data
3 32 (69.57%) HBase
4 16 (34.78%) Apache Hive
5 12 (26.09%) NoSQL
6 8 (17.39%) Impala
6 8 (17.39%) Parquet
7 7 (15.22%) Sqoop
8 5 (10.87%) Apache Cassandra
8 5 (10.87%) Relational Database
9 3 (6.52%) BusinessObjects XI
9 3 (6.52%) Cloudera CDH
9 3 (6.52%) PostgreSQL
10 2 (4.35%) Data Lake
10 2 (4.35%) Data Warehouse
10 2 (4.35%) MariaDB
11 1 (2.17%) Azure SQL Data Warehouse
11 1 (2.17%) Azure SQL Database
11 1 (2.17%) Data Mart
11 1 (2.17%) RDBMS
Development Applications
1 10 (21.74%) Jenkins
2 9 (19.57%) Git (software)
2 9 (19.57%) Gradle
3 2 (4.35%) Cucumber
4 1 (2.17%) Jasmine
4 1 (2.17%) JBehave
4 1 (2.17%) Protractor
4 1 (2.17%) Selenium
4 1 (2.17%) Sonatype Nexus
General
1 8 (17.39%) Finance
2 3 (6.52%) Banking
3 2 (4.35%) Telecoms
Job Titles
1 20 (43.48%) Developer
2 12 (26.09%) Java Developer
3 8 (17.39%) Architect
4 7 (15.22%) Big Data Developer
5 6 (13.04%) Systems Architect
6 5 (10.87%) Hadoop Developer
7 4 (8.70%) Big Data Engineer
7 4 (8.70%) Data Engineer
7 4 (8.70%) Java Hadoop Developer
8 3 (6.52%) Administrator
8 3 (6.52%) Cloud Engineer
8 3 (6.52%) Data Administrator
8 3 (6.52%) Database Developer
8 3 (6.52%) Database Manager
9 2 (4.35%) Apache Spark Developer
9 2 (4.35%) AWS Developer
9 2 (4.35%) Business Intelligence Developer
9 2 (4.35%) Consultant
9 2 (4.35%) MicroStrategy Developer
10 1 (2.17%) Senior MicroStrategy Consultant
Libraries, Frameworks & Software Standards
1 26 (56.52%) Kafka
2 9 (19.57%) JSON
2 9 (19.57%) RabbitMQ
3 8 (17.39%) Apache Avro
3 8 (17.39%) Middleware
3 8 (17.39%) Spring
4 7 (15.22%) Elastic Stack
4 7 (15.22%) REST
5 5 (10.87%) XML
6 4 (8.70%) J2EE
7 3 (6.52%) Apache NiFi
8 2 (4.35%) RESTful
Miscellaneous
1 10 (21.74%) Greenfield Project
2 7 (15.22%) Linux Command Line
2 7 (15.22%) Virtual Team
3 5 (10.87%) Cloud Native
3 5 (10.87%) PKI
4 2 (4.35%) Data Structures
4 2 (4.35%) Enterprise Software
5 1 (2.17%) Reference Data
Operating Systems
1 33 (71.74%) Linux
2 18 (39.13%) Unix
3 8 (17.39%) Red Hat Enterprise Linux
4 6 (13.04%) Ubuntu
Processes & Methodologies
1 16 (34.78%) Continuous Integration
2 15 (32.61%) Agile Software Development
3 11 (23.91%) TDD
3 11 (23.91%) Use Case
4 10 (21.74%) Benchmarking
4 10 (21.74%) MapReduce
5 9 (19.57%) Case Management
6 8 (17.39%) BDD
6 8 (17.39%) Data Analysis
6 8 (17.39%) Data Transformation
6 8 (17.39%) DevOps
7 7 (15.22%) Analytics
7 7 (15.22%) Data Ingestion
7 7 (15.22%) Stakeholder Management
8 6 (13.04%) Big Data Analytics
8 6 (13.04%) Continuous Delivery
8 6 (13.04%) Data Analytics
8 6 (13.04%) Enterprise Architecture
8 6 (13.04%) SDLC
8 6 (13.04%) Security Architecture
Programming Languages
1 18 (39.13%) Java
2 9 (19.57%) SQL
3 7 (15.22%) Shell Script
4 4 (8.70%) Java 8
5 2 (4.35%) Groovy
6 1 (2.17%) Bash Shell
6 1 (2.17%) Korn
6 1 (2.17%) Python
Qualifications
1 9 (19.57%) Security Cleared
2 7 (15.22%) Degree
3 4 (8.70%) SC Cleared
4 2 (4.35%) AWS Certification
5 1 (2.17%) BPSS Clearance
5 1 (2.17%) CISSP
5 1 (2.17%) ISTQB
5 1 (2.17%) MCSE
5 1 (2.17%) Microsoft Certification
Quality Assurance & Compliance
1 2 (4.35%) Data Quality
2 1 (2.17%) Disclosure Scotland
2 1 (2.17%) QA
System Software
1 12 (26.09%) Apache ZooKeeper
1 12 (26.09%) Docker
2 5 (10.87%) Active Directory
2 5 (10.87%) Apache Flume
2 5 (10.87%) vSphere
Systems Management
1 9 (19.57%) Hadoop YARN
2 8 (17.39%) Ansible
3 7 (15.22%) Kubernetes
3 7 (15.22%) Oozie
3 7 (15.22%) Puppet
3 7 (15.22%) Terraform
4 5 (10.87%) logstash
4 5 (10.87%) vCenter Server
5 3 (6.52%) Opscode Chef
6 2 (4.35%) Kibana
Vendors
1 7 (15.22%) Hortonworks
2 5 (10.87%) Red Hat
3 3 (6.52%) MicroStrategy
4 2 (4.35%) Microsoft
4 2 (4.35%) Tableau
5 1 (2.17%) Cloudera
5 1 (2.17%) Databricks
5 1 (2.17%) Informatica