Period
to 19 October 2018

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 19 October 2018 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > South East
6 months to
19 Oct 2018
Same period 2017 Same period 2016
Rank 481 501 555
Rank change year-on-year +20 +54 +66
Permanent jobs citing HDFS 56 35 41
As % of all permanent IT jobs advertised in the South East 0.19% 0.12% 0.12%
As % of the System Software category 1.32% 0.88% 0.82%
Number of salaries quoted 38 32 38
South East median annual salary £57,500 £57,500 £52,750
Median salary % change year-on-year - +9.00% -12.08%
10th Percentile £27,500 £32,000 £42,050
90th Percentile £75,000 £67,500 £70,000
England median annual salary £70,000 £70,000 £80,000
% change year-on-year - -12.50% +14.29%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for system software skills.

All System Software Skills
South East
Permanent vacancies with a requirement for system software skills 4,240 3,966 4,994
As % of all permanent IT jobs advertised in the South East 14.50% 13.71% 14.09%
Number of salaries quoted 3,438 3,430 4,264
South East median annual salary £42,500 £40,000 £40,000
Median salary % change year-on-year +6.25% - -
10th Percentile £23,000 £22,000 £23,000
90th Percentile £67,500 £67,500 £62,500
England median annual salary £50,000 £45,000 £42,500
% change year-on-year +11.11% +5.88% +6.25%

HDFS
Job Vacancy Trend in the South East

Job postings citing HDFS as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for HDFS in the South East

HDFS
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in the South East.

Salary trend for HDFS in the South East

HDFS
Salary Histogram in the South East

The salary distribution of IT jobs citing HDFS in the South East over the 6 months to 19 October 2018.

Salary histogram for HDFS in the South East

HDFS
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the South East region over the 6 months to 19 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +16 34 £57,500 - 1
Berkshire -1 32 £57,500 - 1
Surrey +28 8 £60,000 +11.63% 1
West Sussex - 6 £30,000 -
East Sussex - 6 - - 1
Buckinghamshire +16 2 £61,250 +16.67%
Hampshire -20 2 £52,500 -4.55%
HDFS
England

For the 6 months to 19 October 2018, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for HDFS.

1 51 (91.07%) Hadoop
2 39 (69.64%) Linux
3 36 (64.29%) HBase
4 35 (62.50%) Apache Spark
5 33 (58.93%) Apache Hive
6 31 (55.36%) Java
7 29 (51.79%) Big Data
8 28 (50.00%) Degree
9 26 (46.43%) Apache Flume
10 24 (42.86%) Agile Software Development
11 23 (41.07%) Windows
11 23 (41.07%) Kafka
12 22 (39.29%) Continuous Integration
13 21 (37.50%) Amazon AWS
13 21 (37.50%) SQL
14 20 (35.71%) Data Analysis
14 20 (35.71%) Impala
15 19 (33.93%) Jenkins
15 19 (33.93%) Scala
16 18 (32.14%) Git (software)
16 18 (32.14%) Python
16 18 (32.14%) Shell Script
16 18 (32.14%) DevOps
17 17 (30.36%) Kibana
17 17 (30.36%) Analytical Skills
17 17 (30.36%) Elasticsearch
17 17 (30.36%) Virtual Machines
17 17 (30.36%) Configuration Management
17 17 (30.36%) Visualisation
17 17 (30.36%) Computer Science

HDFS
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 35 (62.50%) Apache Spark
2 17 (30.36%) Elasticsearch
3 9 (16.07%) Apache
4 8 (14.29%) Cloud Foundry
5 6 (10.71%) Apache Pig
5 6 (10.71%) JBoss
6 2 (3.57%) GemFire
6 2 (3.57%) Tomcat
Cloud Services
1 21 (37.50%) Amazon AWS
2 12 (21.43%) GitHub
2 12 (21.43%) Microsoft Azure
3 5 (8.93%) Azure Data Factory
4 4 (7.14%) Amazon EC2
4 4 (7.14%) Amazon EMR
4 4 (7.14%) Cloud Computing
5 2 (3.57%) PaaS
Communications & Networking
1 5 (8.93%) Internet
2 4 (7.14%) HTTP
Database & Business Intelligence
1 51 (91.07%) Hadoop
2 36 (64.29%) HBase
3 33 (58.93%) Apache Hive
4 29 (51.79%) Big Data
5 20 (35.71%) Impala
6 13 (23.21%) Sqoop
7 12 (21.43%) Data Lake
7 12 (21.43%) SQL Server
8 10 (17.86%) Data Warehouse
9 9 (16.07%) SQL Server Analysis Services
9 9 (16.07%) SQL Server Integration Services
10 8 (14.29%) RDBMS
10 8 (14.29%) Relational Database
11 6 (10.71%) MySQL
11 6 (10.71%) Parquet
12 5 (8.93%) Azure SQL Data Warehouse
12 5 (8.93%) HDInsight
12 5 (8.93%) Power BI
12 5 (8.93%) SQL Server 2014
12 5 (8.93%) SQL Server Reporting Services
Development Applications
1 19 (33.93%) Jenkins
2 18 (32.14%) Git (software)
3 8 (14.29%) Gradle
3 8 (14.29%) JUnit
4 6 (10.71%) Eclipse
4 6 (10.71%) TeamCity
5 4 (7.14%) JIRA
5 4 (7.14%) Subversion
5 4 (7.14%) Team Foundation Server
6 1 (1.79%) git-flow
General
1 7 (12.50%) Retail
2 6 (10.71%) Marketing
3 5 (8.93%) Advertising
4 3 (5.36%) Finance
5 1 (1.79%) Banking
5 1 (1.79%) Investment Banking
Job Titles
1 18 (32.14%) Developer
2 15 (26.79%) Big Data Engineer
2 15 (26.79%) Hadoop Engineer
3 13 (23.21%) Java Developer
4 11 (19.64%) Senior Developer
5 10 (17.86%) Data Engineer
6 8 (14.29%) Cybersecurity Engineer
6 8 (14.29%) DevOps Engineer
6 8 (14.29%) Security Engineer
7 6 (10.71%) Data Scientist
7 6 (10.71%) Senior Java Developer
8 5 (8.93%) Consultant
8 5 (8.93%) Linux Engineer
8 5 (8.93%) Linux Systems Engineer
8 5 (8.93%) Systems Engineer
9 4 (7.14%) Big Data Developer
9 4 (7.14%) Business Consultant
9 4 (7.14%) Business Intelligence Consultant
9 4 (7.14%) Senior Big Data Developer
10 3 (5.36%) Java Engineer
Libraries, Frameworks & Software Standards
1 23 (41.07%) Kafka
2 16 (28.57%) JSON
3 10 (17.86%) Spring
4 9 (16.07%) REST
5 8 (14.29%) Middleware
6 7 (12.50%) CSS
6 7 (12.50%) HTML
6 7 (12.50%) Web Services
7 6 (10.71%) Apache Avro
7 6 (10.71%) Drools
7 6 (10.71%) Keras
7 6 (10.71%) MLlib
7 6 (10.71%) Node.js
7 6 (10.71%) RabbitMQ
7 6 (10.71%) Spark Streaming
7 6 (10.71%) TensorFlow
8 5 (8.93%) J2EE
9 4 (7.14%) HTML5
9 4 (7.14%) RESTful
9 4 (7.14%) XML
Miscellaneous
1 17 (30.36%) Analytical Skills
1 17 (30.36%) Computer Science
2 8 (14.29%) Linux Command Line
3 7 (12.50%) Greenfield Project
4 6 (10.71%) Algorithms
4 6 (10.71%) Data Structures
5 5 (8.93%) Driving Licence
5 5 (8.93%) Virtual Team
6 2 (3.57%) Replication
Operating Systems
1 39 (69.64%) Linux
2 23 (41.07%) Windows
3 13 (23.21%) Unix
4 2 (3.57%) Red Hat Enterprise Linux
Processes & Methodologies
1 24 (42.86%) Agile Software Development
2 22 (39.29%) Continuous Integration
3 20 (35.71%) Data Analysis
4 18 (32.14%) DevOps
5 17 (30.36%) Configuration Management
5 17 (30.36%) Visualisation
6 16 (28.57%) Data Science
7 14 (25.00%) Change Management
7 14 (25.00%) MapReduce
8 13 (23.21%) Cybersecurity
8 13 (23.21%) Integration Testing
8 13 (23.21%) Low Latency
8 13 (23.21%) Release Management
8 13 (23.21%) Scrum
9 12 (21.43%) Analytics
9 12 (21.43%) Business Intelligence
9 12 (21.43%) Data Analytics
9 12 (21.43%) Machine Learning
10 11 (19.64%) Problem-Solving
10 11 (19.64%) Use Case
Programming Languages
1 31 (55.36%) Java
2 21 (37.50%) SQL
3 19 (33.93%) Scala
4 18 (32.14%) Python
4 18 (32.14%) Shell Script
5 13 (23.21%) C
5 13 (23.21%) R
6 7 (12.50%) JavaScript
7 6 (10.71%) Go
7 6 (10.71%) HiveQL
8 1 (1.79%) C#
Qualifications
1 28 (50.00%) Degree
2 15 (26.79%) Security Cleared
3 13 (23.21%) DV Cleared
4 4 (7.14%) Computer Science Degree
5 2 (3.57%) MCSA
5 2 (3.57%) MCSE
5 2 (3.57%) Microsoft Certification
5 2 (3.57%) SC Cleared
Quality Assurance & Compliance
1 12 (21.43%) QA
2 5 (8.93%) Data Quality
System Software
1 26 (46.43%) Apache Flume
2 17 (30.36%) Virtual Machines
3 9 (16.07%) Apache ZooKeeper
Systems Management
1 17 (30.36%) Kibana
2 16 (28.57%) Hadoop YARN
3 13 (23.21%) Puppet
4 4 (7.14%) Kubernetes
4 4 (7.14%) Oozie
4 4 (7.14%) Rundeck
Vendors
1 13 (23.21%) Atlassian
2 11 (19.64%) Cloudera
2 11 (19.64%) Hortonworks
3 9 (16.07%) Microsoft
4 4 (7.14%) Oracle
4 4 (7.14%) Tableau
4 4 (7.14%) Talend
5 2 (3.57%) Red Hat
6 1 (1.79%) MapR
6 1 (1.79%) MicroStrategy