Period
to 20 August 2018

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 20 August 2018 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > South East
6 months to
20 Aug 2018
Same period 2017 Same period 2016
Rank 461 524 558
Rank change year-on-year +63 +34 +80
Permanent jobs citing HDFS 81 24 57
As % of all permanent IT jobs advertised in the South East 0.27% 0.082% 0.15%
As % of the System Software category 1.86% 0.59% 1.10%
Number of salaries quoted 62 20 49
South East median annual salary £60,000 £55,000 £51,500
Median salary % change year-on-year +9.09% +6.80% -1.90%
10th Percentile £27,500 £45,000 £35,750
90th Percentile £78,750 £67,500 £65,750
England median annual salary £70,000 £70,000 £75,000
% change year-on-year - -6.67% +7.14%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for system software skills.

All System Software Skills
South East
Permanent vacancies with a requirement for system software skills 4,346 4,047 5,186
As % of all permanent IT jobs advertised in the South East 14.67% 13.91% 14.05%
Number of salaries quoted 3,477 3,488 4,468
South East median annual salary £43,000 £40,000 £40,000
Median salary % change year-on-year +7.50% - -
10th Percentile £22,750 £22,250 £22,500
90th Percentile £67,500 £65,400 £61,250
England median annual salary £50,000 £45,000 £42,500
% change year-on-year +11.11% +5.88% +6.25%

HDFS
Job Vacancy Trend in the South East

Job postings citing HDFS as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for HDFS in the South East

HDFS
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in the South East.

Salary trend for HDFS in the South East

HDFS
Salary Histogram in the South East

The salary distribution of IT jobs citing HDFS in the South East over the 6 months to 20 August 2018.

Salary histogram for HDFS in the South East

HDFS
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the South East region over the 6 months to 20 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +50 46 £65,000 +8.33% 2
Berkshire +29 38 £63,750 +2.00% 1
West Sussex - 13 £30,000 -
East Sussex - 12 £77,500 -
Surrey +18 7 £65,000 +30.00% 2
Buckinghamshire +13 7 £70,000 +33.33% 1
Hampshire -14 3 £50,000 -9.09% 2
Oxfordshire - 1 £42,500 -
HDFS
England

For the 6 months to 20 August 2018, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for HDFS.

1 68 (83.95%) Hadoop
2 44 (54.32%) Linux
3 43 (53.09%) Java
4 41 (50.62%) Apache Hive
5 37 (45.68%) HBase
6 35 (43.21%) Apache Spark
7 34 (41.98%) Big Data
8 33 (40.74%) Python
9 32 (39.51%) Continuous Integration
10 30 (37.04%) Agile Software Development
10 30 (37.04%) Machine Learning
11 29 (35.80%) Apache Flume
11 29 (35.80%) Scala
12 28 (34.57%) SQL
12 28 (34.57%) Data Science
13 27 (33.33%) Data Analysis
14 26 (32.10%) Amazon AWS
14 26 (32.10%) Impala
15 25 (30.86%) R
15 25 (30.86%) Degree
16 24 (29.63%) Windows
17 21 (25.93%) Kafka
18 20 (24.69%) Jenkins
19 19 (23.46%) Hadoop YARN
20 18 (22.22%) Change Management
20 18 (22.22%) Retail
20 18 (22.22%) Node.js
20 18 (22.22%) MapReduce
20 18 (22.22%) DevOps
20 18 (22.22%) Problem-Solving

HDFS
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 35 (43.21%) Apache Spark
2 13 (16.05%) Elasticsearch
3 4 (4.94%) Apache
3 4 (4.94%) Apache Pig
4 3 (3.70%) Cloud Foundry
5 2 (2.47%) JBoss
6 1 (1.23%) GemFire
6 1 (1.23%) SAS
6 1 (1.23%) Tomcat
Cloud Services
1 26 (32.10%) Amazon AWS
2 13 (16.05%) Microsoft Azure
3 10 (12.35%) Azure Data Factory
4 4 (4.94%) Google Cloud Platform
5 3 (3.70%) GitHub
5 3 (3.70%) OpenShift
6 1 (1.23%) PaaS
Communications & Networking
1 13 (16.05%) Internet
Database & Business Intelligence
1 68 (83.95%) Hadoop
2 41 (50.62%) Apache Hive
3 37 (45.68%) HBase
4 34 (41.98%) Big Data
5 26 (32.10%) Impala
6 15 (18.52%) Sqoop
7 13 (16.05%) Data Lake
7 13 (16.05%) Data Warehouse
8 10 (12.35%) Azure SQL Data Warehouse
8 10 (12.35%) Azure SQL Database
8 10 (12.35%) HDInsight
8 10 (12.35%) Power BI
8 10 (12.35%) SQL Server
8 10 (12.35%) SQL Server Integration Services
9 6 (7.41%) SQL Server 2014
9 6 (7.41%) SQL Server Analysis Services
9 6 (7.41%) SQL Server Reporting Services
10 5 (6.17%) Relational Database
11 4 (4.94%) NoSQL
11 4 (4.94%) SQL Server 2012
Development Applications
1 20 (24.69%) Jenkins
2 15 (18.52%) Git (software)
3 12 (14.81%) JUnit
3 12 (14.81%) TeamCity
4 5 (6.17%) git-flow
5 3 (3.70%) Gradle
6 1 (1.23%) Eclipse
General
1 18 (22.22%) Retail
2 12 (14.81%) Marketing
3 10 (12.35%) Advertising
4 5 (6.17%) Banking
4 5 (6.17%) Investment Banking
5 2 (2.47%) Finance
Job Titles
1 22 (27.16%) Big Data Engineer
1 22 (27.16%) Data Engineer
1 22 (27.16%) Hadoop Engineer
2 19 (23.46%) Developer
3 17 (20.99%) Java Developer
4 13 (16.05%) Data Scientist
5 12 (14.81%) Senior Developer
6 11 (13.58%) Java Engineer
7 10 (12.35%) Consultant
7 10 (12.35%) Senior Java Developer
8 8 (9.88%) Cybersecurity Engineer
8 8 (9.88%) DevOps Engineer
8 8 (9.88%) Security Engineer
9 6 (7.41%) Data Consultant
10 5 (6.17%) Business Intelligence Consultant
10 5 (6.17%) Lead Developer
10 5 (6.17%) Lead Java Developer
10 5 (6.17%) Linux Engineer
10 5 (6.17%) Linux Systems Engineer
10 5 (6.17%) Systems Engineer
Libraries, Frameworks & Software Standards
1 21 (25.93%) Kafka
2 18 (22.22%) Node.js
3 15 (18.52%) JSON
4 12 (14.81%) TensorFlow
5 11 (13.58%) Keras
5 11 (13.58%) MLlib
6 10 (12.35%) REST
7 9 (11.11%) Spring
8 8 (9.88%) CSS
8 8 (9.88%) HTML
9 7 (8.64%) Web Services
10 6 (7.41%) Spring Boot
11 4 (4.94%) J2EE
12 3 (3.70%) Middleware
12 3 (3.70%) RESTful
13 2 (2.47%) Akka
13 2 (2.47%) Apache Avro
13 2 (2.47%) Drools
13 2 (2.47%) RabbitMQ
14 1 (1.23%) Spark Streaming
Miscellaneous
1 14 (17.28%) Computer Science
2 13 (16.05%) Algorithms
2 13 (16.05%) Analytical Skills
2 13 (16.05%) Data Structures
2 13 (16.05%) Greenfield Project
3 5 (6.17%) Driving Licence
4 3 (3.70%) Linux Command Line
4 3 (3.70%) Virtual Team
5 1 (1.23%) Replication
Operating Systems
1 44 (54.32%) Linux
2 24 (29.63%) Windows
3 4 (4.94%) Unix
4 1 (1.23%) Red Hat Enterprise Linux
Processes & Methodologies
1 32 (39.51%) Continuous Integration
2 30 (37.04%) Agile Software Development
2 30 (37.04%) Machine Learning
3 28 (34.57%) Data Science
4 27 (33.33%) Data Analysis
5 18 (22.22%) Change Management
5 18 (22.22%) DevOps
5 18 (22.22%) MapReduce
5 18 (22.22%) Problem-Solving
6 17 (20.99%) Visualisation
7 16 (19.75%) Cybersecurity
8 15 (18.52%) Analytics
9 13 (16.05%) Business Intelligence
9 13 (16.05%) Configuration Management
9 13 (16.05%) Critical Thinking
9 13 (16.05%) Data Analytics
9 13 (16.05%) Low Latency
9 13 (16.05%) OO
9 13 (16.05%) Predictive Modelling
9 13 (16.05%) Release Management
Programming Languages
1 43 (53.09%) Java
2 33 (40.74%) Python
3 29 (35.80%) Scala
4 28 (34.57%) SQL
5 25 (30.86%) R
6 15 (18.52%) Shell Script
7 13 (16.05%) C
7 13 (16.05%) HiveQL
8 12 (14.81%) Go
9 8 (9.88%) JavaScript
10 1 (1.23%) C#
Qualifications
1 25 (30.86%) Degree
2 15 (18.52%) Security Cleared
3 13 (16.05%) DV Cleared
4 2 (2.47%) MCSA
4 2 (2.47%) MCSE
4 2 (2.47%) Microsoft Certification
4 2 (2.47%) SC Cleared
Quality Assurance & Compliance
1 5 (6.17%) Data Quality
2 3 (3.70%) QA
System Software
1 29 (35.80%) Apache Flume
2 13 (16.05%) Virtual Machines
3 4 (4.94%) Apache ZooKeeper
3 4 (4.94%) Docker
Systems Management
1 19 (23.46%) Hadoop YARN
2 13 (16.05%) Kibana
2 13 (16.05%) Puppet
3 7 (8.64%) Kubernetes
4 4 (4.94%) Docker Swarm
5 2 (2.47%) Oozie
Vendors
1 15 (18.52%) Cloudera
2 14 (17.28%) Hortonworks
3 13 (16.05%) Atlassian
4 10 (12.35%) Microsoft
5 8 (9.88%) Talend
6 5 (6.17%) MicroStrategy
7 4 (4.94%) Google
7 4 (4.94%) Informatica
8 2 (2.47%) MapR
9 1 (1.23%) Capita
9 1 (1.23%) Oracle
9 1 (1.23%) Red Hat
9 1 (1.23%) SAP