Period
to 26 May 2018

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 26 May 2018 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > South East
6 months to
26 May 2018
Same period 2017 Same period 2016
Rank 456 519 570
Rank change year-on-year +63 +51 +76
Permanent jobs citing HDFS 92 17 55
As % of all permanent IT jobs advertised in the South East 0.30% 0.058% 0.15%
As % of the System Software category 2.16% 0.41% 1.04%
Number of salaries quoted 73 12 49
South East median annual salary £60,000 £55,000 £51,500
Median salary % change year-on-year +9.09% +6.80% -1.90%
10th Percentile £37,500 £45,000 £35,600
90th Percentile £78,750 £93,625 £65,000
England median annual salary £70,000 £72,500 £70,000
% change year-on-year -3.45% +3.57% +3.70%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for system software skills.

All System Software Skills
South East
Permanent vacancies with a requirement for system software skills 4,266 4,151 5,286
As % of all permanent IT jobs advertised in the South East 13.94% 14.20% 14.08%
Number of salaries quoted 3,434 3,515 4,603
South East median annual salary £42,500 £40,000 £40,000
Median salary % change year-on-year +6.25% - -
10th Percentile £23,000 £22,500 £22,750
90th Percentile £67,500 £65,000 £61,250
England median annual salary £47,500 £42,500 £41,500
% change year-on-year +11.76% +2.41% +3.75%

HDFS
Job Vacancy Trend in the South East

Job postings citing HDFS as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for HDFS in the South East

HDFS
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in the South East.

Salary trend for HDFS in the South East

HDFS
Salary Histogram in the South East

The salary distribution of IT jobs citing HDFS in the South East over the 6 months to 26 May 2018.

Salary histogram for HDFS in the South East

HDFS
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the South East region over the 6 months to 26 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +41 51 £65,000 -25.71% 3
Berkshire +34 40 £65,000 -25.71% 3
East Sussex - 15 £77,500 -
West Sussex - 14 £30,000 - 1
Buckinghamshire - 10 £61,250 -
Hampshire -36 7 £50,000 -9.09% 4
Surrey -6 5 £65,000 +30.00% 4
Oxfordshire - 1 £42,500 -
HDFS
England

For the 6 months to 26 May 2018, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for HDFS.

1 71 (77.17%) Hadoop
2 57 (61.96%) Java
3 46 (50.00%) Apache Hive
4 44 (47.83%) Linux
5 42 (45.65%) Continuous Integration
5 42 (45.65%) Agile Software Development
6 41 (44.57%) Python
7 38 (41.30%) HBase
8 36 (39.13%) Big Data
9 34 (36.96%) Machine Learning
10 33 (35.87%) Apache Flume
11 32 (34.78%) Scala
11 32 (34.78%) R
11 32 (34.78%) SQL
12 30 (32.61%) Apache Spark
12 30 (32.61%) Data Science
13 29 (31.52%) MapReduce
14 28 (30.43%) Node.js
14 28 (30.43%) Degree
14 28 (30.43%) Amazon AWS
15 26 (28.26%) Windows
16 22 (23.91%) Jenkins
16 22 (23.91%) Impala
17 21 (22.83%) Sqoop
17 21 (22.83%) Problem-Solving
17 21 (22.83%) Internet
17 21 (22.83%) OO
18 20 (21.74%) Data Warehouse
18 20 (21.74%) Data Analysis
18 20 (21.74%) JSON

HDFS
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 30 (32.61%) Apache Spark
2 14 (15.22%) Apache Pig
3 7 (7.61%) SAS
4 6 (6.52%) Elasticsearch
5 4 (4.35%) Oracle SOA Suite
5 4 (4.35%) WebLogic
6 2 (2.17%) Apache
Business Applications
1 4 (4.35%) Oracle 11i
1 4 (4.35%) Oracle Assets
1 4 (4.35%) Oracle EBS
1 4 (4.35%) Oracle EBS R12
1 4 (4.35%) Oracle General Ledger
1 4 (4.35%) Oracle iProcurement
1 4 (4.35%) Oracle Payables
1 4 (4.35%) Oracle Receivables
Cloud Services
1 28 (30.43%) Amazon AWS
2 11 (11.96%) Microsoft Azure
3 9 (9.78%) Azure Data Factory
4 4 (4.35%) GitHub
4 4 (4.35%) Google Cloud Platform
5 3 (3.26%) OpenShift
Communications & Networking
1 21 (22.83%) Internet
Database & Business Intelligence
1 71 (77.17%) Hadoop
2 46 (50.00%) Apache Hive
3 38 (41.30%) HBase
4 36 (39.13%) Big Data
5 22 (23.91%) Impala
6 21 (22.83%) Sqoop
7 20 (21.74%) Data Warehouse
8 14 (15.22%) SQL Server
9 13 (14.13%) Power BI
10 11 (11.96%) Data Lake
10 11 (11.96%) Relational Database
11 9 (9.78%) Azure SQL Data Warehouse
11 9 (9.78%) Azure SQL Database
11 9 (9.78%) HDInsight
11 9 (9.78%) SQL Server Integration Services
12 7 (7.61%) PostgreSQL
13 5 (5.43%) SQL Server 2014
13 5 (5.43%) SQL Server Analysis Services
13 5 (5.43%) SQL Server Reporting Services
14 4 (4.35%) Cosmos DB
Development Applications
1 22 (23.91%) Jenkins
2 15 (16.30%) Git (software)
2 15 (16.30%) TeamCity
3 12 (13.04%) JUnit
4 7 (7.61%) git-flow
5 4 (4.35%) Ant
5 4 (4.35%) Team Foundation Server
General
1 19 (20.65%) Retail
2 15 (16.30%) Marketing
3 9 (9.78%) Advertising
4 5 (5.43%) Banking
4 5 (5.43%) Finance
4 5 (5.43%) Investment Banking
Job Titles
1 28 (30.43%) Big Data Engineer
2 24 (26.09%) Developer
3 23 (25.00%) Java Developer
4 22 (23.91%) Data Engineer
5 20 (21.74%) Hadoop Engineer
6 19 (20.65%) Java Engineer
7 18 (19.57%) Senior Developer
8 17 (18.48%) Senior Java Developer
9 14 (15.22%) Data Scientist
9 14 (15.22%) Software Engineer
10 13 (14.13%) Consultant
11 10 (10.87%) Java Software Engineer
12 8 (8.70%) Big Data Software Engineer
13 7 (7.61%) Data Consultant
14 6 (6.52%) Python Engineer
14 6 (6.52%) Python Software Engineer
14 6 (6.52%) Senior Java Engineer
14 6 (6.52%) Senior Java Software Engineer
14 6 (6.52%) Senior Software Engineer
15 5 (5.43%) Cybersecurity Engineer
Libraries, Frameworks & Software Standards
1 28 (30.43%) Node.js
2 20 (21.74%) JSON
3 19 (20.65%) Kafka
4 16 (17.39%) CSS
4 16 (17.39%) HTML
4 16 (17.39%) REST
5 13 (14.13%) TensorFlow
6 12 (13.04%) Keras
6 12 (13.04%) MLlib
7 11 (11.96%) Web Services
8 8 (8.70%) Spring
9 7 (7.61%) Spring Boot
10 4 (4.35%) EJB
10 4 (4.35%) EJB 3.0
10 4 (4.35%) Java EE
10 4 (4.35%) Oracle Fusion
10 4 (4.35%) SOAP
10 4 (4.35%) XML
10 4 (4.35%) XSD
10 4 (4.35%) XSLT
Miscellaneous
1 14 (15.22%) Algorithms
1 14 (15.22%) Data Structures
2 13 (14.13%) Greenfield Project
3 11 (11.96%) Computer Science
4 7 (7.61%) Analytical Skills
5 4 (4.35%) Driving Licence
5 4 (4.35%) Hybrid Cloud
5 4 (4.35%) Private Cloud
5 4 (4.35%) Public Cloud
6 2 (2.17%) Client/Server
Operating Systems
1 44 (47.83%) Linux
2 26 (28.26%) Windows
3 1 (1.09%) Unix
Processes & Methodologies
1 42 (45.65%) Agile Software Development
1 42 (45.65%) Continuous Integration
2 34 (36.96%) Machine Learning
3 30 (32.61%) Data Science
4 29 (31.52%) MapReduce
5 21 (22.83%) OO
5 21 (22.83%) Problem-Solving
6 20 (21.74%) Data Analysis
7 15 (16.30%) Business Intelligence
7 15 (16.30%) Deep Learning
7 15 (16.30%) Software Engineering
8 14 (15.22%) Predictive Modelling
9 13 (14.13%) Analytics
9 13 (14.13%) DevOps
10 12 (13.04%) Digital Marketing
10 12 (13.04%) Visualisation
11 11 (11.96%) Change Management
11 11 (11.96%) Data Analytics
11 11 (11.96%) ETL
11 11 (11.96%) Use Case
Programming Languages
1 57 (61.96%) Java
2 41 (44.57%) Python
3 32 (34.78%) R
3 32 (34.78%) Scala
3 32 (34.78%) SQL
4 16 (17.39%) JavaScript
5 15 (16.30%) Go
5 15 (16.30%) Shell Script
6 14 (15.22%) HiveQL
7 7 (7.61%) C
8 4 (4.35%) PL/SQL
8 4 (4.35%) WebLogic Scripting Tool
8 4 (4.35%) XPath
9 2 (2.17%) C#
Qualifications
1 28 (30.43%) Degree
2 7 (7.61%) DV Cleared
2 7 (7.61%) Security Cleared
3 4 (4.35%) Computer Science Degree
3 4 (4.35%) ISTQB
3 4 (4.35%) PRINCE2 Certification
Quality Assurance & Compliance
1 3 (3.26%) Data Quality
System Software
1 33 (35.87%) Apache Flume
2 6 (6.52%) Virtual Machines
3 4 (4.35%) Docker
4 1 (1.09%) Apache ZooKeeper
Systems Management
1 19 (20.65%) Hadoop YARN
2 12 (13.04%) Oozie
3 7 (7.61%) Kubernetes
4 6 (6.52%) Kibana
4 6 (6.52%) Puppet
5 4 (4.35%) Docker Swarm
Vendors
1 17 (18.48%) Cloudera
2 16 (17.39%) Hortonworks
3 11 (11.96%) Oracle
4 9 (9.78%) Microsoft
5 7 (7.61%) MicroStrategy
5 7 (7.61%) SAP
6 6 (6.52%) Atlassian
6 6 (6.52%) Talend
7 4 (4.35%) Google
7 4 (4.35%) Informatica
7 4 (4.35%) Kofax
7 4 (4.35%) Perforce
7 4 (4.35%) Tableau
8 1 (1.09%) BT
8 1 (1.09%) Capita
8 1 (1.09%) MapR