Period
to 19 July 2019

The following table provides summary statistics for permanent job vacancies advertised in the East of England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 19 July 2019 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > East of England
6 months to
19 Jul 2019
Same period 2018 Same period 2017
Rank 262 330 361
Rank change year-on-year +68 +31 -
Permanent jobs citing HDFS 19 31 11
As % of all permanent IT jobs advertised in the East of England 0.25% 0.26% 0.088%
As % of the System Software category 1.39% 1.75% 0.69%
Number of salaries quoted 16 30 2
East of England median annual salary £70,000 £72,500 £55,000
Median salary % change year-on-year -3.45% +31.82% -
10th Percentile £61,250 £41,100 £47,500
90th Percentile £77,500 £80,000 £62,500
England median annual salary £65,000 £70,000 £70,000
% change year-on-year -7.14% - -3.45%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East of England with a requirement for system software skills.

All System Software Skills
East of England
Permanent vacancies with a requirement for system software skills 1,367 1,774 1,598
As % of all permanent IT jobs advertised in the East of England 18.23% 14.71% 12.80%
Number of salaries quoted 1,089 1,353 1,265
East of England median annual salary £42,500 £45,000 £42,500
Median salary % change year-on-year -5.56% +5.88% +6.25%
10th Percentile £24,975 £23,550 £23,500
90th Percentile £67,500 £70,000 £62,500
England median annual salary £50,000 £48,000 £44,000
% change year-on-year +4.17% +9.09% +3.53%

HDFS
Job Vacancy Trend in the East of England

Job postings citing HDFS as a percentage of all IT jobs advertised in the East of England.

Job vacancy trend for HDFS in the East of England

HDFS
Salary Trend in the East of England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in the East of England.

Salary trend for HDFS in the East of England

HDFS
Salary Histogram in the East of England

The salary distribution of IT jobs citing HDFS in the East of England over the 6 months to 19 July 2019.

Salary histogram for HDFS in the East of England

HDFS
Job Locations in the East of England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the East of England region over the 6 months to 19 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Bedfordshire -5 16 £70,000 -3.45% 2
Essex +27 3 £75,000 -6.25%
HDFS
England

For the 6 months to 19 July 2019, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East of England region with a requirement for HDFS.

1 19 (100.00%) Hadoop
1 19 (100.00%) Big Data
1 19 (100.00%) Analytics
1 19 (100.00%) Apache Spark
2 18 (94.74%) Sqoop
3 17 (89.47%) Apache Hive
4 15 (78.95%) HBase
4 15 (78.95%) Impala
4 15 (78.95%) Data Science
5 14 (73.68%) Apache Kudu
5 14 (73.68%) MapReduce
5 14 (73.68%) Performance Tuning
5 14 (73.68%) Agile Software Development
5 14 (73.68%) SQL Server
5 14 (73.68%) Python
6 12 (63.16%) Oozie
7 11 (57.89%) Hadoop YARN
7 11 (57.89%) Data Quality
7 11 (57.89%) Apache ZooKeeper
7 11 (57.89%) Data Modelling
7 11 (57.89%) Shell Script
7 11 (57.89%) Unix
7 11 (57.89%) Quality Management
7 11 (57.89%) Scrum
7 11 (57.89%) Scala
8 10 (52.63%) E-Commerce
9 4 (21.05%) Tableau
9 4 (21.05%) Relational Database
9 4 (21.05%) ETL
9 4 (21.05%) RDBMS

HDFS
Co-occurring IT Skills in the East of England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 19 (100.00%) Apache Spark
2 3 (15.79%) Apache
2 3 (15.79%) Apache Geronimo
2 3 (15.79%) Apache Pig
2 3 (15.79%) GlassFish
2 3 (15.79%) JBoss
2 3 (15.79%) Tomcat
2 3 (15.79%) WebSphere
3 1 (5.26%) Confluence
Applications
1 3 (15.79%) Weka
Cloud Services
1 1 (5.26%) Amazon AWS
1 1 (5.26%) Amazon EMR
1 1 (5.26%) Amazon Kinesis
1 1 (5.26%) Amazon S3
1 1 (5.26%) Google Analytics
1 1 (5.26%) IaaS
1 1 (5.26%) PaaS
1 1 (5.26%) Qubole
Database & Business Intelligence
1 19 (100.00%) Big Data
1 19 (100.00%) Hadoop
2 18 (94.74%) Sqoop
3 17 (89.47%) Apache Hive
4 15 (78.95%) HBase
4 15 (78.95%) Impala
5 14 (73.68%) Apache Kudu
5 14 (73.68%) SQL Server
6 4 (21.05%) RDBMS
6 4 (21.05%) Relational Database
7 3 (15.79%) CouchDB
7 3 (15.79%) Mahout
7 3 (15.79%) MongoDB
7 3 (15.79%) MySQL
7 3 (15.79%) Neo4j
7 3 (15.79%) NoSQL
7 3 (15.79%) PostgreSQL
8 1 (5.26%) Amazon Redshift
8 1 (5.26%) OLAP
8 1 (5.26%) OLTP
Development Applications
1 4 (21.05%) Maven
2 3 (15.79%) Ant
2 3 (15.79%) Gradle
3 1 (5.26%) Artifactory
3 1 (5.26%) Git (software)
3 1 (5.26%) Jenkins
3 1 (5.26%) JIRA
3 1 (5.26%) Sonatype Nexus
General
1 1 (5.26%) Marketing
1 1 (5.26%) Retail
Job Titles
1 14 (73.68%) Data Engineer
2 13 (68.42%) Senior Data Engineer
3 10 (52.63%) Big Data Engineer
3 10 (52.63%) Hadoop Engineer
3 10 (52.63%) Senior Hadoop Engineer
4 3 (15.79%) Agile Developer
4 3 (15.79%) Agile Java Developer
4 3 (15.79%) Developer
4 3 (15.79%) Java Developer
4 3 (15.79%) Java Swing Developer
4 3 (15.79%) Lead Developer
4 3 (15.79%) Lead Java Developer
5 1 (5.26%) Architect
5 1 (5.26%) Lead Project Manager
5 1 (5.26%) Project Leader
5 1 (5.26%) Project Manager
5 1 (5.26%) Solutions Architect
Libraries, Frameworks & Software Standards
1 3 (15.79%) CSS
1 3 (15.79%) EJB
1 3 (15.79%) FreeMarker
1 3 (15.79%) Hibernate
1 3 (15.79%) HTML
1 3 (15.79%) Java EE
1 3 (15.79%) JMS
1 3 (15.79%) JPA
1 3 (15.79%) JSP
1 3 (15.79%) REST
1 3 (15.79%) Servlets
1 3 (15.79%) SOAP
1 3 (15.79%) Spring
1 3 (15.79%) Spring MVC
1 3 (15.79%) Swing
1 3 (15.79%) TopLink
1 3 (15.79%) Web Services
2 2 (10.53%) Kafka
3 1 (5.26%) Apache Avro
3 1 (5.26%) Spark Streaming
Miscellaneous
1 1 (5.26%) Analytical Skills
Operating Systems
1 11 (57.89%) Unix
2 4 (21.05%) Linux
Processes & Methodologies
1 19 (100.00%) Analytics
2 15 (78.95%) Data Science
3 14 (73.68%) Agile Software Development
3 14 (73.68%) MapReduce
3 14 (73.68%) Performance Tuning
4 11 (57.89%) Data Modelling
4 11 (57.89%) Quality Management
4 11 (57.89%) Scrum
5 10 (52.63%) E-Commerce
6 4 (21.05%) ETL
7 3 (15.79%) MVC
7 3 (15.79%) OOP
8 2 (10.53%) Machine Learning
8 2 (10.53%) Technical Leadership
9 1 (5.26%) Concurrent Programming
9 1 (5.26%) Customer-Centricity
9 1 (5.26%) Data Engineering
9 1 (5.26%) Personalization
9 1 (5.26%) Predictive Modelling
9 1 (5.26%) Visualisation
Programming Languages
1 14 (73.68%) Python
2 11 (57.89%) Scala
2 11 (57.89%) Shell Script
3 4 (21.05%) Java
3 4 (21.05%) SQL
4 3 (15.79%) JavaScript
4 3 (15.79%) PL/SQL
4 3 (15.79%) T-SQL
Quality Assurance & Compliance
1 11 (57.89%) Data Quality
System Software
1 11 (57.89%) Apache ZooKeeper
2 2 (10.53%) Apache Flume
Systems Management
1 12 (63.16%) Oozie
2 11 (57.89%) Hadoop YARN
3 1 (5.26%) Ansible
Vendors
1 4 (21.05%) Tableau
2 3 (15.79%) Alteryx
2 3 (15.79%) Oracle
3 1 (5.26%) Google
3 1 (5.26%) Informatica
3 1 (5.26%) MicroStrategy