Period
to 21 April 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 21 April 2019 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
21 Apr 2019
Same period 2018 Same period 2017
Rank 823 771 924
Rank change year-on-year -52 +153 -8
Permanent jobs citing HDFS 248 414 241
As % of all permanent IT jobs advertised in England 0.18% 0.25% 0.15%
As % of the System Software category 1.10% 1.82% 1.21%
Number of salaries quoted 198 293 199
England median annual salary £70,000 £70,000 £75,000
Median salary % change year-on-year - -6.67% +7.14%
10th Percentile £46,250 £42,500 £48,750
90th Percentile £93,250 £97,500 £115,000
UK median annual salary £68,750 £70,000 £75,000
% change year-on-year -1.79% -6.67% +9.09%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 22,638 22,780 19,966
As % of all permanent IT jobs advertised in England 16.45% 13.71% 12.37%
Number of salaries quoted 18,388 18,634 16,748
England median annual salary £50,000 £47,500 £42,500
Median salary % change year-on-year +5.26% +11.76% +2.41%
10th Percentile £26,000 £25,000 £23,713
90th Percentile £83,750 £80,000 £75,000
UK median annual salary £50,000 £46,000 £42,500
% change year-on-year +8.70% +8.24% +5.05%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

The salary distribution of IT jobs citing HDFS in England over the 6 months to 21 April 2019.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 21 April 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +11 165 £75,000 - 8
North of England +43 32 £49,337 +9.64% 1
South West +17 22 £50,000 -4.76%
East of England +63 19 £72,500 - 1
Yorkshire +21 17 £49,337 -6.02%
North East +36 9 £49,337 -26.91%
Midlands +34 6 £77,500 +29.17% 2
North West +32 6 £70,000 +55.56% 1
East Midlands - 5 £77,500 -
South East -36 4 £50,000 -16.67% 1
West Midlands +17 1 - - 2
HDFS
UK

For the 6 months to 21 April 2019, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for HDFS.

1 217 (87.50%) Hadoop
2 200 (80.65%) Big Data
3 178 (71.77%) Apache Hive
4 160 (64.52%) Apache Spark
5 158 (63.71%) Java
6 151 (60.89%) Agile Software Development
7 134 (54.03%) Python
8 127 (51.21%) HBase
9 108 (43.55%) Kafka
10 101 (40.73%) SQL
11 100 (40.32%) ETL
12 95 (38.31%) NoSQL
13 94 (37.90%) Scala
14 92 (37.10%) Analytics
15 89 (35.89%) Linux
16 82 (33.06%) Oracle
17 76 (30.65%) Amazon AWS
18 73 (29.44%) Data Science
19 70 (28.23%) Machine Learning
20 69 (27.82%) MongoDB
21 67 (27.02%) Sqoop
22 65 (26.21%) Apache Cassandra
23 64 (25.81%) Apache Flume
23 64 (25.81%) Data Engineering
23 64 (25.81%) Data Warehouse
24 63 (25.40%) Data Integration
25 62 (25.00%) Cloudera
26 59 (23.79%) Impala
27 55 (22.18%) Oozie
28 54 (21.77%) Hadoop YARN

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 160 (64.52%) Apache Spark
2 41 (16.53%) Apache Pig
3 38 (15.32%) Apache
4 36 (14.52%) Elasticsearch
5 33 (13.31%) Apache Solr
6 14 (5.65%) JBoss
6 14 (5.65%) WebSphere
7 13 (5.24%) Apache Geronimo
7 13 (5.24%) GlassFish
7 13 (5.24%) Tomcat
8 10 (4.03%) WildFly
9 9 (3.63%) SAS
10 6 (2.42%) Jetty
11 4 (1.61%) Apache Airflow
12 2 (0.81%) Confluence
13 1 (0.40%) Cloud Foundry
13 1 (0.40%) WebLogic
Applications
1 13 (5.24%) Weka
Business Applications
1 1 (0.40%) Adobe Campaign
Cloud Services
1 76 (30.65%) Amazon AWS
2 41 (16.53%) GitHub
3 34 (13.71%) Microsoft Azure
4 20 (8.06%) Cloud Computing
5 18 (7.26%) Amazon EMR
6 17 (6.85%) Amazon S3
6 17 (6.85%) Google Cloud Platform
7 12 (4.84%) Serverless
8 8 (3.23%) AWS Lambda
9 6 (2.42%) Azure Data Factory
9 6 (2.42%) SaaS
10 5 (2.02%) Amazon Kinesis
11 4 (1.61%) Amazon EC2
12 3 (1.21%) AWS Data Pipeline
12 3 (1.21%) IaaS
12 3 (1.21%) PaaS
13 2 (0.81%) AWS CloudFormation
13 2 (0.81%) Azure Machine Learning
13 2 (0.81%) IBM Cloud
14 1 (0.40%) Data Lake Analytics
Communications & Networking
1 8 (3.23%) Internet
2 6 (2.42%) Kerberos
3 1 (0.40%) Firewall
3 1 (0.40%) HTTP
3 1 (0.40%) HTTPS
3 1 (0.40%) SSL
3 1 (0.40%) VPN
Database & Business Intelligence
1 217 (87.50%) Hadoop
2 200 (80.65%) Big Data
3 178 (71.77%) Apache Hive
4 127 (51.21%) HBase
5 95 (38.31%) NoSQL
6 69 (27.82%) MongoDB
7 67 (27.02%) Sqoop
8 65 (26.21%) Apache Cassandra
9 64 (25.81%) Data Warehouse
10 59 (23.79%) Impala
11 44 (17.74%) Relational Database
12 40 (16.13%) PostgreSQL
13 37 (14.92%) SQL Server
14 34 (13.71%) MySQL
15 31 (12.50%) Spark SQL
16 30 (12.10%) Redis
17 28 (11.29%) RDBMS
18 27 (10.89%) Data Lake
19 24 (9.68%) Neo4j
20 22 (8.87%) CouchDB
Development Applications
1 33 (13.31%) Git (software)
2 23 (9.27%) Maven
3 21 (8.47%) IntelliJ
4 16 (6.45%) Jenkins
5 13 (5.24%) Ant
5 13 (5.24%) Gradle
6 12 (4.84%) Eclipse
6 12 (4.84%) NetBeans
7 5 (2.02%) JIRA
8 4 (1.61%) JUnit
9 2 (0.81%) Selenium
9 2 (0.81%) Team Foundation Server
10 1 (0.40%) Hudson
10 1 (0.40%) Oracle APEX
10 1 (0.40%) Protractor
10 1 (0.40%) Travis CI
General
1 45 (18.15%) Finance
2 21 (8.47%) Retail
3 16 (6.45%) Banking
4 10 (4.03%) Telecoms
5 8 (3.23%) Marketing
6 3 (1.21%) Investment Banking
6 3 (1.21%) Legal
7 2 (0.81%) Financial Institution
7 2 (0.81%) Law
8 1 (0.40%) Electronics
8 1 (0.40%) Front Office
8 1 (0.40%) Manufacturing
8 1 (0.40%) Retail Banking
Job Titles
1 107 (43.15%) Data Engineer
2 71 (28.63%) Developer
3 57 (22.98%) Java Developer
4 52 (20.97%) Big Data Engineer
5 28 (11.29%) Architect
6 26 (10.48%) Senior Data Engineer
7 25 (10.08%) Python Engineer
8 22 (8.87%) Big Data Developer
9 19 (7.66%) Senior Developer
9 19 (7.66%) Senior Java Developer
10 18 (7.26%) Lead Developer
10 18 (7.26%) Lead Java Developer
11 14 (5.65%) Data Architect
12 11 (4.44%) Data Scientist
13 10 (4.03%) Senior Data Scientist
14 9 (3.63%) Big Data Architect
14 9 (3.63%) Core Java Developer
15 8 (3.23%) Agile Developer
15 8 (3.23%) Designer
15 8 (3.23%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 108 (43.55%) Kafka
2 42 (16.94%) Spring
2 42 (16.94%) Web Services
3 34 (13.71%) Spark Streaming
4 32 (12.90%) Hibernate
5 26 (10.48%) REST
6 25 (10.08%) JPA
6 25 (10.08%) SOAP
7 22 (8.87%) Spring Boot
8 19 (7.66%) RabbitMQ
9 17 (6.85%) HTML
10 16 (6.45%) JSP
11 13 (5.24%) ActiveMQ
11 13 (5.24%) FreeMarker
11 13 (5.24%) Java EE
11 13 (5.24%) JMS
11 13 (5.24%) Node.js
11 13 (5.24%) Servlets
11 13 (5.24%) Swing
11 13 (5.24%) TopLink
Miscellaneous
1 30 (12.10%) Analytical Skills
2 21 (8.47%) Data Structures
3 17 (6.85%) Algorithms
4 10 (4.03%) Fintech
4 10 (4.03%) Greenfield Project
5 5 (2.02%) Public Cloud
5 5 (2.02%) User Experience
6 4 (1.61%) Data Centre
6 4 (1.61%) Enterprise Software
6 4 (1.61%) Hybrid Cloud
6 4 (1.61%) Virtual Team
7 3 (1.21%) Cloud Native
7 3 (1.21%) Linux Command Line
8 2 (0.81%) FMCG
9 1 (0.40%) Replication
9 1 (0.40%) Robotics
9 1 (0.40%) Self-Motivation
Operating Systems
1 89 (35.89%) Linux
2 48 (19.35%) Unix
3 16 (6.45%) Windows
4 9 (3.63%) Ubuntu
5 1 (0.40%) VMS
5 1 (0.40%) Windows Server
Processes & Methodologies
1 151 (60.89%) Agile Software Development
2 100 (40.32%) ETL
3 92 (37.10%) Analytics
4 73 (29.44%) Data Science
5 70 (28.23%) Machine Learning
6 64 (25.81%) Data Engineering
7 63 (25.40%) Data Integration
8 54 (21.77%) Data Analysis
9 48 (19.35%) MapReduce
10 45 (18.15%) Mentoring
11 41 (16.53%) DevOps
12 39 (15.73%) Data Modelling
13 38 (15.32%) Open Source
13 38 (15.32%) Use Case
14 35 (14.11%) Continuous Integration
14 35 (14.11%) Data Transformation
15 32 (12.90%) Coaching
15 32 (12.90%) Computer Science
15 32 (12.90%) Problem-Solving
16 31 (12.50%) Data Reconciliation
Programming Languages
1 158 (63.71%) Java
2 134 (54.03%) Python
3 101 (40.73%) SQL
4 94 (37.90%) Scala
5 42 (16.94%) JavaScript
6 28 (11.29%) R
7 25 (10.08%) T-SQL
8 23 (9.27%) Ruby
9 21 (8.47%) PL/SQL
10 18 (7.26%) Java 8
11 11 (4.44%) Shell Script
12 9 (3.63%) Groovy
13 8 (3.23%) C#
14 3 (1.21%) C
14 3 (1.21%) C++
14 3 (1.21%) HiveQL
14 3 (1.21%) PHP
15 2 (0.81%) MATLAB
15 2 (0.81%) Perl
16 1 (0.40%) PowerShell
Qualifications
1 36 (14.52%) Degree
2 20 (8.06%) Computer Science Degree
3 4 (1.61%) AWS Certification
4 3 (1.21%) Security Cleared
5 2 (0.81%) SC Cleared
6 1 (0.40%) DV Cleared
6 1 (0.40%) PhD
6 1 (0.40%) TOGAF Certification
Quality Assurance & Compliance
1 15 (6.05%) GDPR
2 13 (5.24%) QA
3 9 (3.63%) Data Quality
4 6 (2.42%) IFRS
4 6 (2.42%) PCI DSS
5 3 (1.21%) ISO/IEC 27001
6 1 (0.40%) EMIR
6 1 (0.40%) MiFID
System Software
1 64 (25.81%) Apache Flume
2 33 (13.31%) Docker
3 16 (6.45%) Apache ZooKeeper
4 2 (0.81%) Active Directory
5 1 (0.40%) Virtual Machines
5 1 (0.40%) VMware Infrastructure
5 1 (0.40%) vSphere
Systems Management
1 55 (22.18%) Oozie
2 54 (21.77%) Hadoop YARN
3 24 (9.68%) Kubernetes
4 11 (4.44%) Puppet
5 6 (2.42%) Ansible
6 5 (2.02%) Kibana
7 4 (1.61%) Mesos
7 4 (1.61%) Terraform
8 2 (0.81%) logstash
9 1 (0.40%) Ambari
9 1 (0.40%) Check_MK
9 1 (0.40%) Nagios
9 1 (0.40%) Rsyslog
9 1 (0.40%) Single Sign-On
Vendors
1 82 (33.06%) Oracle
2 62 (25.00%) Cloudera
3 54 (21.77%) Hortonworks
4 19 (7.66%) Tableau
5 16 (6.45%) Teradata
6 15 (6.05%) Informatica
6 15 (6.05%) MapR
6 15 (6.05%) Talend
7 13 (5.24%) Alteryx
8 12 (4.84%) Google
9 11 (4.44%) Databricks
10 7 (2.82%) Microsoft
11 5 (2.02%) Ab Initio
12 4 (1.61%) IBM
13 3 (1.21%) Cognos
13 3 (1.21%) Jaspersoft
13 3 (1.21%) MicroStrategy
13 3 (1.21%) Syncsort
13 3 (1.21%) TIBCO
14 2 (0.81%) WorldPay