Period
to 22 September 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 22 September 2019 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
22 Sep 2019
Same period 2018 Same period 2017
Rank 833 754 954
Rank change year-on-year -79 +200 +18
Permanent jobs citing HDFS 220 403 226
As % of all permanent IT jobs advertised in England 0.17% 0.26% 0.14%
As % of the System Software category 0.98% 1.75% 1.05%
Number of salaries quoted 197 296 179
England median annual salary £70,000 £70,000 £70,000
10th Percentile £46,250 £41,100 £45,000
90th Percentile £92,500 £97,500 £102,500
UK median annual salary £70,000 £70,000 £70,000

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 22,564 23,070 21,541
As % of all permanent IT jobs advertised in England 17.56% 14.86% 12.98%
Number of salaries quoted 18,508 18,922 18,222
England median annual salary £50,000 £50,000 £45,000
Median salary % change year-on-year - +11.11% +5.88%
10th Percentile £25,750 £25,000 £24,000
90th Percentile £85,000 £81,250 £75,000
UK median annual salary £50,000 £49,039 £45,000
% change year-on-year +1.96% +8.97% +5.88%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

The salary distribution of IT jobs citing HDFS in England over the 6 months to 22 September 2019.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 22 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -7 153 £75,000 - 18
North of England +5 19 £57,275 +43.19% 4
East of England +61 17 £70,000 -3.45% 1
South West +19 17 £52,500 -8.70% 1
Yorkshire +5 15 £57,275 -11.88% 3
South East -33 10 £47,500 -17.39% 6
Midlands +13 4 £65,000 +8.33%
West Midlands +20 3 £56,250 -6.25%
North East - 3 £57,275 - 1
East Midlands +22 1 £75,000 +25.00%
North West +10 1 - -
HDFS
UK

For the 6 months to 22 September 2019, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for HDFS.

1 186 (84.55%) Hadoop
2 168 (76.36%) Apache Hive
3 164 (74.55%) Apache Spark
4 157 (71.36%) Big Data
5 142 (64.55%) Python
6 107 (48.64%) SQL
7 105 (47.73%) Agile Software Development
8 100 (45.45%) Scala
9 96 (43.64%) HBase
10 81 (36.82%) Impala
11 77 (35.00%) Analytics
11 77 (35.00%) Azure
12 76 (34.55%) AWS
12 76 (34.55%) Data Science
13 75 (34.09%) Java
13 75 (34.09%) Linux
14 73 (33.18%) ETL
14 73 (33.18%) Hadoop YARN
15 71 (32.27%) NoSQL
16 62 (28.18%) Data Engineering
17 60 (27.27%) Kafka
18 55 (25.00%) Data Modelling
19 51 (23.18%) Data Warehouse
20 48 (21.82%) Sqoop
21 46 (20.91%) Apache
21 46 (20.91%) SQL Server
22 45 (20.45%) Machine Learning
23 44 (20.00%) Business Intelligence
24 40 (18.18%) Amazon EMR
24 40 (18.18%) Amazon S3

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 164 (74.55%) Apache Spark
2 46 (20.91%) Apache
3 18 (8.18%) Apache Pig
4 15 (6.82%) SAS
5 13 (5.91%) Elasticsearch
6 11 (5.00%) Apache Airflow
6 11 (5.00%) Apache Solr
7 3 (1.36%) Confluence
8 2 (0.91%) Cloud Foundry
8 2 (0.91%) WildFly
9 1 (0.45%) JBoss
9 1 (0.45%) Jupyter
9 1 (0.45%) OpenStack
9 1 (0.45%) WebLogic Portal
Applications
1 1 (0.45%) Microsoft Project
Business Applications
1 1 (0.45%) Adobe Campaign
Cloud Services
1 77 (35.00%) Azure
2 76 (34.55%) AWS
3 40 (18.18%) Amazon EMR
3 40 (18.18%) Amazon S3
4 20 (9.09%) GCP
5 15 (6.82%) Azure Data Factory
6 14 (6.36%) Amazon Kinesis
7 10 (4.55%) GitHub
8 9 (4.09%) IaaS
8 9 (4.09%) PaaS
9 6 (2.73%) AWS CloudFormation
10 4 (1.82%) Power Platform
10 4 (1.82%) SaaS
11 3 (1.36%) Amazon EC2
11 3 (1.36%) Cloud Computing
11 3 (1.36%) Serverless
12 2 (0.91%) OpenShift
13 1 (0.45%) AWS Lambda
13 1 (0.45%) Azure Machine Learning
13 1 (0.45%) Data Lake Analytics
Communications & Networking
1 11 (5.00%) Kerberos
2 6 (2.73%) Firewall
2 6 (2.73%) VPN
3 5 (2.27%) SSL
4 3 (1.36%) HTTP
4 3 (1.36%) HTTPS
5 1 (0.45%) Broadband
Database & Business Intelligence
1 186 (84.55%) Hadoop
2 168 (76.36%) Apache Hive
3 157 (71.36%) Big Data
4 96 (43.64%) HBase
5 81 (36.82%) Impala
6 71 (32.27%) NoSQL
7 51 (23.18%) Data Warehouse
8 48 (21.82%) Sqoop
9 46 (20.91%) SQL Server
10 26 (11.82%) HDInsight
11 24 (10.91%) Data Lake
12 22 (10.00%) Apache Cassandra
13 21 (9.55%) MongoDB
14 19 (8.64%) Apache Kudu
14 19 (8.64%) Data Mining
14 19 (8.64%) PostgreSQL
15 16 (7.27%) Amazon Redshift
15 16 (7.27%) Neo4j
16 12 (5.45%) Relational Database
17 11 (5.00%) Presto
Development Applications
1 27 (12.27%) Git (software)
2 15 (6.82%) Jenkins
3 10 (4.55%) IntelliJ
4 8 (3.64%) Eclipse
4 8 (3.64%) NetBeans
4 8 (3.64%) ProC
5 7 (3.18%) JIRA
6 6 (2.73%) GitLab
7 3 (1.36%) JUnit
7 3 (1.36%) Maven
7 3 (1.36%) Sonatype Nexus
8 2 (0.91%) Gradle
9 1 (0.45%) Artifactory
9 1 (0.45%) Bitbucket
9 1 (0.45%) Hudson
9 1 (0.45%) Selenium
9 1 (0.45%) Travis CI
General
1 26 (11.82%) Finance
2 11 (5.00%) Public Sector
3 9 (4.09%) Retail
4 8 (3.64%) Games
5 6 (2.73%) Legal
5 6 (2.73%) Manufacturing
6 5 (2.27%) Banking
6 5 (2.27%) Marketing
7 2 (0.91%) Front Office
8 1 (0.45%) Investment Banking
8 1 (0.45%) Retail Banking
Job Titles
1 105 (47.73%) Data Engineer
2 44 (20.00%) Senior Data Engineer
3 37 (16.82%) Big Data Engineer
4 36 (16.36%) Developer
5 24 (10.91%) Architect
6 21 (9.55%) Data Scientist
7 19 (8.64%) Data Architect
8 17 (7.73%) Senior Data Scientist
9 16 (7.27%) Big Data Developer
9 16 (7.27%) Java Developer
10 15 (6.82%) Hadoop Engineer
11 12 (5.45%) Cloud Architect
11 12 (5.45%) Senior Hadoop Engineer
12 11 (5.00%) Senior Developer
12 11 (5.00%) Senior Java Developer
13 10 (4.55%) Cloud Engineer
14 9 (4.09%) Data Warehouse Developer
14 9 (4.09%) Oracle Data Warehouse Developer
14 9 (4.09%) Oracle Developer
15 7 (3.18%) QA Engineer
Libraries, Frameworks & Software Standards
1 60 (27.27%) Kafka
2 18 (8.18%) D3.js
2 18 (8.18%) ggplot2
3 17 (7.73%) RabbitMQ
4 16 (7.27%) LAPP Stack
4 16 (7.27%) Web Services
5 14 (6.36%) Spring
6 10 (4.55%) Spring Boot
7 9 (4.09%) Elastic Stack
7 9 (4.09%) Lambda Expressions
8 8 (3.64%) ActiveMQ
8 8 (3.64%) Apache NiFi
8 8 (3.64%) Hibernate
8 8 (3.64%) JPA
8 8 (3.64%) Node.js
8 8 (3.64%) SOAP
8 8 (3.64%) Spring Cloud
9 6 (2.73%) OAuth
9 6 (2.73%) SAML
10 5 (2.27%) LDAP
Miscellaneous
1 27 (12.27%) Algorithms
2 21 (9.55%) Analytical Skills
3 13 (5.91%) Data Structures
4 8 (3.64%) Management Information System
5 7 (3.18%) Data Centre
5 7 (3.18%) Greenfield Project
6 6 (2.73%) Hybrid Cloud
7 3 (1.36%) Fixed Income
7 3 (1.36%) Linux Command Line
7 3 (1.36%) Public Cloud
7 3 (1.36%) Replication
7 3 (1.36%) Virtual Team
8 2 (0.91%) Cloud Native
8 2 (0.91%) Equities
8 2 (0.91%) Self-Motivation
8 2 (0.91%) User Experience
9 1 (0.45%) Market Risk
9 1 (0.45%) Social Network
Operating Systems
1 75 (34.09%) Linux
2 38 (17.27%) Unix
3 4 (1.82%) Windows
4 2 (0.91%) SUSE Linux Enterprise Server
4 2 (0.91%) Ubuntu
4 2 (0.91%) Windows Server
Processes & Methodologies
1 105 (47.73%) Agile Software Development
2 77 (35.00%) Analytics
3 76 (34.55%) Data Science
4 73 (33.18%) ETL
5 62 (28.18%) Data Engineering
6 55 (25.00%) Data Modelling
7 45 (20.45%) Machine Learning
8 44 (20.00%) Business Intelligence
9 36 (16.36%) MapReduce
10 30 (13.64%) Data Integration
11 29 (13.18%) Problem-Solving
12 22 (10.00%) Microservices
13 21 (9.55%) Data Ingestion
13 21 (9.55%) Software Engineering
13 21 (9.55%) Visualisation
14 20 (9.09%) DevOps
15 19 (8.64%) Data Management
15 19 (8.64%) Mentoring
16 18 (8.18%) Continuous Integration
16 18 (8.18%) Performance Tuning
Programming Languages
1 142 (64.55%) Python
2 107 (48.64%) SQL
3 100 (45.45%) Scala
4 75 (34.09%) Java
5 27 (12.27%) JavaScript
5 27 (12.27%) Shell Script
6 25 (11.36%) R
7 18 (8.18%) PL/SQL
8 14 (6.36%) Bash Shell
9 11 (5.00%) C
10 8 (3.64%) Ruby
10 8 (3.64%) T-SQL
11 5 (2.27%) Perl
12 4 (1.82%) Java 8
13 3 (1.36%) C#
14 2 (0.91%) Groovy
14 2 (0.91%) HiveQL
14 2 (0.91%) PowerShell
15 1 (0.45%) PHP 7
15 1 (0.45%) Pig Latin
Qualifications
1 25 (11.36%) Degree
2 9 (4.09%) Computer Science Degree
3 4 (1.82%) Security Cleared
4 2 (0.91%) DV Cleared
4 2 (0.91%) MCSA
4 2 (0.91%) Microsoft Certification
5 1 (0.45%) SC Cleared
5 1 (0.45%) TOGAF Certification
Quality Assurance & Compliance
1 35 (15.91%) Data Quality
2 27 (12.27%) QA
3 7 (3.18%) GDPR
4 6 (2.73%) ISO/IEC 27001
System Software
1 26 (11.82%) Apache Flume
2 16 (7.27%) Docker
3 15 (6.82%) Apache ZooKeeper
4 2 (0.91%) Cronacle
4 2 (0.91%) Virtual Machines
4 2 (0.91%) VMware Infrastructure
4 2 (0.91%) vSphere
Systems Management
1 73 (33.18%) Hadoop YARN
2 35 (15.91%) Oozie
3 11 (5.00%) Terraform
4 9 (4.09%) Ambari
4 9 (4.09%) Ansible
5 7 (3.18%) Kubernetes
6 6 (2.73%) Single Sign-On
7 5 (2.27%) Puppet
8 4 (1.82%) Mesos
9 2 (0.91%) Check_MK
9 2 (0.91%) Control-M
9 2 (0.91%) Nagios
9 2 (0.91%) Rsyslog
Vendors
1 39 (17.73%) Cloudera
2 31 (14.09%) Oracle
3 22 (10.00%) Hortonworks
4 16 (7.27%) Teradata
5 14 (6.36%) Informatica
6 12 (5.45%) Databricks
7 10 (4.55%) Google
8 8 (3.64%) Microsoft
8 8 (3.64%) Talend
9 7 (3.18%) Tableau
10 5 (2.27%) MapR
11 4 (1.82%) MicroStrategy
12 3 (1.36%) Ab Initio
12 3 (1.36%) Cognos
12 3 (1.36%) Jaspersoft
12 3 (1.36%) Syncsort
12 3 (1.36%) TIBCO
13 2 (0.91%) Blue Prism
13 2 (0.91%) UiPath
13 2 (0.91%) VMware