Period
to 1 April 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 1 April 2020 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
1 Apr 2020
Same period 2019 Same period 2018
Rank 839 829 804
Rank change year-on-year -10 -25 +117
Permanent jobs citing HDFS 122 249 379
As % of all permanent jobs advertised in England 0.11% 0.18% 0.23%
As % of the System Software category 0.66% 1.12% 1.68%
Number of salaries quoted 117 199 294
Median annual salary £75,000 £72,500 £70,000
Median salary % change year-on-year +3.45% +3.57% -6.67%
10th Percentile £50,000 £49,337 £40,592
90th Percentile £85,500 £98,000 £97,500
UK median annual salary £75,000 £72,500 £70,000
% change year-on-year +3.45% +3.57% -6.67%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 18,617 22,321 22,546
As % of all permanent IT jobs advertised in England 17.17% 16.26% 13.67%
Number of salaries quoted 15,225 18,166 18,537
Median annual salary £50,000 £50,000 £47,000
Median salary % change year-on-year - +6.38% +10.59%
10th Percentile £26,250 £26,000 £25,000
90th Percentile £86,250 £83,750 £78,750
UK median annual salary £50,000 £50,000 £45,000
% change year-on-year - +11.11% +5.88%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a proportion of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

3-month moving average salary quoted in jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

Salary distribution for jobs citing HDFS in England over the 6 months to 1 April 2020.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 1 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -26 54 £77,500 +3.33% 6
Midlands +84 26 £75,000 -3.23% 5
East Midlands +46 20 £75,000 -3.23% 1
North of England +55 17 £54,671 +10.81%
East of England +47 16 £75,000 +3.45%
Yorkshire +38 11 £54,835 +11.14%
South East +66 7 £75,000 +76.47% 1
West Midlands +52 6 £51,250 - 4
North East +4 4 £54,671 +10.81%
North West +37 2 - -
South West +17 2 £77,500 +55.00% 1
HDFS
UK

For the 6 months to 1 April 2020, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for HDFS.

1 120 (98.36%) Hadoop
2 114 (93.44%) Big Data
3 104 (85.25%) Apache Hive
4 90 (73.77%) Apache Spark
5 73 (59.84%) Agile Software Development
6 64 (52.46%) Python
7 61 (50.00%) Java
8 60 (49.18%) Impala
8 60 (49.18%) HBase
9 58 (47.54%) Scala
10 50 (40.98%) Analytics
10 50 (40.98%) SQL
11 47 (38.52%) AWS
11 47 (38.52%) Data Engineering
12 44 (36.07%) Kafka
12 44 (36.07%) Data Modelling
13 43 (35.25%) NoSQL
13 43 (35.25%) Azure
14 38 (31.15%) Software Engineering
15 37 (30.33%) Hadoop YARN
16 33 (27.05%) Linux
16 33 (27.05%) Data Science
17 32 (26.23%) Amazon EMR
18 31 (25.41%) Cloudera
19 30 (24.59%) MapReduce
19 30 (24.59%) ETL
20 29 (23.77%) Business Intelligence
21 28 (22.95%) Amazon S3
22 27 (22.13%) SQL Server
23 24 (19.67%) Data Warehouse

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 90 (73.77%) Apache Spark
2 20 (16.39%) Apache
3 6 (4.92%) Apache Airflow
4 5 (4.10%) Apache Pig
5 4 (3.28%) SAS
6 2 (1.64%) CMS
6 2 (1.64%) Elasticsearch
7 1 (0.82%) Jupyter
7 1 (0.82%) OpenStack
7 1 (0.82%) OpenWhisk
7 1 (0.82%) Tomcat
7 1 (0.82%) WebLogic
Applications
1 1 (0.82%) Microsoft Excel
1 1 (0.82%) SPSS
Business Applications
1 1 (0.82%) Oracle Applications
Cloud Services
1 47 (38.52%) AWS
2 43 (35.25%) Azure
3 32 (26.23%) Amazon EMR
4 28 (22.95%) Amazon S3
5 15 (12.30%) Amazon Kinesis
6 9 (7.38%) Azure Data Factory
7 6 (4.92%) GCP
8 4 (3.28%) IaaS
8 4 (3.28%) PaaS
8 4 (3.28%) Serverless
9 3 (2.46%) Adobe Creative Cloud
9 3 (2.46%) Power Platform
Communications & Networking
1 5 (4.10%) SSL
2 4 (3.28%) Firewall
2 4 (3.28%) Kerberos
2 4 (3.28%) VPN
3 2 (1.64%) FTP
3 2 (1.64%) HTTP
3 2 (1.64%) HTTPS
4 1 (0.82%) IPFS
Database & Business Intelligence
1 120 (98.36%) Hadoop
2 114 (93.44%) Big Data
3 104 (85.25%) Apache Hive
4 60 (49.18%) HBase
4 60 (49.18%) Impala
5 43 (35.25%) NoSQL
6 27 (22.13%) SQL Server
7 24 (19.67%) Data Warehouse
8 19 (15.57%) HDInsight
8 19 (15.57%) Sqoop
9 16 (13.11%) Data Lake
10 15 (12.30%) Apache Kudu
11 14 (11.48%) Amazon Redshift
11 14 (11.48%) Relational Database
12 13 (10.66%) RDBMS
13 11 (9.02%) Neo4j
14 10 (8.20%) OLTP
14 10 (8.20%) PostgreSQL
15 9 (7.38%) Amazon DynamoDB
16 8 (6.56%) Apache Cassandra
Development Applications
1 9 (7.38%) Git (software)
2 8 (6.56%) Jenkins
3 3 (2.46%) JIRA
3 3 (2.46%) JUnit
3 3 (2.46%) Octopus Deploy
3 3 (2.46%) TeamCity
3 3 (2.46%) Visual Studio Team System
4 1 (0.82%) Artifactory
4 1 (0.82%) GitLab
4 1 (0.82%) IBM UrbanCode
4 1 (0.82%) Maven
4 1 (0.82%) ProC
4 1 (0.82%) Sonatype Nexus
4 1 (0.82%) Team Foundation Server
General
1 23 (18.85%) Finance
2 12 (9.84%) Retail
3 10 (8.20%) Public Sector
4 6 (4.92%) Legal
5 5 (4.10%) Banking
6 4 (3.28%) Marketing
7 2 (1.64%) Manufacturing
8 1 (0.82%) Games
8 1 (0.82%) Telecoms
Job Titles
1 59 (48.36%) Data Engineer
2 27 (22.13%) Big Data Engineer
3 26 (21.31%) Architect
4 22 (18.03%) Data Architect
5 18 (14.75%) Senior Data Engineer
6 17 (13.93%) Developer
7 16 (13.11%) Java Developer
8 12 (9.84%) Analytics Developer
8 12 (9.84%) Big Data Developer
8 12 (9.84%) Lead Developer
8 12 (9.84%) Lead Java Developer
8 12 (9.84%) Senior Big Data Developer
8 12 (9.84%) Senior Developer
8 12 (9.84%) Senior Java Developer
9 11 (9.02%) Cloud Architect
10 10 (8.20%) Big Data Architect
11 7 (5.74%) Hadoop Architect
11 7 (5.74%) Technical Architect
12 6 (4.92%) DevOps Engineer
13 5 (4.10%) Data Scientist
Libraries, Frameworks & Software Standards
1 44 (36.07%) Kafka
2 15 (12.30%) J2EE
3 10 (8.20%) LAPP Stack
4 9 (7.38%) Elastic Stack
4 9 (7.38%) Lambda Expressions
5 6 (4.92%) PySpark
6 5 (4.10%) .NET
6 5 (4.10%) OAuth
7 4 (3.28%) HTML
7 4 (3.28%) LDAP
7 4 (3.28%) SAML
8 3 (2.46%) Web Services
9 2 (1.64%) Akka
10 1 (0.82%) ADO
10 1 (0.82%) D3.js
10 1 (0.82%) Flask
10 1 (0.82%) OAuth2
10 1 (0.82%) Pandas
10 1 (0.82%) XML
10 1 (0.82%) XSLT
Miscellaneous
1 17 (13.93%) Analytical Skills
2 15 (12.30%) Algorithms
3 13 (10.66%) Enterprise Software
3 13 (10.66%) Public Cloud
4 4 (3.28%) Data Centre
5 3 (2.46%) Derivative
5 3 (2.46%) Mobile App
6 2 (1.64%) Management Information System
6 2 (1.64%) Tandem
7 1 (0.82%) Cloud Native
7 1 (0.82%) Embedded Systems
7 1 (0.82%) Greenfield Project
7 1 (0.82%) PMI
Operating Systems
1 33 (27.05%) Linux
2 19 (15.57%) Unix
3 3 (2.46%) Android
3 3 (2.46%) Apple iOS
4 2 (1.64%) Red Hat Enterprise Linux
Processes & Methodologies
1 73 (59.84%) Agile Software Development
2 50 (40.98%) Analytics
3 47 (38.52%) Data Engineering
4 44 (36.07%) Data Modelling
5 38 (31.15%) Software Engineering
6 33 (27.05%) Data Science
7 30 (24.59%) ETL
7 30 (24.59%) MapReduce
8 29 (23.77%) Business Intelligence
9 24 (19.67%) Machine Learning
10 20 (16.39%) Scrum
11 19 (15.57%) Data Development
12 18 (14.75%) Data Analysis
12 18 (14.75%) Technical Leadership
13 17 (13.93%) Performance Tuning
14 16 (13.11%) Mentoring
14 16 (13.11%) Test Automation
15 15 (12.30%) DevOps
16 14 (11.48%) Coaching
17 13 (10.66%) Data Analytics
Programming Languages
1 64 (52.46%) Python
2 61 (50.00%) Java
3 58 (47.54%) Scala
4 50 (40.98%) SQL
5 22 (18.03%) Shell Script
6 8 (6.56%) Bash Shell
7 7 (5.74%) Ruby
8 6 (4.92%) R
9 5 (4.10%) HiveQL
9 5 (4.10%) JavaScript
9 5 (4.10%) PL/SQL
10 4 (3.28%) Java 8
11 2 (1.64%) C
11 2 (1.64%) Groovy
11 2 (1.64%) Haskell
11 2 (1.64%) Perl
12 1 (0.82%) Go
12 1 (0.82%) Kotlin
12 1 (0.82%) PHP
Qualifications
1 19 (15.57%) Degree
2 12 (9.84%) AWS Certification
3 3 (2.46%) Computer Science Degree
4 2 (1.64%) Master's Degree
5 1 (0.82%) PMI Certification
5 1 (0.82%) SC Cleared
5 1 (0.82%) Security Cleared
Quality Assurance & Compliance
1 18 (14.75%) Data Quality
2 13 (10.66%) QA
3 6 (4.92%) GDPR
3 6 (4.92%) ISO/IEC 27001
System Software
1 15 (12.30%) Apache Flume
2 7 (5.74%) Apache ZooKeeper
3 6 (4.92%) Docker
4 1 (0.82%) Alluxio
4 1 (0.82%) Ceph
4 1 (0.82%) etcd
4 1 (0.82%) Gluster
Systems Management
1 37 (30.33%) Hadoop YARN
2 22 (18.03%) Oozie
3 7 (5.74%) Ansible
4 6 (4.92%) Terraform
5 5 (4.10%) Kubernetes
5 5 (4.10%) Mesos
6 4 (3.28%) Ambari
6 4 (3.28%) Puppet
6 4 (3.28%) Single Sign-On
7 3 (2.46%) Opscode Chef
8 2 (1.64%) Graphite
8 2 (1.64%) Kibana
8 2 (1.64%) Nagios
8 2 (1.64%) Opsview
9 1 (0.82%) Grafana
9 1 (0.82%) Istio
9 1 (0.82%) Knative
9 1 (0.82%) Prometheus
Vendors
1 31 (25.41%) Cloudera
2 13 (10.66%) Oracle
3 9 (7.38%) Databricks
4 8 (6.56%) Hortonworks
5 6 (4.92%) Informatica
5 6 (4.92%) Talend
6 5 (4.10%) SolarWinds
6 5 (4.10%) Tableau
7 3 (2.46%) Adobe
7 3 (2.46%) Google
7 3 (2.46%) MapR
7 3 (2.46%) Splunk
8 2 (1.64%) IBM
8 2 (1.64%) Teradata
9 1 (0.82%) Confluent
9 1 (0.82%) Microsoft