Period
to 9 May 2021

The following table provides summary statistics for permanent job vacancies advertised in Yorkshire with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 9 May 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > Yorkshire
6 months to
9 May 2021
Same period 2020 Same period 2019
Rank 215 213 276
Rank change year-on-year -2 +63 +31
Permanent jobs citing HDFS 9 6 19
As % of all permanent jobs advertised in Yorkshire 0.18% 0.12% 0.25%
As % of the System Software category 0.81% 0.75% 1.39%
Number of salaries quoted 6 5 18
10th Percentile " " £42,625
25th Percentile £50,000 £50,000 "
Median annual salary (50th Percentile) £55,000 £54,671 £49,337
Median % change year-on-year +0.60% +10.81% -6.02%
75th Percentile £60,000 £60,000 £63,354
90th Percentile " " "
England median annual salary £60,000 £75,000 £65,000
% change year-on-year -20.00% +15.38% -7.14%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Yorkshire with a requirement for system software skills.

All System Software Skills
Yorkshire
Permanent vacancies with a requirement for system software skills 1,112 795 1,369
As % of all permanent IT jobs advertised in Yorkshire 22.03% 16.06% 18.37%
Number of salaries quoted 1,015 698 1,233
10th Percentile £24,000 £25,000 £21,000
25th Percentile £33,625 £34,313 £26,250
Median annual salary (50th Percentile) £47,500 £45,000 £37,500
Median % change year-on-year +5.56% +20.00% -
75th Percentile £63,750 £58,750 £48,750
90th Percentile £72,500 £70,000 £57,500
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

HDFS
Job Vacancy Trend in Yorkshire

Job postings citing HDFS as a proportion of all IT jobs advertised in Yorkshire.

Job vacancy trend for HDFS in Yorkshire

HDFS
Salary Trend in Yorkshire

3-month moving average salary quoted in jobs citing HDFS in Yorkshire.

Salary trend for HDFS in Yorkshire

HDFS
Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the Yorkshire region over the 6 months to 9 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
West Yorkshire +7 9 £55,000 +0.60%
HDFS
England

For the 6 months to 9 May 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Yorkshire region with a requirement for HDFS.

1 9 (100.00%) Python
1 9 (100.00%) Hadoop
1 9 (100.00%) Big Data
1 9 (100.00%) Apache Hive
1 9 (100.00%) Apache Spark
2 8 (88.89%) HBase
2 8 (88.89%) Kafka
3 7 (77.78%) Hadoop YARN
3 7 (77.78%) DevOps
4 6 (66.67%) Opsview
4 6 (66.67%) Puppet
4 6 (66.67%) Graphite
4 6 (66.67%) Kubernetes
4 6 (66.67%) Software Delivery
4 6 (66.67%) SDLC
4 6 (66.67%) Data Engineering
4 6 (66.67%) Terraform
4 6 (66.67%) AWS
4 6 (66.67%) Bash Shell
4 6 (66.67%) Sqoop
4 6 (66.67%) Jenkins
4 6 (66.67%) Opscode Chef
4 6 (66.67%) Ansible
4 6 (66.67%) Docker
4 6 (66.67%) Red Hat Enterprise Linux
4 6 (66.67%) Git (software)
4 6 (66.67%) Web Services
4 6 (66.67%) Linux
4 6 (66.67%) Nagios
4 6 (66.67%) Configuration Management

HDFS
Co-occurring IT Skills in Yorkshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 9 (100.00%) Apache Spark
2 2 (22.22%) Apache
Cloud Services
1 6 (66.67%) AWS
2 1 (11.11%) Azure
2 1 (11.11%) Azure Data Factory
2 1 (11.11%) Azure Synapse Analytics
2 1 (11.11%) Power Platform
Database & Business Intelligence
1 9 (100.00%) Apache Hive
1 9 (100.00%) Big Data
1 9 (100.00%) Hadoop
2 8 (88.89%) HBase
3 6 (66.67%) Sqoop
4 3 (33.33%) Data Lake
5 1 (11.11%) Power BI
5 1 (11.11%) Spark SQL
5 1 (11.11%) SQL Server Integration Services
Development Applications
1 6 (66.67%) Git (software)
1 6 (66.67%) Jenkins
2 2 (22.22%) Maven
General
1 2 (22.22%) Finance
Job Titles
1 6 (66.67%) DevOps Engineer
2 3 (33.33%) Data Engineer
2 3 (33.33%) Senior DevOps
2 3 (33.33%) Senior DevOps Engineer
3 2 (22.22%) Big Data Engineer
3 2 (22.22%) Scala Engineer
4 1 (11.11%) Cloud Engineer
4 1 (11.11%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 8 (88.89%) Kafka
2 6 (66.67%) Web Services
3 1 (11.11%) PySpark
Miscellaneous
1 1 (11.11%) Data Structures
Operating Systems
1 6 (66.67%) Linux
1 6 (66.67%) Red Hat Enterprise Linux
Processes & Methodologies
1 7 (77.78%) DevOps
2 6 (66.67%) Configuration Management
2 6 (66.67%) Data Engineering
2 6 (66.67%) SDLC
2 6 (66.67%) Software Delivery
3 2 (22.22%) Software Engineering
4 1 (11.11%) Agile Software Development
4 1 (11.11%) Analytics
4 1 (11.11%) Business Intelligence
4 1 (11.11%) Data Migration
4 1 (11.11%) Data Modelling
4 1 (11.11%) Event-Driven Architecture
4 1 (11.11%) Memory Management
4 1 (11.11%) Migration
4 1 (11.11%) Performance Optimisation
4 1 (11.11%) TDD
4 1 (11.11%) Visualisation
Programming Languages
1 9 (100.00%) Python
2 6 (66.67%) Bash Shell
3 3 (33.33%) Scala
4 1 (11.11%) SQL
4 1 (11.11%) T-SQL
System Software
1 6 (66.67%) Docker
Systems Management
1 7 (77.78%) Hadoop YARN
2 6 (66.67%) Ansible
2 6 (66.67%) Graphite
2 6 (66.67%) Kubernetes
2 6 (66.67%) Nagios
2 6 (66.67%) Opscode Chef
2 6 (66.67%) Opsview
2 6 (66.67%) Puppet
2 6 (66.67%) Terraform
3 2 (22.22%) Oozie
Vendors
1 1 (11.11%) Databricks