Period
to 9 May 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 9 May 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
Central London > City of London
6 months to
9 May 2021
Same period 2020 Same period 2019
Rank 225 264 291
Rank change year-on-year +39 +27 +24
Permanent jobs citing HDFS 8 11 31
As % of all permanent jobs advertised in the City of London 0.16% 0.15% 0.31%
As % of the System Software category 0.83% 0.79% 1.73%
Number of salaries quoted 8 10 25
10th Percentile £48,750 £62,500 "
25th Percentile £51,563 £70,000 £49,337
Median annual salary (50th Percentile) £60,000 £75,000 £75,000
Median % change year-on-year -20.00% - +7.14%
75th Percentile £67,500 £80,000 £82,500
90th Percentile £71,175 £80,125 "
Central London median annual salary £60,000 £75,000 £75,000
% change year-on-year -20.00% - +7.14%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for system software skills.

All System Software Skills
City of London
Permanent vacancies with a requirement for system software skills 969 1,401 1,794
As % of all permanent IT jobs advertised in the City of London 19.53% 18.61% 17.81%
Number of salaries quoted 867 1,246 1,627
10th Percentile £46,250 £31,250 £30,500
25th Percentile £57,500 £46,250 £45,000
Median annual salary (50th Percentile) £75,000 £67,500 £65,000
Median % change year-on-year +11.11% +3.85% +13.04%
75th Percentile £92,500 £85,000 £82,500
90th Percentile £102,500 £98,125 £95,000
Central London median annual salary £72,500 £65,000 £62,500
% change year-on-year +11.54% +4.00% +11.11%

HDFS
Job Vacancy Trend in the City of London

Job postings citing HDFS as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for HDFS in the City of London

HDFS
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing HDFS in the City of London.

Salary trend for HDFS in the City of London

HDFS
Salary Histogram in the City of London

Salary distribution for jobs citing HDFS in the City of London over the 6 months to 9 May 2021.

Salary histogram for HDFS in the City of London

For the 6 months to 9 May 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for HDFS.

1 8 (100.00%) SQL
1 8 (100.00%) Java
1 8 (100.00%) JavaScript
1 8 (100.00%) Hadoop
1 8 (100.00%) Azure
1 8 (100.00%) Apache Hive
1 8 (100.00%) Cloudera
1 8 (100.00%) Data Engineering
1 8 (100.00%) Power BI
1 8 (100.00%) Power Platform
2 7 (87.50%) HiveQL
2 7 (87.50%) Talend
2 7 (87.50%) Requirements Gathering
2 7 (87.50%) Data Analytics
2 7 (87.50%) Analytics
2 7 (87.50%) Oracle Database
2 7 (87.50%) Impala
2 7 (87.50%) AWS
2 7 (87.50%) PL/SQL
2 7 (87.50%) Pentaho
2 7 (87.50%) Oracle
2 7 (87.50%) Unix
2 7 (87.50%) Python
2 7 (87.50%) ETL
2 7 (87.50%) SAS
2 7 (87.50%) BusinessObjects
2 7 (87.50%) Informatica
2 7 (87.50%) Shell Script
3 1 (12.50%) Information Security
3 1 (12.50%) Agile Software Development

HDFS
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (87.50%) SAS
2 1 (12.50%) Apache
2 1 (12.50%) Apache Airflow
2 1 (12.50%) Apache Spark
Cloud Services
1 8 (100.00%) Azure
1 8 (100.00%) Power Platform
2 7 (87.50%) AWS
3 1 (12.50%) PaaS
3 1 (12.50%) SaaS
Database & Business Intelligence
1 8 (100.00%) Apache Hive
1 8 (100.00%) Hadoop
1 8 (100.00%) Power BI
2 7 (87.50%) BusinessObjects
2 7 (87.50%) Impala
2 7 (87.50%) Oracle Database
2 7 (87.50%) Pentaho
3 1 (12.50%) Data Lake
3 1 (12.50%) HDInsight
3 1 (12.50%) NoSQL
3 1 (12.50%) Qlik Sense
Job Titles
1 7 (87.50%) Data Engineer
2 1 (12.50%) Technical Leader
Libraries, Frameworks & Software Standards
1 1 (12.50%) AngularJS
1 1 (12.50%) HTML
Operating Systems
1 7 (87.50%) Unix
Processes & Methodologies
1 8 (100.00%) Data Engineering
2 7 (87.50%) Analytics
2 7 (87.50%) Data Analytics
2 7 (87.50%) ETL
2 7 (87.50%) Requirements Gathering
3 1 (12.50%) Agile Software Development
3 1 (12.50%) Business Intelligence
3 1 (12.50%) Continuous Deployment
3 1 (12.50%) Continuous Integration
3 1 (12.50%) Data Architecture
3 1 (12.50%) Data Strategy
3 1 (12.50%) DevOps
3 1 (12.50%) Enterprise Architecture
3 1 (12.50%) Information Security
3 1 (12.50%) Open Source
3 1 (12.50%) TDD
3 1 (12.50%) Technical Leadership
3 1 (12.50%) Technology Roadmap
3 1 (12.50%) Test Automation
Programming Languages
1 8 (100.00%) Java
1 8 (100.00%) JavaScript
1 8 (100.00%) SQL
2 7 (87.50%) HiveQL
2 7 (87.50%) PL/SQL
2 7 (87.50%) Python
2 7 (87.50%) Shell Script
Quality Assurance & Compliance
1 1 (12.50%) GDPR
1 1 (12.50%) QA
Vendors
1 8 (100.00%) Cloudera
2 7 (87.50%) Informatica
2 7 (87.50%) Oracle
2 7 (87.50%) Talend
3 1 (12.50%) Microsoft