Period
to 21 September 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 21 September 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
Central London > City of London
6 months to
21 Sep 2021
Same period 2020 Same period 2019
Rank 243 190 308
Rank change year-on-year -53 +118 +22
Permanent jobs citing HDFS 8 7 16
As % of all permanent jobs advertised in the City of London 0.14% 0.18% 0.16%
As % of the System Software category 0.75% 0.92% 0.83%
Number of salaries quoted 8 7 13
10th Percentile £47,500 " £52,450
25th Percentile £48,438 £63,750 £63,750
Median annual salary (50th Percentile) £57,207 £67,500 £75,000
Median % change year-on-year -15.25% -10.00% -
75th Percentile £69,625 £79,875 £81,250
90th Percentile £79,825 £80,500 £91,290
Central London median annual salary £57,207 £67,500 £75,000
% change year-on-year -15.25% -10.00% -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for system software skills.

All System Software Skills
City of London
Permanent vacancies with a requirement for system software skills 1,069 760 1,938
As % of all permanent IT jobs advertised in the City of London 18.09% 19.69% 19.32%
Number of salaries quoted 994 677 1,781
10th Percentile £42,500 £37,733 £28,500
25th Percentile £56,250 £52,500 £45,000
Median annual salary (50th Percentile) £75,000 £70,000 £65,000
Median % change year-on-year +7.14% +7.69% +8.33%
75th Percentile £95,000 £85,000 £85,000
90th Percentile £105,000 £96,250 £95,000
Central London median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% +8.33%

HDFS
Job Vacancy Trend in the City of London

Job postings citing HDFS as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for HDFS in the City of London

HDFS
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing HDFS in the City of London.

Salary trend for HDFS in the City of London

HDFS
Salary Histogram in the City of London

Salary distribution for jobs citing HDFS in the City of London over the 6 months to 21 September 2021.

Salary histogram for HDFS in the City of London

For the 6 months to 21 September 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for HDFS.

1 8 (100.00%) Java
1 8 (100.00%) SQL
1 8 (100.00%) Hadoop
2 7 (87.50%) Apache Hive
3 6 (75.00%) Impala
3 6 (75.00%) Data Modelling
4 5 (62.50%) Python
4 5 (62.50%) Agile Software Development
4 5 (62.50%) Software Engineering
4 5 (62.50%) Analytics
5 4 (50.00%) Amazon Redshift
5 4 (50.00%) Process Improvement
5 4 (50.00%) Public Sector
5 4 (50.00%) Requirements Gathering
5 4 (50.00%) Software Testing
5 4 (50.00%) Informatica
5 4 (50.00%) PostgreSQL
5 4 (50.00%) Scrum
5 4 (50.00%) Data Warehouse
5 4 (50.00%) Unix
5 4 (50.00%) ETL
5 4 (50.00%) SAS
5 4 (50.00%) MySQL
5 4 (50.00%) Oracle
5 4 (50.00%) PL/SQL
5 4 (50.00%) Mentoring
5 4 (50.00%) Coaching
5 4 (50.00%) Apache Spark
5 4 (50.00%) HiveQL
5 4 (50.00%) Software Delivery

HDFS
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (50.00%) Apache Spark
1 4 (50.00%) SAS
2 1 (12.50%) Apache
2 1 (12.50%) Apache Airflow
Cloud Services
1 1 (12.50%) Azure
1 1 (12.50%) PaaS
1 1 (12.50%) Power Platform
1 1 (12.50%) SaaS
Database & Business Intelligence
1 8 (100.00%) Hadoop
2 7 (87.50%) Apache Hive
3 6 (75.00%) Impala
4 4 (50.00%) Amazon Redshift
4 4 (50.00%) Data Warehouse
4 4 (50.00%) MySQL
4 4 (50.00%) Pentaho
4 4 (50.00%) PostgreSQL
5 3 (37.50%) Big Data
5 3 (37.50%) NoSQL
6 1 (12.50%) Data Lake
6 1 (12.50%) DB2
6 1 (12.50%) HDInsight
6 1 (12.50%) Power BI
6 1 (12.50%) Qlik Sense
General
1 4 (50.00%) Public Sector
2 1 (12.50%) Banking
2 1 (12.50%) Finance
Job Titles
1 6 (75.00%) Data Engineer
2 4 (50.00%) Informatica Engineer
3 2 (25.00%) Senior Data Engineer
4 1 (12.50%) Data Analytics Engineer
4 1 (12.50%) Software Engineer
4 1 (12.50%) Technical Leader
Libraries, Frameworks & Software Standards
1 1 (12.50%) AngularJS
1 1 (12.50%) HTML
1 1 (12.50%) Kafka
1 1 (12.50%) RESTful
Miscellaneous
1 1 (12.50%) Equities
Operating Systems
1 4 (50.00%) Unix
Processes & Methodologies
1 6 (75.00%) Data Modelling
2 5 (62.50%) Agile Software Development
2 5 (62.50%) Analytics
2 5 (62.50%) Software Engineering
3 4 (50.00%) Coaching
3 4 (50.00%) ETL
3 4 (50.00%) Mentoring
3 4 (50.00%) Process Improvement
3 4 (50.00%) Requirements Gathering
3 4 (50.00%) Scrum
3 4 (50.00%) Software Delivery
3 4 (50.00%) Software Testing
4 3 (37.50%) Data Engineering
4 3 (37.50%) Technical Leadership
5 1 (12.50%) API Integration
5 1 (12.50%) Business Intelligence
5 1 (12.50%) Continuous Deployment
5 1 (12.50%) Data Strategy
5 1 (12.50%) Migration
5 1 (12.50%) Technology Roadmap
Programming Languages
1 8 (100.00%) Java
1 8 (100.00%) SQL
2 5 (62.50%) Python
3 4 (50.00%) HiveQL
3 4 (50.00%) PL/SQL
4 2 (25.00%) Scala
5 1 (12.50%) JavaScript
Qualifications
1 2 (25.00%) SC Cleared
1 2 (25.00%) Security Cleared
Quality Assurance & Compliance
1 1 (12.50%) GDPR
1 1 (12.50%) QA
Vendors
1 4 (50.00%) Informatica
1 4 (50.00%) Oracle
1 4 (50.00%) Talend
2 3 (37.50%) Cloudera
3 1 (12.50%) Microsoft