Period
to 22 April 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 22 April 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > London
6 months to
22 Apr 2021
Same period 2020 Same period 2019
Rank 535 641 606
Rank change year-on-year +106 -35 +3
Permanent jobs citing HDFS 42 37 167
As % of all permanent jobs advertised in London 0.13% 0.083% 0.28%
As % of the System Software category 0.67% 0.46% 1.68%
Number of salaries quoted 23 31 131
10th Percentile " £57,500 £52,500
25th Percentile £52,500 £62,500 £57,500
Median annual salary (50th Percentile) £65,000 £75,000 £75,000
Median % change year-on-year -13.33% - -
75th Percentile £81,125 £85,000 £82,500
90th Percentile £85,000 " £95,000
England median annual salary £60,000 £75,000 £70,000
% change year-on-year -20.00% +7.14% -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for system software skills.

All System Software Skills
London
Permanent vacancies with a requirement for system software skills 6,291 8,018 9,944
As % of all permanent IT jobs advertised in London 19.96% 17.98% 16.43%
Number of salaries quoted 4,989 6,745 8,337
10th Percentile £40,000 £31,500 £30,000
25th Percentile £52,500 £45,000 £42,500
Median annual salary (50th Percentile) £70,000 £65,000 £60,000
Median % change year-on-year +7.69% +8.33% +4.35%
75th Percentile £87,500 £83,750 £80,000
90th Percentile £100,000 £97,500 £95,000
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

HDFS
Job Vacancy Trend in London

Job postings citing HDFS as a proportion of all IT jobs advertised in London.

Job vacancy trend for HDFS in London

HDFS
Salary Trend in London

3-month moving average salary quoted in jobs citing HDFS in London.

Salary trend for HDFS in London

HDFS
Salary Histogram in London

Salary distribution for jobs citing HDFS in London over the 6 months to 22 April 2021.

Salary histogram for HDFS in London

HDFS
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the London region over the 6 months to 22 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +65 8 £60,000 -20.00%
HDFS
England

For the 6 months to 22 April 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for HDFS.

1 42 (100.00%) Hadoop
2 40 (95.24%) SQL
3 36 (85.71%) Apache Hive
4 32 (76.19%) Azure
5 31 (73.81%) Java
6 29 (69.05%) ETL
7 28 (66.67%) Python
8 27 (64.29%) AWS
9 23 (54.76%) Big Data
9 23 (54.76%) Analytics
10 21 (50.00%) Cloudera
11 19 (45.24%) Agile Software Development
11 19 (45.24%) Power BI
11 19 (45.24%) Power Platform
12 18 (42.86%) Oracle
12 18 (42.86%) Degree
13 17 (40.48%) Data Analytics
13 17 (40.48%) Talend
13 17 (40.48%) JavaScript
13 17 (40.48%) PL/SQL
13 17 (40.48%) Informatica
13 17 (40.48%) Software Engineering
13 17 (40.48%) Problem-Solving
13 17 (40.48%) Oracle Database
14 16 (38.10%) BusinessObjects
14 16 (38.10%) Computer Science
15 15 (35.71%) Pentaho
15 15 (35.71%) Shell Script
15 15 (35.71%) SAS
15 15 (35.71%) Unix

HDFS
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 15 (35.71%) SAS
2 11 (26.19%) Apache Spark
3 5 (11.90%) Apache
4 2 (4.76%) Apache Airflow
5 1 (2.38%) Apache Pig
5 1 (2.38%) Elasticsearch
Cloud Services
1 32 (76.19%) Azure
2 27 (64.29%) AWS
3 19 (45.24%) Power Platform
4 9 (21.43%) GCP
5 8 (19.05%) Amazon S3
5 8 (19.05%) Azure Synapse Analytics
6 4 (9.52%) Azure Data Factory
6 4 (9.52%) PaaS
6 4 (9.52%) SaaS
7 3 (7.14%) Cloud Computing
8 2 (4.76%) IaaS
9 1 (2.38%) Amazon EMR
Communications & Networking
1 8 (19.05%) FTP
2 2 (4.76%) SMS
Database & Business Intelligence
1 42 (100.00%) Hadoop
2 36 (85.71%) Apache Hive
3 23 (54.76%) Big Data
4 19 (45.24%) Power BI
5 17 (40.48%) Oracle Database
6 16 (38.10%) BusinessObjects
7 15 (35.71%) Impala
7 15 (35.71%) Pentaho
8 11 (26.19%) HBase
9 9 (21.43%) Relational Database
9 9 (21.43%) SQL Server
10 8 (19.05%) Azure SQL Database
10 8 (19.05%) Data Lake
10 8 (19.05%) SAP HANA
11 7 (16.67%) MongoDB
11 7 (16.67%) NoSQL
12 6 (14.29%) MariaDB
12 6 (14.29%) MySQL
12 6 (14.29%) OLAP
12 6 (14.29%) OLTP
Development Applications
1 10 (23.81%) Git (software)
2 8 (19.05%) ER Studio
2 8 (19.05%) ERwin
2 8 (19.05%) Subversion
3 3 (7.14%) Maven
4 2 (4.76%) Eclipse
4 2 (4.76%) IBM UrbanCode
4 2 (4.76%) IntelliJ
4 2 (4.76%) Jenkins
4 2 (4.76%) Postman
4 2 (4.76%) SoapUI
5 1 (2.38%) GitLab
General
1 6 (14.29%) Advertising
2 5 (11.90%) Marketing
3 1 (2.38%) Finance
Job Titles
1 16 (38.10%) Data Engineer
2 8 (19.05%) Developer
2 8 (19.05%) ETL Developer
3 7 (16.67%) Architect
4 6 (14.29%) Administrator
4 6 (14.29%) DBA
4 6 (14.29%) Senior DBA
5 5 (11.90%) Solutions Architect
6 4 (9.52%) Azure Developer
6 4 (9.52%) SSAS Developer
6 4 (9.52%) SSIS Developer
6 4 (9.52%) SSRS Developer
7 2 (4.76%) Big Data Architect
7 2 (4.76%) Big Data Solutions Architect
7 2 (4.76%) Data Architect
7 2 (4.76%) Software Engineer
8 1 (2.38%) Cloud Architect
8 1 (2.38%) Lead Architect
8 1 (2.38%) Lead Data Architect
8 1 (2.38%) Technical Leader
Libraries, Frameworks & Software Standards
1 8 (19.05%) AngularJS
1 8 (19.05%) Kafka
2 6 (14.29%) Hibernate
3 4 (9.52%) Spark Streaming
4 3 (7.14%) PySpark
5 2 (4.76%) HTML
5 2 (4.76%) JSON
5 2 (4.76%) REST
5 2 (4.76%) SOAP
5 2 (4.76%) Spring
5 2 (4.76%) Spring Boot
5 2 (4.76%) Web Services
6 1 (2.38%) Apache NiFi
Miscellaneous
1 12 (28.57%) Analytical Skills
2 10 (23.81%) Virtual Team
3 6 (14.29%) Replication
4 4 (9.52%) Social Media
5 2 (4.76%) User Experience
Operating Systems
1 15 (35.71%) Unix
2 6 (14.29%) Linux
Processes & Methodologies
1 29 (69.05%) ETL
2 23 (54.76%) Analytics
3 19 (45.24%) Agile Software Development
4 17 (40.48%) Data Analytics
4 17 (40.48%) Problem-Solving
4 17 (40.48%) Software Engineering
5 16 (38.10%) Computer Science
6 15 (35.71%) Requirements Gathering
7 14 (33.33%) Data Engineering
8 12 (28.57%) Technical Leadership
9 10 (23.81%) Business Intelligence
10 9 (21.43%) Data Modelling
10 9 (21.43%) Metadata Management
10 9 (21.43%) Open Source
11 8 (19.05%) Coaching
11 8 (19.05%) Mentoring
11 8 (19.05%) Process Improvement
11 8 (19.05%) Scrum
11 8 (19.05%) Software Delivery
11 8 (19.05%) Software Testing
Programming Languages
1 40 (95.24%) SQL
2 31 (73.81%) Java
3 28 (66.67%) Python
4 17 (40.48%) JavaScript
4 17 (40.48%) PL/SQL
5 15 (35.71%) HiveQL
5 15 (35.71%) Shell Script
6 7 (16.67%) Scala
7 6 (14.29%) Bash Shell
7 6 (14.29%) Perl
7 6 (14.29%) PHP
Qualifications
1 18 (42.86%) Degree
2 8 (19.05%) BPSS Clearance
2 8 (19.05%) Computer Science Degree
Quality Assurance & Compliance
1 2 (4.76%) QA
2 1 (2.38%) Data Quality
2 1 (2.38%) GDPR
System Software
1 2 (4.76%) Docker
2 1 (2.38%) Apache Flume
Systems Management
1 6 (14.29%) Ansible
1 6 (14.29%) Opscode Chef
1 6 (14.29%) Puppet
2 2 (4.76%) Kubernetes
3 1 (2.38%) Hadoop YARN
3 1 (2.38%) Oozie
Vendors
1 21 (50.00%) Cloudera
2 18 (42.86%) Oracle
3 17 (40.48%) Informatica
3 17 (40.48%) Talend
4 12 (28.57%) Google
5 10 (23.81%) Databricks
6 8 (19.05%) Salesforce.com
6 8 (19.05%) SAP
7 6 (14.29%) Facebook
7 6 (14.29%) Marin
8 4 (9.52%) Hortonworks
9 2 (4.76%) Ab Initio
9 2 (4.76%) Cognos
9 2 (4.76%) Microsoft
9 2 (4.76%) Splunk
10 1 (2.38%) MicroStrategy
10 1 (2.38%) Netezza
10 1 (2.38%) Teradata