Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 25 January 2022

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 25 January 2022 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > London
6 months to
25 Jan 2022		 Same period 2021 Same period 2020
Rank 682 468 615
Rank change year-on-year -214 +147 +3
Permanent jobs citing HDFS 52 52 112
As % of all permanent jobs advertised in London 0.10% 0.22% 0.22%
As % of the System Software category 0.55% 1.13% 1.24%
Number of salaries quoted 32 18 107
10th Percentile £46,250 £52,500 £58,550
25th Percentile £47,500 £58,500 £68,750
Median annual salary (50th Percentile) £57,500 £67,500 £77,000
Median % change year-on-year -14.81% -12.34% +2.67%
75th Percentile £75,000 £91,875 £85,000
90th Percentile £82,500 £100,500 £93,320
England median annual salary £57,500 £60,000 £75,000
% change year-on-year -4.17% -20.00% +7.14%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for system software skills.

All System Software Skills
London
Permanent vacancies with a requirement for system software skills 9,511 4,594 9,025
As % of all permanent IT jobs advertised in London 18.58% 19.07% 17.75%
Number of salaries quoted 6,316 3,963 7,530
10th Percentile £35,000 £40,000 £29,500
25th Percentile £50,000 £52,500 £41,250
Median annual salary (50th Percentile) £70,000 £70,000 £62,500
Median % change year-on-year - +12.00% +4.17%
75th Percentile £92,500 £85,000 £81,250
90th Percentile £112,500 £100,000 £95,000
England median annual salary £56,000 £55,000 £50,000
% change year-on-year +1.82% +10.00% -

HDFS
Job Vacancy Trend in London

Job postings citing HDFS as a proportion of all IT jobs advertised in London.

Job vacancy trend for HDFS in London

HDFS
Salary Trend in London

3-month moving average salary quoted in jobs citing HDFS in London.

Salary trend for HDFS in London

HDFS
Salary Histogram in London

Salary distribution for jobs citing HDFS in London over the 6 months to 25 January 2022.

Salary histogram for HDFS in London

HDFS
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the London region over the 6 months to 25 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
Central London -41 11 £57,500 -14.81% 1
HDFS
England

For the 6 months to 25 January 2022, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for HDFS.

1 52 (100.00%) Hadoop
2 43 (82.69%) Apache Hive
3 39 (75.00%) Python
4 35 (67.31%) Java
5 34 (65.38%) SQL
5 34 (65.38%) Agile Software Development
5 34 (65.38%) Analytics
6 32 (61.54%) Data Warehouse
7 26 (50.00%) Data Modelling
7 26 (50.00%) AWS
8 25 (48.08%) Apache Spark
8 25 (48.08%) Impala
9 24 (46.15%) PL/SQL
9 24 (46.15%) MySQL
9 24 (46.15%) Oracle
9 24 (46.15%) Software Engineering
10 23 (44.23%) PostgreSQL
10 23 (44.23%) ETL
11 22 (42.31%) Informatica
11 22 (42.31%) Talend
12 21 (40.38%) Pentaho
12 21 (40.38%) SAS
12 21 (40.38%) Unix
12 21 (40.38%) Scrum
12 21 (40.38%) Amazon Redshift
12 21 (40.38%) HiveQL
13 20 (38.46%) Mentoring
14 19 (36.54%) Azure
15 18 (34.62%) Scala
16 17 (32.69%) HBase

HDFS
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 25 (48.08%) Apache Spark
2 21 (40.38%) SAS
3 6 (11.54%) Elasticsearch
4 4 (7.69%) Confluence
5 2 (3.85%) Apache
5 2 (3.85%) Apache Pig
Applications
1 1 (1.92%) Chatbot
Cloud Services
1 26 (50.00%) AWS
2 19 (36.54%) Azure
3 15 (28.85%) GCP
4 8 (15.38%) Amazon EMR
4 8 (15.38%) Amazon Kinesis
4 8 (15.38%) Amazon S3
4 8 (15.38%) AWS Lambda
4 8 (15.38%) Serverless
5 6 (11.54%) Power Platform
6 4 (7.69%) Tricentis Tosca
7 3 (5.77%) Azure Machine Learning
8 2 (3.85%) Azure Cosmos DB
8 2 (3.85%) Azure Data Factory
8 2 (3.85%) Azure Synapse Analytics
Communications & Networking
1 3 (5.77%) Internet
1 3 (5.77%) SMS
2 1 (1.92%) Kerberos
Database & Business Intelligence
1 52 (100.00%) Hadoop
2 43 (82.69%) Apache Hive
3 32 (61.54%) Data Warehouse
4 25 (48.08%) Impala
5 24 (46.15%) MySQL
6 23 (44.23%) PostgreSQL
7 21 (40.38%) Amazon Redshift
7 21 (40.38%) Pentaho
8 17 (32.69%) HBase
9 12 (23.08%) Big Data
10 11 (21.15%) Data Lake
11 9 (17.31%) Amazon RDS
12 8 (15.38%) Amazon Athena
12 8 (15.38%) Amazon Aurora
12 8 (15.38%) Amazon DynamoDB
12 8 (15.38%) Electronic Patient Records
12 8 (15.38%) NoSQL
13 6 (11.54%) Power BI
14 5 (9.62%) BusinessObjects
15 4 (7.69%) Apache Cassandra
Development Applications
1 10 (19.23%) Git (software)
2 9 (17.31%) GitLab
2 9 (17.31%) Jenkins
3 4 (7.69%) Bitbucket
3 4 (7.69%) JIRA
4 3 (5.77%) Eclipse
4 3 (5.77%) IBM UrbanCode
4 3 (5.77%) IntelliJ
4 3 (5.77%) Maven
4 3 (5.77%) Postman
4 3 (5.77%) SoapUI
5 1 (1.92%) MLflow
5 1 (1.92%) Subversion
General
1 17 (32.69%) Public Sector
2 10 (19.23%) Marketing
3 4 (7.69%) Analytical Skills
3 4 (7.69%) Social Skills
4 3 (5.77%) Banking
4 3 (5.77%) Finance
4 3 (5.77%) Retail
4 3 (5.77%) Retail Banking
5 2 (3.85%) Inclusion and Diversity
5 2 (3.85%) Law
6 1 (1.92%) Financial Institution
6 1 (1.92%) Legal
6 1 (1.92%) Presentation Skills
Job Titles
1 33 (63.46%) Data Engineer
2 9 (17.31%) Informatica Engineer
3 8 (15.38%) AWS Engineer
4 5 (9.62%) Data Scientist
5 4 (7.69%) Cloud Engineer
5 4 (7.69%) Developer
6 3 (5.77%) Big Data Engineer
6 3 (5.77%) Hadoop Developer
6 3 (5.77%) Java Engineer
6 3 (5.77%) Senior Java Engineer
7 2 (3.85%) Azure Engineer
7 2 (3.85%) DevOps Engineer
7 2 (3.85%) Senior Data Engineer
7 2 (3.85%) Senior Data Scientist
7 2 (3.85%) Software Engineer
8 1 (1.92%) Big Data Developer
8 1 (1.92%) Cloud Architect
8 1 (1.92%) Hadoop Engineer
8 1 (1.92%) Java Hadoop Developer
8 1 (1.92%) Senior Hadoop Engineer
Libraries, Frameworks & Software Standards
1 5 (9.62%) Kafka
2 4 (7.69%) TensorFlow
3 3 (5.77%) JSON
3 3 (5.77%) REST
3 3 (5.77%) SOAP
3 3 (5.77%) Spring
3 3 (5.77%) Spring Boot
3 3 (5.77%) Web Services
4 2 (3.85%) Keras
4 2 (3.85%) PyTorch
4 2 (3.85%) scikit-learn
5 1 (1.92%) Apache Beam
5 1 (1.92%) Hibernate
5 1 (1.92%) Matplotlib
5 1 (1.92%) Node.js
5 1 (1.92%) NumPy
5 1 (1.92%) Pandas
5 1 (1.92%) PySpark
5 1 (1.92%) SciPy
Miscellaneous
1 3 (5.77%) Algorithms
1 3 (5.77%) Online Banking
1 3 (5.77%) Virtual Team
2 2 (3.85%) Hybrid Cloud
2 2 (3.85%) Social Network
3 1 (1.92%) Data Structures
3 1 (1.92%) Social Media
Operating Systems
1 21 (40.38%) Unix
2 6 (11.54%) Linux
Processes & Methodologies
1 34 (65.38%) Agile Software Development
1 34 (65.38%) Analytics
2 26 (50.00%) Data Modelling
3 24 (46.15%) Software Engineering
4 23 (44.23%) ETL
5 21 (40.38%) Scrum
6 20 (38.46%) Mentoring
7 17 (32.69%) Requirements Gathering
7 17 (32.69%) Software Delivery
7 17 (32.69%) Software Testing
8 16 (30.77%) Coaching
9 15 (28.85%) Data Science
9 15 (28.85%) Process Improvement
10 14 (26.92%) Artificial Intelligence
11 13 (25.00%) Data Engineering
11 13 (25.00%) Machine Learning
12 11 (21.15%) Data Pipeline
12 11 (21.15%) DevOps
13 10 (19.23%) Deep Learning
14 9 (17.31%) CI/CD
Programming Languages
1 39 (75.00%) Python
2 35 (67.31%) Java
3 34 (65.38%) SQL
4 24 (46.15%) PL/SQL
5 21 (40.38%) HiveQL
6 18 (34.62%) Scala
7 5 (9.62%) R
8 2 (3.85%) Shell Script
9 1 (1.92%) Bash
9 1 (1.92%) HQL
9 1 (1.92%) JavaScript
9 1 (1.92%) Pig Latin
Qualifications
1 3 (5.77%) PhD
2 1 (1.92%) Computer Science Degree
2 1 (1.92%) Degree
2 1 (1.92%) SC Cleared
2 1 (1.92%) Security Cleared
System Software
1 12 (23.08%) Docker
2 3 (5.77%) Apache ZooKeeper
3 2 (3.85%) Apache Flume
Systems Management
1 14 (26.92%) Kubernetes
2 7 (13.46%) Ansible
3 2 (3.85%) Hadoop YARN
4 1 (1.92%) Kubeflow
4 1 (1.92%) Puppet
Vendors
1 24 (46.15%) Oracle
2 22 (42.31%) Informatica
2 22 (42.31%) Talend
3 8 (15.38%) Cognizant
4 3 (5.77%) Splunk
5 2 (3.85%) Ab Initio
5 2 (3.85%) Databricks
5 2 (3.85%) Microsoft
6 1 (1.92%) Cognos
6 1 (1.92%) MicroStrategy