Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for permanent job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 23 May 2022 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK
6 months to
23 May 2022		 Same period 2021 Same period 2020
Rank 1113 769 805
Rank change year-on-year -344 +36 +64
Permanent jobs citing HDFS 93 125 96
As % of all permanent jobs advertised in the UK 0.057% 0.14% 0.10%
As % of the System Software category 0.31% 0.73% 0.60%
Number of salaries quoted 40 44 75
10th Percentile - £49,050 £50,000
25th Percentile £48,750 £50,000 £61,875
Median annual salary (50th Percentile) £72,500 £60,000 £75,000
Median % change year-on-year +20.83% -20.00% +15.38%
75th Percentile £110,000 £72,813 £84,375
90th Percentile £125,000 £84,400 £105,000
UK excluding London median annual salary £57,500 £55,500 £75,000
% change year-on-year +3.60% -26.00% +42.86%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for system software skills.

All System Software Skills
UK
Permanent vacancies with a requirement for system software skills 29,924 17,025 16,088
As % of all permanent IT jobs advertised in the UK 18.36% 18.53% 17.31%
Number of salaries quoted 15,407 13,307 13,246
10th Percentile £28,000 £30,000 £27,000
25th Percentile £38,806 £39,000 £36,250
Median annual salary (50th Percentile) £55,000 £55,000 £52,500
Median % change year-on-year - +4.76% +5.00%
75th Percentile £80,000 £75,000 £72,500
90th Percentile £95,000 £90,000 £87,500
UK excluding London median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% +5.88%

HDFS
Job Vacancy Trend

Job postings citing HDFS as a proportion of all IT jobs advertised.

Job vacancy trend for HDFS in the UK

HDFS
Salary Trend

3-month moving average salary quoted in jobs citing HDFS.

Salary trend for HDFS in the UK

HDFS
Salary Histogram

Salary distribution for jobs citing HDFS over the 6 months to 23 May 2022.

Salary histogram for HDFS in the UK

HDFS
Top 10 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 6 months to 23 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
England -324 71 £72,500 +20.83% 8
London -270 38 £95,000 +46.15% 6
Work from Home -286 33 £95,000 +66.92% 5
UK excluding London -193 27 £57,500 +3.60% 2
South East -128 12 £60,000 -7.69%
North West -74 9 - -
North of England -86 9 - -
West Midlands -41 5 £57,500 -2.13% 1
Midlands -71 5 £57,500 +3.60% 1
Scotland - 1 £67,500 -

For the 6 months to 23 May 2022, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for HDFS.

1 84 (90.32%) Hadoop
2 74 (79.57%) Apache Hive
3 67 (72.04%) Kafka
4 66 (70.97%) Apache Spark
5 62 (66.67%) Java
6 56 (60.22%) HBase
7 53 (56.99%) Python
8 47 (50.54%) ETL
9 44 (47.31%) Agile
10 39 (41.94%) SQL
11 37 (39.78%) Big Data
12 36 (38.71%) Computer Science
13 35 (37.63%) Scala
14 33 (35.48%) Spark Streaming
14 33 (35.48%) AWS
15 32 (34.41%) Hadoop YARN
16 31 (33.33%) Microservices
16 31 (33.33%) Relational Database
16 31 (33.33%) Open Source
16 31 (33.33%) OO
17 29 (31.18%) PostgreSQL
17 29 (31.18%) RESTful
17 29 (31.18%) Apache ZooKeeper
18 28 (30.11%) Analytics
18 28 (30.11%) Apache
19 27 (29.03%) Unix
19 27 (29.03%) Data Warehouse
19 27 (29.03%) Software Engineering
19 27 (29.03%) NoSQL
20 26 (27.96%) Azure

HDFS
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 66 (70.97%) Apache Spark
2 28 (30.11%) Apache
3 13 (13.98%) Apache Pig
4 12 (12.90%) SAS
5 9 (9.68%) GemFire
6 8 (8.60%) Apache Airflow
6 8 (8.60%) Elasticsearch
7 5 (5.38%) Apache Pulsar
8 3 (3.23%) Confluence
Cloud Services
1 33 (35.48%) AWS
2 26 (27.96%) Azure
3 22 (23.66%) Amazon Kinesis
4 21 (22.58%) GCP
5 17 (18.28%) Power Platform
6 9 (9.68%) GitHub
6 9 (9.68%) OpenShift
7 6 (6.45%) Amazon EMR
7 6 (6.45%) Amazon S3
8 5 (5.38%) Snowflake
9 4 (4.30%) AWS Lambda
9 4 (4.30%) Serverless
10 3 (3.23%) Tricentis Tosca
11 2 (2.15%) Amazon EC2
11 2 (2.15%) Amazon ELB
12 1 (1.08%) Azure Machine Learning
Communications & Networking
1 7 (7.53%) Kerberos
Database & Business Intelligence
1 84 (90.32%) Hadoop
2 74 (79.57%) Apache Hive
3 56 (60.22%) HBase
4 37 (39.78%) Big Data
5 31 (33.33%) Relational Database
6 29 (31.18%) PostgreSQL
7 27 (29.03%) Data Warehouse
7 27 (29.03%) NoSQL
8 23 (24.73%) Impala
9 20 (21.51%) Amazon Redshift
9 20 (21.51%) Cloudera CDH
9 20 (21.51%) OLAP
9 20 (21.51%) OLTP
9 20 (21.51%) Presto
9 20 (21.51%) RDBMS
10 18 (19.35%) MongoDB
11 17 (18.28%) Power BI
12 16 (17.20%) MySQL
13 14 (15.05%) Apache Cassandra
14 13 (13.98%) Data Lake
Development Applications
1 14 (15.05%) Jenkins
2 13 (13.98%) Git (software)
3 9 (9.68%) Artifactory
3 9 (9.68%) Cucumber
3 9 (9.68%) Cypress.io
3 9 (9.68%) Eclipse
3 9 (9.68%) Gradle
3 9 (9.68%) IntelliJ
3 9 (9.68%) JUnit
3 9 (9.68%) Mockito
3 9 (9.68%) Protractor
3 9 (9.68%) Sonatype Nexus
3 9 (9.68%) Storybook
4 4 (4.30%) GitLab
5 3 (3.23%) Bitbucket
5 3 (3.23%) JIRA
6 2 (2.15%) Maven
6 2 (2.15%) Subversion
General
1 20 (21.51%) Advertising
2 16 (17.20%) Finance
3 13 (13.98%) Social Skills
4 11 (11.83%) Banking
4 11 (11.83%) Inclusion and Diversity
4 11 (11.83%) Law
4 11 (11.83%) Public Sector
5 4 (4.30%) Marketing
6 3 (3.23%) Mandarin Language
7 2 (2.15%) Games
7 2 (2.15%) Retail
8 1 (1.08%) Influencing Skills
8 1 (1.08%) Manufacturing
Job Titles
1 35 (37.63%) Data Engineer
2 20 (21.51%) Java Engineer
3 10 (10.75%) Data Scientist
4 9 (9.68%) Principal Engineer
5 8 (8.60%) Big Data Engineer
6 7 (7.53%) Database Engineer
6 7 (7.53%) Senior Database Engineer
7 5 (5.38%) Applications Engineer
7 5 (5.38%) Senior Data Engineer
8 4 (4.30%) AWS Engineer
8 4 (4.30%) Consultant
8 4 (4.30%) Principal Software Engineer
8 4 (4.30%) Software Engineer
9 3 (3.23%) Data Consultant
9 3 (3.23%) Developer
9 3 (3.23%) ETL Consultant
9 3 (3.23%) Technical Engineer
10 2 (2.15%) Informatica Engineer
10 2 (2.15%) Lead Software Developer
10 2 (2.15%) Software Developer
Libraries, Frameworks & Software Standards
1 67 (72.04%) Kafka
2 33 (35.48%) Spark Streaming
3 29 (31.18%) RESTful
4 20 (21.51%) Hibernate
5 14 (15.05%) Node.js
6 13 (13.98%) RabbitMQ
7 11 (11.83%) Apache NiFi
7 11 (11.83%) JSON
7 11 (11.83%) Spring
8 10 (10.75%) TensorFlow
9 9 (9.68%) AngularJS
9 9 (9.68%) Express
9 9 (9.68%) ggplot
9 9 (9.68%) Keras
9 9 (9.68%) NumPy
9 9 (9.68%) Play Framework
9 9 (9.68%) React
9 9 (9.68%) Redux
9 9 (9.68%) Twitter Bootstrap
9 9 (9.68%) WireMock
Miscellaneous
1 11 (11.83%) Linux Command Line
2 9 (9.68%) Algorithms
2 9 (9.68%) Management Information System
3 1 (1.08%) Blockchain
3 1 (1.08%) Credit Risk
3 1 (1.08%) Derivative
3 1 (1.08%) Equities
3 1 (1.08%) Foreign Exchange (FX)
3 1 (1.08%) Hybrid Cloud
3 1 (1.08%) Online Games
3 1 (1.08%) Virtual Team
Operating Systems
1 27 (29.03%) Unix
2 24 (25.81%) Linux
3 1 (1.08%) Red Hat Enterprise Linux
Processes & Methodologies
1 47 (50.54%) ETL
2 44 (47.31%) Agile
3 36 (38.71%) Computer Science
4 31 (33.33%) Microservices
4 31 (33.33%) OO
4 31 (33.33%) Open Source
5 28 (30.11%) Analytics
6 27 (29.03%) Software Engineering
7 22 (23.66%) Data Modelling
8 21 (22.58%) Data Science
8 21 (22.58%) Problem-Solving
9 20 (21.51%) Critical Thinking
10 19 (20.43%) CI/CD
10 19 (20.43%) Software Testing
11 17 (18.28%) Scrum
12 16 (17.20%) Software Delivery
13 15 (16.13%) DevOps
14 14 (15.05%) Machine Learning
15 12 (12.90%) Data Engineering
15 12 (12.90%) Data Pipeline
Programming Languages
1 62 (66.67%) Java
2 53 (56.99%) Python
3 39 (41.94%) SQL
4 35 (37.63%) Scala
5 15 (16.13%) HiveQL
5 15 (16.13%) PL/SQL
5 15 (16.13%) Shell Script
6 9 (9.68%) Groovy
6 9 (9.68%) MATLAB
7 8 (8.60%) Bash
8 7 (7.53%) R
9 5 (5.38%) JavaScript
9 5 (5.38%) TypeScript
10 3 (3.23%) Go
Qualifications
1 15 (16.13%) Degree
2 9 (9.68%) OCP
2 9 (9.68%) Oracle Certification
3 6 (6.45%) Computer Science Degree
4 4 (4.30%) SC Cleared
4 4 (4.30%) Security Cleared
5 1 (1.08%) Master's Degree
5 1 (1.08%) PhD
Quality Assurance & Compliance
1 1 (1.08%) Data Quality
System Software
1 29 (31.18%) Apache ZooKeeper
2 6 (6.45%) Apache Flume
3 4 (4.30%) Docker
3 4 (4.30%) VMware Infrastructure
Systems Management
1 32 (34.41%) Hadoop YARN
2 25 (26.88%) Oozie
3 20 (21.51%) Ansible
4 8 (8.60%) Puppet
5 5 (5.38%) Kubernetes
6 3 (3.23%) Ambari
7 2 (2.15%) Opscode Chef
Vendors
1 20 (21.51%) Marin
2 17 (18.28%) Oracle
3 15 (16.13%) Informatica
4 12 (12.90%) Talend
5 10 (10.75%) Hortonworks
6 9 (9.68%) Databricks
6 9 (9.68%) Okta
6 9 (9.68%) VMware
7 5 (5.38%) Splunk
8 4 (4.30%) Cognizant
9 2 (2.15%) Microsoft
9 2 (2.15%) StreamSets
9 2 (2.15%) Teradata
10 1 (1.08%) Sun
10 1 (1.08%) Sybase