Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 19 October 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 19 October 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
19 Oct 2021		 Same period 2020 Same period 2019
Rank 751 584 842
Rank change year-on-year -167 +258 -47
Permanent jobs citing HDFS 247 87 213
As % of all permanent jobs advertised in England 0.22% 0.20% 0.17%
As % of the System Software category 1.22% 1.04% 0.97%
Number of salaries quoted 46 41 198
10th Percentile £47,500 £47,250 £49,337
25th Percentile £47,813 £56,750 £57,331
Median annual salary (50th Percentile) £60,000 £74,250 £72,500
Median % change year-on-year -19.19% +2.41% +3.57%
75th Percentile £81,875 £95,000 £83,750
90th Percentile £96,875 £111,250 £92,500
UK median annual salary £60,000 £70,000 £72,500
% change year-on-year -14.29% -3.45% +3.57%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 20,241 8,335 21,978
As % of all permanent IT jobs advertised in England 18.35% 18.73% 17.45%
Number of salaries quoted 13,879 7,197 18,432
10th Percentile £28,250 £30,750 £25,500
25th Percentile £38,750 £40,000 £32,700
Median annual salary (50th Percentile) £56,500 £55,000 £50,000
Median % change year-on-year +2.73% +10.00% -
75th Percentile £77,500 £73,750 £70,000
90th Percentile £95,000 £87,500 £85,000
UK median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% -

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a proportion of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

3-month moving average salary quoted in jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

Salary distribution for jobs citing HDFS in England over the 6 months to 19 October 2021.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 19 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
South East +16 187 £72,500 +11.54% 6
London -249 48 £60,000 -33.33% 23
Midlands -135 5 £55,000 -0.90% 12
West Midlands -122 4 £55,000 +10.00% 10
North of England - 4 £56,914 - 3
North East - 2 £56,914 - 1
Yorkshire - 2 - - 1
East Midlands -94 1 £65,000 +17.12% 2
HDFS
UK

For the 6 months to 19 October 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for HDFS.

1 230 (93.12%) Java
2 220 (89.07%) Apache Spark
3 215 (87.04%) Agile Software Development
4 208 (84.21%) Software Engineering
4 208 (84.21%) Unix
5 206 (83.40%) Kafka
6 205 (83.00%) HBase
7 199 (80.57%) Computer Science
8 198 (80.16%) JSON
8 198 (80.16%) DevOps
8 198 (80.16%) Jenkins
9 195 (78.95%) Git (software)
9 195 (78.95%) Banking
10 194 (78.54%) Spring
11 193 (78.14%) PostgreSQL
11 193 (78.14%) Finance
12 192 (77.73%) Linux
13 191 (77.33%) Shell Script
14 190 (76.92%) IntelliJ
14 190 (76.92%) Eclipse
14 190 (76.92%) Degree
15 189 (76.52%) Linux Command Line
16 187 (75.71%) Spark Streaming
16 187 (75.71%) Apache
16 187 (75.71%) Microservices
17 186 (75.30%) Ansible
18 184 (74.49%) Inclusion and Diversity
19 183 (74.09%) Digital Banking
19 183 (74.09%) Law
19 183 (74.09%) RESTful

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 220 (89.07%) Apache Spark
2 187 (75.71%) Apache
3 181 (73.28%) GemFire
4 17 (6.88%) SAS
5 9 (3.64%) Elasticsearch
6 7 (2.83%) Cloud Foundry
7 3 (1.21%) Confluence
8 1 (0.40%) Apache Pig
Applications
1 1 (0.40%) Chatbot
1 1 (0.40%) Microsoft Excel
Cloud Services
1 181 (73.28%) GitHub
2 144 (58.30%) AWS
3 123 (49.80%) Amazon Kinesis
4 113 (45.75%) GCP
5 112 (45.34%) Azure
6 40 (16.19%) OpenShift
7 7 (2.83%) PaaS
8 6 (2.43%) Amazon EMR
8 6 (2.43%) Power Platform
9 4 (1.62%) Amazon EC2
9 4 (1.62%) Amazon ELB
9 4 (1.62%) Amazon S3
10 2 (0.81%) AWS Data Pipeline
10 2 (0.81%) Tricentis Tosca
11 1 (0.40%) AWS CloudFormation
11 1 (0.40%) Azure Cosmos DB
11 1 (0.40%) Azure Data Factory
11 1 (0.40%) Azure Machine Learning
11 1 (0.40%) Azure Synapse Analytics
11 1 (0.40%) Cloud Computing
Communications & Networking
1 10 (4.05%) Internet
2 9 (3.64%) SMS
3 4 (1.62%) Sourcefire
Database & Business Intelligence
1 205 (83.00%) HBase
2 193 (78.14%) PostgreSQL
3 178 (72.06%) MariaDB
4 174 (70.45%) Redis
5 166 (67.21%) NoSQL
6 157 (63.56%) Relational Database
7 143 (57.89%) Big Data
8 71 (28.74%) Hadoop
9 58 (23.48%) Apache Hive
10 23 (9.31%) Impala
11 21 (8.50%) Data Warehouse
12 20 (8.10%) MySQL
13 17 (6.88%) Amazon Redshift
13 17 (6.88%) Pentaho
14 11 (4.45%) DB2
15 8 (3.24%) OLTP
16 6 (2.43%) Apache Cassandra
16 6 (2.43%) MongoDB
16 6 (2.43%) Power BI
17 5 (2.02%) Data Lake
Development Applications
1 198 (80.16%) Jenkins
2 195 (78.95%) Git (software)
3 190 (76.92%) Eclipse
3 190 (76.92%) IntelliJ
4 181 (73.28%) Cucumber
4 181 (73.28%) Cypress.io
4 181 (73.28%) Gradle
4 181 (73.28%) JUnit
4 181 (73.28%) Protractor
4 181 (73.28%) Sonatype Nexus
4 181 (73.28%) Storybook
5 174 (70.45%) Mockito
6 123 (49.80%) Artifactory
7 83 (33.60%) SonarQube
8 9 (3.64%) IBM UrbanCode
8 9 (3.64%) Maven
8 9 (3.64%) Postman
8 9 (3.64%) SoapUI
9 7 (2.83%) Appium
10 4 (1.62%) GitLab
General
1 195 (78.95%) Banking
2 193 (78.14%) Finance
3 184 (74.49%) Inclusion and Diversity
4 183 (74.09%) Law
5 14 (5.67%) Public Sector
6 6 (2.43%) Retail Banking
6 6 (2.43%) Social Skills
7 3 (1.21%) Analytical Skills
7 3 (1.21%) Marketing
8 2 (0.81%) Retail
8 2 (0.81%) Telecoms
9 1 (0.40%) Documentation Skills
9 1 (0.40%) Financial Institution
9 1 (0.40%) Legal
9 1 (0.40%) Presentation Skills
Job Titles
1 150 (60.73%) Software Engineer
2 76 (30.77%) Principal Engineer
2 76 (30.77%) Principal Software Engineer
3 57 (23.08%) Lead Software Engineer
4 45 (18.22%) Developer
5 40 (16.19%) Software Developer
6 39 (15.79%) Lead Developer
6 39 (15.79%) Lead Software Developer
7 29 (11.74%) Data Engineer
8 11 (4.45%) Informatica Engineer
8 11 (4.45%) Senior Software Engineer
9 10 (4.05%) DevOps Engineer
10 6 (2.43%) Architect
10 6 (2.43%) Java Engineer
10 6 (2.43%) Senior Java Engineer
11 5 (2.02%) Big Data Engineer
11 5 (2.02%) Senior Data Engineer
12 4 (1.62%) Consultant
12 4 (1.62%) Hadoop Consultant
12 4 (1.62%) Security Consultant
Libraries, Frameworks & Software Standards
1 206 (83.40%) Kafka
2 198 (80.16%) JSON
3 194 (78.54%) Spring
4 187 (75.71%) Spark Streaming
5 183 (74.09%) RESTful
6 181 (73.28%) AngularJS
6 181 (73.28%) CSS
6 181 (73.28%) Express
6 181 (73.28%) Node.js
6 181 (73.28%) React
6 181 (73.28%) Redux
6 181 (73.28%) Tailwind CSS
6 181 (73.28%) Twitter Bootstrap
7 175 (70.85%) Play Framework
8 174 (70.45%) WireMock
9 130 (52.63%) RabbitMQ
10 129 (52.23%) LAMP
10 129 (52.23%) LAPP Stack
11 29 (11.74%) Web Services
12 25 (10.12%) Java EE
Miscellaneous
1 189 (76.52%) Linux Command Line
2 88 (35.63%) User Experience
3 57 (23.08%) Self-Motivation
4 16 (6.48%) Virtual Team
5 6 (2.43%) Cloud Native
5 6 (2.43%) Online Banking
6 4 (1.62%) Cyber Defence
6 4 (1.62%) Internet of Things
7 3 (1.21%) Data Structures
7 3 (1.21%) Social Media
8 2 (0.81%) Algorithms
8 2 (0.81%) Cybercrime
8 2 (0.81%) Cyberthreat
8 2 (0.81%) Equities
9 1 (0.40%) Apple TV
9 1 (0.40%) Data Centre
9 1 (0.40%) Hybrid Cloud
9 1 (0.40%) Social Network
Operating Systems
1 208 (84.21%) Unix
2 192 (77.73%) Linux
3 5 (2.02%) Windows
Processes & Methodologies
1 215 (87.04%) Agile Software Development
2 208 (84.21%) Software Engineering
3 199 (80.57%) Computer Science
4 198 (80.16%) DevOps
5 187 (75.71%) Microservices
6 183 (74.09%) Digital Banking
7 181 (73.28%) Cross-Browser Testing
7 181 (73.28%) Validation
8 146 (59.11%) Business Continuity
9 137 (55.47%) Software Testing
10 135 (54.66%) Full Stack Development
11 126 (51.01%) OO
11 126 (51.01%) Scrum
12 123 (49.80%) Clean Code
12 123 (49.80%) High Availability
12 123 (49.80%) Performance Monitoring
13 122 (49.39%) Multithreading
14 120 (48.58%) Scaled Agile Framework
15 119 (48.18%) Open Source
16 118 (47.77%) BDD
Programming Languages
1 230 (93.12%) Java
2 191 (77.33%) Shell Script
3 181 (73.28%) Groovy
4 170 (68.83%) Python
5 54 (21.86%) SQL
6 26 (10.53%) PL/SQL
7 17 (6.88%) HiveQL
7 17 (6.88%) Scala
8 5 (2.02%) Perl
8 5 (2.02%) R
9 4 (1.62%) JavaScript
10 2 (0.81%) Bash Shell
11 1 (0.40%) C#
11 1 (0.40%) C++
11 1 (0.40%) VBA
Qualifications
1 190 (76.92%) Degree
2 174 (70.45%) OCP
2 174 (70.45%) Oracle Certification
3 16 (6.48%) Computer Science Degree
4 7 (2.83%) Security Cleared
5 5 (2.02%) SC Cleared
6 2 (0.81%) DV Cleared
6 2 (0.81%) PhD
7 1 (0.40%) AWS Certification
7 1 (0.40%) TOGAF Certification
Quality Assurance & Compliance
1 2 (0.81%) SLA
System Software
1 125 (50.61%) VMware Infrastructure
2 16 (6.48%) Docker
3 9 (3.64%) Apache ZooKeeper
4 1 (0.40%) Apache Flume
4 1 (0.40%) Virtual Servers
Systems Management
1 186 (75.30%) Ansible
2 46 (18.62%) Opscode Chef
3 13 (5.26%) Kubernetes
4 2 (0.81%) Hadoop YARN
4 2 (0.81%) Puppet
5 1 (0.40%) Kubeflow
5 1 (0.40%) Terraform
Vendors
1 181 (73.28%) Okta
1 181 (73.28%) VMware
2 26 (10.53%) Oracle
3 18 (7.29%) Informatica
3 18 (7.29%) Talend
4 13 (5.26%) Splunk
5 5 (2.02%) Cloudera
6 4 (1.62%) Cisco
7 3 (1.21%) Ab Initio
8 2 (0.81%) Databricks
8 2 (0.81%) Google
8 2 (0.81%) Microsoft
9 1 (0.40%) Apple
9 1 (0.40%) Cognos
9 1 (0.40%) MicroStrategy