Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 16 May 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 16 May 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
16 May 2021		 Same period 2020 Same period 2019
Rank 738 801 845
Rank change year-on-year +63 +44 -70
Permanent jobs citing HDFS 114 99 242
As % of all permanent jobs advertised in England 0.14% 0.11% 0.18%
As % of the System Software category 0.75% 0.64% 1.08%
Number of salaries quoted 43 80 194
10th Percentile £48,950 £50,000 £46,250
25th Percentile £50,000 £61,063 £50,000
Median annual salary (50th Percentile) £60,000 £75,000 £65,000
Median % change year-on-year -20.00% +15.38% -7.14%
75th Percentile £73,750 £83,750 £80,000
90th Percentile £84,600 £105,000 £89,250
UK median annual salary £60,000 £75,000 £65,000
% change year-on-year -20.00% +15.38% -7.14%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 15,184 15,477 22,360
As % of all permanent IT jobs advertised in England 19.00% 17.44% 16.73%
Number of salaries quoted 12,045 12,840 18,432
10th Percentile £30,000 £27,000 £26,000
25th Percentile £40,000 £36,250 £33,938
Median annual salary (50th Percentile) £55,000 £52,500 £50,000
Median % change year-on-year +4.76% +5.00% +5.26%
75th Percentile £75,000 £72,500 £68,750
90th Percentile £91,250 £87,500 £85,000
UK median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a proportion of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

3-month moving average salary quoted in jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

Salary distribution for jobs citing HDFS in England over the 6 months to 16 May 2021.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 16 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
South East +82 44 £65,000 -13.33% 2
London +53 43 £65,000 -14.75% 3
North of England -5 11 £55,000 +0.60% 1
Yorkshire -18 9 £55,000 +0.30%
Midlands -30 9 £55,500 -26.00% 5
East Midlands -12 7 £55,500 -26.00% 2
South West -35 3 - -
West Midlands -17 2 £58,750 +11.90% 3
North West +29 1 - -
East of England +19 1 - -
North East +1 1 £56,914 +4.10% 1
HDFS
UK

For the 6 months to 16 May 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for HDFS.

1 80 (70.18%) Java
2 77 (67.54%) Apache Spark
3 72 (63.16%) HBase
4 71 (62.28%) Hadoop
5 67 (58.77%) Big Data
5 67 (58.77%) Kafka
6 65 (57.02%) Python
7 62 (54.39%) Computer Science
8 61 (53.51%) Degree
8 61 (53.51%) Apache Hive
9 59 (51.75%) Git (software)
9 59 (51.75%) Agile Software Development
10 56 (49.12%) Unix
10 56 (49.12%) Shell Script
10 56 (49.12%) Ansible
11 54 (47.37%) AWS
11 54 (47.37%) Linux
11 54 (47.37%) Apache
11 54 (47.37%) Finance
11 54 (47.37%) Software Engineering
12 52 (45.61%) SQL
12 52 (45.61%) DevOps
13 51 (44.74%) Jenkins
14 50 (43.86%) AngularJS
15 49 (42.98%) Azure
16 48 (42.11%) MariaDB
17 47 (41.23%) Banking
17 47 (41.23%) PostgreSQL
17 47 (41.23%) Spark Streaming
18 45 (39.47%) Spring

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 77 (67.54%) Apache Spark
2 54 (47.37%) Apache
3 42 (36.84%) GemFire
4 14 (12.28%) SAS
5 3 (2.63%) Elasticsearch
6 2 (1.75%) Apache Airflow
6 2 (1.75%) Apache Pig
6 2 (1.75%) Oracle SOA Suite
7 1 (0.88%) BizTalk Server
Business Applications
1 1 (0.88%) Dynamics CRM
Cloud Services
1 54 (47.37%) AWS
2 49 (42.98%) Azure
3 42 (36.84%) GitHub
4 24 (21.05%) GCP
5 21 (18.42%) Power Platform
6 14 (12.28%) Amazon Kinesis
7 12 (10.53%) OpenShift
8 10 (8.77%) Amazon S3
9 9 (7.89%) Azure Synapse Analytics
10 6 (5.26%) Azure Data Factory
11 4 (3.51%) AWS CloudFormation
11 4 (3.51%) PaaS
11 4 (3.51%) SaaS
12 3 (2.63%) Cloud Computing
13 2 (1.75%) IaaS
13 2 (1.75%) Matillion
14 1 (0.88%) Amazon EMR
14 1 (0.88%) AWS Data Pipeline
Communications & Networking
1 8 (7.02%) FTP
2 3 (2.63%) SMS
Database & Business Intelligence
1 72 (63.16%) HBase
2 71 (62.28%) Hadoop
3 67 (58.77%) Big Data
4 61 (53.51%) Apache Hive
5 48 (42.11%) MariaDB
6 47 (41.23%) PostgreSQL
7 42 (36.84%) Redis
8 38 (33.33%) NoSQL
9 36 (31.58%) Relational Database
10 22 (19.30%) Impala
11 21 (18.42%) Power BI
12 20 (17.54%) Data Lake
13 17 (14.91%) Oracle Database
14 14 (12.28%) BusinessObjects
14 14 (12.28%) Pentaho
14 14 (12.28%) SQL Server
15 10 (8.77%) MongoDB
16 9 (7.89%) Presto
16 9 (7.89%) Sqoop
17 8 (7.02%) Spark SQL
Development Applications
1 59 (51.75%) Git (software)
2 51 (44.74%) Jenkins
3 45 (39.47%) Eclipse
3 45 (39.47%) IntelliJ
4 42 (36.84%) Cucumber
4 42 (36.84%) Cypress.io
4 42 (36.84%) Gradle
4 42 (36.84%) JUnit
4 42 (36.84%) Mockito
4 42 (36.84%) Protractor
4 42 (36.84%) Sonatype Nexus
4 42 (36.84%) Storybook
5 14 (12.28%) Artifactory
6 10 (8.77%) SonarQube
7 9 (7.89%) Maven
8 8 (7.02%) ER Studio
8 8 (7.02%) ERwin
8 8 (7.02%) Subversion
9 4 (3.51%) Bitbucket
10 3 (2.63%) SoapUI
General
1 54 (47.37%) Finance
2 47 (41.23%) Banking
3 42 (36.84%) Law
4 15 (13.16%) Analytical Skills
5 7 (6.14%) Social Skills
6 6 (5.26%) Advertising
6 6 (5.26%) Marketing
7 2 (1.75%) Back Office
7 2 (1.75%) Presentation Skills
8 1 (0.88%) Pharmaceutical
8 1 (0.88%) Retail
Job Titles
1 27 (23.68%) Data Engineer
1 27 (23.68%) Software Engineer
2 23 (20.18%) Developer
3 20 (17.54%) Architect
4 14 (12.28%) Principal Engineer
4 14 (12.28%) Principal Software Engineer
5 12 (10.53%) ETL Developer
5 12 (10.53%) Solutions Architect
6 10 (8.77%) Lead Developer
6 10 (8.77%) Lead Software Developer
6 10 (8.77%) Lead Software Engineer
6 10 (8.77%) Software Developer
7 8 (7.02%) Principal Architect
8 7 (6.14%) Big Data Engineer
8 7 (6.14%) DevOps Engineer
9 6 (5.26%) Administrator
9 6 (5.26%) DBA
9 6 (5.26%) Scala Engineer
9 6 (5.26%) Senior DBA
10 5 (4.39%) Data Architect
Libraries, Frameworks & Software Standards
1 67 (58.77%) Kafka
2 50 (43.86%) AngularJS
3 47 (41.23%) Spark Streaming
4 45 (39.47%) JSON
4 45 (39.47%) Spring
5 42 (36.84%) CSS
5 42 (36.84%) Express
5 42 (36.84%) Node.js
5 42 (36.84%) React
5 42 (36.84%) Redux
5 42 (36.84%) RESTful
5 42 (36.84%) Tailwind CSS
5 42 (36.84%) Twitter Bootstrap
5 42 (36.84%) WireMock
6 25 (21.93%) Play Framework
7 22 (19.30%) LAMP
7 22 (19.30%) LAPP Stack
8 16 (14.04%) RabbitMQ
9 11 (9.65%) Web Services
10 10 (8.77%) Java EE
Miscellaneous
1 42 (36.84%) Linux Command Line
2 24 (21.05%) Self-Motivation
3 15 (13.16%) User Experience
4 11 (9.65%) Virtual Team
5 6 (5.26%) Replication
6 5 (4.39%) Social Media
7 3 (2.63%) Cloud Native
7 3 (2.63%) Data Structures
8 2 (1.75%) Enterprise Software
9 1 (0.88%) Biotechnology
9 1 (0.88%) Driving Licence
9 1 (0.88%) NHS
Operating Systems
1 56 (49.12%) Unix
2 54 (47.37%) Linux
3 6 (5.26%) Red Hat Enterprise Linux
Processes & Methodologies
1 62 (54.39%) Computer Science
2 59 (51.75%) Agile Software Development
3 54 (47.37%) Software Engineering
4 52 (45.61%) DevOps
5 43 (37.72%) Microservices
6 42 (36.84%) Cross-Browser Testing
6 42 (36.84%) Digital Banking
6 42 (36.84%) Validation
7 39 (34.21%) ETL
8 32 (28.07%) Open Source
9 30 (26.32%) Data Engineering
10 28 (24.56%) Analytics
10 28 (24.56%) Scrum
11 24 (21.05%) Business Continuity
12 22 (19.30%) System Testing
12 22 (19.30%) TDD
13 20 (17.54%) BDD
13 20 (17.54%) Fintech
13 20 (17.54%) High Availability
13 20 (17.54%) Kanban
Programming Languages
1 80 (70.18%) Java
2 65 (57.02%) Python
3 56 (49.12%) Shell Script
4 52 (45.61%) SQL
5 42 (36.84%) Groovy
6 19 (16.67%) Scala
7 17 (14.91%) PL/SQL
8 16 (14.04%) JavaScript
9 15 (13.16%) HiveQL
10 12 (10.53%) Bash Shell
11 6 (5.26%) Perl
11 6 (5.26%) PHP
12 3 (2.63%) R
13 1 (0.88%) C#
13 1 (0.88%) C++
13 1 (0.88%) Julia
13 1 (0.88%) T-SQL
Qualifications
1 61 (53.51%) Degree
2 42 (36.84%) OCP
2 42 (36.84%) Oracle Certification
3 8 (7.02%) Computer Science Degree
4 5 (4.39%) BPSS Clearance
5 4 (3.51%) AWS Certification
5 4 (3.51%) Security Cleared
5 4 (3.51%) TOGAF Certification
6 2 (1.75%) SC Cleared
7 1 (0.88%) PhD
Quality Assurance & Compliance
1 3 (2.63%) Data Quality
2 2 (1.75%) QA
3 1 (0.88%) GDPR
System Software
1 30 (26.32%) VMware Infrastructure
2 16 (14.04%) Docker
3 8 (7.02%) Apache ZooKeeper
4 4 (3.51%) Virtual Servers
5 2 (1.75%) Apache Flume
Systems Management
1 56 (49.12%) Ansible
2 24 (21.05%) Opscode Chef
3 16 (14.04%) Hadoop YARN
3 16 (14.04%) Kubernetes
4 12 (10.53%) Puppet
5 10 (8.77%) Terraform
6 8 (7.02%) Oozie
7 6 (5.26%) Graphite
7 6 (5.26%) Nagios
7 6 (5.26%) Opsview
Vendors
1 42 (36.84%) Okta
1 42 (36.84%) VMware
2 27 (23.68%) Cloudera
3 19 (16.67%) Oracle
4 17 (14.91%) Talend
5 16 (14.04%) Informatica
6 14 (12.28%) Databricks
7 13 (11.40%) Google
8 8 (7.02%) Salesforce.com
8 8 (7.02%) SAP
9 6 (5.26%) Facebook
9 6 (5.26%) Marin
9 6 (5.26%) Microsoft
10 5 (4.39%) Ab Initio
11 3 (2.63%) Hortonworks
11 3 (2.63%) Splunk
12 2 (1.75%) Cognos
12 2 (1.75%) MicroStrategy