Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 27 February 2021

The following table provides summary statistics for permanent job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 27 February 2021 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK
6 months to
27 Feb 2021		 Same period 2020 Same period 2019
Rank 720 870 844
Rank change year-on-year +150 -26 +70
Permanent jobs citing HDFS 84 157 280
As % of all permanent jobs advertised in the UK 0.11% 0.13% 0.19%
As % of the System Software category 0.62% 0.75% 1.18%
Number of salaries quoted 56 150 220
Median annual salary £61,250 £75,000 £72,500
Median salary % change year-on-year -18.33% +3.45% +3.57%
10th Percentile £48,125 £50,000 £49,337
90th Percentile £85,000 £85,000 £101,250
UK excluding London median annual salary £55,500 £72,500 £60,000
% change year-on-year -23.45% +20.83% -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for system software skills.

All System Software Skills
UK
Permanent vacancies with a requirement for system software skills 13,597 20,903 23,701
As % of all permanent IT jobs advertised in the UK 18.31% 17.00% 15.68%
Number of salaries quoted 11,235 17,298 19,571
Median annual salary £55,000 £50,000 £50,000
Median salary % change year-on-year +10.00% - +11.11%
10th Percentile £29,750 £25,750 £25,750
90th Percentile £88,750 £85,000 £82,500
UK excluding London median annual salary £47,500 £42,500 £42,500
% change year-on-year +11.76% - +6.25%

HDFS
Job Vacancy Trend

Job postings citing HDFS as a proportion of all IT jobs advertised.

Job vacancy trend for HDFS in the UK

HDFS
Salary Trend

3-month moving average salary quoted in jobs citing HDFS.

Salary trend for HDFS in the UK

HDFS
Salary Histogram

Salary distribution for jobs citing HDFS over the 6 months to 27 February 2021.

Salary histogram for HDFS in the UK

HDFS
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 6 months to 27 February 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +138 79 £62,500 -16.67% 14
London +150 50 £72,500 -3.33% 3
UK excluding London +106 31 £55,500 -23.45% 11
North of England +56 11 £55,000 +0.60% 1
Midlands +53 10 £55,500 -26.00% 3
Yorkshire +32 9 £55,000 +0.30%
Work from Home -93 9 £75,000 -
East Midlands +25 8 £55,500 -26.00% 2
South East +120 3 £65,000 -11.86% 6
South West +43 3 - - 1
North West +69 2 £52,500 - 1
Scotland +25 2 £53,000 +4.33%
West Midlands - 2 £55,000 - 1
Northern Ireland - 2 £63,750 -

For the 6 months to 27 February 2021, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for HDFS.

1 83 (98.81%) Hadoop
2 69 (82.14%) Apache Hive
3 64 (76.19%) Big Data
4 59 (70.24%) SQL
5 56 (66.67%) Python
6 55 (65.48%) ETL
7 50 (59.52%) AWS
8 47 (55.95%) Java
9 46 (54.76%) Cloudera
10 43 (51.19%) Azure
11 42 (50.00%) Oracle
12 40 (47.62%) Impala
12 40 (47.62%) Analytics
13 38 (45.24%) Software Engineering
14 35 (41.67%) Informatica
14 35 (41.67%) Data Analytics
14 35 (41.67%) Oracle Database
14 35 (41.67%) HBase
14 35 (41.67%) Power BI
14 35 (41.67%) Power Platform
15 33 (39.29%) PL/SQL
15 33 (39.29%) Unix
16 32 (38.10%) Shell Script
16 32 (38.10%) Apache Spark
16 32 (38.10%) HiveQL
16 32 (38.10%) Software Delivery
17 31 (36.90%) Talend
17 31 (36.90%) BusinessObjects
18 30 (35.71%) SAS
18 30 (35.71%) JavaScript

HDFS
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 32 (38.10%) Apache Spark
2 30 (35.71%) SAS
3 10 (11.90%) Apache
4 3 (3.57%) Elasticsearch
5 2 (2.38%) Apache Pig
5 2 (2.38%) BizTalk Server
5 2 (2.38%) Oracle SOA Suite
6 1 (1.19%) Confluence
6 1 (1.19%) Mule
6 1 (1.19%) WebLogic
Business Applications
1 2 (2.38%) Dynamics CRM
2 1 (1.19%) SAP FI-CA
2 1 (1.19%) SAP PSCD
Cloud Services
1 50 (59.52%) AWS
2 43 (51.19%) Azure
3 35 (41.67%) Power Platform
4 7 (8.33%) Amazon S3
5 5 (5.95%) Azure Data Factory
5 5 (5.95%) GCP
6 3 (3.57%) IaaS
6 3 (3.57%) PaaS
6 3 (3.57%) SaaS
7 1 (1.19%) Amazon EMR
Communications & Networking
1 4 (4.76%) FTP
2 2 (2.38%) Kerberos
2 2 (2.38%) SMS
Database & Business Intelligence
1 83 (98.81%) Hadoop
2 69 (82.14%) Apache Hive
3 64 (76.19%) Big Data
4 40 (47.62%) Impala
5 35 (41.67%) HBase
5 35 (41.67%) Oracle Database
5 35 (41.67%) Power BI
6 31 (36.90%) BusinessObjects
7 30 (35.71%) Pentaho
8 22 (26.19%) Data Lake
9 15 (17.86%) Relational Database
10 13 (15.48%) SQL Server
11 12 (14.29%) MySQL
12 10 (11.90%) MongoDB
12 10 (11.90%) Spark SQL
12 10 (11.90%) Sqoop
13 9 (10.71%) NoSQL
13 9 (10.71%) Presto
14 7 (8.33%) RDBMS
14 7 (8.33%) Snowflake Schema
Development Applications
1 15 (17.86%) Git (software)
2 10 (11.90%) Jenkins
3 8 (9.52%) Maven
4 4 (4.76%) ER Studio
4 4 (4.76%) ERwin
4 4 (4.76%) Subversion
5 3 (3.57%) Postman
5 3 (3.57%) SoapUI
6 2 (2.38%) Eclipse
6 2 (2.38%) IBM UrbanCode
6 2 (2.38%) IntelliJ
7 1 (1.19%) Cucumber
7 1 (1.19%) JIRA
7 1 (1.19%) Oracle Forms
7 1 (1.19%) Selenium
7 1 (1.19%) Toad
General
1 17 (20.24%) Finance
2 6 (7.14%) Advertising
3 2 (2.38%) Back Office
3 2 (2.38%) Retail
4 1 (1.19%) Financial Institution
4 1 (1.19%) Front Office
4 1 (1.19%) Games
4 1 (1.19%) Marketing
4 1 (1.19%) Public Sector
Job Titles
1 42 (50.00%) Data Engineer
2 15 (17.86%) Developer
3 10 (11.90%) Architect
3 10 (11.90%) ETL Developer
4 8 (9.52%) Administrator
5 7 (8.33%) DevOps Engineer
6 6 (7.14%) Big Data Engineer
6 6 (7.14%) Data Architect
6 6 (7.14%) DBA
6 6 (7.14%) Scala Engineer
6 6 (7.14%) Senior DBA
7 5 (5.95%) Senior Developer
7 5 (5.95%) Solutions Architect
8 4 (4.76%) Big Data Developer
8 4 (4.76%) Software Engineer
9 3 (3.57%) AWS Architect
9 3 (3.57%) AWS Engineer
9 3 (3.57%) Senior DevOps
9 3 (3.57%) Senior DevOps Engineer
9 3 (3.57%) Senior ETL Developer
Libraries, Frameworks & Software Standards
1 25 (29.76%) Kafka
2 9 (10.71%) Web Services
3 7 (8.33%) Spring
4 6 (7.14%) AngularJS
4 6 (7.14%) Hibernate
5 4 (4.76%) RabbitMQ
5 4 (4.76%) Spark Streaming
6 3 (3.57%) .NET
6 3 (3.57%) Apache NiFi
6 3 (3.57%) JSON
6 3 (3.57%) SOAP
7 2 (2.38%) ASP.NET
7 2 (2.38%) ASP.NET MVC
7 2 (2.38%) CGI
7 2 (2.38%) Middleware
7 2 (2.38%) REST
7 2 (2.38%) Spring Boot
8 1 (1.19%) XML
Miscellaneous
1 9 (10.71%) Analytical Skills
2 8 (9.52%) Virtual Team
3 6 (7.14%) Replication
4 4 (4.76%) Social Media
5 3 (3.57%) Cloud Native
6 2 (2.38%) Data Structures
6 2 (2.38%) Driving Licence
6 2 (2.38%) Enterprise Software
6 2 (2.38%) User Experience
7 1 (1.19%) Hedge funds
7 1 (1.19%) Reference Data
Operating Systems
1 33 (39.29%) Unix
2 14 (16.67%) Linux
3 7 (8.33%) Red Hat Enterprise Linux
4 1 (1.19%) Windows
Processes & Methodologies
1 55 (65.48%) ETL
2 40 (47.62%) Analytics
3 38 (45.24%) Software Engineering
4 35 (41.67%) Data Analytics
5 32 (38.10%) Software Delivery
6 30 (35.71%) Agile Software Development
6 30 (35.71%) Requirements Gathering
7 27 (32.14%) Scrum
8 26 (30.95%) Data Engineering
9 25 (29.76%) Coaching
9 25 (29.76%) Mentoring
10 23 (27.38%) Process Improvement
11 15 (17.86%) Computer Science
12 14 (16.67%) Problem-Solving
13 12 (14.29%) DevOps
14 10 (11.90%) Data Modelling
15 9 (10.71%) Business Intelligence
15 9 (10.71%) Configuration Management
15 9 (10.71%) Open Source
15 9 (10.71%) SDLC
Programming Languages
1 59 (70.24%) SQL
2 56 (66.67%) Python
3 47 (55.95%) Java
4 33 (39.29%) PL/SQL
5 32 (38.10%) HiveQL
5 32 (38.10%) Shell Script
6 30 (35.71%) JavaScript
7 13 (15.48%) Bash Shell
7 13 (15.48%) Scala
8 6 (7.14%) Perl
8 6 (7.14%) PHP
9 3 (3.57%) R
10 1 (1.19%) C#
Qualifications
1 18 (21.43%) BPSS Clearance
2 14 (16.67%) Degree
3 4 (4.76%) Computer Science Degree
3 4 (4.76%) Security Cleared
4 3 (3.57%) AWS Certification
5 2 (2.38%) SC Cleared
6 1 (1.19%) ISEB
6 1 (1.19%) ISTQB
6 1 (1.19%) ISTQB Foundation Certification
6 1 (1.19%) Sun Certification
Quality Assurance & Compliance
1 5 (5.95%) Data Quality
2 1 (1.19%) QA
System Software
1 12 (14.29%) Apache ZooKeeper
2 11 (13.10%) Docker
3 1 (1.19%) Apache Flume
Systems Management
1 19 (22.62%) Hadoop YARN
2 15 (17.86%) Ansible
3 13 (15.48%) Opscode Chef
3 13 (15.48%) Puppet
4 11 (13.10%) Kubernetes
5 8 (9.52%) Oozie
6 7 (8.33%) Graphite
6 7 (8.33%) Nagios
6 7 (8.33%) Opsview
6 7 (8.33%) Terraform
Vendors
1 46 (54.76%) Cloudera
2 42 (50.00%) Oracle
3 35 (41.67%) Informatica
4 31 (36.90%) Talend
5 11 (13.10%) Databricks
6 8 (9.52%) Google
7 6 (7.14%) Ab Initio
7 6 (7.14%) Facebook
7 6 (7.14%) Marin
7 6 (7.14%) Microsoft
8 5 (5.95%) SAP
9 4 (4.76%) Salesforce.com
9 4 (4.76%) Teradata
10 2 (2.38%) Cognos
10 2 (2.38%) Splunk
11 1 (1.19%) Hortonworks
11 1 (1.19%) MicroStrategy
11 1 (1.19%) Netezza
11 1 (1.19%) TIBCO