Period
to 21 February 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 21 February 2020 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
21 Feb 2020
Same period 2019 Same period 2018
Rank 841 830 873
Rank change year-on-year -11 +43 +43
Permanent jobs citing HDFS 147 269 303
As % of all permanent IT jobs advertised in England 0.13% 0.19% 0.18%
As % of the System Software category 0.75% 1.21% 1.37%
Number of salaries quoted 132 205 248
England median annual salary £75,000 £72,500 £70,000
Median salary % change year-on-year +3.45% +3.57% -6.67%
10th Percentile £51,738 £49,337 £43,750
90th Percentile £86,125 £97,500 £102,500
UK median annual salary £75,000 £72,500 £70,000
% change year-on-year +3.45% +3.57% -6.67%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 19,562 22,273 22,111
As % of all permanent IT jobs advertised in England 17.11% 15.85% 13.40%
Number of salaries quoted 16,079 18,255 18,399
England median annual salary £50,000 £50,000 £45,000
Median salary % change year-on-year - +11.11% +5.88%
10th Percentile £26,000 £25,750 £24,500
90th Percentile £85,000 £82,500 £77,500
UK median annual salary £50,000 £50,000 £45,000
% change year-on-year - +11.11% +5.88%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

The salary distribution of IT jobs citing HDFS in England over the 6 months to 21 February 2020.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 21 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +22 85 £75,000 - 9
North of England +35 19 £54,671 +10.81% 1
East of England +51 18 £75,000 +3.45%
East Midlands +37 17 £75,000 - 1
Midlands +36 17 £75,000 - 1
Yorkshire +39 13 £54,835 +11.14% 1
South East +60 5 £73,750 +96.67% 6
North East +2 4 £54,671 +10.81%
South West +22 3 £76,250 +52.50% 3
North West +47 2 - -
HDFS
UK

For the 6 months to 21 February 2020, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for HDFS.

1 141 (95.92%) Hadoop
2 129 (87.76%) Apache Hive
3 128 (87.07%) Big Data
4 104 (70.75%) Apache Spark
5 93 (63.27%) Python
6 78 (53.06%) Agile Software Development
7 68 (46.26%) Azure
8 67 (45.58%) Impala
8 67 (45.58%) Data Modelling
8 67 (45.58%) SQL
9 66 (44.90%) AWS
10 62 (42.18%) Scala
11 59 (40.14%) HBase
12 58 (39.46%) Data Engineering
13 56 (38.10%) Java
13 56 (38.10%) Linux
14 53 (36.05%) Business Intelligence
15 52 (35.37%) NoSQL
16 50 (34.01%) Amazon S3
16 50 (34.01%) Data Science
17 44 (29.93%) Hadoop YARN
18 43 (29.25%) SQL Server
19 42 (28.57%) Analytics
19 42 (28.57%) Amazon EMR
20 41 (27.89%) Data Warehouse
21 38 (25.85%) Apache
22 35 (23.81%) ETL
22 35 (23.81%) Shell Script
22 35 (23.81%) Software Engineering
23 33 (22.45%) Kafka

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 104 (70.75%) Apache Spark
2 38 (25.85%) Apache
3 19 (12.93%) Apache Airflow
4 7 (4.76%) SAS
5 5 (3.40%) Apache Pig
6 2 (1.36%) Elasticsearch
7 1 (0.68%) OpenStack
7 1 (0.68%) OpenWhisk
7 1 (0.68%) Tomcat
7 1 (0.68%) WebLogic
Applications
1 1 (0.68%) Microsoft Excel
1 1 (0.68%) SPSS
Business Applications
1 1 (0.68%) Oracle Applications
Cloud Services
1 68 (46.26%) Azure
2 66 (44.90%) AWS
3 50 (34.01%) Amazon S3
4 42 (28.57%) Amazon EMR
5 22 (14.97%) GCP
6 18 (12.24%) Amazon Kinesis
7 14 (9.52%) Azure Data Factory
8 8 (5.44%) IaaS
8 8 (5.44%) PaaS
9 4 (2.72%) Serverless
10 3 (2.04%) Power Platform
11 2 (1.36%) Adobe Creative Cloud
12 1 (0.68%) OpenShift
12 1 (0.68%) SaaS
Communications & Networking
1 7 (4.76%) Firewall
1 7 (4.76%) Kerberos
1 7 (4.76%) VPN
2 3 (2.04%) HTTP
2 3 (2.04%) HTTPS
2 3 (2.04%) SSL
3 1 (0.68%) IPFS
Database & Business Intelligence
1 141 (95.92%) Hadoop
2 129 (87.76%) Apache Hive
3 128 (87.07%) Big Data
4 67 (45.58%) Impala
5 59 (40.14%) HBase
6 52 (35.37%) NoSQL
7 43 (29.25%) SQL Server
8 41 (27.89%) Data Warehouse
9 30 (20.41%) HDInsight
10 21 (14.29%) Data Lake
11 20 (13.61%) Sqoop
12 19 (12.93%) Presto
13 18 (12.24%) Apache Kudu
14 17 (11.56%) Amazon Redshift
15 16 (10.88%) BigQuery
15 16 (10.88%) Neo4j
16 15 (10.20%) PostgreSQL
17 14 (9.52%) Amazon DynamoDB
17 14 (9.52%) SQL Server Analysis Services
18 13 (8.84%) Relational Database
Development Applications
1 13 (8.84%) ProC
2 11 (7.48%) Jenkins
3 10 (6.80%) Git (software)
4 3 (2.04%) JIRA
4 3 (2.04%) JUnit
4 3 (2.04%) Octopus Deploy
4 3 (2.04%) TeamCity
4 3 (2.04%) Visual Studio Team System
5 1 (0.68%) IBM UrbanCode
5 1 (0.68%) Maven
5 1 (0.68%) Sonatype Nexus
5 1 (0.68%) Team Foundation Server
General
1 24 (16.33%) Finance
2 11 (7.48%) Games
3 10 (6.80%) Public Sector
3 10 (6.80%) Retail
4 8 (5.44%) Legal
5 4 (2.72%) Banking
6 2 (1.36%) Manufacturing
6 2 (1.36%) Marketing
7 1 (0.68%) Telecoms
Job Titles
1 74 (50.34%) Data Engineer
2 33 (22.45%) Architect
3 29 (19.73%) Big Data Engineer
4 28 (19.05%) Data Architect
5 24 (16.33%) Senior Data Engineer
6 19 (12.93%) Cloud Architect
7 17 (11.56%) Developer
8 16 (10.88%) Java Developer
9 14 (9.52%) Big Data Developer
10 13 (8.84%) Senior Big Data Developer
10 13 (8.84%) Senior Developer
10 13 (8.84%) Senior Java Developer
11 12 (8.16%) Analytics Developer
11 12 (8.16%) Lead Developer
11 12 (8.16%) Lead Java Developer
12 11 (7.48%) Data Scientist
13 10 (6.80%) Senior Data Scientist
14 9 (6.12%) DevOps Engineer
14 9 (6.12%) Hadoop Architect
14 9 (6.12%) Technical Architect
Libraries, Frameworks & Software Standards
1 33 (22.45%) Kafka
2 15 (10.20%) LAPP Stack
3 14 (9.52%) Lambda Expressions
4 13 (8.84%) J2EE
5 10 (6.80%) Elastic Stack
6 8 (5.44%) OAuth
7 7 (4.76%) D3.js
7 7 (4.76%) ggplot2
7 7 (4.76%) LDAP
7 7 (4.76%) SAML
8 5 (3.40%) .NET
8 5 (3.40%) Web Services
9 4 (2.72%) PySpark
10 2 (1.36%) Akka
10 2 (1.36%) Spring
11 1 (0.68%) .NET Core
11 1 (0.68%) Apache NiFi
11 1 (0.68%) gRPC
11 1 (0.68%) JMX
11 1 (0.68%) OAuth2
Miscellaneous
1 29 (19.73%) Analytical Skills
2 20 (13.61%) Algorithms
3 14 (9.52%) Public Cloud
4 12 (8.16%) Enterprise Software
5 7 (4.76%) Data Centre
6 3 (2.04%) Derivative
7 2 (1.36%) Cloud Native
7 2 (1.36%) Equities
7 2 (1.36%) Fixed Income
7 2 (1.36%) Greenfield Project
7 2 (1.36%) Management Information System
7 2 (1.36%) Tandem
8 1 (0.68%) Embedded Systems
8 1 (0.68%) Hybrid Cloud
8 1 (0.68%) Replication
8 1 (0.68%) Social Network
Operating Systems
1 56 (38.10%) Linux
2 20 (13.61%) Unix
3 2 (1.36%) Red Hat Enterprise Linux
Processes & Methodologies
1 78 (53.06%) Agile Software Development
2 67 (45.58%) Data Modelling
3 58 (39.46%) Data Engineering
4 53 (36.05%) Business Intelligence
5 50 (34.01%) Data Science
6 42 (28.57%) Analytics
7 35 (23.81%) ETL
7 35 (23.81%) Software Engineering
8 32 (21.77%) Machine Learning
9 25 (17.01%) MapReduce
10 20 (13.61%) Data Analysis
11 18 (12.24%) Data Development
11 18 (12.24%) DevOps
12 17 (11.56%) Performance Tuning
12 17 (11.56%) Test Automation
13 16 (10.88%) Microservices
13 16 (10.88%) Technical Leadership
14 15 (10.20%) Data Integration
14 15 (10.20%) Scrum
14 15 (10.20%) Stakeholder Management
Programming Languages
1 93 (63.27%) Python
2 67 (45.58%) SQL
3 62 (42.18%) Scala
4 56 (38.10%) Java
5 35 (23.81%) Shell Script
6 14 (9.52%) C
6 14 (9.52%) PL/SQL
7 12 (8.16%) Ruby
8 11 (7.48%) Bash Shell
8 11 (7.48%) R
9 7 (4.76%) JavaScript
10 4 (2.72%) Groovy
10 4 (2.72%) Java 8
11 2 (1.36%) Haskell
11 2 (1.36%) Perl
12 1 (0.68%) Go
12 1 (0.68%) Kotlin
12 1 (0.68%) PHP
12 1 (0.68%) T-SQL
Qualifications
1 18 (12.24%) Degree
2 12 (8.16%) AWS Certification
3 1 (0.68%) Computer Science Degree
3 1 (0.68%) MCSA
3 1 (0.68%) Microsoft Certification
3 1 (0.68%) SC Cleared
3 1 (0.68%) Security Cleared
Quality Assurance & Compliance
1 23 (15.65%) Data Quality
2 18 (12.24%) QA
3 8 (5.44%) GDPR
3 8 (5.44%) ISO/IEC 27001
System Software
1 16 (10.88%) Apache Flume
2 9 (6.12%) Docker
3 7 (4.76%) Apache ZooKeeper
4 1 (0.68%) Alluxio
4 1 (0.68%) Ceph
4 1 (0.68%) etcd
4 1 (0.68%) Gluster
Systems Management
1 44 (29.93%) Hadoop YARN
2 26 (17.69%) Oozie
3 8 (5.44%) Ansible
4 7 (4.76%) Ambari
4 7 (4.76%) Single Sign-On
4 7 (4.76%) Terraform
5 6 (4.08%) Kubernetes
6 5 (3.40%) Puppet
7 3 (2.04%) Mesos
7 3 (2.04%) Opscode Chef
8 2 (1.36%) Graphite
8 2 (1.36%) Nagios
8 2 (1.36%) Opsview
9 1 (0.68%) Grafana
9 1 (0.68%) Istio
9 1 (0.68%) Knative
9 1 (0.68%) Prometheus
Vendors
1 29 (19.73%) Cloudera
2 20 (13.61%) Oracle
3 15 (10.20%) Teradata
4 14 (9.52%) Databricks
5 11 (7.48%) Hortonworks
6 9 (6.12%) Google
7 8 (5.44%) Tableau
8 5 (3.40%) SolarWinds
9 4 (2.72%) MapR
10 3 (2.04%) Informatica
10 3 (2.04%) Microsoft
11 2 (1.36%) Adobe
11 2 (1.36%) Blue Prism
11 2 (1.36%) Talend
11 2 (1.36%) UiPath
12 1 (0.68%) Alteryx
12 1 (0.68%) Confluent