Period
to 13 December 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 13 December 2019 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > London
6 months to
13 Dec 2019
Same period 2018 Same period 2017
Rank 598 602 690
Rank change year-on-year +4 +88 -37
Permanent jobs citing HDFS 130 210 172
As % of all permanent IT jobs advertised in London 0.24% 0.32% 0.23%
As % of the System Software category 1.37% 1.98% 1.74%
Number of salaries quoted 122 173 149
London median annual salary £76,750 £75,000 £75,000
Median salary % change year-on-year +2.33% - -6.25%
10th Percentile £56,250 £60,000 £53,750
90th Percentile £93,720 £101,150 £105,000
England median annual salary £75,000 £72,500 £70,000
% change year-on-year +3.45% +3.57% -6.67%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for system software skills.

All System Software Skills
London
Permanent vacancies with a requirement for system software skills 9,501 10,605 9,885
As % of all permanent IT jobs advertised in London 17.73% 15.97% 13.32%
Number of salaries quoted 7,862 8,869 8,377
London median annual salary £62,500 £60,000 £55,000
Median salary % change year-on-year +4.17% +9.09% +10.00%
10th Percentile £29,000 £29,000 £28,500
90th Percentile £95,000 £91,250 £85,000
England median annual salary £50,000 £50,000 £45,000
% change year-on-year - +11.11% +5.88%

HDFS
Job Vacancy Trend in London

Job postings citing HDFS as a percentage of all IT jobs advertised in London.

Job vacancy trend for HDFS in London

HDFS
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in London.

Salary trend for HDFS in London

HDFS
Salary Histogram in London

The salary distribution of IT jobs citing HDFS in London over the 6 months to 13 December 2019.

Salary histogram for HDFS in London

HDFS
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the London region over the 6 months to 13 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
East London +15 16 £80,000 -15.79% 1
Central London +2 15 £75,000 - 2
West London +23 2 £60,000 -33.33%
HDFS
England

For the 6 months to 13 December 2019, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for HDFS.

1 120 (92.31%) Hadoop
2 109 (83.85%) Apache Hive
3 101 (77.69%) Big Data
4 94 (72.31%) Python
5 92 (70.77%) Azure
6 84 (64.62%) Apache Spark
7 73 (56.15%) SQL
8 69 (53.08%) AWS
9 60 (46.15%) Agile Software Development
10 57 (43.85%) Linux
10 57 (43.85%) Business Intelligence
11 56 (43.08%) Data Modelling
12 55 (42.31%) Amazon S3
13 54 (41.54%) NoSQL
14 48 (36.92%) Apache
14 48 (36.92%) Data Science
15 47 (36.15%) HBase
16 45 (34.62%) Amazon EMR
16 45 (34.62%) Hadoop YARN
16 45 (34.62%) Scala
17 42 (32.31%) HDInsight
18 40 (30.77%) SQL Server
19 38 (29.23%) Java
19 38 (29.23%) Impala
19 38 (29.23%) Data Engineering
20 36 (27.69%) Machine Learning
21 29 (22.31%) Algorithms
21 29 (22.31%) ETL
22 28 (21.54%) QA
23 27 (20.77%) Data Warehouse

HDFS
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 84 (64.62%) Apache Spark
2 48 (36.92%) Apache
3 19 (14.62%) Apache Airflow
4 9 (6.92%) SAS
5 2 (1.54%) Apache Pig
Applications
1 1 (0.77%) Microsoft Project
Business Applications
1 1 (0.77%) Adobe Campaign
Cloud Services
1 92 (70.77%) Azure
2 69 (53.08%) AWS
3 55 (42.31%) Amazon S3
4 45 (34.62%) Amazon EMR
5 25 (19.23%) GCP
6 19 (14.62%) Azure Data Factory
7 18 (13.85%) Amazon Kinesis
8 12 (9.23%) IaaS
8 12 (9.23%) PaaS
9 2 (1.54%) Amazon EC2
9 2 (1.54%) OpenShift
9 2 (1.54%) Power Platform
9 2 (1.54%) SaaS
10 1 (0.77%) Serverless
Communications & Networking
1 11 (8.46%) Kerberos
2 10 (7.69%) Firewall
2 10 (7.69%) VPN
3 5 (3.85%) HTTP
3 5 (3.85%) HTTPS
3 5 (3.85%) SSL
4 1 (0.77%) Broadband
Database & Business Intelligence
1 120 (92.31%) Hadoop
2 109 (83.85%) Apache Hive
3 101 (77.69%) Big Data
4 54 (41.54%) NoSQL
5 47 (36.15%) HBase
6 42 (32.31%) HDInsight
7 40 (30.77%) SQL Server
8 38 (29.23%) Impala
9 27 (20.77%) Data Warehouse
10 24 (18.46%) PostgreSQL
11 23 (17.69%) Neo4j
12 21 (16.15%) Data Lake
13 20 (15.38%) Data Mining
13 20 (15.38%) Presto
14 18 (13.85%) Amazon DynamoDB
14 18 (13.85%) Amazon Redshift
15 16 (12.31%) BigQuery
15 16 (12.31%) Sqoop
16 15 (11.54%) SQL Server Analysis Services
17 6 (4.62%) Azure SQL Data Warehouse
Development Applications
1 14 (10.77%) ProC
2 4 (3.08%) Git (software)
2 4 (3.08%) Jenkins
3 2 (1.54%) JIRA
4 1 (0.77%) Bitbucket
4 1 (0.77%) Maven
4 1 (0.77%) Selenium
General
1 14 (10.77%) Public Sector
2 12 (9.23%) Finance
2 12 (9.23%) Games
3 11 (8.46%) Legal
4 5 (3.85%) Retail
5 4 (3.08%) Manufacturing
5 4 (3.08%) Marketing
6 1 (0.77%) Banking
Job Titles
1 65 (50.00%) Data Engineer
2 24 (18.46%) Architect
3 22 (16.92%) Data Architect
4 19 (14.62%) Data Scientist
4 19 (14.62%) Senior Data Engineer
5 18 (13.85%) Cloud Architect
6 15 (11.54%) Senior Data Scientist
7 10 (7.69%) Big Data Engineer
7 10 (7.69%) Cloud Engineer
7 10 (7.69%) Developer
7 10 (7.69%) DevOps Engineer
8 6 (4.62%) Senior DevOps
8 6 (4.62%) Senior DevOps Engineer
9 5 (3.85%) Big Data Developer
9 5 (3.85%) Java Developer
10 4 (3.08%) Principal Engineer
11 3 (2.31%) Business Intelligence Architect
11 3 (2.31%) Junior
12 2 (1.54%) Oracle Developer
12 2 (1.54%) Solutions Architect
Libraries, Frameworks & Software Standards
1 24 (18.46%) LAPP Stack
2 18 (13.85%) Lambda Expressions
3 14 (10.77%) D3.js
3 14 (10.77%) ggplot2
4 13 (10.00%) Kafka
5 10 (7.69%) OAuth
5 10 (7.69%) SAML
6 9 (6.92%) Elastic Stack
6 9 (6.92%) LDAP
7 4 (3.08%) Web Services
8 3 (2.31%) Akka
9 2 (1.54%) Apache Avro
9 2 (1.54%) PySpark
9 2 (1.54%) SparkR
9 2 (1.54%) Spring
10 1 (0.77%) Natural Language Processing
10 1 (0.77%) Redux
10 1 (0.77%) REST
10 1 (0.77%) Symfony
10 1 (0.77%) Theano
Miscellaneous
1 29 (22.31%) Algorithms
2 18 (13.85%) Analytical Skills
3 10 (7.69%) Data Centre
4 2 (1.54%) Cloud Native
4 2 (1.54%) Data Structures
4 2 (1.54%) Equities
4 2 (1.54%) Fixed Income
4 2 (1.54%) Greenfield Project
4 2 (1.54%) Hybrid Cloud
4 2 (1.54%) Public Cloud
5 1 (0.77%) Derivative
5 1 (0.77%) Linux Command Line
5 1 (0.77%) Management Information System
5 1 (0.77%) Replication
5 1 (0.77%) Social Network
5 1 (0.77%) Virtual Team
Operating Systems
1 57 (43.85%) Linux
2 5 (3.85%) Unix
Processes & Methodologies
1 60 (46.15%) Agile Software Development
2 57 (43.85%) Business Intelligence
3 56 (43.08%) Data Modelling
4 48 (36.92%) Data Science
5 38 (29.23%) Data Engineering
6 36 (27.69%) Machine Learning
7 29 (22.31%) ETL
8 24 (18.46%) Software Engineering
9 23 (17.69%) Data Integration
10 22 (16.92%) Metadata Management
11 19 (14.62%) Test Automation
12 17 (13.08%) Analytics
13 16 (12.31%) Data Management
13 16 (12.31%) DevOps
14 15 (11.54%) Data Architecture
14 15 (11.54%) Data Cleansing
14 15 (11.54%) Functional Testing
15 14 (10.77%) Regression Testing
16 12 (9.23%) Master Data Management
16 12 (9.23%) Microservices
Programming Languages
1 94 (72.31%) Python
2 73 (56.15%) SQL
3 45 (34.62%) Scala
4 38 (29.23%) Java
5 19 (14.62%) R
6 16 (12.31%) PL/SQL
6 16 (12.31%) Shell Script
7 14 (10.77%) C
8 11 (8.46%) JavaScript
9 10 (7.69%) Bash Shell
9 10 (7.69%) Ruby
10 4 (3.08%) Java 8
11 1 (0.77%) Haskell
11 1 (0.77%) HiveQL
11 1 (0.77%) PHP
11 1 (0.77%) PHP 7
11 1 (0.77%) Pig Latin
11 1 (0.77%) T-SQL
Qualifications
1 9 (6.92%) Degree
2 2 (1.54%) MCSA
2 2 (1.54%) Microsoft Certification
Quality Assurance & Compliance
1 28 (21.54%) QA
2 27 (20.77%) Data Quality
3 11 (8.46%) GDPR
3 11 (8.46%) ISO/IEC 27001
System Software
1 3 (2.31%) Apache Flume
1 3 (2.31%) Docker
2 1 (0.77%) Cronacle
Systems Management
1 45 (34.62%) Hadoop YARN
2 13 (10.00%) Oozie
3 10 (7.69%) Ambari
3 10 (7.69%) Single Sign-On
4 4 (3.08%) Puppet
5 3 (2.31%) Ansible
5 3 (2.31%) Terraform
6 2 (1.54%) Kubernetes
7 1 (0.77%) Control-M
Vendors
1 19 (14.62%) Oracle
2 18 (13.85%) Databricks
3 16 (12.31%) Teradata
4 15 (11.54%) Cloudera
5 12 (9.23%) Google
5 12 (9.23%) Hortonworks
6 4 (3.08%) Microsoft
7 3 (2.31%) Tableau
8 2 (1.54%) Blue Prism
8 2 (1.54%) MapR
8 2 (1.54%) UiPath
9 1 (0.77%) Adobe
9 1 (0.77%) Alteryx
9 1 (0.77%) IBM
9 1 (0.77%) Salesforce Marketing Cloud
9 1 (0.77%) Salesforce.com
9 1 (0.77%) Talend