Period
to 22 September 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 22 September 2019 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > London
6 months to
22 Sep 2019
Same period 2018 Same period 2017
Rank 573 566 692
Rank change year-on-year -7 +126 +1
Permanent jobs citing HDFS 153 269 168
As % of all permanent IT jobs advertised in London 0.28% 0.39% 0.22%
As % of the System Software category 1.56% 2.55% 1.69%
Number of salaries quoted 141 196 137
London median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% -17.65%
10th Percentile £56,250 £55,000 £53,750
90th Percentile £92,500 £97,500 £108,500
England median annual salary £70,000 £70,000 £70,000

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for system software skills.

All System Software Skills
London
Permanent vacancies with a requirement for system software skills 9,807 10,557 9,925
As % of all permanent IT jobs advertised in London 17.80% 15.43% 13.25%
Number of salaries quoted 8,084 8,871 8,434
London median annual salary £65,000 £60,000 £55,000
Median salary % change year-on-year +8.33% +9.09% +10.00%
10th Percentile £29,825 £29,000 £28,000
90th Percentile £97,500 £90,500 £85,000
England median annual salary £50,000 £50,000 £45,000
% change year-on-year - +11.11% +5.88%

HDFS
Job Vacancy Trend in London

Job postings citing HDFS as a percentage of all IT jobs advertised in London.

Job vacancy trend for HDFS in London

HDFS
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in London.

Salary trend for HDFS in London

HDFS
Salary Histogram in London

The salary distribution of IT jobs citing HDFS in London over the 6 months to 22 September 2019.

Salary histogram for HDFS in London

HDFS
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the London region over the 6 months to 22 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +18 18 £75,000 - 3
West London +31 9 £60,000 - 2
East London +6 6 £80,750 -15.00% 3
South London - 1 £87,500 - 1
HDFS
England

For the 6 months to 22 September 2019, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for HDFS.

1 133 (86.93%) Hadoop
2 119 (77.78%) Apache Hive
3 108 (70.59%) Big Data
4 106 (69.28%) Apache Spark
5 104 (67.97%) Python
6 80 (52.29%) SQL
7 73 (47.71%) Azure
8 68 (44.44%) Scala
9 67 (43.79%) Agile Software Development
10 66 (43.14%) AWS
11 57 (37.25%) Data Science
12 56 (36.60%) HBase
13 52 (33.99%) NoSQL
14 51 (33.33%) Impala
14 51 (33.33%) Linux
15 49 (32.03%) Java
16 46 (30.07%) ETL
16 46 (30.07%) Hadoop YARN
17 39 (25.49%) Data Engineering
18 38 (24.84%) Data Warehouse
18 38 (24.84%) Analytics
19 36 (23.53%) Business Intelligence
20 35 (22.88%) Data Modelling
20 35 (22.88%) Kafka
20 35 (22.88%) Machine Learning
21 33 (21.57%) Amazon EMR
22 32 (20.92%) Amazon S3
22 32 (20.92%) Apache
23 31 (20.26%) SQL Server
24 28 (18.30%) Data Integration

HDFS
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 106 (69.28%) Apache Spark
2 32 (20.92%) Apache
3 14 (9.15%) SAS
4 9 (5.88%) Apache Airflow
5 7 (4.58%) Apache Pig
6 3 (1.96%) Apache Solr
6 3 (1.96%) Elasticsearch
7 2 (1.31%) WildFly
8 1 (0.65%) Cloud Foundry
8 1 (0.65%) Confluence
Applications
1 1 (0.65%) Microsoft Project
Business Applications
1 1 (0.65%) Adobe Campaign
Cloud Services
1 73 (47.71%) Azure
2 66 (43.14%) AWS
3 33 (21.57%) Amazon EMR
4 32 (20.92%) Amazon S3
5 20 (13.07%) GCP
6 13 (8.50%) Amazon Kinesis
7 12 (7.84%) Azure Data Factory
8 8 (5.23%) IaaS
8 8 (5.23%) PaaS
9 3 (1.96%) Amazon EC2
9 3 (1.96%) Cloud Computing
9 3 (1.96%) Power Platform
10 2 (1.31%) OpenShift
10 2 (1.31%) SaaS
11 1 (0.65%) Serverless
Communications & Networking
1 8 (5.23%) Kerberos
2 6 (3.92%) Firewall
2 6 (3.92%) VPN
3 3 (1.96%) HTTP
3 3 (1.96%) HTTPS
3 3 (1.96%) SSL
4 1 (0.65%) Broadband
Database & Business Intelligence
1 133 (86.93%) Hadoop
2 119 (77.78%) Apache Hive
3 108 (70.59%) Big Data
4 56 (36.60%) HBase
5 52 (33.99%) NoSQL
6 51 (33.33%) Impala
7 38 (24.84%) Data Warehouse
8 31 (20.26%) SQL Server
9 23 (15.03%) HDInsight
10 18 (11.76%) Data Mining
10 18 (11.76%) PostgreSQL
10 18 (11.76%) Sqoop
11 16 (10.46%) Neo4j
12 15 (9.80%) Amazon Redshift
12 15 (9.80%) Data Lake
13 13 (8.50%) Apache Cassandra
14 11 (7.19%) Presto
15 9 (5.88%) Amazon DynamoDB
15 9 (5.88%) Oracle Database
15 9 (5.88%) Relational Database
Development Applications
1 11 (7.19%) Jenkins
2 9 (5.88%) Git (software)
3 8 (5.23%) ProC
4 5 (3.27%) JIRA
5 3 (1.96%) JUnit
6 2 (1.31%) IntelliJ
7 1 (0.65%) Bitbucket
7 1 (0.65%) Hudson
7 1 (0.65%) Maven
7 1 (0.65%) Selenium
7 1 (0.65%) Travis CI
General
1 14 (9.15%) Finance
2 11 (7.19%) Public Sector
3 8 (5.23%) Games
4 6 (3.92%) Legal
4 6 (3.92%) Manufacturing
5 5 (3.27%) Retail
6 4 (2.61%) Banking
6 4 (2.61%) Marketing
7 2 (1.31%) Front Office
8 1 (0.65%) Investment Banking
8 1 (0.65%) Retail Banking
Job Titles
1 74 (48.37%) Data Engineer
2 22 (14.38%) Developer
3 20 (13.07%) Data Scientist
3 20 (13.07%) Senior Data Engineer
4 16 (10.46%) Architect
4 16 (10.46%) Senior Data Scientist
5 14 (9.15%) Data Architect
6 12 (7.84%) Big Data Developer
6 12 (7.84%) Big Data Engineer
7 10 (6.54%) Cloud Architect
8 9 (5.88%) Cloud Engineer
8 9 (5.88%) Data Warehouse Developer
8 9 (5.88%) Oracle Data Warehouse Developer
8 9 (5.88%) Oracle Developer
9 7 (4.58%) Java Developer
9 7 (4.58%) QA Engineer
10 6 (3.92%) DevOps Engineer
11 5 (3.27%) Scala Developer
12 4 (2.61%) Hadoop Developer
12 4 (2.61%) Principal Engineer
Libraries, Frameworks & Software Standards
1 35 (22.88%) Kafka
2 17 (11.11%) D3.js
2 17 (11.11%) ggplot2
3 15 (9.80%) LAPP Stack
4 9 (5.88%) Elastic Stack
4 9 (5.88%) Lambda Expressions
5 6 (3.92%) OAuth
5 6 (3.92%) SAML
6 5 (3.27%) LDAP
6 5 (3.27%) RabbitMQ
6 5 (3.27%) Spring
6 5 (3.27%) Web Services
7 3 (1.96%) .NET
7 3 (1.96%) Akka
7 3 (1.96%) Apache NiFi
7 3 (1.96%) PySpark
7 3 (1.96%) REST
8 2 (1.31%) Spark Streaming
8 2 (1.31%) SparkR
8 2 (1.31%) Spring Boot
Miscellaneous
1 26 (16.99%) Algorithms
2 15 (9.80%) Analytical Skills
3 13 (8.50%) Data Structures
4 7 (4.58%) Data Centre
4 7 (4.58%) Greenfield Project
5 3 (1.96%) Fixed Income
5 3 (1.96%) Public Cloud
5 3 (1.96%) Virtual Team
6 2 (1.31%) Cloud Native
6 2 (1.31%) Equities
6 2 (1.31%) Hybrid Cloud
6 2 (1.31%) Linux Command Line
6 2 (1.31%) User Experience
7 1 (0.65%) Market Risk
7 1 (0.65%) Social Network
Operating Systems
1 51 (33.33%) Linux
2 16 (10.46%) Unix
3 2 (1.31%) Ubuntu
Processes & Methodologies
1 67 (43.79%) Agile Software Development
2 57 (37.25%) Data Science
3 46 (30.07%) ETL
4 39 (25.49%) Data Engineering
5 38 (24.84%) Analytics
6 36 (23.53%) Business Intelligence
7 35 (22.88%) Data Modelling
7 35 (22.88%) Machine Learning
8 28 (18.30%) Data Integration
9 17 (11.11%) Problem-Solving
9 17 (11.11%) Software Engineering
10 16 (10.46%) Metadata Management
11 15 (9.80%) Data Development
11 15 (9.80%) Statistics
12 14 (9.15%) Data Ingestion
12 14 (9.15%) DevOps
12 14 (9.15%) Mathematics
12 14 (9.15%) Microservices
13 13 (8.50%) MapReduce
14 12 (7.84%) Kimball Methodology
Programming Languages
1 104 (67.97%) Python
2 80 (52.29%) SQL
3 68 (44.44%) Scala
4 49 (32.03%) Java
5 23 (15.03%) R
6 18 (11.76%) PL/SQL
7 16 (10.46%) JavaScript
8 10 (6.54%) Shell Script
9 8 (5.23%) C
9 8 (5.23%) Ruby
10 6 (3.92%) Bash Shell
11 4 (2.61%) Java 8
12 3 (1.96%) C#
13 2 (1.31%) Groovy
13 2 (1.31%) HiveQL
14 1 (0.65%) PHP
14 1 (0.65%) PHP 7
14 1 (0.65%) Pig Latin
Qualifications
1 13 (8.50%) Degree
2 2 (1.31%) MCSA
2 2 (1.31%) Microsoft Certification
2 2 (1.31%) Security Cleared
3 1 (0.65%) SC Cleared
Quality Assurance & Compliance
1 24 (15.69%) QA
2 21 (13.73%) Data Quality
3 6 (3.92%) GDPR
3 6 (3.92%) ISO/IEC 27001
System Software
1 9 (5.88%) Apache Flume
2 8 (5.23%) Docker
3 3 (1.96%) Apache ZooKeeper
4 2 (1.31%) Cronacle
Systems Management
1 46 (30.07%) Hadoop YARN
2 13 (8.50%) Oozie
3 7 (4.58%) Kubernetes
4 6 (3.92%) Ambari
4 6 (3.92%) Single Sign-On
5 5 (3.27%) Terraform
6 4 (2.61%) Ansible
6 4 (2.61%) Mesos
7 3 (1.96%) Puppet
8 2 (1.31%) Control-M
Vendors
1 24 (15.69%) Oracle
2 19 (12.42%) Cloudera
3 13 (8.50%) Hortonworks
4 11 (7.19%) Databricks
5 10 (6.54%) Google
6 9 (5.88%) Teradata
7 6 (3.92%) Microsoft
8 5 (3.27%) Tableau
9 4 (2.61%) MapR
9 4 (2.61%) Talend
10 2 (1.31%) Blue Prism
10 2 (1.31%) UiPath
11 1 (0.65%) Adobe
11 1 (0.65%) Alteryx
11 1 (0.65%) Informatica
11 1 (0.65%) Jaspersoft
11 1 (0.65%) MicroStrategy
11 1 (0.65%) Salesforce Marketing Cloud
11 1 (0.65%) Salesforce.com
11 1 (0.65%) Syncsort