Period
to 21 April 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 21 April 2019 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
England > London
6 months to
21 Apr 2019
Same period 2018 Same period 2017
Rank 591 602 638
Rank change year-on-year +11 +36 +31
Permanent jobs citing HDFS 165 238 179
As % of all permanent IT jobs advertised in London 0.27% 0.34% 0.26%
As % of the System Software category 1.65% 2.38% 2.08%
Number of salaries quoted 129 154 150
London median annual salary £75,000 £75,000 £80,000
Median salary % change year-on-year - -6.25% -
10th Percentile £53,500 £57,500 £55,000
90th Percentile £96,000 £101,750 £115,000
England median annual salary £70,000 £70,000 £75,000
% change year-on-year - -6.67% +7.14%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for system software skills.

All System Software Skills
London
Permanent vacancies with a requirement for system software skills 9,994 10,020 8,623
As % of all permanent IT jobs advertised in London 16.46% 14.31% 12.57%
Number of salaries quoted 8,277 8,431 7,375
London median annual salary £60,000 £55,000 £52,500
Median salary % change year-on-year +9.09% +4.76% +5.00%
10th Percentile £30,000 £29,250 £27,500
90th Percentile £95,000 £88,750 £82,500
England median annual salary £50,000 £47,500 £42,500
% change year-on-year +5.26% +11.76% +2.41%

HDFS
Job Vacancy Trend in London

Job postings citing HDFS as a percentage of all IT jobs advertised in London.

Job vacancy trend for HDFS in London

HDFS
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in London.

Salary trend for HDFS in London

HDFS
Salary Histogram in London

The salary distribution of IT jobs citing HDFS in London over the 6 months to 21 April 2019.

Salary histogram for HDFS in London

HDFS
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the London region over the 6 months to 21 April 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +42 41 £75,000 +3.45% 4
West London +39 13 £60,000 -
South London +1 2 £85,000 +3.03%
HDFS
England

For the 6 months to 21 April 2019, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for HDFS.

1 152 (92.12%) Hadoop
2 135 (81.82%) Big Data
3 118 (71.52%) Apache Hive
4 100 (60.61%) Java
5 99 (60.00%) Agile Software Development
6 93 (56.36%) Python
7 90 (54.55%) Apache Spark
8 83 (50.30%) Kafka
9 79 (47.88%) HBase
10 67 (40.61%) Amazon AWS
11 63 (38.18%) Scala
12 62 (37.58%) ETL
13 59 (35.76%) Data Science
14 58 (35.15%) NoSQL
15 56 (33.94%) SQL
16 54 (32.73%) Linux
17 51 (30.91%) Data Warehouse
18 46 (27.88%) Impala
19 41 (24.85%) Hadoop YARN
19 41 (24.85%) Analytics
20 40 (24.24%) Machine Learning
20 40 (24.24%) Apache Cassandra
21 39 (23.64%) Oracle
22 37 (22.42%) Apache Flume
23 36 (21.82%) Data Integration
24 35 (21.21%) Cloudera
24 35 (21.21%) Finance
25 33 (20.00%) MapReduce
26 32 (19.39%) Microsoft Azure
27 29 (17.58%) Open Source

HDFS
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 90 (54.55%) Apache Spark
2 21 (12.73%) Apache Pig
2 21 (12.73%) Apache Solr
2 21 (12.73%) Elasticsearch
3 9 (5.45%) Apache
3 9 (5.45%) SAS
4 8 (4.85%) WildFly
5 6 (3.64%) Jetty
6 3 (1.82%) Apache Airflow
7 2 (1.21%) Confluence
8 1 (0.61%) Cloud Foundry
8 1 (0.61%) JBoss
8 1 (0.61%) WebLogic
8 1 (0.61%) WebSphere
Business Applications
1 1 (0.61%) Adobe Campaign
Cloud Services
1 67 (40.61%) Amazon AWS
2 32 (19.39%) Microsoft Azure
3 18 (10.91%) Cloud Computing
3 18 (10.91%) GitHub
4 17 (10.30%) Amazon EMR
4 17 (10.30%) Google Cloud Platform
5 15 (9.09%) Amazon S3
6 11 (6.67%) Serverless
7 8 (4.85%) AWS Lambda
8 6 (3.64%) Azure Data Factory
8 6 (3.64%) SaaS
9 4 (2.42%) Amazon EC2
9 4 (2.42%) Amazon Kinesis
10 3 (1.82%) AWS Data Pipeline
11 2 (1.21%) AWS CloudFormation
11 2 (1.21%) IaaS
11 2 (1.21%) IBM Cloud
11 2 (1.21%) PaaS
12 1 (0.61%) Azure Machine Learning
Communications & Networking
1 8 (4.85%) Internet
2 5 (3.03%) Kerberos
3 1 (0.61%) Firewall
3 1 (0.61%) HTTP
3 1 (0.61%) HTTPS
3 1 (0.61%) SSL
3 1 (0.61%) VPN
Database & Business Intelligence
1 152 (92.12%) Hadoop
2 135 (81.82%) Big Data
3 118 (71.52%) Apache Hive
4 79 (47.88%) HBase
5 58 (35.15%) NoSQL
6 51 (30.91%) Data Warehouse
7 46 (27.88%) Impala
8 40 (24.24%) Apache Cassandra
9 28 (16.97%) Sqoop
10 26 (15.76%) Relational Database
11 21 (12.73%) Flink
11 21 (12.73%) MongoDB
12 20 (12.12%) PostgreSQL
13 18 (10.91%) Amazon Redshift
13 18 (10.91%) MySQL
13 18 (10.91%) Redis
13 18 (10.91%) SQL Server
14 13 (7.88%) Data Lake
14 13 (7.88%) RDBMS
15 10 (6.06%) Oracle Database
Development Applications
1 17 (10.30%) Git (software)
2 16 (9.70%) Jenkins
3 10 (6.06%) Maven
4 7 (4.24%) IntelliJ
5 5 (3.03%) JIRA
6 4 (2.42%) JUnit
7 1 (0.61%) Hudson
7 1 (0.61%) Oracle APEX
7 1 (0.61%) Selenium
7 1 (0.61%) Travis CI
General
1 35 (21.21%) Finance
2 14 (8.48%) Banking
3 13 (7.88%) Retail
4 10 (6.06%) Telecoms
5 7 (4.24%) Marketing
6 3 (1.82%) Legal
7 2 (1.21%) Financial Institution
8 1 (0.61%) Front Office
8 1 (0.61%) Investment Banking
8 1 (0.61%) Manufacturing
8 1 (0.61%) Retail Banking
Job Titles
1 75 (45.45%) Data Engineer
2 39 (23.64%) Developer
3 28 (16.97%) Java Developer
4 27 (16.36%) Big Data Engineer
5 24 (14.55%) Architect
6 19 (11.52%) Big Data Developer
6 19 (11.52%) Senior Data Engineer
7 14 (8.48%) Data Architect
8 9 (5.45%) Big Data Architect
8 9 (5.45%) Core Java Developer
8 9 (5.45%) Data Scientist
9 8 (4.85%) Hadoop Engineer
9 8 (4.85%) Python Engineer
9 8 (4.85%) Senior Data Scientist
10 7 (4.24%) Data Warehouse Developer
10 7 (4.24%) Java Developer - Fintech
10 7 (4.24%) Oracle Data Warehouse Developer
10 7 (4.24%) Oracle Developer
11 6 (3.64%) Consultant
11 6 (3.64%) Senior Developer
Libraries, Frameworks & Software Standards
1 83 (50.30%) Kafka
2 15 (9.09%) Spring
2 15 (9.09%) Web Services
3 13 (7.88%) REST
4 11 (6.67%) Apache Avro
4 11 (6.67%) Spark Streaming
5 10 (6.06%) JAX-RS
5 10 (6.06%) React
5 10 (6.06%) Redux
6 9 (5.45%) D3.js
6 9 (5.45%) PySpark
7 8 (4.85%) ggplot2
7 8 (4.85%) Spring Boot
8 7 (4.24%) Grails
8 7 (4.24%) Hibernate
8 7 (4.24%) LAMP
8 7 (4.24%) Ruby on Rails
9 6 (3.64%) J2EE
9 6 (3.64%) RESTful
10 5 (3.03%) RabbitMQ
Miscellaneous
1 24 (14.55%) Analytical Skills
2 18 (10.91%) Data Structures
3 13 (7.88%) Algorithms
4 10 (6.06%) Fintech
5 8 (4.85%) Greenfield Project
6 5 (3.03%) User Experience
7 4 (2.42%) Data Centre
8 3 (1.82%) Cloud Native
8 3 (1.82%) Linux Command Line
9 2 (1.21%) FMCG
9 2 (1.21%) Virtual Team
10 1 (0.61%) Public Cloud
10 1 (0.61%) Self-Motivation
Operating Systems
1 54 (32.73%) Linux
2 20 (12.12%) Unix
3 12 (7.27%) Windows
4 7 (4.24%) Ubuntu
5 1 (0.61%) VMS
Processes & Methodologies
1 99 (60.00%) Agile Software Development
2 62 (37.58%) ETL
3 59 (35.76%) Data Science
4 41 (24.85%) Analytics
5 40 (24.24%) Machine Learning
6 36 (21.82%) Data Integration
7 33 (20.00%) MapReduce
8 29 (17.58%) Data Engineering
8 29 (17.58%) Open Source
9 25 (15.15%) Data Modelling
10 22 (13.33%) Continuous Integration
10 22 (13.33%) Data Analysis
11 21 (12.73%) Software Engineering
12 20 (12.12%) Data Ingestion
13 19 (11.52%) TDD
14 16 (9.70%) Mentoring
14 16 (9.70%) Visualisation
15 15 (9.09%) Data Analytics
15 15 (9.09%) Data Architecture
15 15 (9.09%) Scrum
Programming Languages
1 100 (60.61%) Java
2 93 (56.36%) Python
3 63 (38.18%) Scala
4 56 (33.94%) SQL
5 23 (13.94%) R
6 18 (10.91%) Java 8
6 18 (10.91%) Ruby
7 14 (8.48%) JavaScript
8 8 (4.85%) PL/SQL
9 7 (4.24%) C#
9 7 (4.24%) Groovy
9 7 (4.24%) Shell Script
10 2 (1.21%) C++
10 2 (1.21%) HiveQL
10 2 (1.21%) Perl
10 2 (1.21%) PHP
11 1 (0.61%) MATLAB
Qualifications
1 9 (5.45%) Degree
2 6 (3.64%) Computer Science Degree
3 2 (1.21%) SC Cleared
3 2 (1.21%) Security Cleared
4 1 (0.61%) PhD
Quality Assurance & Compliance
1 15 (9.09%) GDPR
2 8 (4.85%) Data Quality
3 7 (4.24%) QA
4 6 (3.64%) IFRS
4 6 (3.64%) PCI DSS
5 3 (1.82%) ISO/IEC 27001
6 1 (0.61%) EMIR
6 1 (0.61%) MiFID
System Software
1 37 (22.42%) Apache Flume
2 19 (11.52%) Docker
3 16 (9.70%) Apache ZooKeeper
4 2 (1.21%) Active Directory
Systems Management
1 41 (24.85%) Hadoop YARN
2 28 (16.97%) Oozie
3 21 (12.73%) Kubernetes
4 10 (6.06%) Puppet
5 6 (3.64%) Ansible
6 5 (3.03%) Kibana
7 4 (2.42%) Mesos
7 4 (2.42%) Terraform
8 2 (1.21%) logstash
9 1 (0.61%) Ambari
9 1 (0.61%) Single Sign-On
Vendors
1 39 (23.64%) Oracle
2 35 (21.21%) Cloudera
3 27 (16.36%) Hortonworks
4 15 (9.09%) MapR
5 13 (7.88%) Talend
6 11 (6.67%) Google
7 10 (6.06%) Databricks
8 9 (5.45%) Informatica
9 8 (4.85%) Teradata
10 7 (4.24%) Microsoft
11 5 (3.03%) Tableau
12 4 (2.42%) IBM
13 2 (1.21%) WorldPay
14 1 (0.61%) Adobe
14 1 (0.61%) Cognos
14 1 (0.61%) Jaspersoft
14 1 (0.61%) MicroStrategy
14 1 (0.61%) RapidMiner
14 1 (0.61%) Salesforce Marketing Cloud
14 1 (0.61%) Syncsort