The following table provides summary statistics for permanent job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 3 months to 30 May 2017 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK
3 months to
30 May 2017
Same period 2016 Same period 2015
Rank 743 754 911
Rank change year-on-year +11 +157  
Permanent jobs citing HDFS 125 186 73
As % of all permanent IT jobs advertised in the UK 0.15% 0.19% 0.068%
As % of the System Software category 1.15% 1.50% 0.56%
Number of salaries quoted 98 152 54
Median salary £67,500 £70,000 £70,000
Median salary % change year-on-year -3.57% -  
90% offered a salary of more than £50,000 £45,000 £50,000
10% offered a salary of more than £100,000 £115,000 £140,000
UK excluding London median salary £55,000 £51,500 £50,000
% change year-on-year +6.79% +3.00%  

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for system software skills.

System Software Skills
UK
Permanent job vacancies with a requirement for system software skills 10857 12359 13001
As % of all permanent IT job vacancies advertised in the UK 12.69% 12.59% 12.02%
Number of salaries quoted 9202 10471 10743
Median salary £43,000 £42,500 £41,500
Median salary % change year-on-year +1.17% +2.40%  
90% offered a salary of more than £26,000 £25,000 £25,000
10% offered a salary of more than £70,000 £65,000 £67,500
UK excluding London median salary £37,500 £38,000 £37,500
% change year-on-year -1.31% +1.33%  

HDFS
Job Vacancy Trend

The job posting trend of jobs advertised citing HDFS as a proportion of all permanent or contract IT jobs with a match in the System Software category.

Job vacancy trend for HDFS in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS.

Salary trend for HDFS in the UK

HDFS
Salary Histogram

The salary distribution of IT jobs citing HDFS over the 3 months to 30 May 2017.

Salary histogram for HDFS in the UK

HDFS
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 30 May 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -10 115 £67,500 -3.57% 19
London +11 81 £70,000 -12.50% 14
City of London +24 16 £67,500 -3.57% 4
North West -14 15 £75,000 +57.89% 2
South East +44 10 £55,000 +10.00% 2
Scotland - 9 £65,750 -
Edinburgh - 9 £65,750 -
Manchester -18 8 £75,000 +57.89% 2
Cheshire - 7 £80,000 -
Surrey +48 5 £50,000 -
East of England - 5 £55,000 - 1
Hampshire +26 4 £55,000 +10.00%
Farnborough - 4 £55,000 -
Guildford - 4 £50,000 -
Chester - 3 £55,000 -
West End of London - 2 £57,500 -
South West - 2 £52,500 -
Cambridgeshire - 2 - - 1
Essex - 2 £55,000 -
Yorkshire +9 1 - -
Berkshire +1 1 - - 1
Reading -10 1 - - 1
Staines - 1 - -
Uxbridge - 1 - -
York - 1 - -
Devon - 1 £45,000 -
Durham - 1 £50,000 -
Croydon - 1 £55,000 -
Bristol - 1 £60,000 -
Cambridge - 1 - - 1

For the 6 months to 30 May 2017, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 214 (85.94%) Hadoop
2 210 (84.34%) Big Data
3 186 (74.70%) Apache Hive
4 164 (65.86%) Apache Spark
5 136 (54.62%) Java
6 125 (50.20%) HBase
7 105 (42.17%) MapReduce
7 105 (42.17%) Kafka
8 94 (37.75%) Apache Pig
9 89 (35.74%) Python
10 83 (33.33%) NoSQL
11 80 (32.13%) Linux
11 80 (32.13%) Agile Software Development
12 77 (30.92%) Analytics
13 75 (30.12%) Apache
14 61 (24.50%) Scala
15 60 (24.10%) Finance
16 58 (23.29%) Sqoop
16 58 (23.29%) Analytical Skills
17 57 (22.89%) Oozie
18 56 (22.49%) SQL
19 49 (19.68%) Unix
20 48 (19.28%) Hortonworks
20 48 (19.28%) Cloudera
21 42 (16.87%) Apache Cassandra
21 42 (16.87%) Degree
22 41 (16.47%) Hadoop YARN
23 37 (14.86%) ETL
24 35 (14.06%) Impala
24 35 (14.06%) Apache Flume

HDFS
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 164 (65.86%) Apache Spark
2 94 (37.75%) Apache Pig
3 75 (30.12%) Apache
4 16 (6.43%) Elasticsearch
5 10 (4.02%) Apache Solr
6 9 (3.61%) Tomcat
7 8 (3.21%) SAS
8 4 (1.61%) Apache Geronimo
8 4 (1.61%) Cloud Foundry
8 4 (1.61%) GemFire
8 4 (1.61%) GlassFish
8 4 (1.61%) JBoss
8 4 (1.61%) WebSphere
9 3 (1.20%) OpenStack
10 2 (0.80%) Mule
11 1 (0.40%) Confluence
11 1 (0.40%) Oracle Coherence
Applications
1 4 (1.61%) Weka
2 3 (1.20%) Microsoft Excel
Cloud Services
1 30 (12.05%) Amazon AWS
2 14 (5.62%) Microsoft Azure
3 12 (4.82%) GitHub
4 10 (4.02%) Google Cloud Platform
5 9 (3.61%) Cloud Computing
6 8 (3.21%) PaaS
7 6 (2.41%) IaaS
8 3 (1.20%) Loggly
8 3 (1.20%) SaaS
8 3 (1.20%) Sumo Logic
9 2 (0.80%) Amazon EC2
10 1 (0.40%) Amazon EMR
10 1 (0.40%) AWS Lambda
10 1 (0.40%) DigitalOcean
Communications & Networking
1 10 (4.02%) Kerberos
2 8 (3.21%) Internet
3 6 (2.41%) Network Security
4 5 (2.01%) LDAP
5 4 (1.61%) HTTP
6 3 (1.20%) DNS
7 2 (0.80%) Broadband
Database & Business Intelligence
1 214 (85.94%) Hadoop
2 210 (84.34%) Big Data
3 186 (74.70%) Apache Hive
4 125 (50.20%) HBase
5 83 (33.33%) NoSQL
6 58 (23.29%) Sqoop
7 42 (16.87%) Apache Cassandra
8 35 (14.06%) Impala
9 31 (12.45%) MongoDB
10 28 (11.24%) Relational Database
11 24 (9.64%) MySQL
12 21 (8.43%) Data Warehouse
13 18 (7.23%) SQL Server
14 13 (5.22%) HAWQ
15 12 (4.82%) PostgreSQL
15 12 (4.82%) RDBMS
16 11 (4.42%) Parquet
17 10 (4.02%) Data Mining
17 10 (4.02%) Redis
18 9 (3.61%) CouchDB
Development Applications
1 24 (9.64%) Jenkins
2 21 (8.43%) Git (software)
3 15 (6.02%) Gradle
4 14 (5.62%) Maven
5 9 (3.61%) Subversion
6 7 (2.81%) Talend Open Studio
7 6 (2.41%) Eclipse
7 6 (2.41%) RStudio
8 5 (2.01%) JUnit
8 5 (2.01%) SQL Server Management Studio (SSMS)
9 4 (1.61%) Ant
9 4 (1.61%) Grunt
9 4 (1.61%) JIRA
9 4 (1.61%) Vagrant
10 2 (0.80%) FindBugs
10 2 (0.80%) Gerrit
10 2 (0.80%) Jasmine
10 2 (0.80%) Selenium
10 2 (0.80%) TeamCity
11 1 (0.40%) Atlassian Bamboo
General
1 60 (24.10%) Finance
2 23 (9.24%) Retail
3 19 (7.63%) Banking
4 14 (5.62%) Advertising
5 9 (3.61%) Games
5 9 (3.61%) Telecoms
6 7 (2.81%) Front Office
6 7 (2.81%) Investment Banking
7 5 (2.01%) Marketing
8 4 (1.61%) Legal
8 4 (1.61%) Manufacturing
9 2 (0.80%) Automotive
10 1 (0.40%) Financial Institution
Job Titles
1 58 (23.29%) Architect
2 57 (22.89%) Developer
3 50 (20.08%) Data Architect
4 49 (19.68%) Data Engineer
5 36 (14.46%) Hadoop Engineer
6 34 (13.65%) Big Data Engineer
7 30 (12.05%) Big Data Architect
8 27 (10.84%) Java Developer
9 19 (7.63%) Administrator
9 19 (7.63%) Hadoop Administrator
10 18 (7.23%) Hadoop Architect
11 17 (6.83%) Big Data Developer
12 16 (6.43%) Senior Developer
13 15 (6.02%) Enterprise Architect
14 14 (5.62%) Enterprise Data Architect
14 14 (5.62%) Scala Developer
14 14 (5.62%) Senior Data Engineer
15 13 (5.22%) Hadoop Developer
16 12 (4.82%) Data Scientist
17 11 (4.42%) Apache Spark Developer
Libraries, Frameworks & Software Standards
1 105 (42.17%) Kafka
2 21 (8.43%) Spring
3 18 (7.23%) Akka
4 17 (6.83%) JSON
5 16 (6.43%) Apache Avro
6 14 (5.62%) REST
7 13 (5.22%) AngularJS
8 10 (4.02%) Elastic Stack
8 10 (4.02%) Middleware
9 9 (3.61%) J2EE
9 9 (3.61%) jQuery
9 9 (3.61%) Spark Streaming
10 8 (3.21%) Natural Language Processing
10 8 (3.21%) RabbitMQ
10 8 (3.21%) RESTful
11 7 (2.81%) Apache Flex
11 7 (2.81%) HTML
11 7 (2.81%) Web Services
12 6 (2.41%) .NET
12 6 (2.41%) XML
Miscellaneous
1 58 (23.29%) Analytical Skills
2 34 (13.65%) Computer Science
3 22 (8.84%) Virtual Team
4 19 (7.63%) Algorithms
5 14 (5.62%) Linux Command Line
6 10 (4.02%) Replication
7 9 (3.61%) Greenfield Project
8 8 (3.21%) Data Structures
8 8 (3.21%) Foreign Exchange (FX)
9 7 (2.81%) Fintech
10 6 (2.41%) Clustering
10 6 (2.41%) Data Centre
10 6 (2.41%) Management Information System
10 6 (2.41%) Social Network
11 5 (2.01%) Derivative
12 4 (1.61%) Fixed Income
13 3 (1.20%) Security Operations Centre
14 2 (0.80%) Grid Computing
14 2 (0.80%) PKI
14 2 (0.80%) User Experience
Operating Systems
1 80 (32.13%) Linux
2 49 (19.68%) Unix
3 6 (2.41%) Red Hat Enterprise Linux
4 3 (1.20%) CoreOS
5 2 (0.80%) Windows
6 1 (0.40%) Mesosphere
Processes & Methodologies
1 105 (42.17%) MapReduce
2 80 (32.13%) Agile Software Development
3 77 (30.92%) Analytics
4 37 (14.86%) ETL
5 34 (13.65%) E-Commerce
6 33 (13.25%) Mentoring
7 32 (12.85%) Data Architecture
7 32 (12.85%) Open Source
8 31 (12.45%) TDD
9 28 (11.24%) Machine Learning
10 25 (10.04%) Software Engineering
11 24 (9.64%) Business Intelligence
12 23 (9.24%) Stakeholder Management
12 23 (9.24%) Visualisation
13 21 (8.43%) OO
14 20 (8.03%) Data Ingestion
14 20 (8.03%) DevOps
15 19 (7.63%) Data Analytics
15 19 (7.63%) Scrum
16 18 (7.23%) Data Management
Programming Languages
1 136 (54.62%) Java
2 89 (35.74%) Python
3 61 (24.50%) Scala
4 56 (22.49%) SQL
5 22 (8.84%) JavaScript
6 19 (7.63%) C++
7 17 (6.83%) Ruby
8 15 (6.02%) C
8 15 (6.02%) PHP
8 15 (6.02%) Shell Script
9 13 (5.22%) Perl
10 11 (4.42%) C#
10 11 (4.42%) R
11 10 (4.02%) Bash Shell
11 10 (4.02%) T-SQL
12 5 (2.01%) PL/SQL
13 3 (1.20%) F#
13 3 (1.20%) PHP 5
13 3 (1.20%) PHP 7
14 2 (0.80%) Go
Qualifications
1 42 (16.87%) Degree
2 19 (7.63%) PhD
3 14 (5.62%) Computer Science Degree
3 14 (5.62%) Postgraduate
4 7 (2.81%) CISSP
5 5 (2.01%) CEH
5 5 (2.01%) GCIH
5 5 (2.01%) OSCP
6 3 (1.20%) Security Cleared
7 2 (0.80%) Numerate Degree
7 2 (0.80%) OCA
7 2 (0.80%) OCP
7 2 (0.80%) Oracle Certification
7 2 (0.80%) SC Cleared
8 1 (0.40%) CBAP
8 1 (0.40%) IIBA
Quality Assurance & Compliance
1 11 (4.42%) QA
2 7 (2.81%) Data Quality
3 6 (2.41%) GCP
4 3 (1.20%) GPG13
4 3 (1.20%) ISO/IEC 27001
5 2 (0.80%) SLA
6 1 (0.40%) Basel III
6 1 (0.40%) Dodd-Frank
System Software
1 35 (14.06%) Apache Flume
2 25 (10.04%) Apache ZooKeeper
3 13 (5.22%) Docker
4 8 (3.21%) VMware Infrastructure
5 5 (2.01%) Snort
6 3 (1.20%) vCloud
6 3 (1.20%) VirtualBox
7 2 (0.80%) Oracle RAC
8 1 (0.40%) Cronacle
8 1 (0.40%) KVM
8 1 (0.40%) Virtual Machines
8 1 (0.40%) Xen
Systems Management
1 57 (22.89%) Oozie
2 41 (16.47%) Hadoop YARN
3 16 (6.43%) Puppet
4 15 (6.02%) Ambari
5 14 (5.62%) Ansible
6 11 (4.42%) Opscode Chef
7 8 (3.21%) Terraform
8 6 (2.41%) Graphite
8 6 (2.41%) Kibana
8 6 (2.41%) Kubernetes
8 6 (2.41%) logstash
8 6 (2.41%) Mesos
9 5 (2.01%) Fluentd
9 5 (2.01%) QRadar
10 4 (1.61%) Nagios
11 3 (1.20%) CSIRT
11 3 (1.20%) Salt
11 3 (1.20%) ZABBIX
12 1 (0.40%) Docker Swarm
12 1 (0.40%) Rancher
Vendors
1 48 (19.28%) Cloudera
1 48 (19.28%) Hortonworks
2 27 (10.84%) MapR
3 22 (8.84%) Oracle
4 13 (5.22%) Google
5 11 (4.42%) Tableau
6 10 (4.02%) Splunk
7 8 (3.21%) Red Hat
7 8 (3.21%) VMware
8 7 (2.81%) Talend
9 6 (2.41%) IBM
10 5 (2.01%) ArcSight
10 5 (2.01%) FireEye
10 5 (2.01%) Fortinet
10 5 (2.01%) LogRhythm
10 5 (2.01%) Palo Alto
10 5 (2.01%) Sophos
10 5 (2.01%) Sourcefire
10 5 (2.01%) TippingPoint
10 5 (2.01%) Vertica
City of London
TDA Group
Salary: £60000 - £80000 per annum + Benefits + Bonus
Posted: 5 days ago
London
Worldpay
Posted: 4 days ago
London
Morgan Mckinley
Salary: £56000 per annum
Posted: 5 days ago
East London
Client Server
Salary: £80k to £95k + benefits
Posted: 5 days ago
London
Computer Futures
Salary: £75000 per annum + competitive
Posted: 8 days ago
City, London
ANSON MCCADE
Salary: UKP 95000 per year
Posted: 6 days ago
City, London
ANSON MCCADE
Salary: UKP 90000 per year
Posted: 6 days ago
London
Worldpay
Posted: 8 days ago
Manchester
Computer Futures
Salary: healthcare, discount, death in service
Posted: 14 days ago
Cambridge
Harvey Nash plc
Salary: £400 - £500 per day
Posted: 18 days ago
London
Client Server
Salary: £80k to £95k + benefits
Posted: 12 days ago
London
Direct Resource Services Ltd
Salary: £0 - £70,000 per year
Posted: 14 days ago
London
Venturi
Salary: £70000.00 - £95000.00 per annum + Bonus & Benefits
Posted: 27 days ago