The following table provides summary statistics for permanent job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 3 months to 30 March 2017 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK
3 months to
30 Mar 2017
Same period 2016 Same period 2015
Rank 729 735 894
Rank change year-on-year +6 +159  
Permanent jobs citing HDFS 123 216 75
As % of all permanent IT jobs advertised in the UK 0.14% 0.21% 0.070%
As % of the System Software category 1.19% 1.68% 0.56%
Number of salaries quoted 100 162 49
Median salary £76,500 £65,000 £65,000
Median salary % change year-on-year +17.69% -  
90% offered a salary of more than £54,750 £50,000 £45,000
10% offered a salary of more than £110,000 £120,000 £83,500
UK excluding London median salary £60,000 £57,500 £45,000
% change year-on-year +4.34% +27.77%  

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for system software skills.

System Software Skills
UK
Permanent job vacancies with a requirement for system software skills 10313 12839 13478
As % of all permanent IT job vacancies advertised in the UK 12.06% 12.28% 12.52%
Number of salaries quoted 8611 10851 11153
Median salary £42,500 £42,000 £42,000
Median salary % change year-on-year +1.19% -  
90% offered a salary of more than £25,000 £25,000 £25,000
10% offered a salary of more than £70,000 £65,000 £65,000
UK excluding London median salary £38,000 £38,000 £37,500
% change year-on-year - +1.33%  

HDFS
Job Vacancy Trend

The job posting trend of jobs advertised citing HDFS as a proportion of all permanent or contract IT jobs with a match in the System Software category.

Job vacancy trend for HDFS in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS.

Salary trend for HDFS in the UK

HDFS
Salary Histogram

The salary distribution of IT jobs citing HDFS over the 3 months to 30 March 2017.

Salary histogram for HDFS in the UK

HDFS
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 30 March 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -32 107 £76,500 +17.69% 20
London -1 81 £80,000 +6.66% 9
City of London +24 20 £100,000 +53.84% 1
North West -7 11 £55,000 - 1
Edinburgh - 11 £85,000 - 3
Scotland - 11 £85,000 - 3
South East +31 8 £85,000 +61.90% 4
Surrey +54 6 £67,500 -
Cheshire - 6 £55,000 -
Manchester - 5 £75,000 - 1
Chester - 4 £55,000 -
Essex - 3 £55,000 -
East of England - 3 £55,000 - 3
Canary Wharf - 2 £72,500 -
North East - 2 £50,000 - 1
Guildford - 2 £50,000 -
Durham - 2 £50,000 - 1
Staines - 2 - -
Berkshire +14 1 £87,500 +66.66% 1
West Midlands +10 1 - -
Wales - 1 £65,000 -
South West - 1 £45,000 - 1
South Wales - 1 £65,000 -
Devon - 1 £45,000 -
Newport - 1 £65,000 -
Exeter - 1 £45,000 -
Birmingham - 1 - -
Croydon - 1 £55,000 -
Crewe - 1 £55,000 -
Colchester - 1 £65,000 -

For the 6 months to 30 March 2017, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 235 (83.04%) Hadoop
2 234 (82.69%) Big Data
3 204 (72.08%) Apache Hive
4 187 (66.08%) Apache Spark
5 171 (60.42%) Java
6 149 (52.65%) HBase
7 118 (41.70%) Apache Pig
8 109 (38.52%) Linux
9 106 (37.46%) MapReduce
10 98 (34.63%) Agile Software Development
11 87 (30.74%) Kafka
12 80 (28.27%) Sqoop
13 79 (27.92%) NoSQL
13 79 (27.92%) Python
14 78 (27.56%) Analytics
15 75 (26.50%) Oozie
15 75 (26.50%) Apache
16 62 (21.91%) Scala
17 61 (21.55%) Finance
18 60 (21.20%) Degree
19 58 (20.49%) Hadoop YARN
20 56 (19.79%) Business Intelligence
20 56 (19.79%) SQL
21 53 (18.73%) Open Source
22 52 (18.37%) Unix
23 51 (18.02%) Amazon AWS
23 51 (18.02%) Analytical Skills
24 48 (16.96%) Software Engineering
25 47 (16.61%) Hortonworks
26 46 (16.25%) Cloudera

HDFS
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 187 (66.08%) Apache Spark
2 118 (41.70%) Apache Pig
3 75 (26.50%) Apache
4 33 (11.66%) Elasticsearch
5 11 (3.89%) SAS
6 10 (3.53%) Apache Solr
7 9 (3.18%) Cloud Foundry
8 7 (2.47%) OpenStack
9 6 (2.12%) JBoss
9 6 (2.12%) Tomcat
10 5 (1.77%) WildFly
11 4 (1.41%) Apache Geronimo
11 4 (1.41%) GlassFish
11 4 (1.41%) WebSphere
12 3 (1.06%) nginx
13 2 (0.71%) GemFire
13 2 (0.71%) Oracle Workflow
14 1 (0.35%) Oracle Coherence
Applications
1 4 (1.41%) Weka
2 3 (1.06%) MS Excel
Cloud Services
1 51 (18.02%) Amazon AWS
2 29 (10.25%) Microsoft Azure
3 13 (4.59%) Cloud Computing
4 11 (3.89%) Google Cloud Platform
5 7 (2.47%) IaaS
6 5 (1.77%) PaaS
7 4 (1.41%) Loggly
7 4 (1.41%) Sumo Logic
8 3 (1.06%) GitHub
9 2 (0.71%) Amazon EC2
9 2 (0.71%) Amazon EMR
10 1 (0.35%) AWS Lambda
10 1 (0.35%) DigitalOcean
10 1 (0.35%) Google Compute Engine
Communications & Networking
1 29 (10.25%) Kerberos
2 19 (6.71%) Internet
3 7 (2.47%) HTTP
4 5 (1.77%) LDAP
4 5 (1.77%) Network Security
5 4 (1.41%) DNS
6 3 (1.06%) IPv4
7 2 (0.71%) FTP
Database & Business Intelligence
1 235 (83.04%) Hadoop
2 234 (82.69%) Big Data
3 204 (72.08%) Apache Hive
4 149 (52.65%) HBase
5 80 (28.27%) Sqoop
6 79 (27.92%) NoSQL
7 44 (15.55%) Apache Cassandra
8 39 (13.78%) MongoDB
9 31 (10.95%) SQL Server
10 29 (10.25%) Impala
11 28 (9.89%) MySQL
12 26 (9.19%) Relational Database
13 25 (8.83%) Data Warehouse
14 23 (8.13%) Redis
15 20 (7.07%) PostgreSQL
16 16 (5.65%) HAWQ
16 16 (5.65%) Neo4j
16 16 (5.65%) QlikView
17 15 (5.30%) RDBMS
18 12 (4.24%) Data Lake
Development Applications
1 23 (8.13%) Jenkins
2 19 (6.71%) Selenium
3 18 (6.36%) Git (software)
4 17 (6.01%) Maven
5 12 (4.24%) Grunt
6 10 (3.53%) TeamCity
7 9 (3.18%) Gerrit
7 9 (3.18%) Jasmine
8 8 (2.83%) JUnit
9 7 (2.47%) Sonatype Nexus
10 6 (2.12%) Gradle
11 5 (1.77%) IntelliJ
12 4 (1.41%) Ant
12 4 (1.41%) JIRA
12 4 (1.41%) Subversion
12 4 (1.41%) TestNG
12 4 (1.41%) Vagrant
13 3 (1.06%) Apache Continuum
13 3 (1.06%) Bugzilla
13 3 (1.06%) Trac
General
1 61 (21.55%) Finance
2 28 (9.89%) Banking
3 18 (6.36%) Retail
4 17 (6.01%) Advertising
5 9 (3.18%) Telecoms
6 8 (2.83%) Games
7 6 (2.12%) Investment Banking
7 6 (2.12%) Manufacturing
8 4 (1.41%) Marketing
9 3 (1.06%) Automotive
9 3 (1.06%) Spanish Language
10 2 (0.71%) Financial Institution
10 2 (0.71%) Legal
10 2 (0.71%) Multimedia
11 1 (0.35%) Corporate Banking
11 1 (0.35%) Front Office
Job Titles
1 73 (25.80%) Developer
2 66 (23.32%) Architect
3 58 (20.49%) Data Architect
4 49 (17.31%) Data Engineer
5 42 (14.84%) Big Data Engineer
5 42 (14.84%) Java Developer
6 37 (13.07%) Big Data Architect
7 32 (11.31%) Administrator
7 32 (11.31%) Hadoop Administrator
8 27 (9.54%) Big Data Developer
8 27 (9.54%) Hadoop Engineer
9 24 (8.48%) Hadoop Architect
9 24 (8.48%) Java Engineer
10 23 (8.13%) Hadoop Developer
11 22 (7.77%) Software Engineer
12 21 (7.42%) Apache Spark Developer
12 21 (7.42%) Java Software Engineer
13 19 (6.71%) Scala Developer
13 19 (6.71%) Senior Developer
14 18 (6.36%) Enterprise Architect
Libraries, Frameworks & Software Standards
1 87 (30.74%) Kafka
2 22 (7.77%) Spring
3 20 (7.07%) AngularJS
4 18 (6.36%) Node.js
5 16 (5.65%) REST
6 14 (4.95%) Web Services
7 13 (4.59%) Apache Avro
7 13 (4.59%) HTML
7 13 (4.59%) J2EE
8 11 (3.89%) Elastic Stack
8 11 (3.89%) Hibernate
9 10 (3.53%) RESTful
10 9 (3.18%) Akka
10 9 (3.18%) jQuery
11 8 (2.83%) D3.js
11 8 (2.83%) JSON
11 8 (2.83%) SOAP
11 8 (2.83%) Spring Boot
11 8 (2.83%) XML
12 7 (2.47%) Natural Language Processing
Miscellaneous
1 51 (18.02%) Analytical Skills
2 44 (15.55%) Computer Science
3 21 (7.42%) Algorithms
4 14 (4.95%) Fintech
5 12 (4.24%) Virtual Team
6 11 (3.89%) Replication
7 8 (2.83%) Clustering
8 6 (2.12%) Data Centre
8 6 (2.12%) Linux Command Line
9 5 (1.77%) Management Information System
9 5 (1.77%) PKI
10 4 (1.41%) Derivative
10 4 (1.41%) Social Network
11 3 (1.06%) Client/Server
11 3 (1.06%) Data Structures
11 3 (1.06%) Enterprise Software
11 3 (1.06%) Security Operations Centre
12 2 (0.71%) Market Risk
12 2 (0.71%) Reference Data
12 2 (0.71%) User Experience
Operating Systems
1 109 (38.52%) Linux
2 52 (18.37%) Unix
3 12 (4.24%) Windows
4 9 (3.18%) Red Hat Enterprise Linux
5 5 (1.77%) Ubuntu
6 4 (1.41%) CoreOS
Processes & Methodologies
1 106 (37.46%) MapReduce
2 98 (34.63%) Agile Software Development
3 78 (27.56%) Analytics
4 56 (19.79%) Business Intelligence
5 53 (18.73%) Open Source
6 48 (16.96%) Software Engineering
7 42 (14.84%) TDD
8 37 (13.07%) Data Architecture
8 37 (13.07%) ETL
8 37 (13.07%) Mentoring
9 33 (11.66%) E-Commerce
10 28 (9.89%) Data Management
11 27 (9.54%) DevOps
12 26 (9.19%) Continuous Integration
12 26 (9.19%) Visualisation
13 24 (8.48%) Data Modelling
14 23 (8.13%) Data Ingestion
14 23 (8.13%) Scrum
15 22 (7.77%) BDD
15 22 (7.77%) Machine Learning
Programming Languages
1 171 (60.42%) Java
2 79 (27.92%) Python
3 62 (21.91%) Scala
4 56 (19.79%) SQL
5 29 (10.25%) Ruby
6 25 (8.83%) C++
7 23 (8.13%) JavaScript
8 20 (7.07%) C
9 18 (6.36%) R
10 17 (6.01%) Bash Shell
10 17 (6.01%) C#
11 14 (4.95%) Perl
12 13 (4.59%) PHP
13 9 (3.18%) Go
14 7 (2.47%) PL/SQL
15 6 (2.12%) Shell Script
16 5 (1.77%) Groovy
16 5 (1.77%) T-SQL
17 3 (1.06%) MATLAB
18 1 (0.35%) PHP 5
Qualifications
1 60 (21.20%) Degree
2 19 (6.71%) Postgraduate
3 17 (6.01%) PhD
4 7 (2.47%) CISSP
5 6 (2.12%) Security Cleared
6 5 (1.77%) CEH
6 5 (1.77%) GCIH
6 5 (1.77%) OSCP
6 5 (1.77%) SC Cleared
7 2 (0.71%) OCA
7 2 (0.71%) OCP
7 2 (0.71%) Oracle Certification
8 1 (0.35%) CBAP
8 1 (0.35%) IIBA
Quality Assurance & Compliance
1 13 (4.59%) QA
2 8 (2.83%) Data Quality
3 3 (1.06%) GCP
3 3 (1.06%) GPG13
3 3 (1.06%) ISO/IEC 27001
4 2 (0.71%) SLA
5 1 (0.35%) Basel III
5 1 (0.35%) Dodd-Frank
System Software
1 40 (14.13%) Apache Flume
2 29 (10.25%) Apache ZooKeeper
3 19 (6.71%) Docker
4 12 (4.24%) VMware Infrastructure
5 7 (2.47%) VirtualBox
6 5 (1.77%) Snort
7 3 (1.06%) KVM
7 3 (1.06%) vCloud
8 2 (0.71%) Oracle RAC
9 1 (0.35%) Active Directory
9 1 (0.35%) Xen
Systems Management
1 75 (26.50%) Oozie
2 58 (20.49%) Hadoop YARN
3 29 (10.25%) Puppet
4 20 (7.07%) Ambari
5 18 (6.36%) Ansible
6 17 (6.01%) Opscode Chef
7 10 (3.53%) Kubernetes
8 9 (3.18%) Kibana
9 7 (2.47%) Terraform
10 6 (2.12%) logstash
11 5 (1.77%) Fluentd
11 5 (1.77%) Nagios
11 5 (1.77%) QRadar
12 4 (1.41%) Salt
12 4 (1.41%) ZABBIX
13 3 (1.06%) CSIRT
14 2 (0.71%) Graphite
14 2 (0.71%) Mesos
15 1 (0.35%) Ganglia
15 1 (0.35%) Rancher
Vendors
1 47 (16.61%) Hortonworks
2 46 (16.25%) Cloudera
3 31 (10.95%) Oracle
4 27 (9.54%) Tableau
5 17 (6.01%) MapR
6 12 (4.24%) Google
6 12 (4.24%) Splunk
6 12 (4.24%) VMware
7 11 (3.89%) Red Hat
8 8 (2.83%) MicroStrategy
9 6 (2.12%) Microsoft
10 5 (1.77%) AlienVault
10 5 (1.77%) ArcSight
10 5 (1.77%) FireEye
10 5 (1.77%) Fortinet
10 5 (1.77%) LogRhythm
10 5 (1.77%) Palo Alto
10 5 (1.77%) Sophos
10 5 (1.77%) Sourcefire
10 5 (1.77%) TippingPoint
Cambridgeshire
Harvey Nash plc
Salary: £400 - £401 per day
Posted: Yesterday
City, London
Oliver Bernard
Salary: £95000 - £105000 per annum
Posted: 2 days ago
Farnborough, Hampshire
Discover Financial Services
Salary: benefits and bonus
Posted: 22 hours ago
Edinburgh, Midlothian
Scene One Ltd
Salary: bonus & benefits
Posted: 22 hours ago
London
Computer Futures
Salary: £55000 - £70000 per annum + competitive
Posted: 2 days ago
Cambridge, Cambridgeshire
Softweb Resourcing Limited
Salary: From £40,000 to £65,000 per annum Salary DOE + Benefits
Posted: 6 days ago
London
Churchill Frank
Salary: £50000 - £70000 per annum
Posted: 8 days ago
London
Churchill Frank
Salary: £75000 - £90000 per annum
Posted: 20 days ago
London
Churchill Frank
Salary: £80000 - £100000 per annum + Bonus, Pension, Travel Allowence
Posted: 20 days ago
Edinburgh
TDA Group
Salary: £80000 - £100000 per annum + Bonus & Benefits
Posted: 21 days ago
Edinburgh
TDA Group
Salary: £60000 - £75000 per annum + Bonus & Benefits
Posted: 21 days ago
Cambridge, Cambridgeshire
ECM Selection
Salary: to £50k+ DoE
Posted: 16 days ago
Leeds
Sky Betting & Gaming
Posted: 17 days ago
London
Computer Futures
Salary: competitive
Posted: 20 days ago
London
Computer Futures
Salary: competitive
Posted: 17 days ago
London
IQ Sales People
Salary: £75000 per annum + 20% Bonus and benefits
Posted: 13 days ago
Durham
Computer Futures
Salary: £40000 - £60000 per annum + competitive
Posted: 27 days ago
Salford, Lancashire
Raytheon Systems Ltd
Posted: 24 days ago