The following table provides summary statistics for permanent job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 3 months to 24 March 2017 with a comparison to the same period in the previous 2 years.

3 months to
24 Mar 2017
Same period 2016 Same period 2015
Hadoop Distributed File System (HDFS)
UK
Rank 730 739 882
Rank change year-on-year +9 +143  
Permanent jobs citing HDFS 127 209 77
As % of all permanent IT jobs advertised in the UK 0.15% 0.20% 0.073%
As % of the System Software category 1.24% 1.66% 0.58%
Number of salaries quoted 106 156 51
Median salary £76,500 £67,500 £62,500
Median salary % change year-on-year +13.33% +8.00%  
90% offered a salary of more than £53,750 £50,900 £45,000
10% offered a salary of more than £110,000 £120,000 £82,500
UK excluding London median salary £55,000 £57,500 £45,000
% change year-on-year -4.34% +27.77%  

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for system software skills.

System Software Skills
UK
Permanent job vacancies with a requirement for system software skills 10273 12592 13247
As % of all permanent IT job vacancies advertised in the UK 12.09% 12.23% 12.54%
Number of salaries quoted 8561 10613 10976
Median salary £42,500 £42,000 £42,500
Median salary % change year-on-year +1.19% -1.17%  
90% offered a salary of more than £25,000 £25,000 £25,000
10% offered a salary of more than £70,000 £65,000 £65,000
UK excluding London median salary £38,000 £38,000 £37,500
% change year-on-year - +1.33%  

HDFS
Job Vacancy Trend

The job posting trend of jobs advertised citing HDFS as a proportion of all permanent or contract IT jobs with a match in the System Software category.

Job vacancy trend for HDFS in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS.

Salary trend for HDFS in the UK

HDFS
Salary Histogram

The salary distribution of IT jobs citing HDFS over the 3 months to 24 March 2017.

Salary histogram for HDFS in the UK

HDFS
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 24 March 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +3 111 £76,500 +13.33% 21
London +10 84 £80,000 +6.66% 13
City of London +40 20 £100,000 +53.84% 3
North West -7 12 £55,000 - 1
Scotland - 11 £85,000 - 2
Edinburgh - 11 £85,000 - 2
South East +31 7 £85,000 +61.90% 2
Manchester - 6 £63,750 - 1
Cheshire - 6 £55,000 -
Surrey +43 5 £67,500 -
Chester - 4 £55,000 -
Canary Wharf - 3 £72,500 -
East of England - 3 £55,000 - 2
Essex - 3 £55,000 -
North East - 2 £50,000 - 1
Guildford - 2 £50,000 -
Durham - 2 £50,000 - 1
Yorkshire +16 1 £55,000 - 1
West Yorkshire +13 1 £55,000 - 1
Berkshire +12 1 £87,500 +66.66% 1
West Midlands +6 1 - -
Leeds +5 1 £55,000 - 1
Newport - 1 £65,000 -
Devon - 1 £45,000 -
South Wales - 1 £65,000 -
Birmingham - 1 - -
Croydon - 1 £55,000 -
Crewe - 1 £55,000 -
Exeter - 1 £45,000 -
Colchester - 1 £65,000 -

HDFS
Top 30 Related IT Skills

For the 6 months to 24 March 2017, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 240 (83.04%) Big Data
2 237 (82.01%) Hadoop
3 203 (70.24%) Apache Hive
4 189 (65.40%) Apache Spark
5 177 (61.25%) Java
6 150 (51.90%) HBase
7 117 (40.48%) Apache Pig
8 114 (39.45%) Linux
9 107 (37.02%) MapReduce
10 100 (34.60%) Agile Software Development
11 88 (30.45%) Kafka
12 79 (27.34%) Sqoop
12 79 (27.34%) NoSQL
13 78 (26.99%) Apache
13 78 (26.99%) Python
14 76 (26.30%) Analytics
14 76 (26.30%) Oozie
15 65 (22.49%) Scala
16 62 (21.45%) Finance
17 60 (20.76%) Business Intelligence
17 60 (20.76%) Degree
17 60 (20.76%) Hadoop YARN
18 58 (20.07%) Open Source
19 56 (19.38%) SQL
20 53 (18.34%) Software Engineering
20 53 (18.34%) Amazon AWS
21 51 (17.65%) Unix
22 49 (16.96%) Analytical Skills
23 47 (16.26%) Cloudera
24 46 (15.92%) Apache Cassandra

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 189 (65.40%) Apache Spark
2 117 (40.48%) Apache Pig
3 78 (26.99%) Apache
4 37 (12.80%) Elasticsearch
5 13 (4.50%) SAS
6 11 (3.81%) Apache Solr
7 9 (3.11%) Cloud Foundry
8 8 (2.77%) WildFly
9 7 (2.42%) OpenStack
10 6 (2.08%) JBoss
10 6 (2.08%) Tomcat
11 4 (1.38%) Apache Geronimo
11 4 (1.38%) GlassFish
11 4 (1.38%) WebSphere
12 3 (1.04%) nginx
13 2 (0.69%) GemFire
13 2 (0.69%) Oracle Workflow
14 1 (0.35%) Oracle Coherence
Applications
1 4 (1.38%) Weka
2 3 (1.04%) MS Excel
Cloud Services
1 53 (18.34%) Amazon AWS
2 27 (9.34%) Microsoft Azure
3 15 (5.19%) Cloud Computing
4 11 (3.81%) Google Cloud Platform
5 7 (2.42%) IaaS
6 5 (1.73%) PaaS
7 4 (1.38%) Loggly
7 4 (1.38%) Sumo Logic
8 3 (1.04%) GitHub
9 2 (0.69%) Amazon EC2
9 2 (0.69%) Amazon EMR
10 1 (0.35%) AWS Lambda
10 1 (0.35%) DigitalOcean
10 1 (0.35%) Google Compute Engine
Communications & Networking
1 29 (10.03%) Kerberos
2 20 (6.92%) Internet
3 7 (2.42%) HTTP
4 5 (1.73%) Network Security
5 4 (1.38%) DNS
5 4 (1.38%) LDAP
6 3 (1.04%) IPv4
7 2 (0.69%) FTP
Database & Business Intelligence
1 240 (83.04%) Big Data
2 237 (82.01%) Hadoop
3 203 (70.24%) Apache Hive
4 150 (51.90%) HBase
5 79 (27.34%) NoSQL
5 79 (27.34%) Sqoop
6 46 (15.92%) Apache Cassandra
7 39 (13.49%) MongoDB
8 33 (11.42%) SQL Server
9 28 (9.69%) Impala
9 28 (9.69%) Relational Database
10 27 (9.34%) MySQL
11 26 (9.00%) Data Warehouse
12 24 (8.30%) PostgreSQL
13 23 (7.96%) Redis
14 19 (6.57%) Neo4j
15 17 (5.88%) RDBMS
16 16 (5.54%) HAWQ
17 15 (5.19%) QlikView
18 11 (3.81%) Data Lake
Development Applications
1 24 (8.30%) Jenkins
2 19 (6.57%) Git (software)
2 19 (6.57%) Selenium
3 17 (5.88%) Maven
4 12 (4.15%) Grunt
4 12 (4.15%) TeamCity
5 9 (3.11%) Gerrit
5 9 (3.11%) Jasmine
6 8 (2.77%) IntelliJ
6 8 (2.77%) JUnit
6 8 (2.77%) Sonatype Nexus
7 6 (2.08%) Gradle
8 4 (1.38%) Ant
8 4 (1.38%) JIRA
8 4 (1.38%) Subversion
8 4 (1.38%) TestNG
8 4 (1.38%) Vagrant
9 3 (1.04%) Apache Continuum
9 3 (1.04%) Bugzilla
9 3 (1.04%) Trac
General
1 62 (21.45%) Finance
2 29 (10.03%) Banking
3 17 (5.88%) Advertising
3 17 (5.88%) Retail
4 9 (3.11%) Telecoms
5 8 (2.77%) Games
6 7 (2.42%) Manufacturing
7 6 (2.08%) Investment Banking
8 5 (1.73%) Marketing
9 3 (1.04%) Automotive
9 3 (1.04%) Spanish Language
10 2 (0.69%) Financial Institution
10 2 (0.69%) Legal
10 2 (0.69%) Multimedia
11 1 (0.35%) Corporate Banking
11 1 (0.35%) Front Office
Job Titles
1 79 (27.34%) Developer
2 64 (22.15%) Architect
3 56 (19.38%) Data Architect
4 48 (16.61%) Data Engineer
5 45 (15.57%) Java Developer
6 43 (14.88%) Big Data Engineer
7 36 (12.46%) Big Data Architect
8 33 (11.42%) Administrator
8 33 (11.42%) Hadoop Administrator
9 29 (10.03%) Big Data Developer
10 26 (9.00%) Hadoop Engineer
10 26 (9.00%) Java Engineer
11 24 (8.30%) Hadoop Developer
11 24 (8.30%) Software Engineer
12 23 (7.96%) Hadoop Architect
12 23 (7.96%) Java Software Engineer
13 22 (7.61%) Apache Spark Developer
14 21 (7.27%) Senior Developer
15 19 (6.57%) Scala Developer
16 17 (5.88%) Enterprise Architect
Libraries, Frameworks & Software Standards
1 88 (30.45%) Kafka
2 25 (8.65%) Spring
3 20 (6.92%) AngularJS
4 19 (6.57%) Node.js
5 16 (5.54%) REST
6 15 (5.19%) Web Services
7 13 (4.50%) Apache Avro
7 13 (4.50%) HTML
7 13 (4.50%) J2EE
8 11 (3.81%) Elastic Stack
8 11 (3.81%) Hibernate
8 11 (3.81%) RESTful
8 11 (3.81%) Spring Boot
9 9 (3.11%) Akka
9 9 (3.11%) jQuery
9 9 (3.11%) JSON
9 9 (3.11%) XML
10 8 (2.77%) D3.js
10 8 (2.77%) Grails
10 8 (2.77%) Ruby on Rails
Miscellaneous
1 49 (16.96%) Analytical Skills
2 44 (15.22%) Computer Science
3 20 (6.92%) Algorithms
4 14 (4.84%) Fintech
5 11 (3.81%) Replication
5 11 (3.81%) Virtual Team
6 7 (2.42%) Clustering
7 6 (2.08%) Linux Command Line
8 5 (1.73%) Data Centre
8 5 (1.73%) PKI
9 4 (1.38%) Derivative
9 4 (1.38%) Enterprise Software
9 4 (1.38%) Management Information System
9 4 (1.38%) Social Network
10 3 (1.04%) Client/Server
10 3 (1.04%) Credit Risk
10 3 (1.04%) Data Structures
10 3 (1.04%) Mainframe
10 3 (1.04%) Security Operations Centre
11 2 (0.69%) Market Risk
Operating Systems
1 114 (39.45%) Linux
2 51 (17.65%) Unix
3 13 (4.50%) Windows
4 10 (3.46%) Red Hat Enterprise Linux
5 8 (2.77%) Ubuntu
6 4 (1.38%) CoreOS
Processes & Methodologies
1 107 (37.02%) MapReduce
2 100 (34.60%) Agile Software Development
3 76 (26.30%) Analytics
4 60 (20.76%) Business Intelligence
5 58 (20.07%) Open Source
6 53 (18.34%) Software Engineering
7 42 (14.53%) TDD
8 38 (13.15%) Data Architecture
9 37 (12.80%) Mentoring
10 36 (12.46%) ETL
11 32 (11.07%) E-Commerce
12 29 (10.03%) Data Management
13 28 (9.69%) Continuous Integration
13 28 (9.69%) DevOps
14 25 (8.65%) Data Modelling
15 24 (8.30%) Visualisation
16 23 (7.96%) Scrum
17 22 (7.61%) BDD
17 22 (7.61%) Data Ingestion
18 21 (7.27%) Machine Learning
Programming Languages
1 177 (61.25%) Java
2 78 (26.99%) Python
3 65 (22.49%) Scala
4 56 (19.38%) SQL
5 32 (11.07%) Ruby
6 26 (9.00%) C++
7 23 (7.96%) JavaScript
8 20 (6.92%) C
9 18 (6.23%) C#
9 18 (6.23%) R
10 17 (5.88%) Bash Shell
11 13 (4.50%) Perl
11 13 (4.50%) PHP
12 9 (3.11%) Go
13 8 (2.77%) Groovy
14 7 (2.42%) PL/SQL
15 6 (2.08%) Shell Script
16 5 (1.73%) T-SQL
17 3 (1.04%) MATLAB
18 1 (0.35%) PHP 5
Qualifications
1 60 (20.76%) Degree
2 19 (6.57%) Postgraduate
3 17 (5.88%) PhD
4 7 (2.42%) CISSP
5 6 (2.08%) Security Cleared
6 5 (1.73%) CEH
6 5 (1.73%) GCIH
6 5 (1.73%) OSCP
6 5 (1.73%) SC Cleared
7 2 (0.69%) OCA
7 2 (0.69%) OCP
7 2 (0.69%) Oracle Certification
8 1 (0.35%) CBAP
8 1 (0.35%) IIBA
Quality Assurance & Compliance
1 13 (4.50%) QA
2 8 (2.77%) Data Quality
3 3 (1.04%) GCP
3 3 (1.04%) GPG13
3 3 (1.04%) ISO/IEC 27001
4 1 (0.35%) Basel III
4 1 (0.35%) Dodd-Frank
4 1 (0.35%) SLA
System Software
1 42 (14.53%) Apache Flume
2 30 (10.38%) Apache ZooKeeper
3 22 (7.61%) Docker
4 12 (4.15%) VMware Infrastructure
5 7 (2.42%) VirtualBox
6 5 (1.73%) Snort
7 3 (1.04%) KVM
7 3 (1.04%) vCloud
8 1 (0.35%) Active Directory
8 1 (0.35%) Oracle RAC
8 1 (0.35%) Xen
Systems Management
1 76 (26.30%) Oozie
2 60 (20.76%) Hadoop YARN
3 28 (9.69%) Puppet
4 18 (6.23%) Ambari
5 17 (5.88%) Ansible
6 16 (5.54%) Opscode Chef
7 13 (4.50%) Kubernetes
8 9 (3.11%) Kibana
9 7 (2.42%) Terraform
10 6 (2.08%) logstash
11 5 (1.73%) Fluentd
11 5 (1.73%) Nagios
11 5 (1.73%) QRadar
12 4 (1.38%) Salt
12 4 (1.38%) ZABBIX
13 3 (1.04%) CSIRT
14 2 (0.69%) Graphite
14 2 (0.69%) Mesos
15 1 (0.35%) Ganglia
15 1 (0.35%) Rancher
Vendors
1 47 (16.26%) Cloudera
2 43 (14.88%) Hortonworks
3 32 (11.07%) Oracle
4 25 (8.65%) Tableau
5 16 (5.54%) MapR
6 13 (4.50%) Google
7 12 (4.15%) Red Hat
7 12 (4.15%) Splunk
7 12 (4.15%) VMware
8 8 (2.77%) MicroStrategy
9 6 (2.08%) Microsoft
10 5 (1.73%) AlienVault
10 5 (1.73%) ArcSight
10 5 (1.73%) FireEye
10 5 (1.73%) Fortinet
10 5 (1.73%) LogRhythm
10 5 (1.73%) Palo Alto
10 5 (1.73%) Sophos
10 5 (1.73%) Sourcefire
10 5 (1.73%) TippingPoint
London
Churchill Frank
Salary: £50000 - £70000 per annum
Posted: 2 days ago
Central London / West End
ANSON MCCADE
Salary: £80,000 - £90,000
Posted: 2 days ago
City, London
Oliver Bernard
Salary: £95000 - £105000 per annum
Posted: 4 days ago
City, London
ANSON MCCADE
Salary: £85,000 - £95,000 + excellent package
Posted: 4 days ago
Cambridge, Cambridgeshire
Softweb Resourcing Limited
Salary: From £40,000 to £65,000 per annum Salary DOE + Benefits
Posted: 6 days ago
London
Churchill Frank
Salary: £75000 - £90000 per annum
Posted: 14 days ago
London
Churchill Frank
Salary: £80000 - £100000 per annum + Bonus, Pension, Travel Allowence
Posted: 14 days ago
Cambridge, Cambridgeshire
ECM Selection
Salary: to £50k+ DoE
Posted: 10 days ago
London
IQ Sales People
Salary: £75000 per annum + 20% Bonus and benefits
Posted: 7 days ago
Edinburgh
TDA Group
Salary: £80000 - £100000 per annum + Bonus & Benefits
Posted: 15 days ago
Edinburgh
TDA Group
Salary: £60000 - £75000 per annum + Bonus & Benefits
Posted: 15 days ago
Leeds
Sky Betting & Gaming
Posted: 11 days ago
London
Computer Futures
Salary: competitive
Posted: 11 days ago
London
Computer Futures
Salary: competitive
Posted: 14 days ago
London
Computer Futures
Salary: £55000 - £70000 per annum + competitive
Posted: 11 days ago
Durham
Computer Futures
Salary: £40000 - £60000 per annum + competitive
Posted: 21 days ago
Salford, Lancashire
Raytheon Systems Ltd
Posted: 18 days ago
London
Computer Futures
Salary: £55000 - £90000 per annum + competitive
Posted: 27 days ago