The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 7 December 2016 with a comparison to the same period over the previous 2 years.

3 months to
7 Dec 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 709 851 890
Rank change year-on-year
+142 +39
Permanent jobs citing HDFS 167 134 85
As % of all permanent IT jobs located in the UK 0.19% 0.12% 0.075%
As % of the System Software category 1.49% 1.08% 0.62%
Number of salaries quoted 121 110 65
Median salary £70,000 £70,000 £60,000
Median salary % change year-on-year
- +16.66%
90% offered a salary of more than £51,050 £50,000 £50,000
10% offered a salary of more than £93,250 £101,500 £82,500
UK excluding London median salary £67,500 £60,000 £56,250
% change year-on-year
+12.50% +6.66%

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
11188 12396 13816
As % of all permanent IT jobs located in the UK 12.42% 11.55% 12.21%
Number of salaries quoted 9260 10420 11617
Median salary £41,500 £42,500 £40,000
Median salary % change year-on-year
-2.35% +6.25%
90% offered a salary of more than £25,000 £25,000 £25,000
10% offered a salary of more than £70,000 £60,000 £65,000
UK excluding London median salary £37,500 £39,500 £37,500
% change year-on-year
-5.06% +5.33%

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 7 December 2016 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 7 December 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +115 150 £70,000 - 21
London +81 108 £75,000 - 15
South East +68 23 £55,000 -8.33% 1
City of London +39 20 £87,500 +25.00% 4
Berkshire +51 16 £55,000 -8.33% 1
Reading +35 15 £55,000 -10.20% 1
West Midlands -7 13 £63,750 -22.72%
Wales - 11 £80,000 -
Cardiff - 11 £80,000 -
South Wales - 11 £80,000 -
Warwickshire +16 10 - -
Warwick +15 10 - -
Canary Wharf -1 7 £67,500 -15.62%
Newport - 6 £80,000 -
Hampshire - 5 £52,500 -
Scotland +24 3 - - 1
Yorkshire - 3 £55,000 - 1
Glasgow - 3 - -
Birmingham - 3 £63,750 -
Leeds - 3 £55,000 - 1
West Yorkshire - 3 £55,000 - 1
North West -24 2 £40,000 -38.46% 3
West Sussex +22 1 £62,500 +83.82%
Manchester -18 1 £50,000 -23.07% 3
Cheshire - 1 £30,000 -
Chester - 1 £30,000 -
Portsmouth - 1 £80,000 -
Southampton - 1 £80,000 -
Surrey - 1 £92,500 -
Bristol - 1 £75,000 -

HDFS
Top 30 Related IT Skills

For the 6 months to 7 December 2016, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 242 (83.16%) Hadoop
2 228 (78.35%) Big Data
3 226 (77.66%) Java
4 191 (65.64%) Apache Hive
5 166 (57.04%) Apache Spark
6 152 (52.23%) HBase
7 128 (43.99%) Agile Software Development
8 107 (36.77%) Linux
9 106 (36.43%) Apache Pig
10 104 (35.74%) MapReduce
11 98 (33.68%) Scala
12 90 (30.93%) Business Intelligence
13 84 (28.87%) Python
13 84 (28.87%) Software Engineering
14 80 (27.49%) SQL
15 79 (27.15%) Hadoop YARN
16 78 (26.80%) Analytics
17 73 (25.09%) Apache
18 72 (24.74%) Apache Cassandra
18 72 (24.74%) Open Source
19 70 (24.05%) Oozie
20 66 (22.68%) TDD
21 65 (22.34%) NoSQL
22 63 (21.65%) Degree
23 62 (21.31%) Finance
24 60 (20.62%) Amazon AWS
25 58 (19.93%) Kafka
26 57 (19.59%) Apache Flume
26 57 (19.59%) Sqoop
27 51 (17.53%) Cloudera

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 166 (57.04%) Apache Spark
2 106 (36.43%) Apache Pig
3 73 (25.09%) Apache
4 47 (16.15%) Elasticsearch
5 20 (6.87%) WildFly
6 14 (4.81%) SAS
7 10 (3.44%) OpenStack
8 9 (3.09%) Apache Solr
9 8 (2.75%) nginx
10 7 (2.41%) Cloud Foundry
11 6 (2.06%) JBoss
12 4 (1.37%) WebLogic
12 4 (1.37%) WebSphere
13 2 (0.69%) Oracle Workflow
13 2 (0.69%) Tomcat
Applications
1 3 (1.03%) SPSS
Business Applications
1 1 (0.34%) SAP Oil and Gas
Cloud Services
1 60 (20.62%) Amazon AWS
2 28 (9.62%) Microsoft Azure
3 25 (8.59%) Cloud Computing
4 15 (5.15%) Google Cloud Platform
5 14 (4.81%) IaaS
6 10 (3.44%) PaaS
7 7 (2.41%) Amazon S3
8 6 (2.06%) GitHub
9 4 (1.37%) Amazon EC2
9 4 (1.37%) Sumo Logic
10 3 (1.03%) Amazon EMR
11 2 (0.69%) CloudFront
11 2 (0.69%) iTunes
12 1 (0.34%) DigitalOcean
12 1 (0.34%) Google Compute Engine
Communications & Networking
1 27 (9.28%) Kerberos
2 20 (6.87%) HTTP
2 20 (6.87%) Internet
3 7 (2.41%) FTP
4 6 (2.06%) IPv4
5 4 (1.37%) DNS
6 2 (0.69%) LDAP
6 2 (0.69%) Network Security
6 2 (0.69%) SSL
Database & Business Intelligence
1 242 (83.16%) Hadoop
2 228 (78.35%) Big Data
3 191 (65.64%) Apache Hive
4 152 (52.23%) HBase
5 72 (24.74%) Apache Cassandra
6 65 (22.34%) NoSQL
7 57 (19.59%) Sqoop
8 51 (17.53%) PostgreSQL
9 50 (17.18%) Relational Database
10 46 (15.81%) SQL Server
11 41 (14.09%) MongoDB
12 38 (13.06%) MySQL
13 35 (12.03%) Data Warehouse
14 32 (11.00%) Neo4j
15 30 (10.31%) RDBMS
16 25 (8.59%) Impala
17 24 (8.25%) Redis
18 14 (4.81%) QlikView
19 11 (3.78%) Apache Accumulo
19 11 (3.78%) Pentaho
Development Applications
1 29 (9.97%) Jenkins
2 28 (9.62%) Selenium
3 26 (8.93%) Git (software)
4 20 (6.87%) IntelliJ
5 17 (5.84%) TeamCity
6 14 (4.81%) Maven
7 13 (4.47%) Cucumber
7 13 (4.47%) Grunt
7 13 (4.47%) JIRA
7 13 (4.47%) Sonatype Nexus
8 10 (3.44%) Gerrit
8 10 (3.44%) Jasmine
9 9 (3.09%) Vagrant
10 8 (2.75%) Talend Open Studio
11 7 (2.41%) Subversion
12 6 (2.06%) Bugzilla
12 6 (2.06%) JUnit
12 6 (2.06%) Trac
13 3 (1.03%) Apache Continuum
13 3 (1.03%) TestNG
General
1 62 (21.31%) Finance
2 41 (14.09%) Banking
3 8 (2.75%) Manufacturing
4 7 (2.41%) Advertising
4 7 (2.41%) Legal
4 7 (2.41%) Retail
5 6 (2.06%) Investment Banking
5 6 (2.06%) Marketing
6 5 (1.72%) Telecoms
7 4 (1.37%) Financial Institution
7 4 (1.37%) Multimedia
8 3 (1.03%) Corporate Banking
8 3 (1.03%) Spanish Language
9 2 (0.69%) Games
10 1 (0.34%) Automotive
10 1 (0.34%) Electronics
10 1 (0.34%) Front Office
Job Titles
1 124 (42.61%) Developer
2 73 (25.09%) Java Developer
3 48 (16.49%) Big Data Developer
4 44 (15.12%) Hadoop Developer
5 39 (13.40%) Data Engineer
6 38 (13.06%) Big Data Engineer
6 38 (13.06%) Senior Developer
7 37 (12.71%) Java Engineer
8 36 (12.37%) Lead Developer
9 31 (10.65%) Administrator
9 31 (10.65%) Hadoop Administrator
10 30 (10.31%) Architect
11 29 (9.97%) Apache Spark Developer
12 28 (9.62%) Scala Developer
12 28 (9.62%) Senior Java Developer
12 28 (9.62%) Software Engineer
13 26 (8.93%) Data Architect
13 26 (8.93%) Java Software Engineer
14 23 (7.90%) Senior Java Engineer
15 22 (7.56%) Java Hadoop Developer
Libraries, Frameworks & Software Standards
1 58 (19.93%) Kafka
2 38 (13.06%) Spring
3 22 (7.56%) REST
4 21 (7.22%) Hibernate
5 20 (6.87%) Grails
5 20 (6.87%) HTML
5 20 (6.87%) Ruby on Rails
5 20 (6.87%) Spring Boot
6 19 (6.53%) AngularJS
7 18 (6.19%) J2EE
7 18 (6.19%) RESTful
8 17 (5.84%) Web Services
9 16 (5.50%) Node.js
10 11 (3.78%) Apache Avro
10 11 (3.78%) XML
11 10 (3.44%) CSS
11 10 (3.44%) JSON
12 9 (3.09%) LAPP Stack
13 8 (2.75%) D3.js
13 8 (2.75%) HTML5
Miscellaneous
1 36 (12.37%) Computer Science
2 28 (9.62%) Analytical Skills
3 20 (6.87%) Mathematics
4 17 (5.84%) Visualisation
5 14 (4.81%) Fintech
6 12 (4.12%) Replication
7 11 (3.78%) Algorithms
7 11 (3.78%) Derivative
8 9 (3.09%) Data Centre
8 9 (3.09%) Data Integration
9 8 (2.75%) Statistics
10 6 (2.06%) PKI
11 5 (1.72%) Physics
12 4 (1.37%) Credit Derivative
12 4 (1.37%) Credit Risk
12 4 (1.37%) Enterprise Software
12 4 (1.37%) Equities
12 4 (1.37%) Foreign Exchange (FX)
12 4 (1.37%) Neural Network
13 3 (1.03%) Mainframe
Operating Systems
1 107 (36.77%) Linux
2 24 (8.25%) Unix
3 20 (6.87%) Ubuntu
4 12 (4.12%) Windows
5 9 (3.09%) Red Hat Enterprise Linux
6 4 (1.37%) CoreOS
Processes & Methodologies
1 128 (43.99%) Agile Software Development
2 104 (35.74%) MapReduce
3 90 (30.93%) Business Intelligence
4 84 (28.87%) Software Engineering
5 78 (26.80%) Analytics
6 72 (24.74%) Open Source
7 66 (22.68%) TDD
8 46 (15.81%) ETL
9 44 (15.12%) DevOps
10 42 (14.43%) Data Modelling
11 39 (13.40%) Scrum
12 33 (11.34%) BDD
12 33 (11.34%) Data Management
13 28 (9.62%) SDLC
14 27 (9.28%) Continuous Integration
15 26 (8.93%) Data Analytics
15 26 (8.93%) Open Source Development
16 23 (7.90%) E-Commerce
17 22 (7.56%) OO
18 20 (6.87%) Mentoring
Programming Languages
1 226 (77.66%) Java
2 98 (33.68%) Scala
3 84 (28.87%) Python
4 80 (27.49%) SQL
5 37 (12.71%) Ruby
6 32 (11.00%) R
7 31 (10.65%) C#
8 25 (8.59%) C++
9 23 (7.90%) JavaScript
10 20 (6.87%) Groovy
11 19 (6.53%) Bash Shell
11 19 (6.53%) Shell Script
12 13 (4.47%) C
13 11 (3.78%) MATLAB
13 11 (3.78%) Perl
14 10 (3.44%) Go
14 10 (3.44%) PHP
15 8 (2.75%) PL/SQL
16 5 (1.72%) PowerShell
16 5 (1.72%) T-SQL
Qualifications
1 63 (21.65%) Degree
2 17 (5.84%) Security Cleared
3 11 (3.78%) Postgraduate
4 10 (3.44%) SC Cleared
5 8 (2.75%) PhD
6 6 (2.06%) DV Cleared
7 2 (0.69%) CEH
7 2 (0.69%) CISSP
7 2 (0.69%) GCIH
7 2 (0.69%) OSCP
Quality Assurance & Compliance
1 10 (3.44%) QA
2 3 (1.03%) Data Quality
3 2 (0.69%) GPG13
3 2 (0.69%) ISO/IEC 27001
4 1 (0.34%) Basel III
4 1 (0.34%) Dodd-Frank
System Software
1 57 (19.59%) Apache Flume
2 33 (11.34%) Docker
3 25 (8.59%) Apache ZooKeeper
4 10 (3.44%) VirtualBox
4 10 (3.44%) VMware Infrastructure
5 6 (2.06%) KVM
6 2 (0.69%) GPFS
6 2 (0.69%) Snort
7 1 (0.34%) Active Directory
7 1 (0.34%) Btrfs
7 1 (0.34%) Gluster
7 1 (0.34%) Xen
Systems Management
1 79 (27.15%) Hadoop YARN
2 70 (24.05%) Oozie
3 27 (9.28%) Puppet
4 24 (8.25%) Kubernetes
5 15 (5.15%) Ambari
6 14 (4.81%) Opscode Chef
7 13 (4.47%) Ansible
8 7 (2.41%) Kibana
9 6 (2.06%) Nagios
9 6 (2.06%) Salt
9 6 (2.06%) ZABBIX
10 2 (0.69%) Fluentd
10 2 (0.69%) Graphite
10 2 (0.69%) QRadar
11 1 (0.34%) Consul
11 1 (0.34%) logstash
11 1 (0.34%) Packer
11 1 (0.34%) Rancher
11 1 (0.34%) Terraform
Vendors
1 51 (17.53%) Cloudera
2 45 (15.46%) Oracle
3 30 (10.31%) Hortonworks
4 26 (8.93%) Tableau
5 15 (5.15%) Google
6 14 (4.81%) MicroStrategy
7 11 (3.78%) MapR
8 10 (3.44%) Red Hat
8 10 (3.44%) VMware
9 9 (3.09%) Splunk
10 8 (2.75%) Talend
11 7 (2.41%) SAP
12 5 (1.72%) Cognos
13 4 (1.37%) IBM
13 4 (1.37%) Informatica
13 4 (1.37%) Netezza
13 4 (1.37%) New Relic
13 4 (1.37%) Rackspace
13 4 (1.37%) SaltStack
13 4 (1.37%) Teradata
London
Client Server
Salary: £50k to £80k (multiple roles) + benefits
Posted: 22 hours ago
London
Churchill Frank
Salary: £75000 - £100000 per annum + car, bonus, pension
Posted: 21 hours ago
East London
Client Server
Salary: competitive salary + bonus + benefits
Posted: Yesterday
City, London
Hays Finance Technology
Salary: £80000.00 - £90000.00 per annum + a generous bonus
Posted: 2 days ago
London
Computer Futures
Salary: £100000 per annum + competitive
Posted: 6 days ago
London
Churchill Frank
Salary: £70000 - £100000 per annum + bonus, benefits, pension
Posted: 8 days ago
London
Client Server
Salary: £50k to £80k (multiple roles) + benefits
Posted: 8 days ago
London
Computer Futures
Salary: £55000 - £70000 per annum + competitive
Posted: 6 days ago
Manchester, Lancashire
Raytheon Systems Ltd
Salary: Full Benefits package, Bonus
Posted: 5 days ago
City, London
JM
Salary: £100000 - £120000 per annum + plus benefits and bonus package
Posted: 4 days ago
Manchester, Lancashire
Raytheon Systems Ltd
Salary: Full Benefits package, Bonus
Posted: 6 days ago
London
Client Server
Salary: £60k to £75k + bonus + benefits
Posted: 14 days ago
Edinburgh
TDA Group
Salary: £60000 - £75000 per annum + Bonus
Posted: 23 days ago
City of London
TDA Group
Salary: £85000 - £100000 per annum + Bonus
Posted: 22 days ago
London
Lawrence Harvey
Salary: £50000.00 - £70000.00 per annum
Posted: 8 days ago
Manchester, Lancashire
Raytheon Systems Ltd
Salary: Full Benefits package, Bonus
Posted: 14 days ago
London
Client Server
Salary: £60,000 to £75,000 + bonus + benefits
Posted: 21 days ago