The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 30 September 2016 with a comparison to the same period over the previous 2 years.

3 months to
30 Sep 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 788 861 913
Rank change year-on-year
+73 +52
Permanent jobs citing HDFS 124 114 74
As % of all permanent IT jobs located in the UK 0.13% 0.10% 0.065%
As % of the System Software category 1.07% 0.94% 0.56%
Number of salaries quoted 89 73 49
Median salary £77,500 £62,500 £62,500
Median salary % change year-on-year
+24.00% -
90% offered a salary of more than £52,400 £42,500 £42,500
10% offered a salary of more than £95,000 £85,000 £80,000
UK excluding London median salary £55,000 £60,000 £77,000
% change year-on-year
-8.33% -22.07%

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
11609 12068 13288
As % of all permanent IT jobs located in the UK 12.19% 11.06% 11.62%
Number of salaries quoted 9740 10111 10973
Median salary £42,500 £40,000 £40,000
Median salary % change year-on-year
+6.25% -
90% offered a salary of more than £26,000 £25,000 £25,000
10% offered a salary of more than £67,500 £62,500 £65,000
UK excluding London median salary £40,000 £38,500 £37,500
% change year-on-year
+3.89% +2.66%

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 30 September 2016 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 27 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 30 September 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +59 115 £75,000 +20.00% 13
London +60 86 £80,000 +14.28% 4
South East +41 19 £52,750 -12.08% 4
City of London +34 9 £100,000 +42.85% 1
Hampshire - 9 £52,500 - 4
West Midlands - 7 £50,000 - 2
Warwickshire - 6 - - 1
Warwick - 6 - - 1
West Sussex - 5 £62,500 -
Reading +24 4 £51,500 -20.76%
Berkshire +2 4 £51,500 -14.16%
Canary Wharf - 4 £67,500 -
Fareham - 4 £52,500 - 1
Southampton - 3 £60,000 - 2
Leeds +37 2 £67,500 +12.50%
Yorkshire +29 2 £67,500 +12.50%
West Yorkshire +25 2 £67,500 +12.50%
Edinburgh - 2 - -
Scotland - 2 - -
North West -11 1 £50,000 -16.66% 2
Manchester -16 1 £50,000 -20.00% 1
Portsmouth - 1 £45,500 -
Docklands, London - 1 - -
Cardiff - 1 £58,000 - 1
South Wales - 1 £58,000 - 2
Birmingham - 1 £50,000 - 1
Wales - 1 £58,000 - 2

HDFS
Top 30 Related IT Skills

For the 6 months to 30 September 2016, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 258 (91.81%) Hadoop
2 226 (80.43%) Big Data
3 220 (78.29%) Java
4 187 (66.55%) Apache Hive
5 155 (55.16%) Apache Spark
6 139 (49.47%) HBase
7 112 (39.86%) Apache Pig
7 112 (39.86%) MapReduce
8 111 (39.50%) Scala
9 109 (38.79%) Agile Software Development
10 106 (37.72%) Python
11 87 (30.96%) Analytics
12 85 (30.25%) Software Engineering
13 82 (29.18%) Kafka
14 81 (28.83%) Apache Cassandra
15 80 (28.47%) SQL
16 75 (26.69%) Linux
17 73 (25.98%) Hadoop YARN
18 69 (24.56%) Business Intelligence
19 67 (23.84%) Open Source
19 67 (23.84%) Apache Flume
20 62 (22.06%) Degree
21 61 (21.71%) Cloudera
22 60 (21.35%) Apache
22 60 (21.35%) PostgreSQL
23 59 (21.00%) SQL Server
23 59 (21.00%) NoSQL
24 58 (20.64%) Relational Database
25 57 (20.28%) TDD
26 55 (19.57%) Oracle

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 155 (55.16%) Apache Spark
2 112 (39.86%) Apache Pig
3 60 (21.35%) Apache
4 33 (11.74%) Elasticsearch
5 15 (5.34%) WildFly
6 12 (4.27%) SAS
7 10 (3.56%) Apache Solr
8 9 (3.20%) OpenStack
9 7 (2.49%) nginx
10 5 (1.78%) JBoss
11 4 (1.42%) Tomcat
11 4 (1.42%) WebLogic
11 4 (1.42%) WebSphere
12 1 (0.36%) IIS
Applications
1 7 (2.49%) MS Excel
2 4 (1.42%) SPSS
Business Applications
1 1 (0.36%) Oracle Receivables
1 1 (0.36%) SAP Oil and Gas
Cloud Services
1 43 (15.30%) Amazon AWS
2 23 (8.19%) Cloud Computing
3 13 (4.63%) Google Cloud Platform
3 13 (4.63%) IaaS
4 10 (3.56%) Amazon S3
5 9 (3.20%) Microsoft Azure
6 7 (2.49%) Amazon EC2
6 7 (2.49%) PaaS
7 6 (2.14%) GitHub
7 6 (2.14%) Sumo Logic
8 4 (1.42%) Amazon EMR
9 3 (1.07%) CloudFront
10 2 (0.71%) DigitalOcean
10 2 (0.71%) iTunes
11 1 (0.36%) Amazon ELB
11 1 (0.36%) AWS CloudFormation
11 1 (0.36%) AWS Lambda
Communications & Networking
1 27 (9.61%) HTTP
2 14 (4.98%) Internet
3 7 (2.49%) DNS
4 5 (1.78%) FTP
4 5 (1.78%) Kerberos
5 3 (1.07%) IPv4
6 2 (0.71%) SSL
7 1 (0.36%) LDAP
7 1 (0.36%) SSH
7 1 (0.36%) TCP/IP
7 1 (0.36%) VPN
Database & Business Intelligence
1 258 (91.81%) Hadoop
2 226 (80.43%) Big Data
3 187 (66.55%) Apache Hive
4 139 (49.47%) HBase
5 81 (28.83%) Apache Cassandra
6 60 (21.35%) PostgreSQL
7 59 (21.00%) NoSQL
7 59 (21.00%) SQL Server
8 58 (20.64%) Relational Database
9 53 (18.86%) Sqoop
10 46 (16.37%) MySQL
11 36 (12.81%) Data Warehouse
11 36 (12.81%) Impala
12 33 (11.74%) MongoDB
13 29 (10.32%) RDBMS
14 24 (8.54%) Neo4j
15 18 (6.41%) Voldemort
16 15 (5.34%) QlikView
17 14 (4.98%) Redis
18 11 (3.91%) Amazon Redshift
Development Applications
1 23 (8.19%) Git (software)
2 20 (7.12%) Jenkins
3 17 (6.05%) JIRA
4 16 (5.69%) IntelliJ
5 11 (3.91%) Cucumber
5 11 (3.91%) TeamCity
5 11 (3.91%) Vagrant
6 10 (3.56%) Selenium
7 9 (3.20%) Maven
8 7 (2.49%) Sonatype Nexus
8 7 (2.49%) Talend Open Studio
9 6 (2.14%) Eclipse
9 6 (2.14%) NetBeans
10 5 (1.78%) Grunt
11 4 (1.42%) JUnit
11 4 (1.42%) Subversion
12 3 (1.07%) Bugzilla
12 3 (1.07%) RStudio
12 3 (1.07%) Trac
13 2 (0.71%) NeoLoad
General
1 47 (16.73%) Finance
2 39 (13.88%) Banking
3 16 (5.69%) Manufacturing
4 9 (3.20%) Retail
5 8 (2.85%) Marketing
6 7 (2.49%) Legal
7 6 (2.14%) Investment Banking
8 5 (1.78%) Games
9 3 (1.07%) Advertising
10 2 (0.71%) Corporate Banking
10 2 (0.71%) Financial Institution
10 2 (0.71%) Front Office
10 2 (0.71%) iGaming
10 2 (0.71%) Multimedia
10 2 (0.71%) Telecoms
11 1 (0.36%) Electronics
11 1 (0.36%) Law
Job Titles
1 124 (44.13%) Developer
2 76 (27.05%) Java Developer
3 51 (18.15%) Hadoop Developer
4 43 (15.30%) Big Data Developer
5 42 (14.95%) Data Engineer
6 39 (13.88%) Senior Developer
7 38 (13.52%) Big Data Engineer
7 38 (13.52%) Lead Developer
8 32 (11.39%) Java Hadoop Developer
9 29 (10.32%) Hadoop Engineer
9 29 (10.32%) Scala Developer
9 29 (10.32%) Senior Java Developer
10 28 (9.96%) Architect
11 25 (8.90%) Data Architect
12 24 (8.54%) Big Data Architect
12 24 (8.54%) Java Engineer
13 22 (7.83%) Java Scala Developer
14 21 (7.47%) Administrator
15 20 (7.12%) Lead Java Developer
15 20 (7.12%) Software Engineer
Libraries, Frameworks & Software Standards
1 82 (29.18%) Kafka
2 39 (13.88%) Spring
3 27 (9.61%) REST
4 26 (9.25%) J2EE
5 23 (8.19%) Hibernate
6 21 (7.47%) LAPP Stack
7 20 (7.12%) HTML
8 18 (6.41%) Web Services
9 16 (5.69%) Ruby on Rails
10 15 (5.34%) CSS
10 15 (5.34%) Grails
10 15 (5.34%) Spring Boot
11 10 (3.56%) .NET
11 10 (3.56%) Apache Camel
12 9 (3.20%) AngularJS
12 9 (3.20%) Node.js
12 9 (3.20%) NumPy
12 9 (3.20%) RESTful
13 7 (2.49%) D3.js
13 7 (2.49%) ELK Stack
Miscellaneous
1 30 (10.68%) Analytical Skills
2 25 (8.90%) Computer Science
3 19 (6.76%) Visualisation
4 16 (5.69%) Data Centre
4 16 (5.69%) Mathematics
5 12 (4.27%) Replication
6 9 (3.20%) Derivative
7 7 (2.49%) Algorithms
7 7 (2.49%) Physics
8 5 (1.78%) Fintech
9 4 (1.42%) Credit Derivative
9 4 (1.42%) Data Integration
9 4 (1.42%) Equities
9 4 (1.42%) Foreign Exchange (FX)
9 4 (1.42%) Statistics
10 3 (1.07%) Credit Risk
10 3 (1.07%) Enterprise Software
10 3 (1.07%) Management Information System
10 3 (1.07%) PKI
11 2 (0.71%) Online Banking
Operating Systems
1 75 (26.69%) Linux
2 22 (7.83%) Unix
3 15 (5.34%) Ubuntu
4 6 (2.14%) CoreOS
5 5 (1.78%) Windows
6 4 (1.42%) Red Hat Enterprise Linux
7 1 (0.36%) Windows Server
Processes & Methodologies
1 112 (39.86%) MapReduce
2 109 (38.79%) Agile Software Development
3 87 (30.96%) Analytics
4 85 (30.25%) Software Engineering
5 69 (24.56%) Business Intelligence
6 67 (23.84%) Open Source
7 57 (20.28%) TDD
8 49 (17.44%) Scrum
9 48 (17.08%) ETL
10 39 (13.88%) DevOps
11 38 (13.52%) Data Analytics
12 35 (12.46%) Performance Tuning
13 32 (11.39%) BDD
14 28 (9.96%) Big Data Analytics
14 28 (9.96%) Data Modelling
14 28 (9.96%) E-Commerce
14 28 (9.96%) Stakeholder Management
15 27 (9.61%) SDLC
16 26 (9.25%) Multithreading
17 22 (7.83%) Data Management
Programming Languages
1 220 (78.29%) Java
2 111 (39.50%) Scala
3 106 (37.72%) Python
4 80 (28.47%) SQL
5 38 (13.52%) R
6 35 (12.46%) Shell Script
7 34 (12.10%) Ruby
8 33 (11.74%) C#
9 26 (9.25%) C++
10 18 (6.41%) MATLAB
11 17 (6.05%) PHP
12 15 (5.34%) Groovy
12 15 (5.34%) JavaScript
13 13 (4.63%) Bash Shell
14 9 (3.20%) C
15 8 (2.85%) Perl
16 6 (2.14%) Go
16 6 (2.14%) PL/SQL
17 5 (1.78%) PowerShell
17 5 (1.78%) T-SQL
Qualifications
1 62 (22.06%) Degree
2 15 (5.34%) Security Cleared
3 11 (3.91%) PhD
4 7 (2.49%) DV Cleared
4 7 (2.49%) SC Cleared
5 5 (1.78%) Postgraduate
Quality Assurance & Compliance
1 1 (0.36%) Basel III
1 1 (0.36%) Data Quality
1 1 (0.36%) Dodd-Frank
1 1 (0.36%) QA
1 1 (0.36%) SLA
System Software
1 67 (23.84%) Apache Flume
2 28 (9.96%) Docker
3 16 (5.69%) Apache ZooKeeper
4 10 (3.56%) VMware Infrastructure
5 9 (3.20%) VirtualBox
6 3 (1.07%) KVM
6 3 (1.07%) Xen
7 2 (0.71%) GPFS
8 1 (0.36%) Btrfs
8 1 (0.36%) Gluster
8 1 (0.36%) LXC
Systems Management
1 73 (25.98%) Hadoop YARN
2 50 (17.79%) Oozie
3 21 (7.47%) Kubernetes
4 20 (7.12%) Puppet
5 17 (6.05%) Ansible
6 15 (5.34%) Opscode Chef
7 9 (3.20%) Ambari
8 8 (2.85%) Nagios
8 8 (2.85%) Salt
8 8 (2.85%) ZABBIX
9 5 (1.78%) Mesos
10 4 (1.42%) Kibana
11 2 (0.71%) Consul
11 2 (0.71%) Graphite
11 2 (0.71%) Packer
11 2 (0.71%) Rancher
11 2 (0.71%) Terraform
12 1 (0.36%) HAProxy
12 1 (0.36%) logstash
Vendors
1 61 (21.71%) Cloudera
2 55 (19.57%) Oracle
3 32 (11.39%) Hortonworks
4 23 (8.19%) MapR
5 18 (6.41%) Tableau
6 15 (5.34%) Google
7 10 (3.56%) VMware
8 9 (3.20%) Informatica
8 9 (3.20%) SAP
9 8 (2.85%) Splunk
10 7 (2.49%) MicroStrategy
10 7 (2.49%) Talend
11 6 (2.14%) New Relic
11 6 (2.14%) Rackspace
11 6 (2.14%) SaltStack
12 5 (1.78%) IBM
13 4 (1.42%) Red Hat
14 3 (1.07%) Actian
14 3 (1.07%) Netezza
14 3 (1.07%) Teradata
Cardiff, South Glamorgan
HAYS INFORMATION TECHNOLOGY
Salary: £30000.00 - £100000.00 per annum + Completely Negotiable
Posted: 4 hours ago
Southampton, Hampshire
Executive Recruitment Services (ERS)
Posted: Yesterday
Southampton, Hampshire
Executive Recruitment Services (ERS)
Posted: Yesterday
Manchester
TDA Group
Salary: £70000 - £75000 per annum + + Bonus + 30 days holiday
Posted: 7 days ago
City, London
Parallel Consulting
Salary: £50000 - £75000 per annum
Posted: 6 days ago
Central London / West End
First Utility
Salary: From £55,000 to £65,000 per annum
Posted: 9 days ago
Warwick, Warwickshire
First Utility
Salary: From £55,000 to £65,000 per annum
Posted: 9 days ago
Birmingham
Churchill Frank International
Salary: £45000 - £55000 per annum + Bonus + Benefits
Posted: 9 days ago
London
Computer Futures
Salary: competitive
Posted: 7 days ago
Colchester, Essex
Polar Recruitment
Salary: £55000 - £65000 per annum + life insurance, pension, 25 days hols
Posted: 4 days ago
London
Calibre Search Ltd
Salary: £60000 - £100000.00 per annum
Posted: 4 days ago
Hampshire
Spectrum IT
Salary: £40000 - £60000 per annum + benefits
Posted: 11 days ago
UK
Wipro
Posted: 18 days ago