The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 27 August 2016 with a comparison to the same period over the previous 2 years.

3 months to
27 Aug 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 790 843 888
Rank change year-on-year
+53 +45
Permanent jobs citing HDFS 125 113 89
As % of all permanent IT jobs located in the UK 0.13% 0.10% 0.076%
As % of the System Software category 1.05% 0.92% 0.67%
Number of salaries quoted 96 66 69
Median salary £85,000 £63,750 £65,000
Median salary % change year-on-year
+33.33% -1.92%
90% offered a salary of more than £51,500 £42,500 £42,500
10% offered a salary of more than £102,000 £87,500 £89,250
UK excluding London median salary £54,000 £60,000 £60,000
% change year-on-year
-10.00% -

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
11880 12226 13249
As % of all permanent IT jobs located in the UK 12.34% 11.20% 11.36%
Number of salaries quoted 10084 10181 10903
Median salary £42,500 £40,000 £40,000
Median salary % change year-on-year
+6.25% -
90% offered a salary of more than £26,000 £25,000 £25,000
10% offered a salary of more than £67,500 £62,500 £65,000
UK excluding London median salary £40,000 £38,000 £37,500
% change year-on-year
+5.26% +1.33%

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 27 August 2016 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 25 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 27 August 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +62 118 £85,000 +33.33% 16
London +50 89 £87,500 +16.66% 13
South East +26 20 £52,000 -13.33% 1
Hampshire - 14 £50,000 - 1
City of London +55 10 £100,000 +33.33% 2
Berkshire +13 5 £57,500 -4.16%
Warwickshire - 5 - -
Warwick - 5 - -
West Midlands - 5 - -
Fareham - 4 £52,500 -
Reading - 3 £51,500 -
Southampton - 3 £60,000 -
Yorkshire +28 2 £61,250 +2.08%
Scotland +20 2 - -
Edinburgh +18 2 - -
North West +4 2 £24,000 -44.82% 2
Manchester -1 2 £24,000 -46.66% 2
Newbury -5 2 £67,500 +12.50%
Docklands, London - 2 - -
Leeds +23 1 £67,500 +12.50%
West Yorkshire +15 1 £67,500 +12.50%
Portsmouth - 1 £45,500 -
Cardiff - 1 £58,000 -
South Wales - 1 £58,000 -
Wales - 1 £58,000 -

HDFS
Top 30 Related IT Skills

For the 6 months to 27 August 2016, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 299 (94.32%) Hadoop
2 259 (81.70%) Big Data
3 241 (76.03%) Java
4 203 (64.04%) Apache Hive
5 181 (57.10%) Apache Spark
6 152 (47.95%) HBase
7 141 (44.48%) Python
8 135 (42.59%) MapReduce
9 123 (38.80%) Apache Pig
10 114 (35.96%) Scala
11 113 (35.65%) Agile Software Development
12 104 (32.81%) Apache Cassandra
13 102 (32.18%) Analytics
14 94 (29.65%) Kafka
15 93 (29.34%) Hadoop YARN
15 93 (29.34%) Linux
16 92 (29.02%) Software Engineering
17 91 (28.71%) SQL
18 86 (27.13%) Apache Flume
18 86 (27.13%) Cloudera
19 82 (25.87%) Open Source
20 80 (25.24%) SQL Server
21 78 (24.61%) Degree
22 75 (23.66%) Apache
22 75 (23.66%) PostgreSQL
23 72 (22.71%) Business Intelligence
24 71 (22.40%) Oracle
25 67 (21.14%) Relational Database
26 66 (20.82%) NoSQL
27 65 (20.50%) Sqoop

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 181 (57.10%) Apache Spark
2 123 (38.80%) Apache Pig
3 75 (23.66%) Apache
4 30 (9.46%) Elasticsearch
5 18 (5.68%) OpenStack
6 13 (4.10%) nginx
6 13 (4.10%) SAS
7 9 (2.84%) Apache Solr
8 8 (2.52%) JBoss
8 8 (2.52%) WildFly
9 5 (1.58%) Tomcat
9 5 (1.58%) WebLogic
10 4 (1.26%) WebSphere
11 1 (0.32%) Eucalyptus
11 1 (0.32%) IIS
Applications
1 8 (2.52%) MS Excel
2 3 (0.95%) SPSS
3 1 (0.32%) MS Visio
Business Applications
1 3 (0.95%) SAP Oil and Gas
2 1 (0.32%) Oracle Receivables
Cloud Services
1 50 (15.77%) Amazon AWS
2 23 (7.26%) IaaS
3 16 (5.05%) Cloud Computing
4 14 (4.42%) Microsoft Azure
5 13 (4.10%) Google Cloud Platform
5 13 (4.10%) PaaS
6 9 (2.84%) Sumo Logic
7 7 (2.21%) Amazon EC2
8 6 (1.89%) Amazon S3
9 5 (1.58%) Amazon EMR
10 4 (1.26%) DigitalOcean
11 3 (0.95%) CloudFront
12 2 (0.63%) iTunes
12 2 (0.63%) SaaS
13 1 (0.32%) Amazon ELB
13 1 (0.32%) Amazon Kinesis
13 1 (0.32%) AWS CloudFormation
13 1 (0.32%) AWS Lambda
13 1 (0.32%) GitHub
Communications & Networking
1 36 (11.36%) HTTP
2 17 (5.36%) Internet
3 10 (3.15%) DNS
4 9 (2.84%) IPv4
5 6 (1.89%) Kerberos
6 2 (0.63%) FTP
6 2 (0.63%) LDAP
6 2 (0.63%) SSL
6 2 (0.63%) VoIP
7 1 (0.32%) SSH
7 1 (0.32%) TCP/IP
7 1 (0.32%) VPN
Database & Business Intelligence
1 299 (94.32%) Hadoop
2 259 (81.70%) Big Data
3 203 (64.04%) Apache Hive
4 152 (47.95%) HBase
5 104 (32.81%) Apache Cassandra
6 80 (25.24%) SQL Server
7 75 (23.66%) PostgreSQL
8 67 (21.14%) Relational Database
9 66 (20.82%) NoSQL
10 65 (20.50%) Sqoop
11 52 (16.40%) Impala
12 51 (16.09%) MongoDB
13 48 (15.14%) MySQL
14 36 (11.36%) Data Warehouse
15 28 (8.83%) RDBMS
16 25 (7.89%) Redis
17 19 (5.99%) Neo4j
18 18 (5.68%) QlikView
18 18 (5.68%) Voldemort
19 14 (4.42%) Data Mining
Development Applications
1 32 (10.09%) Git (software)
2 26 (8.20%) Jenkins
3 21 (6.62%) JIRA
4 16 (5.05%) Selenium
5 14 (4.42%) Maven
6 11 (3.47%) Bugzilla
6 11 (3.47%) Subversion
7 10 (3.15%) IntelliJ
7 10 (3.15%) Trac
8 9 (2.84%) Vagrant
9 8 (2.52%) Eclipse
9 8 (2.52%) JUnit
9 8 (2.52%) NetBeans
9 8 (2.52%) TeamCity
10 5 (1.58%) Cucumber
10 5 (1.58%) Grunt
10 5 (1.58%) Talend Open Studio
11 4 (1.26%) NeoLoad
11 4 (1.26%) RStudio
11 4 (1.26%) The Grinder
General
1 60 (18.93%) Finance
2 34 (10.73%) Banking
3 27 (8.52%) Manufacturing
4 17 (5.36%) Marketing
5 10 (3.15%) Retail
6 7 (2.21%) Telecoms
7 5 (1.58%) Advertising
7 5 (1.58%) Games
7 5 (1.58%) Investment Banking
8 4 (1.26%) Legal
9 3 (0.95%) Electronics
9 3 (0.95%) Financial Institution
10 2 (0.63%) Corporate Banking
10 2 (0.63%) iGaming
10 2 (0.63%) Multimedia
11 1 (0.32%) Front Office
11 1 (0.32%) Law
Job Titles
1 126 (39.75%) Developer
2 77 (24.29%) Java Developer
3 54 (17.03%) Hadoop Developer
4 49 (15.46%) Data Engineer
5 47 (14.83%) Big Data Engineer
6 43 (13.56%) Big Data Developer
7 41 (12.93%) Hadoop Engineer
8 37 (11.67%) Senior Developer
9 36 (11.36%) Java Hadoop Developer
10 33 (10.41%) Architect
11 32 (10.09%) Administrator
11 32 (10.09%) Lead Developer
12 30 (9.46%) Data Architect
12 30 (9.46%) Hadoop Administrator
13 29 (9.15%) Big Data Architect
13 29 (9.15%) Java Engineer
13 29 (9.15%) Scala Developer
13 29 (9.15%) Senior Java Developer
14 24 (7.57%) Java Scala Developer
15 22 (6.94%) Software Engineer
Libraries, Frameworks & Software Standards
1 94 (29.65%) Kafka
2 35 (11.04%) LAPP Stack
3 34 (10.73%) REST
4 33 (10.41%) Spring
5 31 (9.78%) HTML
6 25 (7.89%) J2EE
7 24 (7.57%) Hibernate
7 24 (7.57%) Web Services
8 21 (6.62%) CSS
9 16 (5.05%) AngularJS
10 15 (4.73%) XML
11 14 (4.42%) JSON
12 12 (3.79%) Node.js
13 10 (3.15%) Apache Camel
13 10 (3.15%) ELK Stack
13 10 (3.15%) JDBC
13 10 (3.15%) Ruby on Rails
14 9 (2.84%) Java SE
14 9 (2.84%) LAMP
14 9 (2.84%) WebSockets
Miscellaneous
1 32 (10.09%) Analytical Skills
2 25 (7.89%) Computer Science
3 18 (5.68%) Visualisation
4 16 (5.05%) Data Centre
5 14 (4.42%) Algorithms
5 14 (4.42%) Replication
6 13 (4.10%) Mathematics
7 9 (2.84%) Management Information System
7 9 (2.84%) PKI
8 7 (2.21%) Data Integration
8 7 (2.21%) Derivative
8 7 (2.21%) Fintech
8 7 (2.21%) Physics
9 3 (0.95%) Clustering
9 3 (0.95%) Credit Derivative
9 3 (0.95%) Data Structures
9 3 (0.95%) Enterprise Software
9 3 (0.95%) Equities
9 3 (0.95%) Foreign Exchange (FX)
9 3 (0.95%) Statistics
Operating Systems
1 93 (29.34%) Linux
2 29 (9.15%) Unix
3 10 (3.15%) Red Hat Enterprise Linux
4 9 (2.84%) CoreOS
4 9 (2.84%) Windows
5 8 (2.52%) Ubuntu
6 1 (0.32%) Windows Server
Processes & Methodologies
1 135 (42.59%) MapReduce
2 113 (35.65%) Agile Software Development
3 102 (32.18%) Analytics
4 92 (29.02%) Software Engineering
5 82 (25.87%) Open Source
6 72 (22.71%) Business Intelligence
7 59 (18.61%) TDD
8 55 (17.35%) Performance Tuning
9 54 (17.03%) ETL
10 50 (15.77%) Data Analytics
11 44 (13.88%) Scrum
12 37 (11.67%) Stakeholder Management
13 35 (11.04%) DevOps
14 33 (10.41%) Big Data Analytics
15 32 (10.09%) BDD
16 30 (9.46%) Data Management
17 29 (9.15%) Multithreading
18 28 (8.83%) SDLC
19 27 (8.52%) E-Commerce
20 25 (7.89%) Continuous Integration
Programming Languages
1 241 (76.03%) Java
2 141 (44.48%) Python
3 114 (35.96%) Scala
4 91 (28.71%) SQL
5 46 (14.51%) R
6 41 (12.93%) Shell Script
7 33 (10.41%) C#
8 31 (9.78%) Ruby
9 28 (8.83%) C++
10 25 (7.89%) JavaScript
11 23 (7.26%) Bash Shell
12 20 (6.31%) MATLAB
12 20 (6.31%) PHP
13 12 (3.79%) Perl
14 10 (3.15%) C
14 10 (3.15%) Go
15 8 (2.52%) Groovy
16 3 (0.95%) Clojure
17 1 (0.32%) ANSI SQL
17 1 (0.32%) HiveQL
Qualifications
1 78 (24.61%) Degree
2 24 (7.57%) Security Cleared
3 14 (4.42%) PhD
4 13 (4.10%) SC Cleared
5 10 (3.15%) DV Cleared
6 4 (1.26%) Postgraduate
Quality Assurance & Compliance
1 4 (1.26%) Data Quality
2 3 (0.95%) SLA
3 1 (0.32%) QA
System Software
1 86 (27.13%) Apache Flume
2 34 (10.73%) Docker
3 21 (6.62%) Apache ZooKeeper
4 19 (5.99%) VMware Infrastructure
5 18 (5.68%) VirtualBox
6 9 (2.84%) KVM
7 5 (1.58%) Xen
8 2 (0.63%) GPFS
8 2 (0.63%) Virtual Machines
9 1 (0.32%) Btrfs
9 1 (0.32%) Gluster
9 1 (0.32%) LXC
Systems Management
1 93 (29.34%) Hadoop YARN
2 60 (18.93%) Oozie
3 21 (6.62%) Ansible
4 20 (6.31%) Ambari
5 19 (5.99%) Opscode Chef
6 18 (5.68%) Puppet
7 17 (5.36%) Kubernetes
8 11 (3.47%) Nagios
8 11 (3.47%) Salt
8 11 (3.47%) ZABBIX
9 10 (3.15%) Kibana
10 5 (1.58%) Mesos
11 4 (1.26%) Consul
11 4 (1.26%) Packer
11 4 (1.26%) Rancher
11 4 (1.26%) Terraform
12 2 (0.63%) Graphite
13 1 (0.32%) HAProxy
13 1 (0.32%) logstash
Vendors
1 86 (27.13%) Cloudera
2 71 (22.40%) Oracle
3 46 (14.51%) Hortonworks
4 36 (11.36%) MapR
5 20 (6.31%) Tableau
5 20 (6.31%) VMware
6 17 (5.36%) Google
7 12 (3.79%) Informatica
7 12 (3.79%) SAP
8 11 (3.47%) Splunk
9 10 (3.15%) Rackspace
9 10 (3.15%) Red Hat
10 9 (2.84%) New Relic
10 9 (2.84%) SaltStack
11 8 (2.52%) IBM
12 6 (1.89%) Netezza
12 6 (1.89%) Teradata
13 5 (1.58%) Talend
14 4 (1.26%) Dynatrace
14 4 (1.26%) MicroStrategy
London
Oliver Bernard
Salary: From £85,000 to £95,000 per annum
Posted: Yesterday
Hampshire
Executive Recruitment Services (ERS)
Salary: £45000 - £75000 per annum
Posted: 2 days ago
Manchester
TDA Group
Salary: £70000 - £75000 per annum + + Bonus + 30 days holiday
Posted: 5 days ago
London
Calibre Search Ltd
Salary: £60000 - £100000.00 per annum
Posted: Yesterday
London
Computer Futures
Salary: £80000 per annum + competitive
Posted: 11 days ago
London
Computer Futures
Salary: £70000 per annum + competitive
Posted: 11 days ago
Manchester
TDA Group
Salary: £70000 - £75000 per annum + +30 days holiday
Posted: 17 days ago
London
Accenture
Posted: 9 days ago
London
Client Server
Salary: £85k to £100k + benefits
Posted: 25 days ago
City, London
Schroders plc
Posted: 18 days ago