The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 26 June 2016 with a comparison to the same period over the previous 2 years.

3 months to
26 Jun 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 768 895 917
Rank change year-on-year
+127 +22
Permanent jobs citing HDFS 156 81 86
As % of all permanent IT jobs located in the UK 0.16% 0.073% 0.071%
As % of the System Software category 1.26% 0.62% 0.65%
Number of salaries quoted 129 62 77
Median salary £80,000 £75,000 £70,000
Median salary % change year-on-year
+6.66% +7.14%
90% offered a salary of more than £47,000 £50,000 £46,400
10% offered a salary of more than £120,000 £124,000 £100,000
UK excluding London median salary £51,250 £50,000 £40,000
% change year-on-year
+2.50% +25.00%

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
12337 13029 13288
As % of all permanent IT jobs located in the UK 12.71% 11.76% 11.02%
Number of salaries quoted 10509 10779 11177
Median salary £42,500 £41,000 £40,000
Median salary % change year-on-year
+3.65% +2.50%
90% offered a salary of more than £25,000 £25,000 £25,000
10% offered a salary of more than £67,500 £62,500 £65,000
UK excluding London median salary £39,000 £37,500 £37,500
% change year-on-year
+4.00% -

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 26 June 2016 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 20 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 26 June 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +116 155 £80,000 +6.66% 15
London +79 110 £85,000 +3.03% 11
South East +58 24 £50,000 -4.76% 2
Berkshire +30 16 £52,500 - 1
City of London +61 15 £100,000 +25.00%
Reading - 14 £41,500 -
Warwick - 10 £55,000 -
Warwickshire - 10 £55,000 -
West Midlands - 10 £55,000 -
Yorkshire +34 8 £55,000 -8.33%
Hampshire - 8 £50,000 - 1
West Yorkshire +22 6 £47,500 -20.83%
Leeds +20 5 - -
North West +16 3 £35,750 -28.50% 2
Newbury +12 2 £67,500 +28.57%
Manchester -3 2 £35,750 -28.50% 2
Merseyside - 1 - -
Bradford - 1 £47,500 -
Docklands, London - 1 - -
Liverpool - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 26 June 2016, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 357 (97.01%) Hadoop
2 313 (85.05%) Big Data
3 270 (73.37%) Java
4 220 (59.78%) Apache Hive
5 214 (58.15%) Apache Spark
6 178 (48.37%) HBase
7 170 (46.20%) Python
8 159 (43.21%) MapReduce
9 142 (38.59%) Apache Pig
10 131 (35.60%) Linux
11 129 (35.05%) Cloudera
12 125 (33.97%) SQL
13 122 (33.15%) Analytics
14 114 (30.98%) Degree
15 109 (29.62%) SQL Server
16 107 (29.08%) Hadoop YARN
17 105 (28.53%) Agile Software Development
18 102 (27.72%) Business Intelligence
18 102 (27.72%) Scala
19 99 (26.90%) Open Source
20 98 (26.63%) Apache Cassandra
21 95 (25.82%) Apache Flume
22 94 (25.54%) Kafka
23 91 (24.73%) Finance
24 87 (23.64%) Sqoop
25 83 (22.55%) Apache
25 83 (22.55%) ETL
25 83 (22.55%) Oracle
26 80 (21.74%) Performance Tuning
27 77 (20.92%) PostgreSQL

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 214 (58.15%) Apache Spark
2 142 (38.59%) Apache Pig
3 83 (22.55%) Apache
4 18 (4.89%) Elasticsearch
5 15 (4.08%) OpenStack
5 15 (4.08%) SAS
6 10 (2.72%) nginx
7 9 (2.45%) Apache Solr
7 9 (2.45%) JBoss
8 8 (2.17%) Confluence
9 7 (1.90%) Tomcat
10 5 (1.36%) Cloud Foundry
11 4 (1.09%) GemFire
12 1 (0.27%) Eucalyptus
12 1 (0.27%) IIS
12 1 (0.27%) WebLogic
Applications
1 8 (2.17%) MS Excel
2 3 (0.82%) MS Visio
3 2 (0.54%) SPSS
Business Applications
1 3 (0.82%) SAP Oil and Gas
2 1 (0.27%) Oracle Receivables
Cloud Services
1 56 (15.22%) Amazon AWS
2 20 (5.43%) Cloud Computing
3 15 (4.08%) IaaS
4 13 (3.53%) Microsoft Azure
4 13 (3.53%) PaaS
5 9 (2.45%) Google Cloud Platform
6 6 (1.63%) Amazon EMR
6 6 (1.63%) Sumo Logic
7 5 (1.36%) GitHub
7 5 (1.36%) SaaS
8 4 (1.09%) Amazon EC2
8 4 (1.09%) Amazon S3
9 3 (0.82%) DigitalOcean
10 1 (0.27%) Amazon ELB
10 1 (0.27%) Amazon Kinesis
10 1 (0.27%) AWS CloudFormation
10 1 (0.27%) AWS Lambda
10 1 (0.27%) CloudFront
Communications & Networking
1 25 (6.79%) HTTP
2 17 (4.62%) Internet
3 8 (2.17%) IPv4
3 8 (2.17%) Kerberos
4 7 (1.90%) DNS
5 2 (0.54%) LDAP
5 2 (0.54%) VoIP
6 1 (0.27%) SSH
6 1 (0.27%) TCP/IP
6 1 (0.27%) VPN
Database & Business Intelligence
1 357 (97.01%) Hadoop
2 313 (85.05%) Big Data
3 220 (59.78%) Apache Hive
4 178 (48.37%) HBase
5 109 (29.62%) SQL Server
6 98 (26.63%) Apache Cassandra
7 87 (23.64%) Sqoop
8 77 (20.92%) PostgreSQL
9 76 (20.65%) NoSQL
10 71 (19.29%) Relational Database
11 67 (18.21%) Impala
12 51 (13.86%) MongoDB
13 45 (12.23%) Data Warehouse
14 42 (11.41%) MySQL
15 30 (8.15%) RDBMS
16 28 (7.61%) Redis
17 22 (5.98%) Data Mining
18 18 (4.89%) Amazon Redshift
18 18 (4.89%) QlikView
19 16 (4.35%) SQL Server Integration Services
Development Applications
1 50 (13.59%) Git (software)
2 33 (8.97%) Jenkins
3 22 (5.98%) JIRA
3 22 (5.98%) Maven
4 20 (5.43%) JUnit
5 17 (4.62%) Eclipse
6 15 (4.08%) Selenium
7 13 (3.53%) Bugzilla
7 13 (3.53%) NetBeans
7 13 (3.53%) Subversion
8 11 (2.99%) Gradle
9 10 (2.72%) Talend Open Studio
9 10 (2.72%) Trac
10 9 (2.45%) TestNG
11 7 (1.90%) Gerrit
12 6 (1.63%) TeamCity
12 6 (1.63%) Vagrant
13 5 (1.36%) Grunt
14 3 (0.82%) Hudson
14 3 (0.82%) NeoLoad
General
1 91 (24.73%) Finance
2 49 (13.32%) Manufacturing
3 30 (8.15%) Banking
4 23 (6.25%) Marketing
5 11 (2.99%) Advertising
6 9 (2.45%) Retail
7 7 (1.90%) Games
7 7 (1.90%) Telecoms
8 4 (1.09%) Investment Banking
8 4 (1.09%) Legal
8 4 (1.09%) Pharmaceutical
9 3 (0.82%) Electronics
10 2 (0.54%) iGaming
10 2 (0.54%) Publishing
11 1 (0.27%) Financial Institution
11 1 (0.27%) Front Office
11 1 (0.27%) Law
Job Titles
1 125 (33.97%) Developer
2 80 (21.74%) Java Developer
3 59 (16.03%) Data Engineer
4 51 (13.86%) Big Data Engineer
5 50 (13.59%) Hadoop Developer
5 50 (13.59%) Hadoop Engineer
6 45 (12.23%) Administrator
7 42 (11.41%) Hadoop Administrator
8 38 (10.33%) Big Data Developer
9 37 (10.05%) Architect
10 36 (9.78%) Java Hadoop Developer
11 34 (9.24%) Data Architect
12 32 (8.70%) Big Data Architect
13 30 (8.15%) Senior Developer
14 28 (7.61%) Big Data Consultant
14 28 (7.61%) Consultant
14 28 (7.61%) Data Consultant
15 27 (7.34%) Java Engineer
15 27 (7.34%) Software Engineer
16 26 (7.07%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 94 (25.54%) Kafka
2 47 (12.77%) LAPP Stack
3 39 (10.60%) HTML
4 33 (8.97%) REST
5 31 (8.42%) J2EE
5 31 (8.42%) Spring
6 27 (7.34%) CSS
6 27 (7.34%) Web Services
7 22 (5.98%) Hibernate
7 22 (5.98%) JSON
8 19 (5.16%) AngularJS
8 19 (5.16%) XML
9 15 (4.08%) JDBC
10 14 (3.80%) Java SE
10 14 (3.80%) Node.js
11 12 (3.26%) D3.js
11 12 (3.26%) Velocity
12 11 (2.99%) .NET
12 11 (2.99%) Spring Integration
13 10 (2.72%) ODBC
Miscellaneous
1 40 (10.87%) Computer Science
2 34 (9.24%) Analytical Skills
3 23 (6.25%) Mathematics
4 22 (5.98%) Algorithms
5 21 (5.71%) Visualisation
6 18 (4.89%) Fintech
6 18 (4.89%) Physics
7 17 (4.62%) Management Information System
8 13 (3.53%) Replication
9 11 (2.99%) Data Centre
10 9 (2.45%) Clustering
10 9 (2.45%) Data Structures
11 8 (2.17%) PKI
11 8 (2.17%) Wiki
12 7 (1.90%) Mobile App
13 5 (1.36%) Cloud Native
14 4 (1.09%) Data Integration
14 4 (1.09%) Life Science
14 4 (1.09%) Virtual Team
15 3 (0.82%) Statistics
Operating Systems
1 131 (35.60%) Linux
2 46 (12.50%) Unix
3 20 (5.43%) Windows
4 13 (3.53%) Red Hat Enterprise Linux
5 6 (1.63%) CoreOS
6 1 (0.27%) Windows Server
Processes & Methodologies
1 159 (43.21%) MapReduce
2 122 (33.15%) Analytics
3 105 (28.53%) Agile Software Development
4 102 (27.72%) Business Intelligence
5 99 (26.90%) Open Source
6 83 (22.55%) ETL
7 80 (21.74%) Performance Tuning
8 75 (20.38%) Software Engineering
9 71 (19.29%) Data Analytics
10 57 (15.49%) Stakeholder Management
11 54 (14.67%) TDD
12 49 (13.32%) Data Management
13 44 (11.96%) Business Development
14 43 (11.68%) Scrum
15 33 (8.97%) Continuous Integration
15 33 (8.97%) Multithreading
16 30 (8.15%) SDLC
17 29 (7.88%) Big Data Analytics
18 25 (6.79%) Machine Learning
19 24 (6.52%) DevOps
Programming Languages
1 270 (73.37%) Java
2 170 (46.20%) Python
3 125 (33.97%) SQL
4 102 (27.72%) Scala
5 61 (16.58%) Shell Script
6 53 (14.40%) R
7 35 (9.51%) C++
8 31 (8.42%) JavaScript
8 31 (8.42%) Ruby
9 26 (7.07%) C#
10 17 (4.62%) Bash Shell
11 16 (4.35%) MATLAB
12 15 (4.08%) PHP
13 13 (3.53%) Perl
14 8 (2.17%) C
15 7 (1.90%) Go
16 2 (0.54%) Clojure
17 1 (0.27%) ANSI SQL
17 1 (0.27%) HiveQL
17 1 (0.27%) TypeScript
Qualifications
1 114 (30.98%) Degree
2 17 (4.62%) Security Cleared
3 12 (3.26%) PhD
4 8 (2.17%) DV Cleared
4 8 (2.17%) SC Cleared
Quality Assurance & Compliance
1 12 (3.26%) Data Quality
2 4 (1.09%) QA
3 3 (0.82%) SLA
System Software
1 95 (25.82%) Apache Flume
2 35 (9.51%) Apache ZooKeeper
3 24 (6.52%) Docker
4 15 (4.08%) VMware Infrastructure
5 14 (3.80%) VirtualBox
6 8 (2.17%) KVM
7 4 (1.09%) Xen
8 2 (0.54%) Virtual Machines
9 1 (0.27%) GPFS
9 1 (0.27%) LXC
Systems Management
1 107 (29.08%) Hadoop YARN
2 71 (19.29%) Oozie
3 25 (6.79%) Ambari
4 22 (5.98%) Puppet
5 20 (5.43%) Mesos
6 13 (3.53%) Ansible
6 13 (3.53%) Opscode Chef
7 9 (2.45%) Kibana
8 6 (1.63%) Kubernetes
8 6 (1.63%) Nagios
8 6 (1.63%) Salt
8 6 (1.63%) ZABBIX
9 3 (0.82%) Consul
9 3 (0.82%) Packer
9 3 (0.82%) Rancher
9 3 (0.82%) Terraform
10 1 (0.27%) HAProxy
10 1 (0.27%) logstash
Vendors
1 129 (35.05%) Cloudera
2 83 (22.55%) Oracle
3 76 (20.65%) Hortonworks
4 54 (14.67%) MapR
5 24 (6.52%) Tableau
6 20 (5.43%) Netezza
7 16 (4.35%) VMware
8 15 (4.08%) Google
8 15 (4.08%) Informatica
9 13 (3.53%) Red Hat
10 11 (2.99%) WorldPay
11 10 (2.72%) SAP
11 10 (2.72%) Splunk
11 10 (2.72%) Talend
12 9 (2.45%) Teradata
13 8 (2.17%) Sybase
14 7 (1.90%) MicroStrategy
14 7 (1.90%) Rackspace
15 6 (1.63%) New Relic
15 6 (1.63%) SaltStack
Manchester
TDA Group
Salary: £60000 - £65000 per annum + +Bonus +30 days holiday
Posted: 4 days ago
Edinburgh
TDA Group
Salary: £60000 - £65000 per annum + Bonus +OT +30 days holiday
Posted: 4 days ago
Manchester
TDA Group
Salary: £45000 - £50000 per annum + Bonus +OT +28 days holiday
Posted: 4 days ago
West London
Client Server
Salary: £85k to £100k + benefits
Posted: 4 days ago
Hampshire
Spectrum IT Recruitment (South) Ltd
Salary: £40000 - £60000 per annum + benefits
Posted: 4 days ago
London
Executive Recruitment Services (ERS)
Salary: £45000 - £75000 per annum
Posted: 4 days ago
Berkshire
Computer Futures
Salary: competitive
Posted: 6 days ago
London
Client Server
Salary: £85k to £100k + benefits
Posted: 11 days ago
London
Computer Futures
Salary: £70000 - £80000 per annum + competitive
Posted: 15 days ago
London
Computer Futures
Salary: £70000 - £80000 per annum + competitive
Posted: 14 days ago
London
People Source Consulting
Salary: £40000 - £55000 per annum
Posted: 23 days ago
London
Client Server
Salary: £85,000 to £100,000 + benefits
Posted: 18 days ago
London
Computer Futures
Salary: £70000 - £80000 per annum + competitive
Posted: 19 days ago