The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 4 May 2016 with a comparison to the same period over the previous 2 years.

3 months to
4 May 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 739 877 952
Rank change year-on-year
+138 +75
Permanent jobs citing HDFS 215 88 39
As % of all permanent IT jobs located in the UK 0.21% 0.080% 0.033%
As % of the System Software category 1.70% 0.66% 0.31%
Number of salaries quoted 169 58 36
Median salary £65,000 £65,000 £70,000
Median salary % change year-on-year
- -7.14%
90% offered a salary of more than £45,000 £45,000 £58,750
10% offered a salary of more than £120,000 £97,000 £100,000
UK excluding London median salary £52,500 £50,000 £40,000
% change year-on-year
+5.00% +25.00%

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
12653 13368 12504
As % of all permanent IT jobs located in the UK 12.33% 12.13% 10.48%
Number of salaries quoted 10724 10977 10513
Median salary £42,000 £42,000 £41,000
Median salary % change year-on-year
- +2.43%
90% offered a salary of more than £25,000 £25,000 £25,000
10% offered a salary of more than £65,000 £60,000 £65,000
UK excluding London median salary £37,500 £37,500 £39,000
% change year-on-year
- -3.84%

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 4 May 2016 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 25 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 4 May 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +152 215 £65,000 - 17
London +91 143 £75,000 -3.22% 12
South East +55 43 £51,500 -1.90% 2
Berkshire +45 32 £52,500 - 1
Reading - 31 £52,500 - 1
City of London +63 23 £70,000 -12.50% 2
West Midlands -5 16 £57,500 -28.12% 1
Warwick - 15 £57,500 - 1
Warwickshire - 15 £57,500 - 1
Yorkshire +10 10 £47,500 +5.55% 2
West Yorkshire +5 10 £47,500 +5.55% 2
Leeds +12 9 - - 2
Hampshire - 8 £50,000 - 1
North West +19 3 £47,500 -5.00%
Farnborough - 3 - -
Tunbridge Wells - 2 £42,500 -
Liverpool - 2 - -
Kent - 2 £42,500 -
Merseyside - 2 - -
Manchester -2 1 £47,500 -5.00%
Newbury -9 1 £52,500 -
Southampton - 1 £40,000 -
Bradford - 1 £47,500 -
Clapham - 1 £60,000 -
Surrey - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 4 May 2016, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 354 (95.16%) Hadoop
2 312 (83.87%) Big Data
3 270 (72.58%) Java
4 222 (59.68%) Apache Spark
5 201 (54.03%) Apache Hive
6 177 (47.58%) HBase
7 174 (46.77%) Python
8 151 (40.59%) SQL
9 150 (40.32%) MapReduce
10 148 (39.78%) Linux
11 134 (36.02%) Apache Pig
12 131 (35.22%) Cloudera
13 126 (33.87%) Analytics
14 120 (32.26%) Degree
15 110 (29.57%) SQL Server
15 110 (29.57%) Open Source
16 108 (29.03%) Agile Software Development
17 107 (28.76%) Business Intelligence
18 100 (26.88%) Hadoop YARN
19 99 (26.61%) ETL
20 98 (26.34%) Finance
21 95 (25.54%) Apache
21 95 (25.54%) Apache Cassandra
21 95 (25.54%) Hortonworks
22 93 (25.00%) Scala
23 88 (23.66%) Kafka
24 87 (23.39%) Apache Flume
25 86 (23.12%) Sqoop
26 82 (22.04%) Performance Tuning
27 80 (21.51%) Oozie

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 222 (59.68%) Apache Spark
2 134 (36.02%) Apache Pig
3 95 (25.54%) Apache
4 20 (5.38%) Elasticsearch
5 19 (5.11%) Node.js
6 13 (3.49%) OpenStack
7 12 (3.23%) SAS
8 11 (2.96%) Confluence
8 11 (2.96%) JBoss
9 9 (2.42%) Apache Solr
10 8 (2.15%) nginx
11 5 (1.34%) Cloud Foundry
11 5 (1.34%) Tomcat
12 4 (1.08%) GemFire
13 1 (0.27%) Eucalyptus
13 1 (0.27%) WebLogic
Applications
1 6 (1.61%) MS Excel
2 5 (1.34%) MS Visio
Business Applications
1 2 (0.54%) SAP Oil and Gas
2 1 (0.27%) Oracle Receivables
Cloud Services
1 52 (13.98%) Amazon AWS
2 27 (7.26%) Cloud Computing
3 13 (3.49%) IaaS
3 13 (3.49%) PaaS
4 12 (3.23%) Microsoft Azure
5 7 (1.88%) Google Cloud Platform
6 6 (1.61%) Amazon EMR
7 5 (1.34%) SaaS
8 4 (1.08%) GitHub
8 4 (1.08%) Sumo Logic
9 3 (0.81%) DigitalOcean
10 1 (0.27%) Amazon Kinesis
10 1 (0.27%) Amazon S3
Communications & Networking
1 16 (4.30%) HTTP
1 16 (4.30%) Internet
2 8 (2.15%) IPv4
3 7 (1.88%) Kerberos
4 4 (1.08%) DNS
5 2 (0.54%) VoIP
6 1 (0.27%) LDAP
Database & Business Intelligence
1 354 (95.16%) Hadoop
2 312 (83.87%) Big Data
3 201 (54.03%) Apache Hive
4 177 (47.58%) HBase
5 110 (29.57%) SQL Server
6 95 (25.54%) Apache Cassandra
7 86 (23.12%) Sqoop
8 77 (20.70%) NoSQL
9 75 (20.16%) PostgreSQL
10 74 (19.89%) Impala
11 63 (16.94%) Relational Database
12 51 (13.71%) Data Warehouse
13 47 (12.63%) MongoDB
14 36 (9.68%) MySQL
15 35 (9.41%) RDBMS
16 28 (7.53%) Redis
17 25 (6.72%) SQL Server Integration Services
18 24 (6.45%) Amazon Redshift
19 20 (5.38%) Data Mining
20 18 (4.84%) QlikView
Development Applications
1 48 (12.90%) Git (software)
2 32 (8.60%) Jenkins
3 26 (6.99%) JUnit
4 22 (5.91%) JIRA
5 18 (4.84%) Maven
6 17 (4.57%) Subversion
7 16 (4.30%) Talend Open Studio
8 15 (4.03%) Eclipse
8 15 (4.03%) Selenium
9 13 (3.49%) Bugzilla
10 11 (2.96%) Gradle
10 11 (2.96%) NetBeans
10 11 (2.96%) TestNG
11 10 (2.69%) Trac
12 7 (1.88%) Gerrit
13 5 (1.34%) TeamCity
14 4 (1.08%) Checkstyle
14 4 (1.08%) FindBugs
14 4 (1.08%) Oracle APEX
14 4 (1.08%) Toad
General
1 98 (26.34%) Finance
2 47 (12.63%) Manufacturing
3 28 (7.53%) Banking
4 21 (5.65%) Marketing
5 14 (3.76%) Retail
6 10 (2.69%) Advertising
7 7 (1.88%) Legal
8 6 (1.61%) Telecoms
9 5 (1.34%) Games
10 4 (1.08%) Pharmaceutical
10 4 (1.08%) Publishing
11 3 (0.81%) Investment Banking
12 2 (0.54%) Electronics
13 1 (0.27%) Financial Institution
13 1 (0.27%) Law
13 1 (0.27%) Multimedia
Job Titles
1 132 (35.48%) Developer
2 79 (21.24%) Java Developer
3 62 (16.67%) Administrator
4 59 (15.86%) Hadoop Administrator
5 52 (13.98%) Data Engineer
6 46 (12.37%) Hadoop Engineer
7 42 (11.29%) Big Data Developer
7 42 (11.29%) Hadoop Developer
8 39 (10.48%) Big Data Engineer
9 30 (8.06%) Architect
10 29 (7.80%) Senior Developer
11 28 (7.53%) Software Engineer
12 27 (7.26%) Java Hadoop Developer
13 26 (6.99%) Data Architect
14 24 (6.45%) Big Data Architect
15 23 (6.18%) Java Engineer
15 23 (6.18%) Senior Java Developer
16 21 (5.65%) Scala Developer
17 20 (5.38%) Big Data Consultant
17 20 (5.38%) Head of IT
Libraries, Frameworks & Software Standards
1 88 (23.66%) Kafka
2 51 (13.71%) LAPP Stack
3 39 (10.48%) HTML
4 28 (7.53%) Web Services
5 27 (7.26%) J2EE
5 27 (7.26%) REST
6 26 (6.99%) Spring
7 24 (6.45%) CSS
7 24 (6.45%) XML
8 20 (5.38%) Hibernate
8 20 (5.38%) JSON
9 18 (4.84%) AngularJS
10 16 (4.30%) JDBC
11 14 (3.76%) Apache Camel
12 13 (3.49%) D3.js
12 13 (3.49%) Velocity
13 12 (3.23%) .NET
13 12 (3.23%) J2SE
13 12 (3.23%) Java SE
14 11 (2.96%) POSIX
Miscellaneous
1 52 (13.98%) Computer Science
2 30 (8.06%) Analytical Skills
3 29 (7.80%) Mathematics
4 28 (7.53%) Algorithms
5 24 (6.45%) Physics
6 23 (6.18%) Fintech
7 21 (5.65%) Data Structures
7 21 (5.65%) Visualisation
8 18 (4.84%) Management Information System
9 11 (2.96%) Replication
9 11 (2.96%) Wiki
10 8 (2.15%) Clustering
10 8 (2.15%) Data Integration
10 8 (2.15%) PKI
11 7 (1.88%) Mobile App
11 7 (1.88%) Tandem
12 4 (1.08%) Data Centre
12 4 (1.08%) Life Science
12 4 (1.08%) Statistics
13 3 (0.81%) Online Banking
Operating Systems
1 148 (39.78%) Linux
2 47 (12.63%) Unix
3 24 (6.45%) Red Hat Enterprise Linux
4 22 (5.91%) Windows
5 4 (1.08%) CoreOS
Processes & Methodologies
1 150 (40.32%) MapReduce
2 126 (33.87%) Analytics
3 110 (29.57%) Open Source
4 108 (29.03%) Agile Software Development
5 107 (28.76%) Business Intelligence
6 99 (26.61%) ETL
7 82 (22.04%) Performance Tuning
8 73 (19.62%) Data Analytics
9 62 (16.67%) Data Management
10 60 (16.13%) Software Engineering
11 54 (14.52%) Stakeholder Management
11 54 (14.52%) TDD
12 43 (11.56%) Business Development
13 39 (10.48%) Scrum
14 34 (9.14%) Multithreading
15 31 (8.33%) Continuous Integration
16 25 (6.72%) SDLC
17 24 (6.45%) DevOps
18 22 (5.91%) Machine Learning
19 21 (5.65%) Big Data Analytics
Programming Languages
1 270 (72.58%) Java
2 174 (46.77%) Python
3 151 (40.59%) SQL
4 93 (25.00%) Scala
5 67 (18.01%) Shell Script
6 49 (13.17%) R
7 38 (10.22%) Ruby
8 37 (9.95%) C++
9 27 (7.26%) JavaScript
10 25 (6.72%) C#
11 17 (4.57%) Bash Shell
12 14 (3.76%) Perl
13 12 (3.23%) PHP
14 10 (2.69%) MATLAB
15 7 (1.88%) C
16 5 (1.34%) Go
17 4 (1.08%) PL/SQL
18 1 (0.27%) ANSI SQL
18 1 (0.27%) HiveQL
18 1 (0.27%) TypeScript
Qualifications
1 120 (32.26%) Degree
2 12 (3.23%) PhD
3 11 (2.96%) Security Cleared
4 8 (2.15%) SC Cleared
5 3 (0.81%) DV Cleared
Quality Assurance & Compliance
1 14 (3.76%) Data Quality
2 4 (1.08%) QA
3 3 (0.81%) SLA
System Software
1 87 (23.39%) Apache Flume
2 44 (11.83%) Apache ZooKeeper
3 21 (5.65%) Docker
4 16 (4.30%) VMware Infrastructure
5 12 (3.23%) VirtualBox
6 8 (2.15%) KVM
7 3 (0.81%) Xen
Systems Management
1 100 (26.88%) Hadoop YARN
2 80 (21.51%) Oozie
3 39 (10.48%) Ambari
4 28 (7.53%) Mesos
5 17 (4.57%) Puppet
6 11 (2.96%) Kibana
7 7 (1.88%) Ansible
7 7 (1.88%) Opscode Chef
8 4 (1.08%) Kubernetes
8 4 (1.08%) Nagios
8 4 (1.08%) Salt
8 4 (1.08%) ZABBIX
9 3 (0.81%) Packer
9 3 (0.81%) Terraform
Vendors
1 131 (35.22%) Cloudera
2 95 (25.54%) Hortonworks
3 77 (20.70%) Oracle
4 63 (16.94%) MapR
5 37 (9.95%) Tableau
6 26 (6.99%) Netezza
7 24 (6.45%) Red Hat
8 23 (6.18%) Teradata
9 18 (4.84%) Informatica
10 17 (4.57%) VMware
11 16 (4.30%) Talend
11 16 (4.30%) WorldPay
12 14 (3.76%) IBM
13 13 (3.49%) Google
14 11 (2.96%) Splunk
14 11 (2.96%) Sybase
15 8 (2.15%) Ab Initio
16 7 (1.88%) Cognos
17 6 (1.61%) MicroStrategy
17 6 (1.61%) SAP
City, London
ANSON MCCADE
Salary: £70 500 to £95 000 basic (+ superb package!!!)
Posted: 15 hours ago
Reading
Computer Futures
Salary: £35000 - £65000 per annum + Great Benefits Package
Posted: Yesterday
Central London / West End
Client Server
Salary: £85k to £100k + benefits
Posted: Yesterday
London
Explore Recruitment Solutions
Salary: £50000 - £55000 per annum
Posted: 4 days ago
London
E-synergy Solutions
Salary: £100000 - £130000 per annum + Bonus, Pension, Benefits
Posted: 4 days ago
Hampshire
Spectrum IT Recruitment (South) Ltd
Salary: £40000 - £60000 per annum + benefits
Posted: 5 days ago
London
Senitor Associates
Salary: £35000 - £55000 per annum
Posted: 6 days ago
Central London / West End
ANSON MCCADE
Salary: £50,000 to £70,000 basic (Plus substantial package)
Posted: 6 days ago
London
Capita Resourcing Ltd
Salary: £35000 - £50000 per annum + Equity shares
Posted: 7 days ago
London
Client Server
Salary: £75k to £90k + benefits
Posted: 13 days ago
Warwick, Warwickshire
First Utility
Salary: From £45,000 to £65,000 per annum + Bonus + Excellent Benefits
Posted: 13 days ago
London
Talent Point
Salary: £90000 - £110000 per annum + BONUS + BENEFITS
Posted: 15 days ago
London
Client Server
Salary: £85,000 to £100,000 + benefits
Posted: 16 days ago
Leeds, West Yorkshire
Sky Betting and Gaming
Posted: 22 days ago
Leeds, West Yorkshire
Sky Betting and Gaming
Posted: 22 days ago