The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 24 July 2016 with a comparison to the same period over the previous 2 years.

3 months to
24 Jul 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 794 875 892
Rank change year-on-year
+81 +17
Permanent jobs citing HDFS 137 90 95
As % of all permanent IT jobs located in the UK 0.14% 0.082% 0.082%
As % of the System Software category 1.11% 0.71% 0.73%
Number of salaries quoted 106 57 78
Median salary £85,000 £75,000 £66,000
Median salary % change year-on-year
+13.33% +13.63%
90% offered a salary of more than £50,000 £54,200 £42,500
10% offered a salary of more than £112,500 £104,500 £100,000
UK excluding London median salary £55,000 £55,000 £42,500
% change year-on-year
- +29.41%

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
12318 12760 12937
As % of all permanent IT jobs located in the UK 12.57% 11.57% 11.22%
Number of salaries quoted 10476 10555 10743
Median salary £42,500 £40,000 £40,000
Median salary % change year-on-year
+6.25% -
90% offered a salary of more than £26,000 £25,000 £25,000
10% offered a salary of more than £67,500 £62,500 £65,000
UK excluding London median salary £40,000 £38,000 £37,500
% change year-on-year
+5.26% +1.33%

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 24 July 2016 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 19 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 24 July 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +96 136 £85,000 +13.33% 15
London +66 97 £92,500 +12.12% 10
South East +51 18 £50,000 -16.66% 2
West Midlands - 14 £55,000 - 1
Warwickshire - 14 £55,000 - 1
Warwick - 14 £55,000 - 1
City of London +64 12 £100,000 +17.64% 1
Hampshire - 9 £50,000 - 1
Berkshire +15 8 £57,500 -4.16% 1
Reading - 6 £47,500 - 1
Yorkshire +32 4 £55,000 -8.33%
North West +17 3 £24,000 -40.00% 2
Leeds +23 2 - -
West Yorkshire +13 2 - -
Newbury +3 2 £67,500 -
Manchester -8 2 £24,000 -52.00% 2
Merseyside - 1 - -
Docklands, London - 1 - -
Liverpool - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 24 July 2016, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 347 (97.47%) Hadoop
2 305 (85.67%) Big Data
3 272 (76.40%) Java
4 230 (64.61%) Apache Hive
5 205 (57.58%) Apache Spark
6 181 (50.84%) HBase
7 165 (46.35%) Python
8 159 (44.66%) MapReduce
9 140 (39.33%) Apache Pig
10 125 (35.11%) Linux
11 118 (33.15%) SQL
12 113 (31.74%) Analytics
13 112 (31.46%) Cloudera
14 111 (31.18%) Agile Software Development
15 109 (30.62%) Scala
16 106 (29.78%) Hadoop YARN
17 102 (28.65%) Degree
17 102 (28.65%) SQL Server
18 100 (28.09%) Apache Cassandra
19 99 (27.81%) Kafka
20 95 (26.69%) Apache Flume
20 95 (26.69%) Open Source
21 93 (26.12%) Business Intelligence
22 85 (23.88%) Oracle
23 82 (23.03%) Software Engineering
23 82 (23.03%) Apache
23 82 (23.03%) Sqoop
24 80 (22.47%) Finance
25 79 (22.19%) PostgreSQL
26 78 (21.91%) Relational Database

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 205 (57.58%) Apache Spark
2 140 (39.33%) Apache Pig
3 82 (23.03%) Apache
4 17 (4.78%) Elasticsearch
4 17 (4.78%) OpenStack
5 16 (4.49%) SAS
6 10 (2.81%) nginx
7 9 (2.53%) Apache Solr
8 8 (2.25%) JBoss
9 7 (1.97%) Confluence
9 7 (1.97%) Tomcat
10 5 (1.40%) Cloud Foundry
11 4 (1.12%) GemFire
12 1 (0.28%) Eucalyptus
12 1 (0.28%) IIS
12 1 (0.28%) WebLogic
Applications
1 8 (2.25%) MS Excel
2 3 (0.84%) MS Visio
3 2 (0.56%) SPSS
Business Applications
1 3 (0.84%) SAP Oil and Gas
2 1 (0.28%) Oracle Receivables
Cloud Services
1 55 (15.45%) Amazon AWS
2 17 (4.78%) IaaS
3 14 (3.93%) Cloud Computing
4 13 (3.65%) Microsoft Azure
4 13 (3.65%) PaaS
5 11 (3.09%) Google Cloud Platform
6 8 (2.25%) Sumo Logic
7 5 (1.40%) GitHub
8 4 (1.12%) Amazon EC2
8 4 (1.12%) Amazon EMR
8 4 (1.12%) Amazon S3
8 4 (1.12%) DigitalOcean
8 4 (1.12%) SaaS
9 1 (0.28%) Amazon ELB
9 1 (0.28%) Amazon Kinesis
9 1 (0.28%) AWS CloudFormation
9 1 (0.28%) AWS Lambda
9 1 (0.28%) CloudFront
9 1 (0.28%) iTunes
Communications & Networking
1 30 (8.43%) HTTP
2 19 (5.34%) Internet
3 9 (2.53%) DNS
4 8 (2.25%) IPv4
4 8 (2.25%) Kerberos
5 2 (0.56%) LDAP
5 2 (0.56%) VoIP
6 1 (0.28%) SSH
6 1 (0.28%) TCP/IP
6 1 (0.28%) VPN
Database & Business Intelligence
1 347 (97.47%) Hadoop
2 305 (85.67%) Big Data
3 230 (64.61%) Apache Hive
4 181 (50.84%) HBase
5 102 (28.65%) SQL Server
6 100 (28.09%) Apache Cassandra
7 82 (23.03%) Sqoop
8 79 (22.19%) PostgreSQL
9 78 (21.91%) Relational Database
10 77 (21.63%) NoSQL
11 63 (17.70%) Impala
12 53 (14.89%) MongoDB
13 48 (13.48%) MySQL
14 42 (11.80%) Data Warehouse
15 32 (8.99%) RDBMS
16 29 (8.15%) Redis
17 21 (5.90%) Data Mining
18 16 (4.49%) QlikView
19 14 (3.93%) Amazon Redshift
19 14 (3.93%) Voldemort
Development Applications
1 49 (13.76%) Git (software)
2 33 (9.27%) Jenkins
3 22 (6.18%) JIRA
3 22 (6.18%) Maven
4 18 (5.06%) JUnit
5 17 (4.78%) Eclipse
6 14 (3.93%) Selenium
7 13 (3.65%) NetBeans
8 12 (3.37%) Bugzilla
8 12 (3.37%) Subversion
9 11 (3.09%) Gradle
10 10 (2.81%) Trac
11 8 (2.25%) TestNG
11 8 (2.25%) Vagrant
12 7 (1.97%) TeamCity
13 6 (1.69%) Gerrit
13 6 (1.69%) Grunt
14 5 (1.40%) Talend Open Studio
15 4 (1.12%) NeoLoad
15 4 (1.12%) RStudio
General
1 80 (22.47%) Finance
2 38 (10.67%) Manufacturing
3 36 (10.11%) Banking
4 24 (6.74%) Marketing
5 10 (2.81%) Advertising
6 8 (2.25%) Retail
7 7 (1.97%) Telecoms
8 6 (1.69%) Games
9 5 (1.40%) Investment Banking
10 3 (0.84%) Electronics
10 3 (0.84%) Financial Institution
10 3 (0.84%) Legal
10 3 (0.84%) Pharmaceutical
11 2 (0.56%) Corporate Banking
11 2 (0.56%) iGaming
12 1 (0.28%) Front Office
12 1 (0.28%) Law
12 1 (0.28%) Publishing
Job Titles
1 131 (36.80%) Developer
2 83 (23.31%) Java Developer
3 59 (16.57%) Data Engineer
4 56 (15.73%) Big Data Engineer
5 54 (15.17%) Hadoop Developer
6 47 (13.20%) Hadoop Engineer
7 42 (11.80%) Administrator
8 40 (11.24%) Big Data Developer
9 39 (10.96%) Hadoop Administrator
10 38 (10.67%) Architect
11 37 (10.39%) Java Hadoop Developer
12 36 (10.11%) Senior Developer
13 35 (9.83%) Data Architect
14 33 (9.27%) Big Data Architect
15 32 (8.99%) Java Engineer
16 30 (8.43%) Senior Java Developer
17 25 (7.02%) Scala Developer
17 25 (7.02%) Software Engineer
18 23 (6.46%) Big Data Consultant
18 23 (6.46%) Consultant
Libraries, Frameworks & Software Standards
1 99 (27.81%) Kafka
2 45 (12.64%) LAPP Stack
3 38 (10.67%) HTML
4 36 (10.11%) REST
5 34 (9.55%) J2EE
6 33 (9.27%) Spring
7 27 (7.58%) CSS
7 27 (7.58%) Web Services
8 24 (6.74%) Hibernate
9 22 (6.18%) JSON
10 19 (5.34%) AngularJS
11 18 (5.06%) XML
12 15 (4.21%) JDBC
12 15 (4.21%) Node.js
13 14 (3.93%) Java SE
14 12 (3.37%) .NET
15 11 (3.09%) D3.js
15 11 (3.09%) Spring Integration
16 10 (2.81%) ODBC
16 10 (2.81%) Spark Streaming
Miscellaneous
1 33 (9.27%) Analytical Skills
1 33 (9.27%) Computer Science
2 21 (5.90%) Algorithms
3 20 (5.62%) Visualisation
4 18 (5.06%) Fintech
5 17 (4.78%) Mathematics
6 16 (4.49%) Replication
7 14 (3.93%) Management Information System
8 13 (3.65%) Data Centre
9 12 (3.37%) Physics
10 8 (2.25%) Clustering
10 8 (2.25%) Data Structures
10 8 (2.25%) PKI
11 7 (1.97%) Mobile App
11 7 (1.97%) Wiki
12 5 (1.40%) Data Integration
13 4 (1.12%) Cloud Native
13 4 (1.12%) Derivative
13 4 (1.12%) Virtual Team
14 3 (0.84%) Statistics
Operating Systems
1 125 (35.11%) Linux
2 46 (12.92%) Unix
3 18 (5.06%) Windows
4 13 (3.65%) Red Hat Enterprise Linux
5 8 (2.25%) CoreOS
6 1 (0.28%) Windows Server
Processes & Methodologies
1 159 (44.66%) MapReduce
2 113 (31.74%) Analytics
3 111 (31.18%) Agile Software Development
4 95 (26.69%) Open Source
5 93 (26.12%) Business Intelligence
6 82 (23.03%) Software Engineering
7 77 (21.63%) Performance Tuning
8 73 (20.51%) ETL
9 60 (16.85%) Data Analytics
9 60 (16.85%) TDD
10 47 (13.20%) Scrum
10 47 (13.20%) Stakeholder Management
11 40 (11.24%) Data Management
12 38 (10.67%) Continuous Integration
13 34 (9.55%) Multithreading
14 33 (9.27%) Business Development
15 32 (8.99%) Big Data Analytics
16 31 (8.71%) SDLC
17 28 (7.87%) DevOps
18 27 (7.58%) BDD
Programming Languages
1 272 (76.40%) Java
2 165 (46.35%) Python
3 118 (33.15%) SQL
4 109 (30.62%) Scala
5 57 (16.01%) Shell Script
6 51 (14.33%) R
7 36 (10.11%) C++
8 31 (8.71%) C#
8 31 (8.71%) JavaScript
9 28 (7.87%) Ruby
10 20 (5.62%) Bash Shell
11 18 (5.06%) PHP
12 17 (4.78%) MATLAB
13 14 (3.93%) Perl
14 10 (2.81%) C
15 9 (2.53%) Go
16 3 (0.84%) Clojure
17 1 (0.28%) ANSI SQL
17 1 (0.28%) HiveQL
17 1 (0.28%) TypeScript
Qualifications
1 102 (28.65%) Degree
2 19 (5.34%) Security Cleared
3 12 (3.37%) PhD
4 10 (2.81%) DV Cleared
5 8 (2.25%) SC Cleared
Quality Assurance & Compliance
1 9 (2.53%) Data Quality
2 4 (1.12%) QA
3 3 (0.84%) SLA
System Software
1 95 (26.69%) Apache Flume
2 33 (9.27%) Apache ZooKeeper
3 29 (8.15%) Docker
4 17 (4.78%) VMware Infrastructure
5 16 (4.49%) VirtualBox
6 8 (2.25%) KVM
7 5 (1.40%) Xen
8 2 (0.56%) Virtual Machines
9 1 (0.28%) GPFS
9 1 (0.28%) LXC
Systems Management
1 106 (29.78%) Hadoop YARN
2 72 (20.22%) Oozie
3 25 (7.02%) Ambari
4 24 (6.74%) Puppet
5 19 (5.34%) Ansible
6 16 (4.49%) Opscode Chef
7 13 (3.65%) Mesos
8 9 (2.53%) Kibana
8 9 (2.53%) Nagios
8 9 (2.53%) Salt
8 9 (2.53%) ZABBIX
9 8 (2.25%) Kubernetes
10 4 (1.12%) Consul
10 4 (1.12%) Packer
10 4 (1.12%) Rancher
10 4 (1.12%) Terraform
11 1 (0.28%) Graphite
11 1 (0.28%) HAProxy
11 1 (0.28%) logstash
Vendors
1 112 (31.46%) Cloudera
2 85 (23.88%) Oracle
3 69 (19.38%) Hortonworks
4 48 (13.48%) MapR
5 22 (6.18%) Tableau
6 18 (5.06%) VMware
7 17 (4.78%) Google
8 15 (4.21%) Netezza
9 13 (3.65%) Red Hat
10 12 (3.37%) Informatica
10 12 (3.37%) SAP
10 12 (3.37%) Splunk
11 10 (2.81%) WorldPay
12 9 (2.53%) Rackspace
13 8 (2.25%) IBM
13 8 (2.25%) New Relic
13 8 (2.25%) SaltStack
14 7 (1.97%) Sybase
15 6 (1.69%) MicroStrategy
15 6 (1.69%) Teradata
Manchester
TDA Group
Salary: £70000 - £75000 per annum + +30 days holiday
Posted: 3 days ago
Edinburgh
TDA Group
Salary: £70000 - £75000 per annum + +OT +30 days holiday
Posted: 3 days ago
Manchester
TDA Group
Salary: £50000 - £55000 per annum + Bonus +OT +28 days holiday
Posted: 3 days ago
Central London / West End
Client Server
Salary: £85k to £100k + benefits
Posted: 6 days ago
London
Computer Futures
Salary: £70000 - £80000 per annum + competitive
Posted: 5 days ago
United Kingdom
Network Compucare Ltd
Posted: 3 days ago
London
Computer Futures
Salary: competitive
Posted: 9 days ago
London
Client Server
Salary: £85k to £100k + benefits
Posted: 16 days ago
Central London / West End
First Utility
Salary: Up to £65,000 + Bonus + Excellent Benefits
Posted: 27 days ago
Warwick, Warwickshire
First Utility
Salary: Up to £65,000 + Bonus + Excellent Benefits
Posted: 27 days ago
Hampshire
Spectrum IT
Salary: £40000 - £60000 per annum + benefits
Posted: 24 days ago
London
Apple
Salary: Competitive
Posted: 20 days ago
London
Computer Futures
Salary: competitive
Posted: 23 days ago
Reading
Computer Futures
Salary: £45000 - £70000 per annum + Fantastic Benefits Package
Posted: 17 days ago