The table below looks at the statistics for HDFS skills in IT jobs advertised across the UK. Included is a guide to the salaries offered in IT jobs that have cited HDFS over the 3 months to 25 February 2017 with a comparison to the same period over the previous 2 years.

3 months to
25 Feb 2017
Same period 2016 Same period 2015
Hadoop Distributed File System (HDFS)
UK
Rank 721 757 883
Rank change year-on-year
+36 +126
Permanent jobs citing HDFS 120 182 83
As % of all permanent IT jobs located in the UK 0.14% 0.18% 0.078%
As % of the System Software category 1.19% 1.46% 0.61%
Number of salaries quoted 100 129 65
Median salary £80,000 £68,750 £65,000
Median salary % change year-on-year
+16.36% +5.76%
90% offered a salary of more than £54,750 £52,500 £45,000
10% offered a salary of more than £110,000 £120,000 £83,750
UK excluding London median salary £65,000 £57,500 £45,000
% change year-on-year
+13.04% +27.77%

The following table is for comparison with the above and provides statistics for the entire System Software category in permanent jobs advertised across the UK.

System Software Category
UK
Permanent IT job ads with a match in the
System Software category
10092 12489 13510
As % of all permanent IT jobs located in the UK 12.17% 12.24% 12.67%
Number of salaries quoted 8394 10589 11327
Median salary £42,500 £41,500 £40,500
Median salary % change year-on-year
+2.40% +2.46%
90% offered a salary of more than £25,000 £25,000 £24,500
10% offered a salary of more than £70,000 £65,000 £65,000
UK excluding London median salary £37,500 £38,500 £37,500
% change year-on-year
-2.59% +2.66%

HDFS
Jobs Demand Trend

The demand trend of job ads citing HDFS as a proportion of all IT jobs with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS within the UK.

HDFS Salary Trend in the UK

HDFS
Salary Histogram

This chart provides a salary histogram for IT jobs citing HDFS over the 3 months to 25 February 2017 within the UK.

HDFS Salary Histogram in the UK

HDFS
Top 27 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the UK over the 3 months to 25 February 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +31 112 £80,000 +14.28% 20
London +57 96 £80,000 - 13
City of London +40 26 £110,000 +29.41% 4
Canary Wharf - 6 £72,500 -
South East +46 5 £87,500 +66.66% 3
North West -13 5 £52,500 -
Scotland +24 4 £86,250 +43.75%
Edinburgh +5 4 £86,250 +43.75%
West Midlands +13 3 - -
Manchester -28 3 £52,500 -
Berkshire +40 2 £87,500 +59.09% 2
Yorkshire +29 2 £55,000 -8.52% 1
Leeds +19 2 £55,000 -8.52% 1
Warwick +18 2 - -
West Yorkshire +14 2 £55,000 -8.52% 1
Warwickshire +7 2 - -
Surrey - 2 £87,500 - 1
Cheshire - 2 £41,250 -
Chester - 2 £41,250 -
Reading +35 1 - - 2
Colchester - 1 £65,000 - 2
Newport - 1 £65,000 -
South Wales - 1 £65,000 -
Birmingham - 1 - -
East of England - 1 £65,000 - 3
Wales - 1 £65,000 -
Essex - 1 £65,000 - 2

HDFS
Top 30 Related IT Skills

For the 6 months to 25 February 2017, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for HDFS.

1 234 (82.69%) Big Data
2 230 (81.27%) Hadoop
3 194 (68.55%) Apache Hive
4 187 (66.08%) Java
5 176 (62.19%) Apache Spark
6 147 (51.94%) HBase
7 111 (39.22%) Apache Pig
8 109 (38.52%) Linux
9 105 (37.10%) Agile Software Development
10 97 (34.28%) MapReduce
11 77 (27.21%) Business Intelligence
11 77 (27.21%) Kafka
12 75 (26.50%) Sqoop
13 74 (26.15%) NoSQL
14 73 (25.80%) Oozie
15 72 (25.44%) Apache
16 71 (25.09%) Analytics
17 69 (24.38%) Scala
18 67 (23.67%) Python
19 66 (23.32%) SQL
20 64 (22.61%) Degree
21 62 (21.91%) Finance
22 60 (21.20%) Open Source
23 59 (20.85%) Amazon AWS
24 53 (18.73%) Software Engineering
24 53 (18.73%) Hadoop YARN
25 50 (17.67%) Analytical Skills
26 47 (16.61%) TDD
26 47 (16.61%) Computer Science
27 45 (15.90%) Apache Cassandra

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 176 (62.19%) Apache Spark
2 111 (39.22%) Apache Pig
3 72 (25.44%) Apache
4 44 (15.55%) Elasticsearch
5 12 (4.24%) WildFly
6 11 (3.89%) Apache Solr
7 9 (3.18%) SAS
8 7 (2.47%) Cloud Foundry
9 6 (2.12%) OpenStack
10 4 (1.41%) JBoss
10 4 (1.41%) nginx
11 2 (0.71%) Apache Geronimo
11 2 (0.71%) GlassFish
11 2 (0.71%) Oracle Workflow
11 2 (0.71%) Tomcat
11 2 (0.71%) WebSphere
Applications
1 3 (1.06%) MS Excel
2 2 (0.71%) Weka
3 1 (0.35%) SPSS
Cloud Services
1 59 (20.85%) Amazon AWS
2 30 (10.60%) Microsoft Azure
3 17 (6.01%) Cloud Computing
4 10 (3.53%) Google Cloud Platform
5 7 (2.47%) IaaS
6 6 (2.12%) GitHub
7 5 (1.77%) Amazon S3
7 5 (1.77%) PaaS
8 2 (0.71%) Amazon EC2
8 2 (0.71%) Amazon EMR
8 2 (0.71%) Loggly
8 2 (0.71%) Sumo Logic
9 1 (0.35%) Google Compute Engine
Communications & Networking
1 26 (9.19%) Kerberos
2 17 (6.01%) Internet
3 6 (2.12%) FTP
3 6 (2.12%) HTTP
4 5 (1.77%) Network Security
5 4 (1.41%) IPv4
6 2 (0.71%) DNS
6 2 (0.71%) LDAP
Database & Business Intelligence
1 234 (82.69%) Big Data
2 230 (81.27%) Hadoop
3 194 (68.55%) Apache Hive
4 147 (51.94%) HBase
5 75 (26.50%) Sqoop
6 74 (26.15%) NoSQL
7 45 (15.90%) Apache Cassandra
8 34 (12.01%) MongoDB
8 34 (12.01%) SQL Server
9 32 (11.31%) Data Warehouse
10 28 (9.89%) MySQL
11 27 (9.54%) Relational Database
12 23 (8.13%) PostgreSQL
12 23 (8.13%) Redis
13 21 (7.42%) Impala
14 20 (7.07%) Neo4j
15 19 (6.71%) RDBMS
16 16 (5.65%) HAWQ
17 14 (4.95%) QlikView
18 10 (3.53%) Pentaho
Development Applications
1 26 (9.19%) Jenkins
2 22 (7.77%) Selenium
3 21 (7.42%) Git (software)
4 15 (5.30%) Maven
4 15 (5.30%) TeamCity
5 12 (4.24%) Grunt
5 12 (4.24%) IntelliJ
5 12 (4.24%) Sonatype Nexus
6 10 (3.53%) Gerrit
6 10 (3.53%) Jasmine
7 9 (3.18%) Cucumber
7 9 (3.18%) JIRA
8 7 (2.47%) JUnit
8 7 (2.47%) Vagrant
9 6 (2.12%) Talend Open Studio
10 5 (1.77%) Subversion
11 4 (1.41%) Bugzilla
11 4 (1.41%) TestNG
11 4 (1.41%) Trac
12 3 (1.06%) Apache Continuum
General
1 62 (21.91%) Finance
2 35 (12.37%) Banking
3 17 (6.01%) Advertising
4 10 (3.53%) Retail
5 8 (2.83%) Games
5 8 (2.83%) Telecoms
6 7 (2.47%) Investment Banking
6 7 (2.47%) Manufacturing
7 6 (2.12%) Legal
8 5 (1.77%) Marketing
9 3 (1.06%) Automotive
9 3 (1.06%) Spanish Language
10 2 (0.71%) Financial Institution
10 2 (0.71%) Front Office
10 2 (0.71%) Multimedia
11 1 (0.35%) Corporate Banking
Job Titles
1 94 (33.22%) Developer
2 59 (20.85%) Architect
3 51 (18.02%) Data Architect
3 51 (18.02%) Java Developer
4 39 (13.78%) Data Engineer
5 36 (12.72%) Big Data Engineer
6 35 (12.37%) Big Data Developer
7 32 (11.31%) Big Data Architect
8 31 (10.95%) Administrator
8 31 (10.95%) Hadoop Administrator
9 28 (9.89%) Hadoop Developer
10 26 (9.19%) Senior Developer
11 25 (8.83%) Apache Spark Developer
11 25 (8.83%) Java Engineer
12 24 (8.48%) Software Engineer
13 23 (8.13%) Java Software Engineer
14 21 (7.42%) Scala Developer
15 19 (6.71%) Hadoop Architect
16 17 (6.01%) Enterprise Architect
17 16 (5.65%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 77 (27.21%) Kafka
2 28 (9.89%) Spring
3 21 (7.42%) AngularJS
4 18 (6.36%) REST
5 17 (6.01%) Node.js
6 15 (5.30%) Apache Avro
6 15 (5.30%) HTML
6 15 (5.30%) RESTful
7 13 (4.59%) J2EE
8 12 (4.24%) Grails
8 12 (4.24%) Hibernate
8 12 (4.24%) Ruby on Rails
8 12 (4.24%) Spring Boot
8 12 (4.24%) Web Services
9 10 (3.53%) .NET
9 10 (3.53%) Akka
9 10 (3.53%) XML
10 9 (3.18%) Elastic Stack
10 9 (3.18%) jQuery
11 8 (2.83%) D3.js
Miscellaneous
1 50 (17.67%) Analytical Skills
2 47 (16.61%) Computer Science
3 16 (5.65%) Algorithms
4 15 (5.30%) Fintech
5 8 (2.83%) Replication
6 7 (2.47%) Virtual Team
7 6 (2.12%) Derivative
7 6 (2.12%) Linux Command Line
7 6 (2.12%) PKI
8 5 (1.77%) Clustering
8 5 (1.77%) Credit Risk
9 4 (1.41%) Data Centre
10 3 (1.06%) Client/Server
10 3 (1.06%) Data Structures
10 3 (1.06%) Enterprise Software
10 3 (1.06%) Mainframe
10 3 (1.06%) Management Information System
10 3 (1.06%) Market Risk
10 3 (1.06%) Reference Data
10 3 (1.06%) Social Network
Operating Systems
1 109 (38.52%) Linux
2 38 (13.43%) Unix
3 13 (4.59%) Windows
4 12 (4.24%) Ubuntu
5 7 (2.47%) Red Hat Enterprise Linux
6 2 (0.71%) CoreOS
Processes & Methodologies
1 105 (37.10%) Agile Software Development
2 97 (34.28%) MapReduce
3 77 (27.21%) Business Intelligence
4 71 (25.09%) Analytics
5 60 (21.20%) Open Source
6 53 (18.73%) Software Engineering
7 47 (16.61%) TDD
8 38 (13.43%) ETL
9 37 (13.07%) Data Modelling
10 35 (12.37%) Data Architecture
11 33 (11.66%) DevOps
12 32 (11.31%) Mentoring
13 29 (10.25%) Data Management
13 29 (10.25%) Scrum
14 26 (9.19%) Continuous Integration
14 26 (9.19%) E-Commerce
15 23 (8.13%) Visualisation
16 22 (7.77%) OO
16 22 (7.77%) SDLC
17 20 (7.07%) Data Ingestion
Programming Languages
1 187 (66.08%) Java
2 69 (24.38%) Scala
3 67 (23.67%) Python
4 66 (23.32%) SQL
5 34 (12.01%) Ruby
6 26 (9.19%) C++
7 24 (8.48%) JavaScript
8 23 (8.13%) R
9 22 (7.77%) C#
10 19 (6.71%) C
11 17 (6.01%) Bash Shell
12 12 (4.24%) Groovy
12 12 (4.24%) Shell Script
13 11 (3.89%) Perl
13 11 (3.89%) PL/SQL
14 10 (3.53%) PHP
15 7 (2.47%) Go
15 7 (2.47%) T-SQL
16 5 (1.77%) PowerShell
17 4 (1.41%) MATLAB
Qualifications
1 64 (22.61%) Degree
2 20 (7.07%) Postgraduate
3 18 (6.36%) PhD
4 7 (2.47%) CISSP
4 7 (2.47%) Security Cleared
5 6 (2.12%) SC Cleared
6 5 (1.77%) CEH
6 5 (1.77%) GCIH
6 5 (1.77%) OSCP
7 2 (0.71%) OCA
7 2 (0.71%) OCP
7 2 (0.71%) Oracle Certification
8 1 (0.35%) CBAP
8 1 (0.35%) IIBA
Quality Assurance & Compliance
1 11 (3.89%) QA
2 8 (2.83%) Data Quality
3 3 (1.06%) GPG13
3 3 (1.06%) ISO/IEC 27001
4 2 (0.71%) Basel III
4 2 (0.71%) Dodd-Frank
System Software
1 45 (15.90%) Apache Flume
2 30 (10.60%) Apache ZooKeeper
3 24 (8.48%) Docker
4 10 (3.53%) VMware Infrastructure
5 6 (2.12%) VirtualBox
6 5 (1.77%) Snort
7 4 (1.41%) KVM
8 2 (0.71%) vCloud
9 1 (0.35%) Active Directory
Systems Management
1 73 (25.80%) Oozie
2 53 (18.73%) Hadoop YARN
3 27 (9.54%) Puppet
4 17 (6.01%) Ambari
5 15 (5.30%) Kubernetes
6 11 (3.89%) Ansible
7 10 (3.53%) Kibana
8 9 (3.18%) Opscode Chef
9 6 (2.12%) logstash
10 5 (1.77%) Fluentd
10 5 (1.77%) QRadar
11 4 (1.41%) Terraform
12 3 (1.06%) CSIRT
12 3 (1.06%) Nagios
13 2 (0.71%) Graphite
13 2 (0.71%) Mesos
13 2 (0.71%) Salt
13 2 (0.71%) ZABBIX
14 1 (0.35%) Ganglia
Vendors
1 37 (13.07%) Cloudera
1 37 (13.07%) Hortonworks
2 29 (10.25%) Oracle
3 25 (8.83%) Tableau
4 12 (4.24%) Google
4 12 (4.24%) MicroStrategy
5 11 (3.89%) MapR
5 11 (3.89%) Red Hat
6 10 (3.53%) Splunk
6 10 (3.53%) VMware
7 6 (2.12%) Microsoft
7 6 (2.12%) Talend
8 5 (1.77%) ArcSight
8 5 (1.77%) FireEye
8 5 (1.77%) Fortinet
8 5 (1.77%) LogRhythm
8 5 (1.77%) Palo Alto
8 5 (1.77%) Sophos
8 5 (1.77%) Sourcefire
8 5 (1.77%) TippingPoint
London
Computer Futures
Salary: £55000 - £90000 per annum + competitive
Posted: 9 hours ago
London
Computer Futures - London & S.E(Permanent and Contract)
Posted: Yesterday
Cambridge, Cambridgeshire
Softweb Resourcing Limited
Salary: From £40,000 to £65,000 per annum Salary DOE + Benefits
Posted: 2 days ago
City, London
Oliver Bernard
Salary: £95000 - £105000 per annum
Posted: 2 days ago
London
Churchill Frank
Salary: £90000 - £150000 per annum + Bonus + Equity
Posted: 6 days ago
Staines
Centrica
Salary: Competitive plus benefits
Posted: 3 days ago
Colchester, Essex
Cloudscope
Salary: From £30,000 to £55,000 per annum
Posted: 2 days ago
Colchester, Essex
Cloudscope
Salary: From £55,000 to £70,000 per annum
Posted: 2 days ago
London
Oliver Bernard
Salary: £65000 - £75000 per annum
Posted: 2 days ago
City of London
Computer Futures
Salary: competitive
Posted: 12 days ago
London
Kindred Group
Salary: Competitive
Posted: 15 days ago
London
Churchill Frank
Salary: £75000 - £76000 per annum
Posted: 16 days ago
Leeds
BAE SYSTEMS
Salary: Competitive + Benefits
Posted: 13 days ago
London
Nigel Frank International
Posted: 18 days ago
City of London
Churchill Frank
Salary: £60000 - £90000 per annum + Great Benefits
Posted: 25 days ago