Period
to 22 November 2017

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 6 months to 22 November 2017 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS)
UK > England
6 months to
22 Nov 2017
Same period 2016 Same period 2015
Rank 930 921 1046
Rank change year-on-year -9 +125 +107
Permanent jobs citing HDFS 243 269 221
As % of all permanent IT jobs advertised in England 0.14% 0.15% 0.11%
As % of the System Software category 1.11% 1.21% 0.95%
Number of salaries quoted 196 201 162
England median annual salary £70,000 £80,000 £70,000
Median salary % change year-on-year -12.50% +14.29% +12.00%
10th Percentile £45,000 £49,750 £45,125
90th Percentile £104,375 £110,000 £99,625
UK median annual salary £70,000 £80,000 £70,000
% change year-on-year -12.50% +14.29% +14.29%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

All System Software Skills
England
Permanent vacancies with a requirement for system software skills 21885 22243 23277
As % of all permanent IT jobs advertised in England 12.93% 12.39% 11.47%
Number of salaries quoted 18421 18805 19503
England median annual salary £45,000 £42,500 £40,000
Median salary % change year-on-year +5.88% +6.25% -
10th Percentile £24,000 £23,500 £22,750
90th Percentile £75,000 £72,500 £67,500
UK median annual salary £45,000 £42,500 £40,000
% change year-on-year +5.88% +6.25% +1.53%

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in England.

Salary trend for HDFS in England

HDFS
Salary Histogram in England

The salary distribution of IT jobs citing HDFS in England over the 6 months to 22 November 2017.

Salary histogram for HDFS in England

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 6 months to 22 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -27 172 £72,500 -9.38% 15
South East +38 43 £57,500 +4.55% 2
East of England - 10 £105,000 - 1
North of England -7 7 £45,000 -18.18% 6
North West -15 7 £45,000 +21.62% 2
South West +16 6 £50,000 -33.33% 3
Midlands +20 4 £46,125 -7.75%
West Midlands -8 3 £42,250 -15.50%
East Midlands - 1 £50,000 -
HDFS
UK

For the 6 months to 22 November 2017, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for HDFS.

1 200 (82.30%) Hadoop
2 194 (79.84%) Big Data
3 182 (74.90%) Apache Spark
4 155 (63.79%) Java
5 130 (53.50%) Apache Hive
6 111 (45.68%) HBase
7 109 (44.86%) Agile Software Development
8 100 (41.15%) MapReduce
9 94 (38.68%) Python
10 93 (38.27%) Kafka
11 89 (36.63%) Analytics
12 81 (33.33%) Scala
13 78 (32.10%) SQL
14 70 (28.81%) Linux
15 68 (27.98%) Apache
16 65 (26.75%) NoSQL
17 60 (24.69%) Finance
18 58 (23.87%) ETL
18 58 (23.87%) Degree
19 54 (22.22%) Amazon AWS
20 52 (21.40%) SQL Server
21 51 (20.99%) JavaScript
22 50 (20.58%) Continuous Integration
22 50 (20.58%) TDD
23 46 (18.93%) Apache Pig
23 46 (18.93%) Apache Flume
24 43 (17.70%) Git (software)
24 43 (17.70%) REST
25 42 (17.28%) Spring
26 41 (16.87%) Relational Database

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 182 (74.90%) Apache Spark
2 68 (27.98%) Apache
3 46 (18.93%) Apache Pig
4 30 (12.35%) Apache Solr
5 25 (10.29%) Elasticsearch
6 8 (3.29%) Confluence
6 8 (3.29%) Tomcat
7 4 (1.65%) Oracle Coherence
8 3 (1.23%) JBoss
8 3 (1.23%) OpenStack
9 2 (0.82%) Cloud Foundry
9 2 (0.82%) GemFire
9 2 (0.82%) SAS
10 1 (0.41%) Apache Airflow
10 1 (0.41%) Oracle SOA Suite
10 1 (0.41%) WebLogic
10 1 (0.41%) WebSphere
Applications
1 2 (0.82%) Microsoft Excel
Business Applications
1 1 (0.41%) Summit
Cloud Services
1 54 (22.22%) Amazon AWS
2 15 (6.17%) Google Cloud Platform
3 13 (5.35%) Cloud Computing
4 12 (4.94%) Microsoft Azure
5 10 (4.12%) Amazon EMR
6 5 (2.06%) Amazon S3
6 5 (2.06%) IaaS
7 4 (1.65%) Azure Data Factory
7 4 (1.65%) GitHub
7 4 (1.65%) PaaS
8 3 (1.23%) Loggly
8 3 (1.23%) SaaS
8 3 (1.23%) Sumo Logic
9 2 (0.82%) AWS Lambda
9 2 (0.82%) Cortana Intelligence Suite
9 2 (0.82%) Serverless
10 1 (0.41%) Amazon EC2
10 1 (0.41%) Amazon Kinesis
Communications & Networking
1 20 (8.23%) Internet
2 16 (6.58%) Kerberos
3 6 (2.47%) HTTP
4 5 (2.06%) DNS
5 4 (1.65%) LDAP
5 4 (1.65%) Network Security
6 3 (1.23%) TCP/IP
7 2 (0.82%) Broadband
8 1 (0.41%) Firewall
8 1 (0.41%) SSL
Database & Business Intelligence
1 200 (82.30%) Hadoop
2 194 (79.84%) Big Data
3 130 (53.50%) Apache Hive
4 111 (45.68%) HBase
5 65 (26.75%) NoSQL
6 52 (21.40%) SQL Server
7 41 (16.87%) Relational Database
8 37 (15.23%) Impala
9 33 (13.58%) Sqoop
10 32 (13.17%) MongoDB
11 28 (11.52%) Apache Cassandra
11 28 (11.52%) SQL Server Integration Services
12 21 (8.64%) PostgreSQL
13 20 (8.23%) MySQL
14 19 (7.82%) Redis
15 18 (7.41%) SQL Server Analysis Services
16 17 (7.00%) Data Warehouse
17 14 (5.76%) RDBMS
17 14 (5.76%) SQL Server Reporting Services
18 13 (5.35%) Data Lake
Development Applications
1 43 (17.70%) Git (software)
2 30 (12.35%) Jenkins
3 21 (8.64%) Subversion
4 20 (8.23%) JIRA
4 20 (8.23%) Maven
4 20 (8.23%) RStudio
4 20 (8.23%) SQL Server Management Studio (SSMS)
5 14 (5.76%) Eclipse
6 11 (4.53%) Grunt
7 9 (3.70%) Gerrit
7 9 (3.70%) IntelliJ
8 8 (3.29%) Cucumber
8 8 (3.29%) Jasmine
8 8 (3.29%) Selenium
9 7 (2.88%) Bitbucket
10 6 (2.47%) NetBeans
10 6 (2.47%) Talend Open Studio
11 5 (2.06%) Gradle
11 5 (2.06%) JIRA Agile
12 3 (1.23%) SonarQube
General
1 60 (24.69%) Finance
2 29 (11.93%) Banking
3 20 (8.23%) Retail
4 9 (3.70%) Front Office
5 7 (2.88%) Telecoms
6 5 (2.06%) Advertising
6 5 (2.06%) Games
6 5 (2.06%) Marketing
7 4 (1.65%) Investment Banking
7 4 (1.65%) Legal
8 3 (1.23%) Electronics
8 3 (1.23%) Manufacturing
9 1 (0.41%) Financial Institution
9 1 (0.41%) iGaming
9 1 (0.41%) Retail Banking
Job Titles
1 95 (39.09%) Developer
2 44 (18.11%) Java Developer
3 37 (15.23%) Big Data Engineer
3 37 (15.23%) Data Engineer
4 33 (13.58%) Big Data Developer
5 32 (13.17%) Senior Developer
6 27 (11.11%) Architect
6 27 (11.11%) Hadoop Engineer
6 27 (11.11%) Senior Java Developer
7 24 (9.88%) Data Manager
8 23 (9.47%) Data Architect
9 19 (7.82%) Big Data Architect
10 17 (7.00%) Scala Developer
11 14 (5.76%) Software Engineer
12 11 (4.53%) Big Data Software Engineer
13 10 (4.12%) Hadoop Developer
14 7 (2.88%) Angular Developer
14 7 (2.88%) JavaScript Developer
14 7 (2.88%) Technical Leader
15 6 (2.47%) Java Scala Developer
Libraries, Frameworks & Software Standards
1 93 (38.27%) Kafka
2 43 (17.70%) REST
3 42 (17.28%) Spring
4 26 (10.70%) Node.js
5 25 (10.29%) AngularJS
5 25 (10.29%) HTML
6 24 (9.88%) CSS
6 24 (9.88%) JSON
7 21 (8.64%) Apache Avro
8 18 (7.41%) Web Services
9 17 (7.00%) RabbitMQ
9 17 (7.00%) Spring Boot
10 14 (5.76%) Elastic Stack
11 12 (4.94%) SOAP
12 10 (4.12%) Java EE
12 10 (4.12%) Samza
12 10 (4.12%) XML
13 9 (3.70%) D3.js
13 9 (3.70%) Drools
14 8 (3.29%) Regular Expression
Miscellaneous
1 37 (15.23%) Analytical Skills
2 36 (14.81%) Computer Science
3 26 (10.70%) Greenfield Project
4 22 (9.05%) Algorithms
5 18 (7.41%) Data Structures
6 14 (5.76%) Fintech
7 7 (2.88%) Virtual Team
8 5 (2.06%) Credit Risk
8 5 (2.06%) Linux Command Line
8 5 (2.06%) Social Network
9 4 (1.65%) Clustering
9 4 (1.65%) Replication
10 3 (1.23%) Derivative
10 3 (1.23%) Driving Licence
10 3 (1.23%) Fixed Income
10 3 (1.23%) Market Risk
11 2 (0.82%) Enterprise Software
11 2 (0.82%) FMCG
11 2 (0.82%) Foreign Exchange (FX)
11 2 (0.82%) Online Games
Operating Systems
1 70 (28.81%) Linux
2 23 (9.47%) Windows
3 19 (7.82%) Unix
4 3 (1.23%) CoreOS
5 2 (0.82%) Mesosphere
5 2 (0.82%) Ubuntu
Processes & Methodologies
1 109 (44.86%) Agile Software Development
2 100 (41.15%) MapReduce
3 89 (36.63%) Analytics
4 58 (23.87%) ETL
5 50 (20.58%) Continuous Integration
5 50 (20.58%) TDD
6 39 (16.05%) Business Intelligence
7 35 (14.40%) OO
8 33 (13.58%) Software Engineering
9 30 (12.35%) Scrum
10 28 (11.52%) Machine Learning
11 27 (11.11%) Microservices
12 26 (10.70%) Data Management
13 24 (9.88%) Data Architecture
13 24 (9.88%) Data Modelling
14 23 (9.47%) BDD
14 23 (9.47%) Visualisation
15 21 (8.64%) Use Case
16 17 (7.00%) Business Analytics
16 17 (7.00%) Test Automation
Programming Languages
1 155 (63.79%) Java
2 94 (38.68%) Python
3 81 (33.33%) Scala
4 78 (32.10%) SQL
5 51 (20.99%) JavaScript
6 35 (14.40%) R
7 27 (11.11%) T-SQL
8 16 (6.58%) Ruby
9 14 (5.76%) Bash Shell
10 13 (5.35%) C
10 13 (5.35%) C#
11 8 (3.29%) Shell Script
12 7 (2.88%) C++
13 6 (2.47%) Go
13 6 (2.47%) PHP
14 3 (1.23%) CoffeeScript
14 3 (1.23%) F#
15 2 (0.82%) Clojure
15 2 (0.82%) HiveQL
15 2 (0.82%) PHP 7
Qualifications
1 58 (23.87%) Degree
2 29 (11.93%) Computer Science Degree
3 12 (4.94%) Security Cleared
4 8 (3.29%) CEH
4 8 (3.29%) CISSP
4 8 (3.29%) GCIH
4 8 (3.29%) OSCP
5 7 (2.88%) DV Cleared
6 5 (2.06%) SC Cleared
7 3 (1.23%) Master's Degree
7 3 (1.23%) PhD
8 2 (0.82%) Numerate Degree
9 1 (0.41%) CTC Cleared
Quality Assurance & Compliance
1 10 (4.12%) Data Quality
2 8 (3.29%) GPG13
2 8 (3.29%) ISO/IEC 27001
2 8 (3.29%) QA
3 3 (1.23%) GCP
4 1 (0.41%) GDPR
4 1 (0.41%) MiFID
System Software
1 46 (18.93%) Apache Flume
2 29 (11.93%) Apache ZooKeeper
3 28 (11.52%) Docker
4 8 (3.29%) Snort
5 3 (1.23%) VirtualBox
5 3 (1.23%) VMware Infrastructure
6 2 (0.82%) MapR-FS
6 2 (0.82%) Virtual Machines
7 1 (0.41%) Cronacle
Systems Management
1 36 (14.81%) Hadoop YARN
2 28 (11.52%) Oozie
3 22 (9.05%) Puppet
4 12 (4.94%) Ansible
4 12 (4.94%) Kubernetes
5 9 (3.70%) Opscode Chef
5 9 (3.70%) Terraform
6 8 (3.29%) Ambari
6 8 (3.29%) Suricata
7 7 (2.88%) Nagios
8 6 (2.47%) Mesos
8 6 (2.47%) QRadar
9 5 (2.06%) Graphite
9 5 (2.06%) Kibana
9 5 (2.06%) Salt
10 3 (1.23%) Fluentd
10 3 (1.23%) logstash
10 3 (1.23%) ZABBIX
11 2 (0.82%) Docker Swarm
11 2 (0.82%) yum
Vendors
1 36 (14.81%) Cloudera
2 26 (10.70%) Hortonworks
2 26 (10.70%) Oracle
3 18 (7.41%) MapR
4 16 (6.58%) Google
5 11 (4.53%) Microsoft
6 9 (3.70%) Splunk
6 9 (3.70%) Tableau
6 9 (3.70%) Teradata
7 8 (3.29%) FireEye
7 8 (3.29%) Fortinet
7 8 (3.29%) Palo Alto
7 8 (3.29%) Sophos
7 8 (3.29%) Sourcefire
7 8 (3.29%) TippingPoint
8 7 (2.88%) Atlassian
9 6 (2.47%) AlienVault
9 6 (2.47%) ArcSight
9 6 (2.47%) LogRhythm
9 6 (2.47%) Talend