HDFS Jobs in England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDFS over the 3 months to 24 June 2017 with a comparison to the same period in the previous 2 years.

Hadoop Distributed File System (HDFS) UK / England
Location	3 months to 24 Jun 2017	Same period 2016	Same period 2015
Rank	733	750	875
Rank change year-on-year	+17	+125
Permanent jobs citing HDFS	124	159	76
As % of all permanent IT jobs advertised in England	0.15%	0.17%	0.073%
As % of the System Software category	1.16%	1.36%	0.61%
Number of salaries quoted	95	131	58
Median salary	£70,000	£80,000	£75,000
Median salary % change year-on-year	-12.50%	+6.66%
90% offered a salary of more than	£55,000	£47,500	£50,000
10% offered a salary of more than	£105,000	£120,000	£129,500
UK excluding London median salary	£56,250	£51,250	£50,000
% change year-on-year	+9.75%	+2.50%

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for system software skills.

System Software Skills England
Permanent job vacancies with a requirement for system software skills	10697	11692	12427
As % of all permanent IT job vacancies advertised in England	12.94%	12.64%	11.95%
Number of salaries quoted	9106	10043	10329
Median salary	£45,000	£42,500	£41,000
Median salary % change year-on-year	+5.88%	+3.65%
90% offered a salary of more than	£26,000	£25,182	£25,000
10% offered a salary of more than	£70,000	£65,000	£67,500
UK excluding London median salary	£38,000	£39,000	£37,500
% change year-on-year	-2.56%	+4.00%

HDFS
Job Vacancy Trend in England

The job posting trend of jobs advertised in England citing HDFS as a proportion of all permanent or contract IT jobs with a match in the System Software category.

HDFS
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing HDFS in England.

HDFS
Salary Histogram in England

The salary distribution of IT jobs citing HDFS in England over the 3 months to 24 June 2017.

HDFS
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing HDFS within the England region over the 3 months to 24 June 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location	Rank Change on Same Period Last Year	Matching Permanent IT Job Ads	Median Salary Last 3 Months	Median Salary % Change on Same Period Last Year	Live Job Vacancies
London	+15	100	£70,000	-17.64%	17
South East	+31	9	£55,000	+10.00%	2
North West	-32	9	£78,750	+120.27%
East of England	-	3	-	-
South West	-	2	£60,000	-
Yorkshire	-3	1	-	-	1
HDFS UK

HDFS
Top 30 Co-occurring IT Skills in England

For the 6 months to 24 June 2017, IT jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for HDFS.

1	200 (85.11%)	Hadoop
2	197 (83.83%)	Big Data
3	172 (73.19%)	Apache Hive
4	155 (65.96%)	Apache Spark
5	136 (57.87%)	Java
6	128 (54.47%)	HBase
7	108 (45.96%)	Kafka
8	101 (42.98%)	MapReduce
9	86 (36.60%)	Apache Pig
9	86 (36.60%)	Python
10	85 (36.17%)	NoSQL
11	83 (35.32%)	Agile Software Development
12	75 (31.91%)	Analytics
13	69 (29.36%)	Apache
14	68 (28.94%)	Scala

15	67 (28.51%)	Finance
16	63 (26.81%)	SQL
16	63 (26.81%)	Linux
17	57 (24.26%)	Analytical Skills
18	53 (22.55%)	Oozie
19	49 (20.85%)	Sqoop
20	48 (20.43%)	Hortonworks
21	43 (18.30%)	Cloudera
21	43 (18.30%)	ETL
22	41 (17.45%)	Apache Cassandra
23	40 (17.02%)	Impala
24	34 (14.47%)	Relational Database
24	34 (14.47%)	Apache Flume
24	34 (14.47%)	Degree
25	33 (14.04%)	MongoDB

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
Applications
Cloud Services
Communications & Networking
Database & Business Intelligence
Development Applications
General
Job Titles
Libraries, Frameworks & Software Standards
Miscellaneous
Operating Systems
Processes & Methodologies
Programming Languages
Qualifications
Quality Assurance & Compliance
System Software
Systems Management
Vendors

Application Platforms
1	155 (65.96%)	Apache Spark
2	86 (36.60%)	Apache Pig
3	69 (29.36%)	Apache
4	17 (7.23%)	Elasticsearch
5	14 (5.96%)	Apache Solr
6	9 (3.83%)	Tomcat
7	4 (1.70%)	Apache Geronimo
7	4 (1.70%)	Cloud Foundry
7	4 (1.70%)	GemFire
7	4 (1.70%)	GlassFish
7	4 (1.70%)	JBoss
7	4 (1.70%)	SAS
7	4 (1.70%)	WebSphere
8	3 (1.28%)	OpenStack
9	2 (0.85%)	Mule
10	1 (0.43%)	Oracle Coherence

Applications
1	4 (1.70%)	Weka
2	2 (0.85%)	Microsoft Excel

Cloud Services
1	25 (10.64%)	Amazon AWS
2	12 (5.11%)	GitHub
3	11 (4.68%)	Google Cloud Platform
3	11 (4.68%)	Microsoft Azure
4	9 (3.83%)	Cloud Computing
4	9 (3.83%)	PaaS
5	7 (2.98%)	IaaS
6	4 (1.70%)	SaaS
7	3 (1.28%)	Loggly
7	3 (1.28%)	Sumo Logic
8	2 (0.85%)	Amazon EC2
9	1 (0.43%)	Amazon EMR
9	1 (0.43%)	AWS Lambda
9	1 (0.43%)	DigitalOcean

Communications & Networking
1	9 (3.83%)	Kerberos
2	8 (3.40%)	Internet
3	6 (2.55%)	LDAP
4	4 (1.70%)	HTTP
4	4 (1.70%)	Network Security
5	3 (1.28%)	DNS
6	2 (0.85%)	Broadband
7	1 (0.43%)	SSL

Database & Business Intelligence
1	200 (85.11%)	Hadoop
2	197 (83.83%)	Big Data
3	172 (73.19%)	Apache Hive
4	128 (54.47%)	HBase
5	85 (36.17%)	NoSQL
6	49 (20.85%)	Sqoop
7	41 (17.45%)	Apache Cassandra
8	40 (17.02%)	Impala
9	34 (14.47%)	Relational Database
10	33 (14.04%)	MongoDB
11	24 (10.21%)	SQL Server
12	21 (8.94%)	MySQL
13	20 (8.51%)	Data Warehouse
14	15 (6.38%)	RDBMS
15	13 (5.53%)	SQL Server Integration Services
16	12 (5.11%)	PostgreSQL
17	11 (4.68%)	Parquet
18	10 (4.26%)	CouchDB
18	10 (4.26%)	Data Mining
19	9 (3.83%)	HAWQ

Development Applications
1	23 (9.79%)	Jenkins
2	22 (9.36%)	Git (software)
3	16 (6.81%)	Gradle
3	16 (6.81%)	Subversion
4	14 (5.96%)	Maven
5	13 (5.53%)	RStudio
6	12 (5.11%)	SQL Server Management Studio (SSMS)
7	7 (2.98%)	Talend Open Studio
8	6 (2.55%)	Eclipse
9	5 (2.13%)	JUnit
10	4 (1.70%)	Ant
10	4 (1.70%)	JIRA
10	4 (1.70%)	Vagrant
11	2 (0.85%)	FindBugs
11	2 (0.85%)	Grunt
11	2 (0.85%)	TeamCity
12	1 (0.43%)	Artifactory
12	1 (0.43%)	SonarQube
12	1 (0.43%)	Sonatype Nexus
12	1 (0.43%)	The Grinder

General
1	67 (28.51%)	Finance
2	21 (8.94%)	Retail
3	18 (7.66%)	Banking
4	10 (4.26%)	Advertising
4	10 (4.26%)	Games
5	8 (3.40%)	Telecoms
6	7 (2.98%)	Front Office
6	7 (2.98%)	Legal
7	6 (2.55%)	Investment Banking
8	3 (1.28%)	Manufacturing
8	3 (1.28%)	Marketing
9	1 (0.43%)	Automotive
9	1 (0.43%)	Financial Institution

Job Titles
1	59 (25.11%)	Developer
2	50 (21.28%)	Architect
3	43 (18.30%)	Data Engineer
4	42 (17.87%)	Data Architect
5	31 (13.19%)	Hadoop Engineer
6	29 (12.34%)	Big Data Engineer
7	26 (11.06%)	Big Data Architect
8	25 (10.64%)	Java Developer
9	17 (7.23%)	Scala Developer
10	16 (6.81%)	Data Manager
11	15 (6.38%)	Big Data Developer
12	14 (5.96%)	Administrator
12	14 (5.96%)	Hadoop Administrator
12	14 (5.96%)	Senior Developer
13	13 (5.53%)	Data Scientist
14	12 (5.11%)	E-Commerce Director
14	12 (5.11%)	Hadoop Architect
14	12 (5.11%)	Hadoop Developer
14	12 (5.11%)	Technology Director
15	11 (4.68%)	Enterprise Architect

Libraries, Frameworks & Software Standards
1	108 (45.96%)	Kafka
2	20 (8.51%)	Spring
3	18 (7.66%)	Akka
3	18 (7.66%)	Apache Avro
4	17 (7.23%)	JSON
4	17 (7.23%)	REST
5	11 (4.68%)	AngularJS
6	9 (3.83%)	jQuery
6	9 (3.83%)	Middleware
6	9 (3.83%)	Natural Language Processing
6	9 (3.83%)	RabbitMQ
6	9 (3.83%)	Spark Streaming
7	8 (3.40%)	Apache Flex
7	8 (3.40%)	Elastic Stack
7	8 (3.40%)	Node.js
8	7 (2.98%)	HTML
8	7 (2.98%)	J2EE
8	7 (2.98%)	MLlib
8	7 (2.98%)	RESTful
8	7 (2.98%)	Web Services

Miscellaneous
1	57 (24.26%)	Analytical Skills
2	31 (13.19%)	Computer Science
3	22 (9.36%)	Virtual Team
4	18 (7.66%)	Algorithms
5	14 (5.96%)	Linux Command Line
6	10 (4.26%)	Data Structures
6	10 (4.26%)	Greenfield Project
6	10 (4.26%)	Replication
7	9 (3.83%)	Foreign Exchange (FX)
8	7 (2.98%)	Social Network
9	5 (2.13%)	Clustering
9	5 (2.13%)	Derivative
10	4 (1.70%)	Data Centre
10	4 (1.70%)	Fintech
10	4 (1.70%)	Fixed Income
10	4 (1.70%)	Management Information System
11	3 (1.28%)	Security Operations Centre
12	2 (0.85%)	Grid Computing
12	2 (0.85%)	Reference Data
12	2 (0.85%)	User Experience

Operating Systems
1	63 (26.81%)	Linux
2	31 (13.19%)	Unix
3	4 (1.70%)	Red Hat Enterprise Linux
4	3 (1.28%)	CoreOS
5	2 (0.85%)	Windows
6	1 (0.43%)	Mesosphere
6	1 (0.43%)	Ubuntu

Processes & Methodologies
1	101 (42.98%)	MapReduce
2	83 (35.32%)	Agile Software Development
3	75 (31.91%)	Analytics
4	43 (18.30%)	ETL
5	31 (13.19%)	E-Commerce
6	29 (12.34%)	Mentoring
7	27 (11.49%)	Machine Learning
7	27 (11.49%)	TDD
8	25 (10.64%)	Data Architecture
8	25 (10.64%)	Open Source
9	24 (10.21%)	Software Engineering
10	23 (9.79%)	Business Intelligence
10	23 (9.79%)	Stakeholder Management
10	23 (9.79%)	Visualisation
11	20 (8.51%)	OO
12	19 (8.09%)	BDD
12	19 (8.09%)	Data Analytics
13	18 (7.66%)	Data Management
14	17 (7.23%)	DevOps
14	17 (7.23%)	Scrum

Programming Languages
1	136 (57.87%)	Java
2	86 (36.60%)	Python
3	68 (28.94%)	Scala
4	63 (26.81%)	SQL
5	21 (8.94%)	C++
6	18 (7.66%)	JavaScript
6	18 (7.66%)	R
7	17 (7.23%)	T-SQL
8	15 (6.38%)	PHP
8	15 (6.38%)	Ruby
9	13 (5.53%)	Shell Script
10	12 (5.11%)	Perl
11	10 (4.26%)	C
11	10 (4.26%)	C#
12	6 (2.55%)	Bash Shell
13	5 (2.13%)	PL/SQL
14	3 (1.28%)	F#
14	3 (1.28%)	PHP 5
14	3 (1.28%)	PHP 7
15	2 (0.85%)	Go

Qualifications
1	34 (14.47%)	Degree
2	17 (7.23%)	PhD
3	13 (5.53%)	Computer Science Degree
4	10 (4.26%)	Postgraduate
5	5 (2.13%)	CISSP
6	3 (1.28%)	CEH
6	3 (1.28%)	GCIH
6	3 (1.28%)	OSCP
7	2 (0.85%)	Numerate Degree
7	2 (0.85%)	OCA
7	2 (0.85%)	OCP
7	2 (0.85%)	Oracle Certification
8	1 (0.43%)	CBAP
8	1 (0.43%)	IIBA
8	1 (0.43%)	Security Cleared

Quality Assurance & Compliance
1	11 (4.68%)	QA
2	7 (2.98%)	GCP
3	5 (2.13%)	Data Quality
4	2 (0.85%)	SLA
5	1 (0.43%)	Basel III
5	1 (0.43%)	Dodd-Frank
5	1 (0.43%)	GPG13
5	1 (0.43%)	ISO/IEC 27001

System Software
1	34 (14.47%)	Apache Flume
2	22 (9.36%)	Apache ZooKeeper
3	13 (5.53%)	Docker
4	6 (2.55%)	VMware Infrastructure
5	3 (1.28%)	Snort
5	3 (1.28%)	VirtualBox
6	2 (0.85%)	Oracle RAC
7	1 (0.43%)	Cronacle
7	1 (0.43%)	vCloud
7	1 (0.43%)	Xen

Systems Management
1	53 (22.55%)	Oozie
2	25 (10.64%)	Hadoop YARN
3	15 (6.38%)	Ansible
4	14 (5.96%)	Ambari
5	13 (5.53%)	Puppet
6	12 (5.11%)	Opscode Chef
7	8 (3.40%)	Terraform
8	6 (2.55%)	Graphite
8	6 (2.55%)	Kubernetes
8	6 (2.55%)	Mesos
9	5 (2.13%)	Kibana
9	5 (2.13%)	logstash
10	4 (1.70%)	Nagios
10	4 (1.70%)	Salt
11	3 (1.28%)	Fluentd
11	3 (1.28%)	QRadar
11	3 (1.28%)	ZABBIX
12	1 (0.43%)	Consul
12	1 (0.43%)	CSIRT
12	1 (0.43%)	Rancher

Vendors
1	48 (20.43%)	Hortonworks
2	43 (18.30%)	Cloudera
3	31 (13.19%)	MapR
4	22 (9.36%)	Oracle
5	13 (5.53%)	Google
6	10 (4.26%)	Tableau
7	7 (2.98%)	IBM
7	7 (2.98%)	Talend
8	6 (2.55%)	Red Hat
8	6 (2.55%)	Splunk
8	6 (2.55%)	VMware
9	5 (2.13%)	Greenplum
9	5 (2.13%)	Vertica
10	4 (1.70%)	Alteryx
11	3 (1.28%)	LogRhythm
11	3 (1.28%)	New Relic
11	3 (1.28%)	Rackspace
11	3 (1.28%)	SaltStack
11	3 (1.28%)	Sourcefire
11	3 (1.28%)	TippingPoint