The table below looks at the statistics for HDFS skills in IT contracts advertised for the England region. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 2 December 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
2 Dec 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 439 530 594
Rank change year-on-year
+91 +64
Contract jobs citing HDFS 171 89 36
As % of all contract IT jobs located in England 0.37% 0.18% 0.068%
As % of the System Software category 2.91% 1.76% 0.67%
Number of daily rates quoted 88 53 17
Median daily rate £575 £625 £525
Median daily rate % change year-on-year
-8.00% +19.04%
90% offered a daily rate of more than £408 £450 £427
10% offered a daily rate of more than £680 £650 £775
UK excluding London median daily rate £498 £588 £525
% change year-on-year
-15.31% +11.90%
Number of hourly rates quoted 0 1 0
Median hourly rate - £37.50 -
UK excluding London median hourly rate - - -
HDFS
UK

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised in the England region.

System Software Category
England
Contract IT job ads with a match in the
System Software category
5883 5054 5410
As % of all contract IT jobs located in England 12.68% 9.94% 10.25%
Number of daily rates quoted 3658 2970 2989
Median daily rate £400 £388 £355
Median daily rate % change year-on-year
+3.22% +9.15%
90% offered a daily rate of more than £195 £175 £176
10% offered a daily rate of more than £575 £550 £500
UK excluding London median daily rate £350 £348 £340
% change year-on-year
+0.71% +2.20%
Number of hourly rates quoted 430 591 686
Median hourly rate £16.50 £16.50 £16.50
90% offered a hourly rate of more than £11.18 £10.50 £11.00
10% offered a hourly rate of more than £49.46 £41.40 £32.40
UK excluding London median hourly rate £16.00 £16.00 £17.00
% change year-on-year
- -5.88%

HDFS
Jobs Demand Trend in England

The demand trend of contract jobs across the England region citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in England

HDFS
Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS across the England region.

HDFS Daily Rate Trend in England

HDFS
Daily Rate Histogram in England

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS across the England region over the 3 months to 2 December 2016.

HDFS Daily Rate Histogram in England

HDFS
Hourly Rate Trend in England

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS across the England region.

HDFS Hourly Rate Trend in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 3 months to 2 December 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +53 128 £580 -10.76% 18
South East +54 29 £494 +30.00%
Yorkshire +25 8 £485 -17.44%
West Midlands -29 2 - -
North West +6 1 £575 -4.16% 4
South West - 1 - - 1
East of England - 1 - -
East Midlands - 1 - -
HDFS
UK

HDFS
Top 30 Related IT Skills in England

For the 6 months to 2 December 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the England region with a requirement for HDFS.

1 278 (98.23%) Hadoop
2 244 (86.22%) Big Data
3 195 (68.90%) Apache Hive
4 182 (64.31%) Apache Spark
5 155 (54.77%) HBase
6 151 (53.36%) Java
7 122 (43.11%) Linux
8 112 (39.58%) Python
9 101 (35.69%) MapReduce
10 96 (33.92%) Scala
11 91 (32.16%) Apache Pig
12 85 (30.04%) Hadoop YARN
13 83 (29.33%) Cloudera
14 82 (28.98%) SQL
15 79 (27.92%) Sqoop
16 76 (26.86%) Kafka
17 74 (26.15%) Agile Software Development
18 69 (24.38%) Unix
19 68 (24.03%) Hortonworks
19 68 (24.03%) DevOps
20 66 (23.32%) Amazon AWS
21 64 (22.61%) NoSQL
22 61 (21.55%) Continuous Integration
22 61 (21.55%) ETL
23 56 (19.79%) Finance
24 55 (19.43%) Scrum
25 52 (18.37%) Apache Cassandra
26 51 (18.02%) Apache Flume
26 51 (18.02%) Banking
27 48 (16.96%) Puppet

HDFS
Top Related IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 182 (64.31%) Apache Spark
2 91 (32.16%) Apache Pig
3 36 (12.72%) Apache
4 29 (10.25%) Elasticsearch
5 20 (7.07%) Apache Solr
6 12 (4.24%) SAS
7 7 (2.47%) Cloud Foundry
7 7 (2.47%) GemFire
7 7 (2.47%) Oracle Coherence
7 7 (2.47%) Tomcat
8 6 (2.12%) Confluence
8 6 (2.12%) Jupyter
9 2 (0.71%) OpenStack
Applications
1 2 (0.71%) MS Excel
2 1 (0.35%) Stata
Business Applications
1 2 (0.71%) SAP Oil and Gas
Cloud Services
1 66 (23.32%) Amazon AWS
2 16 (5.65%) Microsoft Azure
3 15 (5.30%) Cloud Computing
4 14 (4.95%) GitHub
5 6 (2.12%) Google Cloud Platform
5 6 (2.12%) Office 365
5 6 (2.12%) PaaS
6 4 (1.41%) Amazon EMR
7 3 (1.06%) Amazon S3
8 2 (0.71%) IBM Cloud
9 1 (0.35%) Amazon EC2
9 1 (0.35%) CloudFront
9 1 (0.35%) Flurry Analytics
9 1 (0.35%) Google Analytics
9 1 (0.35%) IaaS
9 1 (0.35%) Sumo Logic
Communications & Networking
1 37 (13.07%) Kerberos
2 9 (3.18%) LAN
2 9 (3.18%) WAN
3 7 (2.47%) FTP
4 5 (1.77%) Network Security
5 2 (0.71%) Internet
5 2 (0.71%) LDAP
6 1 (0.35%) DNS
6 1 (0.35%) HTTP
6 1 (0.35%) TCP/IP
Database & Business Intelligence
1 278 (98.23%) Hadoop
2 244 (86.22%) Big Data
3 195 (68.90%) Apache Hive
4 155 (54.77%) HBase
5 79 (27.92%) Sqoop
6 64 (22.61%) NoSQL
7 52 (18.37%) Apache Cassandra
8 38 (13.43%) Impala
9 34 (12.01%) Data Warehouse
10 28 (9.89%) MongoDB
11 25 (8.83%) SQL Server
12 24 (8.48%) Data Lake
12 24 (8.48%) Relational Database
13 22 (7.77%) MySQL
14 19 (6.71%) PostgreSQL
15 15 (5.30%) Cloudera CDH
15 15 (5.30%) QlikView
16 11 (3.89%) Apache Accumulo
16 11 (3.89%) Apache Zeppelin
16 11 (3.89%) BusinessObjects
Development Applications
1 31 (10.95%) Jenkins
2 29 (10.25%) Git (software)
3 25 (8.83%) Maven
4 10 (3.53%) JIRA
4 10 (3.53%) JUnit
5 7 (2.47%) Eclipse
5 7 (2.47%) Selenium
5 7 (2.47%) TeamCity
6 6 (2.12%) Artifactory
6 6 (2.12%) Bundler
6 6 (2.12%) FindBugs
6 6 (2.12%) Gradle
6 6 (2.12%) Jasmine
6 6 (2.12%) Karma Test Runner
6 6 (2.12%) Protractor
6 6 (2.12%) Sonatype Nexus
6 6 (2.12%) WebDriver
7 5 (1.77%) gulp
8 4 (1.41%) Cucumber
8 4 (1.41%) PHPUnit
General
1 56 (19.79%) Finance
2 51 (18.02%) Banking
3 17 (6.01%) Front Office
4 15 (5.30%) Investment Banking
5 7 (2.47%) Retail
6 6 (2.12%) Marketing
7 4 (1.41%) Financial Institution
7 4 (1.41%) Telecoms
8 3 (1.06%) Legal
9 2 (0.71%) Electronics
9 2 (0.71%) Manufacturing
10 1 (0.35%) Advertising
10 1 (0.35%) Games
10 1 (0.35%) Law
Job Titles
1 82 (28.98%) Developer
2 69 (24.38%) Big Data Engineer
3 66 (23.32%) Data Engineer
4 47 (16.61%) Big Data Developer
5 43 (15.19%) Hadoop Developer
6 35 (12.37%) Administrator
7 33 (11.66%) Hadoop Engineer
8 30 (10.60%) Architect
9 28 (9.89%) DevOps Engineer
9 28 (9.89%) Scala Developer
10 21 (7.42%) Data Architect
11 20 (7.07%) Consultant
11 20 (7.07%) Data Administrator
12 19 (6.71%) Big Data Architect
13 18 (6.36%) Java Developer
14 17 (6.01%) Hadoop Administrator
15 15 (5.30%) Technical Leader
16 14 (4.95%) Apache Spark Developer
17 13 (4.59%) Big Data Consultant
17 13 (4.59%) Hadoop Consultant
Libraries, Frameworks & Software Standards
1 76 (26.86%) Kafka
2 22 (7.77%) Spark Streaming
3 18 (6.36%) ELK Stack
4 17 (6.01%) Akka
5 15 (5.30%) REST
6 11 (3.89%) Apache Tez
7 10 (3.53%) JSON
8 9 (3.18%) Apache Avro
8 9 (3.18%) MLlib
9 8 (2.83%) AngularJS
9 8 (2.83%) Oracle GoldenGate
9 8 (2.83%) Play Framework
10 7 (2.47%) D3.js
10 7 (2.47%) spray
10 7 (2.47%) Spring
11 6 (2.12%) Browserify
11 6 (2.12%) J2EE
11 6 (2.12%) JMS
11 6 (2.12%) Spring Boot
11 6 (2.12%) Spring Integration
Miscellaneous
1 25 (8.83%) Computer Science
2 16 (5.65%) Grid Computing
3 13 (4.59%) Visualisation
4 10 (3.53%) Analytical Skills
5 9 (3.18%) Foreign Exchange (FX)
6 8 (2.83%) Management Information System
7 6 (2.12%) Algorithms
8 5 (1.77%) Interest Rate Derivative
8 5 (1.77%) Mathematics
9 4 (1.41%) Data Centre
9 4 (1.41%) Market Risk
9 4 (1.41%) Virtual Team
10 3 (1.06%) Clustering
10 3 (1.06%) Equities
10 3 (1.06%) Fixed Income
10 3 (1.06%) Replication
11 2 (0.71%) Data Structures
11 2 (0.71%) Statistics
12 1 (0.35%) PKI
12 1 (0.35%) Public Cloud
Operating Systems
1 122 (43.11%) Linux
2 69 (24.38%) Unix
3 19 (6.71%) Red Hat Enterprise Linux
4 5 (1.77%) Windows
5 2 (0.71%) CentOS
6 1 (0.35%) CoreOS
6 1 (0.35%) Ubuntu
Processes & Methodologies
1 101 (35.69%) MapReduce
2 74 (26.15%) Agile Software Development
3 68 (24.03%) DevOps
4 61 (21.55%) Continuous Integration
4 61 (21.55%) ETL
5 55 (19.43%) Scrum
6 39 (13.78%) Analytics
6 39 (13.78%) TDD
7 38 (13.43%) Open Source
8 35 (12.37%) Continuous Delivery
9 33 (11.66%) User Stories
10 28 (9.89%) Business Intelligence
11 27 (9.54%) Build Automation
12 23 (8.13%) Software Engineering
13 22 (7.77%) Data Modelling
14 21 (7.42%) Data Architecture
15 20 (7.07%) Performance Tuning
16 19 (6.71%) BDD
16 19 (6.71%) High Availability
17 18 (6.36%) Stakeholder Management
Programming Languages
1 151 (53.36%) Java
2 112 (39.58%) Python
3 96 (33.92%) Scala
4 82 (28.98%) SQL
5 35 (12.37%) Shell Script
6 25 (8.83%) R
7 16 (5.65%) Perl
8 15 (5.30%) Bash Shell
9 14 (4.95%) C
10 12 (4.24%) Ruby
11 9 (3.18%) C++
12 5 (1.77%) PL/SQL
13 4 (1.41%) MATLAB
14 3 (1.06%) HiveQL
14 3 (1.06%) JavaScript
15 2 (0.71%) PHP
16 1 (0.35%) ABAP
16 1 (0.35%) Go
Qualifications
1 34 (12.01%) Security Cleared
2 27 (9.54%) Degree
3 23 (8.13%) SC Cleared
4 18 (6.36%) DV Cleared
5 17 (6.01%) BPSS Clearance
6 2 (0.71%) PhD
Quality Assurance & Compliance
1 13 (4.59%) QA
2 7 (2.47%) SLA
3 3 (1.06%) Data Quality
4 2 (0.71%) Disclosure Scotland
System Software
1 51 (18.02%) Apache Flume
2 37 (13.07%) Apache ZooKeeper
3 30 (10.60%) VMware Infrastructure
4 29 (10.25%) vCloud
5 10 (3.53%) Active Directory
6 9 (3.18%) Oracle RAC
7 6 (2.12%) Docker
8 2 (0.71%) Btrfs
8 2 (0.71%) Ceph
9 1 (0.35%) VirtualBox
Systems Management
1 85 (30.04%) Hadoop YARN
2 48 (16.96%) Puppet
3 46 (16.25%) Oozie
4 22 (7.77%) Ambari
5 16 (5.65%) Ansible
6 14 (4.95%) Kibana
7 13 (4.59%) Nagios
8 10 (3.53%) logstash
9 6 (2.12%) Opscode Chef
10 5 (1.77%) Control-M
10 5 (1.77%) Grafana
10 5 (1.77%) Graphite
10 5 (1.77%) Kubernetes
10 5 (1.77%) Terraform
11 4 (1.41%) Mesos
12 3 (1.06%) Salt
13 2 (0.71%) SCOM
13 2 (0.71%) ZABBIX
14 1 (0.35%) Ganglia
Vendors
1 83 (29.33%) Cloudera
2 68 (24.03%) Hortonworks
3 30 (10.60%) VMware
4 26 (9.19%) Oracle
5 18 (6.36%) Red Hat
6 16 (5.65%) Teradata
7 13 (4.59%) Tableau
8 12 (4.24%) Informatica
9 9 (3.18%) Cisco
9 9 (3.18%) SaltStack
10 8 (2.83%) IBM
11 7 (2.47%) Google
11 7 (2.47%) SAP
12 4 (1.41%) Ab Initio
12 4 (1.41%) Netezza
12 4 (1.41%) Splunk
13 3 (1.06%) MapR
13 3 (1.06%) MicroStrategy
13 3 (1.06%) Talend
14 2 (0.71%) GoldenSource
City, London
E-synergy Solutions
Rate: £550 - £600 per annum
Posted: Yesterday
Somerset
Spring Technology
Rate: £350.00 - £359.00 per day + + SC Clearance
Posted: 2 days ago
South East London
GridCell
Rate: From £500 to £700 per day (Depending on experience)
Posted: 16 days ago