The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 3 months to 27 March 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

3 months to
27 Mar 2017
Same period 2016 Same period 2015
Hadoop Distributed File System (HDFS)
UK / England
Rank 427 545 535
Rank change year-on-year +118 -10  
Contract jobs citing HDFS 140 70 69
As % of all contract IT jobs advertised in England 0.34% 0.14% 0.14%
As % of the System Software category 3.02% 1.32% 1.34%
Number of daily rates quoted 98 54 54
Median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% -  
90% offered a daily rate of more than £400 £375 £434
10% offered a daily rate of more than £650 £650 £725
UK excluding London median daily rate £450 £450 £525
% change year-on-year - -14.28%  
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate - - -

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

Contract System Software Skills
England
Contract job vacancies with a requirement for system software skills 4643 5318 5149
As % of all contract IT job vacancies advertised in England 11.20% 10.84% 10.50%
Number of daily rates quoted 2964 3276 2847
Median daily rate £413 £395 £375
Median daily rate % change year-on-year +4.43% +5.33%  
90% offered a daily rate of more than £200 £200 £190
10% offered a daily rate of more than £575 £538 £525
UK excluding London median daily rate £351 £365 £350
% change year-on-year -3.97% +4.28%  
Number of hourly rates quoted 313 428 606
Median hourly rate £16.50 £16.50 £16.50
90% offered a hourly rate of more than £10.31 £11.00 £11.00
10% offered a hourly rate of more than £45.00 £45.00 £31.50
UK excluding London median hourly rate £15.82 £16.50 £15.85
% change year-on-year -4.13% +4.10%  

HDFS
Job Vacancy Trend in England

The job posting trend of jobs advertised in England citing HDFS as a proportion of all contract or permanent IT jobs with a match in the System Software category.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in England.

Contractor daily rate trend for HDFS in England

HDFS
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing HDFS in England over the 3 months to 27 March 2017.

Contractor daily rate histogram for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 3 months to 27 March 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +88 113 £575 +6.97% 12
South East +28 18 £351 +3.85% 2
North West +24 3 £310 -31.11% 1
Yorkshire - 3 £475 - 1
South West +5 2 £483 - 1
East Midlands - 2 £525 -
East of England - 1 £400 - 2
HDFS
UK

HDFS
Top 30 Related IT Skills in England

For the 6 months to 27 March 2017, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the England region with a requirement for HDFS.

1 282 (98.95%) Hadoop
2 234 (82.11%) Big Data
3 200 (70.18%) Apache Hive
4 187 (65.61%) Apache Spark
5 169 (59.30%) HBase
6 144 (50.53%) Java
7 132 (46.32%) Linux
8 114 (40.00%) Python
9 103 (36.14%) Scala
9 103 (36.14%) DevOps
10 101 (35.44%) Kafka
11 98 (34.39%) Hadoop YARN
12 87 (30.53%) Apache Pig
12 87 (30.53%) MapReduce
13 86 (30.18%) Agile Software Development
14 77 (27.02%) Cloudera
15 69 (24.21%) Finance
15 69 (24.21%) Banking
16 68 (23.86%) Hortonworks
17 67 (23.51%) Puppet
18 66 (23.16%) Amazon AWS
19 63 (22.11%) Unix
20 62 (21.75%) Sqoop
21 61 (21.40%) Oozie
22 59 (20.70%) SQL
22 59 (20.70%) Continuous Integration
23 55 (19.30%) NoSQL
24 54 (18.95%) Ansible
25 52 (18.25%) Impala
25 52 (18.25%) ETL

HDFS
Top Related IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 187 (65.61%) Apache Spark
2 87 (30.53%) Apache Pig
3 35 (12.28%) Apache
4 25 (8.77%) Apache Solr
5 23 (8.07%) Elasticsearch
6 7 (2.46%) OpenStack
6 7 (2.46%) SAS
7 6 (2.11%) Jupyter
8 5 (1.75%) Tomcat
9 4 (1.40%) Confluence
10 3 (1.05%) Cloud Foundry
11 2 (0.70%) GemFire
11 2 (0.70%) JBoss
11 2 (0.70%) WebSphere
12 1 (0.35%) Adobe Experience Manager
12 1 (0.35%) CMS
12 1 (0.35%) Mule
12 1 (0.35%) Oracle Coherence
Applications
1 1 (0.35%) MS Excel
Business Applications
1 2 (0.70%) SAP Oil and Gas
2 1 (0.35%) SAP S/4HANA
Cloud Services
1 66 (23.16%) Amazon AWS
2 19 (6.67%) Amazon S3
3 14 (4.91%) Amazon EC2
4 12 (4.21%) Amazon EMR
4 12 (4.21%) Cloud Computing
4 12 (4.21%) Google Cloud Platform
5 10 (3.51%) IaaS
6 7 (2.46%) Virtual Private Cloud
7 6 (2.11%) Microsoft Azure
8 5 (1.75%) Amazon CloudWatch
8 5 (1.75%) Amazon ELB
8 5 (1.75%) AWS CloudFormation
8 5 (1.75%) Loggly
8 5 (1.75%) Sumo Logic
9 4 (1.40%) PaaS
10 3 (1.05%) GitHub
11 2 (0.70%) IBM Cloud
Communications & Networking
1 38 (13.33%) Kerberos
2 9 (3.16%) LDAP
2 9 (3.16%) Network Security
3 6 (2.11%) HTTP
3 6 (2.11%) SSL
4 5 (1.75%) DNS
4 5 (1.75%) Internet
5 4 (1.40%) FTP
6 2 (0.70%) Firewall
6 2 (0.70%) LAN
6 2 (0.70%) WAN
7 1 (0.35%) TCP/IP
7 1 (0.35%) tcpdump
7 1 (0.35%) Wireshark
Database & Business Intelligence
1 282 (98.95%) Hadoop
2 234 (82.11%) Big Data
3 200 (70.18%) Apache Hive
4 169 (59.30%) HBase
5 62 (21.75%) Sqoop
6 55 (19.30%) NoSQL
7 52 (18.25%) Impala
8 44 (15.44%) Apache Cassandra
9 38 (13.33%) MySQL
10 28 (9.82%) Relational Database
11 25 (8.77%) PostgreSQL
12 24 (8.42%) Data Warehouse
12 24 (8.42%) MongoDB
13 18 (6.32%) QlikView
14 17 (5.96%) Neo4j
15 16 (5.61%) RDBMS
16 13 (4.56%) DB2
17 12 (4.21%) Data Lake
18 10 (3.51%) Apache Zeppelin
18 10 (3.51%) Cloudera CDH
Development Applications
1 33 (11.58%) Jenkins
2 27 (9.47%) Git (software)
3 15 (5.26%) Maven
4 6 (2.11%) JIRA
4 6 (2.11%) Vagrant
4 6 (2.11%) webpack
5 5 (1.75%) Gradle
5 5 (1.75%) Grunt
5 5 (1.75%) JUnit
6 4 (1.40%) Selenium
6 4 (1.40%) Sonatype Nexus
6 4 (1.40%) Talend Open Studio
7 3 (1.05%) Bundler
7 3 (1.05%) Jasmine
7 3 (1.05%) Karma Test Runner
7 3 (1.05%) Protractor
7 3 (1.05%) Subversion
7 3 (1.05%) TeamCity
7 3 (1.05%) WebDriver
8 2 (0.70%) Mockito
General
1 69 (24.21%) Banking
1 69 (24.21%) Finance
2 20 (7.02%) Front Office
3 13 (4.56%) Investment Banking
4 10 (3.51%) Marketing
5 5 (1.75%) Retail
6 4 (1.40%) Telecoms
7 3 (1.05%) Financial Institution
8 2 (0.70%) Electronics
8 2 (0.70%) Law
8 2 (0.70%) Manufacturing
9 1 (0.35%) Advertising
9 1 (0.35%) Billing
9 1 (0.35%) Legal
Job Titles
1 85 (29.82%) Developer
2 61 (21.40%) Big Data Engineer
3 55 (19.30%) Data Engineer
4 47 (16.49%) Big Data Developer
5 45 (15.79%) Administrator
6 37 (12.98%) DevOps Engineer
7 35 (12.28%) Hadoop Engineer
8 33 (11.58%) Hadoop Developer
9 31 (10.88%) Hadoop Administrator
10 28 (9.82%) Consultant
11 21 (7.37%) Hadoop Consultant
12 20 (7.02%) Scala Developer
13 15 (5.26%) Architect
13 15 (5.26%) Java Developer
14 14 (4.91%) Apache Spark Developer
15 11 (3.86%) Big Data Consultant
15 11 (3.86%) Data Administrator
15 11 (3.86%) Linux Administrator
15 11 (3.86%) Technical Leader
16 10 (3.51%) Data Architect
Libraries, Frameworks & Software Standards
1 101 (35.44%) Kafka
2 25 (8.77%) Spark Streaming
3 19 (6.67%) REST
4 15 (5.26%) HTML
5 14 (4.91%) HTML5
6 13 (4.56%) Elastic Stack
7 12 (4.21%) Spring
8 11 (3.86%) AngularJS
9 10 (3.51%) Apache Avro
9 10 (3.51%) Node.js
10 9 (3.16%) Middleware
11 6 (2.11%) CSS
11 6 (2.11%) CSS3
11 6 (2.11%) D3.js
11 6 (2.11%) jQuery
11 6 (2.11%) JSON
11 6 (2.11%) Lucene
11 6 (2.11%) Web Services
11 6 (2.11%) WebSockets
11 6 (2.11%) XML
Miscellaneous
1 27 (9.47%) Computer Science
2 17 (5.96%) Foreign Exchange (FX)
3 14 (4.91%) Algorithms
4 10 (3.51%) Grid Computing
5 9 (3.16%) Analytical Skills
5 9 (3.16%) Derivative
6 6 (2.11%) Fintech
6 6 (2.11%) Fixed Income
6 6 (2.11%) Replication
7 5 (1.75%) Data Centre
7 5 (1.75%) User Experience
8 3 (1.05%) Linux Command Line
9 2 (0.70%) Clustering
9 2 (0.70%) Distributed Denial-of-Service
9 2 (0.70%) Equities
9 2 (0.70%) Equity Derivative
9 2 (0.70%) Management Information System
9 2 (0.70%) Virtual Team
10 1 (0.35%) Blog
10 1 (0.35%) Credit Risk
Operating Systems
1 132 (46.32%) Linux
2 63 (22.11%) Unix
3 28 (9.82%) Red Hat Enterprise Linux
4 11 (3.86%) Windows
5 7 (2.46%) Ubuntu
6 6 (2.11%) CentOS
7 5 (1.75%) CoreOS
7 5 (1.75%) Debian
7 5 (1.75%) Fedora
Processes & Methodologies
1 103 (36.14%) DevOps
2 87 (30.53%) MapReduce
3 86 (30.18%) Agile Software Development
4 59 (20.70%) Continuous Integration
5 52 (18.25%) ETL
6 45 (15.79%) Scrum
7 38 (13.33%) Continuous Delivery
8 37 (12.98%) TDD
9 33 (11.58%) Analytics
10 32 (11.23%) Open Source
11 25 (8.77%) Build Automation
11 25 (8.77%) Business Intelligence
12 22 (7.72%) User Stories
13 19 (6.67%) Data Engineering
13 19 (6.67%) Machine Learning
14 18 (6.32%) Capacity Planning
14 18 (6.32%) Performance Tuning
15 17 (5.96%) Microservices
15 17 (5.96%) Visualisation
16 16 (5.61%) Stakeholder Management
Programming Languages
1 144 (50.53%) Java
2 114 (40.00%) Python
3 103 (36.14%) Scala
4 59 (20.70%) SQL
5 30 (10.53%) Bash Shell
6 24 (8.42%) Shell Script
7 21 (7.37%) R
8 16 (5.61%) Ruby
9 15 (5.26%) JavaScript
10 12 (4.21%) Perl
11 6 (2.11%) C++
11 6 (2.11%) ES6
12 5 (1.75%) PHP
13 3 (1.05%) PL/SQL
13 3 (1.05%) T-SQL
14 2 (0.70%) C
14 2 (0.70%) C#
14 2 (0.70%) Korn
14 2 (0.70%) MATLAB
14 2 (0.70%) PowerShell
Qualifications
1 27 (9.47%) Degree
2 22 (7.72%) Security Cleared
3 16 (5.61%) SC Cleared
4 8 (2.81%) DV Cleared
5 4 (1.40%) BPSS Clearance
6 3 (1.05%) PhD
7 2 (0.70%) CISA
7 2 (0.70%) CISM
7 2 (0.70%) CISSP
8 1 (0.35%) ISTQB
8 1 (0.35%) ISTQB Foundation Certification
Quality Assurance & Compliance
1 16 (5.61%) QA
2 7 (2.46%) MiFID
3 5 (1.75%) Data Quality
4 3 (1.05%) SLA
5 2 (0.70%) FedRAMP
5 2 (0.70%) PCI DSS
6 1 (0.35%) Dodd-Frank
6 1 (0.35%) EMIR
System Software
1 47 (16.49%) Apache ZooKeeper
2 34 (11.93%) Apache Flume
3 25 (8.77%) Docker
4 22 (7.72%) VMware Infrastructure
5 16 (5.61%) Active Directory
5 16 (5.61%) vCloud
6 5 (1.75%) VirtualBox
7 3 (1.05%) Oracle RAC
8 2 (0.70%) vSphere
9 1 (0.35%) VMware ESXi
Systems Management
1 98 (34.39%) Hadoop YARN
2 67 (23.51%) Puppet
3 61 (21.40%) Oozie
4 54 (18.95%) Ansible
5 36 (12.63%) Opscode Chef
6 25 (8.77%) Nagios
6 25 (8.77%) Terraform
7 16 (5.61%) Ambari
8 14 (4.91%) Kubernetes
9 11 (3.86%) Mesos
10 10 (3.51%) Salt
11 8 (2.81%) Kibana
12 6 (2.11%) Grafana
12 6 (2.11%) Graphite
13 5 (1.75%) ZABBIX
14 4 (1.40%) logstash
15 1 (0.35%) Rancher
Vendors
1 77 (27.02%) Cloudera
2 68 (23.86%) Hortonworks
3 27 (9.47%) VMware
4 22 (7.72%) Oracle
5 21 (7.37%) Red Hat
6 16 (5.61%) SaltStack
7 15 (5.26%) Ab Initio
8 13 (4.56%) Google
8 13 (4.56%) Tableau
9 12 (4.21%) MicroStrategy
10 8 (2.81%) Splunk
11 7 (2.46%) Informatica
12 5 (1.75%) New Relic
12 5 (1.75%) Rackspace
12 5 (1.75%) Teradata
13 4 (1.40%) IBM
13 4 (1.40%) SAP
13 4 (1.40%) Talend
14 3 (1.05%) MapR
15 2 (0.70%) Alteryx
Taunton, Somerset
Experis Ltd
Rate: £350 - £400 per day
Posted: 4 days ago
City, London
Talent International
Rate: £350 - £500 per day
Posted: 6 days ago
London
TEKsystems
Rate: £550 - £650 per day
Posted: 6 days ago
Hampshire
Proactive Appointments
Rate: £440 - £450 per day
Posted: 6 days ago
Reading
People Source Consulting
Rate: £270 - £300 per day
Posted: 18 days ago