The following table provides summary statistics for contract job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 3 months to 27 March 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

3 months to
27 Mar 2017
Same period 2016 Same period 2015
Hadoop Distributed File System (HDFS)
UK
Rank 438 568 561
Rank change year-on-year +130 -7  
Contract jobs citing HDFS 145 72 70
As % of all contract IT jobs advertised in the UK 0.32% 0.14% 0.13%
As % of the System Software category 2.90% 1.24% 1.26%
Number of daily rates quoted 102 56 54
Median daily rate £543 £525 £525
Median daily rate % change year-on-year +3.33% -  
90% offered a daily rate of more than £403 £375 £434
10% offered a daily rate of more than £650 £650 £725
UK excluding London median daily rate £450 £450 £525
% change year-on-year - -14.28%  
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate - - -

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

Contract System Software Skills
UK
Contract job vacancies with a requirement for system software skills 5003 5786 5555
As % of all contract IT job vacancies advertised in the UK 11.14% 10.87% 10.28%
Number of daily rates quoted 3184 3510 3053
Median daily rate £400 £390 £375
Median daily rate % change year-on-year +2.56% +4.00%  
90% offered a daily rate of more than £193 £200 £185
10% offered a daily rate of more than £575 £525 £525
UK excluding London median daily rate £351 £365 £350
% change year-on-year -3.97% +4.28%  
Number of hourly rates quoted 349 448 638
Median hourly rate £16.75 £16.50 £16.50
Median hourly rate % change year-on-year +1.51% -  
90% offered a hourly rate of more than £10.50 £11.00 £11.00
10% offered a hourly rate of more than £47.00 £45.00 £34.10
UK excluding London median hourly rate £15.82 £16.50 £15.85
% change year-on-year -4.13% +4.10%  

HDFS
Job Vacancy Trend

The job posting trend of jobs advertised citing HDFS as a proportion of all contract or permanent IT jobs with a match in the System Software category.

Job vacancy trend for HDFS in the UK

HDFS
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS.

Contractor daily rate trend for HDFS in the UK

HDFS
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing HDFS over the 3 months to 27 March 2017.

Contractor daily rate histogram for HDFS in the UK

HDFS
Top 30 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 27 March 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +118 140 £550 +4.76% 20
London +88 113 £575 +6.97% 12
South East +28 18 £351 +3.85% 2
City of London +11 15 £590 +38.82% 3
Reading - 8 £475 - 1
Berkshire - 8 £475 - 1
Hampshire - 7 £351 - 1
North West +24 3 £310 -31.11% 1
Milton Keynes +3 3 £394 +21.15%
Buckinghamshire -6 3 £394 +21.15%
Leeds - 3 £475 - 1
West Yorkshire - 3 £475 - 1
Croydon - 3 £400 -
South Wales - 3 £500 -
Yorkshire - 3 £475 - 1
Wales - 3 £500 -
Scotland +23 2 £488 -30.35% 2
Edinburgh +21 2 £488 -30.35% 2
South West +5 2 £483 - 1
East Midlands - 2 £525 -
Farnborough - 2 - -
Manchester - 2 £235 - 1
Street - 2 £483 -
Newport - 2 £500 -
Somerset - 2 £483 - 1
Cheshire - 1 £420 -
Northamptonshire - 1 £525 -
Northampton - 1 £525 -
Heathrow - 1 £425 -
March - 1 £400 -

HDFS
Top 30 Related IT Skills

For the 6 months to 27 March 2017, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 289 (98.30%) Hadoop
2 240 (81.63%) Big Data
3 206 (70.07%) Apache Hive
4 194 (65.99%) Apache Spark
5 175 (59.52%) HBase
6 145 (49.32%) Java
7 134 (45.58%) Linux
8 118 (40.14%) Python
9 106 (36.05%) Scala
9 106 (36.05%) DevOps
10 105 (35.71%) Kafka
11 101 (34.35%) Hadoop YARN
12 90 (30.61%) Apache Pig
12 90 (30.61%) MapReduce
12 90 (30.61%) Agile Software Development
13 85 (28.91%) Cloudera
14 71 (24.15%) Finance
14 71 (24.15%) Banking
15 70 (23.81%) Hortonworks
16 69 (23.47%) Amazon AWS
17 68 (23.13%) Puppet
18 66 (22.45%) Oozie
19 64 (21.77%) Sqoop
20 63 (21.43%) Unix
21 60 (20.41%) SQL
22 59 (20.07%) Continuous Integration
23 57 (19.39%) NoSQL
24 54 (18.37%) Impala
24 54 (18.37%) Ansible
24 54 (18.37%) ETL

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 194 (65.99%) Apache Spark
2 90 (30.61%) Apache Pig
3 35 (11.90%) Apache
4 25 (8.50%) Apache Solr
4 25 (8.50%) Elasticsearch
5 7 (2.38%) Jupyter
5 7 (2.38%) OpenStack
5 7 (2.38%) SAS
6 5 (1.70%) Cloud Foundry
6 5 (1.70%) Tomcat
7 4 (1.36%) Confluence
8 2 (0.68%) Apache Airflow
8 2 (0.68%) GemFire
8 2 (0.68%) JBoss
8 2 (0.68%) WebSphere
9 1 (0.34%) Adobe Experience Manager
9 1 (0.34%) CMS
9 1 (0.34%) Mule
9 1 (0.34%) Oracle Coherence
Applications
1 1 (0.34%) MS Excel
Business Applications
1 2 (0.68%) SAP Oil and Gas
2 1 (0.34%) SAP S/4HANA
Cloud Services
1 69 (23.47%) Amazon AWS
2 21 (7.14%) Amazon S3
3 14 (4.76%) Amazon EC2
4 12 (4.08%) Amazon EMR
4 12 (4.08%) Cloud Computing
4 12 (4.08%) Google Cloud Platform
5 10 (3.40%) IaaS
6 7 (2.38%) Virtual Private Cloud
7 6 (2.04%) Microsoft Azure
8 5 (1.70%) Amazon CloudWatch
8 5 (1.70%) Amazon ELB
8 5 (1.70%) AWS CloudFormation
8 5 (1.70%) Loggly
8 5 (1.70%) Sumo Logic
9 4 (1.36%) PaaS
10 3 (1.02%) GitHub
11 2 (0.68%) IBM Cloud
Communications & Networking
1 40 (13.61%) Kerberos
2 9 (3.06%) LDAP
2 9 (3.06%) Network Security
3 6 (2.04%) HTTP
3 6 (2.04%) SSL
4 5 (1.70%) DNS
4 5 (1.70%) Internet
5 4 (1.36%) FTP
6 2 (0.68%) Firewall
6 2 (0.68%) LAN
6 2 (0.68%) WAN
7 1 (0.34%) TCP/IP
7 1 (0.34%) tcpdump
7 1 (0.34%) Wireshark
Database & Business Intelligence
1 289 (98.30%) Hadoop
2 240 (81.63%) Big Data
3 206 (70.07%) Apache Hive
4 175 (59.52%) HBase
5 64 (21.77%) Sqoop
6 57 (19.39%) NoSQL
7 54 (18.37%) Impala
8 46 (15.65%) Apache Cassandra
9 38 (12.93%) MySQL
10 28 (9.52%) Relational Database
11 26 (8.84%) Data Warehouse
11 26 (8.84%) MongoDB
12 25 (8.50%) PostgreSQL
13 18 (6.12%) QlikView
14 17 (5.78%) Neo4j
15 16 (5.44%) RDBMS
16 14 (4.76%) Data Lake
17 13 (4.42%) DB2
18 10 (3.40%) Apache Zeppelin
18 10 (3.40%) Cloudera CDH
Development Applications
1 35 (11.90%) Jenkins
2 27 (9.18%) Git (software)
3 15 (5.10%) Maven
4 6 (2.04%) JIRA
4 6 (2.04%) Vagrant
4 6 (2.04%) webpack
5 5 (1.70%) Gradle
5 5 (1.70%) Grunt
5 5 (1.70%) JUnit
6 4 (1.36%) Selenium
6 4 (1.36%) Sonatype Nexus
6 4 (1.36%) Talend Open Studio
7 3 (1.02%) Bundler
7 3 (1.02%) Jasmine
7 3 (1.02%) Karma Test Runner
7 3 (1.02%) Protractor
7 3 (1.02%) Subversion
7 3 (1.02%) TeamCity
7 3 (1.02%) WebDriver
8 2 (0.68%) Mockito
General
1 71 (24.15%) Banking
1 71 (24.15%) Finance
2 20 (6.80%) Front Office
3 13 (4.42%) Investment Banking
4 10 (3.40%) Marketing
5 7 (2.38%) Retail
6 4 (1.36%) Telecoms
7 3 (1.02%) Financial Institution
8 2 (0.68%) Electronics
8 2 (0.68%) Law
8 2 (0.68%) Manufacturing
9 1 (0.34%) Advertising
9 1 (0.34%) Billing
9 1 (0.34%) Legal
9 1 (0.34%) Retail Banking
Job Titles
1 88 (29.93%) Developer
2 62 (21.09%) Big Data Engineer
3 56 (19.05%) Data Engineer
4 47 (15.99%) Big Data Developer
5 45 (15.31%) Administrator
6 37 (12.59%) DevOps Engineer
7 35 (11.90%) Hadoop Engineer
8 33 (11.22%) Hadoop Developer
9 31 (10.54%) Hadoop Administrator
10 28 (9.52%) Consultant
11 22 (7.48%) Scala Developer
12 21 (7.14%) Hadoop Consultant
13 20 (6.80%) Architect
14 15 (5.10%) Apache Spark Developer
14 15 (5.10%) Java Developer
15 14 (4.76%) Data Architect
16 13 (4.42%) Big Data Architect
17 11 (3.74%) Big Data Consultant
17 11 (3.74%) Hadoop Architect
17 11 (3.74%) Linux Administrator
Libraries, Frameworks & Software Standards
1 105 (35.71%) Kafka
2 25 (8.50%) Spark Streaming
3 19 (6.46%) REST
4 15 (5.10%) HTML
5 14 (4.76%) HTML5
6 13 (4.42%) Elastic Stack
7 12 (4.08%) Spring
8 11 (3.74%) AngularJS
9 10 (3.40%) Apache Avro
9 10 (3.40%) Node.js
10 9 (3.06%) Middleware
11 6 (2.04%) Akka
11 6 (2.04%) CSS
11 6 (2.04%) CSS3
11 6 (2.04%) jQuery
11 6 (2.04%) JSON
11 6 (2.04%) Lucene
11 6 (2.04%) Web Services
11 6 (2.04%) WebSockets
11 6 (2.04%) XML
Miscellaneous
1 27 (9.18%) Computer Science
2 17 (5.78%) Foreign Exchange (FX)
3 15 (5.10%) Algorithms
4 10 (3.40%) Grid Computing
5 9 (3.06%) Analytical Skills
5 9 (3.06%) Derivative
6 6 (2.04%) Fintech
6 6 (2.04%) Fixed Income
6 6 (2.04%) Replication
7 5 (1.70%) Data Centre
7 5 (1.70%) User Experience
8 3 (1.02%) Linux Command Line
9 2 (0.68%) Clustering
9 2 (0.68%) Distributed Denial-of-Service
9 2 (0.68%) Equities
9 2 (0.68%) Equity Derivative
9 2 (0.68%) Management Information System
9 2 (0.68%) Virtual Team
10 1 (0.34%) Blog
10 1 (0.34%) Credit Risk
Operating Systems
1 134 (45.58%) Linux
2 63 (21.43%) Unix
3 28 (9.52%) Red Hat Enterprise Linux
4 11 (3.74%) Windows
5 7 (2.38%) Ubuntu
6 6 (2.04%) CentOS
7 5 (1.70%) CoreOS
7 5 (1.70%) Debian
7 5 (1.70%) Fedora
Processes & Methodologies
1 106 (36.05%) DevOps
2 90 (30.61%) Agile Software Development
2 90 (30.61%) MapReduce
3 59 (20.07%) Continuous Integration
4 54 (18.37%) ETL
5 46 (15.65%) Scrum
6 38 (12.93%) Continuous Delivery
6 38 (12.93%) TDD
7 33 (11.22%) Analytics
7 33 (11.22%) Open Source
8 26 (8.84%) Business Intelligence
9 25 (8.50%) Build Automation
10 22 (7.48%) User Stories
11 19 (6.46%) Capacity Planning
11 19 (6.46%) Data Engineering
11 19 (6.46%) Machine Learning
11 19 (6.46%) Performance Tuning
12 17 (5.78%) Microservices
12 17 (5.78%) Visualisation
13 16 (5.44%) Stakeholder Management
Programming Languages
1 145 (49.32%) Java
2 118 (40.14%) Python
3 106 (36.05%) Scala
4 60 (20.41%) SQL
5 30 (10.20%) Bash Shell
6 24 (8.16%) Shell Script
7 23 (7.82%) R
8 17 (5.78%) JavaScript
9 16 (5.44%) Ruby
10 12 (4.08%) Perl
11 6 (2.04%) C++
11 6 (2.04%) ES6
12 5 (1.70%) PHP
13 3 (1.02%) PL/SQL
13 3 (1.02%) T-SQL
14 2 (0.68%) C
14 2 (0.68%) C#
14 2 (0.68%) Korn
14 2 (0.68%) MATLAB
14 2 (0.68%) PowerShell
Qualifications
1 27 (9.18%) Degree
2 22 (7.48%) Security Cleared
3 16 (5.44%) SC Cleared
4 8 (2.72%) DV Cleared
5 4 (1.36%) BPSS Clearance
6 3 (1.02%) PhD
7 2 (0.68%) CISA
7 2 (0.68%) CISM
7 2 (0.68%) CISSP
8 1 (0.34%) ISTQB
8 1 (0.34%) ISTQB Foundation Certification
Quality Assurance & Compliance
1 17 (5.78%) QA
2 7 (2.38%) MiFID
3 6 (2.04%) Data Quality
4 3 (1.02%) SLA
5 2 (0.68%) FedRAMP
5 2 (0.68%) PCI DSS
6 1 (0.34%) Dodd-Frank
6 1 (0.34%) EMIR
System Software
1 47 (15.99%) Apache ZooKeeper
2 36 (12.24%) Apache Flume
3 25 (8.50%) Docker
4 22 (7.48%) VMware Infrastructure
5 16 (5.44%) Active Directory
5 16 (5.44%) vCloud
6 5 (1.70%) VirtualBox
7 3 (1.02%) Oracle RAC
8 2 (0.68%) vSphere
9 1 (0.34%) VMware ESXi
Systems Management
1 101 (34.35%) Hadoop YARN
2 68 (23.13%) Puppet
3 66 (22.45%) Oozie
4 54 (18.37%) Ansible
5 37 (12.59%) Opscode Chef
6 25 (8.50%) Nagios
6 25 (8.50%) Terraform
7 17 (5.78%) Ambari
8 14 (4.76%) Kubernetes
9 11 (3.74%) Mesos
10 10 (3.40%) Salt
11 8 (2.72%) Kibana
12 6 (2.04%) Grafana
12 6 (2.04%) Graphite
13 5 (1.70%) ZABBIX
14 4 (1.36%) logstash
15 1 (0.34%) Rancher
Vendors
1 85 (28.91%) Cloudera
2 70 (23.81%) Hortonworks
3 27 (9.18%) VMware
4 22 (7.48%) Oracle
5 21 (7.14%) Red Hat
6 16 (5.44%) SaltStack
7 15 (5.10%) Ab Initio
8 13 (4.42%) Google
8 13 (4.42%) Tableau
9 12 (4.08%) MicroStrategy
10 11 (3.74%) Splunk
11 7 (2.38%) Informatica
12 5 (1.70%) New Relic
12 5 (1.70%) Rackspace
12 5 (1.70%) Teradata
13 4 (1.36%) IBM
13 4 (1.36%) SAP
13 4 (1.36%) Talend
14 3 (1.02%) MapR
15 2 (0.68%) Alteryx
Taunton, Somerset
Experis Ltd
Rate: £350 - £400 per day
Posted: 4 days ago
City, London
Talent International
Rate: £350 - £500 per day
Posted: 6 days ago
London
TEKsystems
Rate: £550 - £650 per day
Posted: 6 days ago
Hampshire
Proactive Appointments
Rate: £440 - £450 per day
Posted: 6 days ago
Reading
People Source Consulting
Rate: £270 - £300 per day
Posted: 18 days ago