The following table provides summary statistics for contract job vacancies advertised in England with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 3 months to 28 June 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK / England
3 months to
28 Jun 2017
Same period 2016 Same period 2015
Rank 457 558 578
Rank change year-on-year +101 +20  
Contract jobs citing HDFS 126 62 44
As % of all contract IT jobs advertised in England 0.29% 0.13% 0.088%
As % of the System Software category 2.57% 1.02% 0.81%
Number of daily rates quoted 84 47 25
Median daily rate £500 £513 £525
Median daily rate % change year-on-year -2.43% -2.38%  
90% offered a daily rate of more than £376 £408 £409
10% offered a daily rate of more than £675 £698 £778
UK excluding London median daily rate £401 £500 £450
% change year-on-year -19.90% +11.11%  
Number of hourly rates quoted 2 0 4
Median hourly rate £50.00 - £26.00
UK excluding London median hourly rate £50.00 - £26.00

HDFS is in the system software skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for system software skills.

Contract System Software Skills
England
Contract job vacancies with a requirement for system software skills 4912 6089 5407
As % of all contract IT job vacancies advertised in England 11.36% 12.31% 10.77%
Number of daily rates quoted 4639 6522 5378
Median daily rate £415 £400 £350
Median daily rate % change year-on-year +3.75% +14.28%  
90% offered a daily rate of more than £184 £205 £185
10% offered a daily rate of more than £575 £575 £506
UK excluding London median daily rate £375 £350 £330
% change year-on-year +7.14% +6.06%  
Number of hourly rates quoted 402 609 735
Median hourly rate £16.81 £19.00 £18.00
Median hourly rate % change year-on-year -11.55% +5.55%  
90% offered a hourly rate of more than £10.50 £11.09 £10.50
10% offered a hourly rate of more than £48.75 £42.50 £40.00
UK excluding London median hourly rate £16.00 £22.50 £17.50
% change year-on-year -28.88% +28.57%  

HDFS
Job Vacancy Trend in England

Job postings citing HDFS as a percentage of all IT jobs advertised in England.

Job vacancy trend for HDFS in England

HDFS
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS in England.

Contractor daily rate trend for HDFS in England

HDFS
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing HDFS in England over the 3 months to 28 June 2017.

Contractor daily rate histogram for HDFS in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 3 months to 28 June 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +55 85 £550 - 14
South East +50 31 £401 -9.74% 2
South West 0 5 £388 -35.41%
East of England - 3 - - 2
North of England +58 2 £405 - 2
North West +21 2 £405 -
HDFS
UK

For the 6 months to 28 June 2017, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the England region with a requirement for HDFS.

1 262 (98.87%) Hadoop
2 195 (73.58%) Big Data
3 172 (64.91%) Apache Spark
4 158 (59.62%) Apache Hive
5 149 (56.23%) HBase
6 146 (55.09%) Java
7 113 (42.64%) Kafka
8 112 (42.26%) Linux
9 110 (41.51%) Python
10 101 (38.11%) Hadoop YARN
11 90 (33.96%) Scala
11 90 (33.96%) Agile Software Development
12 84 (31.70%) Cloudera
13 83 (31.32%) DevOps
14 70 (26.42%) MapReduce
15 68 (25.66%) Apache ZooKeeper
15 68 (25.66%) Unix
16 60 (22.64%) Apache Pig
16 60 (22.64%) Finance
17 58 (21.89%) Impala
18 57 (21.51%) Apache Flume
18 57 (21.51%) Ansible
19 54 (20.38%) SQL
19 54 (20.38%) Apache Solr
20 52 (19.62%) TDD
20 52 (19.62%) Puppet
21 51 (19.25%) Sqoop
22 50 (18.87%) Amazon AWS
23 49 (18.49%) Oozie
24 46 (17.36%) Apache Cassandra

HDFS
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 172 (64.91%) Apache Spark
2 60 (22.64%) Apache Pig
3 54 (20.38%) Apache Solr
4 35 (13.21%) Apache
5 30 (11.32%) Elasticsearch
6 16 (6.04%) Confluence
7 12 (4.53%) Tomcat
8 4 (1.51%) JBoss
8 4 (1.51%) WebSphere
9 3 (1.13%) Mule
9 3 (1.13%) nginx
9 3 (1.13%) OpenStack
9 3 (1.13%) SAS
10 2 (0.75%) Adobe Experience Manager
10 2 (0.75%) Cloud Foundry
10 2 (0.75%) CMS
11 1 (0.38%) GemFire
Applications
1 1 (0.38%) Microsoft Excel
1 1 (0.38%) MS Visio
Business Applications
1 4 (1.51%) SAP Oil and Gas
Cloud Services
1 50 (18.87%) Amazon AWS
2 24 (9.06%) Amazon S3
3 19 (7.17%) Amazon EC2
4 12 (4.53%) Cloud Computing
4 12 (4.53%) Virtual Private Cloud
5 10 (3.77%) GitHub
6 9 (3.40%) Amazon EMR
7 8 (3.02%) Amazon CloudWatch
7 8 (3.02%) Amazon ELB
7 8 (3.02%) Google Cloud Platform
8 7 (2.64%) IaaS
9 6 (2.26%) Microsoft Azure
10 5 (1.89%) AWS CloudFormation
11 3 (1.13%) AWS CloudTrail
11 3 (1.13%) AWS Lambda
11 3 (1.13%) PaaS
12 1 (0.38%) Loggly
12 1 (0.38%) Sumo Logic
Communications & Networking
1 39 (14.72%) Kerberos
2 10 (3.77%) LDAP
3 8 (3.02%) Network Security
3 8 (3.02%) SSL
4 3 (1.13%) Firewall
4 3 (1.13%) FTP
4 3 (1.13%) OpenLDAP
4 3 (1.13%) tcpdump
4 3 (1.13%) Wireshark
5 2 (0.75%) HTTP
6 1 (0.38%) DNS
6 1 (0.38%) Internet
6 1 (0.38%) TCP/IP
Database & Business Intelligence
1 262 (98.87%) Hadoop
2 195 (73.58%) Big Data
3 158 (59.62%) Apache Hive
4 149 (56.23%) HBase
5 58 (21.89%) Impala
6 51 (19.25%) Sqoop
7 46 (17.36%) Apache Cassandra
8 43 (16.23%) NoSQL
9 31 (11.70%) MySQL
10 28 (10.57%) MongoDB
11 27 (10.19%) PostgreSQL
12 20 (7.55%) Data Warehouse
13 14 (5.28%) Neo4j
13 14 (5.28%) Relational Database
14 12 (4.53%) RDBMS
15 10 (3.77%) SQL Server
16 7 (2.64%) Amazon Redshift
16 7 (2.64%) Apache Zeppelin
17 6 (2.26%) IBM BigInsights
17 6 (2.26%) Parquet
Development Applications
1 45 (16.98%) Jenkins
2 37 (13.96%) Git (software)
3 23 (8.68%) JIRA
4 19 (7.17%) Cucumber
5 11 (4.15%) Maven
6 10 (3.77%) Gradle
7 8 (3.02%) IntelliJ
8 6 (2.26%) Subversion
8 6 (2.26%) webpack
9 5 (1.89%) GitLab
10 4 (1.51%) Eclipse
10 4 (1.51%) Hudson
10 4 (1.51%) JUnit
10 4 (1.51%) Sonatype Nexus
10 4 (1.51%) Talend Open Studio
11 3 (1.13%) Artifactory
12 2 (0.75%) Babel
12 2 (0.75%) gulp
12 2 (0.75%) Protractor
12 2 (0.75%) Vagrant
General
1 60 (22.64%) Finance
2 39 (14.72%) Banking
3 12 (4.53%) Front Office
4 10 (3.77%) Marketing
5 9 (3.40%) Investment Banking
5 9 (3.40%) Telecoms
6 4 (1.51%) Electronics
6 4 (1.51%) Manufacturing
7 3 (1.13%) Law
7 3 (1.13%) Retail
8 2 (0.75%) Billing
8 2 (0.75%) Pharmaceutical
9 1 (0.38%) Financial Institution
9 1 (0.38%) French Language
9 1 (0.38%) Games
Job Titles
1 87 (32.83%) Developer
2 68 (25.66%) Data Engineer
3 62 (23.40%) Big Data Engineer
4 49 (18.49%) Big Data Developer
5 39 (14.72%) Administrator
6 38 (14.34%) Hadoop Engineer
7 29 (10.94%) Hadoop Administrator
8 28 (10.57%) DevOps Engineer
9 23 (8.68%) Hadoop Developer
9 23 (8.68%) Linux Administrator
10 21 (7.92%) Java Developer
11 17 (6.42%) Apache Spark Developer
12 14 (5.28%) Scala Developer
13 12 (4.53%) Consultant
14 11 (4.15%) Architect
14 11 (4.15%) Linux Systems Administrator
14 11 (4.15%) Systems Administrator
15 10 (3.77%) Python Developer
16 9 (3.40%) Hadoop Consultant
16 9 (3.40%) Java Engineer
Libraries, Frameworks & Software Standards
1 113 (42.64%) Kafka
2 41 (15.47%) Spring
3 33 (12.45%) REST
4 29 (10.94%) Spark Streaming
5 20 (7.55%) Spring Boot
6 18 (6.79%) Drools
7 16 (6.04%) Apache Camel
8 15 (5.66%) Middleware
9 13 (4.91%) Elastic Stack
9 13 (4.91%) HTML
10 12 (4.53%) HTML5
11 9 (3.40%) Spring MVC
11 9 (3.40%) Web Services
12 8 (3.02%) AngularJS
12 8 (3.02%) JSON
12 8 (3.02%) Node.js
12 8 (3.02%) RabbitMQ
13 7 (2.64%) Hibernate
13 7 (2.64%) J2EE
13 7 (2.64%) PySpark
Miscellaneous
1 34 (12.83%) Algorithms
2 19 (7.17%) Computer Science
3 16 (6.04%) Analytical Skills
4 11 (4.15%) Foreign Exchange (FX)
5 8 (3.02%) Derivative
6 6 (2.26%) Fintech
6 6 (2.26%) Fixed Income
6 6 (2.26%) Greenfield Project
7 5 (1.89%) Linux Command Line
7 5 (1.89%) User Experience
7 5 (1.89%) Virtual Team
8 4 (1.51%) Distributed Denial-of-Service
9 3 (1.13%) Data Centre
9 3 (1.13%) Grid Computing
9 3 (1.13%) Management Information System
9 3 (1.13%) Market Risk
9 3 (1.13%) Private Cloud
10 2 (0.75%) Equities
10 2 (0.75%) Equity Derivative
10 2 (0.75%) Replication
Operating Systems
1 112 (42.26%) Linux
2 68 (25.66%) Unix
3 35 (13.21%) Red Hat Enterprise Linux
4 22 (8.30%) Ubuntu
5 19 (7.17%) Debian
6 14 (5.28%) Windows
7 9 (3.40%) CentOS
8 6 (2.26%) Fedora
9 4 (1.51%) CoreOS
10 2 (0.75%) Apple iOS
11 1 (0.38%) Android
Processes & Methodologies
1 90 (33.96%) Agile Software Development
2 83 (31.32%) DevOps
3 70 (26.42%) MapReduce
4 52 (19.62%) TDD
5 44 (16.60%) ETL
6 43 (16.23%) Continuous Integration
7 39 (14.72%) Microservices
8 38 (14.34%) Scrum
9 33 (12.45%) Analytics
9 33 (12.45%) Data Architecture
10 28 (10.57%) BDD
11 26 (9.81%) Continuous Delivery
12 23 (8.68%) Machine Learning
12 23 (8.68%) Performance Tuning
13 20 (7.55%) Open Source
14 19 (7.17%) Build Automation
14 19 (7.17%) Data Analysis
15 18 (6.79%) Data Analytics
15 18 (6.79%) Data Engineering
15 18 (6.79%) Security Hardening
Programming Languages
1 146 (55.09%) Java
2 110 (41.51%) Python
3 90 (33.96%) Scala
4 54 (20.38%) SQL
5 22 (8.30%) Bash Shell
6 20 (7.55%) Shell Script
7 17 (6.42%) JavaScript
8 15 (5.66%) R
9 14 (5.28%) Ruby
10 10 (3.77%) Perl
11 6 (2.26%) C++
11 6 (2.26%) ES6
12 4 (1.51%) Korn
12 4 (1.51%) PowerShell
12 4 (1.51%) T-SQL
13 3 (1.13%) C#
13 3 (1.13%) Go
13 3 (1.13%) PL/SQL
14 2 (0.75%) Julia
15 1 (0.38%) C
Qualifications
1 31 (11.70%) Security Cleared
2 22 (8.30%) SC Cleared
3 19 (7.17%) Degree
4 11 (4.15%) Computer Science Degree
5 4 (1.51%) CISA
5 4 (1.51%) CISM
5 4 (1.51%) CISSP
6 3 (1.13%) DBS Check
6 3 (1.13%) DV Cleared
7 2 (0.75%) BPSS Clearance
7 2 (0.75%) ISTQB
7 2 (0.75%) ISTQB Foundation Certification
7 2 (0.75%) Master's Degree
8 1 (0.38%) PhD
Quality Assurance & Compliance
1 8 (3.02%) MiFID
2 7 (2.64%) QA
3 5 (1.89%) SLA
4 4 (1.51%) Data Quality
4 4 (1.51%) FedRAMP
4 4 (1.51%) PCI DSS
5 2 (0.75%) CDISC
5 2 (0.75%) Dodd-Frank
5 2 (0.75%) EMIR
System Software
1 68 (25.66%) Apache ZooKeeper
2 57 (21.51%) Apache Flume
3 36 (13.58%) Docker
4 9 (3.40%) Active Directory
5 7 (2.64%) VMware Infrastructure
6 5 (1.89%) vCloud
7 3 (1.13%) Oracle RAC
7 3 (1.13%) Squid
8 2 (0.75%) vSphere
9 1 (0.38%) VirtualBox
9 1 (0.38%) VMware ESXi
Systems Management
1 101 (38.11%) Hadoop YARN
2 57 (21.51%) Ansible
3 52 (19.62%) Puppet
4 49 (18.49%) Oozie
5 40 (15.09%) Terraform
6 32 (12.08%) Opscode Chef
7 26 (9.81%) Kubernetes
8 11 (4.15%) Ambari
8 11 (4.15%) Kibana
8 11 (4.15%) Nagios
9 9 (3.40%) Mesos
10 7 (2.64%) logstash
11 4 (1.51%) ZABBIX
12 3 (1.13%) Consul
12 3 (1.13%) Grafana
12 3 (1.13%) Graphite
12 3 (1.13%) Packer
12 3 (1.13%) rkt
12 3 (1.13%) Salt
12 3 (1.13%) Sysdig
Vendors
1 84 (31.70%) Cloudera
2 37 (13.96%) Hortonworks
3 21 (7.92%) Oracle
4 12 (4.53%) Red Hat
4 12 (4.53%) VMware
5 10 (3.77%) Google
6 9 (3.40%) IBM
7 8 (3.02%) Tableau
8 6 (2.26%) Ab Initio
9 4 (1.51%) MapR
9 4 (1.51%) MicroStrategy
9 4 (1.51%) SaltStack
9 4 (1.51%) SAP
9 4 (1.51%) Talend
10 3 (1.13%) Alteryx
10 3 (1.13%) ForgeRock
10 3 (1.13%) Informatica
10 3 (1.13%) Splunk
11 2 (0.75%) Adobe
11 2 (0.75%) Cadence
Leeds, West Yorkshire
People Source Consulting
Rate: £450 - £500 per day
Posted: 5 hours ago
Norwich, Norfolk
Talendrone.com
Rate: Negotiable/Excellent Rates
Posted: Yesterday
London
Nicoll Curtin
Rate: £450 - £650 per day
Posted: 2 days ago
London
Sanderson
Rate: £500 - £544 per day
Posted: 2 days ago
London
Talent International
Rate: £550 - £700 per day
Posted: 6 days ago
Croydon, Surrey
Difrent
Rate: From £530 to £550 per day
Posted: 6 days ago
Croydon
People Source Consulting
Rate: £600 - £650 per day
Posted: 7 days ago