The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 24 August 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
24 Aug 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 562 578 594
Rank change year-on-year
+16 +16
Contract jobs citing HDFS 99 84 30
As % of all contract IT jobs located in the UK 0.18% 0.14% 0.054%
As % of the System Software category 1.53% 1.38% 0.53%
Number of daily rates quoted 65 58 21
Median daily rate £550 £575 £750
Median daily rate % change year-on-year
-4.34% -23.33%
90% offered a daily rate of more than £422 £413 £438
10% offered a daily rate of more than £675 £650 £775
UK excluding London median daily rate £538 £450 -
% change year-on-year
+19.44% -
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate - - -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
6481 6105 5696
As % of all contract IT jobs located in the UK 11.89% 10.44% 10.27%
Number of daily rates quoted 4121 3439 3176
Median daily rate £400 £363 £325
Median daily rate % change year-on-year
+10.34% +11.53%
90% offered a daily rate of more than £205 £200 £170
10% offered a daily rate of more than £550 £500 £500
UK excluding London median daily rate £350 £345 £315
% change year-on-year
+1.44% +9.52%
Number of hourly rates quoted 423 629 652
Median hourly rate £18.00 £17.50 £16.50
Median hourly rate % change year-on-year
+2.85% +6.06%
90% offered a hourly rate of more than £11.50 £11.00 £10.85
10% offered a hourly rate of more than £42.00 £42.50 £31.50
UK excluding London median hourly rate £20.00 £17.00 £16.50
% change year-on-year
+17.64% +3.03%

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 24 August 2016.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 27 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 24 August 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +17 99 £550 -4.34% 16
London +2 72 £550 -6.38% 14
South East - 13 £288 -
City of London +22 8 £650 +42.85% 3
Buckinghamshire - 8 - -
Buckingham - 4 - -
West Midlands - 4 £538 -
South West +11 3 £600 +41.17%
Yorkshire +1 3 £600 +14.28%
South Yorkshire -2 3 £600 +14.28%
Sheffield -8 3 £600 +14.28%
North West - 3 £568 - 2
East of England +9 2 £420 -11.57%
Canary Wharf +3 2 £400 -38.46%
Hampshire - 2 - -
Ipswich - 2 £420 -
Farnborough - 2 - -
Hereford - 2 £519 -
Herefordshire - 2 £519 -
Suffolk - 2 £420 -
Street - 1 - -
Reading - 1 - -
Somerset - 1 - -
Liverpool - 1 - -
Manchester - 1 £568 - 2
Merseyside - 1 - -
Berkshire - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 24 August 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 174 (97.21%) Hadoop
2 146 (81.56%) Big Data
3 129 (72.07%) Apache Hive
4 116 (64.80%) Apache Spark
5 103 (57.54%) Java
6 76 (42.46%) HBase
7 70 (39.11%) Scala
8 65 (36.31%) Agile Software Development
9 57 (31.84%) Apache Pig
10 55 (30.73%) Cloudera
10 55 (30.73%) Python
11 52 (29.05%) MapReduce
12 49 (27.37%) Kafka
13 48 (26.82%) Sqoop
14 43 (24.02%) Linux
15 41 (22.91%) Apache Flume
15 41 (22.91%) Hadoop YARN
16 40 (22.35%) SQL
17 39 (21.79%) Continuous Integration
18 37 (20.67%) Impala
19 36 (20.11%) ETL
19 36 (20.11%) Scrum
20 33 (18.44%) Finance
20 33 (18.44%) TDD
20 33 (18.44%) Amazon AWS
21 32 (17.88%) NoSQL
21 32 (17.88%) Data Warehouse
22 31 (17.32%) Unix
23 30 (16.76%) Hortonworks
24 29 (16.20%) Shell Script

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 116 (64.80%) Apache Spark
2 57 (31.84%) Apache Pig
3 13 (7.26%) Apache
3 13 (7.26%) Elasticsearch
4 12 (6.70%) SAS
5 5 (2.79%) Tomcat
6 4 (2.23%) GemFire
7 3 (1.68%) Cloud Foundry
8 2 (1.12%) Confluence
8 2 (1.12%) Oracle Coherence
9 1 (0.56%) Apache Solr
9 1 (0.56%) nginx
9 1 (0.56%) OpenStack
Applications
1 1 (0.56%) MS Visio
1 1 (0.56%) SPSS
Business Applications
1 2 (1.12%) SAP Oil and Gas
Cloud Services
1 33 (18.44%) Amazon AWS
2 15 (8.38%) Microsoft Azure
3 10 (5.59%) GitHub
4 3 (1.68%) Amazon S3
4 3 (1.68%) Google Cloud Platform
4 3 (1.68%) PaaS
5 1 (0.56%) Amazon EC2
5 1 (0.56%) Amazon EMR
5 1 (0.56%) CloudFront
Communications & Networking
1 9 (5.03%) Kerberos
2 3 (1.68%) FTP
3 1 (0.56%) Broadband
3 1 (0.56%) Internet
3 1 (0.56%) LDAP
3 1 (0.56%) SAN
3 1 (0.56%) TCP/IP
3 1 (0.56%) Wireshark
Database & Business Intelligence
1 174 (97.21%) Hadoop
2 146 (81.56%) Big Data
3 129 (72.07%) Apache Hive
4 76 (42.46%) HBase
5 48 (26.82%) Sqoop
6 37 (20.67%) Impala
7 32 (17.88%) Data Warehouse
7 32 (17.88%) NoSQL
8 22 (12.29%) Apache Cassandra
9 17 (9.50%) SQL Server
10 15 (8.38%) Relational Database
11 14 (7.82%) Data Lake
12 13 (7.26%) MongoDB
13 11 (6.15%) Apache Accumulo
14 9 (5.03%) PostgreSQL
15 7 (3.91%) Amazon Redshift
15 7 (3.91%) Mahout
15 7 (3.91%) MySQL
15 7 (3.91%) QlikView
15 7 (3.91%) SAP HANA
Development Applications
1 23 (12.85%) Jenkins
2 16 (8.94%) Git (software)
2 16 (8.94%) Maven
3 6 (3.35%) JIRA
3 6 (3.35%) JUnit
4 5 (2.79%) TeamCity
5 4 (2.23%) Artifactory
5 4 (2.23%) Eclipse
5 4 (2.23%) FindBugs
5 4 (2.23%) Sonatype Nexus
6 3 (1.68%) Cucumber
6 3 (1.68%) Gradle
7 2 (1.12%) PigUnit
7 2 (1.12%) PyUnit
7 2 (1.12%) RSpec
7 2 (1.12%) RStudio
8 1 (0.56%) ANTLR
8 1 (0.56%) GitLab
8 1 (0.56%) NeoLoad
8 1 (0.56%) PHPUnit
General
1 33 (18.44%) Finance
2 23 (12.85%) Banking
3 9 (5.03%) Retail
4 8 (4.47%) Investment Banking
5 6 (3.35%) Front Office
6 4 (2.23%) Telecoms
7 3 (1.68%) Back Office
7 3 (1.68%) Financial Institution
7 3 (1.68%) Legal
7 3 (1.68%) Marketing
8 2 (1.12%) Electronics
8 2 (1.12%) Manufacturing
Job Titles
1 64 (35.75%) Developer
2 40 (22.35%) Hadoop Developer
3 36 (20.11%) Big Data Developer
4 35 (19.55%) Big Data Engineer
4 35 (19.55%) Data Engineer
5 31 (17.32%) Architect
6 24 (13.41%) Hadoop Engineer
7 22 (12.29%) Big Data Architect
7 22 (12.29%) Data Architect
8 17 (9.50%) Hadoop Architect
8 17 (9.50%) Scala Developer
9 14 (7.82%) Java Developer
10 11 (6.15%) Consultant
11 10 (5.59%) DevOps Engineer
11 10 (5.59%) Hadoop Consultant
11 10 (5.59%) Senior Developer
12 9 (5.03%) Apache Spark Developer
12 9 (5.03%) Cloud Developer
12 9 (5.03%) Senior Big Data Developer
13 8 (4.47%) Programmer
Libraries, Frameworks & Software Standards
1 49 (27.37%) Kafka
2 15 (8.38%) Spark Streaming
3 13 (7.26%) REST
4 11 (6.15%) Akka
4 11 (6.15%) JSON
4 11 (6.15%) Web Services
5 9 (5.03%) Apache Tez
5 9 (5.03%) J2EE
6 8 (4.47%) Spring
7 7 (3.91%) ELK Stack
7 7 (3.91%) Hibernate
7 7 (3.91%) MLlib
8 5 (2.79%) Cascading
8 5 (2.79%) JDBC
8 5 (2.79%) Play Framework
8 5 (2.79%) spray
9 4 (2.23%) ODBC
9 4 (2.23%) Spring Boot
9 4 (2.23%) WebHDFS
10 3 (1.68%) Spring Integration
Miscellaneous
1 10 (5.59%) Computer Science
2 6 (3.35%) Analytical Skills
2 6 (3.35%) Management Information System
3 4 (2.23%) Data Integration
3 4 (2.23%) Virtual Team
4 3 (1.68%) Equities
4 3 (1.68%) Fixed Income
4 3 (1.68%) Mathematics
4 3 (1.68%) Replication
5 2 (1.12%) Credit Risk
5 2 (1.12%) Data Structures
5 2 (1.12%) Foreign Exchange (FX)
6 1 (0.56%) Algorithms
6 1 (0.56%) Blockchain
6 1 (0.56%) Fintech
6 1 (0.56%) Hedge funds
6 1 (0.56%) Mainframe
6 1 (0.56%) Market Risk
6 1 (0.56%) Public Cloud
6 1 (0.56%) Visualisation
Operating Systems
1 43 (24.02%) Linux
2 31 (17.32%) Unix
3 5 (2.79%) Red Hat Enterprise Linux
4 2 (1.12%) CentOS
4 2 (1.12%) Ubuntu
5 1 (0.56%) Solaris
5 1 (0.56%) Windows
5 1 (0.56%) Windows 2000
5 1 (0.56%) Windows XP
Processes & Methodologies
1 65 (36.31%) Agile Software Development
2 52 (29.05%) MapReduce
3 39 (21.79%) Continuous Integration
4 36 (20.11%) ETL
4 36 (20.11%) Scrum
5 33 (18.44%) TDD
6 25 (13.97%) Continuous Delivery
6 25 (13.97%) DevOps
7 24 (13.41%) Analytics
7 24 (13.41%) Business Intelligence
8 22 (12.29%) E-Commerce
8 22 (12.29%) Open Source
9 21 (11.73%) Software Engineering
10 14 (7.82%) High Availability
11 13 (7.26%) Kanban
11 13 (7.26%) Pair Programming
12 12 (6.70%) Automated Testing
12 12 (6.70%) Build Automation
12 12 (6.70%) Unit Testing
12 12 (6.70%) User Stories
Programming Languages
1 103 (57.54%) Java
2 70 (39.11%) Scala
3 55 (30.73%) Python
4 40 (22.35%) SQL
5 29 (16.20%) Shell Script
6 12 (6.70%) R
7 9 (5.03%) Perl
8 8 (4.47%) C
8 8 (4.47%) PL/SQL
9 5 (2.79%) Bash Shell
10 3 (1.68%) HiveQL
10 3 (1.68%) JavaScript
11 2 (1.12%) PHP
11 2 (1.12%) VBA
12 1 (0.56%) C++
12 1 (0.56%) COBOL
12 1 (0.56%) Groovy
12 1 (0.56%) JAQL
12 1 (0.56%) JCL
12 1 (0.56%) MATLAB
Qualifications
1 19 (10.61%) Security Cleared
2 14 (7.82%) Degree
3 10 (5.59%) BPSS Clearance
3 10 (5.59%) DV Cleared
4 7 (3.91%) SC Cleared
5 1 (0.56%) BC Cleared
5 1 (0.56%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 5 (2.79%) QA
2 2 (1.12%) Data Quality
System Software
1 41 (22.91%) Apache Flume
2 14 (7.82%) vCloud
2 14 (7.82%) VMware Infrastructure
3 11 (6.15%) Apache ZooKeeper
4 4 (2.23%) Active Directory
5 2 (1.12%) Ceph
6 1 (0.56%) Btrfs
6 1 (0.56%) Docker
6 1 (0.56%) Virtual Machines
Systems Management
1 41 (22.91%) Hadoop YARN
2 16 (8.94%) Puppet
3 15 (8.38%) Oozie
4 8 (4.47%) Kibana
5 6 (3.35%) Ambari
5 6 (3.35%) Control-M
5 6 (3.35%) logstash
6 2 (1.12%) Ganglia
6 2 (1.12%) Nagios
7 1 (0.56%) Graphite
7 1 (0.56%) HP Quality Center
7 1 (0.56%) Kubernetes
7 1 (0.56%) OpenAM
7 1 (0.56%) Perfmon
7 1 (0.56%) ZABBIX
Vendors
1 55 (30.73%) Cloudera
2 30 (16.76%) Hortonworks
3 25 (13.97%) Oracle
4 14 (7.82%) Informatica
4 14 (7.82%) VMware
5 9 (5.03%) IBM
5 9 (5.03%) SAP
6 8 (4.47%) Tableau
6 8 (4.47%) Teradata
7 4 (2.23%) Red Hat
8 3 (1.68%) Google
8 3 (1.68%) MapR
8 3 (1.68%) MicroStrategy
9 2 (1.12%) Ab Initio
9 2 (1.12%) Cognos
9 2 (1.12%) HP
9 2 (1.12%) Platfora
9 2 (1.12%) Rackspace
9 2 (1.12%) Vertica
10 1 (0.56%) Dynatrace
City of London
Vivid Resourcing
Posted: Yesterday
London
TEKsystems
Rate: £600 - £700 per day
Posted: Yesterday
London
TEKsystems
Rate: £600 - £800 per day
Posted: Yesterday
London
Oliver Bernard
Rate: From £550 to £600 per day
Posted: Yesterday
West London
Vivid Resourcing
Rate: £435 - £525 per day
Posted: 5 days ago
City, London
McGregor Boyall
Rate: £650 per day
Posted: 5 days ago
London
Mortimer Spinks
Rate: Market Rates
Posted: 6 days ago