The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 28 June 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
28 Jun 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 582 594 595
Rank change year-on-year
+12 +1
Contract jobs citing HDFS 64 44 19
As % of all contract IT jobs located in the UK 0.12% 0.080% 0.036%
As % of the System Software category 0.95% 0.76% 0.35%
Number of daily rates quoted 47 25 8
Median daily rate £513 £525 £488
Median daily rate % change year-on-year
-2.38% +7.69%
90% offered a daily rate of more than £415 £418 £375
10% offered a daily rate of more than £675 £725 £820
UK excluding London median daily rate £500 £450 -
% change year-on-year
+11.11% -
Number of hourly rates quoted 0 4 0
Median hourly rate - £26.00 -
UK excluding London median hourly rate - £26.00 -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
6771 5823 5449
As % of all contract IT jobs located in the UK 12.57% 10.56% 10.28%
Number of daily rates quoted 4176 3288 2949
Median daily rate £400 £350 £325
Median daily rate % change year-on-year
+14.28% +7.69%
90% offered a daily rate of more than £205 £188 £165
10% offered a daily rate of more than £550 £500 £463
UK excluding London median daily rate £350 £330 £315
% change year-on-year
+6.06% +4.76%
Number of hourly rates quoted 469 604 629
Median hourly rate £20.00 £17.98 £15.50
Median hourly rate % change year-on-year
+11.23% +16.00%
90% offered a hourly rate of more than £12.00 £11.00 £10.02
10% offered a hourly rate of more than £42.00 £40.00 £29.85
UK excluding London median hourly rate £22.50 £17.50 £15.50
% change year-on-year
+28.57% +12.90%

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 28 June 2016.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 24 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 28 June 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +16 62 £513 -2.38% 19
London +7 42 £550 -8.33% 13
South East -6 7 £444 +121.87% 2
West Midlands - 7 £500 - 1
City of London +32 6 £700 +30.23%
Buckinghamshire +10 4 - -
North West -4 4 - - 3
South West +3 3 £600 +41.17%
Herefordshire - 2 £519 -
Hereford - 2 £519 -
Street - 1 - -
Crawley - 1 £388 -
Liverpool - 1 - -
Merseyside - 1 - -
Berkshire - 1 £500 - 1
West Sussex - 1 £388 -
Somerset - 1 - -
Reading - 1 £500 -
Buckingham - 1 - -
Belfast - 1 - -
Stirling - 1 - -
Scotland - 1 - - 1
Northern Ireland - 1 - -
County Antrim - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 28 June 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 132 (97.78%) Hadoop
2 108 (80.00%) Big Data
3 106 (78.52%) Apache Hive
4 86 (63.70%) Apache Spark
5 71 (52.59%) Java
6 54 (40.00%) Apache Pig
7 50 (37.04%) Scala
8 49 (36.30%) Agile Software Development
9 46 (34.07%) HBase
10 40 (29.63%) MapReduce
11 38 (28.15%) Python
12 36 (26.67%) Cloudera
13 35 (25.93%) Kafka
14 30 (22.22%) Impala
14 30 (22.22%) Apache Flume
14 30 (22.22%) Sqoop
15 29 (21.48%) Business Intelligence
16 27 (20.00%) Hadoop YARN
17 26 (19.26%) NoSQL
18 24 (17.78%) Oracle
18 24 (17.78%) Linux
19 23 (17.04%) Analytics
20 22 (16.30%) SQL
20 22 (16.30%) Banking
21 21 (15.56%) TDD
21 21 (15.56%) Finance
21 21 (15.56%) Shell Script
22 20 (14.81%) Unix
22 20 (14.81%) Hortonworks
23 18 (13.33%) Open Source

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 86 (63.70%) Apache Spark
2 54 (40.00%) Apache Pig
3 10 (7.41%) SAS
4 8 (5.93%) Apache
5 3 (2.22%) Apache Solr
6 1 (0.74%) Confluence
6 1 (0.74%) GemFire
6 1 (0.74%) nginx
6 1 (0.74%) OpenStack
6 1 (0.74%) Oracle Coherence
6 1 (0.74%) Tomcat
Applications
1 1 (0.74%) MS Visio
1 1 (0.74%) SPSS
Business Applications
1 1 (0.74%) SAP Oil and Gas
Cloud Services
1 13 (9.63%) Microsoft Azure
2 12 (8.89%) Amazon AWS
3 3 (2.22%) Amazon S3
4 1 (0.74%) Amazon EC2
4 1 (0.74%) CloudFront
4 1 (0.74%) GitHub
Communications & Networking
1 8 (5.93%) Kerberos
2 1 (0.74%) Broadband
2 1 (0.74%) Internet
2 1 (0.74%) SAN
2 1 (0.74%) TCP/IP
2 1 (0.74%) Wireshark
Database & Business Intelligence
1 132 (97.78%) Hadoop
2 108 (80.00%) Big Data
3 106 (78.52%) Apache Hive
4 46 (34.07%) HBase
5 30 (22.22%) Impala
5 30 (22.22%) Sqoop
6 26 (19.26%) NoSQL
7 17 (12.59%) Data Warehouse
8 15 (11.11%) Apache Cassandra
9 14 (10.37%) SQL Server
10 13 (9.63%) Relational Database
11 8 (5.93%) Apache Accumulo
11 8 (5.93%) MongoDB
11 8 (5.93%) MySQL
12 6 (4.44%) QlikView
12 6 (4.44%) SAP HANA
13 5 (3.70%) HCatalog
13 5 (3.70%) Mahout
13 5 (3.70%) PostgreSQL
13 5 (3.70%) RDBMS
Development Applications
1 9 (6.67%) Jenkins
2 7 (5.19%) JIRA
3 6 (4.44%) Git (software)
4 3 (2.22%) Bugzilla
4 3 (2.22%) Hudson
4 3 (2.22%) Maven
4 3 (2.22%) Subversion
5 2 (1.48%) Cucumber
5 2 (1.48%) JUnit
5 2 (1.48%) PigUnit
5 2 (1.48%) PyUnit
5 2 (1.48%) RSpec
6 1 (0.74%) ANTLR
6 1 (0.74%) Fiddler
6 1 (0.74%) GitLab
6 1 (0.74%) NeoLoad
6 1 (0.74%) Rational Performance Tester
6 1 (0.74%) RStudio
6 1 (0.74%) SilkPerformer
6 1 (0.74%) Talend Open Studio
General
1 22 (16.30%) Banking
2 21 (15.56%) Finance
3 7 (5.19%) Investment Banking
4 6 (4.44%) Retail
5 4 (2.96%) Back Office
6 3 (2.22%) Telecoms
7 2 (1.48%) Front Office
7 2 (1.48%) Marketing
8 1 (0.74%) Electronics
8 1 (0.74%) Manufacturing
8 1 (0.74%) Pharmaceutical
Job Titles
1 57 (42.22%) Developer
2 40 (29.63%) Hadoop Developer
3 34 (25.19%) Big Data Developer
4 27 (20.00%) Architect
5 17 (12.59%) Big Data Architect
6 16 (11.85%) Data Architect
6 16 (11.85%) Data Engineer
6 16 (11.85%) Hadoop Engineer
7 15 (11.11%) Hadoop Architect
8 14 (10.37%) Big Data Engineer
9 12 (8.89%) Apache Spark Developer
10 10 (7.41%) Senior Developer
11 9 (6.67%) Cloud Developer
11 9 (6.67%) Scala Developer
12 8 (5.93%) Administrator
12 8 (5.93%) Java Developer
12 8 (5.93%) Programmer
12 8 (5.93%) Senior Hadoop Developer
13 7 (5.19%) Hadoop Administrator
13 7 (5.19%) Senior Big Data Developer
Libraries, Frameworks & Software Standards
1 35 (25.93%) Kafka
2 10 (7.41%) REST
3 8 (5.93%) Apache Tez
3 8 (5.93%) Spring
3 8 (5.93%) Web Services
4 7 (5.19%) Hibernate
4 7 (5.19%) Spark Streaming
5 6 (4.44%) JSON
6 5 (3.70%) HTML
6 5 (3.70%) J2EE
6 5 (3.70%) JDBC
7 4 (2.96%) ODBC
7 4 (2.96%) WebHDFS
8 3 (2.22%) Akka
8 3 (2.22%) Cascading
8 3 (2.22%) HTML5
8 3 (2.22%) Struts
9 2 (1.48%) Java EE
10 1 (0.74%) Grails
10 1 (0.74%) Lucene
Miscellaneous
1 4 (2.96%) Computer Science
2 3 (2.22%) Analytical Skills
2 3 (2.22%) Data Integration
2 3 (2.22%) Data Structures
2 3 (2.22%) Mathematics
2 3 (2.22%) Visualisation
3 2 (1.48%) Credit Risk
3 2 (1.48%) Replication
4 1 (0.74%) Algorithms
4 1 (0.74%) Clustering
4 1 (0.74%) Data Protection Act
4 1 (0.74%) Derivative
4 1 (0.74%) Grid Computing
4 1 (0.74%) Hedge funds
4 1 (0.74%) Life Science
4 1 (0.74%) Mainframe
4 1 (0.74%) Management Information System
4 1 (0.74%) Ontologies
4 1 (0.74%) Physics
4 1 (0.74%) VSAM
Operating Systems
1 24 (17.78%) Linux
2 20 (14.81%) Unix
3 4 (2.96%) Windows
4 3 (2.22%) Red Hat Enterprise Linux
5 2 (1.48%) CentOS
6 1 (0.74%) Fedora
6 1 (0.74%) Solaris
6 1 (0.74%) Ubuntu
6 1 (0.74%) Windows 2000
6 1 (0.74%) Windows XP
Processes & Methodologies
1 49 (36.30%) Agile Software Development
2 40 (29.63%) MapReduce
3 29 (21.48%) Business Intelligence
4 23 (17.04%) Analytics
5 21 (15.56%) TDD
6 18 (13.33%) Open Source
7 17 (12.59%) Scrum
8 16 (11.85%) Continuous Integration
8 16 (11.85%) E-Commerce
8 16 (11.85%) ETL
9 11 (8.15%) High Availability
10 10 (7.41%) Continuous Delivery
11 9 (6.67%) Kanban
11 9 (6.67%) Software Engineering
12 8 (5.93%) Automated Testing
12 8 (5.93%) Multithreading
12 8 (5.93%) Pair Programming
13 7 (5.19%) Data Analytics
13 7 (5.19%) Data Modelling
13 7 (5.19%) Functional Programming
Programming Languages
1 71 (52.59%) Java
2 50 (37.04%) Scala
3 38 (28.15%) Python
4 22 (16.30%) SQL
5 21 (15.56%) Shell Script
6 10 (7.41%) R
7 5 (3.70%) Perl
7 5 (3.70%) PL/SQL
8 4 (2.96%) Bash Shell
8 4 (2.96%) C
9 3 (2.22%) JavaScript
10 2 (1.48%) PHP
10 2 (1.48%) Ruby
10 2 (1.48%) VBA
11 1 (0.74%) C#
11 1 (0.74%) COBOL
11 1 (0.74%) Groovy
11 1 (0.74%) JCL
11 1 (0.74%) MATLAB
11 1 (0.74%) VB.NET
Qualifications
1 10 (7.41%) Security Cleared
2 8 (5.93%) Degree
2 8 (5.93%) DV Cleared
3 1 (0.74%) BC Cleared
3 1 (0.74%) BPSS Clearance
3 1 (0.74%) PRINCE2 Practitioner
3 1 (0.74%) SC Cleared
Quality Assurance & Compliance
1 2 (1.48%) QA
2 1 (0.74%) Data Quality
System Software
1 30 (22.22%) Apache Flume
2 7 (5.19%) Apache ZooKeeper
3 2 (1.48%) Active Directory
3 2 (1.48%) vCloud
3 2 (1.48%) VMware Infrastructure
4 1 (0.74%) Ceph
4 1 (0.74%) Docker
4 1 (0.74%) Virtual Machines
Systems Management
1 27 (20.00%) Hadoop YARN
2 15 (11.11%) Oozie
3 8 (5.93%) Ambari
4 5 (3.70%) Puppet
5 3 (2.22%) Control-M
6 2 (1.48%) Ganglia
6 2 (1.48%) Nagios
7 1 (0.74%) Graphite
7 1 (0.74%) HP Quality Center
7 1 (0.74%) Kubernetes
7 1 (0.74%) OpenAM
7 1 (0.74%) Perfmon
Vendors
1 36 (26.67%) Cloudera
2 24 (17.78%) Oracle
3 20 (14.81%) Hortonworks
4 14 (10.37%) Informatica
5 8 (5.93%) Tableau
5 8 (5.93%) Teradata
6 7 (5.19%) IBM
6 7 (5.19%) MapR
6 7 (5.19%) SAP
7 3 (2.22%) Vertica
8 2 (1.48%) HP
8 2 (1.48%) Netezza
8 2 (1.48%) Platfora
8 2 (1.48%) Red Hat
8 2 (1.48%) Splunk
8 2 (1.48%) VMware
9 1 (0.74%) Ab Initio
9 1 (0.74%) GigaSpaces
9 1 (0.74%) Greenplum
9 1 (0.74%) Terracotta
Manchester, Lancashire
TDA Recruitment Ltd
Salary: £60k-£65k per annum + +Bonus + 30 Days Holiday
Posted: 15 hours ago
London
TEKsystems
Rate: £600 - £700 per day
Posted: 4 days ago
London
Calibre Search Ltd
Rate: £450 - £500 per day
Posted: 21 hours ago
London
Mortimer Spinks
Rate: £725 per day
Posted: 6 days ago
London
People Source Consulting
Rate: £450 - £550 per day
Posted: 14 days ago