The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 29 September 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
29 Sep 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 494 570 603
Rank change year-on-year
+76 +33
Contract jobs citing HDFS 159 93 36
As % of all contract IT jobs located in the UK 0.30% 0.16% 0.062%
As % of the System Software category 2.46% 1.59% 0.61%
Number of daily rates quoted 99 72 28
Median daily rate £550 £638 £775
Median daily rate % change year-on-year
-13.72% -17.74%
UK excluding London median daily rate £526 £450 -
% change year-on-year
+16.88% -
Number of hourly rates quoted 0 1 0
Median hourly rate - £37.50 -
UK excluding London median hourly rate - - -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
6465 5841 5878
As % of all contract IT jobs located in the UK 12.11% 10.07% 10.12%
Number of daily rates quoted 4102 3323 3270
Median daily rate £405 £370 £345
Median daily rate % change year-on-year
+9.45% +7.24%
90% offered a daily rate of more than £200 £194 £175
10% offered a daily rate of more than £550 £525 £500
UK excluding London median daily rate £350 £350 £320
% change year-on-year
- +9.37%
Number of hourly rates quoted 422 625 716
Median hourly rate £16.50 £16.50 £17.00
Median hourly rate % change year-on-year
- -2.94%
90% offered a hourly rate of more than £11.25 £11.00 £11.00
10% offered a hourly rate of more than £44.46 £41.15 £32.00
UK excluding London median hourly rate £16.50 £16.00 £17.00
% change year-on-year
+3.12% -5.88%

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 29 September 2016.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 30 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 29 September 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +75 157 £550 -13.72% 13
London +27 117 £575 -11.53% 5
South East +47 28 £520 +36.71% 3
City of London +16 22 £650 +18.18% 1
Surrey - 11 £550 -
Staines - 9 £290 -
Buckinghamshire - 9 £520 -
Milton Keynes - 5 £520 -
West Midlands -30 4 £550 +22.22% 2
Farnborough - 4 - -
Hampshire - 4 - - 2
Yorkshire +14 3 £600 +14.28%
Sheffield +4 3 £600 +14.28%
South Yorkshire -1 3 £600 +14.28%
Buckingham - 3 - -
East of England +10 2 £420 -16.00% 1
Canary Wharf -1 2 £550 -15.38%
Ipswich - 2 £420 -
Suffolk - 2 £420 -
Shropshire - 2 - -
Telford - 2 - -
Berkshire +1 1 - - 1
Northamptonshire - 1 - -
Manchester - 1 £568 - 1
Newport - 1 £650 - 1
Northampton - 1 - -
Reading - 1 - - 1
Scotland - 1 £300 -
West Sussex - 1 - -
South Wales - 1 £650 - 1

HDFS
Top 30 Related IT Skills

For the 6 months to 29 September 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 219 (98.21%) Hadoop
2 189 (84.75%) Big Data
3 155 (69.51%) Apache Hive
4 135 (60.54%) Apache Spark
5 133 (59.64%) Java
6 104 (46.64%) HBase
7 83 (37.22%) MapReduce
8 78 (34.98%) Linux
9 77 (34.53%) Apache Pig
10 73 (32.74%) Python
11 72 (32.29%) Scala
12 68 (30.49%) SQL
13 66 (29.60%) Hadoop YARN
14 65 (29.15%) Cloudera
15 63 (28.25%) Sqoop
16 61 (27.35%) Agile Software Development
17 57 (25.56%) Kafka
18 53 (23.77%) NoSQL
19 52 (23.32%) Amazon AWS
20 51 (22.87%) Unix
21 50 (22.42%) ETL
21 50 (22.42%) Hortonworks
22 49 (21.97%) Apache Flume
23 47 (21.08%) Continuous Integration
24 41 (18.39%) Scrum
25 40 (17.94%) Apache Cassandra
26 39 (17.49%) TDD
27 37 (16.59%) Analytics
28 35 (15.70%) Open Source
29 34 (15.25%) Finance

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 135 (60.54%) Apache Spark
2 77 (34.53%) Apache Pig
3 24 (10.76%) Apache
4 23 (10.31%) Elasticsearch
5 12 (5.38%) SAS
6 10 (4.48%) Apache Solr
7 7 (3.14%) Tomcat
8 6 (2.69%) GemFire
8 6 (2.69%) Oracle Coherence
9 5 (2.24%) Cloud Foundry
10 4 (1.79%) Confluence
11 1 (0.45%) nginx
11 1 (0.45%) OpenStack
Applications
1 2 (0.90%) MS Excel
2 1 (0.45%) SPSS
2 1 (0.45%) Stata
Business Applications
1 2 (0.90%) SAP Oil and Gas
Cloud Services
1 52 (23.32%) Amazon AWS
2 20 (8.97%) Microsoft Azure
3 13 (5.83%) GitHub
4 10 (4.48%) Cloud Computing
5 6 (2.69%) Office 365
6 5 (2.24%) PaaS
7 4 (1.79%) Amazon S3
8 3 (1.35%) Google Cloud Platform
9 2 (0.90%) Amazon EC2
9 2 (0.90%) Amazon EMR
9 2 (0.90%) CloudFront
10 1 (0.45%) Google Analytics
Communications & Networking
1 20 (8.97%) Kerberos
2 7 (3.14%) FTP
2 7 (3.14%) LAN
2 7 (3.14%) WAN
3 1 (0.45%) Broadband
3 1 (0.45%) Internet
3 1 (0.45%) LDAP
3 1 (0.45%) TCP/IP
Database & Business Intelligence
1 219 (98.21%) Hadoop
2 189 (84.75%) Big Data
3 155 (69.51%) Apache Hive
4 104 (46.64%) HBase
5 63 (28.25%) Sqoop
6 53 (23.77%) NoSQL
7 40 (17.94%) Apache Cassandra
8 34 (15.25%) Data Warehouse
9 31 (13.90%) Impala
10 24 (10.76%) SQL Server
11 21 (9.42%) Relational Database
12 20 (8.97%) MongoDB
13 17 (7.62%) Data Lake
14 12 (5.38%) MySQL
15 11 (4.93%) Apache Accumulo
16 10 (4.48%) PostgreSQL
17 9 (4.04%) DataStax
18 8 (3.59%) Apache Zeppelin
18 8 (3.59%) Mahout
18 8 (3.59%) Oracle Exadata
Development Applications
1 28 (12.56%) Jenkins
2 25 (11.21%) Git (software)
3 21 (9.42%) Maven
4 10 (4.48%) JUnit
5 8 (3.59%) JIRA
6 6 (2.69%) Eclipse
7 5 (2.24%) Bundler
7 5 (2.24%) Cucumber
7 5 (2.24%) Gradle
7 5 (2.24%) gulp
7 5 (2.24%) Jasmine
7 5 (2.24%) Karma Test Runner
7 5 (2.24%) Protractor
7 5 (2.24%) Selenium
7 5 (2.24%) TeamCity
7 5 (2.24%) WebDriver
8 4 (1.79%) Artifactory
8 4 (1.79%) FindBugs
8 4 (1.79%) PHPUnit
8 4 (1.79%) Sonatype Nexus
General
1 34 (15.25%) Finance
2 20 (8.97%) Banking
3 14 (6.28%) Front Office
4 9 (4.04%) Investment Banking
4 9 (4.04%) Retail
5 4 (1.79%) Financial Institution
5 4 (1.79%) Telecoms
6 3 (1.35%) Legal
6 3 (1.35%) Marketing
7 2 (0.90%) Electronics
7 2 (0.90%) Manufacturing
8 1 (0.45%) Games
Job Titles
1 66 (29.60%) Developer
2 53 (23.77%) Data Engineer
3 52 (23.32%) Big Data Engineer
4 39 (17.49%) Big Data Developer
5 32 (14.35%) Hadoop Developer
6 30 (13.45%) Architect
7 28 (12.56%) Hadoop Engineer
8 23 (10.31%) Data Architect
9 22 (9.87%) Big Data Architect
10 21 (9.42%) Administrator
10 21 (9.42%) Scala Developer
11 18 (8.07%) DevOps Engineer
11 18 (8.07%) Java Developer
12 14 (6.28%) Consultant
12 14 (6.28%) Hadoop Architect
13 13 (5.83%) Apache Spark Developer
14 12 (5.38%) Hadoop Administrator
14 12 (5.38%) Senior Developer
15 11 (4.93%) Hadoop Consultant
15 11 (4.93%) Senior Big Data Developer
Libraries, Frameworks & Software Standards
1 57 (25.56%) Kafka
2 18 (8.07%) Spark Streaming
3 16 (7.17%) Akka
4 15 (6.73%) ELK Stack
5 13 (5.83%) Apache Tez
6 11 (4.93%) JSON
7 9 (4.04%) MLlib
8 8 (3.59%) Oracle GoldenGate
9 7 (3.14%) Play Framework
9 7 (3.14%) Spring
10 6 (2.69%) AngularJS
10 6 (2.69%) D3.js
10 6 (2.69%) J2EE
10 6 (2.69%) JMS
10 6 (2.69%) spray
10 6 (2.69%) Spring Boot
10 6 (2.69%) Web Services
11 5 (2.24%) Browserify
11 5 (2.24%) Cascading
11 5 (2.24%) REST
Miscellaneous
1 17 (7.62%) Computer Science
2 9 (4.04%) Analytical Skills
3 7 (3.14%) Grid Computing
3 7 (3.14%) Management Information System
4 5 (2.24%) Foreign Exchange (FX)
4 5 (2.24%) Interest Rate Derivative
4 5 (2.24%) Mathematics
5 4 (1.79%) Market Risk
5 4 (1.79%) Virtual Team
6 3 (1.35%) Algorithms
6 3 (1.35%) Data Integration
6 3 (1.35%) Equities
6 3 (1.35%) Fixed Income
6 3 (1.35%) Replication
7 2 (0.90%) Data Centre
7 2 (0.90%) Data Structures
7 2 (0.90%) Statistics
7 2 (0.90%) Visualisation
8 1 (0.45%) Fintech
8 1 (0.45%) Public Cloud
Operating Systems
1 78 (34.98%) Linux
2 51 (22.87%) Unix
3 9 (4.04%) Red Hat Enterprise Linux
4 2 (0.90%) Ubuntu
5 1 (0.45%) CentOS
Processes & Methodologies
1 83 (37.22%) MapReduce
2 61 (27.35%) Agile Software Development
3 50 (22.42%) ETL
4 47 (21.08%) Continuous Integration
5 41 (18.39%) Scrum
6 39 (17.49%) TDD
7 37 (16.59%) Analytics
8 35 (15.70%) Open Source
9 33 (14.80%) DevOps
10 30 (13.45%) Business Intelligence
11 27 (12.11%) Continuous Delivery
11 27 (12.11%) Software Engineering
12 22 (9.87%) User Stories
13 21 (9.42%) E-Commerce
14 20 (8.97%) Build Automation
15 18 (8.07%) Data Modelling
15 18 (8.07%) Performance Tuning
16 17 (7.62%) BDD
17 15 (6.73%) High Availability
18 14 (6.28%) Stakeholder Management
Programming Languages
1 133 (59.64%) Java
2 73 (32.74%) Python
3 72 (32.29%) Scala
4 68 (30.49%) SQL
5 33 (14.80%) Shell Script
6 18 (8.07%) R
7 15 (6.73%) C
8 10 (4.48%) PL/SQL
9 9 (4.04%) Perl
10 8 (3.59%) C++
11 7 (3.14%) Ruby
12 4 (1.79%) Bash Shell
13 3 (1.35%) HiveQL
13 3 (1.35%) JavaScript
13 3 (1.35%) MATLAB
14 1 (0.45%) ABAP
14 1 (0.45%) Groovy
14 1 (0.45%) JAQL
14 1 (0.45%) PHP
Qualifications
1 30 (13.45%) Security Cleared
2 18 (8.07%) Degree
3 17 (7.62%) SC Cleared
4 16 (7.17%) BPSS Clearance
5 15 (6.73%) DV Cleared
6 2 (0.90%) PhD
7 1 (0.45%) BC Cleared
7 1 (0.45%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 7 (3.14%) SLA
2 5 (2.24%) QA
3 2 (0.90%) Data Quality
3 2 (0.90%) Disclosure Scotland
System Software
1 49 (21.97%) Apache Flume
2 27 (12.11%) Apache ZooKeeper
3 22 (9.87%) vCloud
3 22 (9.87%) VMware Infrastructure
4 7 (3.14%) Oracle RAC
5 3 (1.35%) Active Directory
6 2 (0.90%) Btrfs
6 2 (0.90%) Ceph
7 1 (0.45%) Docker
Systems Management
1 66 (29.60%) Hadoop YARN
2 30 (13.45%) Puppet
3 25 (11.21%) Oozie
4 16 (7.17%) Ambari
5 11 (4.93%) Kibana
6 8 (3.59%) logstash
7 5 (2.24%) Control-M
7 5 (2.24%) Nagios
8 3 (1.35%) Ansible
9 2 (0.90%) Ganglia
9 2 (0.90%) SCOM
10 1 (0.45%) Graphite
10 1 (0.45%) Kubernetes
10 1 (0.45%) OpenAM
10 1 (0.45%) ZABBIX
Vendors
1 65 (29.15%) Cloudera
2 50 (22.42%) Hortonworks
3 30 (13.45%) Oracle
4 22 (9.87%) VMware
5 15 (6.73%) Teradata
6 14 (6.28%) Informatica
7 11 (4.93%) Red Hat
7 11 (4.93%) Tableau
8 9 (4.04%) IBM
8 9 (4.04%) SAP
9 7 (3.14%) Cisco
10 4 (1.79%) Google
11 3 (1.35%) MapR
11 3 (1.35%) MicroStrategy
11 3 (1.35%) Netezza
12 2 (0.90%) Ab Initio
12 2 (0.90%) Cognos
12 2 (0.90%) Rackspace
12 2 (0.90%) Talend
12 2 (0.90%) Vertica
Fareham, Hampshire
Digitech Resourcing Ltd
Rate: From £500 to £750 per day £500-£750p/d
Posted: 2 days ago
Newport, Gwent
Digitech Resourcing Ltd
Rate: From £500 to £750 per day £500-£750p/d
Posted: 2 days ago
Liverpool
Vivid Resourcing
Rate: £525 - £625 per day
Posted: 3 days ago