The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 6 December 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
6 Dec 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 465 559 592
Rank change year-on-year
+94 +33
Contract jobs citing HDFS 174 90 37
As % of all contract IT jobs located in the UK 0.34% 0.16% 0.065%
As % of the System Software category 2.67% 1.65% 0.64%
Number of daily rates quoted 93 53 17
Median daily rate £575 £625 £525
Median daily rate % change year-on-year
-8.00% +19.04%
90% offered a daily rate of more than £415 £450 £427
10% offered a daily rate of more than £700 £650 £775
UK excluding London median daily rate £498 £588 £525
% change year-on-year
-15.31% +11.90%
Number of hourly rates quoted 0 1 0
Median hourly rate - £37.50 -
UK excluding London median hourly rate - - -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
6505 5470 5756
As % of all contract IT jobs located in the UK 12.78% 10.00% 10.19%
Number of daily rates quoted 4053 3171 3155
Median daily rate £400 £375 £350
Median daily rate % change year-on-year
+6.66% +7.14%
90% offered a daily rate of more than £195 £175 £180
10% offered a daily rate of more than £565 £550 £500
UK excluding London median daily rate £350 £350 £348
% change year-on-year
- +0.57%
Number of hourly rates quoted 469 622 724
Median hourly rate £16.50 £16.50 £16.50
90% offered a hourly rate of more than £11.17 £10.50 £11.00
10% offered a hourly rate of more than £49.46 £41.05 £33.65
UK excluding London median hourly rate £16.00 £16.00 £16.50
% change year-on-year
- -3.03%

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 6 December 2016.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 30 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 6 December 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +85 168 £575 -8.00% 20
London +55 128 £580 -10.76% 16
South East +39 27 £494 +30.00%
City of London +21 22 £650 -5.79% 5
Surrey - 10 £550 -
Hampshire +25 9 £425 -
Croydon - 9 - -
Yorkshire +13 8 £485 -17.44%
Staines - 8 £290 -
West Yorkshire +17 5 £475 -
Leeds +16 5 £475 -
Milton Keynes - 5 £520 -
Buckinghamshire - 5 £520 -
Newport - 4 £688 -
South Wales - 4 £688 -
Docklands, London - 4 £575 -
Wales - 4 £688 -
South Yorkshire -7 3 £525 -10.63%
Sheffield -9 3 £525 -10.63%
Farnborough - 3 - -
West Sussex - 2 - -
Scotland +7 1 £300 - 1
North West +1 1 £575 -4.16% 3
Shropshire -2 1 - -
Telford -9 1 - -
West Midlands -36 1 - -
East of England - 1 - -
East Midlands - 1 - -
South West - 1 - - 1
Somerset - 1 - - 1

HDFS
Top 30 Related IT Skills

For the 6 months to 6 December 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 284 (98.27%) Hadoop
2 250 (86.51%) Big Data
3 201 (69.55%) Apache Hive
4 183 (63.32%) Apache Spark
5 158 (54.67%) HBase
6 154 (53.29%) Java
7 128 (44.29%) Linux
8 112 (38.75%) Python
9 104 (35.99%) MapReduce
10 96 (33.22%) Apache Pig
11 94 (32.53%) Scala
12 87 (30.10%) Hadoop YARN
13 84 (29.07%) SQL
14 82 (28.37%) Cloudera
15 80 (27.68%) Kafka
16 79 (27.34%) Sqoop
17 76 (26.30%) Agile Software Development
18 74 (25.61%) Hortonworks
18 74 (25.61%) DevOps
19 70 (24.22%) Unix
20 68 (23.53%) Amazon AWS
21 65 (22.49%) NoSQL
22 60 (20.76%) Continuous Integration
23 58 (20.07%) ETL
24 56 (19.38%) Scrum
25 54 (18.69%) Finance
26 51 (17.65%) Banking
26 51 (17.65%) Puppet
26 51 (17.65%) Apache Flume
27 50 (17.30%) Apache Cassandra

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 183 (63.32%) Apache Spark
2 96 (33.22%) Apache Pig
3 37 (12.80%) Apache
4 29 (10.03%) Elasticsearch
5 20 (6.92%) Apache Solr
6 12 (4.15%) SAS
7 7 (2.42%) Cloud Foundry
7 7 (2.42%) GemFire
7 7 (2.42%) Oracle Coherence
7 7 (2.42%) Tomcat
8 6 (2.08%) Confluence
8 6 (2.08%) Jupyter
9 2 (0.69%) OpenStack
Applications
1 2 (0.69%) MS Excel
2 1 (0.35%) Stata
Business Applications
1 2 (0.69%) SAP Oil and Gas
Cloud Services
1 68 (23.53%) Amazon AWS
2 16 (5.54%) Cloud Computing
2 16 (5.54%) Microsoft Azure
3 14 (4.84%) GitHub
4 6 (2.08%) Google Cloud Platform
4 6 (2.08%) Office 365
4 6 (2.08%) PaaS
5 4 (1.38%) Amazon EMR
6 2 (0.69%) Amazon S3
6 2 (0.69%) IBM Cloud
7 1 (0.35%) Amazon EC2
7 1 (0.35%) CloudFront
7 1 (0.35%) Flurry Analytics
7 1 (0.35%) Google Analytics
7 1 (0.35%) IaaS
7 1 (0.35%) Sumo Logic
Communications & Networking
1 39 (13.49%) Kerberos
2 9 (3.11%) LAN
2 9 (3.11%) WAN
3 7 (2.42%) FTP
4 5 (1.73%) Network Security
5 2 (0.69%) Internet
5 2 (0.69%) LDAP
6 1 (0.35%) DNS
6 1 (0.35%) HTTP
6 1 (0.35%) TCP/IP
Database & Business Intelligence
1 284 (98.27%) Hadoop
2 250 (86.51%) Big Data
3 201 (69.55%) Apache Hive
4 158 (54.67%) HBase
5 79 (27.34%) Sqoop
6 65 (22.49%) NoSQL
7 50 (17.30%) Apache Cassandra
8 34 (11.76%) Data Warehouse
8 34 (11.76%) Impala
9 28 (9.69%) MongoDB
10 24 (8.30%) Data Lake
11 23 (7.96%) SQL Server
12 22 (7.61%) MySQL
12 22 (7.61%) Relational Database
13 19 (6.57%) PostgreSQL
14 16 (5.54%) QlikView
15 14 (4.84%) Cloudera CDH
16 11 (3.81%) Apache Accumulo
16 11 (3.81%) Apache Zeppelin
17 10 (3.46%) BusinessObjects
Development Applications
1 31 (10.73%) Jenkins
2 29 (10.03%) Git (software)
3 25 (8.65%) Maven
4 10 (3.46%) JIRA
4 10 (3.46%) JUnit
5 7 (2.42%) Eclipse
5 7 (2.42%) Selenium
5 7 (2.42%) TeamCity
6 6 (2.08%) Artifactory
6 6 (2.08%) Bundler
6 6 (2.08%) FindBugs
6 6 (2.08%) Gradle
6 6 (2.08%) Jasmine
6 6 (2.08%) Karma Test Runner
6 6 (2.08%) Protractor
6 6 (2.08%) Sonatype Nexus
6 6 (2.08%) WebDriver
7 5 (1.73%) gulp
8 4 (1.38%) Cucumber
8 4 (1.38%) PHPUnit
General
1 54 (18.69%) Finance
2 51 (17.65%) Banking
3 18 (6.23%) Front Office
4 15 (5.19%) Investment Banking
5 8 (2.77%) Retail
6 6 (2.08%) Marketing
7 4 (1.38%) Financial Institution
7 4 (1.38%) Telecoms
8 3 (1.04%) Legal
9 2 (0.69%) Electronics
9 2 (0.69%) Manufacturing
10 1 (0.35%) Advertising
10 1 (0.35%) Games
10 1 (0.35%) Law
Job Titles
1 81 (28.03%) Developer
2 72 (24.91%) Big Data Engineer
3 68 (23.53%) Data Engineer
4 47 (16.26%) Big Data Developer
5 43 (14.88%) Hadoop Developer
6 37 (12.80%) Administrator
7 34 (11.76%) Hadoop Engineer
8 33 (11.42%) Architect
9 30 (10.38%) DevOps Engineer
10 27 (9.34%) Scala Developer
11 23 (7.96%) Data Architect
12 22 (7.61%) Big Data Architect
13 21 (7.27%) Consultant
14 20 (6.92%) Data Administrator
15 19 (6.57%) Hadoop Administrator
16 17 (5.88%) Java Developer
17 15 (5.19%) Hadoop Architect
17 15 (5.19%) Technical Leader
18 13 (4.50%) Apache Spark Developer
18 13 (4.50%) Hadoop Consultant
Libraries, Frameworks & Software Standards
1 80 (27.68%) Kafka
2 19 (6.57%) Spark Streaming
3 18 (6.23%) ELK Stack
4 17 (5.88%) Akka
5 15 (5.19%) REST
6 11 (3.81%) Apache Tez
7 10 (3.46%) JSON
8 9 (3.11%) Apache Avro
8 9 (3.11%) MLlib
9 8 (2.77%) AngularJS
9 8 (2.77%) Oracle GoldenGate
9 8 (2.77%) Play Framework
10 7 (2.42%) D3.js
10 7 (2.42%) spray
10 7 (2.42%) Spring
11 6 (2.08%) Browserify
11 6 (2.08%) J2EE
11 6 (2.08%) JMS
11 6 (2.08%) Spring Boot
11 6 (2.08%) Spring Integration
Miscellaneous
1 26 (9.00%) Computer Science
2 16 (5.54%) Grid Computing
3 13 (4.50%) Visualisation
4 10 (3.46%) Analytical Skills
4 10 (3.46%) Foreign Exchange (FX)
5 8 (2.77%) Management Information System
6 6 (2.08%) Algorithms
7 5 (1.73%) Data Centre
7 5 (1.73%) Interest Rate Derivative
7 5 (1.73%) Mathematics
8 4 (1.38%) Market Risk
8 4 (1.38%) Virtual Team
9 3 (1.04%) Clustering
9 3 (1.04%) Equities
9 3 (1.04%) Fixed Income
9 3 (1.04%) Replication
10 2 (0.69%) Data Structures
10 2 (0.69%) Statistics
11 1 (0.35%) PKI
11 1 (0.35%) Public Cloud
Operating Systems
1 128 (44.29%) Linux
2 70 (24.22%) Unix
3 20 (6.92%) Red Hat Enterprise Linux
4 5 (1.73%) Windows
5 2 (0.69%) CentOS
6 1 (0.35%) CoreOS
6 1 (0.35%) Ubuntu
Processes & Methodologies
1 104 (35.99%) MapReduce
2 76 (26.30%) Agile Software Development
3 74 (25.61%) DevOps
4 60 (20.76%) Continuous Integration
5 58 (20.07%) ETL
6 56 (19.38%) Scrum
7 40 (13.84%) Open Source
7 40 (13.84%) TDD
8 39 (13.49%) Analytics
9 37 (12.80%) Continuous Delivery
10 34 (11.76%) User Stories
11 29 (10.03%) Business Intelligence
12 28 (9.69%) Build Automation
13 25 (8.65%) Software Engineering
14 22 (7.61%) Data Modelling
14 22 (7.61%) Performance Tuning
15 20 (6.92%) BDD
15 20 (6.92%) High Availability
16 18 (6.23%) Data Architecture
16 18 (6.23%) Stakeholder Management
Programming Languages
1 154 (53.29%) Java
2 112 (38.75%) Python
3 94 (32.53%) Scala
4 84 (29.07%) SQL
5 35 (12.11%) Shell Script
6 25 (8.65%) R
7 15 (5.19%) Bash Shell
8 14 (4.84%) C
9 13 (4.50%) Perl
9 13 (4.50%) Ruby
10 9 (3.11%) C++
11 5 (1.73%) PL/SQL
12 4 (1.38%) MATLAB
13 3 (1.04%) HiveQL
14 2 (0.69%) JavaScript
14 2 (0.69%) PHP
15 1 (0.35%) ABAP
15 1 (0.35%) Go
Qualifications
1 35 (12.11%) Security Cleared
2 29 (10.03%) Degree
3 24 (8.30%) SC Cleared
4 19 (6.57%) DV Cleared
5 17 (5.88%) BPSS Clearance
6 2 (0.69%) PhD
Quality Assurance & Compliance
1 13 (4.50%) QA
2 7 (2.42%) SLA
3 5 (1.73%) Data Quality
4 2 (0.69%) Disclosure Scotland
System Software
1 51 (17.65%) Apache Flume
2 39 (13.49%) Apache ZooKeeper
3 31 (10.73%) VMware Infrastructure
4 30 (10.38%) vCloud
5 10 (3.46%) Active Directory
6 9 (3.11%) Oracle RAC
7 7 (2.42%) Docker
8 2 (0.69%) Btrfs
8 2 (0.69%) Ceph
9 1 (0.35%) VirtualBox
Systems Management
1 87 (30.10%) Hadoop YARN
2 51 (17.65%) Puppet
3 50 (17.30%) Oozie
4 24 (8.30%) Ambari
5 18 (6.23%) Ansible
6 14 (4.84%) Kibana
6 14 (4.84%) Nagios
7 10 (3.46%) logstash
8 7 (2.42%) Opscode Chef
9 6 (2.08%) Kubernetes
9 6 (2.08%) Terraform
10 5 (1.73%) Grafana
10 5 (1.73%) Graphite
10 5 (1.73%) Mesos
11 3 (1.04%) Control-M
11 3 (1.04%) Salt
12 2 (0.69%) SCOM
12 2 (0.69%) ZABBIX
13 1 (0.35%) Ganglia
Vendors
1 82 (28.37%) Cloudera
2 74 (25.61%) Hortonworks
3 31 (10.73%) VMware
4 24 (8.30%) Oracle
5 20 (6.92%) Red Hat
6 16 (5.54%) Teradata
7 14 (4.84%) Tableau
8 12 (4.15%) Informatica
9 9 (3.11%) Cisco
9 9 (3.11%) SaltStack
10 8 (2.77%) IBM
11 7 (2.42%) Google
11 7 (2.42%) SAP
12 6 (2.08%) Splunk
13 4 (1.38%) Ab Initio
13 4 (1.38%) Netezza
14 3 (1.04%) MapR
14 3 (1.04%) MicroStrategy
14 3 (1.04%) Talend
15 2 (0.69%) Rackspace
City, London
E-synergy Solutions
Rate: £550 - £600 per annum
Posted: 5 days ago
Somerset
Spring Technology
Rate: £350.00 - £359.00 per day + + SC Clearance
Posted: 5 days ago
South East London
GridCell
Rate: From £500 to £700 per day (Depending on experience)
Posted: 19 days ago