The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 19 January 2017 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
19 Jan 2017
Same period 2016 Same period 2015
Hadoop Distributed File System (HDFS)
UK
Rank 458 540 540
Rank change year-on-year
+82 0
Contract jobs citing HDFS 133 78 52
As % of all contract IT jobs located in the UK 0.30% 0.15% 0.10%
As % of the System Software category 2.46% 1.51% 1.01%
Number of daily rates quoted 76 46 36
Median daily rate £575 £600 £550
Median daily rate % change year-on-year
-4.16% +9.09%
90% offered a daily rate of more than £433 £450 £438
10% offered a daily rate of more than £688 £650 £713
UK excluding London median daily rate £450 £575 £525
% change year-on-year
-21.73% +9.52%
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate - - -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
5415 5161 5173
As % of all contract IT jobs located in the UK 12.11% 10.15% 10.17%
Number of daily rates quoted 3366 3085 2838
Median daily rate £400 £380 £363
Median daily rate % change year-on-year
+5.26% +4.82%
90% offered a daily rate of more than £200 £178 £186
10% offered a daily rate of more than £560 £550 £500
UK excluding London median daily rate £350 £350 £350
Number of hourly rates quoted 394 495 599
Median hourly rate £17.00 £16.50 £16.50
Median hourly rate % change year-on-year
+3.03% -
90% offered a hourly rate of more than £11.00 £10.69 £11.00
10% offered a hourly rate of more than £47.00 £43.00 £32.50
UK excluding London median hourly rate £16.25 £16.50 £16.50
% change year-on-year
-1.51% -

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 19 January 2017.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 25 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 19 January 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +96 132 £575 -4.16% 32
London +57 99 £580 -3.33% 26
South East - 18 £700 - 1
City of London +3 14 £580 +5.45% 6
Yorkshire +19 11 £430 -25.21%
Croydon - 10 - -
Berkshire - 10 £700 -
Reading - 9 £700 -
Leeds +17 8 £410 -
West Yorkshire +17 8 £410 -
Hampshire - 6 £475 - 1
South West +21 4 £440 -
Somerset - 4 £440 -
Sheffield 0 3 £498 -13.47%
South Yorkshire -3 3 £498 -13.47%
Docklands, London - 2 £613 -
Ipswich - 1 - -
Farnborough - 1 - -
Street - 1 - -
Taunton - 1 £440 -
West Sussex - 1 - -
South Wales - 1 - -
East of England - 1 - -
Wales - 1 - -
Suffolk - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 19 January 2017, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 296 (98.34%) Hadoop
2 264 (87.71%) Big Data
3 211 (70.10%) Apache Hive
4 198 (65.78%) Apache Spark
5 177 (58.80%) HBase
6 165 (54.82%) Java
7 140 (46.51%) Linux
8 117 (38.87%) Python
9 112 (37.21%) MapReduce
10 105 (34.88%) Scala
11 96 (31.89%) Apache Pig
12 94 (31.23%) DevOps
13 91 (30.23%) Kafka
14 89 (29.57%) Hadoop YARN
14 89 (29.57%) Agile Software Development
15 86 (28.57%) Hortonworks
16 82 (27.24%) SQL
17 79 (26.25%) Amazon AWS
18 76 (25.25%) Cloudera
18 76 (25.25%) NoSQL
18 76 (25.25%) Sqoop
19 72 (23.92%) Continuous Integration
20 71 (23.59%) Unix
21 66 (21.93%) Puppet
22 63 (20.93%) Oozie
23 62 (20.60%) ETL
24 60 (19.93%) Scrum
25 57 (18.94%) Finance
26 55 (18.27%) Banking
27 54 (17.94%) Apache Cassandra

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 198 (65.78%) Apache Spark
2 96 (31.89%) Apache Pig
3 43 (14.29%) Apache
4 25 (8.31%) Elasticsearch
5 20 (6.64%) Apache Solr
6 7 (2.33%) Cloud Foundry
6 7 (2.33%) Jupyter
6 7 (2.33%) Tomcat
7 6 (1.99%) GemFire
7 6 (1.99%) Oracle Coherence
7 6 (1.99%) SAS
8 5 (1.66%) Confluence
8 5 (1.66%) OpenStack
Applications
1 2 (0.66%) MS Excel
2 1 (0.33%) Stata
Business Applications
1 2 (0.66%) SAP Oil and Gas
Cloud Services
1 79 (26.25%) Amazon AWS
2 16 (5.32%) Cloud Computing
3 15 (4.98%) Microsoft Azure
4 13 (4.32%) GitHub
5 12 (3.99%) Amazon EMR
6 9 (2.99%) Google Cloud Platform
7 8 (2.66%) Amazon EC2
7 8 (2.66%) Amazon S3
7 8 (2.66%) IaaS
8 6 (1.99%) Office 365
8 6 (1.99%) PaaS
9 5 (1.66%) Sumo Logic
10 2 (0.66%) IBM Cloud
11 1 (0.33%) CloudFront
11 1 (0.33%) Flurry Analytics
11 1 (0.33%) Google Analytics
Communications & Networking
1 39 (12.96%) Kerberos
2 9 (2.99%) LAN
2 9 (2.99%) WAN
3 7 (2.33%) Network Security
4 6 (1.99%) FTP
5 5 (1.66%) DNS
5 5 (1.66%) HTTP
5 5 (1.66%) Internet
6 3 (1.00%) LDAP
7 2 (0.66%) Firewall
Database & Business Intelligence
1 296 (98.34%) Hadoop
2 264 (87.71%) Big Data
3 211 (70.10%) Apache Hive
4 177 (58.80%) HBase
5 76 (25.25%) NoSQL
5 76 (25.25%) Sqoop
6 54 (17.94%) Apache Cassandra
7 37 (12.29%) MySQL
8 34 (11.30%) Data Warehouse
9 33 (10.96%) Impala
10 32 (10.63%) Relational Database
11 28 (9.30%) MongoDB
12 26 (8.64%) PostgreSQL
13 20 (6.64%) Data Lake
13 20 (6.64%) SQL Server
14 16 (5.32%) QlikView
14 16 (5.32%) RDBMS
15 13 (4.32%) Neo4j
16 11 (3.65%) Apache Zeppelin
16 11 (3.65%) DB2
Development Applications
1 35 (11.63%) Jenkins
2 32 (10.63%) Git (software)
3 26 (8.64%) Maven
4 10 (3.32%) JUnit
5 9 (2.99%) JIRA
6 7 (2.33%) Eclipse
6 7 (2.33%) Selenium
7 6 (1.99%) Bundler
7 6 (1.99%) Gradle
7 6 (1.99%) Jasmine
7 6 (1.99%) Karma Test Runner
7 6 (1.99%) Protractor
7 6 (1.99%) Sonatype Nexus
7 6 (1.99%) Vagrant
7 6 (1.99%) WebDriver
8 5 (1.66%) Grunt
8 5 (1.66%) gulp
8 5 (1.66%) TeamCity
9 4 (1.33%) Cucumber
9 4 (1.33%) FindBugs
General
1 57 (18.94%) Finance
2 55 (18.27%) Banking
3 21 (6.98%) Front Office
4 15 (4.98%) Investment Banking
5 6 (1.99%) Retail
6 5 (1.66%) Financial Institution
6 5 (1.66%) Marketing
7 3 (1.00%) Legal
7 3 (1.00%) Telecoms
8 2 (0.66%) Electronics
8 2 (0.66%) Manufacturing
9 1 (0.33%) Advertising
9 1 (0.33%) Games
9 1 (0.33%) Law
Job Titles
1 88 (29.24%) Developer
2 72 (23.92%) Big Data Engineer
3 69 (22.92%) Data Engineer
4 55 (18.27%) Big Data Developer
5 43 (14.29%) Hadoop Developer
6 40 (13.29%) Administrator
7 39 (12.96%) Hadoop Engineer
8 35 (11.63%) DevOps Engineer
9 33 (10.96%) Consultant
10 29 (9.63%) Scala Developer
11 26 (8.64%) Hadoop Consultant
12 23 (7.64%) Hadoop Administrator
13 20 (6.64%) Architect
13 20 (6.64%) Data Administrator
13 20 (6.64%) Java Developer
14 17 (5.65%) Technical Leader
15 16 (5.32%) Apache Spark Developer
16 15 (4.98%) Big Data Consultant
16 15 (4.98%) Data Architect
16 15 (4.98%) Data Consultant
Libraries, Frameworks & Software Standards
1 91 (30.23%) Kafka
2 20 (6.64%) ELK Stack
3 17 (5.65%) Spark Streaming
4 16 (5.32%) Akka
4 16 (5.32%) REST
5 12 (3.99%) AngularJS
6 10 (3.32%) JSON
7 9 (2.99%) Apache Avro
7 9 (2.99%) Apache Tez
8 8 (2.66%) MLlib
8 8 (2.66%) Oracle GoldenGate
8 8 (2.66%) Play Framework
9 7 (2.33%) D3.js
9 7 (2.33%) spray
9 7 (2.33%) Web Services
10 6 (1.99%) Browserify
10 6 (1.99%) HTML
10 6 (1.99%) Spring
10 6 (1.99%) Spring Boot
10 6 (1.99%) Spring Integration
Miscellaneous
1 28 (9.30%) Computer Science
2 16 (5.32%) Grid Computing
3 13 (4.32%) Algorithms
3 13 (4.32%) Visualisation
4 11 (3.65%) Foreign Exchange (FX)
5 9 (2.99%) Analytical Skills
6 7 (2.33%) Replication
7 6 (1.99%) Data Centre
7 6 (1.99%) Management Information System
7 6 (1.99%) Mathematics
8 5 (1.66%) Interest Rate Derivative
9 4 (1.33%) Market Risk
9 4 (1.33%) Statistics
10 3 (1.00%) Clustering
10 3 (1.00%) Virtual Team
11 2 (0.66%) Equities
11 2 (0.66%) Fixed Income
12 1 (0.33%) Blog
12 1 (0.33%) Credit Risk
12 1 (0.33%) Data Extraction
Operating Systems
1 140 (46.51%) Linux
2 71 (23.59%) Unix
3 19 (6.31%) Red Hat Enterprise Linux
4 5 (1.66%) CoreOS
4 5 (1.66%) Windows
5 1 (0.33%) CentOS
Processes & Methodologies
1 112 (37.21%) MapReduce
2 94 (31.23%) DevOps
3 89 (29.57%) Agile Software Development
4 72 (23.92%) Continuous Integration
5 62 (20.60%) ETL
6 60 (19.93%) Scrum
7 52 (17.28%) Continuous Delivery
7 52 (17.28%) TDD
8 40 (13.29%) Open Source
9 38 (12.62%) Analytics
9 38 (12.62%) User Stories
10 33 (10.96%) Business Intelligence
11 31 (10.30%) Software Engineering
12 30 (9.97%) Build Automation
13 24 (7.97%) BDD
14 21 (6.98%) Data Engineering
14 21 (6.98%) Data Modelling
14 21 (6.98%) High Availability
15 20 (6.64%) Performance Tuning
16 18 (5.98%) Microservices
Programming Languages
1 165 (54.82%) Java
2 117 (38.87%) Python
3 105 (34.88%) Scala
4 82 (27.24%) SQL
5 32 (10.63%) Shell Script
6 26 (8.64%) R
7 14 (4.65%) Bash Shell
7 14 (4.65%) Ruby
8 13 (4.32%) C
9 9 (2.99%) C++
9 9 (2.99%) Perl
10 6 (1.99%) PHP
11 5 (1.66%) JavaScript
12 4 (1.33%) MATLAB
13 3 (1.00%) PL/SQL
14 2 (0.66%) Go
15 1 (0.33%) ABAP
15 1 (0.33%) C#
Qualifications
1 36 (11.96%) Security Cleared
2 30 (9.97%) Degree
3 27 (8.97%) SC Cleared
4 18 (5.98%) BPSS Clearance
5 16 (5.32%) DV Cleared
6 4 (1.33%) PhD
Quality Assurance & Compliance
1 18 (5.98%) QA
2 7 (2.33%) SLA
3 6 (1.99%) Data Quality
4 2 (0.66%) Disclosure Scotland
System Software
1 45 (14.95%) Apache ZooKeeper
2 38 (12.62%) Apache Flume
3 37 (12.29%) VMware Infrastructure
4 32 (10.63%) vCloud
5 13 (4.32%) Docker
6 9 (2.99%) Active Directory
6 9 (2.99%) Oracle RAC
7 5 (1.66%) VirtualBox
8 2 (0.66%) Btrfs
Systems Management
1 89 (29.57%) Hadoop YARN
2 66 (21.93%) Puppet
3 63 (20.93%) Oozie
4 41 (13.62%) Ansible
5 23 (7.64%) Ambari
6 22 (7.31%) Opscode Chef
7 21 (6.98%) Nagios
8 13 (4.32%) Terraform
9 12 (3.99%) Kibana
10 10 (3.32%) Kubernetes
11 8 (2.66%) logstash
11 8 (2.66%) Salt
12 6 (1.99%) ZABBIX
13 5 (1.66%) Grafana
13 5 (1.66%) Graphite
13 5 (1.66%) Mesos
14 2 (0.66%) SCOM
15 1 (0.33%) Control-M
Vendors
1 86 (28.57%) Hortonworks
2 76 (25.25%) Cloudera
3 37 (12.29%) VMware
4 31 (10.30%) Oracle
5 25 (8.31%) Red Hat
6 15 (4.98%) SaltStack
7 14 (4.65%) Teradata
8 13 (4.32%) Tableau
9 12 (3.99%) MicroStrategy
10 11 (3.65%) Ab Initio
11 10 (3.32%) Google
11 10 (3.32%) Splunk
12 9 (2.99%) Cisco
13 8 (2.66%) Informatica
14 7 (2.33%) IBM
15 6 (1.99%) SAP
16 5 (1.66%) New Relic
16 5 (1.66%) Rackspace
17 4 (1.33%) MapR
18 3 (1.00%) Talend
London
Lorien Resourcing
Rate: Competitive Rate
Posted: 3 hours ago
London
LA International
Rate: £500 - £550 per day
Posted: 3 days ago
London
Square One Resources
Rate: Up to £525 per day
Posted: 3 days ago
Manchester
Glocomms
Rate: £700 - £800 per day
Posted: 15 days ago