The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 24 February 2017 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
24 Feb 2017
Same period 2016 Same period 2015
Hadoop Distributed File System (HDFS)
UK
Rank 471 567 526
Rank change year-on-year
+96 -41
Contract jobs citing HDFS 137 61 85
As % of all contract IT jobs located in the UK 0.30% 0.12% 0.16%
As % of the System Software category 2.65% 1.14% 1.60%
Number of daily rates quoted 92 40 63
Median daily rate £568 £525 £538
Median daily rate % change year-on-year
+8.09% -2.32%
90% offered a daily rate of more than £410 £400 £430
10% offered a daily rate of more than £650 £625 £725
UK excluding London median daily rate £445 £500 £500
% change year-on-year
-11.00% -
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate - - -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
5163 5356 5328
As % of all contract IT jobs located in the UK 11.37% 10.30% 10.15%
Number of daily rates quoted 3266 3199 2931
Median daily rate £400 £375 £375
Median daily rate % change year-on-year
+6.66% -
90% offered a daily rate of more than £190 £190 £188
10% offered a daily rate of more than £575 £525 £500
UK excluding London median daily rate £350 £350 £350
Number of hourly rates quoted 374 480 598
Median hourly rate £17.50 £16.00 £16.50
Median hourly rate % change year-on-year
+9.37% -3.03%
90% offered a hourly rate of more than £10.50 £11.00 £11.00
10% offered a hourly rate of more than £47.00 £43.00 £32.52
UK excluding London median hourly rate £16.00 £16.00 £16.00

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 24 February 2017.

HDFS Daily Rate Histogram in the UK

HDFS
Top 30 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 24 February 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +109 134 £573 +9.04% 21
London +78 98 £575 +9.52% 14
South East - 20 £700 - 3
City of London +11 18 £580 +10.47% 4
Berkshire - 12 £700 - 2
Yorkshire +26 11 £430 -25.21% 1
Reading - 11 £700 - 2
West Yorkshire +29 9 £410 - 1
Leeds +15 9 £410 - 1
Croydon - 6 £400 -
South West +19 5 £440 -
Somerset - 5 £440 -
Hampshire - 5 £400 -
South Wales - 3 £500 -
Wales - 3 £500 -
South Yorkshire +1 2 £488 -15.21%
Sheffield -2 2 £488 -15.21%
Buckinghamshire - 2 £338 -
Street - 2 £483 -
Milton Keynes - 2 £338 -
Newport - 2 £500 -
North West +19 1 £420 -6.66%
East of England - 1 £400 - 3
Cambridgeshire - 1 £400 - 1
March - 1 £400 -
Warrington - 1 £420 -
Farnborough - 1 - -
Taunton - 1 £440 -
Docklands, London - 1 £575 -
West Sussex - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 24 February 2017, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 308 (98.40%) Hadoop
2 267 (85.30%) Big Data
3 209 (66.77%) Apache Spark
4 208 (66.45%) Apache Hive
5 183 (58.47%) HBase
6 172 (54.95%) Java
7 145 (46.33%) Linux
8 131 (41.85%) Python
9 113 (36.10%) Scala
10 111 (35.46%) MapReduce
11 102 (32.59%) Apache Pig
12 100 (31.95%) Hadoop YARN
13 96 (30.67%) Kafka
14 95 (30.35%) DevOps
15 86 (27.48%) Hortonworks
15 86 (27.48%) Agile Software Development
16 81 (25.88%) Cloudera
17 75 (23.96%) Amazon AWS
18 74 (23.64%) Sqoop
19 72 (23.00%) NoSQL
20 71 (22.68%) SQL
21 67 (21.41%) Oozie
21 67 (21.41%) Banking
22 66 (21.09%) Finance
22 66 (21.09%) Puppet
23 65 (20.77%) Unix
24 64 (20.45%) Continuous Integration
25 57 (18.21%) Apache Cassandra
26 56 (17.89%) ETL
26 56 (17.89%) Scrum

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 209 (66.77%) Apache Spark
2 102 (32.59%) Apache Pig
3 42 (13.42%) Apache
4 25 (7.99%) Apache Solr
5 23 (7.35%) Elasticsearch
6 7 (2.24%) Jupyter
7 6 (1.92%) Cloud Foundry
7 6 (1.92%) SAS
8 5 (1.60%) Confluence
8 5 (1.60%) OpenStack
8 5 (1.60%) Oracle Coherence
9 4 (1.28%) Tomcat
10 3 (0.96%) GemFire
Applications
1 2 (0.64%) MS Excel
2 1 (0.32%) Stata
Business Applications
1 2 (0.64%) SAP S/4HANA
2 1 (0.32%) SAP Oil and Gas
Cloud Services
1 75 (23.96%) Amazon AWS
2 18 (5.75%) Cloud Computing
3 16 (5.11%) Amazon S3
4 14 (4.47%) Microsoft Azure
5 13 (4.15%) Amazon EMR
6 12 (3.83%) Amazon EC2
7 11 (3.51%) Google Cloud Platform
8 8 (2.56%) IaaS
9 6 (1.92%) Office 365
10 5 (1.60%) GitHub
10 5 (1.60%) Loggly
10 5 (1.60%) Sumo Logic
11 4 (1.28%) Amazon CloudWatch
11 4 (1.28%) Amazon ELB
11 4 (1.28%) AWS CloudFormation
11 4 (1.28%) Virtual Private Cloud
12 3 (0.96%) PaaS
13 2 (0.64%) IBM Cloud
14 1 (0.32%) CloudFront
14 1 (0.32%) Flurry Analytics
Communications & Networking
1 43 (13.74%) Kerberos
2 9 (2.88%) LAN
2 9 (2.88%) WAN
3 7 (2.24%) Network Security
4 6 (1.92%) HTTP
4 6 (1.92%) LDAP
5 5 (1.60%) DNS
5 5 (1.60%) Internet
6 4 (1.28%) FTP
6 4 (1.28%) SSL
7 2 (0.64%) Firewall
8 1 (0.32%) TCP/IP
8 1 (0.32%) tcpdump
8 1 (0.32%) Wireshark
Database & Business Intelligence
1 308 (98.40%) Hadoop
2 267 (85.30%) Big Data
3 208 (66.45%) Apache Hive
4 183 (58.47%) HBase
5 74 (23.64%) Sqoop
6 72 (23.00%) NoSQL
7 57 (18.21%) Apache Cassandra
8 43 (13.74%) MySQL
9 40 (12.78%) Impala
10 32 (10.22%) Relational Database
11 28 (8.95%) MongoDB
12 27 (8.63%) Data Warehouse
13 24 (7.67%) PostgreSQL
14 19 (6.07%) RDBMS
15 17 (5.43%) QlikView
16 16 (5.11%) Data Lake
17 15 (4.79%) Neo4j
17 15 (4.79%) SQL Server
18 13 (4.15%) Apache Zeppelin
18 13 (4.15%) DB2
Development Applications
1 28 (8.95%) Git (software)
1 28 (8.95%) Jenkins
2 19 (6.07%) Maven
3 9 (2.88%) JIRA
3 9 (2.88%) Selenium
4 8 (2.56%) Bundler
4 8 (2.56%) Jasmine
4 8 (2.56%) Karma Test Runner
4 8 (2.56%) Protractor
4 8 (2.56%) WebDriver
5 7 (2.24%) gulp
5 7 (2.24%) JUnit
6 6 (1.92%) Vagrant
6 6 (1.92%) webpack
7 5 (1.60%) Babel
7 5 (1.60%) Grunt
7 5 (1.60%) Talend Open Studio
8 4 (1.28%) Eclipse
8 4 (1.28%) Sonatype Nexus
8 4 (1.28%) Subversion
General
1 67 (21.41%) Banking
2 66 (21.09%) Finance
3 26 (8.31%) Front Office
4 17 (5.43%) Investment Banking
5 6 (1.92%) Marketing
6 5 (1.60%) Retail
7 3 (0.96%) Financial Institution
7 3 (0.96%) Telecoms
8 2 (0.64%) Law
9 1 (0.32%) Advertising
9 1 (0.32%) Electronics
9 1 (0.32%) Games
9 1 (0.32%) Legal
9 1 (0.32%) Manufacturing
Job Titles
1 99 (31.63%) Developer
2 68 (21.73%) Big Data Engineer
3 63 (20.13%) Data Engineer
4 56 (17.89%) Big Data Developer
5 44 (14.06%) Administrator
6 37 (11.82%) Hadoop Developer
7 36 (11.50%) DevOps Engineer
8 34 (10.86%) Hadoop Engineer
9 31 (9.90%) Consultant
10 27 (8.63%) Scala Developer
11 25 (7.99%) Hadoop Administrator
12 22 (7.03%) Hadoop Consultant
13 20 (6.39%) Data Administrator
13 20 (6.39%) Java Developer
14 19 (6.07%) Apache Spark Developer
15 18 (5.75%) Architect
16 15 (4.79%) Technical Leader
17 14 (4.47%) Big Data Architect
17 14 (4.47%) Data Architect
18 12 (3.83%) Big Data Consultant
Libraries, Frameworks & Software Standards
1 96 (30.67%) Kafka
2 23 (7.35%) Spark Streaming
3 19 (6.07%) Elastic Stack
4 14 (4.47%) AngularJS
4 14 (4.47%) REST
5 13 (4.15%) HTML
6 12 (3.83%) Akka
7 11 (3.51%) D3.js
7 11 (3.51%) HTML5
8 10 (3.19%) Apache Avro
8 10 (3.19%) Node.js
8 10 (3.19%) Spring
9 9 (2.88%) Apache Tez
10 8 (2.56%) Browserify
10 8 (2.56%) Oracle GoldenGate
11 7 (2.24%) JSON
11 7 (2.24%) Middleware
12 6 (1.92%) Play Framework
12 6 (1.92%) WebSockets
12 6 (1.92%) XML
Miscellaneous
1 31 (9.90%) Computer Science
2 18 (5.75%) Foreign Exchange (FX)
3 16 (5.11%) Algorithms
3 16 (5.11%) Grid Computing
4 9 (2.88%) Derivative
5 8 (2.56%) Analytical Skills
6 7 (2.24%) Data Centre
7 6 (1.92%) Fintech
7 6 (1.92%) Fixed Income
8 5 (1.60%) Replication
8 5 (1.60%) User Experience
9 4 (1.28%) Interest Rate Derivative
10 3 (0.96%) Clustering
10 3 (0.96%) Linux Command Line
10 3 (0.96%) Market Risk
11 2 (0.64%) Data Structures
11 2 (0.64%) Equities
11 2 (0.64%) Equity Derivative
11 2 (0.64%) Management Information System
12 1 (0.32%) Blog
Operating Systems
1 145 (46.33%) Linux
2 65 (20.77%) Unix
3 24 (7.67%) Red Hat Enterprise Linux
4 7 (2.24%) Windows
5 5 (1.60%) CoreOS
6 4 (1.28%) CentOS
7 3 (0.96%) Fedora
8 2 (0.64%) Debian
8 2 (0.64%) Ubuntu
Processes & Methodologies
1 111 (35.46%) MapReduce
2 95 (30.35%) DevOps
3 86 (27.48%) Agile Software Development
4 64 (20.45%) Continuous Integration
5 56 (17.89%) ETL
5 56 (17.89%) Scrum
6 49 (15.65%) TDD
7 44 (14.06%) Analytics
8 42 (13.42%) Continuous Delivery
9 40 (12.78%) Open Source
10 31 (9.90%) User Stories
11 30 (9.58%) Business Intelligence
12 23 (7.35%) Build Automation
13 22 (7.03%) BDD
14 21 (6.71%) Configuration Management
15 20 (6.39%) Data Engineering
15 20 (6.39%) Data Modelling
15 20 (6.39%) Performance Tuning
16 19 (6.07%) Software Engineering
17 18 (5.75%) Machine Learning
Programming Languages
1 172 (54.95%) Java
2 131 (41.85%) Python
3 113 (36.10%) Scala
4 71 (22.68%) SQL
5 28 (8.95%) R
5 28 (8.95%) Shell Script
6 21 (6.71%) Bash Shell
6 21 (6.71%) Ruby
7 14 (4.47%) JavaScript
8 12 (3.83%) C++
9 11 (3.51%) C
9 11 (3.51%) Perl
10 6 (1.92%) ES6
10 6 (1.92%) PHP
11 4 (1.28%) MATLAB
12 2 (0.64%) C#
12 2 (0.64%) Go
12 2 (0.64%) PL/SQL
13 1 (0.32%) ABAP
Qualifications
1 30 (9.58%) Degree
1 30 (9.58%) Security Cleared
2 25 (7.99%) SC Cleared
3 14 (4.47%) DV Cleared
4 9 (2.88%) BPSS Clearance
5 5 (1.60%) PhD
6 1 (0.32%) ISTQB
6 1 (0.32%) ISTQB Foundation Certification
Quality Assurance & Compliance
1 16 (5.11%) QA
2 7 (2.24%) MiFID
2 7 (2.24%) SLA
3 6 (1.92%) Data Quality
4 2 (0.64%) Disclosure Scotland
5 1 (0.32%) Dodd-Frank
5 1 (0.32%) EMIR
System Software
1 47 (15.02%) Apache ZooKeeper
2 41 (13.10%) Apache Flume
3 28 (8.95%) VMware Infrastructure
4 23 (7.35%) vCloud
5 17 (5.43%) Docker
6 13 (4.15%) Active Directory
7 9 (2.88%) Oracle RAC
8 5 (1.60%) VirtualBox
9 1 (0.32%) Btrfs
Systems Management
1 100 (31.95%) Hadoop YARN
2 67 (21.41%) Oozie
3 66 (21.09%) Puppet
4 51 (16.29%) Ansible
5 25 (7.99%) Opscode Chef
6 23 (7.35%) Terraform
7 22 (7.03%) Nagios
8 21 (6.71%) Ambari
9 13 (4.15%) Kubernetes
10 9 (2.88%) Mesos
11 8 (2.56%) Kibana
11 8 (2.56%) Salt
12 6 (1.92%) Grafana
12 6 (1.92%) Graphite
13 5 (1.60%) ZABBIX
14 4 (1.28%) logstash
15 2 (0.64%) SCOM
16 1 (0.32%) Rancher
Vendors
1 86 (27.48%) Hortonworks
2 81 (25.88%) Cloudera
3 32 (10.22%) VMware
4 30 (9.58%) Oracle
5 26 (8.31%) Red Hat
6 16 (5.11%) SaltStack
7 14 (4.47%) Tableau
7 14 (4.47%) Teradata
8 13 (4.15%) Ab Initio
9 12 (3.83%) Google
9 12 (3.83%) MicroStrategy
9 12 (3.83%) Splunk
10 9 (2.88%) Cisco
11 8 (2.56%) Informatica
12 5 (1.60%) New Relic
12 5 (1.60%) Rackspace
12 5 (1.60%) SAP
12 5 (1.60%) Talend
13 4 (1.28%) IBM
13 4 (1.28%) MapR
City of London
Huxley
Rate: £550 - £650 per day
Posted: 21 hours ago
Reading, Berkshire
Masento
Rate: From £500 to £600 per day all inclusive
Posted: Yesterday
London
Icore Tech
Rate: £400 - £401 per day + Negotiable
Posted: Yesterday
London
TEKsystems
Rate: £600 - £700 per day
Posted: 2 days ago
Reading, Berkshire
Seven Principles Consulting
Rate: From £450 to £500 per day
Posted: 3 days ago
London
Computer People
Posted: 6 days ago