The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 4 May 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
4 May 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 562 572 609
Rank change year-on-year
+10 +37
Contract jobs citing HDFS 85 64 12
As % of all contract IT jobs located in the UK 0.15% 0.11% 0.022%
As % of the System Software category 1.33% 1.14% 0.22%
Number of daily rates quoted 69 47 9
Median daily rate £500 £588 £425
Median daily rate % change year-on-year
-14.89% +38.23%
90% offered a daily rate of more than £383 £446 £375
10% offered a daily rate of more than £650 £725 £475
UK excluding London median daily rate £475 £513 -
% change year-on-year
-7.31% -
Number of hourly rates quoted 0 4 0
Median hourly rate - £26.00 -
UK excluding London median hourly rate - £26.00 -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
6413 5616 5403
As % of all contract IT jobs located in the UK 11.54% 10.06% 9.91%
Number of daily rates quoted 3951 3105 2800
Median daily rate £388 £350 £345
Median daily rate % change year-on-year
+10.71% +1.44%
90% offered a daily rate of more than £200 £187 £163
10% offered a daily rate of more than £538 £500 £463
UK excluding London median daily rate £360 £338 £315
% change year-on-year
+6.66% +7.14%
Number of hourly rates quoted 460 671 627
Median hourly rate £17.50 £17.00 £16.50
Median hourly rate % change year-on-year
+2.94% +3.03%
90% offered a hourly rate of more than £11.37 £11.00 £11.00
10% offered a hourly rate of more than £42.08 £38.13 £35.00
UK excluding London median hourly rate £17.50 £16.50 £16.38
% change year-on-year
+6.06% +0.76%

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 4 May 2016.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 20 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 4 May 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England 0 84 £500 -14.89% 16
London +13 66 £550 -6.46% 11
West Midlands - 10 £500 - 1
City of London +39 9 £425 -29.16% 2
South East -6 5 £369 - 2
North West -1 3 - -
Canary Wharf - 3 £650 -
Crawley - 2 £369 -
Merseyside - 2 - -
West Sussex - 2 £369 -
Milton Keynes +10 1 £325 -
Buckinghamshire +7 1 £325 -
Berkshire - 1 £500 - 1
Northern Ireland - 1 - -
Liverpool - 1 - -
Wirral - 1 - -
Reading - 1 £500 - 1
Belfast - 1 - -
Southwark - 1 £250 -
County Antrim - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 4 May 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 147 (96.08%) Hadoop
2 126 (82.35%) Big Data
3 121 (79.08%) Apache Hive
4 99 (64.71%) Apache Spark
5 88 (57.52%) Java
6 63 (41.18%) Apache Pig
7 57 (37.25%) Scala
8 54 (35.29%) HBase
9 47 (30.72%) MapReduce
10 45 (29.41%) Agile Software Development
11 44 (28.76%) Kafka
12 41 (26.80%) Python
13 34 (22.22%) Sqoop
14 33 (21.57%) SQL
15 31 (20.26%) Apache Flume
15 31 (20.26%) Impala
16 30 (19.61%) Business Intelligence
17 28 (18.30%) Linux
18 27 (17.65%) Cloudera
19 25 (16.34%) TDD
19 25 (16.34%) Oracle
20 22 (14.38%) Shell Script
20 22 (14.38%) NoSQL
20 22 (14.38%) Analytics
21 21 (13.73%) Hortonworks
21 21 (13.73%) Unix
22 20 (13.07%) Data Modelling
23 18 (11.76%) ETL
23 18 (11.76%) Microsoft Azure
23 18 (11.76%) Oozie

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 99 (64.71%) Apache Spark
2 63 (41.18%) Apache Pig
3 9 (5.88%) Apache
4 7 (4.58%) SAS
5 6 (3.92%) Elasticsearch
5 6 (3.92%) JBoss
6 4 (2.61%) Apache Solr
6 4 (2.61%) Node.js
7 1 (0.65%) Confluence
7 1 (0.65%) OpenStack
7 1 (0.65%) Oracle Workflow
Applications
1 2 (1.31%) MS Visio
2 1 (0.65%) Spreadsheet
2 1 (0.65%) SPSS
Cloud Services
1 18 (11.76%) Microsoft Azure
2 13 (8.50%) Amazon AWS
3 1 (0.65%) Amazon S3
3 1 (0.65%) IaaS
Communications & Networking
1 7 (4.58%) Kerberos
2 2 (1.31%) HTTP
2 2 (1.31%) SAN
3 1 (0.65%) Broadband
3 1 (0.65%) DNS
3 1 (0.65%) Internet
3 1 (0.65%) TCP/IP
3 1 (0.65%) Wireshark
Database & Business Intelligence
1 147 (96.08%) Hadoop
2 126 (82.35%) Big Data
3 121 (79.08%) Apache Hive
4 54 (35.29%) HBase
5 34 (22.22%) Sqoop
6 31 (20.26%) Impala
7 22 (14.38%) NoSQL
8 16 (10.46%) Data Warehouse
8 16 (10.46%) SQL Server
9 12 (7.84%) Relational Database
10 11 (7.19%) MongoDB
11 10 (6.54%) Apache Cassandra
12 8 (5.23%) Data Mining
13 7 (4.58%) RDBMS
14 6 (3.92%) Mahout
14 6 (3.92%) MySQL
14 6 (3.92%) SAP HANA
14 6 (3.92%) SQL Server Analysis Services
14 6 (3.92%) SQL Server Integration Services
15 5 (3.27%) HCatalog
Development Applications
1 10 (6.54%) Jenkins
2 8 (5.23%) Git (software)
2 8 (5.23%) JIRA
3 4 (2.61%) Bugzilla
3 4 (2.61%) Hudson
3 4 (2.61%) Subversion
4 3 (1.96%) Maven
5 2 (1.31%) Cucumber
5 2 (1.31%) JUnit
5 2 (1.31%) PyUnit
5 2 (1.31%) RSpec
6 1 (0.65%) ANTLR
6 1 (0.65%) Eclipse
6 1 (0.65%) GitLab
6 1 (0.65%) JMeter
6 1 (0.65%) LoadRunner
6 1 (0.65%) NeoLoad
6 1 (0.65%) RStudio
6 1 (0.65%) SilkPerformer
6 1 (0.65%) Visual Studio
General
1 17 (11.11%) Banking
2 16 (10.46%) Finance
3 6 (3.92%) Retail
4 4 (2.61%) Back Office
4 4 (2.61%) Investment Banking
5 2 (1.31%) Telecoms
6 1 (0.65%) Front Office
6 1 (0.65%) German Language
6 1 (0.65%) Manufacturing
6 1 (0.65%) Pharmaceutical
Job Titles
1 70 (45.75%) Developer
2 48 (31.37%) Hadoop Developer
3 40 (26.14%) Big Data Developer
4 27 (17.65%) Architect
5 18 (11.76%) Big Data Architect
5 18 (11.76%) Data Architect
6 15 (9.80%) Big Data Engineer
6 15 (9.80%) Data Engineer
6 15 (9.80%) Hadoop Architect
6 15 (9.80%) Hadoop Engineer
7 14 (9.15%) Apache Spark Developer
7 14 (9.15%) Java Developer
8 11 (7.19%) Consultant
9 10 (6.54%) Senior Developer
10 9 (5.88%) Senior Hadoop Developer
11 8 (5.23%) Cloud Developer
11 8 (5.23%) Scala Developer
11 8 (5.23%) Senior Big Data Developer
12 7 (4.58%) Hadoop Consultant
12 7 (4.58%) Java Hadoop Developer
Libraries, Frameworks & Software Standards
1 44 (28.76%) Kafka
2 10 (6.54%) REST
2 10 (6.54%) Web Services
3 8 (5.23%) Spring
4 7 (4.58%) Hibernate
4 7 (4.58%) JSON
5 6 (3.92%) Drools
6 5 (3.27%) HTML
7 4 (2.61%) HTML5
7 4 (2.61%) J2EE
7 4 (2.61%) JDBC
7 4 (2.61%) ODBC
7 4 (2.61%) RESTful
7 4 (2.61%) SOAP
7 4 (2.61%) Struts
8 3 (1.96%) Akka
8 3 (1.96%) Cascading
8 3 (1.96%) Spark Streaming
9 2 (1.31%) Apache Avro
10 1 (0.65%) Play Framework
Miscellaneous
1 5 (3.27%) Visualisation
2 4 (2.61%) Analytical Skills
2 4 (2.61%) Computer Science
2 4 (2.61%) Data Structures
3 3 (1.96%) Mathematics
3 3 (1.96%) Replication
4 2 (1.31%) Credit Risk
4 2 (1.31%) Data Integration
4 2 (1.31%) Fintech
4 2 (1.31%) Grid Computing
4 2 (1.31%) iSeries
5 1 (0.65%) Algorithms
5 1 (0.65%) Blockchain
5 1 (0.65%) Clustering
5 1 (0.65%) Enterprise Software
5 1 (0.65%) Hedge funds
5 1 (0.65%) Life Science
5 1 (0.65%) Mainframe
5 1 (0.65%) Management Information System
5 1 (0.65%) Physics
Operating Systems
1 28 (18.30%) Linux
2 21 (13.73%) Unix
3 5 (3.27%) Windows
4 4 (2.61%) Red Hat Enterprise Linux
5 1 (0.65%) CentOS
5 1 (0.65%) Fedora
5 1 (0.65%) Solaris
5 1 (0.65%) Ubuntu
5 1 (0.65%) Windows 2000
5 1 (0.65%) Windows XP
Processes & Methodologies
1 47 (30.72%) MapReduce
2 45 (29.41%) Agile Software Development
3 30 (19.61%) Business Intelligence
4 25 (16.34%) TDD
5 22 (14.38%) Analytics
6 20 (13.07%) Data Modelling
7 18 (11.76%) ETL
8 15 (9.80%) Open Source
8 15 (9.80%) Scrum
9 13 (8.50%) Continuous Delivery
9 13 (8.50%) Continuous Integration
10 12 (7.84%) E-Commerce
10 12 (7.84%) High Availability
11 9 (5.88%) BDD
12 8 (5.23%) Automated Testing
12 8 (5.23%) Data Analytics
12 8 (5.23%) Functional Programming
12 8 (5.23%) Kanban
12 8 (5.23%) Multithreading
12 8 (5.23%) Pair Programming
Programming Languages
1 88 (57.52%) Java
2 57 (37.25%) Scala
3 41 (26.80%) Python
4 33 (21.57%) SQL
5 22 (14.38%) Shell Script
6 12 (7.84%) R
7 6 (3.92%) Bash Shell
8 5 (3.27%) C#
8 5 (3.27%) PL/SQL
9 4 (2.61%) Perl
9 4 (2.61%) PHP
9 4 (2.61%) Ruby
9 4 (2.61%) T-SQL
10 3 (1.96%) C
11 2 (1.31%) VBA
12 1 (0.65%) COBOL
12 1 (0.65%) Groovy
12 1 (0.65%) HiveQL
12 1 (0.65%) JAQL
12 1 (0.65%) Pig Latin
Qualifications
1 11 (7.19%) Security Cleared
2 9 (5.88%) Degree
3 8 (5.23%) DV Cleared
4 7 (4.58%) SC Cleared
5 1 (0.65%) BC Cleared
5 1 (0.65%) BPSS Clearance
5 1 (0.65%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 4 (2.61%) QA
2 1 (0.65%) Data Quality
System Software
1 31 (20.26%) Apache Flume
2 8 (5.23%) Apache ZooKeeper
3 2 (1.31%) vCloud
3 2 (1.31%) VMware Infrastructure
4 1 (0.65%) Active Directory
4 1 (0.65%) Docker
Systems Management
1 18 (11.76%) Oozie
2 17 (11.11%) Hadoop YARN
3 10 (6.54%) Ambari
4 5 (3.27%) Puppet
5 1 (0.65%) Ansible
5 1 (0.65%) Control-M
5 1 (0.65%) Ganglia
5 1 (0.65%) Graphite
5 1 (0.65%) HP Quality Center
5 1 (0.65%) Kubernetes
5 1 (0.65%) Nagios
5 1 (0.65%) OpenAM
5 1 (0.65%) Opscode Chef
5 1 (0.65%) Perfmon
5 1 (0.65%) Salt
Vendors
1 27 (17.65%) Cloudera
2 25 (16.34%) Oracle
3 21 (13.73%) Hortonworks
4 14 (9.15%) Informatica
5 13 (8.50%) MapR
6 7 (4.58%) Tableau
7 6 (3.92%) SAP
8 5 (3.27%) IBM
8 5 (3.27%) Teradata
9 4 (2.61%) Splunk
10 3 (1.96%) Red Hat
11 2 (1.31%) Cognos
11 2 (1.31%) HP
11 2 (1.31%) Platfora
11 2 (1.31%) Rackspace
11 2 (1.31%) Vertica
11 2 (1.31%) VMware
12 1 (0.65%) AppDynamics
12 1 (0.65%) Dynatrace
12 1 (0.65%) WorldPay
City, London
E-synergy Solutions
Rate: £750 - £850 per annum
Posted: 5 days ago
London
Venturi
Rate: £550 - £600 per day
Posted: 26 days ago