The table below looks at the statistics for HDFS skills in IT contracts advertised across the UK. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 24 May 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
24 May 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 571 574 599
Rank change year-on-year
+3 +25
Contract jobs citing HDFS 80 50 12
As % of all contract IT jobs located in the UK 0.15% 0.092% 0.022%
As % of the System Software category 1.23% 0.91% 0.23%
Number of daily rates quoted 65 36 7
Median daily rate £525 £588 £450
Median daily rate % change year-on-year
-10.63% +30.55%
90% offered a daily rate of more than £393 £440 £375
10% offered a daily rate of more than £650 £725 £770
UK excluding London median daily rate £500 £500 -
Number of hourly rates quoted 0 4 0
Median hourly rate - £26.00 -
UK excluding London median hourly rate - £26.00 -

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised across the UK.

System Software Category
UK
Contract IT job ads with a match in the
System Software category
6481 5509 5319
As % of all contract IT jobs located in the UK 12.10% 10.17% 9.93%
Number of daily rates quoted 3984 3079 2814
Median daily rate £400 £350 £338
Median daily rate % change year-on-year
+14.28% +3.70%
90% offered a daily rate of more than £200 £180 £165
10% offered a daily rate of more than £550 £500 £463
UK excluding London median daily rate £360 £325 £315
% change year-on-year
+10.76% +3.17%
Number of hourly rates quoted 433 646 648
Median hourly rate £18.50 £17.00 £16.00
Median hourly rate % change year-on-year
+8.82% +6.25%
90% offered a hourly rate of more than £11.45 £11.00 £10.38
10% offered a hourly rate of more than £41.60 £38.25 £33.00
UK excluding London median hourly rate £19.00 £16.50 £15.63
% change year-on-year
+15.15% +5.60%

HDFS
Jobs Demand Trend

The demand trend of contract jobs citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in the UK

HDFS
Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS within the UK.

HDFS Daily Rate Trend in the UK

HDFS
Daily Rate Histogram

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS within the UK over the 3 months to 24 May 2016.

HDFS Daily Rate Histogram in the UK

HDFS
Hourly Rate Trend

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS within the UK.

HDFS Hourly Rate Trend in the UK

HDFS
Top 20 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 3 months to 24 May 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +21 78 £525 -10.63% 14
London +21 63 £563 -6.25% 11
City of London +33 9 £425 -28.42% 3
West Midlands - 7 £500 -
South East -7 5 £369 +84.37% 3
North West -7 3 - -
Canary Wharf - 3 £650 -
Crawley - 2 £369 -
West Sussex - 2 £369 -
Buckinghamshire +5 1 £325 +62.50%
Milton Keynes +4 1 £325 -
Stirling - 1 - -
Scotland - 1 - -
Northern Ireland - 1 - -
Liverpool - 1 - -
Merseyside - 1 - -
Berkshire - 1 £500 - 2
Belfast - 1 - -
Reading - 1 £500 - 1
County Antrim - 1 - -

HDFS
Top 30 Related IT Skills

For the 6 months to 24 May 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for HDFS.

1 135 (95.74%) Hadoop
2 118 (83.69%) Big Data
3 111 (78.72%) Apache Hive
4 88 (62.41%) Apache Spark
5 81 (57.45%) Java
6 54 (38.30%) Scala
6 54 (38.30%) Apache Pig
7 48 (34.04%) HBase
8 45 (31.91%) Agile Software Development
9 41 (29.08%) Kafka
9 41 (29.08%) MapReduce
10 35 (24.82%) Python
11 34 (24.11%) Business Intelligence
12 29 (20.57%) Sqoop
13 27 (19.15%) Apache Flume
13 27 (19.15%) Impala
14 25 (17.73%) Oracle
15 24 (17.02%) SQL
15 24 (17.02%) Linux
15 24 (17.02%) Cloudera
16 23 (16.31%) Analytics
17 22 (15.60%) TDD
17 22 (15.60%) NoSQL
18 21 (14.89%) Shell Script
18 21 (14.89%) Unix
19 20 (14.18%) Hortonworks
20 17 (12.06%) Banking
20 17 (12.06%) Open Source
21 16 (11.35%) Scrum
22 15 (10.64%) Oozie

HDFS
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 88 (62.41%) Apache Spark
2 54 (38.30%) Apache Pig
3 9 (6.38%) Apache
4 7 (4.96%) SAS
5 4 (2.84%) Apache Solr
6 3 (2.13%) Elasticsearch
6 3 (2.13%) JBoss
7 1 (0.71%) Confluence
7 1 (0.71%) nginx
7 1 (0.71%) Node.js
7 1 (0.71%) OpenStack
7 1 (0.71%) Oracle Workflow
7 1 (0.71%) Tomcat
Applications
1 2 (1.42%) MS Visio
2 1 (0.71%) Spreadsheet
2 1 (0.71%) SPSS
Cloud Services
1 14 (9.93%) Microsoft Azure
2 12 (8.51%) Amazon AWS
3 2 (1.42%) Amazon S3
4 1 (0.71%) Amazon EC2
4 1 (0.71%) CloudFront
4 1 (0.71%) IaaS
Communications & Networking
1 7 (4.96%) Kerberos
2 2 (1.42%) HTTP
3 1 (0.71%) Broadband
3 1 (0.71%) DNS
3 1 (0.71%) Internet
3 1 (0.71%) SAN
3 1 (0.71%) TCP/IP
3 1 (0.71%) Wireshark
Database & Business Intelligence
1 135 (95.74%) Hadoop
2 118 (83.69%) Big Data
3 111 (78.72%) Apache Hive
4 48 (34.04%) HBase
5 29 (20.57%) Sqoop
6 27 (19.15%) Impala
7 22 (15.60%) NoSQL
8 15 (10.64%) Data Warehouse
9 14 (9.93%) Relational Database
10 12 (8.51%) SQL Server
11 8 (5.67%) Apache Cassandra
11 8 (5.67%) RDBMS
12 7 (4.96%) MongoDB
12 7 (4.96%) MySQL
13 6 (4.26%) SAP HANA
14 5 (3.55%) HCatalog
14 5 (3.55%) Mahout
14 5 (3.55%) PostgreSQL
14 5 (3.55%) QlikView
15 4 (2.84%) Pentaho
Development Applications
1 10 (7.09%) Jenkins
2 8 (5.67%) Git (software)
2 8 (5.67%) JIRA
3 4 (2.84%) Bugzilla
3 4 (2.84%) Hudson
3 4 (2.84%) Subversion
4 3 (2.13%) Maven
5 2 (1.42%) Cucumber
5 2 (1.42%) JUnit
5 2 (1.42%) PyUnit
5 2 (1.42%) RSpec
6 1 (0.71%) ANTLR
6 1 (0.71%) Eclipse
6 1 (0.71%) Fiddler
6 1 (0.71%) JMeter
6 1 (0.71%) LoadRunner
6 1 (0.71%) Rational Performance Tester
6 1 (0.71%) SilkPerformer
6 1 (0.71%) Talend Open Studio
6 1 (0.71%) Visual Studio
General
1 17 (12.06%) Banking
2 14 (9.93%) Finance
3 5 (3.55%) Retail
4 4 (2.84%) Back Office
4 4 (2.84%) Investment Banking
5 2 (1.42%) Front Office
6 1 (0.71%) Pharmaceutical
6 1 (0.71%) Telecoms
Job Titles
1 66 (46.81%) Developer
2 44 (31.21%) Hadoop Developer
3 41 (29.08%) Big Data Developer
4 25 (17.73%) Architect
5 19 (13.48%) Big Data Architect
6 18 (12.77%) Data Architect
7 16 (11.35%) Data Engineer
8 15 (10.64%) Big Data Engineer
8 15 (10.64%) Hadoop Engineer
9 14 (9.93%) Apache Spark Developer
9 14 (9.93%) Hadoop Architect
10 11 (7.80%) Java Developer
10 11 (7.80%) Senior Developer
11 10 (7.09%) Scala Developer
12 9 (6.38%) Consultant
12 9 (6.38%) Senior Hadoop Developer
13 8 (5.67%) Cloud Developer
13 8 (5.67%) Senior Big Data Developer
14 6 (4.26%) Hadoop Administrator
14 6 (4.26%) Hadoop Consultant
Libraries, Frameworks & Software Standards
1 41 (29.08%) Kafka
2 10 (7.09%) REST
3 9 (6.38%) Web Services
4 8 (5.67%) Spring
5 7 (4.96%) Hibernate
5 7 (4.96%) JSON
6 6 (4.26%) HTML
7 4 (2.84%) HTML5
7 4 (2.84%) J2EE
7 4 (2.84%) JDBC
7 4 (2.84%) ODBC
7 4 (2.84%) Struts
8 3 (2.13%) Akka
8 3 (2.13%) Cascading
8 3 (2.13%) Drools
8 3 (2.13%) Spark Streaming
9 1 (0.71%) Apache Thrift
9 1 (0.71%) Oracle GoldenGate
9 1 (0.71%) spray
9 1 (0.71%) Spring Boot
Miscellaneous
1 5 (3.55%) Analytical Skills
1 5 (3.55%) Visualisation
2 4 (2.84%) Computer Science
2 4 (2.84%) Data Structures
3 3 (2.13%) Data Integration
3 3 (2.13%) Mathematics
3 3 (2.13%) Replication
4 2 (1.42%) Credit Risk
4 2 (1.42%) Fintech
4 2 (1.42%) iSeries
5 1 (0.71%) Algorithms
5 1 (0.71%) Blockchain
5 1 (0.71%) Clustering
5 1 (0.71%) Derivative
5 1 (0.71%) Enterprise Software
5 1 (0.71%) Grid Computing
5 1 (0.71%) Hedge funds
5 1 (0.71%) Life Science
5 1 (0.71%) Mainframe
5 1 (0.71%) Physics
Operating Systems
1 24 (17.02%) Linux
2 21 (14.89%) Unix
3 5 (3.55%) Windows
4 3 (2.13%) Red Hat Enterprise Linux
5 1 (0.71%) CentOS
5 1 (0.71%) Fedora
5 1 (0.71%) Solaris
5 1 (0.71%) Ubuntu
5 1 (0.71%) Windows 2000
5 1 (0.71%) Windows XP
Processes & Methodologies
1 45 (31.91%) Agile Software Development
2 41 (29.08%) MapReduce
3 34 (24.11%) Business Intelligence
4 23 (16.31%) Analytics
5 22 (15.60%) TDD
6 17 (12.06%) Open Source
7 16 (11.35%) Scrum
8 15 (10.64%) ETL
9 14 (9.93%) Data Modelling
9 14 (9.93%) E-Commerce
10 12 (8.51%) Continuous Integration
11 11 (7.80%) High Availability
12 10 (7.09%) Continuous Delivery
13 9 (6.38%) Kanban
14 8 (5.67%) Automated Testing
14 8 (5.67%) Data Analytics
14 8 (5.67%) Multithreading
14 8 (5.67%) Pair Programming
15 7 (4.96%) DevOps
15 7 (4.96%) Functional Programming
Programming Languages
1 81 (57.45%) Java
2 54 (38.30%) Scala
3 35 (24.82%) Python
4 24 (17.02%) SQL
5 21 (14.89%) Shell Script
6 11 (7.80%) R
7 5 (3.55%) Bash Shell
7 5 (3.55%) PL/SQL
8 4 (2.84%) C
8 4 (2.84%) C#
9 3 (2.13%) Perl
9 3 (2.13%) PHP
9 3 (2.13%) Ruby
10 2 (1.42%) VBA
11 1 (0.71%) COBOL
11 1 (0.71%) Groovy
11 1 (0.71%) JavaScript
11 1 (0.71%) JCL
11 1 (0.71%) MATLAB
11 1 (0.71%) VB.NET
Qualifications
1 9 (6.38%) Degree
1 9 (6.38%) Security Cleared
2 7 (4.96%) DV Cleared
3 4 (2.84%) SC Cleared
4 1 (0.71%) BC Cleared
4 1 (0.71%) BPSS Clearance
4 1 (0.71%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 3 (2.13%) QA
2 1 (0.71%) Data Quality
System Software
1 27 (19.15%) Apache Flume
2 7 (4.96%) Apache ZooKeeper
3 2 (1.42%) vCloud
3 2 (1.42%) VMware Infrastructure
4 1 (0.71%) Active Directory
4 1 (0.71%) Docker
Systems Management
1 15 (10.64%) Oozie
2 13 (9.22%) Hadoop YARN
3 8 (5.67%) Ambari
4 5 (3.55%) Puppet
5 1 (0.71%) Ansible
5 1 (0.71%) Control-M
5 1 (0.71%) Ganglia
5 1 (0.71%) Graphite
5 1 (0.71%) HP Quality Center
5 1 (0.71%) Kubernetes
5 1 (0.71%) Nagios
5 1 (0.71%) OpenAM
5 1 (0.71%) Opscode Chef
5 1 (0.71%) Perfmon
5 1 (0.71%) Salt
Vendors
1 25 (17.73%) Oracle
2 24 (17.02%) Cloudera
3 20 (14.18%) Hortonworks
4 14 (9.93%) Informatica
5 11 (7.80%) MapR
6 8 (5.67%) Tableau
7 6 (4.26%) IBM
7 6 (4.26%) SAP
7 6 (4.26%) Teradata
8 2 (1.42%) Cognos
8 2 (1.42%) HP
8 2 (1.42%) Platfora
8 2 (1.42%) Rackspace
8 2 (1.42%) Red Hat
8 2 (1.42%) Splunk
8 2 (1.42%) Vertica
8 2 (1.42%) VMware
9 1 (0.71%) AppDynamics
9 1 (0.71%) SaltStack
9 1 (0.71%) WorldPay
London
Recruitment Genius Ltd
Posted: 19 days ago