The table below looks at the statistics for HDFS skills in IT contracts advertised for the England region. Included is a guide to the contractor rates offered in IT contracts that have cited HDFS over the 3 months to 26 July 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
26 Jul 2016
Same period 2015 Same period 2014
Hadoop Distributed File System (HDFS)
Rank 562 556 569
Rank change year-on-year
-6 +13
Contract jobs citing HDFS 66 58 23
As % of all contract IT jobs located in England 0.13% 0.11% 0.047%
As % of the System Software category 1.08% 1.04% 0.46%
Number of daily rates quoted 39 41 12
Median daily rate £550 £550 £550
90% offered a daily rate of more than £450 £413 £378
10% offered a daily rate of more than £705 £673 £775
UK excluding London median daily rate £538 £450 -
% change year-on-year
+19.44% -
Number of hourly rates quoted 0 1 0
Median hourly rate - £26.00 -
UK excluding London median hourly rate - £26.00 -
HDFS
UK

The following table is for comparison with the above and provides statistics for the entire System Software category in contract jobs advertised in the England region.

System Software Category
England
Contract IT job ads with a match in the
System Software category
6104 5594 5042
As % of all contract IT jobs located in England 12.24% 10.84% 10.36%
Number of daily rates quoted 3884 3227 2753
Median daily rate £400 £350 £325
Median daily rate % change year-on-year
+14.28% +7.69%
90% offered a daily rate of more than £210 £200 £170
10% offered a daily rate of more than £550 £500 £475
UK excluding London median daily rate £350 £338 £313
% change year-on-year
+3.70% +8.00%
Number of hourly rates quoted 395 570 630
Median hourly rate £17.00 £17.50 £16.00
Median hourly rate % change year-on-year
-2.85% +9.37%
90% offered a hourly rate of more than £11.50 £11.00 £10.50
10% offered a hourly rate of more than £40.00 £40.00 £28.50
UK excluding London median hourly rate £20.50 £17.00 £15.50
% change year-on-year
+20.58% +9.67%

HDFS
Jobs Demand Trend in England

The demand trend of contract jobs across the England region citing HDFS as a proportion of all IT contracts with a match in the System Software category.

HDFS Jobs Demand Trend in England

HDFS
Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing HDFS across the England region.

HDFS Daily Rate Trend in England

HDFS
Daily Rate Histogram in England

This chart provides a histogram of daily rates quoted in contract IT jobs citing HDFS across the England region over the 3 months to 26 July 2016.

HDFS Daily Rate Histogram in England

HDFS
Hourly Rate Trend in England

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing HDFS across the England region.

HDFS Hourly Rate Trend in England

HDFS
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the England region over the 3 months to 26 July 2016. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location
(Click see detailed
statistics and trends)
Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -7 41 £575 -8.00% 8
South East +23 11 £288 +43.75% 2
West Midlands - 5 £525 -
North West - 4 - - 2
Yorkshire -1 3 £600 +14.28%
South West -5 3 £600 +41.17%
HDFS
UK

HDFS
Top 30 Related IT Skills in England

For the 6 months to 26 July 2016, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the England region with a requirement for HDFS.

1 145 (97.97%) Hadoop
2 116 (78.38%) Apache Hive
3 115 (77.70%) Big Data
4 104 (70.27%) Apache Spark
5 81 (54.73%) Java
6 61 (41.22%) HBase
7 60 (40.54%) Apache Pig
8 57 (38.51%) Scala
9 54 (36.49%) Agile Software Development
10 46 (31.08%) MapReduce
10 46 (31.08%) Python
11 45 (30.41%) Cloudera
12 43 (29.05%) Sqoop
13 40 (27.03%) Apache Flume
14 39 (26.35%) Kafka
15 37 (25.00%) Hadoop YARN
15 37 (25.00%) Impala
16 30 (20.27%) Finance
17 28 (18.92%) Shell Script
18 27 (18.24%) Linux
18 27 (18.24%) NoSQL
19 25 (16.89%) Oracle
20 24 (16.22%) ETL
20 24 (16.22%) Business Intelligence
21 23 (15.54%) Data Warehouse
21 23 (15.54%) SQL
21 23 (15.54%) TDD
22 22 (14.86%) Banking
23 21 (14.19%) Apache Cassandra
23 21 (14.19%) Unix

HDFS
Top Related IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 104 (70.27%) Apache Spark
2 60 (40.54%) Apache Pig
3 12 (8.11%) SAS
4 8 (5.41%) Apache
5 5 (3.38%) Elasticsearch
6 2 (1.35%) Apache Solr
6 2 (1.35%) Confluence
6 2 (1.35%) GemFire
6 2 (1.35%) OpenStack
6 2 (1.35%) Tomcat
7 1 (0.68%) Cloud Foundry
7 1 (0.68%) nginx
7 1 (0.68%) Oracle Coherence
Applications
1 1 (0.68%) MS Visio
1 1 (0.68%) SPSS
Business Applications
1 2 (1.35%) SAP Oil and Gas
Cloud Services
1 15 (10.14%) Amazon AWS
2 14 (9.46%) Microsoft Azure
3 4 (2.70%) Amazon S3
4 2 (1.35%) GitHub
5 1 (0.68%) Amazon EC2
5 1 (0.68%) CloudFront
5 1 (0.68%) PaaS
Communications & Networking
1 10 (6.76%) Kerberos
2 2 (1.35%) TCP/IP
3 1 (0.68%) FTP
3 1 (0.68%) Internet
3 1 (0.68%) LDAP
3 1 (0.68%) SAN
3 1 (0.68%) Wireshark
Database & Business Intelligence
1 145 (97.97%) Hadoop
2 116 (78.38%) Apache Hive
3 115 (77.70%) Big Data
4 61 (41.22%) HBase
5 43 (29.05%) Sqoop
6 37 (25.00%) Impala
7 27 (18.24%) NoSQL
8 23 (15.54%) Data Warehouse
9 21 (14.19%) Apache Cassandra
10 13 (8.78%) MongoDB
10 13 (8.78%) SQL Server
11 12 (8.11%) Data Lake
11 12 (8.11%) Relational Database
12 8 (5.41%) Apache Accumulo
12 8 (5.41%) MySQL
13 7 (4.73%) SAP HANA
14 6 (4.05%) PostgreSQL
14 6 (4.05%) QlikView
15 5 (3.38%) Neo4j
15 5 (3.38%) PowerCenter
Development Applications
1 10 (6.76%) Jenkins
2 8 (5.41%) Git (software)
3 6 (4.05%) JIRA
4 5 (3.38%) Maven
5 3 (2.03%) JUnit
6 2 (1.35%) Artifactory
6 2 (1.35%) Cucumber
6 2 (1.35%) Eclipse
6 2 (1.35%) FindBugs
6 2 (1.35%) PigUnit
6 2 (1.35%) PyUnit
6 2 (1.35%) RSpec
6 2 (1.35%) RStudio
6 2 (1.35%) Sonatype Nexus
6 2 (1.35%) TeamCity
7 1 (0.68%) GitLab
7 1 (0.68%) Gradle
7 1 (0.68%) Hudson
7 1 (0.68%) NeoLoad
7 1 (0.68%) Talend Open Studio
General
1 30 (20.27%) Finance
2 22 (14.86%) Banking
3 7 (4.73%) Investment Banking
3 7 (4.73%) Retail
4 4 (2.70%) Back Office
4 4 (2.70%) Front Office
4 4 (2.70%) Telecoms
5 3 (2.03%) Marketing
6 2 (1.35%) Electronics
6 2 (1.35%) Manufacturing
7 1 (0.68%) Financial Institution
7 1 (0.68%) Legal
Job Titles
1 59 (39.86%) Developer
2 43 (29.05%) Hadoop Developer
3 32 (21.62%) Big Data Developer
4 31 (20.95%) Architect
5 21 (14.19%) Big Data Architect
6 20 (13.51%) Data Architect
7 19 (12.84%) Data Engineer
7 19 (12.84%) Hadoop Architect
8 18 (12.16%) Big Data Engineer
8 18 (12.16%) Hadoop Engineer
9 11 (7.43%) Programmer
9 11 (7.43%) Scala Developer
10 10 (6.76%) Apache Spark Developer
10 10 (6.76%) Cloud Developer
10 10 (6.76%) Senior Developer
11 9 (6.08%) Java Developer
12 8 (5.41%) Administrator
12 8 (5.41%) Senior Big Data Developer
12 8 (5.41%) Senior Hadoop Developer
13 7 (4.73%) Hadoop Administrator
Libraries, Frameworks & Software Standards
1 39 (26.35%) Kafka
2 13 (8.78%) Spark Streaming
3 10 (6.76%) REST
4 9 (6.08%) Apache Tez
5 8 (5.41%) Hibernate
5 8 (5.41%) J2EE
6 7 (4.73%) JSON
6 7 (4.73%) Spring
6 7 (4.73%) Web Services
7 5 (3.38%) Akka
7 5 (3.38%) Cascading
7 5 (3.38%) JDBC
8 4 (2.70%) ODBC
8 4 (2.70%) WebHDFS
9 3 (2.03%) ELK Stack
10 2 (1.35%) HTML
10 2 (1.35%) Java EE
10 2 (1.35%) Spring Boot
11 1 (0.68%) Grails
11 1 (0.68%) Lucene
Miscellaneous
1 4 (2.70%) Analytical Skills
2 3 (2.03%) Computer Science
2 3 (2.03%) Data Integration
2 3 (2.03%) Data Structures
2 3 (2.03%) Replication
2 3 (2.03%) Virtual Team
3 2 (1.35%) Algorithms
3 2 (1.35%) Credit Risk
3 2 (1.35%) Management Information System
3 2 (1.35%) Mathematics
3 2 (1.35%) Visualisation
4 1 (0.68%) Blockchain
4 1 (0.68%) Clustering
4 1 (0.68%) Equities
4 1 (0.68%) Fintech
4 1 (0.68%) Fixed Income
4 1 (0.68%) Foreign Exchange (FX)
4 1 (0.68%) Grid Computing
4 1 (0.68%) Hedge funds
4 1 (0.68%) Mainframe
Operating Systems
1 27 (18.24%) Linux
2 21 (14.19%) Unix
3 3 (2.03%) Red Hat Enterprise Linux
4 2 (1.35%) CentOS
4 2 (1.35%) Ubuntu
4 2 (1.35%) Windows
5 1 (0.68%) Solaris
5 1 (0.68%) Windows 2000
5 1 (0.68%) Windows XP
Processes & Methodologies
1 54 (36.49%) Agile Software Development
2 46 (31.08%) MapReduce
3 24 (16.22%) Business Intelligence
3 24 (16.22%) ETL
4 23 (15.54%) TDD
5 21 (14.19%) Analytics
6 19 (12.84%) Scrum
7 18 (12.16%) Continuous Integration
7 18 (12.16%) Open Source
8 16 (10.81%) E-Commerce
9 11 (7.43%) High Availability
10 10 (6.76%) Continuous Delivery
10 10 (6.76%) Functional Programming
10 10 (6.76%) Kanban
10 10 (6.76%) Software Engineering
11 9 (6.08%) Automated Testing
11 9 (6.08%) Pair Programming
12 8 (5.41%) Data Architecture
12 8 (5.41%) Data Modelling
12 8 (5.41%) Multithreading
Programming Languages
1 81 (54.73%) Java
2 57 (38.51%) Scala
3 46 (31.08%) Python
4 28 (18.92%) Shell Script
5 23 (15.54%) SQL
6 10 (6.76%) R
7 9 (6.08%) Perl
8 7 (4.73%) PL/SQL
9 6 (4.05%) Bash Shell
10 5 (3.38%) C
11 3 (2.03%) HiveQL
11 3 (2.03%) JavaScript
12 2 (1.35%) PHP
12 2 (1.35%) Ruby
12 2 (1.35%) VBA
13 1 (0.68%) C#
13 1 (0.68%) C++
13 1 (0.68%) COBOL
13 1 (0.68%) Groovy
13 1 (0.68%) JCL
Qualifications
1 9 (6.08%) Security Cleared
2 7 (4.73%) DV Cleared
3 6 (4.05%) Degree
4 1 (0.68%) BC Cleared
4 1 (0.68%) BPSS Clearance
4 1 (0.68%) SC Cleared
Quality Assurance & Compliance
1 3 (2.03%) QA
2 1 (0.68%) Data Quality
System Software
1 40 (27.03%) Apache Flume
2 8 (5.41%) Apache ZooKeeper
3 4 (2.70%) Active Directory
4 2 (1.35%) Ceph
4 2 (1.35%) vCloud
4 2 (1.35%) VMware Infrastructure
5 1 (0.68%) Docker
5 1 (0.68%) Virtual Machines
Systems Management
1 37 (25.00%) Hadoop YARN
2 14 (9.46%) Oozie
3 7 (4.73%) Ambari
4 6 (4.05%) Control-M
5 5 (3.38%) Puppet
6 2 (1.35%) Ganglia
6 2 (1.35%) Kibana
6 2 (1.35%) logstash
6 2 (1.35%) Nagios
7 1 (0.68%) Graphite
7 1 (0.68%) HP Quality Center
7 1 (0.68%) Kubernetes
7 1 (0.68%) OpenAM
7 1 (0.68%) Perfmon
Vendors
1 45 (30.41%) Cloudera
2 25 (16.89%) Oracle
3 21 (14.19%) Hortonworks
4 17 (11.49%) Informatica
5 9 (6.08%) SAP
6 8 (5.41%) Teradata
7 6 (4.05%) IBM
7 6 (4.05%) Tableau
8 4 (2.70%) MapR
9 3 (2.03%) Vertica
10 2 (1.35%) Ab Initio
10 2 (1.35%) Cognos
10 2 (1.35%) HP
10 2 (1.35%) Platfora
10 2 (1.35%) Rackspace
10 2 (1.35%) Red Hat
10 2 (1.35%) Splunk
10 2 (1.35%) VMware
11 1 (0.68%) MicroStrategy
11 1 (0.68%) Terracotta
London
People Source Consulting
Rate: £450 - £550 per day
Posted: 8 days ago