Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 21 June 2018

The following table provides summary statistics for contract job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 21 June 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK
6 months to
21 Jun 2018		 Same period 2017 Same period 2016
Rank 542 589 763
Rank change year-on-year +47 +174 -12
Contract jobs citing HDFS 356 262 136
As % of all contract IT jobs advertised in the UK 0.36% 0.29% 0.13%
As % of the System Software category 2.60% 2.55% 1.09%
Number of daily rates quoted 241 184 105
UK median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% - -4.55%
10th Percentile £425 £375 £375
90th Percentile £675 £675 £675
UK excluding London median daily rate £519 £401 £450
% change year-on-year +29.53% -11.00% -
Number of hourly rates quoted 3 2 0
UK median hourly rate £22.00 £50.00 -
Median hourly rate % change year-on-year -56.00% - -
UK excluding London median hourly rate £22.25 £50.00 -
% change year-on-year -55.50% - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 13,707 10,257 12,461
As % of all contract IT jobs advertised in the UK 13.70% 11.25% 11.68%
Number of daily rates quoted 8,836 6,558 7,636
UK median daily rate £450 £420 £400
Median daily rate % change year-on-year +7.14% +5.00% +14.29%
10th Percentile £185 £163 £174
90th Percentile £625 £588 £575
UK excluding London median daily rate £400 £375 £365
% change year-on-year +6.67% +2.74% +7.53%
Number of hourly rates quoted 818 655 923
UK median hourly rate £16.00 £16.00 £16.00
10th Percentile £11.00 £10.13 £10.50
90th Percentile £45.87 £45.25 £42.00
UK excluding London median hourly rate £15.50 £15.00 £16.38
% change year-on-year +3.33% -8.40% +9.17%

HDFS
Job Vacancy Trend

Job postings citing HDFS as a percentage of all IT jobs advertised.

Job vacancy trend for HDFS in the UK

HDFS
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS.

Contractor daily rate trend for HDFS in the UK

HDFS
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing HDFS over the 6 months to 21 June 2018.

Contractor daily rate histogram for HDFS in the UK

HDFS
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing HDFS.

Contractor hourly rate trend for HDFS in the UK

HDFS
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 6 months to 21 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +27 348 £550 +4.76% 36
London -8 215 £550 -2.22% 22
UK excluding London +59 136 £519 +29.53% 19
South East +47 112 £525 +31.09% 5
South West +5 6 £488 +21.88% 2
East Midlands +3 6 £600 +14.29%
Midlands -8 6 £600 +14.29%
Scotland -32 6 £500 +2.56% 5
East of England +3 3 £450 +12.50% 2
North of England -38 3 £600 +46.34% 5
North West -11 2 £600 +50.00% 3
Yorkshire -16 1 £600 +46.34% 2

For the 6 months to 21 June 2018, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for HDFS.

1 327 (91.85%) Hadoop
2 288 (80.90%) Big Data
3 267 (75.00%) Apache Spark
4 223 (62.64%) Java
5 216 (60.67%) HBase
6 200 (56.18%) Apache Hive
7 189 (53.09%) Kafka
8 172 (48.31%) Linux
9 158 (44.38%) Agile Software Development
10 125 (35.11%) Python
11 120 (33.71%) Hadoop YARN
12 118 (33.15%) Scala
12 118 (33.15%) SQL
13 101 (28.37%) Unix
14 100 (28.09%) Cloudera
15 97 (27.25%) Amazon AWS
16 91 (25.56%) Finance
17 90 (25.28%) Jenkins
18 89 (25.00%) Sqoop
18 89 (25.00%) Apache ZooKeeper
19 86 (24.16%) Analytics
19 86 (24.16%) NoSQL
19 86 (24.16%) TDD
20 84 (23.60%) Oozie
21 83 (23.31%) DevOps
21 83 (23.31%) Continuous Integration
22 82 (23.03%) ETL
23 80 (22.47%) Apache
24 79 (22.19%) Git (software)
25 78 (21.91%) Hortonworks

HDFS
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 267 (75.00%) Apache Spark
2 80 (22.47%) Apache
3 57 (16.01%) Apache Solr
4 51 (14.33%) Apache Pig
5 31 (8.71%) Cloud Foundry
6 27 (7.58%) Elasticsearch
7 20 (5.62%) Confluence
7 20 (5.62%) GemFire
8 16 (4.49%) Tomcat
9 12 (3.37%) JBoss
10 10 (2.81%) nginx
11 6 (1.69%) SAS
12 4 (1.12%) WildFly
13 1 (0.28%) Apache Airflow
Applications
1 12 (3.37%) Microsoft Excel
1 12 (3.37%) MS Visio
Business Applications
1 1 (0.28%) Summit
Cloud Services
1 97 (27.25%) Amazon AWS
2 43 (12.08%) GitHub
3 32 (8.99%) Amazon S3
4 27 (7.58%) Microsoft Azure
5 25 (7.02%) PaaS
6 17 (4.78%) Amazon EC2
6 17 (4.78%) Virtual Private Cloud
7 12 (3.37%) Serverless
8 11 (3.09%) AWS Lambda
8 11 (3.09%) Google Tag Manager
9 10 (2.81%) Amazon EMR
10 6 (1.69%) Google Cloud Platform
11 5 (1.40%) Amazon CloudWatch
11 5 (1.40%) Amazon ELB
11 5 (1.40%) Amazon Kinesis
11 5 (1.40%) AWS CloudTrail
11 5 (1.40%) Cloud Computing
11 5 (1.40%) IaaS
12 2 (0.56%) AWS Elastic Beanstalk
12 2 (0.56%) Yarn
Communications & Networking
1 59 (16.57%) Kerberos
2 21 (5.90%) SSL
3 13 (3.65%) HTTP
4 6 (1.69%) Firewall
4 6 (1.69%) Network Security
4 6 (1.69%) RTMP
4 6 (1.69%) VPN
5 5 (1.40%) OpenLDAP
6 4 (1.12%) FTP
6 4 (1.12%) Internet
7 1 (0.28%) Multicast
Database & Business Intelligence
1 327 (91.85%) Hadoop
2 288 (80.90%) Big Data
3 216 (60.67%) HBase
4 200 (56.18%) Apache Hive
5 89 (25.00%) Sqoop
6 86 (24.16%) NoSQL
7 74 (20.79%) Impala
8 62 (17.42%) Apache Cassandra
9 52 (14.61%) SQL Server
10 50 (14.04%) MongoDB
11 47 (13.20%) Data Warehouse
12 45 (12.64%) Data Lake
13 44 (12.36%) PostgreSQL
14 40 (11.24%) Parquet
15 35 (9.83%) Relational Database
16 25 (7.02%) Amazon Redshift
17 21 (5.90%) MySQL
18 14 (3.93%) RDBMS
19 12 (3.37%) Apache Zeppelin
20 11 (3.09%) Cloudera CDH
Development Applications
1 90 (25.28%) Jenkins
2 79 (22.19%) Git (software)
3 36 (10.11%) Cucumber
4 30 (8.43%) JUnit
5 28 (7.87%) Gradle
6 25 (7.02%) IntelliJ
6 25 (7.02%) JIRA
7 20 (5.62%) Maven
8 18 (5.06%) Eclipse
9 11 (3.09%) TeamCity
10 8 (2.25%) GitLab
10 8 (2.25%) Subversion
11 7 (1.97%) FishEye
11 7 (1.97%) JBehave
12 6 (1.69%) Selenium
12 6 (1.69%) Sonatype Nexus
13 5 (1.40%) Artifactory
14 4 (1.12%) Jasmine
15 3 (0.84%) VersionOne
15 3 (0.84%) Visual Studio Team System
General
1 91 (25.56%) Finance
2 26 (7.30%) Banking
3 14 (3.93%) Investment Banking
4 11 (3.09%) Retail
5 10 (2.81%) Games
6 8 (2.25%) Front Office
7 5 (1.40%) Marketing
8 2 (0.56%) French Language
8 2 (0.56%) Legal
8 2 (0.56%) Telecoms
9 1 (0.28%) Aerospace
9 1 (0.28%) Back Office
9 1 (0.28%) Manufacturing
9 1 (0.28%) Private Banking
Job Titles
1 133 (37.36%) Developer
2 89 (25.00%) Data Engineer
3 77 (21.63%) Big Data Developer
4 59 (16.57%) Big Data Engineer
5 50 (14.04%) Java Developer
6 39 (10.96%) Hadoop Developer
7 33 (9.27%) Architect
8 27 (7.58%) Big Data Architect
9 26 (7.30%) Hadoop Engineer
10 25 (7.02%) Consultant
10 25 (7.02%) Data Architect
11 19 (5.34%) DevOps Engineer
12 17 (4.78%) Java Engineer
13 15 (4.21%) Platform Engineer
13 15 (4.21%) Senior Developer
14 14 (3.93%) Data Consultant
15 13 (3.65%) Administrator
15 13 (3.65%) AWS Engineer
15 13 (3.65%) Big Data Consultant
15 13 (3.65%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 189 (53.09%) Kafka
2 69 (19.38%) Spring
3 65 (18.26%) JSON
4 63 (17.70%) RabbitMQ
5 54 (15.17%) RESTful
6 42 (11.80%) Middleware
7 39 (10.96%) REST
8 35 (9.83%) J2EE
9 31 (8.71%) XML
10 29 (8.15%) Spark Streaming
10 29 (8.15%) Web Services
11 28 (7.87%) Apache Avro
12 20 (5.62%) Drools
13 16 (4.49%) MLlib
13 16 (4.49%) Node.js
14 15 (4.21%) Spring Boot
15 14 (3.93%) SOAP
16 13 (3.65%) HTML
16 13 (3.65%) JMS
17 12 (3.37%) AngularJS
Miscellaneous
1 61 (17.13%) Greenfield Project
2 36 (10.11%) Virtual Team
3 35 (9.83%) Linux Command Line
4 30 (8.43%) Analytical Skills
5 28 (7.87%) Algorithms
6 17 (4.78%) Computer Science
7 13 (3.65%) Wiki
8 10 (2.81%) Derivative
9 8 (2.25%) Data Structures
10 7 (1.97%) Fintech
11 6 (1.69%) Equity Derivative
11 6 (1.69%) User Experience
12 5 (1.40%) Clustering
12 5 (1.40%) Grid Computing
12 5 (1.40%) Self-Motivation
13 4 (1.12%) Replication
14 2 (0.56%) Data Centre
14 2 (0.56%) Enterprise Software
14 2 (0.56%) Interest Rate Derivative
15 1 (0.28%) GPGPU
Operating Systems
1 172 (48.31%) Linux
2 101 (28.37%) Unix
3 24 (6.74%) Red Hat Enterprise Linux
4 21 (5.90%) Windows
5 19 (5.34%) CentOS
6 6 (1.69%) Ubuntu
7 5 (1.40%) CoreOS
7 5 (1.40%) DC/OS
7 5 (1.40%) Windows Server
7 5 (1.40%) Windows Server 2008
8 2 (0.56%) Debian
8 2 (0.56%) SUSE Linux Enterprise Server
Processes & Methodologies
1 158 (44.38%) Agile Software Development
2 86 (24.16%) Analytics
2 86 (24.16%) TDD
3 83 (23.31%) Continuous Integration
3 83 (23.31%) DevOps
4 82 (23.03%) ETL
5 74 (20.79%) Scrum
6 59 (16.57%) MapReduce
7 57 (16.01%) BDD
8 44 (12.36%) Microservices
9 40 (11.24%) Test Automation
10 39 (10.96%) Problem-Solving
11 32 (8.99%) Data Modelling
12 31 (8.71%) Business Intelligence
13 30 (8.43%) Software Engineering
14 29 (8.15%) Data Engineering
15 27 (7.58%) Data Analysis
16 26 (7.30%) Data Science
16 26 (7.30%) Machine Learning
16 26 (7.30%) Visualisation
Programming Languages
1 223 (62.64%) Java
2 125 (35.11%) Python
3 118 (33.15%) Scala
3 118 (33.15%) SQL
4 78 (21.91%) Shell Script
5 58 (16.29%) Bash Shell
6 30 (8.43%) Java 8
7 19 (5.34%) R
8 18 (5.06%) Ruby
9 15 (4.21%) JavaScript
10 13 (3.65%) Perl
11 12 (3.37%) Korn
11 12 (3.37%) PowerShell
11 12 (3.37%) T-SQL
12 8 (2.25%) C#
12 8 (2.25%) Go
13 7 (1.97%) PL/SQL
13 7 (1.97%) TypeScript
14 6 (1.69%) Groovy
15 4 (1.12%) C++
Qualifications
1 37 (10.39%) Degree
2 30 (8.43%) Security Cleared
3 23 (6.46%) SC Cleared
4 14 (3.93%) Computer Science Degree
5 8 (2.25%) ISTQB
5 8 (2.25%) Numerate Degree
6 6 (1.69%) DV Cleared
7 2 (0.56%) OCA
7 2 (0.56%) Oracle Certification
8 1 (0.28%) PhD
Quality Assurance & Compliance
1 20 (5.62%) QA
2 4 (1.12%) ISO/IEC 20000
2 4 (1.12%) Sarbanes-Oxley
3 3 (0.84%) Data Quality
4 2 (0.56%) MiFID
5 1 (0.28%) Dodd-Frank
5 1 (0.28%) EMIR
System Software
1 89 (25.00%) Apache ZooKeeper
2 77 (21.63%) Apache Flume
3 36 (10.11%) Docker
4 12 (3.37%) Active Directory
5 5 (1.40%) Squid
6 2 (0.56%) Virtual Machines
7 1 (0.28%) etcd
Systems Management
1 120 (33.71%) Hadoop YARN
2 84 (23.60%) Oozie
3 47 (13.20%) Ansible
4 27 (7.58%) Kubernetes
5 25 (7.02%) Puppet
6 16 (4.49%) Ambari
6 16 (4.49%) Opscode Chef
6 16 (4.49%) Terraform
7 12 (3.37%) Apache Slider
7 12 (3.37%) Kibana
8 10 (2.81%) Mesos
9 7 (1.97%) Packer
10 6 (1.69%) Consul
10 6 (1.69%) Prometheus
11 5 (1.40%) logstash
11 5 (1.40%) Nagios
11 5 (1.40%) rkt
11 5 (1.40%) Salt
11 5 (1.40%) Sysdig
11 5 (1.40%) ZABBIX
Vendors
1 100 (28.09%) Cloudera
2 78 (21.91%) Hortonworks
3 42 (11.80%) Tableau
4 39 (10.96%) MapR
5 37 (10.39%) Oracle
6 24 (6.74%) Talend
7 21 (5.90%) Google
7 21 (5.90%) Salesforce.com
8 11 (3.09%) Atlassian
8 11 (3.09%) Tealium
9 10 (2.81%) Informatica
10 9 (2.53%) Microsoft
10 9 (2.53%) SAP
11 7 (1.97%) Red Hat
12 5 (1.40%) ForgeRock
12 5 (1.40%) SaltStack
13 3 (0.84%) Databricks
13 3 (0.84%) Teradata
14 2 (0.56%) Facebook
14 2 (0.56%) Sybase