Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 19 February 2019

The following table provides summary statistics for contract job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 19 February 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
UK
6 months to
19 Feb 2019		 Same period 2018 Same period 2017
Rank 581 518 537
Rank change year-on-year -63 +19 +217
Contract jobs citing HDFS 293 386 309
As % of all contract IT jobs advertised in the UK 0.30% 0.38% 0.33%
As % of the System Software category 1.93% 3.01% 2.69%
Number of daily rates quoted 175 271 187
UK median daily rate £579 £575 £575
Median daily rate % change year-on-year +0.70% - -4.17%
10th Percentile £475 £413 £405
90th Percentile £721 £675 £713
UK excluding London median daily rate £531 £575 £475
% change year-on-year -7.61% +21.05% -
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 15,178 12,803 11,508
As % of all contract IT jobs advertised in the UK 15.30% 12.71% 12.18%
Number of daily rates quoted 9,971 8,345 7,180
UK median daily rate £470 £450 £405
Median daily rate % change year-on-year +4.44% +11.11% +8.00%
10th Percentile £178 £162 £163
90th Percentile £638 £625 £588
UK excluding London median daily rate £425 £388 £350
% change year-on-year +9.68% +10.71% +2.94%
Number of hourly rates quoted 778 703 834
UK median hourly rate £16.00 £16.00 £16.00
10th Percentile £10.58 £10.50 £10.29
90th Percentile £47.03 £46.00 £44.43
UK excluding London median hourly rate £15.48 £15.00 £15.00
% change year-on-year +3.22% - -3.23%

HDFS
Job Vacancy Trend

Job postings citing HDFS as a percentage of all IT jobs advertised.

Job vacancy trend for HDFS in the UK

HDFS
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing HDFS.

Contractor daily rate trend for HDFS in the UK

HDFS
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing HDFS over the 6 months to 19 February 2019.

Contractor daily rate histogram for HDFS in the UK

HDFS
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing HDFS.

Contractor hourly rate trend for HDFS in the UK

HDFS
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 6 months to 19 February 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -68 292 £579 +0.70% 33
London -53 171 £600 +4.35% 21
UK excluding London -27 120 £531 -7.61% 14
South East -53 70 £538 -6.52% 7
North of England +11 38 £538 -8.51% 2
North East - 17 £538 -
North West -6 15 £550 -4.35% 1
East of England +7 6 - - 3
Yorkshire -6 6 £510 -15.00% 1
South West -36 5 £475 -2.56%
Scotland 0 1 - - 2

For the 6 months to 19 February 2019, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for HDFS.

1 262 (89.42%) Hadoop
2 235 (80.20%) Big Data
3 172 (58.70%) Apache Spark
4 166 (56.66%) HBase
5 165 (56.31%) Java
6 158 (53.92%) Agile Software Development
7 152 (51.88%) Apache Hive
8 148 (50.51%) Kafka
9 126 (43.00%) Linux
10 118 (40.27%) Hadoop YARN
11 102 (34.81%) Unix
12 99 (33.79%) Python
13 93 (31.74%) Sqoop
14 86 (29.35%) SQL
15 83 (28.33%) Continuous Integration
16 80 (27.30%) Amazon AWS
17 78 (26.62%) Jenkins
18 77 (26.28%) DevOps
18 77 (26.28%) TDD
19 74 (25.26%) Impala
20 73 (24.91%) BDD
21 72 (24.57%) Git (software)
22 71 (24.23%) Apache
23 69 (23.55%) Business Intelligence
24 68 (23.21%) Apache ZooKeeper
25 64 (21.84%) NoSQL
26 63 (21.50%) Parquet
27 60 (20.48%) Oozie
27 60 (20.48%) MapReduce
28 59 (20.14%) Scala

HDFS
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 172 (58.70%) Apache Spark
2 71 (24.23%) Apache
3 39 (13.31%) Apache Pig
4 38 (12.97%) Apache Solr
5 37 (12.63%) Confluence
6 25 (8.53%) Elasticsearch
7 11 (3.75%) SAS
8 10 (3.41%) Jupyter
9 8 (2.73%) Cloud Foundry
10 2 (0.68%) GemFire
11 1 (0.34%) MS Exchange
11 1 (0.34%) OpenStack
11 1 (0.34%) SharePoint
Applications
1 12 (4.10%) Microsoft Excel
1 12 (4.10%) MS Visio
Business Applications
1 1 (0.34%) Eloqua
1 1 (0.34%) Summit
Cloud Services
1 80 (27.30%) Amazon AWS
2 46 (15.70%) Microsoft Azure
3 45 (15.36%) GitHub
4 31 (10.58%) Google Cloud Platform
5 29 (9.90%) Amazon S3
6 18 (6.14%) Amazon EC2
7 14 (4.78%) Virtual Private Cloud
8 13 (4.44%) Amazon EMR
8 13 (4.44%) Cloud Computing
9 11 (3.75%) IaaS
10 8 (2.73%) Amazon Kinesis
11 7 (2.39%) PaaS
12 6 (2.05%) Serverless
13 3 (1.02%) Amazon CloudWatch
14 2 (0.68%) AWS Elastic Beanstalk
14 2 (0.68%) AWS Lambda
14 2 (0.68%) OpenShift
15 1 (0.34%) Amazon SQS
15 1 (0.34%) AWS CloudTrail
15 1 (0.34%) IBM Cloud
Communications & Networking
1 33 (11.26%) Kerberos
2 7 (2.39%) VPN
3 5 (1.71%) Firewall
3 5 (1.71%) LAN
3 5 (1.71%) WAN
4 4 (1.37%) HTTPS
4 4 (1.37%) SSL
5 3 (1.02%) HTTP
6 2 (0.68%) MQTT
7 1 (0.34%) Internet
7 1 (0.34%) SSH
7 1 (0.34%) TCP/IP
Database & Business Intelligence
1 262 (89.42%) Hadoop
2 235 (80.20%) Big Data
3 166 (56.66%) HBase
4 152 (51.88%) Apache Hive
5 93 (31.74%) Sqoop
6 74 (25.26%) Impala
7 64 (21.84%) NoSQL
8 63 (21.50%) Parquet
9 56 (19.11%) Apache Cassandra
10 48 (16.38%) SQL Server
11 40 (13.65%) MongoDB
12 35 (11.95%) Relational Database
13 32 (10.92%) Data Lake
14 30 (10.24%) Data Warehouse
15 24 (8.19%) MySQL
16 21 (7.17%) Apache Kudu
17 16 (5.46%) Spark SQL
18 14 (4.78%) Mahout
19 13 (4.44%) Amazon Redshift
19 13 (4.44%) PostgreSQL
Development Applications
1 78 (26.62%) Jenkins
2 72 (24.57%) Git (software)
3 45 (15.36%) JIRA
4 34 (11.60%) Cucumber
5 33 (11.26%) Gradle
6 14 (4.78%) Maven
7 13 (4.44%) FishEye
7 13 (4.44%) JUnit
8 12 (4.10%) Atlassian Bamboo
8 12 (4.10%) Selenium
9 11 (3.75%) jMock
9 11 (3.75%) Subversion
10 10 (3.41%) JBehave
11 6 (2.05%) Gerrit
11 6 (2.05%) Visual Studio
12 5 (1.71%) GitLab
12 5 (1.71%) IntelliJ
13 4 (1.37%) SoapUI
14 3 (1.02%) Log4j
15 2 (0.68%) Ant
General
1 53 (18.09%) Finance
2 24 (8.19%) Banking
3 17 (5.80%) Front Office
4 11 (3.75%) Legal
5 5 (1.71%) Games
5 5 (1.71%) General Ledger
5 5 (1.71%) Retail
6 3 (1.02%) Telecoms
7 2 (0.68%) Advertising
7 2 (0.68%) Aerospace
8 1 (0.34%) Back Office
8 1 (0.34%) Investment Banking
8 1 (0.34%) Marketing
Job Titles
1 106 (36.18%) Developer
2 67 (22.87%) Java Developer
3 60 (20.48%) Data Engineer
4 55 (18.77%) Big Data Engineer
5 36 (12.29%) Big Data Developer
6 33 (11.26%) Architect
7 31 (10.58%) Hadoop Developer
8 28 (9.56%) DevOps Engineer
9 23 (7.85%) Apache Spark Developer
10 21 (7.17%) Administrator
10 21 (7.17%) Hadoop Administrator
10 21 (7.17%) Hadoop Engineer
11 16 (5.46%) Data Architect
11 16 (5.46%) Java Hadoop Developer
12 15 (5.12%) Big Data Architect
13 14 (4.78%) Platform Engineer
14 12 (4.10%) Consultant
15 11 (3.75%) Analyst
16 10 (3.41%) Big Data Consultant
16 10 (3.41%) Data Consultant
Libraries, Frameworks & Software Standards
1 148 (50.51%) Kafka
2 53 (18.09%) Spring
3 49 (16.72%) JSON
3 49 (16.72%) REST
4 46 (15.70%) Apache Avro
5 45 (15.36%) RabbitMQ
6 35 (11.95%) Middleware
7 33 (11.26%) J2EE
8 21 (7.17%) Spark Streaming
9 20 (6.83%) Apache NiFi
10 11 (3.75%) Anaconda
10 11 (3.75%) PySpark
11 10 (3.41%) Apache Tez
11 10 (3.41%) Web Services
12 9 (3.07%) MLlib
12 9 (3.07%) SOAP
13 8 (2.73%) Apache Camel
13 8 (2.73%) HTML5
13 8 (2.73%) Oracle GoldenGate
13 8 (2.73%) XML
Miscellaneous
1 35 (11.95%) Virtual Team
2 33 (11.26%) Linux Command Line
3 23 (7.85%) Analytical Skills
4 16 (5.46%) Greenfield Project
5 15 (5.12%) Algorithms
6 13 (4.44%) Data Structures
7 12 (4.10%) Wiki
8 9 (3.07%) Fintech
9 8 (2.73%) Data Centre
10 7 (2.39%) Management Information System
11 5 (1.71%) Credit Risk
11 5 (1.71%) Hedge funds
12 2 (0.68%) Private Cloud
12 2 (0.68%) Self-Motivation
13 1 (0.34%) Analytical Mindset
13 1 (0.34%) Enterprise Cloud
13 1 (0.34%) Enterprise Software
13 1 (0.34%) Hybrid Cloud
13 1 (0.34%) Public Cloud
13 1 (0.34%) Taxonomies
Operating Systems
1 126 (43.00%) Linux
2 102 (34.81%) Unix
3 17 (5.80%) Windows
4 9 (3.07%) Red Hat Enterprise Linux
5 2 (0.68%) CoreOS
6 1 (0.34%) CentOS
6 1 (0.34%) DC/OS
6 1 (0.34%) Ubuntu
Processes & Methodologies
1 158 (53.92%) Agile Software Development
2 83 (28.33%) Continuous Integration
3 77 (26.28%) DevOps
3 77 (26.28%) TDD
4 73 (24.91%) BDD
5 69 (23.55%) Business Intelligence
6 60 (20.48%) MapReduce
7 53 (18.09%) ETL
8 48 (16.38%) Analytics
8 48 (16.38%) Data Modelling
9 45 (15.36%) Scrum
10 41 (13.99%) Visualisation
11 39 (13.31%) Benchmarking
12 38 (12.97%) Data Science
13 35 (11.95%) Data Engineering
14 34 (11.60%) Test Automation
15 30 (10.24%) System Testing
15 30 (10.24%) Unit Testing
16 28 (9.56%) Data Analysis
16 28 (9.56%) Open Source
Programming Languages
1 165 (56.31%) Java
2 99 (33.79%) Python
3 86 (29.35%) SQL
4 59 (20.14%) Scala
4 59 (20.14%) Shell Script
5 34 (11.60%) Bash Shell
6 24 (8.19%) Java 8
7 20 (6.83%) R
8 15 (5.12%) JavaScript
9 14 (4.78%) C++
10 13 (4.44%) Korn
10 13 (4.44%) PowerShell
11 10 (3.41%) C
12 9 (3.07%) Go
12 9 (3.07%) Ruby
13 7 (2.39%) Groovy
14 5 (1.71%) C#
15 3 (1.02%) MATLAB
15 3 (1.02%) Perl
16 2 (0.68%) T-SQL
Qualifications
1 35 (11.95%) Degree
2 25 (8.53%) Security Cleared
3 23 (7.85%) SC Cleared
4 7 (2.39%) Computer Science Degree
5 4 (1.37%) ISTQB
6 2 (0.68%) BPSS Clearance
6 2 (0.68%) PhD
6 2 (0.68%) SAS Certification
7 1 (0.34%) AWS Certification
7 1 (0.34%) DV Cleared
7 1 (0.34%) ISEB
7 1 (0.34%) TOGAF Certification
Quality Assurance & Compliance
1 19 (6.48%) Data Quality
2 8 (2.73%) QA
3 5 (1.71%) GDPR
3 5 (1.71%) SLA
4 4 (1.37%) ISO/IEC 27001
5 1 (0.34%) Dodd-Frank
5 1 (0.34%) EMIR
5 1 (0.34%) MiFID
5 1 (0.34%) PSD2
System Software
1 68 (23.21%) Apache ZooKeeper
2 54 (18.43%) Apache Flume
3 30 (10.24%) Docker
4 11 (3.75%) vCloud
4 11 (3.75%) VMware Infrastructure
5 5 (1.71%) Oracle RAC
6 2 (0.68%) etcd
6 2 (0.68%) flannel
7 1 (0.34%) Active Directory
7 1 (0.34%) Cronacle
Systems Management
1 118 (40.27%) Hadoop YARN
2 60 (20.48%) Oozie
3 46 (15.70%) Ansible
4 31 (10.58%) Puppet
5 25 (8.53%) Kubernetes
6 21 (7.17%) Ambari
7 17 (5.80%) Opscode Chef
8 8 (2.73%) Terraform
8 8 (2.73%) Tivoli
9 6 (2.05%) Grafana
10 5 (1.71%) Kibana
10 5 (1.71%) logstash
11 3 (1.02%) Prometheus
11 3 (1.02%) ZABBIX
12 2 (0.68%) Mesos
12 2 (0.68%) rkt
12 2 (0.68%) Single Sign-On
13 1 (0.34%) Control-M
13 1 (0.34%) Ganglia
13 1 (0.34%) Nagios
Vendors
1 54 (18.43%) Oracle
2 53 (18.09%) Cloudera
3 51 (17.41%) Hortonworks
4 33 (11.26%) Google
5 28 (9.56%) Tableau
6 16 (5.46%) Talend
7 14 (4.78%) Atlassian
8 11 (3.75%) Sybase
8 11 (3.75%) VMware
9 9 (3.07%) Teradata
10 8 (2.73%) Datameer
10 8 (2.73%) MapR
11 6 (2.05%) Informatica
11 6 (2.05%) Netezza
11 6 (2.05%) Splunk
12 5 (1.71%) Cisco
12 5 (1.71%) IBM
13 4 (1.37%) Alteryx
13 4 (1.37%) Microsoft
13 4 (1.37%) SAP