Period
to 20 September 2018

The following table provides summary statistics for contract job vacancies advertised in the South West with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 20 September 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > South West
6 months to
20 Sep 2018
Same period 2017 Same period 2016
Rank 117 111 140
Rank change year-on-year -6 +29 +36
Contract jobs citing Hadoop 100 102 68
As % of all contract IT jobs advertised in the South West 1.71% 1.86% 1.15%
As % of the Database & Business Intelligence category 8.07% 9.47% 5.55%
Number of daily rates quoted 72 59 40
South West median daily rate £525 £445 £450
Median daily rate % change year-on-year +17.98% -1.11% -4.76%
10th Percentile £401 £368 £357
90th Percentile £575 £640 £566
England median daily rate £534 £536 £525
% change year-on-year -0.37% +2.05% -4.55%
Number of hourly rates quoted 0 1 0
South West median hourly rate - £35.00 -
England median hourly rate £61.25 £35.00 £45.75
% change year-on-year +75.00% -23.50% +36.36%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South West
Contract vacancies with a requirement for database or business intelligence skills 1,239 1,077 1,226
As % of all contract IT jobs advertised in the South West 21.20% 19.59% 20.81%
Number of daily rates quoted 898 681 865
South West median daily rate £425 £400 £350
Median daily rate % change year-on-year +6.25% +14.29% -6.67%
10th Percentile £291 £289 £258
90th Percentile £556 £531 £523
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 16 23 31
South West median hourly rate £39.00 £39.50 £33.00
Median hourly rate % change year-on-year -1.27% +19.70% +1.54%
10th Percentile £17.83 £13.80 £12.00
90th Percentile £68.13 £57.00 £48.00
England median hourly rate £29.75 £30.00 £29.94
% change year-on-year -0.83% +0.20% +8.32%

Hadoop
Job Vacancy Trend in the South West

Job postings citing Hadoop as a percentage of all IT jobs advertised in the South West.

Job vacancy trend for Hadoop in the South West

Hadoop
Contractor Daily Rate Trend in the South West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the South West.

Contractor daily rate trend for Hadoop in the South West

Hadoop
Contractor Daily Rate Histogram in the South West

The daily rate distribution of IT jobs citing Hadoop in the South West over the 6 months to 20 September 2018.

Contractor daily rate histogram for Hadoop in the South West

Hadoop
Contract Job Locations in the South West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the South West region over the 6 months to 20 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Bristol +15 40 £525 +10.53% 6
Somerset +2 33 £525 +24.63% 12
Wiltshire -11 14 £550 -10.57% 10
Gloucestershire -3 4 - - 4
Hadoop
England

For the 6 months to 20 September 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South West region with a requirement for Hadoop.

1 59 (59.00%) Apache Spark
2 54 (54.00%) Big Data
3 51 (51.00%) Finance
4 50 (50.00%) Apache Hive
5 47 (47.00%) Agile Software Development
6 46 (46.00%) Kafka
7 30 (30.00%) Java
8 28 (28.00%) Analytics
9 26 (26.00%) Oozie
9 26 (26.00%) Linux
10 25 (25.00%) Git (software)
11 24 (24.00%) Data Warehouse
11 24 (24.00%) Data Modelling
12 22 (22.00%) SQL
12 22 (22.00%) Data Science
12 22 (22.00%) Ansible
12 22 (22.00%) Enterprise Data Warehouse
13 21 (21.00%) SQL Optimisation
13 21 (21.00%) OLAP Cube
13 21 (21.00%) Machine Learning
13 21 (21.00%) Data Quality
13 21 (21.00%) OLAP
13 21 (21.00%) Star Schema
14 19 (19.00%) HBase
15 16 (16.00%) SDLC
15 16 (16.00%) Security Cleared
16 15 (15.00%) Scala
17 14 (14.00%) Kerberos
18 13 (13.00%) Unix
18 13 (13.00%) CentOS

Hadoop
Co-occurring IT Skills in the South West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 59 (59.00%) Apache Spark
2 7 (7.00%) Apache Pig
3 6 (6.00%) SAS
4 1 (1.00%) Apache
Business Applications
1 1 (1.00%) Remedy ITSM
Cloud Services
1 2 (2.00%) Amazon AWS
1 2 (2.00%) Amazon EMR
2 1 (1.00%) Microsoft Azure
2 1 (1.00%) PaaS
Communications & Networking
1 14 (14.00%) Kerberos
2 12 (12.00%) Firewall
2 12 (12.00%) Network Security
2 12 (12.00%) OpenLDAP
3 2 (2.00%) SSL
4 1 (1.00%) HTTP
4 1 (1.00%) SSH
4 1 (1.00%) TCP/IP
Database & Business Intelligence
1 54 (54.00%) Big Data
2 50 (50.00%) Apache Hive
3 24 (24.00%) Data Warehouse
4 22 (22.00%) Enterprise Data Warehouse
5 21 (21.00%) OLAP
5 21 (21.00%) OLAP Cube
5 21 (21.00%) Star Schema
6 19 (19.00%) HBase
7 6 (6.00%) Apache Accumulo
8 5 (5.00%) Data Lake
9 3 (3.00%) BusinessObjects
10 2 (2.00%) Impala
10 2 (2.00%) NoSQL
10 2 (2.00%) PostgreSQL
11 1 (1.00%) Base SAS
11 1 (1.00%) Geospatial Data
11 1 (1.00%) PowerCenter
11 1 (1.00%) PowerPivot
11 1 (1.00%) Sqoop
Development Applications
1 25 (25.00%) Git (software)
2 11 (11.00%) Jenkins
3 6 (6.00%) Cucumber
4 4 (4.00%) Atlassian Bamboo
4 4 (4.00%) JIRA
4 4 (4.00%) JMeter
4 4 (4.00%) Selenium
4 4 (4.00%) Vagrant
4 4 (4.00%) WATIR
5 3 (3.00%) Eclipse
5 3 (3.00%) IntelliJ
5 3 (3.00%) JUnit
5 3 (3.00%) Maven
6 1 (1.00%) ProC
6 1 (1.00%) SonarQube
General
1 51 (51.00%) Finance
2 9 (9.00%) Banking
3 1 (1.00%) Electronics
3 1 (1.00%) Manufacturing
3 1 (1.00%) Marketing
3 1 (1.00%) Retail Banking
3 1 (1.00%) Telecoms
Job Titles
1 40 (40.00%) Developer
2 25 (25.00%) Data Engineer
3 22 (22.00%) Hadoop Engineer
4 20 (20.00%) Hadoop Developer
5 16 (16.00%) Big Data Engineer
6 12 (12.00%) Java Developer
7 7 (7.00%) Architect
7 7 (7.00%) Big Data Developer
7 7 (7.00%) Data Architect
8 5 (5.00%) Active Directory Expert
8 5 (5.00%) Big Data Architect
8 5 (5.00%) Subject Matter Expert
9 4 (4.00%) Test Automation Engineer
9 4 (4.00%) Test Engineer
10 3 (3.00%) Hadoop Architect
10 3 (3.00%) Java Hadoop Developer
10 3 (3.00%) Project Manager
10 3 (3.00%) Software Engineer
11 2 (2.00%) Finance Manager
11 2 (2.00%) Project Change Manager
Libraries, Frameworks & Software Standards
1 46 (46.00%) Kafka
2 12 (12.00%) LDAP
3 7 (7.00%) Spring
4 5 (5.00%) AngularJS
5 3 (3.00%) REST
6 1 (1.00%) Akka
6 1 (1.00%) Angular 2
6 1 (1.00%) Play Framework
Miscellaneous
1 10 (10.00%) Analytical Skills
2 6 (6.00%) Data Structures
3 5 (5.00%) Greenfield Project
4 4 (4.00%) Self-Motivation
5 3 (3.00%) Algorithms
6 2 (2.00%) Replication
7 1 (1.00%) Linux Command Line
7 1 (1.00%) Private Cloud
Operating Systems
1 26 (26.00%) Linux
2 13 (13.00%) CentOS
2 13 (13.00%) Unix
3 5 (5.00%) Windows
4 2 (2.00%) Red Hat Enterprise Linux
4 2 (2.00%) SUSE Linux Enterprise Server
5 1 (1.00%) Debian
5 1 (1.00%) Ubuntu
Processes & Methodologies
1 47 (47.00%) Agile Software Development
2 28 (28.00%) Analytics
3 24 (24.00%) Data Modelling
4 22 (22.00%) Data Science
5 21 (21.00%) Machine Learning
5 21 (21.00%) SQL Optimisation
6 16 (16.00%) SDLC
7 12 (12.00%) Stakeholder Management
7 12 (12.00%) TDD
8 9 (9.00%) Problem-Solving
9 8 (8.00%) Data Management
9 8 (8.00%) DevOps
9 8 (8.00%) Migration
10 7 (7.00%) BDD
10 7 (7.00%) Continuous Integration
10 7 (7.00%) ETL
11 6 (6.00%) Scrum
11 6 (6.00%) Software Engineering
12 5 (5.00%) Project Management
12 5 (5.00%) Test Automation
Programming Languages
1 30 (30.00%) Java
2 22 (22.00%) SQL
3 15 (15.00%) Scala
4 12 (12.00%) Python
5 8 (8.00%) Java 8
6 7 (7.00%) Bash Shell
7 6 (6.00%) Perl
8 5 (5.00%) C
9 4 (4.00%) Ruby
10 2 (2.00%) R
10 2 (2.00%) Shell Script
11 1 (1.00%) C++
11 1 (1.00%) Go
11 1 (1.00%) JavaScript
11 1 (1.00%) PowerShell
11 1 (1.00%) PROC SQL
Qualifications
1 16 (16.00%) Security Cleared
2 7 (7.00%) SC Cleared
3 4 (4.00%) DV Cleared
3 4 (4.00%) ISTQB
4 1 (1.00%) BC Cleared
4 1 (1.00%) PRINCE2 Certification
Quality Assurance & Compliance
1 21 (21.00%) Data Quality
2 2 (2.00%) GDPR
System Software
1 12 (12.00%) Active Directory
2 9 (9.00%) Docker
3 2 (2.00%) HDFS
4 1 (1.00%) VMware Infrastructure
Systems Management
1 26 (26.00%) Oozie
2 22 (22.00%) Ansible
3 4 (4.00%) Opscode Chef
3 4 (4.00%) Puppet
4 2 (2.00%) Ambari
4 2 (2.00%) Hadoop YARN
5 1 (1.00%) SELinux
Vendors
1 12 (12.00%) Red Hat
2 11 (11.00%) Hortonworks
3 10 (10.00%) Informatica
4 6 (6.00%) Teradata
5 5 (5.00%) Microsoft
6 4 (4.00%) CA Agile Central
7 2 (2.00%) Oracle
7 2 (2.00%) Tableau
8 1 (1.00%) Ab Initio
8 1 (1.00%) Cloudera
8 1 (1.00%) Cognos
8 1 (1.00%) Netezza
8 1 (1.00%) Remedy
8 1 (1.00%) SAP
8 1 (1.00%) VMware