The following table provides summary statistics for contract job vacancies advertised in Scotland with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 3 months to 26 June 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK / Scotland
3 months to
26 Jun 2017
Same period 2016 Same period 2015
Rank 88 130 134
Rank change year-on-year +42 +4  
Contract jobs citing Hadoop 29 21 5
As % of all contract IT jobs advertised in Scotland 1.33% 0.73% 0.17%
As % of the Database & Business Intelligence category 6.39% 3.13% 0.81%
Number of daily rates quoted 15 9 2
Median daily rate £425 £500 £451
Median daily rate % change year-on-year -15.00% +10.98%  
90% offered a daily rate of more than £350 £260 £410
10% offered a daily rate of more than £520 £545 £491
UK excluding London median daily rate £435 £475 £450
% change year-on-year -8.42% +5.55%  
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate £50.00 £25.00 £26.00
% change year-on-year +100.00% -3.84%  

Hadoop is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Scotland with a requirement for database and business intelligence skills.

Contract Database & Business Intelligence Skills
Scotland
Contract job vacancies with a requirement for database and business intelligence skills 454 672 617
As % of all contract IT job vacancies advertised in Scotland 20.79% 23.21% 20.46%
Number of daily rates quoted 236 383 330
Median daily rate £400 £360 £350
Median daily rate % change year-on-year +11.11% +2.85%  
90% offered a daily rate of more than £300 £266 £275
10% offered a daily rate of more than £525 £500 £450
UK excluding London median daily rate £400 £383 £350
% change year-on-year +4.57% +9.28%  
Number of hourly rates quoted 5 14 3
Median hourly rate £43.39 £36.00 £42.50
Median hourly rate % change year-on-year +20.52% -15.29%  
UK excluding London median hourly rate £38.00 £30.50 £26.00
% change year-on-year +24.59% +17.30%  

Hadoop
Job Vacancy Trend in Scotland

The job posting trend of jobs advertised in Scotland citing Hadoop as a proportion of all contract or permanent IT jobs with a match in the Database & Business Intelligence category.

Job vacancy trend for Hadoop in Scotland

Hadoop
Contractor Daily Rate Trend in Scotland

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Scotland.

Contractor daily rate trend for Hadoop in Scotland

Hadoop
Contractor Daily Rate Histogram in Scotland

The daily rate distribution of IT jobs citing Hadoop in Scotland over the 3 months to 26 June 2017.

Contractor daily rate histogram for Hadoop in Scotland

Hadoop
Contract Job Locations in Scotland

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the Scotland region over the 3 months to 26 June 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Edinburgh +29 26 £419 +4.68% 5
Glasgow +8 3 £550 +37.50% 6
Hadoop
UK

For the 6 months to 26 June 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the Scotland region with a requirement for Hadoop.

1 17 (44.74%) Big Data
2 16 (42.11%) Finance
3 15 (39.47%) SQL
3 15 (39.47%) Data Modelling
4 14 (36.84%) ETL
5 12 (31.58%) Analytics
5 12 (31.58%) Banking
6 10 (26.32%) Apache Hive
6 10 (26.32%) Teradata
6 10 (26.32%) SAS
7 9 (23.68%) Data Warehouse
8 8 (21.05%) Agile Software Development
9 7 (18.42%) Retail
9 7 (18.42%) HBase
9 7 (18.42%) Cloudera
9 7 (18.42%) Apache Spark
10 6 (15.79%) Analytical Skills
10 6 (15.79%) Retail Banking
11 5 (13.16%) Data Architecture
11 5 (13.16%) R
11 5 (13.16%) OLAP
12 4 (10.53%) Informatica
12 4 (10.53%) Microsoft
12 4 (10.53%) Data Management
12 4 (10.53%) Apache Cassandra
12 4 (10.53%) Splunk
12 4 (10.53%) Scala
12 4 (10.53%) User Acceptance Testing
12 4 (10.53%) Malware Analysis
12 4 (10.53%) Data Lake

Hadoop
Co-occurring IT Skills in Scotland by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (26.32%) SAS
2 7 (18.42%) Apache Spark
3 2 (5.26%) Apache Airflow
4 1 (2.63%) Confluence
Applications
1 2 (5.26%) Microsoft Excel
2 1 (2.63%) Microsoft Office
Cloud Services
1 3 (7.89%) Amazon AWS
2 2 (5.26%) Amazon S3
3 1 (2.63%) PaaS
Communications & Networking
1 2 (5.26%) Firewall
2 1 (2.63%) DNS
2 1 (2.63%) Internet
2 1 (2.63%) IPsec
2 1 (2.63%) SSL
2 1 (2.63%) VLAN
2 1 (2.63%) VPN
Database & Business Intelligence
1 17 (44.74%) Big Data
2 10 (26.32%) Apache Hive
3 9 (23.68%) Data Warehouse
4 7 (18.42%) HBase
5 5 (13.16%) OLAP
6 4 (10.53%) Apache Cassandra
6 4 (10.53%) Data Lake
7 3 (7.89%) MOLAP
7 3 (7.89%) RDBMS
7 3 (7.89%) Relational Database
8 2 (5.26%) Impala
8 2 (5.26%) PowerCenter
8 2 (5.26%) SAS Visual Analytics
9 1 (2.63%) Enterprise Data Warehouse
9 1 (2.63%) NoSQL
9 1 (2.63%) SQL Server
9 1 (2.63%) SQL Server 2000
9 1 (2.63%) SQL Server 2005
9 1 (2.63%) SQL Server 2012
9 1 (2.63%) SQL Server 2014
Development Applications
1 2 (5.26%) JIRA
2 1 (2.63%) Artifactory
2 1 (2.63%) ERwin
2 1 (2.63%) Git (software)
2 1 (2.63%) ProC
2 1 (2.63%) TeamCity
General
1 16 (42.11%) Finance
2 12 (31.58%) Banking
3 7 (18.42%) Retail
4 6 (15.79%) Retail Banking
Job Titles
1 13 (34.21%) Analyst
2 8 (21.05%) Data Analyst
3 7 (18.42%) Architect
3 7 (18.42%) Data Architect
4 6 (15.79%) Designer
5 5 (13.16%) Solutions Designer
6 4 (10.53%) Big Data Analyst
6 4 (10.53%) Test Analyst
6 4 (10.53%) Test Data Analyst
7 3 (7.89%) Consultant
7 3 (7.89%) Data Modeller
7 3 (7.89%) Senior Analyst
8 2 (5.26%) Data Consultant
8 2 (5.26%) Developer
8 2 (5.26%) SAS Developer
8 2 (5.26%) Senior Test Analyst
8 2 (5.26%) Solutions Architect
8 2 (5.26%) Technical Leader
9 1 (2.63%) SAS Consultant
9 1 (2.63%) Senior Data Warehouse Specialist
Libraries, Frameworks & Software Standards
1 2 (5.26%) Kafka
2 1 (2.63%) .NET
2 1 (2.63%) HTML
2 1 (2.63%) HTML5
Miscellaneous
1 6 (15.79%) Analytical Skills
2 3 (7.89%) Taxonomies
3 2 (5.26%) Data Structures
3 2 (5.26%) Greenfield Project
4 1 (2.63%) Credit Risk
4 1 (2.63%) Mainframe
4 1 (2.63%) Security Operations Centre
Operating Systems
1 1 (2.63%) MVS
1 1 (2.63%) Unix
Processes & Methodologies
1 15 (39.47%) Data Modelling
2 14 (36.84%) ETL
3 12 (31.58%) Analytics
4 8 (21.05%) Agile Software Development
5 5 (13.16%) Data Architecture
6 4 (10.53%) Data Management
6 4 (10.53%) Malware Analysis
6 4 (10.53%) User Acceptance Testing
7 3 (7.89%) Business Analytics
7 3 (7.89%) Business Intelligence
7 3 (7.89%) Cybersecurity
7 3 (7.89%) Data Extraction
7 3 (7.89%) MapReduce
7 3 (7.89%) Master Data Management
7 3 (7.89%) Ontologies
7 3 (7.89%) Scenario Testing
7 3 (7.89%) Test Automation
7 3 (7.89%) Threat Intelligence
7 3 (7.89%) Visualisation
8 2 (5.26%) Migration
Programming Languages
1 15 (39.47%) SQL
2 5 (13.16%) R
3 4 (10.53%) Scala
4 3 (7.89%) Java
4 3 (7.89%) Python
5 2 (5.26%) VB
6 1 (2.63%) C
6 1 (2.63%) C#
6 1 (2.63%) C++
6 1 (2.63%) Dart
6 1 (2.63%) JavaScript
6 1 (2.63%) MATLAB
6 1 (2.63%) Perl
6 1 (2.63%) PowerShell
6 1 (2.63%) PROC SQL
6 1 (2.63%) SAS Macro
6 1 (2.63%) T-SQL
Qualifications
1 1 (2.63%) CISSP
1 1 (2.63%) SANS
Quality Assurance & Compliance
1 1 (2.63%) Data Quality
System Software
1 2 (5.26%) HDFS
Systems Management
1 2 (5.26%) Hadoop YARN
1 2 (5.26%) Oozie
2 1 (2.63%) ArcSight ESM
2 1 (2.63%) QRadar
Vendors
1 10 (26.32%) Teradata
2 7 (18.42%) Cloudera
3 4 (10.53%) Informatica
3 4 (10.53%) Microsoft
3 4 (10.53%) Splunk
4 2 (5.26%) ArcSight
4 2 (5.26%) IBM
4 2 (5.26%) Oracle
5 1 (2.63%) FireEye
5 1 (2.63%) MapR
5 1 (2.63%) Symantec