Period
to 14 November 2018

The following table provides summary statistics for contract job vacancies advertised in the North West with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 14 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > North West
6 months to
14 Nov 2018
Same period 2017 Same period 2016
Rank 146 136 167
Rank change year-on-year -10 +31 +35
Contract jobs citing Hadoop 65 65 59
As % of all contract IT jobs advertised in the North West 1.08% 1.13% 0.85%
As % of the Database & Business Intelligence category 5.15% 4.94% 3.37%
Number of daily rates quoted 52 66 38
North West median daily rate £528 £600 £488
Median daily rate % change year-on-year -12.08% +23.08% -3.94%
10th Percentile £400 £400 £384
90th Percentile £711 £702 £675
England median daily rate £550 £538 £525
% change year-on-year +2.33% +2.38% -
Number of hourly rates quoted 0 0 0
North West median hourly rate - - -
England median hourly rate £47.50 £35.00 £45.75
% change year-on-year +35.71% -23.50% +22.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the North West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
North West
Contract vacancies with a requirement for database or business intelligence skills 1,261 1,317 1,749
As % of all contract IT jobs advertised in the North West 21.03% 22.87% 25.15%
Number of daily rates quoted 843 896 1,162
North West median daily rate £400 £400 £375
Median daily rate % change year-on-year - +6.67% -6.25%
10th Percentile £285 £288 £263
90th Percentile £556 £618 £538
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +3.03%
Number of hourly rates quoted 26 30 44
North West median hourly rate £29.50 £42.50 £35.75
Median hourly rate % change year-on-year -30.59% +18.88% -10.63%
10th Percentile £10.13 £20.43 £14.38
90th Percentile £49.38 £53.00 £59.31
England median hourly rate £33.50 £31.31 £28.00
% change year-on-year +6.99% +11.82% +0.79%

Hadoop
Job Vacancy Trend in the North West

Job postings citing Hadoop as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Trend in the North West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the North West.

Contractor daily rate trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Histogram in the North West

The daily rate distribution of IT jobs citing Hadoop in the North West over the 6 months to 14 November 2018.

Contractor daily rate histogram for Hadoop in the North West

Hadoop
Contract Job Locations in the North West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the North West region over the 6 months to 14 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Manchester -16 37 £469 -14.77% 19
Cheshire +1 16 £503 +14.86% 1
Lancashire -17 10 £670 +9.84% 2
Merseyside -1 2 - - 1
Hadoop
England

For the 6 months to 14 November 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the North West region with a requirement for Hadoop.

1 33 (50.77%) Big Data
2 27 (41.54%) Apache Spark
3 23 (35.38%) Apache Hive
4 22 (33.85%) SQL
5 21 (32.31%) Java
6 19 (29.23%) Python
7 17 (26.15%) Data Warehouse
8 16 (24.62%) Oracle
8 16 (24.62%) Amazon AWS
8 16 (24.62%) Kafka
9 15 (23.08%) HBase
9 15 (23.08%) Cloudera
10 14 (21.54%) Finance
11 13 (20.00%) Business Intelligence
11 13 (20.00%) Analytics
11 13 (20.00%) DevOps
12 12 (18.46%) Jenkins
12 12 (18.46%) SAS
12 12 (18.46%) Agile Software Development
13 11 (16.92%) NoSQL
14 10 (15.38%) Puppet
14 10 (15.38%) Opscode Chef
14 10 (15.38%) Ansible
14 10 (15.38%) Terraform
14 10 (15.38%) Scala
14 10 (15.38%) Unix
14 10 (15.38%) ETL
14 10 (15.38%) Problem-Solving
15 9 (13.85%) Configuration Management
15 9 (13.85%) Linux

Hadoop
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 27 (41.54%) Apache Spark
2 12 (18.46%) SAS
3 5 (7.69%) Apache
4 4 (6.15%) Apache Pig
5 2 (3.08%) Confluence
5 2 (3.08%) Elasticsearch
Cloud Services
1 16 (24.62%) Amazon AWS
2 7 (10.77%) Microsoft Azure
3 4 (6.15%) AWS CloudFormation
4 3 (4.62%) Amazon EC2
4 3 (4.62%) Amazon EMR
4 3 (4.62%) Amazon S3
4 3 (4.62%) Cloud Computing
4 3 (4.62%) Google Cloud Platform
5 2 (3.08%) Amazon Kinesis
5 2 (3.08%) Virtual Private Cloud
Communications & Networking
1 2 (3.08%) DHCP
1 2 (3.08%) DNS
1 2 (3.08%) FTP
1 2 (3.08%) HTTP
1 2 (3.08%) IPsec
1 2 (3.08%) TCP/IP
Database & Business Intelligence
1 33 (50.77%) Big Data
2 23 (35.38%) Apache Hive
3 17 (26.15%) Data Warehouse
4 15 (23.08%) HBase
5 11 (16.92%) NoSQL
6 9 (13.85%) Base SAS
6 9 (13.85%) Relational Database
6 9 (13.85%) SAS Data Integration Studio
6 9 (13.85%) SAS Enterprise Guide
7 8 (12.31%) Impala
7 8 (12.31%) MongoDB
7 8 (12.31%) MySQL
7 8 (12.31%) Pentaho
8 7 (10.77%) Apache Cassandra
9 6 (9.23%) SQL Server
10 5 (7.69%) BusinessObjects
10 5 (7.69%) Ingres
10 5 (7.69%) Sqoop
11 4 (6.15%) PostgreSQL
12 3 (4.62%) RDBMS
Development Applications
1 12 (18.46%) Jenkins
2 8 (12.31%) Git (software)
3 4 (6.15%) JIRA
4 3 (4.62%) Artifactory
4 3 (4.62%) ERwin
5 2 (3.08%) Atlassian Bamboo
5 2 (3.08%) Hudson
5 2 (3.08%) RStudio
5 2 (3.08%) Sonatype Nexus
5 2 (3.08%) Subversion
5 2 (3.08%) Team Foundation Server
6 1 (1.54%) JIRA Agile
6 1 (1.54%) SonarQube
General
1 14 (21.54%) Finance
2 8 (12.31%) Banking
3 3 (4.62%) Automotive
4 1 (1.54%) Legal
4 1 (1.54%) Marketing
4 1 (1.54%) Retail
Job Titles
1 19 (29.23%) Developer
2 15 (23.08%) Data Engineer
3 7 (10.77%) DevOps Engineer
3 7 (10.77%) Hadoop Engineer
4 6 (9.23%) AWS Engineer
4 6 (9.23%) Big Data Engineer
4 6 (9.23%) Cloud Engineer
4 6 (9.23%) SAS Developer
5 5 (7.69%) Analyst
5 5 (7.69%) Architect
5 5 (7.69%) Business Analyst
5 5 (7.69%) Hadoop Developer
6 4 (6.15%) Apache Spark Developer
6 4 (6.15%) Big Data Developer
6 4 (6.15%) Data Architect
6 4 (6.15%) Data Scientist
6 4 (6.15%) Java Developer
6 4 (6.15%) Java Engineer
7 3 (4.62%) Java Hadoop Developer
7 3 (4.62%) SC Cleared Business Analyst
Libraries, Frameworks & Software Standards
1 16 (24.62%) Kafka
2 4 (6.15%) Spark Streaming
2 4 (6.15%) Web Services
3 3 (4.62%) .NET
3 3 (4.62%) Elastic Stack
3 3 (4.62%) RabbitMQ
3 3 (4.62%) Sensu
4 2 (3.08%) AngularJS
4 2 (3.08%) J2EE
4 2 (3.08%) LDAP
4 2 (3.08%) Natural Language Processing
4 2 (3.08%) Node.js
4 2 (3.08%) Pandas
4 2 (3.08%) React
4 2 (3.08%) scikit-learn
5 1 (1.54%) Anaconda
5 1 (1.54%) Apache Avro
5 1 (1.54%) MDX
5 1 (1.54%) REST
5 1 (1.54%) XGBoost
Miscellaneous
1 6 (9.23%) Analytical Skills
2 4 (6.15%) Data Structures
3 3 (4.62%) Management Information System
4 2 (3.08%) Enterprise Software
4 2 (3.08%) Self-Motivation
5 1 (1.54%) Algorithms
5 1 (1.54%) Computer Science
5 1 (1.54%) Fintech
5 1 (1.54%) Public Cloud
5 1 (1.54%) Virtual Team
Operating Systems
1 10 (15.38%) Unix
2 9 (13.85%) Linux
3 2 (3.08%) Windows
Processes & Methodologies
1 13 (20.00%) Analytics
1 13 (20.00%) Business Intelligence
1 13 (20.00%) DevOps
2 12 (18.46%) Agile Software Development
3 10 (15.38%) ETL
3 10 (15.38%) Problem-Solving
4 9 (13.85%) Configuration Management
4 9 (13.85%) Continuous Integration
4 9 (13.85%) Data Modelling
4 9 (13.85%) Open Source
5 7 (10.77%) Data Architecture
5 7 (10.77%) Scrum
6 6 (9.23%) Data Engineering
6 6 (9.23%) Data Science
6 6 (9.23%) Data Strategy
6 6 (9.23%) Migration
7 5 (7.69%) Machine Learning
7 5 (7.69%) Stakeholder Management
7 5 (7.69%) Visualisation
8 4 (6.15%) Test Automation
Programming Languages
1 22 (33.85%) SQL
2 21 (32.31%) Java
3 19 (29.23%) Python
4 10 (15.38%) Scala
5 8 (12.31%) Shell Script
6 6 (9.23%) Ruby
7 5 (7.69%) Bash Shell
8 2 (3.08%) JavaScript
8 2 (3.08%) MATLAB
9 1 (1.54%) Groovy
9 1 (1.54%) Java 8
9 1 (1.54%) PL/SQL
9 1 (1.54%) R
9 1 (1.54%) T-SQL
Qualifications
1 6 (9.23%) SC Cleared
1 6 (9.23%) Security Cleared
2 2 (3.08%) AWS Certification
2 2 (3.08%) CCA
2 2 (3.08%) Degree
2 2 (3.08%) PhD
3 1 (1.54%) BPSS Clearance
Quality Assurance & Compliance
1 4 (6.15%) Data Quality
1 4 (6.15%) QA
System Software
1 5 (7.69%) HDFS
2 3 (4.62%) Docker
3 1 (1.54%) Apache Flume
Systems Management
1 10 (15.38%) Ansible
1 10 (15.38%) Opscode Chef
1 10 (15.38%) Puppet
1 10 (15.38%) Terraform
2 4 (6.15%) Kubernetes
2 4 (6.15%) Salt
3 2 (3.08%) Docker Swarm
4 1 (1.54%) Ambari
4 1 (1.54%) Oozie
Vendors
1 16 (24.62%) Oracle
2 15 (23.08%) Cloudera
3 6 (9.23%) Tableau
4 5 (7.69%) Hortonworks
5 4 (6.15%) Informatica
5 4 (6.15%) Teradata
6 3 (4.62%) CA
6 3 (4.62%) Google
7 2 (3.08%) Ab Initio
7 2 (3.08%) Actuate
7 2 (3.08%) Cognos
7 2 (3.08%) CyberArk
7 2 (3.08%) HP
7 2 (3.08%) MapR
7 2 (3.08%) Microsoft
7 2 (3.08%) SAP
8 1 (1.54%) Salesforce.com
8 1 (1.54%) Talend