Period
to 17 August 2018

The following table provides summary statistics for contract job vacancies advertised in the North West with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 17 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > North West
6 months to
17 Aug 2018
Same period 2017 Same period 2016
Rank 136 163 189
Rank change year-on-year +27 +26 -23
Contract jobs citing Hadoop 84 44 44
As % of all contract IT jobs advertised in the North West 1.37% 0.77% 0.59%
As % of the Database & Business Intelligence category 6.53% 3.37% 2.62%
Number of daily rates quoted 72 39 27
North West median daily rate £541 £600 £435
Median daily rate % change year-on-year -9.79% +37.93% -27.50%
10th Percentile £400 £387 £374
90th Percentile £675 £755 £625
England median daily rate £550 £525 £525
% change year-on-year +4.76% - -4.55%
Number of hourly rates quoted 0 0 0
North West median hourly rate - - -
England median hourly rate £47.50 £35.00 £45.00
% change year-on-year +35.71% -22.22% +60.71%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the North West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
North West
Contract vacancies with a requirement for database or business intelligence skills 1,287 1,307 1,682
As % of all contract IT jobs advertised in the North West 20.97% 22.75% 22.38%
Number of daily rates quoted 889 822 1,067
North West median daily rate £400 £386 £375
Median daily rate % change year-on-year +3.56% +3.00% -4.46%
10th Percentile £275 £270 £250
90th Percentile £588 £532 £525
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 24 20 48
North West median hourly rate £35.00 £41.25 £29.01
Median hourly rate % change year-on-year -15.15% +42.18% -25.13%
10th Percentile £9.98 £13.44 £14.43
90th Percentile £54.55 £46.90 £59.31
England median hourly rate £30.00 £30.00 £28.50
% change year-on-year - +5.26% +11.07%

Hadoop
Job Vacancy Trend in the North West

Job postings citing Hadoop as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Trend in the North West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the North West.

Contractor daily rate trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Histogram in the North West

The daily rate distribution of IT jobs citing Hadoop in the North West over the 6 months to 17 August 2018.

Contractor daily rate histogram for Hadoop in the North West

Hadoop
Contract Job Locations in the North West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the North West region over the 6 months to 17 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Manchester -10 40 £550 - 25
Cheshire +10 23 £463 +12.80% 2
Lancashire -9 7 £670 +9.84% 1
Merseyside +17 3 £400 -33.33% 1
Hadoop
England

For the 6 months to 17 August 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the North West region with a requirement for Hadoop.

1 44 (52.38%) Big Data
2 34 (40.48%) Apache Spark
3 31 (36.90%) Apache Hive
4 27 (32.14%) Amazon AWS
4 27 (32.14%) Finance
5 26 (30.95%) Data Warehouse
6 25 (29.76%) Business Intelligence
6 25 (29.76%) HBase
7 23 (27.38%) SAS
8 22 (26.19%) Python
8 22 (26.19%) Java
9 19 (22.62%) Kafka
9 19 (22.62%) Jenkins
10 18 (21.43%) Cloudera
10 18 (21.43%) Analytics
10 18 (21.43%) DevOps
11 16 (19.05%) Ansible
11 16 (19.05%) Puppet
11 16 (19.05%) SQL
12 15 (17.86%) SAS Data Integration Studio
13 14 (16.67%) Opscode Chef
13 14 (16.67%) Stakeholder Management
13 14 (16.67%) Base SAS
13 14 (16.67%) SAS Enterprise Guide
14 13 (15.48%) MongoDB
14 13 (15.48%) Data Strategy
15 12 (14.29%) Data Architecture
15 12 (14.29%) Agile Software Development
15 12 (14.29%) Configuration Management
16 11 (13.10%) Data Modelling

Hadoop
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 34 (40.48%) Apache Spark
2 23 (27.38%) SAS
3 9 (10.71%) Apache
4 7 (8.33%) Apache Pig
5 1 (1.19%) Confluence
Cloud Services
1 27 (32.14%) Amazon AWS
2 8 (9.52%) AWS CloudFormation
3 7 (8.33%) Microsoft Azure
3 7 (8.33%) Virtual Private Cloud
4 5 (5.95%) Google Cloud Platform
5 3 (3.57%) Cloud Computing
6 2 (2.38%) Amazon EC2
6 2 (2.38%) Amazon ELB
6 2 (2.38%) AWS Lambda
6 2 (2.38%) AWS OpsWorks
6 2 (2.38%) Serverless
7 1 (1.19%) GitHub
7 1 (1.19%) PaaS
Communications & Networking
1 3 (3.57%) DNS
2 2 (2.38%) DHCP
2 2 (2.38%) FTP
2 2 (2.38%) HTTP
2 2 (2.38%) IPsec
2 2 (2.38%) TCP/IP
2 2 (2.38%) VPN
Database & Business Intelligence
1 44 (52.38%) Big Data
2 31 (36.90%) Apache Hive
3 26 (30.95%) Data Warehouse
4 25 (29.76%) HBase
5 15 (17.86%) SAS Data Integration Studio
6 14 (16.67%) Base SAS
6 14 (16.67%) SAS Enterprise Guide
7 13 (15.48%) MongoDB
8 10 (11.90%) BusinessObjects
9 9 (10.71%) NoSQL
9 9 (10.71%) PostgreSQL
10 8 (9.52%) Enterprise Data Warehouse
10 8 (9.52%) Pentaho
11 6 (7.14%) Apache Cassandra
11 6 (7.14%) Data Lake
12 4 (4.76%) Impala
12 4 (4.76%) Relational Database
12 4 (4.76%) Sqoop
13 3 (3.57%) SQL Server
13 3 (3.57%) Text Mining
Development Applications
1 19 (22.62%) Jenkins
2 11 (13.10%) Git (software)
3 8 (9.52%) ERwin
4 6 (7.14%) Atlassian Bamboo
5 5 (5.95%) Hudson
5 5 (5.95%) Sonatype Nexus
5 5 (5.95%) Subversion
5 5 (5.95%) Team Foundation Server
6 4 (4.76%) JIRA
7 2 (2.38%) JUnit
7 2 (2.38%) Mockito
7 2 (2.38%) RStudio
8 1 (1.19%) Bitbucket
8 1 (1.19%) GitLab
8 1 (1.19%) JIRA Agile
8 1 (1.19%) SonarQube
General
1 27 (32.14%) Finance
2 7 (8.33%) Banking
3 5 (5.95%) Automotive
4 3 (3.57%) Retail
5 1 (1.19%) Legal
5 1 (1.19%) Marketing
5 1 (1.19%) Pharmaceutical
Job Titles
1 20 (23.81%) Developer
2 19 (22.62%) Architect
3 12 (14.29%) Data Engineer
4 11 (13.10%) Cloud Architect
5 10 (11.90%) Data Architect
6 8 (9.52%) DevOps Engineer
6 8 (9.52%) Hadoop Engineer
7 6 (7.14%) Consultant
8 5 (5.95%) Analyst
8 5 (5.95%) Cloud Developer
8 5 (5.95%) Cloud Engineer
8 5 (5.95%) Lead Architect
8 5 (5.95%) SAS Developer
9 4 (4.76%) AWS DevOps
9 4 (4.76%) Big Data Architect
9 4 (4.76%) Big Data Developer
9 4 (4.76%) Big Data Engineer
9 4 (4.76%) Data Analyst
9 4 (4.76%) Java Developer
9 4 (4.76%) Senior DevOps
Libraries, Frameworks & Software Standards
1 19 (22.62%) Kafka
2 5 (5.95%) AngularJS
2 5 (5.95%) Node.js
2 5 (5.95%) React
3 3 (3.57%) .NET
3 3 (3.57%) J2EE
3 3 (3.57%) Web Services
4 2 (2.38%) LDAP
4 2 (2.38%) Natural Language Processing
4 2 (2.38%) Pandas
4 2 (2.38%) REST
4 2 (2.38%) scikit-learn
4 2 (2.38%) Spark Streaming
4 2 (2.38%) Spring
5 1 (1.19%) Dropwizard
5 1 (1.19%) JSON
5 1 (1.19%) MDX
5 1 (1.19%) XGBoost
5 1 (1.19%) YAML
Miscellaneous
1 11 (13.10%) Analytical Skills
2 8 (9.52%) Management Information System
3 7 (8.33%) Enterprise Software
4 4 (4.76%) Self-Motivation
5 2 (2.38%) Data Structures
5 2 (2.38%) Public Cloud
6 1 (1.19%) Algorithms
6 1 (1.19%) Computer Science
6 1 (1.19%) Virtual Team
Operating Systems
1 9 (10.71%) Linux
2 8 (9.52%) Unix
3 3 (3.57%) Red Hat Enterprise Linux
4 2 (2.38%) CentOS
4 2 (2.38%) Windows
Processes & Methodologies
1 25 (29.76%) Business Intelligence
2 18 (21.43%) Analytics
2 18 (21.43%) DevOps
3 14 (16.67%) Stakeholder Management
4 13 (15.48%) Data Strategy
5 12 (14.29%) Agile Software Development
5 12 (14.29%) Configuration Management
5 12 (14.29%) Data Architecture
6 11 (13.10%) Continuous Integration
6 11 (13.10%) Data Integration
6 11 (13.10%) Data Modelling
6 11 (13.10%) ETL
6 11 (13.10%) Open Source
7 10 (11.90%) Data Security
7 10 (11.90%) Visualisation
8 9 (10.71%) Data Management
8 9 (10.71%) Data Visualisation
8 9 (10.71%) Metadata Management
9 8 (9.52%) Reverse Engineering
10 7 (8.33%) Scrum
Programming Languages
1 22 (26.19%) Java
1 22 (26.19%) Python
2 16 (19.05%) SQL
3 11 (13.10%) Ruby
4 9 (10.71%) Bash Shell
4 9 (10.71%) Shell Script
5 5 (5.95%) JavaScript
5 5 (5.95%) Scala
6 4 (4.76%) Java 8
7 3 (3.57%) Groovy
8 1 (1.19%) MATLAB
8 1 (1.19%) R
8 1 (1.19%) T-SQL
Qualifications
1 4 (4.76%) AWS Certification
2 3 (3.57%) Degree
3 2 (2.38%) CCA
4 1 (1.19%) PhD
Quality Assurance & Compliance
1 9 (10.71%) Data Quality
2 7 (8.33%) QA
3 1 (1.19%) GCP
System Software
1 10 (11.90%) Docker
2 3 (3.57%) Apache Flume
3 2 (2.38%) HDFS
4 1 (1.19%) Active Directory
Systems Management
1 16 (19.05%) Ansible
1 16 (19.05%) Puppet
2 14 (16.67%) Opscode Chef
3 10 (11.90%) Kubernetes
3 10 (11.90%) Terraform
4 7 (8.33%) Salt
5 5 (5.95%) Docker Swarm
6 3 (3.57%) Consul
6 3 (3.57%) Hadoop YARN
6 3 (3.57%) Oozie
7 2 (2.38%) Ambari
7 2 (2.38%) ZABBIX
8 1 (1.19%) Packer
Vendors
1 18 (21.43%) Cloudera
2 9 (10.71%) Informatica
2 9 (10.71%) Oracle
2 9 (10.71%) Tableau
3 8 (9.52%) CA
4 5 (5.95%) Google
4 5 (5.95%) Hortonworks
5 2 (2.38%) CyberArk
5 2 (2.38%) HP
5 2 (2.38%) Microsoft
5 2 (2.38%) SAP
6 1 (1.19%) Atlassian
6 1 (1.19%) MapR
6 1 (1.19%) Red Hat
6 1 (1.19%) Salesforce.com
6 1 (1.19%) SaltStack
6 1 (1.19%) Teradata