Period
to 13 November 2019

The following table provides summary statistics for contract job vacancies advertised in the North West with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 13 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > North West
6 months to
13 Nov 2019
Same period 2018 Same period 2017
Rank 90 147 138
Rank change year-on-year +57 -9 +37
Contract jobs citing Hadoop 122 62 65
As % of all contract IT jobs advertised in the North West 2.25% 1.04% 1.14%
As % of the Database & Business Intelligence category 9.94% 4.97% 4.97%
Number of daily rates quoted 103 50 66
North West median daily rate £538 £525 £600
Median daily rate % change year-on-year +2.38% -12.50% +23.08%
10th Percentile £440 £400 £400
90th Percentile £615 £719 £702
England median daily rate £550 £550 £538
% change year-on-year - +2.33% +2.38%
Number of hourly rates quoted 0 0 0
North West median hourly rate - - -
England median hourly rate £43.53 £47.50 £35.00
% change year-on-year -8.35% +35.71% -23.50%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the North West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
North West
Contract vacancies with a requirement for database or business intelligence skills 1,227 1,247 1,307
As % of all contract IT jobs advertised in the North West 22.61% 20.96% 22.88%
Number of daily rates quoted 874 832 888
North West median daily rate £450 £400 £400
Median daily rate % change year-on-year +12.50% - +6.67%
10th Percentile £306 £285 £287
90th Percentile £575 £556 £622
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 23 26 30
North West median hourly rate £30.00 £29.50 £42.50
Median hourly rate % change year-on-year +1.69% -30.59% +18.88%
10th Percentile £11.35 £10.13 £20.43
90th Percentile £53.75 £49.38 £53.00
England median hourly rate £31.50 £33.50 £31.23
% change year-on-year -5.97% +7.27% +11.54%

Hadoop
Job Vacancy Trend in the North West

Job postings citing Hadoop as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Trend in the North West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the North West.

Contractor daily rate trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Histogram in the North West

The daily rate distribution of IT jobs citing Hadoop in the North West over the 6 months to 13 November 2019.

Contractor daily rate histogram for Hadoop in the North West

Hadoop
Contract Job Locations in the North West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the North West region over the 6 months to 13 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Lancashire +48 49 £540 -19.40%
Manchester +4 30 £500 +8.11% 10
Cheshire -1 7 £650 +30.00% 1
Merseyside -7 4 £538 - 2
Hadoop
England

For the 6 months to 13 November 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the North West region with a requirement for Hadoop.

1 58 (47.54%) Cloudera
2 55 (45.08%) Big Data
3 49 (40.16%) Python
4 37 (30.33%) DevOps
4 37 (30.33%) Apache Spark
5 36 (29.51%) AWS
5 36 (29.51%) SQL
6 33 (27.05%) Migration
7 29 (23.77%) Data Modelling
8 28 (22.95%) Java
8 28 (22.95%) Terraform
9 27 (22.13%) Azure
9 27 (22.13%) Jenkins
10 26 (21.31%) Hortonworks
10 26 (21.31%) Docker
11 25 (20.49%) Kubernetes
11 25 (20.49%) Analytics
12 24 (19.67%) Analytical Skills
13 23 (18.85%) Puppet
13 23 (18.85%) Tableau
14 22 (18.03%) Data Migration
15 21 (17.21%) Shell Script
15 21 (17.21%) GitLab
15 21 (17.21%) Data Science
16 20 (16.39%) MongoDB
17 19 (15.57%) Microservices
17 19 (15.57%) ETL
17 19 (15.57%) Data Architecture
18 18 (14.75%) NoSQL
19 17 (13.93%) Apache Hive

Hadoop
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 37 (30.33%) Apache Spark
2 10 (8.20%) SAS
3 4 (3.28%) Apache
4 3 (2.46%) Apache Pig
5 1 (0.82%) Elasticsearch
Applications
1 6 (4.92%) Microsoft Excel
1 6 (4.92%) Spreadsheet
2 2 (1.64%) MS Visio
2 2 (1.64%) SPSS
3 1 (0.82%) Stata
Business Applications
1 1 (0.82%) Sparx Enterprise Architect
Cloud Services
1 36 (29.51%) AWS
2 27 (22.13%) Azure
3 6 (4.92%) GCP
4 5 (4.10%) Power Platform
5 2 (1.64%) GitHub
6 1 (0.82%) Cloud Computing
6 1 (0.82%) Google Analytics
Communications & Networking
1 3 (2.46%) Firewall
2 2 (1.64%) F5 BIG-IP GTM
2 2 (1.64%) F5 BIG-IP LTM
2 2 (1.64%) Kerberos
3 1 (0.82%) DNS
Database & Business Intelligence
1 55 (45.08%) Big Data
2 20 (16.39%) MongoDB
3 18 (14.75%) NoSQL
4 17 (13.93%) Apache Hive
5 16 (13.11%) PostgreSQL
6 15 (12.30%) Qlik Sense
7 11 (9.02%) Data Warehouse
8 8 (6.56%) Pentaho
9 7 (5.74%) Sqoop
10 6 (4.92%) Data Lake
11 5 (4.10%) Amazon Redshift
11 5 (4.10%) HBase
11 5 (4.10%) Impala
11 5 (4.10%) Power BI
12 4 (3.28%) SQL Server Analysis Services
12 4 (3.28%) SQL Server Integration Services
12 4 (3.28%) SQL Server Reporting Services
13 3 (2.46%) BusinessObjects
13 3 (2.46%) Oracle OWB
13 3 (2.46%) Relational Database
Development Applications
1 27 (22.13%) Jenkins
2 21 (17.21%) GitLab
3 5 (4.10%) JIRA
4 4 (3.28%) Git (software)
5 3 (2.46%) ERwin
6 1 (0.82%) JIRA Agile
6 1 (0.82%) SonarQube
6 1 (0.82%) Sonatype Nexus
General
1 7 (5.74%) Finance
1 7 (5.74%) Public Sector
2 3 (2.46%) Banking
2 3 (2.46%) Manufacturing
2 3 (2.46%) Pharmaceutical
3 1 (0.82%) Law
Job Titles
1 34 (27.87%) Administrator
2 25 (20.49%) Architect
3 21 (17.21%) Data Architect
4 14 (11.48%) Cloud Engineer
4 14 (11.48%) Data Engineer
5 12 (9.84%) DevOps Administrator
6 10 (8.20%) DevOps Engineer
7 9 (7.38%) Hadoop Administrator
8 8 (6.56%) Cloud Administrator
8 8 (6.56%) Informatica Administrator
9 7 (5.74%) Analyst
9 7 (5.74%) Data Scientist
9 7 (5.74%) Developer
9 7 (5.74%) Hadoop Engineer
10 5 (4.10%) Business Analyst
11 4 (3.28%) Big Data Analyst
11 4 (3.28%) Big Data Engineer
11 4 (3.28%) Data Administrator
11 4 (3.28%) Data Analyst
11 4 (3.28%) Data Business Analyst
Libraries, Frameworks & Software Standards
1 13 (10.66%) Kafka
2 9 (7.38%) Web Services
3 4 (3.28%) REST
4 2 (1.64%) Apache NiFi
4 2 (1.64%) Spring
4 2 (1.64%) Spring Boot
5 1 (0.82%) Apache Avro
5 1 (0.82%) Apache Beam
5 1 (0.82%) JSON
5 1 (0.82%) MLlib
5 1 (0.82%) ODBC
5 1 (0.82%) Regular Expression
5 1 (0.82%) XML
Miscellaneous
1 24 (19.67%) Analytical Skills
2 10 (8.20%) User Experience
3 4 (3.28%) Algorithms
4 3 (2.46%) Greenfield Project
5 2 (1.64%) Taxonomies
6 1 (0.82%) Linux Command Line
6 1 (0.82%) Self-Motivation
Operating Systems
1 11 (9.02%) Windows
2 10 (8.20%) Windows Server
3 8 (6.56%) Linux
4 5 (4.10%) Unix
5 1 (0.82%) Red Hat Enterprise Linux
Processes & Methodologies
1 37 (30.33%) DevOps
2 33 (27.05%) Migration
3 29 (23.77%) Data Modelling
4 25 (20.49%) Analytics
5 22 (18.03%) Data Migration
6 21 (17.21%) Data Science
7 19 (15.57%) Data Architecture
7 19 (15.57%) ETL
7 19 (15.57%) Microservices
8 17 (13.93%) Business Intelligence
8 17 (13.93%) Domain-Driven Design
9 16 (13.11%) Data Strategy
10 15 (12.30%) Data Ingestion
10 15 (12.30%) Software Engineering
11 14 (11.48%) Data Analytics
11 14 (11.48%) TOGAF
12 13 (10.66%) Data Integration
12 13 (10.66%) Digital Transformation Programme
13 12 (9.84%) Content Management
14 11 (9.02%) Machine Learning
Programming Languages
1 49 (40.16%) Python
2 36 (29.51%) SQL
3 28 (22.95%) Java
4 21 (17.21%) Shell Script
5 11 (9.02%) Scala
6 10 (8.20%) PowerShell
6 10 (8.20%) R
7 6 (4.92%) PL/SQL
8 3 (2.46%) Java 8
9 1 (0.82%) C++
9 1 (0.82%) Go
9 1 (0.82%) Perl
Qualifications
1 16 (13.11%) Security Cleared
2 13 (10.66%) SC Cleared
3 7 (5.74%) CCA
4 5 (4.10%) Degree
5 4 (3.28%) BPSS Clearance
5 4 (3.28%) PhD
6 2 (1.64%) CCIE
6 2 (1.64%) CCNP
6 2 (1.64%) Cisco Certification
6 2 (1.64%) DV Cleared
7 1 (0.82%) Numerate Degree
Quality Assurance & Compliance
1 7 (5.74%) Data Quality
2 5 (4.10%) Sarbanes-Oxley
3 3 (2.46%) GDPR
3 3 (2.46%) SLA
4 1 (0.82%) ISO/IEC 27001
System Software
1 26 (21.31%) Docker
2 4 (3.28%) HDFS
3 1 (0.82%) Active Directory
3 1 (0.82%) Apache ZooKeeper
Systems Management
1 28 (22.95%) Terraform
2 25 (20.49%) Kubernetes
3 23 (18.85%) Puppet
4 16 (13.11%) Ansible
5 14 (11.48%) Packer
6 5 (4.10%) Oozie
7 2 (1.64%) FortiGate
Vendors
1 58 (47.54%) Cloudera
2 26 (21.31%) Hortonworks
3 23 (18.85%) Tableau
4 16 (13.11%) Informatica
5 6 (4.92%) Oracle
6 5 (4.10%) Talend
7 4 (3.28%) Google
7 4 (3.28%) Teradata
8 2 (1.64%) Blue Coat
8 2 (1.64%) Cisco
8 2 (1.64%) Cognos
8 2 (1.64%) F5
8 2 (1.64%) IBM
8 2 (1.64%) Juniper
8 2 (1.64%) MapR
8 2 (1.64%) MicroStrategy
8 2 (1.64%) Netezza
8 2 (1.64%) SAP
8 2 (1.64%) Sybase
8 2 (1.64%) Vertica