Period
to 16 July 2019

The following table provides summary statistics for contract job vacancies advertised in the North West with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 16 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > North West
6 months to
16 Jul 2019
Same period 2018 Same period 2017
Rank 99 139 149
Rank change year-on-year +40 +10 +51
Contract jobs citing Hadoop 103 86 48
As % of all contract IT jobs advertised in the North West 1.94% 1.40% 0.85%
As % of the Database & Business Intelligence category 8.75% 6.77% 3.78%
Number of daily rates quoted 86 73 36
North West median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% - +14.13%
10th Percentile £456 £380 £325
90th Percentile £638 £675 £696
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 1 0 0
North West median hourly rate £69.00 - -
England median hourly rate £43.53 £47.50 £47.00
% change year-on-year -8.35% +1.06% +23.68%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the North West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
North West
Contract vacancies with a requirement for database or business intelligence skills 1,177 1,270 1,271
As % of all contract IT jobs advertised in the North West 22.16% 20.61% 22.48%
Number of daily rates quoted 851 884 782
North West median daily rate £425 £390 £375
Median daily rate % change year-on-year +8.97% +4.00% -
10th Percentile £300 £269 £263
90th Percentile £600 £575 £531
England median daily rate £485 £475 £450
% change year-on-year +2.00% +5.56% +5.88%
Number of hourly rates quoted 22 20 29
North West median hourly rate £39.87 £41.25 £41.25
Median hourly rate % change year-on-year -3.35% - +12.24%
10th Percentile £14.58 £11.93 £14.53
90th Percentile £63.75 £55.38 £46.80
England median hourly rate £35.00 £33.50 £30.50
% change year-on-year +4.48% +9.84% +7.02%

Hadoop
Job Vacancy Trend in the North West

Job postings citing Hadoop as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Trend in the North West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the North West.

Contractor daily rate trend for Hadoop in the North West

Hadoop
Contractor Daily Rate Histogram in the North West

The daily rate distribution of IT jobs citing Hadoop in the North West over the 6 months to 16 July 2019.

Contractor daily rate histogram for Hadoop in the North West

Hadoop
Contract Job Locations in the North West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the North West region over the 6 months to 16 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Lancashire +40 51 £550 -12.00% 3
Manchester +3 29 £563 +2.27% 14
Merseyside -7 4 £563 +7.14% 1
Cheshire -6 3 £600 +33.33% 3
Hadoop
England

For the 6 months to 16 July 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the North West region with a requirement for Hadoop.

1 53 (51.46%) Big Data
2 52 (50.49%) Cloudera
3 43 (41.75%) DevOps
4 42 (40.78%) Python
5 41 (39.81%) Amazon AWS
6 40 (38.83%) Hortonworks
7 37 (35.92%) Jenkins
8 34 (33.01%) Apache Spark
9 32 (31.07%) Terraform
10 29 (28.16%) Docker
11 28 (27.18%) Kubernetes
12 27 (26.21%) Java
13 25 (24.27%) SQL
14 24 (23.30%) Migration
15 23 (22.33%) Data Modelling
15 23 (22.33%) Puppet
15 23 (22.33%) MongoDB
15 23 (22.33%) Microsoft Azure
16 21 (20.39%) Agile Software Development
17 20 (19.42%) Data Migration
18 19 (18.45%) Apache Hive
18 19 (18.45%) NoSQL
19 17 (16.50%) Tableau
20 15 (14.56%) GitLab
20 15 (14.56%) Microservices
20 15 (14.56%) Software Engineering
21 14 (13.59%) Linux
21 14 (13.59%) Scala
22 13 (12.62%) Domain-Driven Design
22 13 (12.62%) Analytical Skills

Hadoop
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 34 (33.01%) Apache Spark
2 10 (9.71%) SAS
3 9 (8.74%) Apache Pig
4 8 (7.77%) Apache
Applications
1 3 (2.91%) SPSS
2 2 (1.94%) MS Visio
2 2 (1.94%) Stata
Cloud Services
1 41 (39.81%) Amazon AWS
2 23 (22.33%) Microsoft Azure
3 4 (3.88%) GitHub
3 4 (3.88%) Power Platform
4 3 (2.91%) AWS CloudFormation
5 2 (1.94%) Amazon CloudWatch
6 1 (0.97%) Amazon ECS
6 1 (0.97%) AWS Lambda
6 1 (0.97%) Azure Data Factory
6 1 (0.97%) Cloud Computing
6 1 (0.97%) Google Cloud Platform
6 1 (0.97%) Serverless
6 1 (0.97%) Virtual Private Cloud
Communications & Networking
1 1 (0.97%) DNS
1 1 (0.97%) Firewall
1 1 (0.97%) ICMP
1 1 (0.97%) Network Security
1 1 (0.97%) SSL
1 1 (0.97%) VPN
Database & Business Intelligence
1 53 (51.46%) Big Data
2 23 (22.33%) MongoDB
3 19 (18.45%) Apache Hive
3 19 (18.45%) NoSQL
4 13 (12.62%) Data Warehouse
5 10 (9.71%) HBase
6 7 (6.80%) Apache Cassandra
7 6 (5.83%) Data Lake
7 6 (5.83%) SQL Server
8 5 (4.85%) Impala
8 5 (4.85%) Sqoop
9 4 (3.88%) Power BI
9 4 (3.88%) SQL Server Analysis Services
9 4 (3.88%) SQL Server Integration Services
9 4 (3.88%) SQL Server Reporting Services
10 3 (2.91%) BusinessObjects
10 3 (2.91%) Essbase
10 3 (2.91%) Oracle BI EE
10 3 (2.91%) PostgreSQL
10 3 (2.91%) Qlik Sense
Development Applications
1 37 (35.92%) Jenkins
2 15 (14.56%) GitLab
3 6 (5.83%) Git (software)
3 6 (5.83%) Gradle
3 6 (5.83%) Subversion
4 5 (4.85%) JIRA
4 5 (4.85%) Maven
5 3 (2.91%) ERwin
5 3 (2.91%) SonarQube
6 2 (1.94%) Bitbucket
6 2 (1.94%) JIRA Agile
6 2 (1.94%) JUnit
6 2 (1.94%) Selenium
6 2 (1.94%) Team Foundation Server
7 1 (0.97%) Atlassian Bamboo
7 1 (0.97%) Hudson
7 1 (0.97%) Sonatype Nexus
7 1 (0.97%) TeamCity
General
1 5 (4.85%) Finance
2 4 (3.88%) Banking
3 2 (1.94%) Marketing
4 1 (0.97%) Automotive
4 1 (0.97%) Retail
Job Titles
1 25 (24.27%) Architect
2 23 (22.33%) Data Architect
3 21 (20.39%) Cloud Engineer
4 19 (18.45%) DevOps Engineer
5 17 (16.50%) Hadoop Engineer
6 15 (14.56%) Administrator
7 11 (10.68%) Developer
8 10 (9.71%) Hadoop Administrator
9 9 (8.74%) Data Engineer
10 7 (6.80%) Cloud Automation Engineer
11 6 (5.83%) Automation Engineer
11 6 (5.83%) Consultant
11 6 (5.83%) Lead DevOps
12 5 (4.85%) DevOps Automation Engineer
12 5 (4.85%) DevOps Manager
12 5 (4.85%) Hadoop Consultant
12 5 (4.85%) Java Developer
12 5 (4.85%) Solutions Architect
13 4 (3.88%) AWS DevOps
13 4 (3.88%) Big Data Developer
Libraries, Frameworks & Software Standards
1 11 (10.68%) Kafka
2 8 (7.77%) Web Services
3 5 (4.85%) Spring
4 4 (3.88%) REST
5 3 (2.91%) J2EE
5 3 (2.91%) Spring Boot
6 2 (1.94%) ActiveMQ
6 2 (1.94%) Ajax
6 2 (1.94%) CSS
6 2 (1.94%) Hibernate
6 2 (1.94%) HTML
6 2 (1.94%) HTML5
6 2 (1.94%) jQuery
6 2 (1.94%) JSF
6 2 (1.94%) JSON
6 2 (1.94%) JSP
6 2 (1.94%) Servlets
7 1 (0.97%) Node.js
7 1 (0.97%) RabbitMQ
7 1 (0.97%) RESTful
Miscellaneous
1 13 (12.62%) Analytical Skills
2 8 (7.77%) User Experience
3 4 (3.88%) Algorithms
4 3 (2.91%) Greenfield Project
5 2 (1.94%) Mobile App
5 2 (1.94%) Public Cloud
5 2 (1.94%) SCADA
5 2 (1.94%) Taxonomies
6 1 (0.97%) Clustering
6 1 (0.97%) Replication
Operating Systems
1 14 (13.59%) Linux
2 5 (4.85%) Unix
3 4 (3.88%) Windows
4 2 (1.94%) Solaris
5 1 (0.97%) Red Hat Enterprise Linux
5 1 (0.97%) Windows Server
5 1 (0.97%) Windows Server 2008
5 1 (0.97%) Windows Server 2012
Processes & Methodologies
1 43 (41.75%) DevOps
2 24 (23.30%) Migration
3 23 (22.33%) Data Modelling
4 21 (20.39%) Agile Software Development
5 20 (19.42%) Data Migration
6 15 (14.56%) Microservices
6 15 (14.56%) Software Engineering
7 13 (12.62%) Domain-Driven Design
7 13 (12.62%) Re-Platforming
8 12 (11.65%) TOGAF
9 11 (10.68%) Data Architecture
10 10 (9.71%) Analytics
10 10 (9.71%) Business Intelligence
10 10 (9.71%) Data Ingestion
10 10 (9.71%) Infrastructure as Code
11 8 (7.77%) Data Science
11 8 (7.77%) Data Strategy
11 8 (7.77%) MapReduce
11 8 (7.77%) Performance Tuning
12 7 (6.80%) High Availability
Programming Languages
1 42 (40.78%) Python
2 27 (26.21%) Java
3 25 (24.27%) SQL
4 14 (13.59%) Scala
5 11 (10.68%) Shell Script
6 7 (6.80%) R
7 4 (3.88%) Java 8
8 3 (2.91%) JavaScript
9 1 (0.97%) C++
9 1 (0.97%) Perl
9 1 (0.97%) PL/SQL
9 1 (0.97%) PowerShell
9 1 (0.97%) Ruby
9 1 (0.97%) T-SQL
Qualifications
1 4 (3.88%) CCA
2 3 (2.91%) BPSS Clearance
2 3 (2.91%) Security Cleared
3 2 (1.94%) DV Cleared
4 1 (0.97%) AWS Certification
4 1 (0.97%) Computer Science Degree
4 1 (0.97%) Degree
4 1 (0.97%) ITIL Certification
4 1 (0.97%) SC Cleared
Quality Assurance & Compliance
1 5 (4.85%) Sarbanes-Oxley
2 3 (2.91%) Data Quality
2 3 (2.91%) SLA
3 1 (0.97%) GDPR
3 1 (0.97%) ISO/IEC 27001
System Software
1 29 (28.16%) Docker
2 6 (5.83%) Apache Flume
3 4 (3.88%) HDFS
4 2 (1.94%) Apache ZooKeeper
5 1 (0.97%) Active Directory
Systems Management
1 32 (31.07%) Terraform
2 28 (27.18%) Kubernetes
3 23 (22.33%) Puppet
4 9 (8.74%) Oozie
5 5 (4.85%) Ansible
6 3 (2.91%) Opscode Chef
6 3 (2.91%) Packer
7 2 (1.94%) ZABBIX
8 1 (0.97%) Consul
8 1 (0.97%) Docker Swarm
8 1 (0.97%) Hadoop YARN
8 1 (0.97%) Microsoft Clustering
8 1 (0.97%) Salt
Vendors
1 52 (50.49%) Cloudera
2 40 (38.83%) Hortonworks
3 17 (16.50%) Tableau
4 8 (7.77%) Informatica
5 5 (4.85%) Oracle
6 4 (3.88%) Teradata
7 3 (2.91%) Talend
8 2 (1.94%) Cognos
8 2 (1.94%) MapR
8 2 (1.94%) Microsoft
8 2 (1.94%) MicroStrategy
8 2 (1.94%) MuleSoft
8 2 (1.94%) Netezza
8 2 (1.94%) SAP
8 2 (1.94%) Sybase
9 1 (0.97%) Databricks
9 1 (0.97%) Gemalto
9 1 (0.97%) Google
9 1 (0.97%) Splunk