Period
to 21 February 2019

The following table provides summary statistics for contract job vacancies advertised in the North West with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 21 February 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > North West
6 months to
21 Feb 2019
Same period 2018 Same period 2017
Rank 120 96 115
Rank change year-on-year -24 +19 +57
Contract jobs citing Big Data 98 109 102
As % of all contract IT jobs advertised in the North West 1.71% 2.03% 1.72%
As % of the Database & Business Intelligence category 8.07% 9.09% 6.88%
Number of daily rates quoted 82 87 74
North West median daily rate £600 £525 £510
Median daily rate % change year-on-year +14.29% +2.94% +13.33%
10th Percentile £414 £343 £350
90th Percentile £773 £624 £648
England median daily rate £550 £550 £533
% change year-on-year - +3.29% +2.40%
Number of hourly rates quoted 0 0 0
North West median hourly rate - - -
England median hourly rate £45.00 £37.66 £43.00
% change year-on-year +19.51% -12.43% +33.49%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the North West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
North West
Contract vacancies with a requirement for database or business intelligence skills 1,215 1,199 1,483
As % of all contract IT jobs advertised in the North West 21.17% 22.28% 25.03%
Number of daily rates quoted 832 860 1,010
North West median daily rate £400 £400 £375
Median daily rate % change year-on-year - +6.67% -2.47%
10th Percentile £290 £268 £269
90th Percentile £600 £625 £555
England median daily rate £488 £475 £438
% change year-on-year +2.63% +8.57% +2.94%
Number of hourly rates quoted 27 30 39
North West median hourly rate £36.23 £43.05 £38.50
Median hourly rate % change year-on-year -15.86% +11.82% -0.32%
10th Percentile £17.15 £14.73 £14.38
90th Percentile £47.50 £64.06 £46.40
England median hourly rate £35.00 £35.00 £26.50
% change year-on-year - +32.08% -1.85%

Big Data
Job Vacancy Trend in the North West

Job postings citing Big Data as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Big Data in the North West

Big Data
Contractor Daily Rate Trend in the North West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the North West.

Contractor daily rate trend for Big Data in the North West

Big Data
Contractor Daily Rate Histogram in the North West

The daily rate distribution of IT jobs citing Big Data in the North West over the 6 months to 21 February 2019.

Contractor daily rate histogram for Big Data in the North West

Big Data
Contract Job Locations in the North West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the North West region over the 6 months to 21 February 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Lancashire +11 42 £675 +58.82% 3
Manchester -40 29 £500 -9.09% 28
Cheshire -14 9 £575 +41.98% 9
Merseyside -15 8 £556 -1.11%
Cumbria - 1 - -
Big Data
England

For the 6 months to 21 February 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the North West region with a requirement for Big Data.

1 50 (51.02%) Hadoop
2 38 (38.78%) Cloudera
3 35 (35.71%) Amazon AWS
4 33 (33.67%) Apache Spark
5 29 (29.59%) Hortonworks
6 28 (28.57%) Apache Hive
7 26 (26.53%) Python
7 26 (26.53%) DevOps
8 24 (24.49%) Java
9 23 (23.47%) Agile Software Development
10 22 (22.45%) Data Warehouse
11 21 (21.43%) ETL
11 21 (21.43%) Microsoft Azure
12 20 (20.41%) SQL
13 18 (18.37%) Business Intelligence
14 17 (17.35%) Data Modelling
15 15 (15.31%) Scala
15 15 (15.31%) Data Architecture
16 14 (14.29%) Analytics
16 14 (14.29%) Linux
17 13 (13.27%) Software Engineering
17 13 (13.27%) NoSQL
17 13 (13.27%) HDFS
17 13 (13.27%) Data Lake
18 12 (12.24%) Docker
18 12 (12.24%) Kafka
19 11 (11.22%) HBase
19 11 (11.22%) Web Services
19 11 (11.22%) Microsoft
19 11 (11.22%) Impala

Big Data
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 33 (33.67%) Apache Spark
2 5 (5.10%) SAS
3 3 (3.06%) Apache
3 3 (3.06%) Apache Pig
4 2 (2.04%) Confluence
4 2 (2.04%) Elasticsearch
5 1 (1.02%) Adobe Experience Manager
5 1 (1.02%) Apache Airflow
5 1 (1.02%) OpenStack
5 1 (1.02%) SharePoint
5 1 (1.02%) Tomcat
Applications
1 2 (2.04%) SPSS
1 2 (2.04%) Stata
2 1 (1.02%) Microsoft Excel
2 1 (1.02%) Microsoft Office
2 1 (1.02%) Microsoft PowerPoint
Business Applications
1 4 (4.08%) Payment Gateway
2 1 (1.02%) Distributed Ledger
2 1 (1.02%) Exstream
Cloud Services
1 35 (35.71%) Amazon AWS
2 21 (21.43%) Microsoft Azure
3 7 (7.14%) Amazon EMR
3 7 (7.14%) Amazon S3
4 6 (6.12%) Amazon EC2
5 3 (3.06%) Amazon Kinesis
6 2 (2.04%) AWS Lambda
6 2 (2.04%) Serverless
7 1 (1.02%) AWS Data Pipeline
7 1 (1.02%) Azure Data Factory
7 1 (1.02%) CloudBees
7 1 (1.02%) IaaS
7 1 (1.02%) PaaS
7 1 (1.02%) Slack
Communications & Networking
1 8 (8.16%) Network Security
2 4 (4.08%) DNS
2 4 (4.08%) Firewall
2 4 (4.08%) ICMP
2 4 (4.08%) SSL
2 4 (4.08%) VPN
3 2 (2.04%) Kerberos
4 1 (1.02%) Unified Communications
Database & Business Intelligence
1 50 (51.02%) Hadoop
2 28 (28.57%) Apache Hive
3 22 (22.45%) Data Warehouse
4 13 (13.27%) Data Lake
4 13 (13.27%) NoSQL
5 11 (11.22%) HBase
5 11 (11.22%) Impala
5 11 (11.22%) Power BI
6 9 (9.18%) Relational Database
6 9 (9.18%) Sqoop
7 8 (8.16%) MongoDB
8 6 (6.12%) SQL Server
9 5 (5.10%) Apache Cassandra
9 5 (5.10%) Apache Kudu
9 5 (5.10%) Parquet
9 5 (5.10%) PostgreSQL
10 4 (4.08%) BusinessObjects
10 4 (4.08%) Cloudera CDH
10 4 (4.08%) MySQL
10 4 (4.08%) SQL Server Integration Services
Development Applications
1 6 (6.12%) Git (software)
2 5 (5.10%) Jenkins
3 3 (3.06%) Bitbucket
3 3 (3.06%) Gradle
3 3 (3.06%) Maven
3 3 (3.06%) RStudio
4 2 (2.04%) ERwin
4 2 (2.04%) JIRA
4 2 (2.04%) Subversion
5 1 (1.02%) Artifactory
5 1 (1.02%) Cucumber
5 1 (1.02%) GitLab
5 1 (1.02%) Selenium
5 1 (1.02%) SonarQube
5 1 (1.02%) Toad
General
1 10 (10.20%) Finance
2 4 (4.08%) Banking
2 4 (4.08%) Legal
2 4 (4.08%) Retail
3 1 (1.02%) Law
3 1 (1.02%) Manufacturing
3 1 (1.02%) Telecoms
Job Titles
1 25 (25.51%) Architect
2 20 (20.41%) Data Architect
3 17 (17.35%) Data Engineer
3 17 (17.35%) Developer
4 15 (15.31%) Cloud Engineer
5 14 (14.29%) DevOps Engineer
6 12 (12.24%) Hadoop Engineer
7 11 (11.22%) Big Data Engineer
8 10 (10.20%) Solutions Architect
9 7 (7.14%) Big Data Developer
9 7 (7.14%) Consultant
10 5 (5.10%) Apache Spark Developer
10 5 (5.10%) AWS DevOps
10 5 (5.10%) AWS Engineer
10 5 (5.10%) Hadoop Developer
10 5 (5.10%) Infrastructure Solutions Architect
10 5 (5.10%) Java Developer
10 5 (5.10%) Python Engineer
11 4 (4.08%) PCI DSS Consultant
11 4 (4.08%) Software Engineer
Libraries, Frameworks & Software Standards
1 12 (12.24%) Kafka
2 11 (11.22%) Web Services
3 5 (5.10%) Apache Avro
4 3 (3.06%) Django
4 3 (3.06%) Spark Streaming
4 3 (3.06%) Spring
5 2 (2.04%) Node.js
5 2 (2.04%) Spring Boot
6 1 (1.02%) .NET Core
6 1 (1.02%) Dropwizard
6 1 (1.02%) JSON
6 1 (1.02%) Oracle GoldenGate
6 1 (1.02%) RabbitMQ
6 1 (1.02%) React
6 1 (1.02%) REST
6 1 (1.02%) RESTful
6 1 (1.02%) Ruby on Rails
6 1 (1.02%) Spring Batch
6 1 (1.02%) Spring Security
6 1 (1.02%) Vue.js
Miscellaneous
1 4 (4.08%) Analytical Skills
1 4 (4.08%) Data Structures
2 3 (3.06%) Data Centre
3 2 (2.04%) Algorithms
3 2 (2.04%) Greenfield Project
3 2 (2.04%) Public Cloud
4 1 (1.02%) Enterprise Software
4 1 (1.02%) Hybrid Cloud
4 1 (1.02%) Management Information System
4 1 (1.02%) Mobile App
4 1 (1.02%) Reference Data
Operating Systems
1 14 (14.29%) Linux
2 8 (8.16%) Unix
3 6 (6.12%) Solaris
4 2 (2.04%) Windows
5 1 (1.02%) Android
5 1 (1.02%) Apple iOS
5 1 (1.02%) CentOS
5 1 (1.02%) Red Hat Enterprise Linux
Processes & Methodologies
1 26 (26.53%) DevOps
2 23 (23.47%) Agile Software Development
3 21 (21.43%) ETL
4 18 (18.37%) Business Intelligence
5 17 (17.35%) Data Modelling
6 15 (15.31%) Data Architecture
7 14 (14.29%) Analytics
8 13 (13.27%) Software Engineering
9 11 (11.22%) Digital Transformation Programme
10 8 (8.16%) Migration
11 7 (7.14%) BDD
11 7 (7.14%) Data Governance
11 7 (7.14%) Data Strategy
11 7 (7.14%) Kimball Methodology
12 6 (6.12%) Data Analytics
12 6 (6.12%) Data Integration
12 6 (6.12%) Data Science
12 6 (6.12%) E-Commerce
12 6 (6.12%) Machine Learning
12 6 (6.12%) TDD
Programming Languages
1 26 (26.53%) Python
2 24 (24.49%) Java
3 20 (20.41%) SQL
4 15 (15.31%) Scala
5 7 (7.14%) R
6 4 (4.08%) Shell Script
7 3 (3.06%) Go
7 3 (3.06%) JavaScript
7 3 (3.06%) PHP
8 1 (1.02%) Bash Shell
8 1 (1.02%) C#
8 1 (1.02%) PL/SQL
8 1 (1.02%) Ruby
8 1 (1.02%) T-SQL
Qualifications
1 9 (9.18%) CCA
2 4 (4.08%) CISA
2 4 (4.08%) CISM
2 4 (4.08%) CISSP
2 4 (4.08%) PCI QSA
3 1 (1.02%) AWS Certification
3 1 (1.02%) BPSS Clearance
3 1 (1.02%) Computer Science Degree
3 1 (1.02%) Degree
3 1 (1.02%) SC Cleared
3 1 (1.02%) Security Cleared
3 1 (1.02%) TOGAF Certification
Quality Assurance & Compliance
1 4 (4.08%) GDPR
1 4 (4.08%) PA-DSS
1 4 (4.08%) PCI DSS
2 3 (3.06%) Data Quality
3 1 (1.02%) QA
System Software
1 13 (13.27%) HDFS
2 12 (12.24%) Docker
3 4 (4.08%) Active Directory
4 3 (3.06%) Apache Flume
5 1 (1.02%) Apache ZooKeeper
5 1 (1.02%) Oracle RAC
Systems Management
1 10 (10.20%) Terraform
2 9 (9.18%) Kubernetes
3 8 (8.16%) Oozie
4 5 (5.10%) Puppet
5 2 (2.04%) Ansible
6 1 (1.02%) BMC PATROL
6 1 (1.02%) Ganglia
6 1 (1.02%) Grafana
6 1 (1.02%) Graylog
6 1 (1.02%) Nagios
6 1 (1.02%) NetBackup
6 1 (1.02%) Opscode Chef
Vendors
1 38 (38.78%) Cloudera
2 29 (29.59%) Hortonworks
3 11 (11.22%) Microsoft
4 7 (7.14%) Talend
5 6 (6.12%) Tableau
6 5 (5.10%) Oracle
7 4 (4.08%) Gemalto
7 4 (4.08%) Google
8 3 (3.06%) SAP
9 2 (2.04%) Informatica
9 2 (2.04%) MapR
9 2 (2.04%) Teradata
10 1 (1.02%) Adobe
10 1 (1.02%) Atlassian
10 1 (1.02%) BMC
10 1 (1.02%) CA
10 1 (1.02%) Databricks
10 1 (1.02%) OpenText
10 1 (1.02%) Red Hat