Period
to 20 November 2018

The following table provides summary statistics for contract job vacancies advertised in the North West with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 20 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > North West
6 months to
20 Nov 2018
Same period 2017 Same period 2016
Rank 123 112 146
Rank change year-on-year -11 +34 +18
Contract jobs citing Big Data 99 98 78
As % of all contract IT jobs advertised in the North West 1.66% 1.72% 1.15%
As % of the Database & Business Intelligence category 7.96% 7.61% 4.57%
Number of daily rates quoted 70 77 51
North West median daily rate £528 £550 £475
Median daily rate % change year-on-year -4.09% +15.79% +2.70%
10th Percentile £380 £372 £375
90th Percentile £713 £625 £663
England median daily rate £550 £550 £525
% change year-on-year - +4.76% +0.96%
Number of hourly rates quoted 1 0 0
North West median hourly rate £6.00 - -
England median hourly rate £40.00 £30.91 £43.00
% change year-on-year +29.43% -28.13% -7.53%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the North West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
North West
Contract vacancies with a requirement for database or business intelligence skills 1,244 1,288 1,708
As % of all contract IT jobs advertised in the North West 20.83% 22.61% 25.17%
Number of daily rates quoted 836 880 1,131
North West median daily rate £400 £400 £375
Median daily rate % change year-on-year - +6.67% -6.25%
10th Percentile £285 £284 £263
90th Percentile £556 £622 £544
England median daily rate £475 £460 £425
% change year-on-year +3.26% +8.24% +3.03%
Number of hourly rates quoted 24 34 44
North West median hourly rate £29.50 £42.75 £35.75
Median hourly rate % change year-on-year -30.99% +19.58% -10.63%
10th Percentile £11.55 £21.30 £14.38
90th Percentile £47.50 £61.13 £59.31
England median hourly rate £35.00 £31.50 £28.00
% change year-on-year +11.11% +12.50% +0.39%

Big Data
Job Vacancy Trend in the North West

Job postings citing Big Data as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Big Data in the North West

Big Data
Contractor Daily Rate Trend in the North West

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the North West.

Contractor daily rate trend for Big Data in the North West

Big Data
Contractor Daily Rate Histogram in the North West

The daily rate distribution of IT jobs citing Big Data in the North West over the 6 months to 20 November 2018.

Contractor daily rate histogram for Big Data in the North West

Big Data
Contract Job Locations in the North West

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the North West region over the 6 months to 20 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Manchester -20 45 £525 +3.70% 22
Lancashire -2 26 £588 -3.69% 1
Cheshire -4 19 £531 +63.46% 6
Merseyside -4 5 £363 -39.58% 1
Cumbria - 3 - - 2
Big Data
England

For the 6 months to 20 November 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the North West region with a requirement for Big Data.

1 37 (37.37%) Java
2 33 (33.33%) Hadoop
3 32 (32.32%) Apache Spark
4 30 (30.30%) Agile Software Development
5 29 (29.29%) SQL
6 26 (26.26%) Analytics
7 25 (25.25%) Data Modelling
8 24 (24.24%) ETL
8 24 (24.24%) Apache Hive
9 23 (23.23%) Kafka
10 22 (22.22%) Business Intelligence
10 22 (22.22%) Data Warehouse
11 21 (21.21%) Python
11 21 (21.21%) Finance
11 21 (21.21%) NoSQL
11 21 (21.21%) Amazon AWS
12 17 (17.17%) Open Source
12 17 (17.17%) HBase
13 16 (16.16%) Data Architecture
14 15 (15.15%) Tableau
14 15 (15.15%) Linux
15 14 (14.14%) PostgreSQL
15 14 (14.14%) MongoDB
15 14 (14.14%) Analytical Skills
16 13 (13.13%) Power BI
16 13 (13.13%) Data Analytics
16 13 (13.13%) Cloudera
16 13 (13.13%) HDFS
16 13 (13.13%) DevOps
16 13 (13.13%) Microsoft Azure

Big Data
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 32 (32.32%) Apache Spark
2 12 (12.12%) Elasticsearch
3 6 (6.06%) Apache
4 3 (3.03%) Adobe Experience Manager
4 3 (3.03%) Apache Pig
4 3 (3.03%) SharePoint
5 2 (2.02%) Confluence
5 2 (2.02%) nginx
5 2 (2.02%) SAS
6 1 (1.01%) Oracle SOA Suite
Applications
1 2 (2.02%) Microsoft Office
2 1 (1.01%) Microsoft Excel
2 1 (1.01%) Microsoft PowerPoint
2 1 (1.01%) MS Visio
Business Applications
1 4 (4.04%) Payment Gateway
2 2 (2.02%) Distributed Ledger
3 1 (1.01%) Exstream
Cloud Services
1 21 (21.21%) Amazon AWS
2 13 (13.13%) Microsoft Azure
3 7 (7.07%) Virtual Private Cloud
4 4 (4.04%) Amazon CloudWatch
4 4 (4.04%) AWS CloudTrail
4 4 (4.04%) Cloud Computing
5 3 (3.03%) Amazon EC2
5 3 (3.03%) Amazon EMR
5 3 (3.03%) Amazon S3
5 3 (3.03%) AWS CloudFormation
5 3 (3.03%) Slack
6 2 (2.02%) Amazon Kinesis
6 2 (2.02%) Google Cloud Platform
7 1 (1.01%) OpenShift
7 1 (1.01%) Trello
Communications & Networking
1 4 (4.04%) Firewall
1 4 (4.04%) Network Security
2 3 (3.03%) SMS
3 2 (2.02%) Unified Communications
4 1 (1.01%) DHCP
4 1 (1.01%) DNS
4 1 (1.01%) FTP
4 1 (1.01%) HTTP
4 1 (1.01%) Internet
4 1 (1.01%) IPsec
4 1 (1.01%) Kerberos
4 1 (1.01%) NAS
4 1 (1.01%) SAN
4 1 (1.01%) TCP/IP
Database & Business Intelligence
1 33 (33.33%) Hadoop
2 24 (24.24%) Apache Hive
3 22 (22.22%) Data Warehouse
4 21 (21.21%) NoSQL
5 17 (17.17%) HBase
6 14 (14.14%) MongoDB
6 14 (14.14%) PostgreSQL
7 13 (13.13%) Power BI
8 12 (12.12%) SQL Server
9 11 (11.11%) Sqoop
10 9 (9.09%) BusinessObjects
10 9 (9.09%) Data Lake
10 9 (9.09%) Data Mining
10 9 (9.09%) Relational Database
11 8 (8.08%) Impala
12 7 (7.07%) Apache Cassandra
13 6 (6.06%) MySQL
14 5 (5.05%) Enterprise Data Warehouse
14 5 (5.05%) Geospatial Data
15 4 (4.04%) Apache Kudu
Development Applications
1 13 (13.13%) Git (software)
2 9 (9.09%) Jenkins
3 6 (6.06%) JIRA
3 6 (6.06%) RStudio
4 3 (3.03%) Bitbucket
4 3 (3.03%) Gradle
4 3 (3.03%) Maven
5 2 (2.02%) Artifactory
5 2 (2.02%) Atlassian Bamboo
5 2 (2.02%) Cucumber
5 2 (2.02%) ERwin
5 2 (2.02%) GitLab
5 2 (2.02%) Hudson
5 2 (2.02%) Subversion
5 2 (2.02%) Team Foundation Server
6 1 (1.01%) gulp
6 1 (1.01%) Jasmine
6 1 (1.01%) JIRA Agile
6 1 (1.01%) Karma Test Runner
6 1 (1.01%) SonarQube
General
1 21 (21.21%) Finance
2 6 (6.06%) Retail
3 5 (5.05%) Legal
4 4 (4.04%) Banking
4 4 (4.04%) Manufacturing
4 4 (4.04%) Telecoms
5 1 (1.01%) Automotive
5 1 (1.01%) Law
5 1 (1.01%) Marketing
Job Titles
1 27 (27.27%) Developer
2 23 (23.23%) Data Engineer
3 18 (18.18%) Architect
4 12 (12.12%) Big Data Engineer
5 8 (8.08%) Data Architect
5 8 (8.08%) Java Developer
6 7 (7.07%) Big Data Developer
6 7 (7.07%) Cloud Engineer
6 7 (7.07%) Full Stack Developer
6 7 (7.07%) Java Engineer
6 7 (7.07%) Technical Architect
7 6 (6.06%) Consultant
7 6 (6.06%) Hadoop Engineer
8 5 (5.05%) Analyst
8 5 (5.05%) AWS Engineer
8 5 (5.05%) Software Engineer
9 4 (4.04%) Apache Spark Developer
9 4 (4.04%) Hadoop Developer
9 4 (4.04%) PCI DSS Consultant
9 4 (4.04%) Senior Architect
Libraries, Frameworks & Software Standards
1 23 (23.23%) Kafka
2 8 (8.08%) Spark Streaming
3 6 (6.06%) Node.js
3 6 (6.06%) XML
4 5 (5.05%) JSON
4 5 (5.05%) Spring
4 5 (5.05%) Spring Boot
4 5 (5.05%) Web Services
5 4 (4.04%) Apache Avro
5 4 (4.04%) J2EE
6 3 (3.03%) .NET
6 3 (3.03%) AngularJS
6 3 (3.03%) CSS
6 3 (3.03%) Django
6 3 (3.03%) Dropwizard
6 3 (3.03%) HTML
6 3 (3.03%) React
6 3 (3.03%) REST
6 3 (3.03%) RESTful
6 3 (3.03%) Vue.js
Miscellaneous
1 14 (14.14%) Analytical Skills
2 6 (6.06%) Data Structures
3 4 (4.04%) Computer Science
3 4 (4.04%) Management Information System
4 2 (2.02%) Algorithms
4 2 (2.02%) Data Centre
4 2 (2.02%) Self-Motivation
5 1 (1.01%) Enterprise Software
5 1 (1.01%) Greenfield Project
5 1 (1.01%) Internet of Things
5 1 (1.01%) Reference Data
5 1 (1.01%) Social Media
5 1 (1.01%) User Experience
5 1 (1.01%) Virtual Team
Operating Systems
1 15 (15.15%) Linux
2 7 (7.07%) Unix
3 4 (4.04%) Windows
4 1 (1.01%) AIX
4 1 (1.01%) Android
4 1 (1.01%) Apple iOS
4 1 (1.01%) Red Hat Enterprise Linux
Processes & Methodologies
1 30 (30.30%) Agile Software Development
2 26 (26.26%) Analytics
3 25 (25.25%) Data Modelling
4 24 (24.24%) ETL
5 22 (22.22%) Business Intelligence
6 17 (17.17%) Open Source
7 16 (16.16%) Data Architecture
8 13 (13.13%) Data Analytics
8 13 (13.13%) DevOps
9 11 (11.11%) Kimball Methodology
10 10 (10.10%) Migration
10 10 (10.10%) Visualisation
11 9 (9.09%) Cybersecurity
11 9 (9.09%) Dimensional Modelling
11 9 (9.09%) Machine Learning
11 9 (9.09%) TDD
12 8 (8.08%) Continuous Integration
12 8 (8.08%) Data Development
12 8 (8.08%) Mentoring
12 8 (8.08%) Microservices
Programming Languages
1 37 (37.37%) Java
2 29 (29.29%) SQL
3 21 (21.21%) Python
4 13 (13.13%) Scala
5 12 (12.12%) JavaScript
6 5 (5.05%) PHP
6 5 (5.05%) R
7 3 (3.03%) Go
7 3 (3.03%) Java 8
7 3 (3.03%) Ruby
7 3 (3.03%) Shell Script
8 2 (2.02%) Prolog
8 2 (2.02%) T-SQL
9 1 (1.01%) Bash Shell
9 1 (1.01%) C#
9 1 (1.01%) MATLAB
Qualifications
1 10 (10.10%) Security Cleared
2 7 (7.07%) SC Cleared
3 5 (5.05%) Degree
4 4 (4.04%) CISA
4 4 (4.04%) CISM
4 4 (4.04%) CISSP
4 4 (4.04%) PCI QSA
5 3 (3.03%) Computer Science Degree
6 2 (2.02%) AWS Certification
6 2 (2.02%) CCA
6 2 (2.02%) PhD
7 1 (1.01%) BPSS Clearance
7 1 (1.01%) ISEB
7 1 (1.01%) ISTQB
Quality Assurance & Compliance
1 8 (8.08%) Data Quality
2 4 (4.04%) GDPR
2 4 (4.04%) PA-DSS
2 4 (4.04%) PCI DSS
3 3 (3.03%) QA
4 1 (1.01%) SLA
System Software
1 13 (13.13%) HDFS
2 8 (8.08%) Docker
3 1 (1.01%) Active Directory
3 1 (1.01%) Apache Flume
3 1 (1.01%) Virtual Machines
3 1 (1.01%) VMware ESXi
Systems Management
1 8 (8.08%) Terraform
2 7 (7.07%) Puppet
3 5 (5.05%) Ansible
3 5 (5.05%) Kubernetes
3 5 (5.05%) Oozie
4 3 (3.03%) Opscode Chef
4 3 (3.03%) Salt
5 2 (2.02%) Docker Swarm
5 2 (2.02%) Grafana
5 2 (2.02%) Graylog
5 2 (2.02%) Kibana
6 1 (1.01%) SCCM
Vendors
1 15 (15.15%) Tableau
2 13 (13.13%) Cloudera
3 9 (9.09%) Oracle
4 8 (8.08%) Talend
5 7 (7.07%) Microsoft
6 6 (6.06%) Google
6 6 (6.06%) Hortonworks
7 5 (5.05%) SAP
8 4 (4.04%) AlienVault
8 4 (4.04%) Informatica
9 3 (3.03%) Adobe
10 2 (2.02%) CA
10 2 (2.02%) hybris
10 2 (2.02%) MapR
10 2 (2.02%) Teradata
10 2 (2.02%) Vertica
11 1 (1.01%) HP
11 1 (1.01%) OpenText
11 1 (1.01%) Red Hat
11 1 (1.01%) Salesforce.com