Period
to 17 August 2019

The following table provides summary statistics for contract job vacancies advertised in Yorkshire with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 August 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > Yorkshire
6 months to
17 Aug 2019
Same period 2018 Same period 2017
Rank 75 66 118
Rank change year-on-year -9 +52 +43
Contract jobs citing Big Data 112 148 68
As % of all contract IT jobs advertised in Yorkshire 2.72% 2.99% 1.61%
As % of the Database & Business Intelligence category 13.51% 12.91% 6.88%
Number of daily rates quoted 95 106 71
Yorkshire median daily rate £500 £475 £465
Median daily rate % change year-on-year +5.26% +2.15% -3.13%
10th Percentile £375 £388 £400
90th Percentile £600 £581 £738
England median daily rate £550 £550 £538
% change year-on-year - +2.33% +2.38%
Number of hourly rates quoted 1 0 1
Yorkshire median hourly rate £15.50 - £35.00
England median hourly rate £46.85 £44.00 £27.50
% change year-on-year +6.47% +60.00% -37.39%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Yorkshire with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Yorkshire
Contract vacancies with a requirement for database or business intelligence skills 829 1,146 989
As % of all contract IT jobs advertised in Yorkshire 20.12% 23.17% 23.38%
Number of daily rates quoted 549 816 647
Yorkshire median daily rate £425 £400 £400
Median daily rate % change year-on-year +6.25% - +3.03%
10th Percentile £307 £305 £300
90th Percentile £575 £544 £538
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 20 19 11
Yorkshire median hourly rate £20.86 £20.00 £17.50
Median hourly rate % change year-on-year +4.28% +14.29% +29.63%
10th Percentile £15.22 £14.15 £12.00
90th Percentile £35.00 £34.00 £35.00
England median hourly rate £35.00 £30.00 £30.00
% change year-on-year +16.67% - +5.26%

Big Data
Job Vacancy Trend in Yorkshire

Job postings citing Big Data as a percentage of all IT jobs advertised in Yorkshire.

Job vacancy trend for Big Data in Yorkshire

Big Data
Contractor Daily Rate Trend in Yorkshire

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in Yorkshire.

Contractor daily rate trend for Big Data in Yorkshire

Big Data
Contractor Daily Rate Histogram in Yorkshire

The daily rate distribution of IT jobs citing Big Data in Yorkshire over the 6 months to 17 August 2019.

Contractor daily rate histogram for Big Data in Yorkshire

Big Data
Contract Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the Yorkshire region over the 6 months to 17 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
West Yorkshire -3 84 £475 - 13
South Yorkshire +8 28 £500 +11.11%
Big Data
England

For the 6 months to 17 August 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Yorkshire region with a requirement for Big Data.

1 79 (70.54%) Hadoop
2 62 (55.36%) Python
3 57 (50.89%) Agile Software Development
4 56 (50.00%) Apache Spark
5 45 (40.18%) Linux
6 43 (38.39%) SQL
6 43 (38.39%) Git (software)
7 42 (37.50%) Analytics
8 40 (35.71%) Apache Hive
9 37 (33.04%) Kafka
9 37 (33.04%) Google Cloud Platform
10 36 (32.14%) Jenkins
10 36 (32.14%) Google
11 33 (29.46%) Scala
12 31 (27.68%) Continuous Integration
12 31 (27.68%) Java
13 30 (26.79%) Amazon AWS
14 29 (25.89%) DevOps
14 29 (25.89%) Finance
15 27 (24.11%) BigQuery
16 26 (23.21%) JIRA
17 25 (22.32%) Scrum
18 24 (21.43%) Ruby
19 23 (20.54%) Data Warehouse
19 23 (20.54%) NoSQL
19 23 (20.54%) HBase
20 22 (19.64%) TDD
20 22 (19.64%) Data Science
21 18 (16.07%) R
21 18 (16.07%) GitHub

Big Data
Co-occurring IT Skills in Yorkshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 56 (50.00%) Apache Spark
2 13 (11.61%) SAS
3 11 (9.82%) Confluence
4 10 (8.93%) Jupyter
5 9 (8.04%) OpenStack
6 5 (4.46%) Elasticsearch
6 5 (4.46%) nginx
7 4 (3.57%) Apache
8 1 (0.89%) Apache Airflow
8 1 (0.89%) Apache ServiceMix
8 1 (0.89%) Luigi
8 1 (0.89%) Oracle Workflow
Applications
1 1 (0.89%) Microsoft Office
1 1 (0.89%) Microsoft Project
Business Applications
1 1 (0.89%) Dynamics CRM
Cloud Services
1 37 (33.04%) Google Cloud Platform
2 30 (26.79%) Amazon AWS
3 18 (16.07%) GitHub
4 17 (15.18%) Microsoft Azure
5 6 (5.36%) Amazon EMR
6 3 (2.68%) Amazon EC2
6 3 (2.68%) PaaS
7 2 (1.79%) Amazon ECS
7 2 (1.79%) AWS Fargate
7 2 (1.79%) AWS Lambda
7 2 (1.79%) Azure Data Factory
7 2 (1.79%) Heroku
7 2 (1.79%) Power Platform
7 2 (1.79%) SaaS
7 2 (1.79%) Serverless
8 1 (0.89%) Amazon Kinesis
8 1 (0.89%) AWS CloudFormation
8 1 (0.89%) Dynamics 365
8 1 (0.89%) Office 365
8 1 (0.89%) Trello
Communications & Networking
1 2 (1.79%) Kerberos
2 1 (0.89%) VPN
Database & Business Intelligence
1 79 (70.54%) Hadoop
2 40 (35.71%) Apache Hive
3 27 (24.11%) BigQuery
4 23 (20.54%) Data Warehouse
4 23 (20.54%) HBase
4 23 (20.54%) NoSQL
5 15 (13.39%) Qlik Sense
5 15 (13.39%) QlikView
6 14 (12.50%) Impala
7 13 (11.61%) Pentaho
8 10 (8.93%) PostgreSQL
8 10 (8.93%) RDBMS
8 10 (8.93%) Relational Database
9 6 (5.36%) Snowflake Schema
10 5 (4.46%) Data Lake
10 5 (4.46%) Redis
10 5 (4.46%) Spotfire
11 4 (3.57%) Riak
12 3 (2.68%) Amazon RDS
12 3 (2.68%) GIS
Development Applications
1 43 (38.39%) Git (software)
2 36 (32.14%) Jenkins
3 26 (23.21%) JIRA
4 10 (8.93%) Sonatype Nexus
5 9 (8.04%) Gradle
6 7 (6.25%) Maven
7 6 (5.36%) Eclipse
7 6 (5.36%) IntelliJ
7 6 (5.36%) JUnit
8 5 (4.46%) Mercurial
8 5 (4.46%) Subversion
9 3 (2.68%) Mockito
10 2 (1.79%) CircleCI
11 1 (0.89%) Atlassian Bamboo
11 1 (0.89%) Bitbucket
11 1 (0.89%) Cucumber
General
1 29 (25.89%) Finance
2 14 (12.50%) Financial Institution
3 4 (3.57%) Retail
4 3 (2.68%) Marketing
5 1 (0.89%) Banking
5 1 (0.89%) Retail Banking
Job Titles
1 54 (48.21%) Developer
2 27 (24.11%) Python Developer
3 21 (18.75%) Big Data Engineer
4 16 (14.29%) Data Engineer
5 11 (9.82%) DevOps Engineer
6 10 (8.93%) Lead Developer
6 10 (8.93%) Ruby Engineer
6 10 (8.93%) Scala Developer
7 8 (7.14%) Hadoop Engineer
8 7 (6.25%) Architect
8 7 (6.25%) Ruby Developer
9 6 (5.36%) Big Data Developer
9 6 (5.36%) Python Engineer
10 5 (4.46%) Apache Spark Developer
10 5 (4.46%) Hadoop Developer
11 4 (3.57%) AWS Engineer
11 4 (3.57%) Data Architect
11 4 (3.57%) Technical Leader
12 3 (2.68%) Analyst
12 3 (2.68%) Linux Engineer
Libraries, Frameworks & Software Standards
1 37 (33.04%) Kafka
2 11 (9.82%) PySpark
3 9 (8.04%) NumPy
3 9 (8.04%) Pandas
3 9 (8.04%) scikit-learn
4 6 (5.36%) Spark Streaming
5 5 (4.46%) RabbitMQ
6 4 (3.57%) .NET
6 4 (3.57%) RESTful
6 4 (3.57%) Web Services
7 3 (2.68%) Apache Beam
7 3 (2.68%) Hibernate
7 3 (2.68%) Spring
8 2 (1.79%) Apache NiFi
8 2 (1.79%) ASP.NET
8 2 (1.79%) Django
8 2 (1.79%) WSDL
8 2 (1.79%) XML
9 1 (0.89%) Drools
9 1 (0.89%) SOAP
Miscellaneous
1 13 (11.61%) Virtual Team
2 6 (5.36%) NHS
3 3 (2.68%) Analytical Skills
4 2 (1.79%) Greenfield Project
4 2 (1.79%) Management Information System
5 1 (0.89%) Reference Data
5 1 (0.89%) Self-Motivation
5 1 (0.89%) User Experience
Operating Systems
1 45 (40.18%) Linux
2 7 (6.25%) CentOS
3 4 (3.57%) Unix
Processes & Methodologies
1 57 (50.89%) Agile Software Development
2 42 (37.50%) Analytics
3 31 (27.68%) Continuous Integration
4 29 (25.89%) DevOps
5 25 (22.32%) Scrum
6 22 (19.64%) Data Science
6 22 (19.64%) TDD
7 18 (16.07%) Software Engineering
8 17 (15.18%) Continuous Deployment
9 16 (14.29%) Data Analytics
9 16 (14.29%) Problem-Solving
10 15 (13.39%) Change Management
10 15 (13.39%) Digital Transformation Programme
10 15 (13.39%) Kanban
10 15 (13.39%) Migration
11 13 (11.61%) Unit Testing
12 11 (9.82%) OO
12 11 (9.82%) Visualisation
13 10 (8.93%) Big Data Analytics
13 10 (8.93%) Test Automation
Programming Languages
1 62 (55.36%) Python
2 43 (38.39%) SQL
3 33 (29.46%) Scala
4 31 (27.68%) Java
5 24 (21.43%) Ruby
6 18 (16.07%) R
7 15 (13.39%) Bash Shell
8 8 (7.14%) C#
9 7 (6.25%) C++
10 6 (5.36%) Go
11 3 (2.68%) HiveQL
11 3 (2.68%) PL/SQL
11 3 (2.68%) Shell Script
12 2 (1.79%) Java 8
12 2 (1.79%) JavaScript
13 1 (0.89%) C
13 1 (0.89%) T-SQL
Qualifications
1 9 (8.04%) Degree
2 1 (0.89%) BPSS Clearance
2 1 (0.89%) DBS Check
2 1 (0.89%) Security Cleared
Quality Assurance & Compliance
1 2 (1.79%) QA
2 1 (0.89%) Disclosure Scotland
2 1 (0.89%) GDPR
2 1 (0.89%) PMO
System Software
1 3 (2.68%) Docker
Systems Management
1 16 (14.29%) Ansible
2 14 (12.50%) Opscode Chef
3 9 (8.04%) Terraform
4 6 (5.36%) Oozie
5 4 (3.57%) Kubernetes
6 2 (1.79%) Hadoop YARN
7 1 (0.89%) Consul
7 1 (0.89%) Packer
Vendors
1 36 (32.14%) Google
2 12 (10.71%) Tableau
3 7 (6.25%) Hortonworks
3 7 (6.25%) MapR
4 6 (5.36%) Dataiku
5 3 (2.68%) Cloudera
5 3 (2.68%) Informatica
5 3 (2.68%) Red Hat
6 2 (1.79%) Alteryx
6 2 (1.79%) Paxata
7 1 (0.89%) Atlassian
7 1 (0.89%) Databricks
7 1 (0.89%) ForgeRock
7 1 (0.89%) Oracle
7 1 (0.89%) Splunk