Period
to 16 July 2018

The following table provides summary statistics for contract job vacancies advertised in South Yorkshire with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 16 July 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
Yorkshire > South Yorkshire
6 months to
16 Jul 2018
Same period 2017 Same period 2016
Rank 68 76 74
Rank change year-on-year +8 -2 -5
Contract jobs citing Apache Spark 12 1 6
As % of all contract IT jobs advertised in South Yorkshire 1.20% 0.12% 0.59%
As % of the Application Platforms category 7.41% 0.82% 2.60%
Number of daily rates quoted 8 3 4
South Yorkshire median daily rate £450 £425 £569
Median daily rate % change year-on-year +5.88% -25.27% +8.33%
10th Percentile £410 £413 £527
90th Percentile £497 £438 £639
Yorkshire median daily rate £475 £464 £475
% change year-on-year +2.48% -2.42% -9.52%
Number of hourly rates quoted 0 0 0
South Yorkshire median hourly rate - - -
Yorkshire median hourly rate - £35.00 -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in South Yorkshire with a requirement for application platform skills.

All Application Platform Skills
South Yorkshire
Contract vacancies with a requirement for application platform skills 162 122 231
As % of all contract IT jobs advertised in South Yorkshire 16.15% 15.14% 22.78%
Number of daily rates quoted 100 63 166
South Yorkshire median daily rate £414 £415 £475
Median daily rate % change year-on-year -0.30% -12.63% +50.79%
10th Percentile £297 £223 £250
90th Percentile £511 £640 £704
Yorkshire median daily rate £425 £400 £400
% change year-on-year +6.25% - +11.11%
Number of hourly rates quoted 7 1 6
South Yorkshire median hourly rate £21.33 £12.00 £22.50
Median hourly rate % change year-on-year +77.71% -46.67% +114.29%
10th Percentile £16.11 £12.00 £19.25
90th Percentile £27.41 £12.00 £29.50
Yorkshire median hourly rate £21.33 £16.50 £13.89
% change year-on-year +29.24% +18.79% +32.29%

Apache Spark
Job Vacancy Trend in South Yorkshire

Job postings citing Apache Spark as a percentage of all IT jobs advertised in South Yorkshire.

Job vacancy trend for Apache Spark in South Yorkshire

Apache Spark
Contractor Daily Rate Trend in South Yorkshire

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in South Yorkshire.

Contractor daily rate trend for Apache Spark in South Yorkshire

Apache Spark
Contract Job Locations in South Yorkshire

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the South Yorkshire region over the 6 months to 16 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Sheffield +9 12 £450 +5.88%
Apache Spark
Yorkshire

For the 6 months to 16 July 2018, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South Yorkshire region with a requirement for Apache Spark.

1 11 (91.67%) Java
1 11 (91.67%) Hadoop
2 10 (83.33%) Python
3 8 (66.67%) GCP
3 8 (66.67%) Shell Script
3 8 (66.67%) Agile Software Development
3 8 (66.67%) Atlassian Bamboo
3 8 (66.67%) JIRA
3 8 (66.67%) Confluence
3 8 (66.67%) Big Data
3 8 (66.67%) GitHub
3 8 (66.67%) Bitbucket
3 8 (66.67%) Docker
3 8 (66.67%) DevOps
3 8 (66.67%) Jenkins
3 8 (66.67%) Google Cloud Platform
3 8 (66.67%) Kubernetes
4 7 (58.33%) SaltStack
4 7 (58.33%) Metadata Management
4 7 (58.33%) Terraform
4 7 (58.33%) Sonatype Nexus
4 7 (58.33%) Ansible
4 7 (58.33%) Bash Shell
4 7 (58.33%) Kanban
4 7 (58.33%) Git (software)
4 7 (58.33%) Scrum
4 7 (58.33%) Linux
4 7 (58.33%) VPN
5 5 (41.67%) Google
6 4 (33.33%) Finance

Apache Spark
Co-occurring IT Skills in South Yorkshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 8 (66.67%) Confluence
2 3 (25.00%) Apache Pig
2 3 (25.00%) SAS
Cloud Services
1 8 (66.67%) GitHub
1 8 (66.67%) Google Cloud Platform
2 3 (25.00%) Google Analytics
3 2 (16.67%) Amazon AWS
4 1 (8.33%) IBM Cloud
4 1 (8.33%) Microsoft Azure
4 1 (8.33%) Virtual Private Cloud
Communications & Networking
1 7 (58.33%) VPN
Database & Business Intelligence
1 11 (91.67%) Hadoop
2 8 (66.67%) Big Data
3 4 (33.33%) Apache Hive
4 2 (16.67%) QlikView
5 1 (8.33%) BigQuery
5 1 (8.33%) Bigtable
5 1 (8.33%) Data Warehouse
5 1 (8.33%) HBase
5 1 (8.33%) MongoDB
5 1 (8.33%) NoSQL
5 1 (8.33%) PostgreSQL
5 1 (8.33%) Relational Database
5 1 (8.33%) SAS Visual Analytics
Development Applications
1 8 (66.67%) Atlassian Bamboo
1 8 (66.67%) Bitbucket
1 8 (66.67%) Jenkins
1 8 (66.67%) JIRA
2 7 (58.33%) Git (software)
2 7 (58.33%) Sonatype Nexus
General
1 4 (33.33%) Finance
2 3 (25.00%) Banking
2 3 (25.00%) Private Banking
2 3 (25.00%) Retail Banking
Job Titles
1 8 (66.67%) Developer
2 7 (58.33%) Cloud Developer
3 2 (16.67%) Data Scientist
4 1 (8.33%) Data Engineer
4 1 (8.33%) ETL Developer
4 1 (8.33%) Java Developer
4 1 (8.33%) Python Developer
4 1 (8.33%) Risk Manager
Miscellaneous
1 3 (25.00%) Analytical Skills
1 3 (25.00%) Computer Science
2 2 (16.67%) Management Information System
3 1 (8.33%) Virtual Team
Operating Systems
1 7 (58.33%) Linux
2 1 (8.33%) Unix
Processes & Methodologies
1 8 (66.67%) Agile Software Development
1 8 (66.67%) DevOps
2 7 (58.33%) Kanban
2 7 (58.33%) Metadata Management
2 7 (58.33%) Scrum
3 4 (33.33%) Analytics
3 4 (33.33%) Data Analysis
3 4 (33.33%) Data Modelling
4 3 (25.00%) Anti-Money Laundering
4 3 (25.00%) Asset Management
4 3 (25.00%) Data Science
4 3 (25.00%) Decision Tree
4 3 (25.00%) Open Source
4 3 (25.00%) Regression Analysis
4 3 (25.00%) Wealth Management
5 2 (16.67%) Forensic Analysis
5 2 (16.67%) Infrastructure Management
5 2 (16.67%) Visualisation
6 1 (8.33%) Data Integration
6 1 (8.33%) Use Case
Programming Languages
1 11 (91.67%) Java
2 10 (83.33%) Python
3 8 (66.67%) Shell Script
4 7 (58.33%) Bash Shell
5 4 (33.33%) PL/SQL
5 4 (33.33%) SQL
6 3 (25.00%) Scala
7 1 (8.33%) R
Qualifications
1 3 (25.00%) Degree
Quality Assurance & Compliance
1 8 (66.67%) GCP
2 1 (8.33%) QA
System Software
1 8 (66.67%) Docker
Systems Management
1 8 (66.67%) Kubernetes
2 7 (58.33%) Ansible
2 7 (58.33%) Terraform
3 3 (25.00%) Ambari
Vendors
1 7 (58.33%) SaltStack
2 5 (41.67%) Google
3 4 (33.33%) Oracle
4 1 (8.33%) Ab Initio
4 1 (8.33%) Cloudera
4 1 (8.33%) Hortonworks
4 1 (8.33%) IBM
4 1 (8.33%) Informatica
4 1 (8.33%) Tableau