Period
to 29 July 2021

The following table provides summary statistics for permanent job vacancies advertised in Yorkshire with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 29 July 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
England > Yorkshire
6 months to
29 Jul 2021
Same period 2020 Same period 2019
Rank 205 173 272
Rank change year-on-year -32 +99 -10
Permanent jobs citing Apache Spark 45 7 35
As % of all permanent jobs advertised in Yorkshire 0.76% 0.19% 0.46%
As % of the Application Platforms category 7.69% 1.61% 3.82%
Number of salaries quoted 19 4 28
10th Percentile £38,500 " £40,505
25th Percentile £50,000 £46,000 £43,635
Median annual salary (50th Percentile) £60,000 £59,250 £54,669
Median % change year-on-year +1.27% +8.38% -0.60%
75th Percentile £73,125 £80,313 £72,500
90th Percentile £76,000 £92,125 £95,000
England median annual salary £76,650 £77,500 £75,000
% change year-on-year -1.10% +3.33% +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Yorkshire with a requirement for application platform skills.

All Application Platform Skills
Yorkshire
Permanent vacancies with a requirement for application platform skills 585 436 917
As % of all permanent IT jobs advertised in Yorkshire 9.86% 12.00% 12.06%
Number of salaries quoted 454 377 758
10th Percentile £26,475 £28,650 £25,425
25th Percentile £32,500 £33,750 £31,250
Median annual salary (50th Percentile) £44,638 £42,500 £40,000
Median % change year-on-year +5.03% +6.25% -5.88%
75th Percentile £58,750 £55,000 £52,500
90th Percentile £77,500 £62,500 £60,000
England median annual salary £55,000 £53,500 £52,000
% change year-on-year +2.80% +2.88% +4.00%

Apache Spark
Job Vacancy Trend in Yorkshire

Job postings citing Apache Spark as a proportion of all IT jobs advertised in Yorkshire.

Job vacancy trend for Apache Spark in Yorkshire

Apache Spark
Salary Trend in Yorkshire

3-month moving average salary quoted in jobs citing Apache Spark in Yorkshire.

Salary trend for Apache Spark in Yorkshire

Apache Spark
Salary Histogram in Yorkshire

Salary distribution for jobs citing Apache Spark in Yorkshire over the 6 months to 29 July 2021.

Salary histogram for Apache Spark in Yorkshire

Apache Spark
Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the Yorkshire region over the 6 months to 29 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
West Yorkshire -11 41 £62,500 -27.54% 10
North Yorkshire - 3 - - 1
South Yorkshire -35 1 £35,000 -23.91%
Apache Spark
England

For the 6 months to 29 July 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Yorkshire region with a requirement for Apache Spark.

1 35 (77.78%) Azure
2 34 (75.56%) Python
3 31 (68.89%) SQL
4 30 (66.67%) Big Data
4 30 (66.67%) Databricks
5 25 (55.56%) Data Lake
6 24 (53.33%) Data Engineering
6 24 (53.33%) Azure Synapse Analytics
7 23 (51.11%) Data Pipeline
7 23 (51.11%) Hadoop
7 23 (51.11%) Data Warehouse
8 22 (48.89%) Social Skills
9 21 (46.67%) Azure Data Factory
9 21 (46.67%) Agile Software Development
10 20 (44.44%) Business Intelligence
10 20 (44.44%) Power BI
10 20 (44.44%) Power Platform
11 18 (40.00%) AWS
11 18 (40.00%) Data Integration
11 18 (40.00%) Kafka
12 17 (37.78%) Analytics
12 17 (37.78%) Scala
12 17 (37.78%) Apache
12 17 (37.78%) SQL Server Integration Services
13 16 (35.56%) Relational Database
13 16 (35.56%) T-SQL
13 16 (35.56%) ETL
13 16 (35.56%) SQL Server Analysis Services
14 15 (33.33%) Data Modelling
14 15 (33.33%) DevOps

Apache Spark
Co-occurring IT Skills in Yorkshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 17 (37.78%) Apache
2 9 (20.00%) Apache Synapse
3 3 (6.67%) Apache Airflow
3 3 (6.67%) Luigi
4 2 (4.44%) Tomcat
5 1 (2.22%) Elasticsearch
Cloud Services
1 35 (77.78%) Azure
2 24 (53.33%) Azure Synapse Analytics
3 21 (46.67%) Azure Data Factory
4 20 (44.44%) Power Platform
5 18 (40.00%) AWS
6 11 (24.44%) Serverless
7 6 (13.33%) Azure Functions
8 5 (11.11%) Amazon Kinesis
8 5 (11.11%) AWS Lambda
8 5 (11.11%) Azure Storage
9 4 (8.89%) SaaS
10 3 (6.67%) Amazon EC2
10 3 (6.67%) Amazon EMR
10 3 (6.67%) GCP
11 2 (4.44%) IaaS
11 2 (4.44%) PaaS
12 1 (2.22%) Amazon S3
12 1 (2.22%) Azure Active Directory
12 1 (2.22%) Azure Key Vault
Communications & Networking
1 4 (8.89%) Cisco ASA
1 4 (8.89%) Firewall
Database & Business Intelligence
1 30 (66.67%) Big Data
2 25 (55.56%) Data Lake
3 23 (51.11%) Data Warehouse
3 23 (51.11%) Hadoop
4 20 (44.44%) Power BI
5 17 (37.78%) SQL Server Integration Services
6 16 (35.56%) Relational Database
6 16 (35.56%) SQL Server Analysis Services
7 14 (31.11%) SQL Server
8 12 (26.67%) NoSQL
8 12 (26.67%) Spark SQL
9 11 (24.44%) Azure SQL Database
10 10 (22.22%) SQL Server Reporting Services
11 9 (20.00%) Amazon Athena
12 8 (17.78%) Apache Cassandra
12 8 (17.78%) Microsoft Analysis Services
13 7 (15.56%) Amazon Redshift
13 7 (15.56%) Metadata
13 7 (15.56%) MySQL
13 7 (15.56%) OLAP
Development Applications
1 5 (11.11%) Jenkins
2 3 (6.67%) Visual Studio
3 2 (4.44%) Cucumber
3 2 (4.44%) Gradle
3 2 (4.44%) JIRA
3 2 (4.44%) Maven
3 2 (4.44%) SonarQube
4 1 (2.22%) Git (software)
4 1 (2.22%) kappa
General
1 22 (48.89%) Social Skills
2 7 (15.56%) Presentation Skills
3 5 (11.11%) Public Sector
4 3 (6.67%) Electronics
5 2 (4.44%) Analytical Skills
5 2 (4.44%) Banking
5 2 (4.44%) Games
6 1 (2.22%) Finance
6 1 (2.22%) Military
Job Titles
1 17 (37.78%) Data Engineer
2 11 (24.44%) Architect
3 10 (22.22%) Azure Architect
4 8 (17.78%) Azure Engineer
4 8 (17.78%) Cloud Engineer
5 7 (15.56%) Senior Data Engineer
6 5 (11.11%) Solutions Architect
7 4 (8.89%) AWS Engineer
8 3 (6.67%) Data Architect
9 2 (4.44%) Administrator
9 2 (4.44%) Analyst
9 2 (4.44%) Azure DevOps
9 2 (4.44%) Cloud Administrator
9 2 (4.44%) Data Analyst
9 2 (4.44%) DevOps Engineer
9 2 (4.44%) Java Engineer
9 2 (4.44%) Java Software Engineer
9 2 (4.44%) Platform Engineer
9 2 (4.44%) Python Engineer
9 2 (4.44%) Software Engineer
Libraries, Frameworks & Software Standards
1 18 (40.00%) Kafka
2 12 (26.67%) PySpark
3 7 (15.56%) Spark Streaming
4 5 (11.11%) EDI
4 5 (11.11%) JSON
4 5 (11.11%) XML
5 2 (4.44%) LAMP
5 2 (4.44%) LAPP Stack
5 2 (4.44%) Spring
5 2 (4.44%) Spring Boot
5 2 (4.44%) Swagger
6 1 (2.22%) NumPy
6 1 (2.22%) Pandas
6 1 (2.22%) SAML
Miscellaneous
1 5 (11.11%) NHS
2 3 (6.67%) Blog
2 3 (6.67%) Data Structures
2 3 (6.67%) Tandem
3 2 (4.44%) Management Information System
4 1 (2.22%) Greenfield Project
4 1 (2.22%) Self-Motivation
Operating Systems
1 3 (6.67%) Linux
Processes & Methodologies
1 24 (53.33%) Data Engineering
2 23 (51.11%) Data Pipeline
3 21 (46.67%) Agile Software Development
4 20 (44.44%) Business Intelligence
5 18 (40.00%) Data Integration
6 17 (37.78%) Analytics
7 16 (35.56%) ETL
8 15 (33.33%) Data Modelling
8 15 (33.33%) DevOps
9 14 (31.11%) Visualisation
10 11 (24.44%) Data Architecture
11 10 (22.22%) Migration
12 9 (20.00%) TDD
13 8 (17.78%) Data Analysis
14 7 (15.56%) Data Analytics
14 7 (15.56%) Data Governance
14 7 (15.56%) Data Migration
14 7 (15.56%) Event-Driven
14 7 (15.56%) Event-Driven Architecture
15 5 (11.11%) DataOps
Programming Languages
1 34 (75.56%) Python
2 31 (68.89%) SQL
3 17 (37.78%) Scala
4 16 (35.56%) T-SQL
5 7 (15.56%) C#
5 7 (15.56%) Java
6 6 (13.33%) PL/SQL
7 5 (11.11%) Data Analysis Expressions (DAX)
8 3 (6.67%) C++
8 3 (6.67%) PowerShell
9 2 (4.44%) Java 11
9 2 (4.44%) R
10 1 (2.22%) MATLAB
Qualifications
1 2 (4.44%) Degree
Quality Assurance & Compliance
1 6 (13.33%) Data Quality
System Software
1 8 (17.78%) Docker
2 1 (2.22%) Active Directory
2 1 (2.22%) HDFS
Systems Management
1 12 (26.67%) Kubernetes
2 5 (11.11%) Opscode Chef
2 5 (11.11%) Puppet
3 4 (8.89%) Terraform
4 2 (4.44%) Ansible
4 2 (4.44%) FortiGate
5 1 (2.22%) Active Directory Federation Services
5 1 (2.22%) Hadoop YARN
Vendors
1 30 (66.67%) Databricks
2 12 (26.67%) Microsoft
3 5 (11.11%) Remedy
4 4 (8.89%) Alteryx
4 4 (8.89%) CheckPoint
4 4 (8.89%) Cisco
5 3 (6.67%) IBM
5 3 (6.67%) NVIDIA
5 3 (6.67%) Oracle
6 1 (2.22%) Google
6 1 (2.22%) Talend