PySpark Job Trends in Yorkshire

PySpark - Spark Python API
England > Yorkshire

The table below provides summary statistics and salary benchmarking for jobs advertised in Yorkshire requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 6 November 2025, with comparisons to the same periods in the previous two years.

6 months to
6 Nov 2025
Same period 2024 Same period 2023
Rank 147 166 175
Rank change year-on-year +19 +9 +68
Permanent jobs citing PySpark 11 7 18
As % of all permanent jobs in Yorkshire 0.31% 0.17% 0.55%
As % of the Libraries, Frameworks & Software Standards category 2.96% 1.11% 1.82%
Number of salaries quoted 5 6 8
10th Percentile £62,940 - -
25th Percentile £74,500 £44,738 £41,250
Median annual salary (50th Percentile) £79,000 £49,274 £56,250
Median % change year-on-year +60.33% -12.40% -29.69%
75th Percentile £83,500 £79,078 £64,063
90th Percentile £84,400 £87,500 £66,125
England median annual salary £70,596 £105,000 £75,000
% change year-on-year -32.77% +40.00% -6.25%

All Software Libraries and Frameworks
Yorkshire

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in Yorkshire.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 372 628 991
As % of all permanent jobs advertised in Yorkshire 10.36% 14.83% 30.36%
Number of salaries quoted 276 380 721
10th Percentile £28,250 £31,250 £37,500
25th Percentile £37,500 £42,434 £46,250
Median annual salary (50th Percentile) £60,000 £55,000 £60,000
Median % change year-on-year +9.09% -8.33% +9.09%
75th Percentile £73,750 £69,500 £73,750
90th Percentile £82,500 £81,250 £85,000
England median annual salary £67,500 £65,000 £67,500
% change year-on-year +3.85% -3.70% +3.85%

PySpark
Job Vacancy Trend in Yorkshire

Historical trend showing the proportion of permanent IT job postings citing PySpark relative to all permanent IT jobs advertised in Yorkshire.

PySpark job vacancy trend in Yorkshire

PySpark
Salary Trend in Yorkshire

Salary distribution trend for jobs in Yorkshire citing PySpark.

Salary distribution trend for jobs in Yorkshire citing PySpark

PySpark
Salary Histogram in Yorkshire

Salary distribution for jobs citing PySpark in Yorkshire over the 6 months to 6 November 2025.

Salary histogram for PySpark in Yorkshire

PySpark
Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the Yorkshire region over the 6 months to 6 November 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
West Yorkshire -2 9 £79,000 +17.67% 8
East Yorkshire - 1 - -
North Yorkshire - 1 - -
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in Yorkshire by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 3 (27.27%) Apache Spark
Cloud Services
1 7 (63.64%) Azure
2 4 (36.36%) Azure Data Factory
2 4 (36.36%) Microsoft Purview
3 3 (27.27%) Amazon EKS
3 3 (27.27%) Amazon ELB
3 3 (27.27%) Amazon S3
3 3 (27.27%) AWS
4 1 (9.09%) Azure App Service
4 1 (9.09%) Azure Synapse Analytics
4 1 (9.09%) GitHub
4 1 (9.09%) GitHub Actions
4 1 (9.09%) Power Platform
Database & Business Intelligence
1 7 (63.64%) Metadata
2 5 (45.45%) Spark SQL
3 3 (27.27%) Delta Lake
3 3 (27.27%) DynamoDB
4 1 (9.09%) Big Data
4 1 (9.09%) Power BI
4 1 (9.09%) SQL Server
4 1 (9.09%) Tableau
Development Applications
1 3 (27.27%) MLflow
General
1 6 (54.55%) Social Skills
2 5 (45.45%) Public Sector
3 2 (18.18%) Retail
4 1 (9.09%) Analytical Skills
Job Titles
1 7 (63.64%) Data Engineer
2 3 (27.27%) Architect
2 3 (27.27%) Data Architect
2 3 (27.27%) Machine Learning Engineer
2 3 (27.27%) Operations Engineer
2 3 (27.27%) Principal Architect
2 3 (27.27%) Principal Data Architect
2 3 (27.27%) Principal Data Engineer
2 3 (27.27%) Principal Engineer
3 2 (18.18%) Lead
3 2 (18.18%) Lead Data Engineer
4 1 (9.09%) Analyst
4 1 (9.09%) Artificial Intelligence Engineer
4 1 (9.09%) Data Analyst
Libraries, Frameworks & Software Standards
1 3 (27.27%) Keras
1 3 (27.27%) Lambda Expressions
1 3 (27.27%) Metaflow
1 3 (27.27%) NumPy
1 3 (27.27%) Pandas
1 3 (27.27%) PyTorch
1 3 (27.27%) scikit-learn
1 3 (27.27%) TensorFlow
1 3 (27.27%) YAML
2 1 (9.09%) Matplotlib
Miscellaneous
1 3 (27.27%) Linux Command Line
2 1 (9.09%) Cloud Native
2 1 (9.09%) Enterprise Cloud
Operating Systems
1 3 (27.27%) Unix
Processes & Methodologies
1 7 (63.64%) AI
1 7 (63.64%) Analytics
1 7 (63.64%) Data Engineering
1 7 (63.64%) Machine Learning
2 6 (54.55%) Containerisation
2 6 (54.55%) Data Pipeline
3 5 (45.45%) Mentoring
3 5 (45.45%) Visualisation
4 4 (36.36%) CI/CD
4 4 (36.36%) Data Science
4 4 (36.36%) Data Security
4 4 (36.36%) Information Security
4 4 (36.36%) Migration
5 3 (27.27%) Deployment Automation
5 3 (27.27%) MLOps
5 3 (27.27%) OO
5 3 (27.27%) OOP
5 3 (27.27%) OWASP
5 3 (27.27%) Stakeholder Management
5 3 (27.27%) Technical Leadership
Programming Languages
1 10 (90.91%) Python
2 9 (81.82%) SQL
3 3 (27.27%) T-SQL
Qualifications
1 1 (9.09%) SC Cleared
1 1 (9.09%) Security Cleared
Quality Assurance & Compliance
1 1 (9.09%) Data Quality
1 1 (9.09%) QA
System Software
1 3 (27.27%) Docker
Systems Management
1 6 (54.55%) Kubernetes
2 3 (27.27%) Kubeflow
2 3 (27.27%) Terraform
Vendors
1 9 (81.82%) Databricks
2 5 (45.45%) Microsoft