PySpark Job Trends in Yorkshire

PySpark - Spark Python API
England > Yorkshire

The table below provides summary statistics and salary benchmarking for jobs advertised in Yorkshire requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 16 October 2025, with comparisons to the same periods in the previous two years.

6 months to
16 Oct 2025
Same period 2024 Same period 2023
Rank 151 171 178
Rank change year-on-year +20 +7 +62
Permanent jobs citing PySpark 8 6 16
As % of all permanent jobs in Yorkshire 0.24% 0.14% 0.46%
As % of the Libraries, Frameworks & Software Standards category 2.55% 0.92% 1.55%
Number of salaries quoted 3 5 7
10th Percentile £59,086 - -
25th Percentile £64,867 £44,738 £41,250
Median annual salary (50th Percentile) £79,000 £49,274 £50,000
Median % change year-on-year +60.33% -1.45% -37.50%
75th Percentile £83,500 £53,811 £63,750
90th Percentile - £74,024 £64,250
England median annual salary £71,193 £100,000 £75,000
% change year-on-year -28.81% +33.33% -

All Software Libraries and Frameworks
Yorkshire

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in Yorkshire.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 314 653 1,033
As % of all permanent jobs advertised in Yorkshire 9.38% 14.85% 29.65%
Number of salaries quoted 226 410 745
10th Percentile £28,250 £31,250 £37,500
25th Percentile £38,750 £42,500 £46,250
Median annual salary (50th Percentile) £60,000 £55,000 £60,000
Median % change year-on-year +9.09% -8.33% +9.09%
75th Percentile £72,750 £69,500 £73,750
90th Percentile £83,000 £80,125 £85,000
England median annual salary £67,500 £65,000 £67,500
% change year-on-year +3.85% -3.70% +3.85%

PySpark
Job Vacancy Trend in Yorkshire

Historical trend showing the proportion of permanent IT job postings citing PySpark relative to all permanent IT jobs advertised in Yorkshire.

PySpark job vacancy trend in Yorkshire

PySpark
Salary Trend in Yorkshire

Salary distribution trend for jobs in Yorkshire citing PySpark.

Salary distribution trend for jobs in Yorkshire citing PySpark

PySpark
Salary Histogram in Yorkshire

Salary distribution for jobs citing PySpark in Yorkshire over the 6 months to 16 October 2025.

Salary histogram for PySpark in Yorkshire

PySpark
Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the Yorkshire region over the 6 months to 16 October 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
West Yorkshire +10 6 £79,000 +60.33% 8
East Yorkshire - 1 - -
North Yorkshire - 1 - -
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in Yorkshire by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 3 (37.50%) Apache Spark
Cloud Services
1 4 (50.00%) Azure
2 3 (37.50%) Amazon EKS
2 3 (37.50%) Amazon ELB
2 3 (37.50%) Amazon S3
2 3 (37.50%) AWS
2 3 (37.50%) Azure Data Factory
3 2 (25.00%) Microsoft Purview
4 1 (12.50%) Azure Synapse Analytics
4 1 (12.50%) Power Platform
Database & Business Intelligence
1 5 (62.50%) Metadata
2 4 (50.00%) Spark SQL
3 3 (37.50%) Delta Lake
3 3 (37.50%) DynamoDB
4 1 (12.50%) Big Data
4 1 (12.50%) Power BI
4 1 (12.50%) SQL Server
4 1 (12.50%) Tableau
Development Applications
1 3 (37.50%) MLflow
General
1 5 (62.50%) Social Skills
2 4 (50.00%) Public Sector
3 1 (12.50%) Analytical Skills
3 1 (12.50%) Retail
Job Titles
1 4 (50.00%) Data Engineer
2 3 (37.50%) Machine Learning Engineer
2 3 (37.50%) Operations Engineer
3 2 (25.00%) Architect
3 2 (25.00%) Data Architect
3 2 (25.00%) Principal Architect
3 2 (25.00%) Principal Data Architect
3 2 (25.00%) Principal Data Engineer
3 2 (25.00%) Principal Engineer
4 1 (12.50%) Analyst
4 1 (12.50%) Data Analyst
4 1 (12.50%) Lead
4 1 (12.50%) Lead Data Engineer
Libraries, Frameworks & Software Standards
1 3 (37.50%) Keras
1 3 (37.50%) Lambda Expressions
1 3 (37.50%) Metaflow
1 3 (37.50%) NumPy
1 3 (37.50%) Pandas
1 3 (37.50%) PyTorch
1 3 (37.50%) scikit-learn
1 3 (37.50%) TensorFlow
1 3 (37.50%) YAML
2 1 (12.50%) Matplotlib
Miscellaneous
1 3 (37.50%) Linux Command Line
Operating Systems
1 3 (37.50%) Unix
Processes & Methodologies
1 5 (62.50%) AI
1 5 (62.50%) Containerisation
1 5 (62.50%) Machine Learning
1 5 (62.50%) Visualisation
2 4 (50.00%) Analytics
2 4 (50.00%) Data Engineering
2 4 (50.00%) Data Pipeline
2 4 (50.00%) Data Science
2 4 (50.00%) Information Security
3 3 (37.50%) CI/CD
3 3 (37.50%) Deployment Automation
3 3 (37.50%) Mentoring
3 3 (37.50%) Metadata Management
3 3 (37.50%) MLOps
3 3 (37.50%) OO
3 3 (37.50%) OOP
3 3 (37.50%) OWASP
3 3 (37.50%) Time Management
3 3 (37.50%) Unit Testing
4 2 (25.00%) Technical Leadership
Programming Languages
1 7 (87.50%) Python
2 6 (75.00%) SQL
3 2 (25.00%) T-SQL
Qualifications
1 1 (12.50%) SC Cleared
1 1 (12.50%) Security Cleared
Quality Assurance & Compliance
1 1 (12.50%) Data Quality
1 1 (12.50%) QA
System Software
1 3 (37.50%) Docker
Systems Management
1 5 (62.50%) Kubernetes
2 3 (37.50%) Kubeflow
2 3 (37.50%) Terraform
Vendors
1 6 (75.00%) Databricks
2 3 (37.50%) Microsoft