PySpark Job Trends in the UK excluding London

PySpark - Spark Python API
UK > UK excluding London

The table below provides summary statistics and salary benchmarking for jobs advertised in the UK excluding London requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 9 May 2026, with comparisons to the same periods in the previous two years.

6 months to
9 May 2026
Same period 2025 Same period 2024
Rank 463 445 508
Rank change year-on-year -18 +63 +140
Permanent jobs citing PySpark 114 74 244
As % of all permanent jobs in the UK excluding London 0.17% 0.26% 0.36%
As % of the Libraries, Frameworks & Software Standards category 2.26% 1.53% 1.78%
Number of salaries quoted 87 53 60
10th Percentile £42,500 £49,000 £43,059
25th Percentile £58,125 £50,000 £58,438
Median annual salary (50th Percentile) £72,500 £75,000 £80,000
Median % change year-on-year -3.33% -6.25% +28.00%
75th Percentile £83,750 £79,648 £87,500
90th Percentile £92,500 £106,250 £90,000
UK median annual salary £75,000 £110,000 £70,000
% change year-on-year -31.82% +57.14% -12.50%

All Software Libraries and Frameworks
UK excluding London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in the UK excluding London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 5,048 4,838 13,731
As % of all permanent jobs advertised in the UK excluding London 7.70% 16.97% 20.02%
Number of salaries quoted 3,947 3,494 10,301
10th Percentile £33,750 £32,500 £33,750
25th Percentile £46,250 £45,000 £42,500
Median annual salary (50th Percentile) £60,000 £60,000 £55,000
Median % change year-on-year - +9.09% -4.35%
75th Percentile £73,750 £73,750 £68,750
90th Percentile £87,500 £87,500 £80,000
UK median annual salary £65,000 £66,100 £60,000
% change year-on-year -1.66% +10.17% -11.11%

PySpark
Job Vacancy Trend in the UK excluding London

Historical trend showing the proportion of permanent IT job postings citing PySpark relative to all permanent IT jobs advertised in the UK excluding London.

PySpark job vacancy trend in the UK excluding London

PySpark
Salary Trend in the UK excluding London

Salary distribution trend for jobs in the UK excluding London citing PySpark.

Salary distribution trend for jobs in the UK excluding London citing PySpark

PySpark
Salary Histogram in the UK excluding London

Salary distribution for jobs citing PySpark in the UK excluding London over the 6 months to 9 May 2026.

Salary histogram for PySpark in the UK excluding London

PySpark
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the UK excluding London region over the 6 months to 9 May 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
North of England -25 45 £82,500 +10.00% 20
Yorkshire -26 28 £82,500 -2.94% 3
Midlands -24 27 £60,000 -11.11% 13
East of England +3 20 £75,000 +50.00% 3
West Midlands -21 20 £60,000 +2.13% 8
North West -8 15 £85,000 +13.33% 11
South East -28 11 £72,500 +38.10% 20
South West -45 8 £48,750 -55.68% 1
East Midlands -23 7 £100,000 +33.33% 5
Scotland -24 2 £115,000 +48.19% 3
North East -45 2 £66,720 +6.75% 6
Wales -30 1 - - 1
PySpark
UK

PySpark
Co-Occurring Skills & Capabilities in the UK excluding London by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 16 (14.04%) Apache Spark
2 13 (11.40%) Apache Airflow
3 12 (10.53%) Apache
4 3 (2.63%) Confluence
5 1 (0.88%) Jupyter
Applications
1 4 (3.51%) MS Visio
2 1 (0.88%) Microsoft Excel
2 1 (0.88%) Microsoft Office
Business Applications
1 2 (1.75%) Infor M3
2 1 (0.88%) Primavera
Cloud Services
1 64 (56.14%) Azure
2 37 (32.46%) AWS
3 34 (29.82%) Azure Data Factory
4 22 (19.30%) Power Platform
5 20 (17.54%) Amazon S3
6 17 (14.91%) Azure DevOps
7 12 (10.53%) Serverless
8 10 (8.77%) Azure Logic Apps
9 9 (7.89%) OpenShift
10 8 (7.02%) Azure Functions
10 8 (7.02%) Azure Monitor
11 6 (5.26%) Boomi
11 6 (5.26%) dbt
11 6 (5.26%) GitHub
11 6 (5.26%) Matillion
12 5 (4.39%) AWS CloudFormation
12 5 (4.39%) AWS KMS
12 5 (4.39%) Azure Synapse Analytics
12 5 (4.39%) Microsoft Purview
13 4 (3.51%) AWS Lambda
Database & Business Intelligence
1 32 (28.07%) Spark SQL
2 30 (26.32%) Data Warehouse
3 21 (18.42%) Power BI
4 12 (10.53%) Metadata
5 11 (9.65%) Data Lake
5 11 (9.65%) Delta Lake
5 11 (9.65%) Parquet
6 10 (8.77%) SQL Server
6 10 (8.77%) Star Schema
6 10 (8.77%) Tableau
7 9 (7.89%) Apache Hive
7 9 (7.89%) Impala
7 9 (7.89%) Oracle Database
8 7 (6.14%) SQL Server Integration Services
9 6 (5.26%) Pentaho
9 6 (5.26%) Snowflake Schema
10 4 (3.51%) Amazon Redshift
10 4 (3.51%) Flink
11 2 (1.75%) Azure SQL Database
11 2 (1.75%) IBM InfoSphere
Development Applications
1 15 (13.16%) Git
2 9 (7.89%) IBM UrbanCode
3 5 (4.39%) JIRA
4 2 (1.75%) GitLab
5 1 (0.88%) Cucumber
5 1 (0.88%) Jenkins
5 1 (0.88%) JMeter
5 1 (0.88%) MLflow
5 1 (0.88%) Visual Studio Code
5 1 (0.88%) Zephyr
General
1 33 (28.95%) Finance
2 19 (16.67%) Social Skills
3 18 (15.79%) Analytical Skills
4 13 (11.40%) Public Sector
5 11 (9.65%) Banking
6 9 (7.89%) Investment Banking
7 7 (6.14%) Law
8 5 (4.39%) Automotive
8 5 (4.39%) Documentation Skills
8 5 (4.39%) Legal
9 2 (1.75%) Organisational Skills
10 1 (0.88%) Advertising
10 1 (0.88%) Inclusion and Diversity
10 1 (0.88%) Marketing
10 1 (0.88%) Retail
Job Titles
1 68 (59.65%) Data Engineer
2 29 (25.44%) Senior
3 20 (17.54%) Lead
4 19 (16.67%) Lead Data Engineer
4 19 (16.67%) Senior Data Engineer
5 15 (13.16%) Azure Engineer
6 14 (12.28%) Platform Engineer
7 11 (9.65%) Analyst
8 9 (7.89%) Banking Analyst
8 9 (7.89%) Transformation Analyst
9 8 (7.02%) Azure Platform Engineer
9 8 (7.02%) Cloud Platform Engineer
10 6 (5.26%) Architect
10 6 (5.26%) AWS Engineer
10 6 (5.26%) Azure Data Engineer
11 5 (4.39%) Data Scientist
11 5 (4.39%) Engineering Manager
11 5 (4.39%) Technical Analyst
12 4 (3.51%) Data Manager
12 4 (3.51%) Investment Banking Business Analyst
Libraries, Frameworks & Software Standards
1 10 (8.77%) REST
2 9 (7.89%) ARM Templates
3 8 (7.02%) Pandas
4 7 (6.14%) Kafka
5 4 (3.51%) Great Expectations
6 1 (0.88%) AWS CDK
6 1 (0.88%) PyTorch
6 1 (0.88%) TensorFlow
Miscellaneous
1 6 (5.26%) Data Structures
2 5 (4.39%) Cloud Native
2 5 (4.39%) Legacy Systems
3 4 (3.51%) Analytical Mindset
4 3 (2.63%) Onboarding
5 2 (1.75%) Algorithms
5 2 (1.75%) Credit Risk
5 2 (1.75%) Enterprise Cloud
5 2 (1.75%) Low-Code
6 1 (0.88%) Data Protection Act
6 1 (0.88%) Distributed Computing
6 1 (0.88%) NHS
Processes & Methodologies
1 71 (62.28%) Data Engineering
2 62 (54.39%) Data Pipeline
3 61 (53.51%) ETL
4 58 (50.88%) Analytics
5 54 (47.37%) CI/CD
6 43 (37.72%) Data Modelling
7 42 (36.84%) DevOps
8 31 (27.19%) AI
8 31 (27.19%) Data Transformation
9 29 (25.44%) Agile
10 27 (23.68%) Business Intelligence
11 26 (22.81%) Data Governance
12 23 (20.18%) Decision-Making
13 21 (18.42%) Infrastructure as Code
13 21 (18.42%) Test Automation
14 19 (16.67%) Continuous Improvement
15 17 (14.91%) Machine Learning
15 17 (14.91%) Mentoring
16 15 (13.16%) Migration
17 14 (12.28%) Scrum
Programming Languages
1 106 (92.98%) Python
2 96 (84.21%) SQL
3 6 (5.26%) Data Analysis Expressions
3 6 (5.26%) Scala
4 5 (4.39%) Java
5 4 (3.51%) T-SQL
6 3 (2.63%) PowerShell
6 3 (2.63%) R
7 2 (1.75%) Kusto Query Language
8 1 (0.88%) JavaScript
8 1 (0.88%) VBA
Qualifications
1 17 (14.91%) Degree
2 14 (12.28%) Security Cleared
3 10 (8.77%) Computer Science Degree
4 8 (7.02%) SC Cleared
5 2 (1.75%) Azure Certification
5 2 (1.75%) DBS Check
5 2 (1.75%) Master's Degree
6 1 (0.88%) AWS Certification
Quality Assurance & Compliance
1 48 (42.11%) Data Quality
2 19 (16.67%) GDPR
3 10 (8.77%) HIPAA
4 5 (4.39%) California Consumer Privacy Act
4 5 (4.39%) ISO/IEC 27001
4 5 (4.39%) NIST
4 5 (4.39%) Sarbanes-Oxley
5 1 (0.88%) Accessibility
5 1 (0.88%) QA
System Software
1 1 (0.88%) Docker
Systems Management
1 23 (20.18%) Terraform
2 2 (1.75%) Control-M
3 1 (0.88%) Kubernetes
Vendors
1 63 (55.26%) Databricks
2 28 (24.56%) Microsoft
3 11 (9.65%) Oracle
4 9 (7.89%) Red Hat
5 8 (7.02%) Talend
6 7 (6.14%) Informatica
7 6 (5.26%) MuleSoft
8 2 (1.75%) BMC
8 2 (1.75%) IBM
8 2 (1.75%) Infor
9 1 (0.88%) Autodesk
9 1 (0.88%) Google
9 1 (0.88%) SAP