PySpark - Spark Python API
UK

The table below provides summary statistics and salary benchmarking for jobs requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 11 May 2026, with comparisons to the same periods in the previous two years.

6 months to
11 May 2026
Same period 2025 Same period 2024
Rank 480 369 492
Rank change year-on-year -111 +123 +190
Permanent jobs citing PySpark 240 322 441
As % of all permanent jobs in the UK 0.27% 0.73% 0.46%
As % of the Libraries, Frameworks & Software Standards category 2.67% 3.70% 2.16%
Number of salaries quoted 162 266 181
10th Percentile £52,400 £50,000 £52,500
25th Percentile £60,313 £75,563 £58,750
Median annual salary (50th Percentile) £75,000 £110,000 £70,000
Median % change year-on-year -31.82% +57.14% -12.50%
75th Percentile £87,500 £122,500 £87,500
90th Percentile £100,000 £147,500 £100,000
UK excluding London median annual salary £73,750 £75,000 £80,000
% change year-on-year -1.67% -6.25% +28.00%

All Software Libraries and Frameworks
UK

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 8,997 8,711 20,396
As % of all permanent jobs advertised in the UK 9.95% 19.84% 21.11%
Number of salaries quoted 6,619 6,304 15,761
10th Percentile £40,000 £38,750 £36,250
25th Percentile £50,000 £51,250 £45,000
Median annual salary (50th Percentile) £65,000 £66,100 £60,000
Median % change year-on-year -1.66% +10.17% -11.11%
75th Percentile £85,000 £87,500 £78,750
90th Percentile £100,000 £111,250 £100,000
UK excluding London median annual salary £60,000 £60,000 £55,000
% change year-on-year - +9.09% -4.35%

PySpark
Job Vacancy Trend

Historical trend showing the proportion of permanent IT job postings citing PySpark relative to all permanent IT jobs advertised.

PySpark job vacancy trend in the UK

PySpark
Salary Trend

Salary distribution trend for jobs in the UK citing PySpark.

Salary distribution trend for jobs in the UK citing PySpark

PySpark
Salary Histogram

Salary distribution for jobs citing PySpark over the 6 months to 11 May 2026.

Salary histogram for PySpark in the UK

PySpark
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the UK over the 6 months to 11 May 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -82 232 £75,000 -31.82% 98
London -112 118 £80,000 -27.27% 57
UK excluding London -22 113 £73,750 -1.67% 56
Work from Home -78 79 £75,000 -31.82% 53
North of England -13 45 £82,500 +10.00% 19
Yorkshire -23 28 £82,500 -2.94% 3
Midlands -22 27 £60,000 -11.11% 9
East of England -3 20 £75,000 +50.00% 3
West Midlands -12 20 £60,000 +2.13% 6
North West +2 15 £85,000 +13.33% 11
South East -29 10 £72,500 +38.10% 21
South West -46 8 £48,750 -55.68% 1
East Midlands -26 7 £100,000 +33.33% 3
Scotland -16 2 £115,000 +48.19% 2
North East -43 2 £66,720 +6.75% 5
Wales -28 1 - - 1

PySpark
Co-Occurring Skills & Capabilities by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 54 (22.50%) Apache Spark
2 39 (16.25%) Apache
3 36 (15.00%) Apache Airflow
4 3 (1.25%) Confluence
4 3 (1.25%) SAS
5 2 (0.83%) Jupyter
5 2 (0.83%) Palantir Foundry
Applications
1 13 (5.42%) MS Visio
2 4 (1.67%) Microsoft Excel
3 2 (0.83%) Microsoft PowerPoint
4 1 (0.42%) Microsoft Office
Business Applications
1 2 (0.83%) Infor M3
2 1 (0.42%) Primavera
Cloud Services
1 132 (55.00%) Azure
2 91 (37.92%) AWS
3 69 (28.75%) Azure Data Factory
4 52 (21.67%) Amazon S3
5 49 (20.42%) Power Platform
6 40 (16.67%) Azure DevOps
7 34 (14.17%) Serverless
8 29 (12.08%) Azure Synapse Analytics
9 27 (11.25%) GitHub
10 26 (10.83%) OpenShift
11 17 (7.08%) Azure Monitor
12 14 (5.83%) AWS Lambda
12 14 (5.83%) Azure Functions
13 13 (5.42%) GCP
14 12 (5.00%) Microsoft Purview
15 11 (4.58%) Azure Machine Learning
15 11 (4.58%) SaaS
16 10 (4.17%) Azure Logic Apps
16 10 (4.17%) dbt
17 9 (3.75%) Snowflake
Database & Business Intelligence
1 61 (25.42%) Spark SQL
2 52 (21.67%) Data Warehouse
3 45 (18.75%) Data Lake
4 44 (18.33%) Power BI
5 43 (17.92%) Delta Lake
6 36 (15.00%) Tableau
7 28 (11.67%) Apache Hive
7 28 (11.67%) Parquet
8 27 (11.25%) Impala
9 25 (10.42%) Oracle Database
10 20 (8.33%) Metadata
11 18 (7.50%) Azure SQL Database
12 17 (7.08%) SQL Server
13 12 (5.00%) Relational Database
13 12 (5.00%) Snowflake Schema
13 12 (5.00%) Star Schema
14 11 (4.58%) Amazon Redshift
15 9 (3.75%) Big Data
16 8 (3.33%) SQL Server Integration Services
17 6 (2.50%) Pentaho
Development Applications
1 56 (23.33%) Git
2 25 (10.42%) IBM UrbanCode
3 10 (4.17%) MLflow
4 5 (2.08%) JIRA
5 4 (1.67%) Jenkins
6 3 (1.25%) GitLab
7 1 (0.42%) Cucumber
7 1 (0.42%) Deequ
7 1 (0.42%) JMeter
7 1 (0.42%) Team Foundation Server
7 1 (0.42%) Visual Studio Code
7 1 (0.42%) Zephyr
General
1 87 (36.25%) Finance
2 45 (18.75%) Social Skills
3 37 (15.42%) Analytical Skills
4 29 (12.08%) Banking
5 24 (10.00%) Investment Banking
6 17 (7.08%) Public Sector
7 12 (5.00%) Legal
8 7 (2.92%) Law
9 6 (2.50%) Retail
10 5 (2.08%) Automotive
10 5 (2.08%) Documentation Skills
10 5 (2.08%) Inclusion and Diversity
10 5 (2.08%) Marketing
11 3 (1.25%) Organisational Skills
12 2 (0.83%) Front Office
12 2 (0.83%) Manufacturing
13 1 (0.42%) Advertising
13 1 (0.42%) Financial Institution
Job Titles
1 133 (55.42%) Data Engineer
2 57 (23.75%) Senior
3 39 (16.25%) Senior Data Engineer
4 35 (14.58%) Lead
5 29 (12.08%) Analyst
6 23 (9.58%) Transformation Analyst
7 22 (9.17%) Azure Engineer
7 22 (9.17%) Banking Analyst
7 22 (9.17%) Platform Engineer
8 20 (8.33%) Lead Data Engineer
9 17 (7.08%) Architect
10 14 (5.83%) AWS Engineer
10 14 (5.83%) Business Analyst
11 13 (5.42%) Python Engineer
11 13 (5.42%) Technical Analyst
12 12 (5.00%) Data Business Analyst
13 11 (4.58%) Azure Data Engineer
13 11 (4.58%) Investment Banking Business Analyst
14 10 (4.17%) AWS Data Engineer
15 8 (3.33%) Cloud Platform Engineer
Libraries, Frameworks & Software Standards
1 28 (11.67%) Pandas
2 27 (11.25%) Kafka
3 11 (4.58%) REST
4 9 (3.75%) ARM Templates
5 7 (2.92%) React
6 6 (2.50%) Great Expectations
7 5 (2.08%) PyTorch
7 5 (2.08%) TensorFlow
8 4 (1.67%) CSS
8 4 (1.67%) LangChain
8 4 (1.67%) scikit-learn
8 4 (1.67%) XGBoost
9 3 (1.25%) Node.js
10 2 (0.83%) pytest
11 1 (0.42%) .NET
11 1 (0.42%) .NET Framework
11 1 (0.42%) AWS CDK
11 1 (0.42%) NumPy
11 1 (0.42%) Playwright
11 1 (0.42%) Plotly
Miscellaneous
1 18 (7.50%) Cloud Native
2 8 (3.33%) Legacy Systems
2 8 (3.33%) Product Ownership
3 6 (2.50%) Data Structures
3 6 (2.50%) Distributed Computing
3 6 (2.50%) Enterprise Software
3 6 (2.50%) Reinsurance
4 5 (2.08%) Analytical Mindset
4 5 (2.08%) Onboarding
5 4 (1.67%) Data Protection Act
5 4 (1.67%) NHS
6 3 (1.25%) Data Fabric
6 3 (1.25%) Enterprise Cloud
7 2 (0.83%) Algorithms
7 2 (0.83%) Clustering
7 2 (0.83%) Credit Risk
7 2 (0.83%) Distributed Systems
7 2 (0.83%) Low-Code
8 1 (0.42%) Derivative
8 1 (0.42%) Equities
Processes & Methodologies
1 137 (57.08%) Data Engineering
2 136 (56.67%) Analytics
3 135 (56.25%) Data Pipeline
4 118 (49.17%) CI/CD
5 114 (47.50%) ETL
6 100 (41.67%) Data Modelling
7 89 (37.08%) DevOps
8 80 (33.33%) AI
9 77 (32.08%) Data Governance
10 64 (26.67%) Agile
10 64 (26.67%) Business Intelligence
10 64 (26.67%) Data Transformation
11 47 (19.58%) Infrastructure as Code
12 43 (17.92%) Machine Learning
13 38 (15.83%) Data Science
13 38 (15.83%) Mentoring
14 37 (15.42%) Decision-Making
15 35 (14.58%) Data Architecture
16 34 (14.17%) Continuous Improvement
17 33 (13.75%) Scrum
Programming Languages
1 222 (92.50%) Python
2 198 (82.50%) SQL
3 24 (10.00%) Scala
4 12 (5.00%) R
5 10 (4.17%) Data Analysis Expressions
6 9 (3.75%) Java
7 8 (3.33%) T-SQL
8 7 (2.92%) PowerShell
9 5 (2.08%) JavaScript
10 4 (1.67%) Kusto Query Language
11 3 (1.25%) TypeScript
12 1 (0.42%) Bicep
12 1 (0.42%) C#
12 1 (0.42%) Korn
12 1 (0.42%) SPARQL
12 1 (0.42%) VBA
Qualifications
1 34 (14.17%) Degree
2 26 (10.83%) Security Cleared
3 20 (8.33%) Computer Science Degree
4 18 (7.50%) SC Cleared
5 11 (4.58%) Azure Certification
6 8 (3.33%) Microsoft Certification
7 5 (2.08%) Master's Degree
8 4 (1.67%) AWS Certification
9 3 (1.25%) AWS Certified Solutions Architect
10 2 (0.83%) DBS Check
11 1 (0.42%) BPSS Clearance
Quality Assurance & Compliance
1 107 (44.58%) Data Quality
2 29 (12.08%) GDPR
3 17 (7.08%) HIPAA
4 12 (5.00%) California Consumer Privacy Act
5 5 (2.08%) ISO/IEC 27001
5 5 (2.08%) NIST
5 5 (2.08%) Sarbanes-Oxley
6 4 (1.67%) Solvency II
7 3 (1.25%) Accessibility
8 2 (0.83%) QA
System Software
1 13 (5.42%) Docker
2 1 (0.42%) Virtual Machines
Systems Management
1 51 (21.25%) Terraform
2 12 (5.00%) Kubernetes
3 3 (1.25%) Ansible
3 3 (1.25%) Control-M
Vendors
1 128 (53.33%) Databricks
2 60 (25.00%) Microsoft
3 27 (11.25%) Oracle
4 25 (10.42%) Red Hat
5 10 (4.17%) Talend
6 8 (3.33%) OpenAI
7 7 (2.92%) Foundry
7 7 (2.92%) Informatica
8 6 (2.50%) MuleSoft
9 4 (1.67%) CrowdStrike
9 4 (1.67%) Fortinet
9 4 (1.67%) Google
9 4 (1.67%) Palo Alto
10 3 (1.25%) BMC
10 3 (1.25%) IBM
11 2 (0.83%) Infor
11 2 (0.83%) Palantir
12 1 (0.42%) Apple
12 1 (0.42%) Autodesk
12 1 (0.42%) Cloudera