PySpark - Spark Python API
UK
The table below provides summary statistics for permanent job vacancies requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 28 May 2025, comparing them to the same period in the previous two years.
| 6 months to 28 May 2025 |
Same period 2024 | Same period 2023 | |
|---|---|---|---|
| Rank | 452 | 508 | 697 |
| Rank change year-on-year | +56 | +189 | +43 |
| Permanent jobs citing PySpark | 277 | 452 | 273 |
| As % of all permanent jobs advertised in the UK | 0.51% | 0.44% | 0.28% |
| As % of the Libraries, Frameworks & Software Standards category | 3.01% | 2.13% | 0.93% |
| Number of salaries quoted | 219 | 187 | 216 |
| 10th Percentile | £50,000 | £52,500 | £50,000 |
| 25th Percentile | £66,250 | £57,500 | £62,500 |
| Median annual salary (50th Percentile) | £110,000 | £70,000 | £80,000 |
| Median % change year-on-year | +57.14% | -12.50% | +14.29% |
| 75th Percentile | £122,500 | £87,500 | £105,000 |
| 90th Percentile | £138,750 | £100,000 | £160,000 |
| UK excluding London median annual salary | £62,500 | £77,500 | £65,000 |
| % change year-on-year | -19.35% | +19.23% | +18.18% |
All Software Libraries and Frameworks
UK
PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills.
| Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills | 9,208 | 21,249 | 29,392 |
| As % of all permanent jobs advertised in the UK | 16.84% | 20.80% | 30.01% |
| Number of salaries quoted | 5,664 | 15,856 | 18,240 |
| 10th Percentile | £38,750 | £36,250 | £40,500 |
| 25th Percentile | £51,250 | £45,000 | £51,000 |
| Median annual salary (50th Percentile) | £66,254 | £60,000 | £67,500 |
| Median % change year-on-year | +10.42% | -11.11% | +3.85% |
| 75th Percentile | £87,500 | £78,750 | £87,500 |
| 90th Percentile | £112,350 | £100,000 | £106,250 |
| UK excluding London median annual salary | £60,000 | £55,000 | £57,500 |
| % change year-on-year | +9.09% | -4.35% | +4.55% |
PySpark
Job Vacancy Trend
Job postings citing PySpark as a proportion of all IT jobs advertised.
PySpark
Salary Trend
3-month moving average salary quoted in jobs citing PySpark.
PySpark
Salary Histogram
Salary distribution for jobs citing PySpark over the 6 months to 28 May 2025.
PySpark
Top 16 Job Locations
The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the UK over the 6 months to 28 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.
| Location | Rank Change on Same Period Last Year |
Matching Permanent IT Job Ads |
Median Salary Past 6 Months |
Median Salary % Change on Same Period Last Year |
Live Jobs |
|---|---|---|---|---|---|
| England | +160 | 262 | £110,000 | +57.14% | 427 |
| London | +128 | 203 | £110,000 | +57.14% | 125 |
| Work from Home | +117 | 154 | £110,000 | +62.96% | 131 |
| UK excluding London | +28 | 70 | £62,500 | -19.35% | 365 |
| South East | +106 | 18 | £52,500 | +31.25% | 119 |
| Midlands | +62 | 16 | £65,000 | +4.00% | 60 |
| North of England | +10 | 11 | £72,500 | -12.12% | 74 |
| Scotland | -23 | 11 | £75,000 | +15.38% | 17 |
| East of England | +52 | 10 | £50,000 | -9.09% | 44 |
| West Midlands | +63 | 9 | £62,500 | - | 26 |
| East Midlands | +42 | 7 | £75,000 | - | 31 |
| North West | -31 | 4 | £75,000 | -11.76% | 37 |
| North East | - | 4 | £62,500 | - | 8 |
| South West | +111 | 3 | £115,000 | +109.09% | 46 |
| Yorkshire | +59 | 3 | £85,000 | +6.25% | 29 |
| Wales | - | 1 | £55,000 | - | 12 |
PySpark
Co-occurring Skills and Capabilities by Category
The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||