PySpark - Spark Python API
UK
The following table provides summary statistics for permanent job vacancies with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 4 December 2023 with a comparison to the same period in the previous 2 years.
| 6 months to 4 Dec 2023 |
Same period 2022 | Same period 2021 | |
|---|---|---|---|
| Rank | 579 | 736 | 795 |
| Rank change year-on-year | +157 | +59 | -122 |
| Permanent jobs citing PySpark | 162 | 352 | 310 |
| As % of all permanent jobs advertised in the UK | 0.30% | 0.28% | 0.24% |
| As % of the Libraries, Frameworks & Software Standards category | 1.16% | 0.88% | 0.63% |
| Number of salaries quoted | 130 | 241 | 165 |
| 10th Percentile | £50,875 | £56,250 | £45,000 |
| 25th Percentile | £52,500 | £62,500 | £51,750 |
| Median annual salary (50th Percentile) | £70,000 | £80,000 | £70,000 |
| Median % change year-on-year | -12.50% | +14.29% | +7.69% |
| 75th Percentile | £87,500 | £88,750 | £87,500 |
| 90th Percentile | £106,250 | £100,000 | £108,750 |
| UK excluding London median annual salary | £57,000 | £73,750 | £55,000 |
| % change year-on-year | -22.71% | +34.09% | -8.33% |
All Software Libraries and Frameworks
UK
PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for technical specification, industry standards, software libraries and framework skills.
| Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills | 14,018 | 40,128 | 49,552 |
| As % of all permanent jobs advertised in the UK | 26.33% | 32.38% | 38.64% |
| Number of salaries quoted | 10,969 | 24,275 | 32,022 |
| 10th Percentile | £41,250 | £40,000 | £36,750 |
| 25th Percentile | £51,250 | £50,000 | £45,000 |
| Median annual salary (50th Percentile) | £66,500 | £65,000 | £60,000 |
| Median % change year-on-year | +2.31% | +8.33% | +4.35% |
| 75th Percentile | £85,000 | £86,250 | £80,000 |
| 90th Percentile | £106,258 | £105,000 | £96,250 |
| UK excluding London median annual salary | £57,500 | £57,500 | £52,500 |
| % change year-on-year | - | +9.52% | +5.00% |
PySpark
Job Vacancy Trend
Job postings citing PySpark as a proportion of all IT jobs advertised.
PySpark
Salary Trend
3-month moving average salary quoted in jobs citing PySpark.
PySpark
Salary Histogram
Salary distribution for jobs citing PySpark over the 6 months to 4 December 2023.
PySpark
Top 14 Job Locations
The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the UK over the 6 months to 4 December 2023. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.
| Location | Rank Change on Same Period Last Year |
Matching Permanent IT Job Ads |
Median Salary Past 6 Months |
Median Salary % Change on Same Period Last Year |
Live Jobs |
|---|---|---|---|---|---|
| England | +176 | 155 | £70,000 | -12.50% | 63 |
| London | +164 | 100 | £75,500 | -5.63% | 44 |
| UK excluding London | +188 | 57 | £57,000 | -22.71% | 33 |
| Work from Home | +153 | 50 | £72,500 | -3.33% | 45 |
| North of England | +123 | 18 | £55,000 | -31.25% | 7 |
| Yorkshire | +84 | 14 | £62,500 | -21.88% | |
| West Midlands | +124 | 13 | £53,500 | -26.21% | |
| Midlands | +106 | 13 | £53,500 | -26.21% | |
| South West | +87 | 10 | £77,500 | +8.77% | 2 |
| South East | +148 | 9 | £75,000 | +7.14% | 6 |
| Wales | - | 4 | £59,280 | - | 5 |
| Scotland | +51 | 3 | - | - | 6 |
| North East | +44 | 3 | £55,000 | -35.29% | |
| North West | +92 | 1 | £92,500 | +15.63% | 7 |
PySpark
Co-occurring Skills and Capabilities by Category
The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||