PySpark - Spark Python API
UK
The following table provides summary statistics for permanent job vacancies with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 28 May 2024 with a comparison to the same period in the previous 2 years.
| 6 months to 28 May 2024 |
Same period 2023 | Same period 2022 | |
|---|---|---|---|
| Rank | 498 | 687 | 729 |
| Rank change year-on-year | +189 | +42 | +73 |
| Permanent jobs citing PySpark | 457 | 272 | 578 |
| As % of all permanent jobs advertised in the UK | 0.45% | 0.28% | 0.35% |
| As % of the Libraries, Frameworks & Software Standards category | 2.14% | 0.93% | 0.84% |
| Number of salaries quoted | 193 | 216 | 186 |
| 10th Percentile | £52,500 | £50,000 | £47,500 |
| 25th Percentile | £58,750 | £62,500 | £53,813 |
| Median annual salary (50th Percentile) | £70,000 | £80,000 | £70,000 |
| Median % change year-on-year | -12.50% | +14.29% | +7.69% |
| 75th Percentile | £90,000 | £105,000 | £80,000 |
| 90th Percentile | £100,000 | £160,000 | £82,500 |
| UK excluding London median annual salary | £80,000 | £65,000 | £55,000 |
| % change year-on-year | +23.08% | +18.18% | -4.35% |
All Software Libraries and Frameworks
UK
PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for technical specification, industry standards, software libraries and framework skills.
| Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills | 21,317 | 29,159 | 68,887 |
| As % of all permanent jobs advertised in the UK | 20.77% | 29.95% | 41.26% |
| Number of salaries quoted | 15,893 | 18,093 | 29,995 |
| 10th Percentile | £36,250 | £40,500 | £37,500 |
| 25th Percentile | £45,000 | £51,000 | £47,500 |
| Median annual salary (50th Percentile) | £60,000 | £67,500 | £65,000 |
| Median % change year-on-year | -11.11% | +3.85% | +18.18% |
| 75th Percentile | £78,750 | £87,500 | £82,500 |
| 90th Percentile | £100,000 | £106,250 | £100,000 |
| UK excluding London median annual salary | £55,000 | £57,500 | £55,000 |
| % change year-on-year | -4.35% | +4.55% | +10.00% |
PySpark
Job Vacancy Trend
Job postings citing PySpark as a proportion of all IT jobs advertised.
PySpark
Salary Trend
3-month moving average salary quoted in jobs citing PySpark.
PySpark
Salary Histogram
Salary distribution for jobs citing PySpark over the 6 months to 28 May 2024.
PySpark
Top 15 Job Locations
The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the UK over the 6 months to 28 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.
| Location | Rank Change on Same Period Last Year |
Matching Permanent IT Job Ads |
Median Salary Past 6 Months |
Median Salary % Change on Same Period Last Year |
Live Jobs |
|---|---|---|---|---|---|
| England | +76 | 261 | £70,000 | -12.82% | 67 |
| UK excluding London | +125 | 248 | £80,000 | +23.08% | 36 |
| London | +158 | 189 | £70,000 | -24.32% | 36 |
| Scotland | +88 | 175 | £65,000 | -3.70% | 7 |
| Work from Home | +87 | 159 | £70,000 | -17.65% | 32 |
| North of England | +68 | 43 | £85,000 | +30.77% | 6 |
| North West | +36 | 37 | £85,000 | +6.25% | 4 |
| Midlands | +2 | 14 | £62,500 | +13.64% | 8 |
| West Midlands | +18 | 10 | £62,500 | +25.00% | 3 |
| South West | -28 | 10 | £55,000 | -32.31% | 5 |
| Yorkshire | +72 | 6 | £80,000 | +64.10% | 2 |
| East Midlands | -16 | 4 | - | - | 5 |
| Northern Ireland | - | 3 | £60,000 | - | 2 |
| South East | -30 | 2 | £40,000 | -37.25% | 8 |
| East of England | -6 | 1 | £55,000 | - | 1 |
PySpark
Co-occurring Skills and Capabilities by Category
The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||