PySpark - Spark Python API
UK
The table below provides summary statistics for contract job vacancies requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 6 May 2025, comparing them to the same period in the previous two years.
| 6 months to 6 May 2025 |
Same period 2024 | Same period 2023 | |
|---|---|---|---|
| Rank | 269 | 383 | 454 |
| Rank change year-on-year | +114 | +71 | +32 |
| Contract jobs citing PySpark | 283 | 218 | 272 |
| As % of all contract jobs advertised in the UK | 0.96% | 0.51% | 0.46% |
| As % of the Libraries, Frameworks & Software Standards category | 4.24% | 2.45% | 1.98% |
| Number of daily rates quoted | 199 | 169 | 183 |
| 10th Percentile | £381 | £423 | £458 |
| 25th Percentile | £475 | £475 | £513 |
| Median daily rate (50th Percentile) | £600 | £550 | £600 |
| Median % change year-on-year | +9.09% | -8.33% | - |
| 75th Percentile | £838 | £626 | £709 |
| 90th Percentile | £875 | £763 | £880 |
| UK excluding London median daily rate | £469 | £500 | £600 |
| % change year-on-year | -6.25% | -16.67% | +7.62% |
| Number of hourly rates quoted | 5 | 5 | 3 |
| 10th Percentile | £20.57 | £15.45 | £37.50 |
| 25th Percentile | £21.25 | £15.81 | £39.75 |
| Median hourly rate | £22.00 | £20.47 | £43.50 |
| Median % change year-on-year | +7.47% | -52.94% | -44.76% |
| 75th Percentile | £65.00 | £21.50 | £43.57 |
| 90th Percentile | - | £22.85 | £43.60 |
| UK excluding London median hourly rate | £21.12 | £18.14 | £39.75 |
| % change year-on-year | +16.41% | -54.36% | - |
All Software Libraries and Frameworks
UK
PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills.
| Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills | 6,670 | 8,884 | 13,739 |
| As % of all contract IT jobs advertised in the UK | 22.74% | 20.58% | 23.26% |
| Number of daily rates quoted | 4,578 | 6,170 | 10,017 |
| 10th Percentile | £363 | £338 | £400 |
| 25th Percentile | £425 | £425 | £463 |
| Median daily rate (50th Percentile) | £525 | £525 | £550 |
| Median % change year-on-year | - | -4.55% | - |
| 75th Percentile | £650 | £650 | £675 |
| 90th Percentile | £782 | £775 | £775 |
| UK excluding London median daily rate | £490 | £500 | £500 |
| % change year-on-year | -2.00% | - | - |
| Number of hourly rates quoted | 114 | 238 | 152 |
| 10th Percentile | £27.22 | £21.25 | £31.18 |
| 25th Percentile | £50.00 | £40.08 | £50.00 |
| Median hourly rate | £65.00 | £46.84 | £65.00 |
| Median % change year-on-year | +38.77% | -27.94% | +30.65% |
| 75th Percentile | £68.56 | £65.00 | £75.00 |
| 90th Percentile | £82.70 | £74.61 | £81.00 |
| UK excluding London median hourly rate | £65.00 | £47.50 | £63.25 |
| % change year-on-year | +36.84% | -24.90% | +28.43% |
PySpark
Job Vacancy Trend
Job postings citing PySpark as a proportion of all IT jobs advertised.
PySpark
Contractor Daily Rate Trend
3-month moving average daily rate quoted in jobs citing PySpark.
PySpark
Daily Rate Histogram
Daily rate distribution for jobs citing PySpark over the 6 months to 6 May 2025.
PySpark
Contractor Hourly Rate Trend
3-month moving average hourly rates quoted in jobs citing PySpark.
PySpark
Hourly Rate Histogram
Hourly rate distribution of jobs citing PySpark over the 6 months to 6 May 2025.
PySpark
Top 16 Contract Locations
The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the UK over the 6 months to 6 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.
| Location | Rank Change on Same Period Last Year |
Matching Contract IT Job Ads |
Median Daily Rate Past 6 Months |
Median Daily Rate % Change on Same Period Last Year |
Live Jobs |
|---|---|---|---|---|---|
| England | +115 | 246 | £700 | +27.27% | 137 |
| London | +66 | 178 | £775 | +40.91% | 77 |
| Work from Home | +96 | 124 | £775 | +55.00% | 93 |
| UK excluding London | +75 | 74 | £469 | -6.25% | 82 |
| North of England | +34 | 26 | £475 | -3.06% | 20 |
| South East | +48 | 18 | £505 | +3.59% | 21 |
| Scotland | +8 | 14 | £463 | -7.50% | 12 |
| North West | +19 | 13 | £488 | +5.41% | 11 |
| Midlands | +25 | 9 | £475 | -20.83% | 6 |
| West Midlands | +20 | 8 | £495 | -17.50% | 2 |
| North East | - | 7 | £358 | - | 3 |
| East of England | +32 | 6 | £318 | - | 2 |
| Yorkshire | +21 | 6 | £550 | +12.24% | 6 |
| Wales | +6 | 3 | £675 | +104.55% | 3 |
| South West | +28 | 1 | £250 | -47.37% | 18 |
| East Midlands | - | 1 | £475 | - | 4 |
PySpark
Co-occurring Skills and Capabilities by Category
The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||