Period
to 6 April 2020

The following table provides summary statistics for contract job vacancies advertised in Hampshire with a requirement for PySpark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited PySpark over the 6 months to 6 April 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

PySpark - Spark Python API
South East > Hampshire
6 months to
6 Apr 2020
Same period 2019 Same period 2018
Rank 108 165 173
Rank change year-on-year +57 +8 -
Contract jobs citing PySpark 19 21 4
As % of all contract jobs advertised in Hampshire 0.79% 0.55% 0.11%
As % of the Libraries, Frameworks & Software Standards category 3.85% 1.72% 0.47%
Number of daily rates quoted 20 17 3
Median daily rate £595 £525 £600
Median daily rate % change year-on-year +13.33% -12.50% -
10th Percentile £513 £448 £565
90th Percentile £675 £580 £625
South East median daily rate £595 £525 £550
% change year-on-year +13.33% -4.55% -
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
South East median hourly rate - - -

PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Hampshire with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
Hampshire
Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 493 1,220 857
As % of all contract IT jobs advertised in Hampshire 20.49% 31.78% 23.06%
Number of daily rates quoted 279 823 502
Median daily rate £475 £450 £400
Median daily rate % change year-on-year +5.56% +12.50% -
10th Percentile £346 £330 £313
90th Percentile £588 £575 £538
South East median daily rate £450 £450 £425
% change year-on-year - +5.88% +6.25%
Number of hourly rates quoted 25 31 26
Median hourly rate £42.50 £50.00 £45.00
Median hourly rate % change year-on-year -15.00% +11.11% +3.45%
10th Percentile £32.75 £25.41 £24.81
90th Percentile £53.25 £57.50 £80.73
Median hourly rate £42.50 £47.50 £45.00
% change year-on-year -10.53% +5.56% +5.26%

PySpark
Job Vacancy Trend in Hampshire

Job postings citing PySpark as a proportion of all IT jobs advertised in Hampshire.

Job vacancy trend for PySpark in Hampshire

PySpark
Contractor Daily Rate Trend in Hampshire

3-month moving average daily rate quoted in jobs citing PySpark in Hampshire.

Daily rate trend for PySpark in Hampshire

PySpark
Daily Rate Histogram in Hampshire

Daily rate distribution for jobs citing PySpark in Hampshire over the 6 months to 6 April 2020.

Daily rate histogram for PySpark in Hampshire

PySpark
Contract Job Locations in Hampshire

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the Hampshire region over the 6 months to 6 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Havant - 8 £600 -
Southampton +7 3 £550 +4.76%
Portsmouth +7 1 £585 +11.43%
PySpark
South East

For the 6 months to 6 April 2020, IT contractor jobs citing PySpark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Hampshire region with a requirement for PySpark.

1 19 (100.00%) Python
1 19 (100.00%) Data Science
2 18 (94.74%) Jupyter
2 18 (94.74%) NumPy
2 18 (94.74%) Pandas
3 17 (89.47%) Visualisation
3 17 (89.47%) Keras
3 17 (89.47%) TensorFlow
4 16 (84.21%) Machine Learning
4 16 (84.21%) Artificial Intelligence
5 15 (78.95%) Git (software)
5 15 (78.95%) Deep Learning
5 15 (78.95%) Data Visualisation
6 14 (73.68%) PaaS
6 14 (73.68%) Tableau
7 13 (68.42%) Azure
7 13 (68.42%) Analytics
7 13 (68.42%) SQL
7 13 (68.42%) Apache
7 13 (68.42%) Agile Software Development
7 13 (68.42%) Apache Spark
8 12 (63.16%) scikit-learn
8 12 (63.16%) Azure Machine Learning
8 12 (63.16%) Geospatial Data
8 12 (63.16%) Degree
8 12 (63.16%) Mathematics
8 12 (63.16%) Physics
8 12 (63.16%) Computer Science
9 11 (57.89%) GIS
9 11 (57.89%) NoSQL

PySpark
Co-occurring IT Skills in Hampshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 18 (94.74%) Jupyter
2 13 (68.42%) Apache
2 13 (68.42%) Apache Spark
3 1 (5.26%) Apache Airflow
Cloud Services
1 14 (73.68%) PaaS
2 13 (68.42%) Azure
3 12 (63.16%) Azure Machine Learning
4 1 (5.26%) AWS
4 1 (5.26%) GCP
Database & Business Intelligence
1 12 (63.16%) Geospatial Data
2 11 (57.89%) GIS
2 11 (57.89%) NoSQL
3 1 (5.26%) Big Data
3 1 (5.26%) QlikView
3 1 (5.26%) Spatial Data
Development Applications
1 15 (78.95%) Git (software)
General
1 1 (5.26%) Public Sector
Job Titles
1 18 (94.74%) Data Scientist
2 8 (42.11%) Senior Data Scientist
3 5 (26.32%) Machine Learning Scientist
4 1 (5.26%) Big Data Engineer
4 1 (5.26%) Data Engineer
4 1 (5.26%) Python Engineer
Libraries, Frameworks & Software Standards
1 18 (94.74%) NumPy
1 18 (94.74%) Pandas
2 17 (89.47%) Keras
2 17 (89.47%) TensorFlow
3 12 (63.16%) scikit-learn
Miscellaneous
1 10 (52.63%) Lidar
2 8 (42.11%) Smart City
Processes & Methodologies
1 19 (100.00%) Data Science
2 17 (89.47%) Visualisation
3 16 (84.21%) Artificial Intelligence
3 16 (84.21%) Machine Learning
4 15 (78.95%) Data Visualisation
4 15 (78.95%) Deep Learning
5 13 (68.42%) Agile Software Development
5 13 (68.42%) Analytics
6 12 (63.16%) Computer Science
6 12 (63.16%) Mathematics
6 12 (63.16%) Physics
7 11 (57.89%) Reinforcement Learning
8 10 (52.63%) DevOps
8 10 (52.63%) Telematics
9 9 (47.37%) Anomaly Detection
9 9 (47.37%) Data Engineering
9 9 (47.37%) Data Management
9 9 (47.37%) Portfolio Management
10 8 (42.11%) B2B
11 4 (21.05%) Stakeholder Management
Programming Languages
1 19 (100.00%) Python
2 13 (68.42%) SQL
Qualifications
1 12 (63.16%) Degree
2 10 (52.63%) Numerate Degree
2 10 (52.63%) PhD
3 9 (47.37%) Master's Degree
Vendors
1 14 (73.68%) Tableau
2 1 (5.26%) Google