PySpark Contracts in Scotland

PySpark - Spark Python API
UK > Scotland

The table below provides summary statistics for contract job vacancies advertised in Scotland requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 102 114 158
Rank change year-on-year +12 +44 +10
Contract jobs citing PySpark 14 15 5
As % of all contract jobs advertised in Scotland 0.86% 0.68% 0.17%
As % of the Libraries, Frameworks & Software Standards category 3.63% 3.21% 0.72%
Number of daily rates quoted 7 11 3
10th Percentile - - £503
25th Percentile £413 £475 £506
Median daily rate (50th Percentile) £463 £500 £525
Median % change year-on-year -7.50% -4.76% -13.58%
75th Percentile £475 - £575
90th Percentile £480 - £598
UK median daily rate £600 £533 £600
% change year-on-year +12.68% -11.25% -

All Software Libraries and Frameworks
Scotland

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in Scotland.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 386 467 691
As % of all contract IT jobs advertised in Scotland 23.75% 21.06% 24.14%
Number of daily rates quoted 270 302 527
10th Percentile £348 £328 £406
25th Percentile £408 £411 £438
Median daily rate (50th Percentile) £471 £475 £488
Median % change year-on-year -0.95% -2.56% +2.63%
75th Percentile £538 £575 £549
90th Percentile £600 £675 £650
UK median daily rate £525 £530 £550
% change year-on-year -0.94% -3.64% -
Number of hourly rates quoted 0 4 3
10th Percentile - £33.58 £49.99
25th Percentile - £44.94 £53.38
Median hourly rate - £53.75 £59.03
Median % change year-on-year - -8.94% +24.93%
75th Percentile - £57.50 £64.52
90th Percentile - - £67.81
UK median hourly rate £65.00 £46.18 £65.00
% change year-on-year +40.75% -28.95% +32.65%

PySpark
Job Vacancy Trend in Scotland

Job postings citing PySpark as a proportion of all IT jobs advertised in Scotland.

Job vacancy trend for PySpark in Scotland

PySpark
Contractor Daily Rate Trend in Scotland

3-month moving average daily rate quoted in jobs citing PySpark in Scotland.

Daily rate trend for PySpark in Scotland

PySpark
Contract Job Locations in Scotland

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the Scotland region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Edinburgh +11 7 £425 - 7
Glasgow -4 7 £475 -5.00% 6
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in Scotland by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (21.43%) Apache Spark
2 2 (14.29%) Apache Airflow
3 1 (7.14%) Apache
Cloud Services
1 7 (50.00%) Azure
2 6 (42.86%) AWS
3 5 (35.71%) Azure Synapse Analytics
3 5 (35.71%) GitHub
4 2 (14.29%) Amazon S3
4 2 (14.29%) GCP
4 2 (14.29%) Snowflake
5 1 (7.14%) Amazon EC2
5 1 (7.14%) Amazon EMR
5 1 (7.14%) AWS CloudFormation
5 1 (7.14%) AWS Step Functions
Database & Business Intelligence
1 3 (21.43%) Amazon Redshift
2 2 (14.29%) Big Data
2 2 (14.29%) Hadoop
3 1 (7.14%) Apache Hive
3 1 (7.14%) Data Warehouse
3 1 (7.14%) DB2
3 1 (7.14%) Delta Lake
3 1 (7.14%) MongoDB
3 1 (7.14%) Relational Database
Development Applications
1 2 (14.29%) GitLab
2 1 (7.14%) Bitbucket
2 1 (7.14%) Git
2 1 (7.14%) Jenkins
General
1 4 (28.57%) Finance
2 2 (14.29%) Financial Institution
2 2 (14.29%) Tech for Good
3 1 (7.14%) Banking
3 1 (7.14%) Retail
3 1 (7.14%) Retail Banking
3 1 (7.14%) Social Skills
Job Titles
1 11 (78.57%) Data Engineer
2 4 (28.57%) Azure Data Engineer
2 4 (28.57%) Azure Engineer
3 3 (21.43%) Python Data Engineer
3 3 (21.43%) Python Engineer
4 2 (14.29%) Developer
4 2 (14.29%) Python Developer
5 1 (7.14%) Architect
5 1 (7.14%) AWS Data Engineer
5 1 (7.14%) AWS Engineer
5 1 (7.14%) Azure Architect
5 1 (7.14%) Azure Data Architect
5 1 (7.14%) Data Architect
5 1 (7.14%) Data Scientist
5 1 (7.14%) Environment Manager
5 1 (7.14%) Open Source Engineer
5 1 (7.14%) Senior
5 1 (7.14%) Senior Data Engineer
5 1 (7.14%) Snowflake Data Engineer
5 1 (7.14%) Snowflake Engineer
Libraries, Frameworks & Software Standards
1 1 (7.14%) Great Expectations
1 1 (7.14%) Kafka
1 1 (7.14%) Pandas
Miscellaneous
1 2 (14.29%) Renewable Energy
2 1 (7.14%) Data Protection Act
2 1 (7.14%) Enterprise Cloud
Processes & Methodologies
1 10 (71.43%) CI/CD
2 6 (42.86%) ETL
3 5 (35.71%) Cloud Security
3 5 (35.71%) Data Engineering
3 5 (35.71%) Data Transformation
4 4 (28.57%) Decision-Making
5 3 (21.43%) Agile
5 3 (21.43%) Continuous Integration
5 3 (21.43%) Observability
6 2 (14.29%) Analytics
6 2 (14.29%) Continuous Deployment
6 2 (14.29%) Data Pipeline
6 2 (14.29%) Operational Stability
6 2 (14.29%) Problem-Solving
6 2 (14.29%) SDLC
6 2 (14.29%) Test Automation
6 2 (14.29%) Validation
7 1 (7.14%) Performance Optimisation
7 1 (7.14%) Scaled Agile Framework
7 1 (7.14%) Translating Business Requirements
Programming Languages
1 11 (78.57%) SQL
2 9 (64.29%) Python
3 1 (7.14%) Java
Quality Assurance & Compliance
1 2 (14.29%) Data Quality
2 1 (7.14%) QA
System Software
1 1 (7.14%) Docker
Systems Management
1 1 (7.14%) Terraform
Vendors
1 1 (7.14%) Confluent
1 1 (7.14%) IBM
1 1 (7.14%) Informatica
1 1 (7.14%) Oracle
1 1 (7.14%) StreamSets