PySpark Contracts in Edinburgh

PySpark - Spark Python API
Scotland > Edinburgh

The table below provides summary statistics for contract job vacancies advertised in Edinburgh requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 60 71 107
Rank change year-on-year +11 +36 +21
Contract jobs citing PySpark 7 1 5
As % of all contract jobs advertised in Edinburgh 1.12% 0.12% 0.38%
As % of the Libraries, Frameworks & Software Standards category 4.90% 0.55% 1.30%
Number of daily rates quoted 5 0 3
10th Percentile - - £503
25th Percentile £413 - £506
Median daily rate (50th Percentile) £425 - £525
Median % change year-on-year - - -13.58%
75th Percentile £469 - £575
90th Percentile £480 - £598
Scotland median daily rate £463 £500 £525
% change year-on-year -7.50% -4.76% -13.58%

All Software Libraries and Frameworks
Edinburgh

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in Edinburgh.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 143 182 386
As % of all contract IT jobs advertised in Edinburgh 22.88% 22.33% 29.62%
Number of daily rates quoted 110 121 319
10th Percentile £400 £363 £406
25th Percentile £417 £430 £438
Median daily rate (50th Percentile) £488 £480 £488
Median % change year-on-year +1.72% -1.54% -2.50%
75th Percentile £529 £619 £538
90th Percentile £600 £700 £613
Scotland median daily rate £471 £475 £488
% change year-on-year -0.95% -2.56% +2.63%
Number of hourly rates quoted 0 1 0
Median hourly rate - £26.00 -
Scotland median hourly rate - £53.75 £59.03
% change year-on-year - -8.94% +24.93%

PySpark
Job Vacancy Trend in Edinburgh

Job postings citing PySpark as a proportion of all IT jobs advertised in Edinburgh.

Job vacancy trend for PySpark in Edinburgh

PySpark
Contractor Daily Rate Trend in Edinburgh

3-month moving average daily rate quoted in jobs citing PySpark in Edinburgh.

Daily rate trend for PySpark in Edinburgh

PySpark
Co-occurring Skills and Capabilities in Edinburgh by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (42.86%) Apache Spark
2 2 (28.57%) Apache Airflow
3 1 (14.29%) Apache
Cloud Services
1 6 (85.71%) AWS
2 2 (28.57%) Amazon S3
2 2 (28.57%) Azure
2 2 (28.57%) GCP
2 2 (28.57%) Snowflake
3 1 (14.29%) Amazon EC2
3 1 (14.29%) Amazon EMR
3 1 (14.29%) AWS CloudFormation
3 1 (14.29%) AWS Step Functions
Database & Business Intelligence
1 3 (42.86%) Amazon Redshift
2 2 (28.57%) Big Data
2 2 (28.57%) Hadoop
3 1 (14.29%) Apache Hive
3 1 (14.29%) Data Warehouse
3 1 (14.29%) DB2
3 1 (14.29%) Delta Lake
3 1 (14.29%) MongoDB
3 1 (14.29%) Relational Database
Development Applications
1 2 (28.57%) GitLab
2 1 (14.29%) Bitbucket
2 1 (14.29%) Git
2 1 (14.29%) Jenkins
General
1 2 (28.57%) Finance
1 2 (28.57%) Tech for Good
2 1 (14.29%) Banking
2 1 (14.29%) Retail
2 1 (14.29%) Retail Banking
2 1 (14.29%) Social Skills
Job Titles
1 5 (71.43%) Data Engineer
2 1 (14.29%) AWS Data Engineer
2 1 (14.29%) AWS Engineer
2 1 (14.29%) Data Scientist
2 1 (14.29%) Environment Manager
2 1 (14.29%) Open Source Engineer
2 1 (14.29%) Python Data Engineer
2 1 (14.29%) Python Engineer
2 1 (14.29%) Senior
2 1 (14.29%) Senior Data Engineer
2 1 (14.29%) Snowflake Data Engineer
2 1 (14.29%) Snowflake Engineer
Libraries, Frameworks & Software Standards
1 1 (14.29%) Great Expectations
1 1 (14.29%) Kafka
1 1 (14.29%) Pandas
Miscellaneous
1 2 (28.57%) Renewable Energy
2 1 (14.29%) Data Protection Act
2 1 (14.29%) Enterprise Cloud
Processes & Methodologies
1 5 (71.43%) Data Engineering
2 4 (57.14%) Decision-Making
3 3 (42.86%) CI/CD
3 3 (42.86%) Observability
4 2 (28.57%) Analytics
4 2 (28.57%) Data Pipeline
4 2 (28.57%) ETL
4 2 (28.57%) Problem-Solving
4 2 (28.57%) Test Automation
4 2 (28.57%) Validation
5 1 (14.29%) Agile
5 1 (14.29%) Continuous Integration
5 1 (14.29%) Data Analysis
5 1 (14.29%) Data Extraction
5 1 (14.29%) Data Migration
5 1 (14.29%) Data Protection
5 1 (14.29%) Data Validation
5 1 (14.29%) Migration
5 1 (14.29%) Quality Management
5 1 (14.29%) Workflow
Programming Languages
1 7 (100.00%) Python
2 6 (85.71%) SQL
3 1 (14.29%) Java
Quality Assurance & Compliance
1 2 (28.57%) Data Quality
2 1 (14.29%) QA
System Software
1 1 (14.29%) Docker
Systems Management
1 1 (14.29%) Terraform
Vendors
1 1 (14.29%) Confluent
1 1 (14.29%) IBM
1 1 (14.29%) Informatica
1 1 (14.29%) Oracle
1 1 (14.29%) StreamSets