PySpark Contracts in the UK excluding London

PySpark - Spark Python API
UK > UK excluding London

The table below provides summary statistics for contract job vacancies advertised in the UK excluding London requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 31 May 2025, comparing them to the same period in the previous two years.

6 months to
31 May 2025
Same period 2024 Same period 2023
Rank 284 344 376
Rank change year-on-year +60 +32 +53
Contract jobs citing PySpark 59 53 54
As % of all contract jobs advertised in the UK excluding London 0.45% 0.26% 0.24%
As % of the Libraries, Frameworks & Software Standards category 2.43% 1.59% 1.31%
Number of daily rates quoted 40 39 37
10th Percentile £321 £363 £470
25th Percentile £361 £438 £513
Median daily rate (50th Percentile) £469 £500 £600
Median % change year-on-year -6.25% -16.67% +9.09%
75th Percentile £513 £525 £650
90th Percentile £679 £600 £705
UK median daily rate £575 £525 £600
% change year-on-year +9.52% -12.50% +1.69%
Number of hourly rates quoted 0 4 0
Median hourly rate - £18.14 -
UK median hourly rate - £20.74 -

All Software Libraries and Frameworks
UK excluding London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in the UK excluding London.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 2,425 3,325 4,129
As % of all contract IT jobs advertised in the UK excluding London 18.61% 16.05% 18.12%
Number of daily rates quoted 1,682 2,176 3,071
10th Percentile £325 £325 £350
25th Percentile £400 £406 £425
Median daily rate (50th Percentile) £475 £500 £500
Median % change year-on-year -5.00% - -
75th Percentile £571 £608 £600
90th Percentile £638 £694 £688
UK median daily rate £521 £535 £550
% change year-on-year -2.62% -2.73% -
Number of hourly rates quoted 89 217 86
10th Percentile £33.59 £22.65 £22.20
25th Percentile £50.00 £43.00 £52.50
Median hourly rate £65.00 £48.43 £65.00
Median % change year-on-year +34.21% -25.49% +18.18%
75th Percentile £68.75 £68.00 £75.00
90th Percentile £81.01 £74.46 £79.19
UK median hourly rate £62.50 £47.97 £65.00
% change year-on-year +30.30% -26.21% +23.81%

PySpark
Job Vacancy Trend in the UK excluding London

Job postings citing PySpark as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for PySpark in the UK excluding London

PySpark
Contractor Daily Rate Trend in the UK excluding London

3-month moving average daily rate quoted in jobs citing PySpark in the UK excluding London.

Daily rate trend for PySpark in the UK excluding London

PySpark
Daily Rate Histogram in the UK excluding London

Daily rate distribution for jobs citing PySpark in the UK excluding London over the 6 months to 31 May 2025.

Daily rate histogram for PySpark in the UK excluding London

PySpark
Contractor Hourly Rate Trend in the UK excluding London

3-month moving average hourly rates quoted in jobs citing PySpark in the UK excluding London.

Hourly rate trend for PySpark in the UK excluding London

PySpark
Contract Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the UK excluding London region over the 6 months to 31 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
North of England +29 24 £481 -1.79% 26
North West +15 14 £475 - 17
Scotland -2 11 £444 -11.25% 6
South East +46 9 £465 +24.00% 16
Yorkshire +18 8 £488 -0.51% 8
Midlands +18 7 £475 -20.83% 9
West Midlands +17 6 £500 -16.67% 4
East of England - 6 £318 - 1
North East - 2 - - 1
South West +40 1 £425 -8.11% 16
Wales -2 1 £675 +104.55% 2
East Midlands - 1 £475 - 5
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 15 (25.42%) Apache
2 13 (22.03%) Apache Airflow
3 11 (18.64%) Apache Spark
4 2 (3.39%) Jupyter
4 2 (3.39%) SharePoint
Cloud Services
1 27 (45.76%) Azure
2 17 (28.81%) AWS
3 10 (16.95%) GCP
4 8 (13.56%) Amazon S3
4 8 (13.56%) GitHub
5 6 (10.17%) Azure Data Factory
5 6 (10.17%) Power Platform
6 5 (8.47%) AWS Lambda
6 5 (8.47%) Serverless
7 4 (6.78%) Azure DevOps
7 4 (6.78%) Azure Synapse Analytics
8 3 (5.08%) Amazon EC2
8 3 (5.08%) Amazon EMR
8 3 (5.08%) dbt
8 3 (5.08%) Snowflake
8 3 (5.08%) Vertex AI
9 2 (3.39%) Amazon SQS
10 1 (1.69%) Azure AI
10 1 (1.69%) GitHub Actions
10 1 (1.69%) Microsoft Purview
Communications & Networking
1 2 (3.39%) SMS
Database & Business Intelligence
1 13 (22.03%) Data Warehouse
1 13 (22.03%) Hadoop
2 8 (13.56%) Big Data
2 8 (13.56%) Metadata
3 7 (11.86%) Amazon Redshift
3 7 (11.86%) MongoDB
3 7 (11.86%) MySQL
4 6 (10.17%) Apache Hive
4 6 (10.17%) Data Lake
4 6 (10.17%) Delta Lake
4 6 (10.17%) PostgreSQL
4 6 (10.17%) Power BI
5 5 (8.47%) Spark SQL
5 5 (8.47%) Tableau
6 4 (6.78%) BigQuery
7 3 (5.08%) Azure SQL Database
7 3 (5.08%) Looker
7 3 (5.08%) Relational Database
8 2 (3.39%) Metadata Repository
9 1 (1.69%) Elasticsearch
Development Applications
1 12 (20.34%) Git
2 4 (6.78%) GitLab
3 2 (3.39%) Jenkins
4 1 (1.69%) Bitbucket
4 1 (1.69%) SonarQube
General
1 12 (20.34%) Social Skills
2 9 (15.25%) Public Sector
3 7 (11.86%) Finance
4 6 (10.17%) Analytical Skills
5 3 (5.08%) Banking
5 3 (5.08%) Tech for Good
6 2 (3.39%) Automotive
6 2 (3.39%) Financial Institution
6 2 (3.39%) Health Technology
6 2 (3.39%) Investment Banking
6 2 (3.39%) Retail
7 1 (1.69%) Advertising
7 1 (1.69%) Legal
7 1 (1.69%) Telecoms
Job Titles
1 37 (62.71%) Data Engineer
2 12 (20.34%) Developer
3 8 (13.56%) Python Engineer
3 8 (13.56%) Senior
4 7 (11.86%) Python Data Engineer
4 7 (11.86%) Senior Data Engineer
5 5 (8.47%) Lead
5 5 (8.47%) Python Developer
6 3 (5.08%) Artificial Intelligence Engineer
6 3 (5.08%) Azure Data Engineer
6 3 (5.08%) Azure Engineer
7 2 (3.39%) Architect
7 2 (3.39%) Big Data Developer
7 2 (3.39%) Cloud Engineer
7 2 (3.39%) Data Scientist
7 2 (3.39%) GCP Data Engineer
7 2 (3.39%) GCP Engineer
7 2 (3.39%) Hadoop Developer
8 1 (1.69%) AWS Data Engineer
8 1 (1.69%) Lead Data Engineer
Libraries, Frameworks & Software Standards
1 12 (20.34%) Kafka
2 7 (11.86%) Pandas
3 6 (10.17%) React
4 5 (8.47%) Apache NiFi
5 4 (6.78%) AngularJS
6 3 (5.08%) ADO
6 3 (5.08%) NumPy
7 2 (3.39%) Anaconda
7 2 (3.39%) JDBC
7 2 (3.39%) Node.js
7 2 (3.39%) Spring
7 2 (3.39%) Spring Boot
7 2 (3.39%) YAML
8 1 (1.69%) Great Expectations
8 1 (1.69%) Keycloak
8 1 (1.69%) LangChain
8 1 (1.69%) LAPP Stack
8 1 (1.69%) scikit-learn
Miscellaneous
1 6 (10.17%) Cloud Native
2 4 (6.78%) Hybrid Cloud
3 3 (5.08%) Data Protection Act
3 3 (5.08%) Data Structures
3 3 (5.08%) Onboarding
3 3 (5.08%) Renewable Energy
4 2 (3.39%) NHS
5 1 (1.69%) Algorithms
5 1 (1.69%) Data Centre
5 1 (1.69%) Distributed Computing
5 1 (1.69%) Enterprise Cloud
5 1 (1.69%) Legacy Systems
5 1 (1.69%) Linux Command Line
Operating Systems
1 3 (5.08%) Unix
2 1 (1.69%) Linux
Processes & Methodologies
1 25 (42.37%) Data Engineering
1 25 (42.37%) Data Pipeline
1 25 (42.37%) ETL
2 20 (33.90%) CI/CD
3 13 (22.03%) Data Integration
3 13 (22.03%) Problem-Solving
4 12 (20.34%) Analytics
5 11 (18.64%) Workflow
6 10 (16.95%) Data Security
6 10 (16.95%) Decision-Making
7 9 (15.25%) Data Ingestion
7 9 (15.25%) Machine Learning
8 8 (13.56%) Artificial Intelligence
8 8 (13.56%) Data Science
8 8 (13.56%) DataOps
9 7 (11.86%) Agile
9 7 (11.86%) Business Intelligence
9 7 (11.86%) Data Modelling
9 7 (11.86%) Technical Architecture
9 7 (11.86%) Visualisation
Programming Languages
1 51 (86.44%) Python
2 32 (54.24%) SQL
3 8 (13.56%) Java
4 5 (8.47%) TypeScript
5 3 (5.08%) JavaScript
6 1 (1.69%) Bash
Qualifications
1 13 (22.03%) Security Cleared
2 8 (13.56%) SC Cleared
3 5 (8.47%) BPSS Clearance
4 2 (3.39%) Azure Certification
5 1 (1.69%) Computer Science Degree
5 1 (1.69%) Degree
5 1 (1.69%) DV Cleared
Quality Assurance & Compliance
1 10 (16.95%) Data Quality
2 5 (8.47%) Accessibility
2 5 (8.47%) GDPR
3 1 (1.69%) QA
System Software
1 9 (15.25%) Docker
2 1 (1.69%) Apache ZooKeeper
Systems Management
1 9 (15.25%) Terraform
2 7 (11.86%) Kubernetes
3 1 (1.69%) Ansible
3 1 (1.69%) Progress Chef
3 1 (1.69%) Puppet
Vendors
1 12 (20.34%) Databricks
2 6 (10.17%) Microsoft
3 4 (6.78%) Foundry
4 3 (5.08%) Cloudera
4 3 (5.08%) Palantir
5 2 (3.39%) Brio
5 2 (3.39%) Google
6 1 (1.69%) Checkmarx
6 1 (1.69%) Confluent
6 1 (1.69%) Dynatrace
6 1 (1.69%) IBM
6 1 (1.69%) Informatica
6 1 (1.69%) MuleSoft
6 1 (1.69%) Oracle
6 1 (1.69%) Salesforce
6 1 (1.69%) StreamSets
6 1 (1.69%) Virgin Media