PySpark Contracts in the UK excluding London

PySpark - Spark Python API
UK > UK excluding London

The table below provides summary statistics for contract job vacancies advertised in the UK excluding London requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 258 349 404
Rank change year-on-year +91 +55 +20
Contract jobs citing PySpark 78 50 58
As % of all contract jobs advertised in the UK excluding London 0.61% 0.24% 0.24%
As % of the Libraries, Frameworks & Software Standards category 3.28% 1.52% 1.32%
Number of daily rates quoted 44 31 39
10th Percentile £319 £375 £477
25th Percentile £361 £456 £513
Median daily rate (50th Percentile) £475 £500 £600
Median % change year-on-year -5.00% -16.67% +9.09%
75th Percentile £541 £525 £644
90th Percentile £701 £600 £700
UK median daily rate £600 £533 £600
% change year-on-year +12.68% -11.25% -
Number of hourly rates quoted 2 4 2
10th Percentile £20.31 £15.38 £36.75
25th Percentile £20.59 £15.66 £37.88
Median hourly rate £21.12 £18.14 £39.75
Median % change year-on-year +16.41% -54.36% -
75th Percentile £21.59 £21.29 £41.63
90th Percentile £21.84 £22.77 £42.75
UK median hourly rate £22.00 £20.47 £43.50
% change year-on-year +7.47% -52.94% -44.76%

All Software Libraries and Frameworks
UK excluding London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in the UK excluding London.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 2,378 3,296 4,407
As % of all contract IT jobs advertised in the UK excluding London 18.63% 15.87% 18.31%
Number of daily rates quoted 1,644 2,154 3,299
10th Percentile £350 £324 £357
25th Percentile £406 £406 £425
Median daily rate (50th Percentile) £490 £500 £500
Median % change year-on-year -2.00% - -
75th Percentile £575 £600 £600
90th Percentile £656 £688 £688
UK median daily rate £525 £530 £550
% change year-on-year -0.94% -3.64% -
Number of hourly rates quoted 83 198 91
10th Percentile £30.98 £21.59 £22.50
25th Percentile £56.25 £43.00 £50.00
Median hourly rate £65.00 £47.50 £64.00
Median % change year-on-year +36.84% -25.78% +30.61%
75th Percentile £68.75 £65.00 £74.13
90th Percentile £81.95 £75.00 £78.00
UK median hourly rate £65.00 £46.18 £65.00
% change year-on-year +40.75% -28.95% +32.65%

PySpark
Job Vacancy Trend in the UK excluding London

Job postings citing PySpark as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for PySpark in the UK excluding London

PySpark
Contractor Daily Rate Trend in the UK excluding London

3-month moving average daily rate quoted in jobs citing PySpark in the UK excluding London.

Daily rate trend for PySpark in the UK excluding London

PySpark
Daily Rate Histogram in the UK excluding London

Daily rate distribution for jobs citing PySpark in the UK excluding London over the 6 months to 1 May 2025.

Daily rate histogram for PySpark in the UK excluding London

PySpark
Contractor Hourly Rate Trend in the UK excluding London

3-month moving average hourly rates quoted in jobs citing PySpark in the UK excluding London.

Hourly rate trend for PySpark in the UK excluding London

PySpark
Contract Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the UK excluding London region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
North of England +35 25 £475 -3.06% 15
South East +62 22 £505 +3.59% 28
Scotland +12 14 £463 -7.50% 11
North West +25 13 £488 +5.41% 8
Midlands +27 9 £475 -20.83% 3
West Midlands +18 8 £495 -17.50% 2
North East - 7 £358 - 5
East of England +35 6 £318 - 1
Yorkshire +9 5 £600 +22.45% 2
Wales -1 4 £613 +85.61% 1
South West +38 1 £250 -47.37% 12
East Midlands - 1 £475 - 1
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 17 (21.79%) Apache Spark
2 14 (17.95%) Apache
3 12 (15.38%) Apache Airflow
4 2 (2.56%) Jupyter
4 2 (2.56%) SharePoint
Cloud Services
1 45 (57.69%) Azure
2 22 (28.21%) Azure Data Factory
3 14 (17.95%) AWS
4 12 (15.38%) Azure Synapse Analytics
5 10 (12.82%) GCP
6 9 (11.54%) GitHub
7 7 (8.97%) Azure DevOps
8 6 (7.69%) Amazon S3
8 6 (7.69%) Power Platform
9 3 (3.85%) Amazon EMR
9 3 (3.85%) dbt
9 3 (3.85%) Serverless
9 3 (3.85%) Snowflake
9 3 (3.85%) Vertex AI
10 2 (2.56%) Amazon SQS
10 2 (2.56%) AWS Lambda
10 2 (2.56%) Azure Storage
10 2 (2.56%) Cloud Computing
11 1 (1.28%) AWS Step Functions
11 1 (1.28%) Azure Key Vault
Communications & Networking
1 2 (2.56%) SMS
Database & Business Intelligence
1 15 (19.23%) Big Data
2 14 (17.95%) Hadoop
3 13 (16.67%) Data Lake
3 13 (16.67%) Data Warehouse
4 9 (11.54%) Azure SQL Database
4 9 (11.54%) Metadata
5 7 (8.97%) Apache Hive
6 6 (7.69%) Power BI
7 5 (6.41%) Amazon Redshift
7 5 (6.41%) Delta Lake
7 5 (6.41%) MongoDB
7 5 (6.41%) MySQL
7 5 (6.41%) Spark SQL
7 5 (6.41%) Tableau
8 4 (5.13%) BigQuery
8 4 (5.13%) PostgreSQL
8 4 (5.13%) SQL Server
9 3 (3.85%) Looker
9 3 (3.85%) Relational Database
10 2 (2.56%) Microsoft Analysis Services
Development Applications
1 10 (12.82%) Git
2 4 (5.13%) GitLab
2 4 (5.13%) SpecFlow
3 2 (2.56%) Jenkins
4 1 (1.28%) Bitbucket
4 1 (1.28%) JIRA
4 1 (1.28%) SonarQube
General
1 14 (17.95%) Social Skills
2 10 (12.82%) Finance
2 10 (12.82%) Public Sector
3 9 (11.54%) Analytical Skills
4 4 (5.13%) Telecoms
5 3 (3.85%) Banking
5 3 (3.85%) Electronics
5 3 (3.85%) Manufacturing
5 3 (3.85%) Marketing
5 3 (3.85%) Tech for Good
6 2 (2.56%) Automotive
6 2 (2.56%) Financial Institution
6 2 (2.56%) Investment Banking
7 1 (1.28%) Advertising
7 1 (1.28%) Legal
7 1 (1.28%) Presentation Skills
7 1 (1.28%) Retail
7 1 (1.28%) Retail Banking
Job Titles
1 50 (64.10%) Data Engineer
2 11 (14.10%) Senior
3 10 (12.82%) Developer
4 9 (11.54%) Azure Engineer
4 9 (11.54%) Python Engineer
4 9 (11.54%) Senior Data Engineer
5 8 (10.26%) Python Data Engineer
6 6 (7.69%) Azure Data Engineer
7 5 (6.41%) Data Scientist
8 4 (5.13%) Lead
8 4 (5.13%) Python Developer
9 3 (3.85%) Architect
9 3 (3.85%) Artificial Intelligence Engineer
9 3 (3.85%) Test Engineer
9 3 (3.85%) Tester
10 2 (2.56%) Azure Architect
10 2 (2.56%) Azure Specialist
10 2 (2.56%) Cloud Engineer
10 2 (2.56%) Hadoop Developer
10 2 (2.56%) Microsoft Engineer
Libraries, Frameworks & Software Standards
1 13 (16.67%) Kafka
2 7 (8.97%) Pandas
3 5 (6.41%) Apache NiFi
4 4 (5.13%) AngularJS
4 4 (5.13%) React
5 3 (3.85%) ADO
5 3 (3.85%) Gherkin
5 3 (3.85%) NumPy
6 2 (2.56%) Anaconda
6 2 (2.56%) JDBC
6 2 (2.56%) Spring
6 2 (2.56%) Spring Boot
6 2 (2.56%) YAML
7 1 (1.28%) ARM Templates
7 1 (1.28%) Great Expectations
7 1 (1.28%) Keycloak
7 1 (1.28%) LangChain
7 1 (1.28%) LAPP Stack
7 1 (1.28%) scikit-learn
Miscellaneous
1 6 (7.69%) Cloud Native
2 4 (5.13%) Data Protection Act
2 4 (5.13%) Hybrid Cloud
2 4 (5.13%) Product Ownership
3 3 (3.85%) Data Structures
3 3 (3.85%) Onboarding
3 3 (3.85%) Renewable Energy
4 1 (1.28%) Algorithms
4 1 (1.28%) Data Centre
4 1 (1.28%) Distributed Computing
4 1 (1.28%) Enterprise Cloud
4 1 (1.28%) IoT
4 1 (1.28%) Linux Command Line
4 1 (1.28%) Management Information System
4 1 (1.28%) Public Cloud
4 1 (1.28%) Team-Oriented Environment
Operating Systems
1 4 (5.13%) Unix
2 2 (2.56%) Linux
3 1 (1.28%) Windows
Processes & Methodologies
1 33 (42.31%) Data Pipeline
2 26 (33.33%) Data Engineering
2 26 (33.33%) ETL
3 21 (26.92%) CI/CD
4 20 (25.64%) Analytics
5 16 (20.51%) Machine Learning
6 15 (19.23%) Problem-Solving
7 14 (17.95%) Business Intelligence
7 14 (17.95%) Data Transformation
8 13 (16.67%) Agile
8 13 (16.67%) Data Integration
8 13 (16.67%) Data Science
9 12 (15.38%) Artificial Intelligence
9 12 (15.38%) Data Modelling
10 11 (14.10%) Decision-Making
11 10 (12.82%) Data Security
11 10 (12.82%) Workflow
12 9 (11.54%) Data Ingestion
12 9 (11.54%) DevOps
13 8 (10.26%) Technical Architecture
Programming Languages
1 59 (75.64%) Python
2 51 (65.38%) SQL
3 8 (10.26%) Java
4 3 (3.85%) JavaScript
4 3 (3.85%) T-SQL
4 3 (3.85%) TypeScript
5 1 (1.28%) Bash
5 1 (1.28%) C#
5 1 (1.28%) Data Analysis Expressions
5 1 (1.28%) Perl
Qualifications
1 19 (24.36%) Security Cleared
2 15 (19.23%) SC Cleared
3 3 (3.85%) Azure Certification
3 3 (3.85%) BPSS Clearance
4 1 (1.28%) Computer Science Degree
4 1 (1.28%) Degree
4 1 (1.28%) DV Cleared
Quality Assurance & Compliance
1 13 (16.67%) Data Quality
2 5 (6.41%) Accessibility
3 4 (5.13%) GDPR
4 3 (3.85%) QA
System Software
1 9 (11.54%) Docker
2 1 (1.28%) Apache Flume
2 1 (1.28%) Apache ZooKeeper
2 1 (1.28%) Virtual Machines
Systems Management
1 9 (11.54%) Terraform
2 7 (8.97%) Kubernetes
3 1 (1.28%) Ansible
3 1 (1.28%) Progress Chef
3 1 (1.28%) Puppet
Vendors
1 25 (32.05%) Databricks
2 13 (16.67%) Microsoft
3 4 (5.13%) Foundry
4 3 (3.85%) Cloudera
4 3 (3.85%) Google
4 3 (3.85%) Palantir
4 3 (3.85%) SAP
5 2 (2.56%) StreamSets
6 1 (1.28%) Checkmarx
6 1 (1.28%) Confluent
6 1 (1.28%) Dynatrace
6 1 (1.28%) IBM
6 1 (1.28%) Informatica
6 1 (1.28%) Oracle
6 1 (1.28%) Virgin Media