PySpark Contracts in England

PySpark - Spark Python API
UK > England

The table below provides summary statistics for contract job vacancies advertised in England requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 28 June 2025, comparing them to the same period in the previous two years.

6 months to
28 Jun 2025
Same period 2024 Same period 2023
Rank 299 306 416
Rank change year-on-year +7 +110 +56
Contract jobs citing PySpark 205 255 230
As % of all contract jobs advertised in England 0.81% 0.68% 0.49%
As % of the Libraries, Frameworks & Software Standards category 3.59% 3.22% 2.16%
Number of daily rates quoted 151 200 163
10th Percentile £363 £412 £451
25th Percentile £456 £461 £513
Median daily rate (50th Percentile) £575 £550 £600
Median % change year-on-year +4.55% -8.33% -
75th Percentile £838 £678 £744
90th Percentile £875 £825 £880
UK median daily rate £550 £525 £600
% change year-on-year +4.76% -12.50% -
Number of hourly rates quoted 0 2 0
Median hourly rate - £21.50 -
UK median hourly rate - £20.47 -

All Software Libraries and Frameworks
England

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in England.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 5,718 7,911 10,639
As % of all contract IT jobs advertised in England 22.49% 21.20% 22.56%
Number of daily rates quoted 3,948 5,508 7,918
10th Percentile £357 £350 £386
25th Percentile £413 £431 £463
Median daily rate (50th Percentile) £525 £550 £550
Median % change year-on-year -4.55% - -4.35%
75th Percentile £650 £675 £688
90th Percentile £788 £800 £798
UK median daily rate £515 £538 £550
% change year-on-year -4.19% -2.27% -
Number of hourly rates quoted 120 265 137
10th Percentile £30.23 £23.80 £30.45
25th Percentile £45.31 £43.00 £50.00
Median hourly rate £58.88 £58.00 £65.00
Median % change year-on-year +1.51% -10.77% +23.81%
75th Percentile £68.00 £70.00 £75.00
90th Percentile £81.01 £74.48 £80.25
UK median hourly rate £55.00 £55.00 £65.00
% change year-on-year - -15.38% +26.83%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing PySpark in England.

Daily rate trend for PySpark in England

PySpark
Daily Rate Histogram in England

Daily rate distribution for jobs citing PySpark in England over the 6 months to 28 June 2025.

Daily rate histogram for PySpark in England

PySpark
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing PySpark in England.

Hourly rate trend for PySpark in England

PySpark
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the England region over the 6 months to 28 June 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London +20 153 £713 +29.55% 132
North of England +12 21 £475 -2.06% 20
Yorkshire +5 11 £488 -0.51% 4
North West +15 10 £450 -3.74% 15
South East +49 9 £465 +24.00% 20
Midlands +14 7 £538 -10.42% 8
East of England - 7 £318 - 3
West Midlands +7 5 £600 - 5
East Midlands - 2 £475 - 3
South West +32 1 £425 -7.61% 14
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 70 (34.15%) Apache
2 60 (29.27%) Apache Spark
3 58 (28.29%) Apache Airflow
4 4 (1.95%) Jupyter
5 1 (0.49%) SharePoint
Cloud Services
1 82 (40.00%) AWS
2 81 (39.51%) Azure
3 51 (24.88%) dbt
4 32 (15.61%) Power Platform
5 28 (13.66%) Azure Data Factory
5 28 (13.66%) Serverless
6 27 (13.17%) GCP
7 26 (12.68%) Azure Synapse Analytics
8 25 (12.20%) AWS Lambda
9 24 (11.71%) Snowflake
10 23 (11.22%) Azure DevOps
11 21 (10.24%) Amazon ECS
12 16 (7.80%) OpenShift
13 15 (7.32%) GitHub
14 12 (5.85%) Amazon S3
15 9 (4.39%) Dagster
15 9 (4.39%) Microsoft Purview
16 7 (3.41%) Amazon EC2
17 6 (2.93%) GitHub Actions
18 5 (2.44%) Amazon EKS
Communications & Networking
1 4 (1.95%) SSH
2 1 (0.49%) Ethernet
Database & Business Intelligence
1 49 (23.90%) Data Lake
2 48 (23.41%) Amazon Athena
3 45 (21.95%) Apache Iceberg
4 41 (20.00%) Dremio
5 37 (18.05%) Apache Arrow
6 32 (15.61%) Data Warehouse
6 32 (15.61%) Power BI
7 23 (11.22%) Delta Lake
8 21 (10.24%) Apache Ignite
8 21 (10.24%) Big Data
9 19 (9.27%) Hadoop
10 18 (8.78%) Apache Hive
11 12 (5.85%) Metadata
11 12 (5.85%) Spark SQL
12 11 (5.37%) Azure SQL Database
13 9 (4.39%) SQL Server
14 8 (3.90%) BigQuery
14 8 (3.90%) Relational Database
14 8 (3.90%) Tableau
15 7 (3.41%) MySQL
Development Applications
1 29 (14.15%) Git
2 16 (7.80%) Artifactory
3 6 (2.93%) JIRA
4 4 (1.95%) Jenkins
4 4 (1.95%) RStudio
5 1 (0.49%) Postman
5 1 (0.49%) Selenium
5 1 (0.49%) SonarQube
5 1 (0.49%) SpecFlow
General
1 73 (35.61%) Finance
2 44 (21.46%) Banking
3 41 (20.00%) Front Office
4 33 (16.10%) Analytical Skills
5 32 (15.61%) Social Skills
6 27 (13.17%) Investment Banking
7 15 (7.32%) Public Sector
8 7 (3.41%) Retail
9 5 (2.44%) Financial Institution
10 4 (1.95%) Organisational Skills
11 3 (1.46%) Corporate Banking
11 3 (1.46%) Retail Banking
11 3 (1.46%) Telecoms
12 2 (0.98%) Automotive
12 2 (0.98%) Health Technology
13 1 (0.49%) Law
13 1 (0.49%) Legal
13 1 (0.49%) Manufacturing
13 1 (0.49%) Presentation Skills
13 1 (0.49%) Tech for Good
Job Titles
1 113 (55.12%) Data Engineer
2 48 (23.41%) AWS Engineer
3 40 (19.51%) Python Engineer
4 37 (18.05%) Developer
5 24 (11.71%) Senior
6 23 (11.22%) Software Engineer
7 21 (10.24%) AWS Software Engineer
8 18 (8.78%) Lead
9 17 (8.29%) DevOps Engineer
9 17 (8.29%) Java Engineer
9 17 (8.29%) Senior Data Engineer
9 17 (8.29%) Software Developer
10 16 (7.80%) AWS Developer
10 16 (7.80%) AWS DevOps
10 16 (7.80%) AWS DevOps Engineer
10 16 (7.80%) Developer/Software Engineer
10 16 (7.80%) Snowflake Developer
10 16 (7.80%) Snowflake Engineer
11 15 (7.32%) Python Developer
12 13 (6.34%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 29 (14.15%) Kafka
2 18 (8.78%) Pandas
3 16 (7.80%) J2EE
4 14 (6.83%) NumPy
5 11 (5.37%) YAML
6 10 (4.88%) SciPy
7 9 (4.39%) TensorFlow
8 8 (3.90%) JSON
9 6 (2.93%) pydantic
9 6 (2.93%) pytest
9 6 (2.93%) React
10 5 (2.44%) Apache NiFi
10 5 (2.44%) gRPC
10 5 (2.44%) Protocol Buffers
11 4 (1.95%) AngularJS
12 3 (1.46%) CSS
12 3 (1.46%) HTML
13 2 (0.98%) ADO
13 2 (0.98%) JDBC
13 2 (0.98%) PostGIS
Miscellaneous
1 22 (10.73%) Derivative
1 22 (10.73%) Hedge funds
2 21 (10.24%) Equities
2 21 (10.24%) Fixed Income
2 21 (10.24%) Foreign Exchange (FX)
3 18 (8.78%) Distributed Computing
4 11 (5.37%) Algorithms
5 10 (4.88%) Cloud Native
5 10 (4.88%) Data Structures
6 7 (3.41%) Credit Risk
6 7 (3.41%) Linux Command Line
7 6 (2.93%) Reference Data
8 4 (1.95%) Data Protection Act
8 4 (1.95%) Hybrid Cloud
8 4 (1.95%) Legacy Systems
8 4 (1.95%) Onboarding
9 3 (1.46%) Product Ownership
9 3 (1.46%) Virtual Team
10 2 (0.98%) Distributed Systems
10 2 (0.98%) Renewable Energy
Operating Systems
1 6 (2.93%) Linux
2 4 (1.95%) Unix
Processes & Methodologies
1 82 (40.00%) Data Pipeline
2 80 (39.02%) Data Engineering
3 73 (35.61%) Agile
4 70 (34.15%) ETL
5 59 (28.78%) CI/CD
6 47 (22.93%) Software Engineering
7 46 (22.44%) Analytics
8 45 (21.95%) DevOps
9 44 (21.46%) Asset Management
10 38 (18.54%) Data Modelling
11 35 (17.07%) Data Ingestion
12 33 (16.10%) Machine Learning
13 32 (15.61%) Data Science
14 28 (13.66%) Artificial Intelligence
14 28 (13.66%) Problem-Solving
15 26 (12.68%) Data Governance
16 23 (11.22%) Business Intelligence
16 23 (11.22%) Data Management
17 22 (10.73%) Data Security
17 22 (10.73%) Open Source
Programming Languages
1 175 (85.37%) Python
2 115 (56.10%) SQL
3 54 (26.34%) Java
4 22 (10.73%) Scala
5 16 (7.80%) Go
6 11 (5.37%) JavaScript
7 10 (4.88%) TypeScript
8 7 (3.41%) Bash
9 5 (2.44%) C++
10 2 (0.98%) C#
10 2 (0.98%) PL/SQL
10 2 (0.98%) Shell Script
11 1 (0.49%) C
11 1 (0.49%) Data Analysis Expressions
11 1 (0.49%) Rust
Qualifications
1 36 (17.56%) Security Cleared
2 31 (15.12%) SC Cleared
3 17 (8.29%) Degree
4 11 (5.37%) Master's Degree
5 10 (4.88%) PhD
6 9 (4.39%) Computer Science Degree
7 6 (2.93%) BPSS Clearance
8 3 (1.46%) Azure Certification
9 2 (0.98%) AWS Certification
9 2 (0.98%) AWS Certified Solutions Architect
10 1 (0.49%) DV Cleared
10 1 (0.49%) MCP
Quality Assurance & Compliance
1 26 (12.68%) Data Quality
2 14 (6.83%) GDPR
3 10 (4.88%) Accessibility
4 3 (1.46%) QA
System Software
1 29 (14.15%) Docker
2 1 (0.49%) Apache ZooKeeper
Systems Management
1 37 (18.05%) Terraform
2 29 (14.15%) Kubernetes
3 2 (0.98%) Ansible
3 2 (0.98%) Puppet
4 1 (0.49%) Progress Chef
Vendors
1 55 (26.83%) Databricks
2 15 (7.32%) Palantir
3 14 (6.83%) Foundry
3 14 (6.83%) Microsoft
4 8 (3.90%) Informatica
5 6 (2.93%) Google
6 4 (1.95%) Oracle
7 3 (1.46%) Talend
8 2 (0.98%) Brio
8 2 (0.98%) MuleSoft
8 2 (0.98%) Salesforce
9 1 (0.49%) Bloomberg
9 1 (0.49%) Checkmarx
9 1 (0.49%) Confluent
9 1 (0.49%) Dynatrace
9 1 (0.49%) Refinitiv
9 1 (0.49%) Reuters
9 1 (0.49%) SAP
9 1 (0.49%) Virgin Media