PySpark Contracts in England

PySpark - Spark Python API
UK > England

The table below provides summary statistics for contract job vacancies advertised in England requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 251 370 421
Rank change year-on-year +119 +51 +50
Contract jobs citing PySpark 250 174 243
As % of all contract jobs advertised in England 1.03% 0.47% 0.48%
As % of the Libraries, Frameworks & Software Standards category 4.58% 2.32% 2.08%
Number of daily rates quoted 180 137 171
10th Percentile £363 £425 £463
25th Percentile £500 £475 £513
Median daily rate (50th Percentile) £660 £550 £600
Median % change year-on-year +20.00% -8.33% -
75th Percentile £838 £675 £713
90th Percentile £875 £775 £880
UK median daily rate £600 £533 £600
% change year-on-year +12.68% -11.25% -
Number of hourly rates quoted 3 1 3
10th Percentile £30.00 - £37.50
25th Percentile £43.13 £20.50 £39.75
Median hourly rate £65.00 £21.00 £43.50
Median % change year-on-year +209.52% -51.72% -44.76%
75th Percentile - £21.50 £43.57
90th Percentile - - £43.60
UK median hourly rate £22.00 £20.47 £43.50
% change year-on-year +7.47% -52.94% -44.76%

All Software Libraries and Frameworks
England

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in England.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 5,454 7,511 11,676
As % of all contract IT jobs advertised in England 22.39% 20.19% 23.14%
Number of daily rates quoted 3,783 5,341 8,633
10th Percentile £368 £350 £400
25th Percentile £425 £430 £463
Median daily rate (50th Percentile) £530 £550 £563
Median % change year-on-year -3.64% -2.22% -
75th Percentile £669 £675 £688
90th Percentile £800 £775 £798
UK median daily rate £525 £530 £550
% change year-on-year -0.94% -3.64% -
Number of hourly rates quoted 100 218 138
10th Percentile £30.13 £22.27 £28.73
25th Percentile £51.25 £43.00 £48.88
Median hourly rate £65.00 £46.18 £65.00
Median % change year-on-year +40.75% -28.95% +32.65%
75th Percentile £68.19 £65.00 £75.00
90th Percentile £82.19 £75.00 £80.08
UK median hourly rate £65.00 £46.18 £65.00
% change year-on-year +40.75% -28.95% +32.65%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing PySpark in England.

Daily rate trend for PySpark in England

PySpark
Daily Rate Histogram in England

Daily rate distribution for jobs citing PySpark in England over the 6 months to 1 May 2025.

Daily rate histogram for PySpark in England

PySpark
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing PySpark in England.

Hourly rate trend for PySpark in England

PySpark
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing PySpark in England over the 6 months to 1 May 2025.

Hourly rate histogram for PySpark in England

PySpark
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the England region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London +79 178 £775 +40.91% 88
North of England +35 25 £475 -3.06% 15
South East +62 22 £505 +3.59% 28
North West +25 13 £488 +5.41% 8
Midlands +27 9 £475 -20.83% 3
West Midlands +18 8 £495 -17.50% 2
North East - 7 £358 - 5
East of England +35 6 £318 - 1
Yorkshire +9 5 £600 +22.45% 2
South West +38 1 £250 -47.37% 12
East Midlands - 1 £475 - 1
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 98 (39.20%) Apache
2 86 (34.40%) Apache Airflow
3 76 (30.40%) Apache Spark
4 8 (3.20%) Jupyter
5 2 (0.80%) SharePoint
Cloud Services
1 112 (44.80%) AWS
2 99 (39.60%) Azure
3 80 (32.00%) dbt
4 47 (18.80%) Azure Data Factory
5 45 (18.00%) Amazon ECS
6 42 (16.80%) Serverless
7 40 (16.00%) GCP
8 39 (15.60%) AWS Lambda
8 39 (15.60%) Snowflake
9 32 (12.80%) Azure Synapse Analytics
10 28 (11.20%) OpenShift
11 27 (10.80%) Power Platform
12 26 (10.40%) Dagster
13 21 (8.40%) Azure DevOps
14 19 (7.60%) Amazon EC2
15 17 (6.80%) Amazon EKS
16 15 (6.00%) Amazon S3
17 13 (5.20%) GitHub
18 8 (3.20%) GitHub Actions
19 7 (2.80%) Cloud Computing
Communications & Networking
1 6 (2.40%) SSH
2 2 (0.80%) SMS
Database & Business Intelligence
1 76 (30.40%) Amazon Athena
2 74 (29.60%) Apache Iceberg
2 74 (29.60%) Data Lake
3 70 (28.00%) Dremio
4 61 (24.40%) Apache Arrow
5 45 (18.00%) Apache Ignite
6 33 (13.20%) Data Warehouse
7 29 (11.60%) Big Data
8 27 (10.80%) Power BI
9 23 (9.20%) Apache Hive
10 22 (8.80%) Hadoop
11 21 (8.40%) Azure SQL Database
12 17 (6.80%) Delta Lake
13 14 (5.60%) SQL Server
14 13 (5.20%) Metadata
15 11 (4.40%) Spark SQL
16 10 (4.00%) Relational Database
17 8 (3.20%) BigQuery
17 8 (3.20%) MySQL
18 7 (2.80%) PostgreSQL
Development Applications
1 29 (11.60%) Artifactory
2 25 (10.00%) Git
3 10 (4.00%) JIRA
4 6 (2.40%) RStudio
5 4 (1.60%) SpecFlow
6 3 (1.20%) JMeter
7 2 (0.80%) GitLab
7 2 (0.80%) Jenkins
8 1 (0.40%) Postman
8 1 (0.40%) Selenium
8 1 (0.40%) SonarQube
General
1 105 (42.00%) Finance
2 70 (28.00%) Front Office
3 61 (24.40%) Banking
4 43 (17.20%) Investment Banking
5 41 (16.40%) Analytical Skills
6 31 (12.40%) Social Skills
7 22 (8.80%) Public Sector
8 6 (2.40%) Retail
8 6 (2.40%) Telecoms
9 5 (2.00%) Manufacturing
9 5 (2.00%) Organisational Skills
10 4 (1.60%) Electronics
10 4 (1.60%) Marketing
11 3 (1.20%) Corporate Banking
11 3 (1.20%) Financial Institution
11 3 (1.20%) Law
11 3 (1.20%) Presentation Skills
11 3 (1.20%) Retail Banking
12 2 (0.80%) Automotive
12 2 (0.80%) Documentation Skills
Job Titles
1 147 (58.80%) Data Engineer
2 74 (29.60%) AWS Engineer
3 61 (24.40%) Python Engineer
4 38 (15.20%) Developer
5 34 (13.60%) Senior
5 34 (13.60%) Software Engineer
6 33 (13.20%) AWS Software Engineer
7 29 (11.60%) DevOps Engineer
8 28 (11.20%) AWS DevOps
8 28 (11.20%) AWS DevOps Engineer
9 21 (8.40%) Java Engineer
9 21 (8.40%) Lead
10 19 (7.60%) Java Software Engineer
10 19 (7.60%) Senior Data Engineer
11 17 (6.80%) Python Data Engineer
11 17 (6.80%) Python Developer
12 16 (6.40%) Developer/Software Engineer
12 16 (6.40%) Snowflake Developer
12 16 (6.40%) Snowflake Engineer
12 16 (6.40%) Software Developer
Libraries, Frameworks & Software Standards
1 48 (19.20%) Kafka
2 38 (15.20%) Pandas
3 34 (13.60%) NumPy
4 28 (11.20%) J2EE
4 28 (11.20%) SciPy
5 17 (6.80%) gRPC
5 17 (6.80%) Protocol Buffers
6 11 (4.40%) YAML
7 10 (4.00%) JSON
8 8 (3.20%) pydantic
9 7 (2.80%) TensorFlow
10 6 (2.40%) pytest
11 5 (2.00%) Apache NiFi
12 4 (1.60%) AngularJS
12 4 (1.60%) React
13 3 (1.20%) ADO
13 3 (1.20%) Gherkin
14 2 (0.80%) JDBC
14 2 (0.80%) REST
14 2 (0.80%) Spring
Miscellaneous
1 36 (14.40%) Hedge funds
2 35 (14.00%) Derivative
3 33 (13.20%) Equities
3 33 (13.20%) Fixed Income
3 33 (13.20%) Foreign Exchange (FX)
4 11 (4.40%) Data Structures
5 9 (3.60%) Distributed Computing
5 9 (3.60%) Linux Command Line
6 8 (3.20%) Algorithms
6 8 (3.20%) Cloud Native
6 8 (3.20%) Reference Data
7 6 (2.40%) Credit Risk
8 4 (1.60%) Data Protection Act
8 4 (1.60%) Hybrid Cloud
8 4 (1.60%) Onboarding
8 4 (1.60%) Product Ownership
9 3 (1.20%) Legacy Systems
9 3 (1.20%) Renewable Energy
10 2 (0.80%) Market Risk
10 2 (0.80%) Solar Panel
Operating Systems
1 8 (3.20%) Linux
2 4 (1.60%) Unix
3 1 (0.40%) Windows
Processes & Methodologies
1 105 (42.00%) Agile
2 92 (36.80%) Data Pipeline
3 89 (35.60%) Data Engineering
4 80 (32.00%) Software Engineering
5 74 (29.60%) Asset Management
6 69 (27.60%) CI/CD
7 64 (25.60%) ETL
8 58 (23.20%) DevOps
9 56 (22.40%) Analytics
10 36 (14.40%) Data Modelling
10 36 (14.40%) Data Science
10 36 (14.40%) Machine Learning
11 35 (14.00%) Problem-Solving
12 33 (13.20%) Open Source
13 32 (12.80%) Data Ingestion
14 28 (11.20%) Site Reliability Engineering
15 27 (10.80%) Business Intelligence
16 26 (10.40%) Data Transformation
16 26 (10.40%) Migration
17 25 (10.00%) Data Management
Programming Languages
1 208 (83.20%) Python
2 133 (53.20%) SQL
3 84 (33.60%) Java
4 28 (11.20%) Go
5 20 (8.00%) JavaScript
5 20 (8.00%) TypeScript
6 12 (4.80%) Scala
7 9 (3.60%) Bash
8 5 (2.00%) T-SQL
9 4 (1.60%) C++
10 2 (0.80%) C#
10 2 (0.80%) Data Analysis Expressions
10 2 (0.80%) Groovy
10 2 (0.80%) Rust
11 1 (0.40%) Perl
11 1 (0.40%) PL/SQL
Qualifications
1 40 (16.00%) Security Cleared
2 34 (13.60%) SC Cleared
3 16 (6.40%) Degree
4 11 (4.40%) Master's Degree
5 10 (4.00%) Computer Science Degree
6 8 (3.20%) PhD
7 4 (1.60%) Azure Certification
8 3 (1.20%) AWS Certification
8 3 (1.20%) AWS Certified Solutions Architect
8 3 (1.20%) BPSS Clearance
9 2 (0.80%) DV Cleared
Quality Assurance & Compliance
1 31 (12.40%) Data Quality
2 15 (6.00%) GDPR
3 12 (4.80%) Accessibility
4 6 (2.40%) QA
System Software
1 43 (17.20%) Docker
2 2 (0.80%) HDFS
3 1 (0.40%) Apache Flume
3 1 (0.40%) Apache ZooKeeper
3 1 (0.40%) Virtual Machines
Systems Management
1 48 (19.20%) Terraform
2 38 (15.20%) Kubernetes
3 1 (0.40%) Ansible
3 1 (0.40%) Grafana
3 1 (0.40%) Progress Chef
3 1 (0.40%) Prometheus
3 1 (0.40%) Puppet
Vendors
1 56 (22.40%) Databricks
2 22 (8.80%) Microsoft
3 9 (3.60%) Palantir
4 7 (2.80%) Foundry
4 7 (2.80%) Google
5 5 (2.00%) SAP
6 4 (1.60%) Oracle
6 4 (1.60%) StreamSets
7 3 (1.20%) Bloomberg
7 3 (1.20%) Cloudera
7 3 (1.20%) Refinitiv
7 3 (1.20%) Reuters
8 2 (0.80%) Virgin Media
9 1 (0.40%) Checkmarx
9 1 (0.40%) Confluent
9 1 (0.40%) Dynatrace
9 1 (0.40%) Informatica
9 1 (0.40%) MuleSoft
9 1 (0.40%) Salesforce