PySpark Contracts with Hybrid/Remote/WFH Options

PySpark - Spark Python API
UK > Work from Home

The table below provides summary statistics for remote or hybrid contract work requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 179 272 356
Rank change year-on-year +93 +84 +15
Contract jobs citing PySpark 126 73 122
As % of all contract jobs with a WFH option 1.27% 0.48% 0.47%
As % of the Libraries, Frameworks & Software Standards category 4.91% 1.99% 1.87%
Number of daily rates quoted 105 62 88
10th Percentile £425 £413 £456
25th Percentile £513 £475 £522
Median daily rate (50th Percentile) £775 £500 £614
Median % change year-on-year +55.00% -18.53% +7.68%
75th Percentile £838 £575 £741
90th Percentile £888 £636 £891
UK median daily rate £600 £533 £600
% change year-on-year +12.68% -11.25% -
Number of hourly rates quoted 3 1 3
10th Percentile £30.00 - £37.50
25th Percentile £43.13 £20.50 £39.75
Median hourly rate £65.00 £21.00 £43.50
Median % change year-on-year +209.52% -51.72% -44.76%
75th Percentile - £21.50 £43.57
90th Percentile - - £43.60
UK median hourly rate £22.00 £20.47 £43.50
% change year-on-year +7.47% -52.94% -44.76%

All Software Libraries and Frameworks
Work from Home

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies with remote or hybrid options requiring technical specification, industry standards, software libraries and framework skills.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 2,564 3,665 6,520
As % of all contract jobs with a WFH option 25.89% 23.88% 25.22%
Number of daily rates quoted 1,870 2,555 4,857
10th Percentile £365 £331 £395
25th Percentile £425 £428 £450
Median daily rate (50th Percentile) £525 £525 £540
Median % change year-on-year - -2.78% -0.46%
75th Percentile £650 £650 £663
90th Percentile £825 £775 £753
UK median daily rate £525 £530 £550
% change year-on-year -0.94% -3.64% -
Number of hourly rates quoted 31 93 80
10th Percentile £52.50 £28.00 £22.50
25th Percentile £61.25 - £42.13
Median hourly rate £65.00 £43.00 £63.25
Median % change year-on-year +51.16% -32.02% +29.08%
75th Percentile £70.25 £62.00 £75.00
90th Percentile £93.75 £72.50 £80.25
UK median hourly rate £65.00 £46.18 £65.00
% change year-on-year +40.75% -28.95% +32.65%

PySpark
Trend for Jobs with a WFH Option

Job vacancies with remote working options citing PySpark as a proportion of all IT jobs advertised.

PySpark trend for jobs with Hybrid/Remote/WFH options

PySpark
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with remote working options citing PySpark.

PySpark daily rate for jobs with a WFH option

PySpark
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with remote working options citing PySpark over the 6 months to 1 May 2025.

PySpark daily rate histogram for jobs with a WFH option

PySpark
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with remote working options citing PySpark.

PySpark hourly rate for jobs with a WFH option

PySpark
Hourly Rate Histogram for Jobs with a WFH Option

Hourly rate distribution for jobs with remote working options citing PySpark over the 6 months to 1 May 2025.

PySpark hourly rate histogram for jobs with a WFH option

PySpark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 64 (50.79%) Apache Airflow
2 59 (46.83%) Apache
3 38 (30.16%) Apache Spark
4 2 (1.59%) Jupyter
Cloud Services
1 82 (65.08%) AWS
2 65 (51.59%) dbt
3 45 (35.71%) Amazon ECS
4 40 (31.75%) Azure
5 35 (27.78%) AWS Lambda
5 35 (27.78%) Serverless
6 31 (24.60%) GCP
7 28 (22.22%) OpenShift
8 26 (20.63%) Dagster
8 26 (20.63%) Snowflake
9 22 (17.46%) Amazon EC2
10 17 (13.49%) Amazon EKS
11 14 (11.11%) Azure Data Factory
12 13 (10.32%) Azure Synapse Analytics
13 10 (7.94%) Power Platform
14 9 (7.14%) Amazon S3
14 9 (7.14%) Azure DevOps
15 3 (2.38%) GitHub
16 2 (1.59%) Amazon CloudWatch
16 2 (1.59%) Amazon EMR
Communications & Networking
1 1 (0.79%) SMS
1 1 (0.79%) SSH
Database & Business Intelligence
1 67 (53.17%) Amazon Athena
2 63 (50.00%) Apache Iceberg
3 62 (49.21%) Dremio
4 53 (42.06%) Apache Arrow
5 45 (35.71%) Apache Ignite
6 38 (30.16%) Data Lake
7 10 (7.94%) Data Warehouse
7 10 (7.94%) Power BI
8 9 (7.14%) Amazon Redshift
9 8 (6.35%) Big Data
10 5 (3.97%) Apache Hive
10 5 (3.97%) Hadoop
10 5 (3.97%) Relational Database
11 4 (3.17%) Delta Lake
12 3 (2.38%) Azure SQL Database
12 3 (2.38%) Metadata
12 3 (2.38%) MySQL
12 3 (2.38%) Parquet
13 2 (1.59%) BigQuery
13 2 (1.59%) Spark SQL
Development Applications
1 28 (22.22%) Artifactory
2 5 (3.97%) Git
3 2 (1.59%) JIRA
4 1 (0.79%) GitLab
4 1 (0.79%) RStudio
General
1 71 (56.35%) Finance
2 62 (49.21%) Front Office
3 41 (32.54%) Banking
4 29 (23.02%) Investment Banking
5 15 (11.90%) Analytical Skills
6 9 (7.14%) Social Skills
7 7 (5.56%) Public Sector
8 6 (4.76%) Retail
9 4 (3.17%) Retail Banking
10 3 (2.38%) Corporate Banking
10 3 (2.38%) Tech for Good
11 2 (1.59%) Documentation Skills
11 2 (1.59%) Financial Institution
12 1 (0.79%) Games
12 1 (0.79%) Local Government
12 1 (0.79%) Pharmaceutical
Job Titles
1 83 (65.87%) Data Engineer
2 58 (46.03%) AWS Engineer
3 55 (43.65%) Python Engineer
4 28 (22.22%) AWS DevOps
4 28 (22.22%) AWS DevOps Engineer
4 28 (22.22%) DevOps Engineer
5 25 (19.84%) AWS Software Engineer
5 25 (19.84%) Software Engineer
6 17 (13.49%) Developer
7 16 (12.70%) Python Data Engineer
7 16 (12.70%) Senior
8 15 (11.90%) Java Engineer
8 15 (11.90%) Java Software Engineer
9 10 (7.94%) Python Software Engineer
10 9 (7.14%) Python Developer
10 9 (7.14%) Senior Software Engineer
11 8 (6.35%) AWS Developer
11 8 (6.35%) Developer/Software Engineer
11 8 (6.35%) Snowflake Engineer
11 8 (6.35%) Software Developer
Libraries, Frameworks & Software Standards
1 33 (26.19%) Kafka
1 33 (26.19%) Pandas
2 29 (23.02%) NumPy
3 28 (22.22%) J2EE
4 26 (20.63%) SciPy
5 17 (13.49%) gRPC
5 17 (13.49%) Protocol Buffers
6 4 (3.17%) JSON
7 3 (2.38%) FastAPI
8 2 (1.59%) Django
8 2 (1.59%) Flask
8 2 (1.59%) YAML
9 1 (0.79%) AngularJS
9 1 (0.79%) Apache NiFi
9 1 (0.79%) pytest
9 1 (0.79%) React
9 1 (0.79%) scikit-learn
9 1 (0.79%) Spring Boot
9 1 (0.79%) TensorFlow
9 1 (0.79%) Unity (Game Engine)
Miscellaneous
1 25 (19.84%) Derivative
1 25 (19.84%) Equities
1 25 (19.84%) Fixed Income
1 25 (19.84%) Foreign Exchange (FX)
1 25 (19.84%) Hedge funds
2 5 (3.97%) Renewable Energy
3 3 (2.38%) Algorithms
3 3 (2.38%) Legacy Systems
4 2 (1.59%) Cloud Native
4 2 (1.59%) Linux Command Line
5 1 (0.79%) Data Centre
5 1 (0.79%) Data Protection Act
5 1 (0.79%) Data Structures
5 1 (0.79%) Management Information System
5 1 (0.79%) Product Ownership
5 1 (0.79%) Reference Data
5 1 (0.79%) Self-Motivation
Operating Systems
1 1 (0.79%) Linux
Processes & Methodologies
1 74 (58.73%) Agile
2 64 (50.79%) Software Engineering
3 63 (50.00%) Asset Management
4 57 (45.24%) Data Engineering
5 45 (35.71%) CI/CD
5 45 (35.71%) DevOps
6 30 (23.81%) Data Pipeline
7 29 (23.02%) Open Source
8 28 (22.22%) Analytics
8 28 (22.22%) Site Reliability Engineering
9 22 (17.46%) ETL
9 22 (17.46%) Migration
10 20 (15.87%) Data Modelling
11 16 (12.70%) Data Transformation
12 13 (10.32%) Data Ingestion
12 13 (10.32%) Problem-Solving
13 11 (8.73%) Business Intelligence
13 11 (8.73%) Data Science
14 10 (7.94%) Data Management
14 10 (7.94%) Decision-Making
Programming Languages
1 112 (88.89%) Python
2 65 (51.59%) Java
3 49 (38.89%) SQL
4 28 (22.22%) Go
5 17 (13.49%) JavaScript
5 17 (13.49%) TypeScript
6 2 (1.59%) Bash
6 2 (1.59%) Data Analysis Expressions
6 2 (1.59%) Scala
6 2 (1.59%) T-SQL
Qualifications
1 15 (11.90%) SC Cleared
1 15 (11.90%) Security Cleared
2 2 (1.59%) Computer Science Degree
2 2 (1.59%) Degree
3 1 (0.79%) AWS Certification
3 1 (0.79%) AWS Certified Solutions Architect
3 1 (0.79%) Master's Degree
3 1 (0.79%) PhD
Quality Assurance & Compliance
1 8 (6.35%) Data Quality
2 5 (3.97%) GDPR
3 3 (2.38%) Accessibility
4 2 (1.59%) QA
System Software
1 29 (23.02%) Docker
Systems Management
1 34 (26.98%) Terraform
2 28 (22.22%) Kubernetes
3 1 (0.79%) Grafana
3 1 (0.79%) Prometheus
Vendors
1 24 (19.05%) Databricks
2 11 (8.73%) Microsoft
3 2 (1.59%) Foundry
3 2 (1.59%) Google
3 2 (1.59%) Palantir
4 1 (0.79%) Cloudera
4 1 (0.79%) MuleSoft
4 1 (0.79%) Oracle
4 1 (0.79%) Salesforce