PySpark Contracts in London

PySpark - Spark Python API
England > London

The table below provides summary statistics for contract job vacancies advertised in London requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 3 July 2025, comparing them to the same period in the previous two years.

6 months to
3 Jul 2025
Same period 2024 Same period 2023
Rank 210 223 325
Rank change year-on-year +13 +102 +41
Contract jobs citing PySpark 154 192 166
As % of all contract jobs advertised in London 1.18% 1.09% 0.66%
As % of the Libraries, Frameworks & Software Standards category 4.46% 4.05% 2.47%
Number of daily rates quoted 116 155 118
10th Percentile £406 £425 £471
25th Percentile £490 £475 £516
Median daily rate (50th Percentile) £700 £550 £617
Median % change year-on-year +27.27% -10.90% +2.88%
75th Percentile £838 £750 £750
90th Percentile £875 £875 £880
England median daily rate £575 £550 £600
% change year-on-year +4.55% -8.33% -

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,456 4,740 6,730
As % of all contract IT jobs advertised in London 26.37% 26.90% 26.60%
Number of daily rates quoted 2,409 3,491 5,061
10th Percentile £375 £375 £413
25th Percentile £425 £459 £488
Median daily rate (50th Percentile) £550 £575 £600
Median % change year-on-year -4.35% -4.17% -
75th Percentile £713 £711 £725
90th Percentile £825 £850 £813
England median daily rate £525 £550 £550
% change year-on-year -4.55% - -4.35%
Number of hourly rates quoted 23 27 42
10th Percentile £31.25 £16.25 £31.18
25th Percentile £33.25 £23.80 £47.50
Median hourly rate £45.00 £42.50 £67.25
Median % change year-on-year +5.88% -36.80% +41.58%
75th Percentile £60.75 £61.97 £75.00
90th Percentile £83.75 £75.00 £86.20
England median hourly rate £57.63 £58.15 £65.00
% change year-on-year -0.90% -10.54% +22.64%

PySpark
Job Vacancy Trend in London

Job postings citing PySpark as a proportion of all IT jobs advertised in London.

Job vacancy trend for PySpark in London

PySpark
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing PySpark in London.

Daily rate trend for PySpark in London

PySpark
Daily Rate Histogram in London

Daily rate distribution for jobs citing PySpark in London over the 6 months to 3 July 2025.

Daily rate histogram for PySpark in London

PySpark
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing PySpark in London.

Hourly rate trend for PySpark in London

PySpark
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the London region over the 6 months to 3 July 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +12 24 £698 +26.82% 27
West London - 1 £775 - 1
PySpark
England

PySpark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (34.42%) Apache
2 49 (31.82%) Apache Spark
3 44 (28.57%) Apache Airflow
4 4 (2.60%) Jupyter
Cloud Services
1 70 (45.45%) AWS
2 61 (39.61%) Azure
3 47 (30.52%) dbt
4 26 (16.88%) Power Platform
5 23 (14.94%) Azure Data Factory
5 23 (14.94%) Azure Synapse Analytics
5 23 (14.94%) Serverless
5 23 (14.94%) Snowflake
6 20 (12.99%) Amazon ECS
6 20 (12.99%) AWS Lambda
7 17 (11.04%) Azure DevOps
7 17 (11.04%) GCP
8 15 (9.74%) OpenShift
9 9 (5.84%) Dagster
10 8 (5.19%) GitHub
11 7 (4.55%) Amazon S3
11 7 (4.55%) Microsoft Purview
12 5 (3.25%) Amazon EC2
12 5 (3.25%) Amazon EKS
12 5 (3.25%) GitHub Actions
Communications & Networking
1 4 (2.60%) SSH
Database & Business Intelligence
1 47 (30.52%) Amazon Athena
2 44 (28.57%) Apache Iceberg
3 40 (25.97%) Dremio
4 38 (24.68%) Data Lake
5 36 (23.38%) Apache Arrow
6 26 (16.88%) Power BI
7 20 (12.99%) Apache Ignite
8 18 (11.69%) Data Warehouse
9 16 (10.39%) Apache Hive
10 15 (9.74%) Delta Lake
11 14 (9.09%) Big Data
12 11 (7.14%) Hadoop
13 10 (6.49%) SQL Server
14 9 (5.84%) Azure SQL Database
15 8 (5.19%) Metadata
15 8 (5.19%) Spark SQL
16 5 (3.25%) NoSQL
16 5 (3.25%) Relational Database
17 4 (2.60%) BigQuery
17 4 (2.60%) Tableau
Development Applications
1 16 (10.39%) Git
2 15 (9.74%) Artifactory
3 6 (3.90%) JIRA
4 4 (2.60%) RStudio
5 1 (0.65%) Jenkins
5 1 (0.65%) Postman
5 1 (0.65%) Selenium
5 1 (0.65%) SpecFlow
General
1 67 (43.51%) Finance
2 42 (27.27%) Banking
3 40 (25.97%) Front Office
4 29 (18.83%) Analytical Skills
5 27 (17.53%) Investment Banking
6 22 (14.29%) Social Skills
7 8 (5.19%) Public Sector
8 5 (3.25%) Financial Institution
8 5 (3.25%) Retail
9 4 (2.60%) Organisational Skills
10 3 (1.95%) Corporate Banking
10 3 (1.95%) Retail Banking
11 2 (1.30%) Telecoms
12 1 (0.65%) Games
12 1 (0.65%) Law
12 1 (0.65%) Manufacturing
12 1 (0.65%) Military
12 1 (0.65%) Presentation Skills
12 1 (0.65%) Publishing
Job Titles
1 86 (55.84%) Data Engineer
2 46 (29.87%) AWS Engineer
3 33 (21.43%) Python Engineer
4 27 (17.53%) Developer
5 22 (14.29%) Software Engineer
6 21 (13.64%) AWS Software Engineer
7 17 (11.04%) Java Engineer
7 17 (11.04%) Senior
8 16 (10.39%) AWS Developer
8 16 (10.39%) Developer/Software Engineer
8 16 (10.39%) DevOps Engineer
8 16 (10.39%) Snowflake Developer
8 16 (10.39%) Snowflake Engineer
8 16 (10.39%) Software Developer
9 15 (9.74%) AWS DevOps
9 15 (9.74%) AWS DevOps Engineer
10 13 (8.44%) Java Software Engineer
11 12 (7.79%) Azure Engineer
11 12 (7.79%) Python Developer
12 11 (7.14%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 19 (12.34%) Kafka
2 15 (9.74%) J2EE
3 14 (9.09%) Pandas
4 12 (7.79%) NumPy
5 10 (6.49%) SciPy
6 9 (5.84%) TensorFlow
7 8 (5.19%) YAML
8 7 (4.55%) JSON
9 6 (3.90%) pydantic
9 6 (3.90%) pytest
10 5 (3.25%) gRPC
10 5 (3.25%) Protocol Buffers
11 3 (1.95%) CSS
11 3 (1.95%) HTML
12 2 (1.30%) GeoPandas
12 2 (1.30%) Plotly
12 2 (1.30%) PostGIS
12 2 (1.30%) REST
12 2 (1.30%) scikit-learn
12 2 (1.30%) Spark Streaming
Miscellaneous
1 22 (14.29%) Derivative
1 22 (14.29%) Hedge funds
2 21 (13.64%) Equities
2 21 (13.64%) Fixed Income
2 21 (13.64%) Foreign Exchange (FX)
3 17 (11.04%) Distributed Computing
4 10 (6.49%) Algorithms
5 7 (4.55%) Credit Risk
6 6 (3.90%) Data Structures
6 6 (3.90%) Linux Command Line
6 6 (3.90%) Reference Data
7 3 (1.95%) Cloud Native
7 3 (1.95%) Product Ownership
7 3 (1.95%) Virtual Team
8 2 (1.30%) Data Protection Act
8 2 (1.30%) Distributed Systems
8 2 (1.30%) Legacy Systems
8 2 (1.30%) Market Risk
9 1 (0.65%) Distributed Architecture
9 1 (0.65%) Legacy Applications
Operating Systems
1 5 (3.25%) Linux
2 1 (0.65%) Unix
Processes & Methodologies
1 68 (44.16%) Agile
2 56 (36.36%) Data Pipeline
3 53 (34.42%) Data Engineering
4 45 (29.22%) ETL
5 44 (28.57%) CI/CD
6 43 (27.92%) Asset Management
6 43 (27.92%) Software Engineering
7 36 (23.38%) DevOps
8 30 (19.48%) Analytics
8 30 (19.48%) Data Modelling
9 26 (16.88%) Data Ingestion
10 25 (16.23%) Machine Learning
11 22 (14.29%) Data Science
11 22 (14.29%) Problem-Solving
12 20 (12.99%) Artificial Intelligence
12 20 (12.99%) Data Management
13 18 (11.69%) Business Intelligence
14 17 (11.04%) Data Governance
15 16 (10.39%) Computer Science
15 16 (10.39%) Open Source
Programming Languages
1 131 (85.06%) Python
2 87 (56.49%) SQL
3 48 (31.17%) Java
4 18 (11.69%) Scala
5 15 (9.74%) Go
6 8 (5.19%) JavaScript
7 6 (3.90%) Bash
8 5 (3.25%) C++
8 5 (3.25%) TypeScript
9 2 (1.30%) C#
9 2 (1.30%) PL/SQL
9 2 (1.30%) Shell Script
10 1 (0.65%) C
10 1 (0.65%) Data Analysis Expressions
10 1 (0.65%) Rust
Qualifications
1 22 (14.29%) SC Cleared
1 22 (14.29%) Security Cleared
2 16 (10.39%) Degree
3 11 (7.14%) Master's Degree
4 10 (6.49%) PhD
5 8 (5.19%) Computer Science Degree
6 2 (1.30%) Azure Certification
7 1 (0.65%) AWS Certification
7 1 (0.65%) AWS Certified Solutions Architect
7 1 (0.65%) DBS Check
7 1 (0.65%) MCP
Quality Assurance & Compliance
1 17 (11.04%) Data Quality
2 8 (5.19%) GDPR
3 4 (2.60%) Accessibility
4 3 (1.95%) QA
System Software
1 20 (12.99%) Docker
Systems Management
1 30 (19.48%) Terraform
2 21 (13.64%) Kubernetes
Vendors
1 43 (27.92%) Databricks
2 12 (7.79%) Palantir
3 11 (7.14%) Foundry
4 7 (4.55%) Microsoft
5 5 (3.25%) Informatica
6 4 (2.60%) Google
6 4 (2.60%) Oracle
7 1 (0.65%) Bloomberg
7 1 (0.65%) Confluent
7 1 (0.65%) Refinitiv
7 1 (0.65%) Reuters
7 1 (0.65%) SAP