PySpark Contracts in London

PySpark - Spark Python API
England > London

The table below provides summary statistics for contract job vacancies advertised in London requiring PySpark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 181 260 324
Rank change year-on-year +79 +64 +61
Contract jobs citing PySpark 178 132 174
As % of all contract jobs advertised in London 1.42% 0.74% 0.64%
As % of the Libraries, Frameworks & Software Standards category 5.44% 2.96% 2.35%
Number of daily rates quoted 135 111 124
10th Percentile £456 £438 £463
25th Percentile £550 £494 £513
Median daily rate (50th Percentile) £775 £550 £615
Median % change year-on-year +40.91% -10.57% +0.41%
75th Percentile £875 £700 £750
90th Percentile £888 £800 £915
England median daily rate £660 £550 £600
% change year-on-year +20.00% -8.33% -
Number of hourly rates quoted 2 0 1
Median hourly rate £65.00 - £43.63
England median hourly rate £65.00 £21.00 £43.50
% change year-on-year +209.52% -51.72% -44.76%

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,271 4,464 7,402
As % of all contract IT jobs advertised in London 26.07% 25.04% 27.38%
Number of daily rates quoted 2,298 3,349 5,511
10th Percentile £385 £375 £413
25th Percentile £450 £459 £500
Median daily rate (50th Percentile) £575 £575 £600
Median % change year-on-year - -4.17% -
75th Percentile £725 £700 £730
90th Percentile £838 £825 £813
England median daily rate £530 £550 £563
% change year-on-year -3.64% -2.22% -
Number of hourly rates quoted 18 26 40
10th Percentile £33.25 £16.25 £30.68
25th Percentile £36.06 £23.90 £37.84
Median hourly rate £52.50 £37.17 £66.00
Median % change year-on-year +41.24% -43.68% +35.86%
75th Percentile £65.00 £61.25 £75.00
90th Percentile £76.25 £68.50 £76.63
England median hourly rate £65.00 £46.18 £65.00
% change year-on-year +40.75% -28.95% +32.65%

PySpark
Job Vacancy Trend in London

Job postings citing PySpark as a proportion of all IT jobs advertised in London.

Job vacancy trend for PySpark in London

PySpark
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing PySpark in London.

Daily rate trend for PySpark in London

PySpark
Daily Rate Histogram in London

Daily rate distribution for jobs citing PySpark in London over the 6 months to 1 May 2025.

Daily rate histogram for PySpark in London

PySpark
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing PySpark in London.

Hourly rate trend for PySpark in London

PySpark
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the London region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +13 22 £704 +0.54% 4
West London - 1 £775 -
PySpark
England

PySpark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 83 (46.63%) Apache
2 76 (42.70%) Apache Airflow
3 60 (33.71%) Apache Spark
4 6 (3.37%) Jupyter
Cloud Services
1 100 (56.18%) AWS
2 77 (43.26%) dbt
3 56 (31.46%) Azure
4 45 (25.28%) Amazon ECS
5 38 (21.35%) Serverless
5 38 (21.35%) Snowflake
6 35 (19.66%) AWS Lambda
7 32 (17.98%) GCP
8 28 (15.73%) OpenShift
9 26 (14.61%) Dagster
10 23 (12.92%) Azure Data Factory
11 21 (11.80%) Azure Synapse Analytics
12 19 (10.67%) Power Platform
13 18 (10.11%) Amazon EC2
14 17 (9.55%) Amazon EKS
15 14 (7.87%) Azure DevOps
16 9 (5.06%) Amazon S3
16 9 (5.06%) GitHub
17 7 (3.93%) GitHub Actions
18 4 (2.25%) Microsoft Purview
Communications & Networking
1 6 (3.37%) SSH
Database & Business Intelligence
1 76 (42.70%) Amazon Athena
2 74 (41.57%) Apache Iceberg
3 70 (39.33%) Dremio
4 61 (34.27%) Apache Arrow
5 57 (32.02%) Data Lake
6 45 (25.28%) Apache Ignite
7 19 (10.67%) Data Warehouse
7 19 (10.67%) Power BI
8 16 (8.99%) Apache Hive
9 14 (7.87%) Big Data
10 13 (7.30%) Delta Lake
11 12 (6.74%) Azure SQL Database
12 10 (5.62%) SQL Server
13 9 (5.06%) Hadoop
14 7 (3.93%) Relational Database
15 6 (3.37%) NoSQL
15 6 (3.37%) Spark SQL
16 4 (2.25%) BigQuery
16 4 (2.25%) Metadata
17 3 (1.69%) Parquet
Development Applications
1 29 (16.29%) Artifactory
2 15 (8.43%) Git
3 9 (5.06%) JIRA
4 6 (3.37%) RStudio
5 3 (1.69%) JMeter
6 1 (0.56%) Jenkins
6 1 (0.56%) Postman
6 1 (0.56%) Selenium
General
1 98 (55.06%) Finance
2 70 (39.33%) Front Office
3 58 (32.58%) Banking
4 41 (23.03%) Investment Banking
5 31 (17.42%) Analytical Skills
6 19 (10.67%) Social Skills
7 12 (6.74%) Public Sector
8 5 (2.81%) Organisational Skills
8 5 (2.81%) Retail
9 3 (1.69%) Corporate Banking
9 3 (1.69%) Financial Institution
9 3 (1.69%) Law
9 3 (1.69%) Retail Banking
10 2 (1.12%) Documentation Skills
10 2 (1.12%) Manufacturing
10 2 (1.12%) Presentation Skills
10 2 (1.12%) Telecoms
11 1 (0.56%) Electronics
11 1 (0.56%) Games
11 1 (0.56%) Inclusion and Diversity
Job Titles
1 101 (56.74%) Data Engineer
2 73 (41.01%) AWS Engineer
3 56 (31.46%) Python Engineer
4 34 (19.10%) Software Engineer
5 33 (18.54%) AWS Software Engineer
6 30 (16.85%) Developer
7 29 (16.29%) DevOps Engineer
8 28 (15.73%) AWS DevOps
8 28 (15.73%) AWS DevOps Engineer
9 24 (13.48%) Senior
10 21 (11.80%) Java Engineer
11 19 (10.67%) Java Software Engineer
12 16 (8.99%) AWS Developer
12 16 (8.99%) Developer/Software Engineer
12 16 (8.99%) Lead
12 16 (8.99%) Snowflake Developer
12 16 (8.99%) Snowflake Engineer
12 16 (8.99%) Software Developer
13 15 (8.43%) Python Developer
14 14 (7.87%) Python Software Engineer
Libraries, Frameworks & Software Standards
1 36 (20.22%) Kafka
2 33 (18.54%) Pandas
3 31 (17.42%) NumPy
4 28 (15.73%) J2EE
4 28 (15.73%) SciPy
5 17 (9.55%) gRPC
5 17 (9.55%) Protocol Buffers
6 9 (5.06%) JSON
6 9 (5.06%) YAML
7 8 (4.49%) pydantic
8 7 (3.93%) TensorFlow
9 6 (3.37%) pytest
10 2 (1.12%) Plotly
10 2 (1.12%) REST
10 2 (1.12%) Spark Streaming
11 1 (0.56%) AWS CDK
11 1 (0.56%) boto
11 1 (0.56%) scikit-learn
11 1 (0.56%) Unity (Game Engine)
Miscellaneous
1 36 (20.22%) Hedge funds
2 35 (19.66%) Derivative
3 33 (18.54%) Equities
3 33 (18.54%) Fixed Income
3 33 (18.54%) Foreign Exchange (FX)
4 8 (4.49%) Data Structures
4 8 (4.49%) Distributed Computing
4 8 (4.49%) Linux Command Line
4 8 (4.49%) Reference Data
5 7 (3.93%) Algorithms
6 6 (3.37%) Credit Risk
7 2 (1.12%) Cloud Native
7 2 (1.12%) Legacy Systems
7 2 (1.12%) Market Risk
7 2 (1.12%) Renewable Energy
7 2 (1.12%) Solar Panel
8 1 (0.56%) Distributed Architecture
8 1 (0.56%) Distributed Systems
8 1 (0.56%) Legacy Code
8 1 (0.56%) Onboarding
Operating Systems
1 6 (3.37%) Linux
Processes & Methodologies
1 94 (52.81%) Agile
2 74 (41.57%) Asset Management
2 74 (41.57%) Software Engineering
3 66 (37.08%) Data Engineering
4 56 (31.46%) CI/CD
4 56 (31.46%) Data Pipeline
5 46 (25.84%) DevOps
6 39 (21.91%) ETL
7 33 (18.54%) Analytics
8 28 (15.73%) Open Source
8 28 (15.73%) Site Reliability Engineering
9 22 (12.36%) Data Ingestion
9 22 (12.36%) Migration
9 22 (12.36%) Problem-Solving
10 21 (11.80%) Data Modelling
10 21 (11.80%) Data Science
11 20 (11.24%) Machine Learning
12 19 (10.67%) Data Management
13 14 (7.87%) Computer Science
13 14 (7.87%) Data Transformation
Programming Languages
1 153 (85.96%) Python
2 85 (47.75%) SQL
3 77 (43.26%) Java
4 28 (15.73%) Go
5 17 (9.55%) JavaScript
5 17 (9.55%) TypeScript
6 12 (6.74%) Scala
7 8 (4.49%) Bash
8 4 (2.25%) C++
9 2 (1.12%) Groovy
9 2 (1.12%) Rust
9 2 (1.12%) T-SQL
10 1 (0.56%) C#
10 1 (0.56%) Data Analysis Expressions
10 1 (0.56%) PL/SQL
Qualifications
1 20 (11.24%) Security Cleared
2 18 (10.11%) SC Cleared
3 15 (8.43%) Degree
4 11 (6.18%) Master's Degree
5 9 (5.06%) Computer Science Degree
6 8 (4.49%) PhD
7 2 (1.12%) AWS Certification
7 2 (1.12%) AWS Certified Solutions Architect
8 1 (0.56%) Azure Certification
8 1 (0.56%) DV Cleared
Quality Assurance & Compliance
1 17 (9.55%) Data Quality
2 10 (5.62%) GDPR
3 6 (3.37%) Accessibility
4 4 (2.25%) QA
System Software
1 34 (19.10%) Docker
2 2 (1.12%) HDFS
Systems Management
1 39 (21.91%) Terraform
2 31 (17.42%) Kubernetes
Vendors
1 29 (16.29%) Databricks
2 6 (3.37%) Microsoft
2 6 (3.37%) Palantir
3 4 (2.25%) Foundry
3 4 (2.25%) Google
4 3 (1.69%) Bloomberg
4 3 (1.69%) Oracle
4 3 (1.69%) Refinitiv
4 3 (1.69%) Reuters
4 3 (1.69%) StreamSets
5 2 (1.12%) SAP
6 1 (0.56%) Confluent
6 1 (0.56%) Informatica
6 1 (0.56%) Virgin Media