PySpark Jobs in London

PySpark - Spark Python API
England > London

The table below provides summary statistics for permanent job vacancies advertised in London requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 28 May 2025, comparing them to the same period in the previous two years.

6 months to
28 May 2025
Same period 2024 Same period 2023
Rank 207 335 444
Rank change year-on-year +128 +109 +106
Permanent jobs citing PySpark 203 183 168
As % of all permanent jobs advertised in London 1.62% 0.77% 0.51%
As % of the Libraries, Frameworks & Software Standards category 6.17% 3.15% 1.47%
Number of salaries quoted 169 106 139
10th Percentile £58,000 £52,500 £62,000
25th Percentile £85,000 £57,500 £72,500
Median annual salary (50th Percentile) £110,000 £70,000 £92,500
Median % change year-on-year +57.14% -24.32% +23.33%
75th Percentile £138,750 £93,438 £114,375
90th Percentile £144,500 £107,500 £160,000
England median annual salary £110,000 £70,000 £80,294
% change year-on-year +57.14% -12.82% +14.71%

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,291 5,818 11,454
As % of all permanent jobs advertised in London 26.30% 24.46% 34.57%
Number of salaries quoted 2,190 4,666 8,124
10th Percentile £50,000 £47,500 £50,000
25th Percentile £62,500 £60,000 £62,500
Median annual salary (50th Percentile) £82,500 £80,000 £80,000
Median % change year-on-year +3.13% - +3.23%
75th Percentile £110,938 £105,000 £100,000
90th Percentile £130,125 £133,125 £120,000
England median annual salary £67,037 £60,000 £67,500
% change year-on-year +11.73% -11.11% +3.85%

PySpark
Job Vacancy Trend in London

Job postings citing PySpark as a proportion of all IT jobs advertised in London.

Job vacancy trend for PySpark in London

PySpark
Salary Trend in London

3-month moving average salary quoted in jobs citing PySpark in London.

Salary trend for PySpark in London

PySpark
Salary Histogram in London

Salary distribution for jobs citing PySpark in London over the 6 months to 28 May 2025.

Salary histogram for PySpark in London

PySpark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the London region over the 6 months to 28 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +6 19 £90,500 +34.07% 7
West London +27 3 £60,000 -6.25% 6
PySpark
England

PySpark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 123 (60.59%) Apache Airflow
2 106 (52.22%) Apache
3 72 (35.47%) Apache Spark
4 1 (0.49%) SAS
Applications
1 2 (0.99%) Microsoft Excel
2 1 (0.49%) Microsoft Office
Cloud Services
1 141 (69.46%) AWS
2 117 (57.64%) dbt
3 72 (35.47%) Amazon ECS
4 70 (34.48%) Serverless
5 69 (33.99%) Azure
6 63 (31.03%) AWS Lambda
7 59 (29.06%) OpenShift
8 50 (24.63%) Snowflake
9 39 (19.21%) GCP
10 30 (14.78%) Azure Data Factory
10 30 (14.78%) Azure DevOps
11 25 (12.32%) Power Platform
12 23 (11.33%) Dagster
13 18 (8.87%) Azure Synapse Analytics
14 13 (6.40%) Amazon EC2
14 13 (6.40%) Amazon EKS
15 10 (4.93%) Microsoft Purview
16 8 (3.94%) Amazon S3
17 7 (3.45%) Amazon Kinesis
17 7 (3.45%) Azure Functions
Database & Business Intelligence
1 121 (59.61%) Amazon Athena
2 114 (56.16%) Apache Iceberg
2 114 (56.16%) Dremio
3 103 (50.74%) Apache Arrow
4 71 (34.98%) Apache Ignite
5 32 (15.76%) Data Lake
6 24 (11.82%) Data Warehouse
7 23 (11.33%) Power BI
8 13 (6.40%) Tableau
9 9 (4.43%) Big Data
10 8 (3.94%) Amazon Redshift
10 8 (3.94%) Delta Lake
11 7 (3.45%) NoSQL
12 6 (2.96%) BigQuery
12 6 (2.96%) Hadoop
12 6 (2.96%) Spark SQL
13 5 (2.46%) Apache Hive
13 5 (2.46%) Parquet
13 5 (2.46%) Sqoop
14 4 (1.97%) Metadata
Development Applications
1 60 (29.56%) Artifactory
2 21 (10.34%) Git
3 8 (3.94%) Jenkins
4 5 (2.46%) CircleCI
5 1 (0.49%) Bitbucket
5 1 (0.49%) GitLab
5 1 (0.49%) JIRA
5 1 (0.49%) kappa
5 1 (0.49%) Octopus Deploy
5 1 (0.49%) SpecFlow
5 1 (0.49%) Spinnaker
General
1 131 (64.53%) Finance
2 114 (56.16%) Front Office
3 66 (32.51%) Banking
4 44 (21.67%) Investment Banking
5 25 (12.32%) Social Skills
6 12 (5.91%) Inclusion and Diversity
7 10 (4.93%) Public Sector
8 9 (4.43%) Analytical Skills
9 4 (1.97%) Law
10 3 (1.48%) Marketing
11 1 (0.49%) Financial Institution
11 1 (0.49%) Games
11 1 (0.49%) Tech for Good
Job Titles
1 132 (65.02%) Data Engineer
2 104 (51.23%) AWS Engineer
3 91 (44.83%) Python Engineer
4 61 (30.05%) DevOps Engineer
5 59 (29.06%) AWS DevOps
5 59 (29.06%) AWS DevOps Engineer
6 46 (22.66%) Software Engineer
7 44 (21.67%) AWS Software Engineer
8 38 (18.72%) Developer
8 38 (18.72%) Senior
9 33 (16.26%) AWS Developer
10 32 (15.76%) Developer/Software Engineer
10 32 (15.76%) Snowflake Developer
10 32 (15.76%) Snowflake Engineer
10 32 (15.76%) Software Developer
11 28 (13.79%) Java Engineer
11 28 (13.79%) Java Software Engineer
12 22 (10.84%) Python Developer
13 19 (9.36%) Azure Engineer
14 17 (8.37%) Azure Data Engineer
Libraries, Frameworks & Software Standards
1 70 (34.48%) Kafka
2 59 (29.06%) J2EE
3 32 (15.76%) Pandas
4 23 (11.33%) NumPy
4 23 (11.33%) SciPy
5 12 (5.91%) gRPC
5 12 (5.91%) Protocol Buffers
6 9 (4.43%) scikit-learn
6 9 (4.43%) TensorFlow
7 8 (3.94%) Spark Streaming
8 7 (3.45%) Flask
9 5 (2.46%) OAuth
10 4 (1.97%) Django
11 3 (1.48%) pytest
11 3 (1.48%) YAML
12 2 (0.99%) Smart Contracts
13 1 (0.49%) Apache Avro
13 1 (0.49%) ARM Templates
13 1 (0.49%) JSON
13 1 (0.49%) REST
Miscellaneous
1 54 (26.60%) Equities
1 54 (26.60%) Fixed Income
2 44 (21.67%) Derivative
2 44 (21.67%) Foreign Exchange (FX)
2 44 (21.67%) Hedge funds
3 14 (6.90%) Algorithms
4 12 (5.91%) Product Ownership
5 10 (4.93%) Credit Risk
6 5 (2.46%) Data Structures
6 5 (2.46%) Distributed Applications
6 5 (2.46%) Greenfield Project
7 2 (0.99%) Blockchain
7 2 (0.99%) Cloud Native
7 2 (0.99%) Low-Code
7 2 (0.99%) Reinsurance
8 1 (0.49%) Data Fabric
Processes & Methodologies
1 134 (66.01%) Agile
2 124 (61.08%) Software Engineering
3 119 (58.62%) Asset Management
4 112 (55.17%) Data Engineering
5 96 (47.29%) DevOps
6 93 (45.81%) CI/CD
7 59 (29.06%) Open Source
7 59 (29.06%) Site Reliability Engineering
8 40 (19.70%) Data Pipeline
9 39 (19.21%) ETL
10 34 (16.75%) Analytics
11 33 (16.26%) Data Management
12 32 (15.76%) Data Science
13 31 (15.27%) Data Modelling
14 27 (13.30%) Visualisation
15 22 (10.84%) Data Transformation
15 22 (10.84%) Machine Learning
16 19 (9.36%) Business Intelligence
17 17 (8.37%) Data Analysis
17 17 (8.37%) Problem-Solving
Programming Languages
1 199 (98.03%) Python
2 126 (62.07%) Java
3 104 (51.23%) SQL
4 59 (29.06%) Go
5 15 (7.39%) JavaScript
5 15 (7.39%) Scala
6 12 (5.91%) TypeScript
7 6 (2.96%) T-SQL
8 3 (1.48%) Cypher
9 1 (0.49%) Bicep
9 1 (0.49%) C#
9 1 (0.49%) C++
9 1 (0.49%) PowerShell
9 1 (0.49%) R
9 1 (0.49%) VB
Qualifications
1 26 (12.81%) Degree
2 23 (11.33%) Security Cleared
3 21 (10.34%) SC Cleared
4 10 (4.93%) Master's Degree
5 9 (4.43%) DBS Check
6 8 (3.94%) Azure Certification
7 1 (0.49%) AWS Certification
7 1 (0.49%) Computer Science Degree
7 1 (0.49%) Numerate Degree
Quality Assurance & Compliance
1 19 (9.36%) Data Quality
System Software
1 73 (35.96%) Docker
2 5 (2.46%) Apache Flume
Systems Management
1 85 (41.87%) Terraform
2 71 (34.98%) Kubernetes
3 5 (2.46%) Oozie
Vendors
1 60 (29.56%) Databricks
2 7 (3.45%) Microsoft
3 6 (2.96%) Cloudera
4 3 (1.48%) Google
5 2 (0.99%) Foundry
5 2 (0.99%) Palantir
6 1 (0.49%) CheckPoint
6 1 (0.49%) Informatica
6 1 (0.49%) Oracle
6 1 (0.49%) Splunk