PySpark Jobs in the City of London

PySpark - Spark Python API
Central London > City of London

The table below provides summary statistics for permanent job vacancies advertised in the City of London requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 24 May 2025, comparing them to the same period in the previous two years.

6 months to
24 May 2025
Same period 2024 Same period 2023
Rank 125 138 219
Rank change year-on-year +13 +81 +40
Permanent jobs citing PySpark 13 42 14
As % of all permanent jobs advertised in the City of London 0.67% 1.26% 0.31%
As % of the Libraries, Frameworks & Software Standards category 2.21% 4.88% 0.89%
Number of salaries quoted 7 16 11
10th Percentile £59,000 £48,625 £62,500
25th Percentile £78,000 £52,500 £68,250
Median annual salary (50th Percentile) £110,000 £66,250 £75,000
Median % change year-on-year +66.04% -11.67% +15.38%
75th Percentile £112,500 £72,500 £88,750
90th Percentile £118,000 - £100,000
Central London median annual salary £85,000 £67,500 £85,000
% change year-on-year +25.93% -20.59% +30.77%

All Software Libraries and Frameworks
City of London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in the City of London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 589 861 1,577
As % of all permanent jobs advertised in the City of London 30.49% 25.79% 34.53%
Number of salaries quoted 489 699 1,383
10th Percentile £47,500 £46,250 £51,250
25th Percentile £57,670 £60,000 £62,500
Median annual salary (50th Percentile) £77,500 £77,500 £80,000
Median % change year-on-year - -3.13% +3.23%
75th Percentile £105,000 £100,000 £102,500
90th Percentile £117,500 £117,850 £117,500
Central London median annual salary £77,500 £75,000 £80,000
% change year-on-year +3.33% -6.25% +3.23%

PySpark
Job Vacancy Trend in the City of London

Job postings citing PySpark as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for PySpark in the City of London

PySpark
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing PySpark in the City of London.

Salary trend for PySpark in the City of London

PySpark
Salary Histogram in the City of London

Salary distribution for jobs citing PySpark in the City of London over the 6 months to 24 May 2025.

Salary histogram for PySpark in the City of London

PySpark
Co-occurring Skills and Capabilities in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (7.69%) Apache
1 1 (7.69%) Apache Airflow
Cloud Services
1 8 (61.54%) Azure
2 4 (30.77%) AWS
2 4 (30.77%) GCP
3 3 (23.08%) Azure Data Factory
4 2 (15.38%) Power Platform
5 1 (7.69%) Azure DevOps
5 1 (7.69%) Azure Functions
5 1 (7.69%) Azure Logic Apps
5 1 (7.69%) Azure Synapse Analytics
5 1 (7.69%) Cloud Computing
5 1 (7.69%) Collibra
5 1 (7.69%) dbt
5 1 (7.69%) Microsoft Purview
5 1 (7.69%) PaaS
5 1 (7.69%) SaaS
5 1 (7.69%) Serverless
Database & Business Intelligence
1 3 (23.08%) Big Data
1 3 (23.08%) Data Lake
1 3 (23.08%) Data Warehouse
1 3 (23.08%) Tableau
2 2 (15.38%) Delta Lake
2 2 (15.38%) Metadata
2 2 (15.38%) Parquet
2 2 (15.38%) Power BI
2 2 (15.38%) SQL Server
3 1 (7.69%) Azure SQL Database
3 1 (7.69%) BigQuery
3 1 (7.69%) Data Vault
3 1 (7.69%) Metadata Repository
3 1 (7.69%) Microsoft Analysis Services
3 1 (7.69%) MongoDB
3 1 (7.69%) Neo4j
3 1 (7.69%) PostgreSQL
3 1 (7.69%) SQL Server Analysis Services
3 1 (7.69%) SQL Server Integration Services
3 1 (7.69%) SQL Server Reporting Services
Development Applications
1 4 (30.77%) Git
General
1 4 (30.77%) Social Skills
2 3 (23.08%) Analytical Skills
3 2 (15.38%) Finance
4 1 (7.69%) Banking
4 1 (7.69%) Influencing Skills
4 1 (7.69%) Law
4 1 (7.69%) Marketing
Job Titles
1 8 (61.54%) Data Engineer
2 5 (38.46%) Lead
2 5 (38.46%) Senior
3 3 (23.08%) Data Scientist
3 3 (23.08%) Lead Data Engineer
3 3 (23.08%) Principal Data Scientist
3 3 (23.08%) Senior Data Scientist
4 2 (15.38%) Senior Data Engineer
5 1 (7.69%) Azure Data Engineer
5 1 (7.69%) Azure Engineer
5 1 (7.69%) Head of Engineering
Libraries, Frameworks & Software Standards
1 3 (23.08%) Pandas
1 3 (23.08%) scikit-learn
1 3 (23.08%) TensorFlow
2 2 (15.38%) pytest
3 1 (7.69%) Apache Avro
3 1 (7.69%) Flask
3 1 (7.69%) REST
Miscellaneous
1 3 (23.08%) Algorithms
1 3 (23.08%) Credit Risk
2 2 (15.38%) Reinsurance
3 1 (7.69%) Cloud Native
Processes & Methodologies
1 8 (61.54%) ETL
2 7 (53.85%) Data Engineering
2 7 (53.85%) Data Science
3 5 (38.46%) Machine Learning
4 4 (30.77%) CI/CD
4 4 (30.77%) Data Modelling
4 4 (30.77%) Data Pipeline
4 4 (30.77%) DevOps
4 4 (30.77%) Mathematics
4 4 (30.77%) Predictive Modelling
4 4 (30.77%) Statistics
4 4 (30.77%) Visualisation
5 3 (23.08%) Artificial Intelligence
5 3 (23.08%) Customer Experience
5 3 (23.08%) Decision-Making
5 3 (23.08%) Generative AI
5 3 (23.08%) MLOps
5 3 (23.08%) Neural Network
5 3 (23.08%) Propensity Modelling
5 3 (23.08%) Storytelling
Programming Languages
1 11 (84.62%) Python
2 10 (76.92%) SQL
3 1 (7.69%) Cypher
3 1 (7.69%) Scala
Qualifications
1 6 (46.15%) Degree
2 4 (30.77%) DBS Check
2 4 (30.77%) Master's Degree
3 1 (7.69%) Computer Science Degree
3 1 (7.69%) Numerate Degree
Quality Assurance & Compliance
1 1 (7.69%) Data Quality
System Software
1 2 (15.38%) Docker
Systems Management
1 2 (15.38%) Kubernetes
1 2 (15.38%) Terraform
Vendors
1 11 (84.62%) Databricks
2 2 (15.38%) Microsoft
3 1 (7.69%) Google
3 1 (7.69%) Informatica