PySpark Jobs in the City of London

PySpark - Spark Python API
Central London > City of London

The table below provides summary statistics for permanent job vacancies advertised in the City of London requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 31 May 2025, comparing them to the same period in the previous two years.

6 months to
31 May 2025
Same period 2024 Same period 2023
Rank 127 135 216
Rank change year-on-year +8 +81 +46
Permanent jobs citing PySpark 12 43 14
As % of all permanent jobs advertised in the City of London 0.61% 1.29% 0.31%
As % of the Libraries, Frameworks & Software Standards category 2.06% 5.05% 0.91%
Number of salaries quoted 6 17 11
10th Percentile £76,750 £48,900 £62,500
25th Percentile £98,250 £52,500 £68,250
Median annual salary (50th Percentile) £110,000 £67,500 £75,000
Median % change year-on-year +62.96% -10.00% +15.38%
75th Percentile £113,750 £72,500 £88,750
90th Percentile £118,750 - £100,000
Central London median annual salary £85,000 £68,750 £85,000
% change year-on-year +23.64% -19.12% +30.77%

All Software Libraries and Frameworks
City of London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in the City of London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 583 851 1,545
As % of all permanent jobs advertised in the City of London 29.81% 25.43% 34.52%
Number of salaries quoted 482 683 1,357
10th Percentile £47,500 £46,250 £51,250
25th Percentile £58,750 £58,750 £62,500
Median annual salary (50th Percentile) £77,500 £77,500 £80,000
Median % change year-on-year - -3.13% +3.23%
75th Percentile £105,000 £100,000 £102,500
90th Percentile £117,725 £118,150 £117,500
Central London median annual salary £78,750 £75,000 £80,000
% change year-on-year +5.00% -6.25% +3.23%

PySpark
Job Vacancy Trend in the City of London

Job postings citing PySpark as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for PySpark in the City of London

PySpark
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing PySpark in the City of London.

Salary trend for PySpark in the City of London

PySpark
Salary Histogram in the City of London

Salary distribution for jobs citing PySpark in the City of London over the 6 months to 31 May 2025.

Salary histogram for PySpark in the City of London

PySpark
Co-occurring Skills and Capabilities in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (8.33%) Apache
1 1 (8.33%) Apache Airflow
Cloud Services
1 7 (58.33%) Azure
2 4 (33.33%) AWS
2 4 (33.33%) GCP
3 2 (16.67%) Azure Data Factory
4 1 (8.33%) Azure DevOps
4 1 (8.33%) Azure Functions
4 1 (8.33%) Azure Logic Apps
4 1 (8.33%) Cloud Computing
4 1 (8.33%) Collibra
4 1 (8.33%) dbt
4 1 (8.33%) Microsoft Purview
4 1 (8.33%) PaaS
4 1 (8.33%) Power Platform
4 1 (8.33%) SaaS
4 1 (8.33%) Serverless
Database & Business Intelligence
1 3 (25.00%) Big Data
1 3 (25.00%) Data Warehouse
1 3 (25.00%) Tableau
2 2 (16.67%) Data Lake
2 2 (16.67%) Delta Lake
2 2 (16.67%) Parquet
3 1 (8.33%) Azure SQL Database
3 1 (8.33%) BigQuery
3 1 (8.33%) Metadata
3 1 (8.33%) MongoDB
3 1 (8.33%) Neo4j
3 1 (8.33%) PostgreSQL
3 1 (8.33%) Power BI
3 1 (8.33%) SQL Server
Development Applications
1 4 (33.33%) Git
General
1 4 (33.33%) Social Skills
2 3 (25.00%) Analytical Skills
3 2 (16.67%) Finance
4 1 (8.33%) Banking
4 1 (8.33%) Law
4 1 (8.33%) Marketing
Job Titles
1 7 (58.33%) Data Engineer
2 5 (41.67%) Lead
3 4 (33.33%) Senior
4 3 (25.00%) Data Scientist
4 3 (25.00%) Lead Data Engineer
4 3 (25.00%) Principal Data Scientist
4 3 (25.00%) Senior Data Scientist
5 1 (8.33%) Azure Data Engineer
5 1 (8.33%) Azure Engineer
5 1 (8.33%) Head of Engineering
5 1 (8.33%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 3 (25.00%) Pandas
1 3 (25.00%) scikit-learn
1 3 (25.00%) TensorFlow
2 2 (16.67%) pytest
3 1 (8.33%) Apache Avro
3 1 (8.33%) Flask
3 1 (8.33%) REST
Miscellaneous
1 3 (25.00%) Algorithms
1 3 (25.00%) Credit Risk
2 2 (16.67%) Reinsurance
3 1 (8.33%) Cloud Native
Processes & Methodologies
1 7 (58.33%) Data Science
1 7 (58.33%) ETL
2 6 (50.00%) Data Engineering
3 5 (41.67%) Machine Learning
4 4 (33.33%) CI/CD
4 4 (33.33%) Data Modelling
4 4 (33.33%) DevOps
4 4 (33.33%) Mathematics
4 4 (33.33%) Predictive Modelling
4 4 (33.33%) Statistics
4 4 (33.33%) Visualisation
5 3 (25.00%) Actionable Insight
5 3 (25.00%) Computer Science
5 3 (25.00%) Customer Experience
5 3 (25.00%) Data Pipeline
5 3 (25.00%) Decision-Making
5 3 (25.00%) Generative AI
5 3 (25.00%) MLOps
5 3 (25.00%) Physics
5 3 (25.00%) Storytelling
Programming Languages
1 11 (91.67%) Python
2 10 (83.33%) SQL
3 1 (8.33%) Cypher
3 1 (8.33%) Scala
Qualifications
1 6 (50.00%) Degree
2 4 (33.33%) Master's Degree
3 3 (25.00%) DBS Check
4 1 (8.33%) Computer Science Degree
4 1 (8.33%) Numerate Degree
Quality Assurance & Compliance
1 1 (8.33%) Data Quality
System Software
1 2 (16.67%) Docker
Systems Management
1 2 (16.67%) Kubernetes
1 2 (16.67%) Terraform
Vendors
1 10 (83.33%) Databricks
2 1 (8.33%) Google
2 1 (8.33%) Informatica
2 1 (8.33%) Microsoft