PySpark Jobs in Central London

PySpark - Spark Python API
London > Central London

The table below provides summary statistics for permanent job vacancies advertised in Central London requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 30 April 2025, comparing them to the same period in the previous two years.

6 months to
30 Apr 2025
Same period 2024 Same period 2023
Rank 148 154 231
Rank change year-on-year +6 +77 +42
Permanent jobs citing PySpark 17 43 15
As % of all permanent jobs advertised in Central London 0.67% 1.14% 0.28%
As % of the Libraries, Frameworks & Software Standards category 2.34% 4.52% 0.85%
Number of salaries quoted 9 21 12
10th Percentile £56,000 £50,000 £63,075
25th Percentile £57,500 £53,750 £68,250
Median annual salary (50th Percentile) £96,000 £70,000 £80,000
Median % change year-on-year +37.14% -12.50% +18.52%
75th Percentile £110,000 £72,500 £90,625
90th Percentile £116,500 - £99,250
London median annual salary £110,000 £70,000 £90,000
% change year-on-year +57.14% -22.22% +24.14%

All Software Libraries and Frameworks
Central London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in Central London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 725 952 1,759
As % of all permanent jobs advertised in Central London 28.54% 25.17% 33.20%
Number of salaries quoted 575 787 1,559
10th Percentile £47,500 £46,250 £50,000
25th Percentile £59,380 £58,750 £62,500
Median annual salary (50th Percentile) £77,500 £77,500 £80,000
Median % change year-on-year - -3.13% +3.23%
75th Percentile £103,750 £101,250 £101,125
90th Percentile £117,500 £115,000 £115,000
London median annual salary £82,500 £80,000 £80,000
% change year-on-year +3.13% - +3.23%

PySpark
Job Vacancy Trend in Central London

Job postings citing PySpark as a proportion of all IT jobs advertised in Central London.

Job vacancy trend for PySpark in Central London

PySpark
Salary Trend in Central London

3-month moving average salary quoted in jobs citing PySpark in Central London.

Salary trend for PySpark in Central London

PySpark
Salary Histogram in Central London

Salary distribution for jobs citing PySpark in Central London over the 6 months to 30 April 2025.

Salary histogram for PySpark in Central London

PySpark
Job Locations in Central London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the Central London region over the 6 months to 30 April 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
City of London +15 14 £96,000 +39.64% 4
West End of London -4 3 - -
City of Westminster -16 1 - -
PySpark
London

PySpark
Co-occurring Skills and Capabilities in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (5.88%) Apache
1 1 (5.88%) Apache Airflow
Cloud Services
1 8 (47.06%) Azure
2 5 (29.41%) AWS
3 4 (23.53%) Azure Data Factory
3 4 (23.53%) GCP
4 2 (11.76%) Azure Synapse Analytics
4 2 (11.76%) Power Platform
5 1 (5.88%) Azure DevOps
5 1 (5.88%) Azure Functions
5 1 (5.88%) Azure Logic Apps
5 1 (5.88%) Cloud Computing
5 1 (5.88%) dbt
5 1 (5.88%) PaaS
5 1 (5.88%) SaaS
5 1 (5.88%) Serverless
Database & Business Intelligence
1 6 (35.29%) Tableau
2 3 (17.65%) Big Data
2 3 (17.65%) Data Lake
2 3 (17.65%) Data Warehouse
3 2 (11.76%) Parquet
3 2 (11.76%) Power BI
3 2 (11.76%) SQL Server
4 1 (5.88%) Azure SQL Database
4 1 (5.88%) BigQuery
4 1 (5.88%) Data Vault
4 1 (5.88%) Delta Lake
4 1 (5.88%) Metadata
4 1 (5.88%) Metadata Repository
4 1 (5.88%) Microsoft Analysis Services
4 1 (5.88%) MongoDB
4 1 (5.88%) Neo4j
4 1 (5.88%) PostgreSQL
4 1 (5.88%) SQL Server Analysis Services
4 1 (5.88%) SQL Server Integration Services
4 1 (5.88%) SQL Server Reporting Services
Development Applications
1 7 (41.18%) Git
2 1 (5.88%) JMeter
General
1 8 (47.06%) Social Skills
2 4 (23.53%) Analytical Skills
3 2 (11.76%) Finance
3 2 (11.76%) Influencing Skills
4 1 (5.88%) Law
4 1 (5.88%) Marketing
Job Titles
1 9 (52.94%) Senior
2 8 (47.06%) Data Engineer
3 6 (35.29%) Data Scientist
3 6 (35.29%) Principal Data Scientist
3 6 (35.29%) Senior Data Scientist
4 5 (29.41%) Lead
5 3 (17.65%) Lead Data Engineer
5 3 (17.65%) Senior Data Engineer
6 1 (5.88%) AWS Engineer
6 1 (5.88%) Head of Engineering
6 1 (5.88%) Test Engineer
Libraries, Frameworks & Software Standards
1 6 (35.29%) Pandas
1 6 (35.29%) scikit-learn
1 6 (35.29%) TensorFlow
2 2 (11.76%) pytest
3 1 (5.88%) Apache Avro
3 1 (5.88%) Flask
3 1 (5.88%) Kafka
3 1 (5.88%) REST
Miscellaneous
1 6 (35.29%) Algorithms
1 6 (35.29%) Credit Risk
2 2 (11.76%) Reinsurance
3 1 (5.88%) Cloud Native
Processes & Methodologies
1 10 (58.82%) Data Science
2 8 (47.06%) ETL
2 8 (47.06%) Machine Learning
3 7 (41.18%) Mathematics
3 7 (41.18%) Predictive Modelling
3 7 (41.18%) Statistics
3 7 (41.18%) Visualisation
4 6 (35.29%) Actionable Insight
4 6 (35.29%) Artificial Intelligence
4 6 (35.29%) Data Engineering
4 6 (35.29%) Data Munging
4 6 (35.29%) Decision-Making
4 6 (35.29%) Demand Forecasting
4 6 (35.29%) Natural Language Processing
4 6 (35.29%) Neural Network
4 6 (35.29%) Physics
4 6 (35.29%) Propensity Modelling
4 6 (35.29%) Root Cause Analysis
4 6 (35.29%) Storytelling
4 6 (35.29%) WFM
Programming Languages
1 13 (76.47%) Python
2 12 (70.59%) SQL
3 1 (5.88%) Cypher
3 1 (5.88%) Groovy
Qualifications
1 10 (58.82%) Degree
2 7 (41.18%) DBS Check
2 7 (41.18%) Master's Degree
3 2 (11.76%) Computer Science Degree
4 1 (5.88%) Numerate Degree
System Software
1 2 (11.76%) Docker
Systems Management
1 2 (11.76%) Kubernetes
1 2 (11.76%) Terraform
Vendors
1 14 (82.35%) Databricks
2 3 (17.65%) Microsoft
3 1 (5.88%) Google
3 1 (5.88%) StreamSets