PySpark Jobs in the City of London

PySpark - Spark Python API
Central London > City of London

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 30 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
30 May 2024
Same period 2023 Same period 2022
Rank 135 216 262
Rank change year-on-year +81 +46 -37
Permanent jobs citing PySpark 43 14 27
As % of all permanent jobs advertised in the City of London 1.29% 0.31% 0.36%
As % of the Libraries, Frameworks & Software Standards category 5.05% 0.91% 1.11%
Number of salaries quoted 17 11 9
10th Percentile £48,900 £62,500 £48,750
25th Percentile £52,500 £68,250 £61,500
Median annual salary (50th Percentile) £67,500 £75,000 £65,000
Median % change year-on-year -10.00% +15.38% -
75th Percentile £72,500 £88,750 £76,250
90th Percentile - £100,000 £77,000
Central London median annual salary £68,750 £85,000 £65,000
% change year-on-year -19.12% +30.77% -

All Software Libraries and Frameworks
City of London

PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 851 1,545 2,430
As % of all permanent jobs advertised in the City of London 25.43% 34.52% 32.60%
Number of salaries quoted 683 1,357 2,027
10th Percentile £46,250 £51,250 £48,750
25th Percentile £58,750 £62,500 £60,000
Median annual salary (50th Percentile) £77,500 £80,000 £77,500
Median % change year-on-year -3.13% +3.23% +3.33%
75th Percentile £100,000 £102,500 £100,000
90th Percentile £118,150 £117,500 £110,000
Central London median annual salary £75,000 £80,000 £77,500
% change year-on-year -6.25% +3.23% +6.90%

PySpark
Job Vacancy Trend in the City of London

Job postings citing PySpark as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for PySpark in the City of London

PySpark
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing PySpark in the City of London.

Salary trend for PySpark in the City of London

PySpark
Salary Histogram in the City of London

Salary distribution for jobs citing PySpark in the City of London over the 6 months to 30 May 2024.

Salary histogram for PySpark in the City of London

PySpark
Co-occurring Skills and Capabilities in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (2.33%) SharePoint
Cloud Services
1 14 (32.56%) Azure
2 7 (16.28%) Azure Data Factory
3 6 (13.95%) AWS
3 6 (13.95%) GCP
4 3 (6.98%) Azure Synapse Analytics
5 2 (4.65%) Power Platform
6 1 (2.33%) Azure Cosmos DB
6 1 (2.33%) Azure DevOps
6 1 (2.33%) Azure Functions
6 1 (2.33%) Azure Logic Apps
6 1 (2.33%) Dynamics 365
6 1 (2.33%) Serverless
Database & Business Intelligence
1 23 (53.49%) Tableau
2 16 (37.21%) Data Warehouse
3 7 (16.28%) Data Lake
4 5 (11.63%) Spark SQL
5 2 (4.65%) Power BI
5 2 (4.65%) SQL Server
5 2 (4.65%) SQL Server Integration Services
6 1 (2.33%) Azure SQL Database
6 1 (2.33%) Delta Lake
6 1 (2.33%) NoSQL
6 1 (2.33%) PostgreSQL
Development Applications
1 24 (55.81%) Git
2 1 (2.33%) JMeter
2 1 (2.33%) Postman
2 1 (2.33%) Selenium
2 1 (2.33%) SoapUI
2 1 (2.33%) SpecFlow
General
1 24 (55.81%) Social Skills
2 4 (9.30%) Finance
3 1 (2.33%) Organisational Skills
Job Titles
1 23 (53.49%) Data Scientist
1 23 (53.49%) Senior
1 23 (53.49%) Senior Data Scientist
2 19 (44.19%) Data Engineer
3 2 (4.65%) AWS Data Engineer
3 2 (4.65%) AWS Engineer
3 2 (4.65%) Azure Data Engineer
3 2 (4.65%) Azure Engineer
3 2 (4.65%) GCP Data Engineer
3 2 (4.65%) GCP Engineer
4 1 (2.33%) Automation Tester
4 1 (2.33%) Lead
4 1 (2.33%) Lead Data Engineer
4 1 (2.33%) QA Automation Tester
4 1 (2.33%) QA Tester
4 1 (2.33%) Tester
Libraries, Frameworks & Software Standards
1 23 (53.49%) Pandas
1 23 (53.49%) scikit-learn
1 23 (53.49%) TensorFlow
2 1 (2.33%) .NET
2 1 (2.33%) .NET Framework
2 1 (2.33%) ASP.NET Web API
2 1 (2.33%) CSS
2 1 (2.33%) HTML
2 1 (2.33%) jQuery
2 1 (2.33%) React
2 1 (2.33%) RESTful
2 1 (2.33%) Swagger
2 1 (2.33%) Twitter Bootstrap
Miscellaneous
1 23 (53.49%) Algorithms
Processes & Methodologies
1 35 (81.40%) Data Science
2 23 (53.49%) Actionable Insight
2 23 (53.49%) Artificial Intelligence
2 23 (53.49%) Customer Experience
2 23 (53.49%) Data Munging
2 23 (53.49%) Decision-Making
2 23 (53.49%) Demand Forecasting
2 23 (53.49%) Generative AI
2 23 (53.49%) Machine Learning
2 23 (53.49%) Mathematics
2 23 (53.49%) MLOps
2 23 (53.49%) Natural Language Processing
2 23 (53.49%) Neural Network
2 23 (53.49%) Predictive Modelling
2 23 (53.49%) Propensity Modelling
2 23 (53.49%) Root Cause Analysis
2 23 (53.49%) Statistics
2 23 (53.49%) Storytelling
2 23 (53.49%) Visualisation
2 23 (53.49%) WFM
Programming Languages
1 42 (97.67%) SQL
2 41 (95.35%) Python
3 1 (2.33%) C#
3 1 (2.33%) PL/SQL
3 1 (2.33%) T-SQL
Qualifications
1 23 (53.49%) DBS Check
1 23 (53.49%) Degree
1 23 (53.49%) Master's Degree
Quality Assurance & Compliance
1 1 (2.33%) Data Quality
1 1 (2.33%) QA
Vendors
1 29 (67.44%) Databricks
2 1 (2.33%) Oracle