PySpark Jobs in Central London

PySpark - Spark Python API
London > Central London

The following table provides summary statistics for permanent job vacancies advertised in Central London with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 15 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
15 May 2024
Same period 2023 Same period 2022
Rank 136 229 278
Rank change year-on-year +93 +49 -34
Permanent jobs citing PySpark 54 16 27
As % of all permanent jobs advertised in Central London 1.43% 0.31% 0.33%
As % of the Libraries, Frameworks & Software Standards category 5.84% 0.94% 1.02%
Number of salaries quoted 19 13 11
10th Percentile £49,450 £63,650 £45,000
25th Percentile £53,125 £68,250 £48,750
Median annual salary (50th Percentile) £70,000 £85,000 £65,000
Median % change year-on-year -17.65% +30.77% -3.70%
75th Percentile £72,500 £92,500 £75,625
90th Percentile £74,500 £116,000 £76,250
London median annual salary £70,000 £90,000 £72,500
% change year-on-year -22.22% +24.14% +11.54%

All Software Libraries and Frameworks
Central London

PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Central London with a requirement for technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 924 1,703 2,654
As % of all permanent jobs advertised in Central London 24.52% 33.18% 32.61%
Number of salaries quoted 744 1,499 2,267
10th Percentile £45,750 £50,000 £48,750
25th Percentile £58,750 £62,500 £60,000
Median annual salary (50th Percentile) £75,000 £80,000 £77,500
Median % change year-on-year -6.25% +3.23% +6.90%
75th Percentile £100,000 £100,000 £97,500
90th Percentile £115,000 £115,000 £111,750
London median annual salary £80,000 £80,000 £77,250
% change year-on-year - +3.56% +10.36%

PySpark
Job Vacancy Trend in Central London

Job postings citing PySpark as a proportion of all IT jobs advertised in Central London.

Job vacancy trend for PySpark in Central London

PySpark
Salary Trend in Central London

3-month moving average salary quoted in jobs citing PySpark in Central London.

Salary trend for PySpark in Central London

PySpark
Salary Histogram in Central London

Salary distribution for jobs citing PySpark in Central London over the 6 months to 15 May 2024.

Salary histogram for PySpark in Central London

PySpark
Job Locations in Central London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the Central London region over the 6 months to 15 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
City of London +81 44 £68,750 -8.33% 3
West End of London +19 9 - -
City of Westminster -2 9 £57,500 -64.06%
PySpark
London

PySpark
Co-occurring Skills and Capabilities in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (1.85%) Apache Airflow
1 1 (1.85%) Apache Spark
1 1 (1.85%) SharePoint
Cloud Services
1 15 (27.78%) Azure
2 8 (14.81%) AWS
2 8 (14.81%) Azure Data Factory
3 6 (11.11%) GCP
4 2 (3.70%) Azure DevOps
4 2 (3.70%) Azure Synapse Analytics
4 2 (3.70%) Power Platform
5 1 (1.85%) Azure Cosmos DB
5 1 (1.85%) Azure Functions
5 1 (1.85%) Azure Logic Apps
5 1 (1.85%) Azure Stack
5 1 (1.85%) Dynamics 365
5 1 (1.85%) Serverless
5 1 (1.85%) Snowflake
Database & Business Intelligence
1 32 (59.26%) Tableau
2 16 (29.63%) Data Warehouse
3 7 (12.96%) Data Lake
4 5 (9.26%) Spark SQL
5 2 (3.70%) Power BI
5 2 (3.70%) SQL Server Integration Services
6 1 (1.85%) Apache Hive
6 1 (1.85%) Azure SQL Database
6 1 (1.85%) Big Data
6 1 (1.85%) Delta Lake
6 1 (1.85%) Hadoop
6 1 (1.85%) Impala
6 1 (1.85%) NoSQL
6 1 (1.85%) PostgreSQL
6 1 (1.85%) Presto
6 1 (1.85%) SQL Server
Development Applications
1 33 (61.11%) Git
2 1 (1.85%) JMeter
2 1 (1.85%) Postman
2 1 (1.85%) Selenium
2 1 (1.85%) SoapUI
2 1 (1.85%) SpecFlow
General
1 33 (61.11%) Social Skills
2 4 (7.41%) Finance
3 1 (1.85%) Organisational Skills
Job Titles
1 33 (61.11%) Senior
2 32 (59.26%) Data Scientist
2 32 (59.26%) Senior Data Scientist
3 21 (38.89%) Data Engineer
4 3 (5.56%) AWS Data Engineer
4 3 (5.56%) AWS Engineer
5 2 (3.70%) Azure Data Engineer
5 2 (3.70%) Azure Engineer
5 2 (3.70%) GCP Data Engineer
5 2 (3.70%) GCP Engineer
5 2 (3.70%) Lead
5 2 (3.70%) Lead Data Engineer
6 1 (1.85%) Automation Tester
6 1 (1.85%) QA Automation Tester
6 1 (1.85%) QA Tester
6 1 (1.85%) Senior Data Engineer
6 1 (1.85%) Tester
Libraries, Frameworks & Software Standards
1 32 (59.26%) Pandas
1 32 (59.26%) scikit-learn
1 32 (59.26%) TensorFlow
2 1 (1.85%) .NET
2 1 (1.85%) .NET Framework
2 1 (1.85%) ASP.NET Web API
2 1 (1.85%) CSS
2 1 (1.85%) HTML
2 1 (1.85%) jQuery
2 1 (1.85%) Kafka
2 1 (1.85%) React
2 1 (1.85%) RESTful
2 1 (1.85%) Swagger
2 1 (1.85%) Twitter Bootstrap
Miscellaneous
1 33 (61.11%) Algorithms
2 1 (1.85%) Distributed Systems
Processes & Methodologies
1 45 (83.33%) Data Science
2 33 (61.11%) Machine Learning
3 32 (59.26%) Actionable Insight
3 32 (59.26%) Artificial Intelligence
3 32 (59.26%) Customer Experience
3 32 (59.26%) Data Munging
3 32 (59.26%) Decision-Making
3 32 (59.26%) Demand Forecasting
3 32 (59.26%) Generative AI
3 32 (59.26%) Mathematics
3 32 (59.26%) MLOps
3 32 (59.26%) Natural Language Processing
3 32 (59.26%) Neural Network
3 32 (59.26%) Predictive Modelling
3 32 (59.26%) Propensity Modelling
3 32 (59.26%) Root Cause Analysis
3 32 (59.26%) Statistics
3 32 (59.26%) Storytelling
3 32 (59.26%) Visualisation
3 32 (59.26%) WFM
Programming Languages
1 52 (96.30%) Python
2 51 (94.44%) SQL
3 1 (1.85%) C#
3 1 (1.85%) C++
3 1 (1.85%) Java
3 1 (1.85%) PL/SQL
3 1 (1.85%) Scala
Qualifications
1 33 (61.11%) Degree
1 33 (61.11%) Master's Degree
2 32 (59.26%) DBS Check
Quality Assurance & Compliance
1 1 (1.85%) Data Quality
1 1 (1.85%) QA
Vendors
1 39 (72.22%) Databricks
2 1 (1.85%) Oracle