PySpark Job Trends in London

PySpark - Spark Python API
England > London

The table below provides summary statistics and salary benchmarking for jobs advertised in London requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 14 January 2026, with comparisons to the same periods in the previous two years.

6 months to
14 Jan 2026
Same period 2025 Same period 2024
Rank 306 247 342
Rank change year-on-year -59 +95 +149
Permanent jobs citing PySpark 68 192 101
As % of all permanent jobs in London 0.48% 1.24% 0.55%
As % of the Libraries, Frameworks & Software Standards category 2.56% 4.64% 2.02%
Number of salaries quoted 42 175 84
10th Percentile £52,410 £70,500 £52,500
25th Percentile £67,500 £83,750 £55,000
Median annual salary (50th Percentile) £90,000 £110,000 £71,250
Median % change year-on-year -18.18% +54.39% -14.93%
75th Percentile £103,750 £138,750 £100,000
90th Percentile £120,000 £147,500 £140,000
England median annual salary £71,193 £107,500 £67,500
% change year-on-year -33.77% +59.26% -15.63%

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 2,658 4,138 4,999
As % of all permanent jobs advertised in London 18.85% 26.67% 27.46%
Number of salaries quoted 1,913 2,553 4,333
10th Percentile £50,000 £52,500 £51,250
25th Percentile £62,500 £62,500 £61,250
Median annual salary (50th Percentile) £82,500 £82,500 £80,000
Median % change year-on-year - +3.13% -
75th Percentile £107,500 £107,500 £102,500
90th Percentile £132,500 £125,000 £120,000
England median annual salary £65,000 £66,000 £65,000
% change year-on-year -1.52% +1.54% -3.70%

PySpark
Job Vacancy Trend in London

Historical trend showing the proportion of permanent IT job postings citing PySpark relative to all permanent IT jobs advertised in London.

PySpark job vacancy trend in London

PySpark
Salary Trend in London

Salary distribution trend for jobs in London citing PySpark.

Salary distribution trend for jobs in London citing PySpark

PySpark
Salary Histogram in London

Salary distribution for jobs citing PySpark in London over the 6 months to 14 January 2026.

Salary histogram for PySpark in London

PySpark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the London region over the 6 months to 14 January 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +38 19 £95,000 +58.33% 17
West London +3 3 £75,000 -9.09% 3
South London - 2 £48,975 - 4
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in London by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 16 (23.53%) Apache Spark
2 10 (14.71%) Apache
3 7 (10.29%) Apache Airflow
4 2 (2.94%) SAS
5 1 (1.47%) Jupyter
Applications
1 3 (4.41%) Microsoft Excel
2 2 (2.94%) Microsoft PowerPoint
Cloud Services
1 49 (72.06%) Azure
2 31 (45.59%) AWS
3 22 (32.35%) Azure Data Factory
4 19 (27.94%) Power Platform
5 17 (25.00%) Azure Synapse Analytics
6 16 (23.53%) Azure DevOps
7 13 (19.12%) GCP
8 9 (13.24%) Amazon S3
8 9 (13.24%) GitHub
9 8 (11.76%) Serverless
10 7 (10.29%) Azure Monitor
11 6 (8.82%) AWS Lambda
12 4 (5.88%) Azure AI
12 4 (5.88%) Azure Machine Learning
12 4 (5.88%) dbt
12 4 (5.88%) Microsoft Purview
13 3 (4.41%) AWS CloudFormation
13 3 (4.41%) SaaS
14 2 (2.94%) Amazon EMR
14 2 (2.94%) Amazon Kinesis
Database & Business Intelligence
1 19 (27.94%) Data Warehouse
1 19 (27.94%) Power BI
2 17 (25.00%) Data Lake
2 17 (25.00%) Delta Lake
3 10 (14.71%) Azure SQL Database
4 8 (11.76%) Tableau
5 7 (10.29%) Big Data
5 7 (10.29%) SQL Server
6 6 (8.82%) Metadata
7 5 (7.35%) Amazon Redshift
8 4 (5.88%) Amazon Athena
9 3 (4.41%) Hadoop
9 3 (4.41%) MySQL
9 3 (4.41%) Snowflake Schema
10 2 (2.94%) Amazon RDS
10 2 (2.94%) Apache Hive
10 2 (2.94%) Impala
10 2 (2.94%) Parquet
10 2 (2.94%) Relational Database
11 1 (1.47%) IBM InfoSphere
Development Applications
1 24 (35.29%) Git
2 6 (8.82%) MLflow
3 3 (4.41%) Jenkins
4 1 (1.47%) JIRA
4 1 (1.47%) Team Foundation Server
General
1 26 (38.24%) Finance
2 19 (27.94%) Social Skills
3 12 (17.65%) Analytical Skills
4 9 (13.24%) Retail
5 6 (8.82%) Manufacturing
6 5 (7.35%) Inclusion and Diversity
7 4 (5.88%) Marketing
7 4 (5.88%) Organisational Skills
8 3 (4.41%) Public Sector
9 2 (2.94%) Banking
9 2 (2.94%) Front Office
10 1 (1.47%) Financial Institution
10 1 (1.47%) Legal
Job Titles
1 34 (50.00%) Data Engineer
2 15 (22.06%) Senior
3 9 (13.24%) Consultant
4 7 (10.29%) Data Scientist
4 7 (10.29%) Senior Data Engineer
5 6 (8.82%) Azure Data Engineer
5 6 (8.82%) Azure Engineer
5 6 (8.82%) Lead
5 6 (8.82%) Python Engineer
6 5 (7.35%) AWS Data Engineer
6 5 (7.35%) AWS Engineer
6 5 (7.35%) Platform Engineer
7 4 (5.88%) Artificial Intelligence Consultant
7 4 (5.88%) Data Consultant
7 4 (5.88%) Senior Consultant
7 4 (5.88%) Senior Data Scientist
8 3 (4.41%) Data Manager
8 3 (4.41%) Junior
8 3 (4.41%) Junior Consultant
8 3 (4.41%) Python Software Engineer
Libraries, Frameworks & Software Standards
1 17 (25.00%) Pandas
2 12 (17.65%) Kafka
3 8 (11.76%) PyTorch
3 8 (11.76%) scikit-learn
4 7 (10.29%) React
5 5 (7.35%) NumPy
6 4 (5.88%) CSS
6 4 (5.88%) LangChain
6 4 (5.88%) TensorFlow
6 4 (5.88%) XGBoost
7 3 (4.41%) Node.js
7 3 (4.41%) Polars
8 1 (1.47%) .NET
8 1 (1.47%) .NET Framework
8 1 (1.47%) ASP.NET
8 1 (1.47%) AWS CDK
8 1 (1.47%) Great Expectations
8 1 (1.47%) Playwright
8 1 (1.47%) Plotly
8 1 (1.47%) pytest
Miscellaneous
1 9 (13.24%) Enterprise Software
2 6 (8.82%) Cloud Native
3 4 (5.88%) Distributed Systems
4 2 (2.94%) Clustering
4 2 (2.94%) Derivative
4 2 (2.94%) Legacy Systems
4 2 (2.94%) Reinsurance
5 1 (1.47%) Data Fabric
5 1 (1.47%) Distributed Computing
5 1 (1.47%) Equities
5 1 (1.47%) FMCG
5 1 (1.47%) Greenfield Project
5 1 (1.47%) Hedge funds
5 1 (1.47%) IoT
5 1 (1.47%) Management Information System
5 1 (1.47%) Marketing Technology
5 1 (1.47%) OTC Derivatives
5 1 (1.47%) Video\Live Streaming
Operating Systems
1 1 (1.47%) Linux
Processes & Methodologies
1 38 (55.88%) Analytics
2 37 (54.41%) Data Engineering
2 37 (54.41%) Data Pipeline
3 30 (44.12%) Data Science
4 29 (42.65%) CI/CD
5 28 (41.18%) DevOps
6 27 (39.71%) Data Modelling
6 27 (39.71%) ETL
7 25 (36.76%) Problem-Solving
8 22 (32.35%) Business Intelligence
9 21 (30.88%) Data Governance
10 19 (27.94%) Machine Learning
11 15 (22.06%) Visualisation
12 13 (19.12%) Infrastructure as Code
13 12 (17.65%) AI
14 11 (16.18%) Mentoring
15 10 (14.71%) Agile
15 10 (14.71%) Decision-Making
16 9 (13.24%) Computer Science
16 9 (13.24%) Data Architecture
Programming Languages
1 64 (94.12%) Python
2 57 (83.82%) SQL
3 15 (22.06%) Scala
4 8 (11.76%) R
5 4 (5.88%) Java
5 4 (5.88%) JavaScript
5 4 (5.88%) PowerShell
6 3 (4.41%) TypeScript
7 2 (2.94%) Data Analysis Expressions
7 2 (2.94%) T-SQL
8 1 (1.47%) Bash
8 1 (1.47%) C#
8 1 (1.47%) Korn
8 1 (1.47%) PL/SQL
8 1 (1.47%) SPARQL
Qualifications
1 15 (22.06%) Degree
2 7 (10.29%) Master's Degree
3 6 (8.82%) Microsoft Certification
4 5 (7.35%) Azure Certification
5 4 (5.88%) AWS Certification
5 4 (5.88%) Computer Science Degree
5 4 (5.88%) PhD
5 4 (5.88%) SC Cleared
5 4 (5.88%) Security Cleared
6 2 (2.94%) AWS Certified Solutions Architect
7 1 (1.47%) BPSS Clearance
Quality Assurance & Compliance
1 31 (45.59%) Data Quality
2 2 (2.94%) GDPR
3 1 (1.47%) SOC 2
System Software
1 16 (23.53%) Docker
Systems Management
1 15 (22.06%) Terraform
2 12 (17.65%) Kubernetes
3 1 (1.47%) Control-M
Vendors
1 40 (58.82%) Databricks
2 11 (16.18%) Microsoft
3 7 (10.29%) CrowdStrike
3 7 (10.29%) Fortinet
3 7 (10.29%) Palo Alto
4 5 (7.35%) Foundry
5 4 (5.88%) OpenAI
6 3 (4.41%) Google
7 1 (1.47%) Apple
7 1 (1.47%) BMC
7 1 (1.47%) IBM
7 1 (1.47%) Oracle
7 1 (1.47%) Palantir
7 1 (1.47%) Talend