PySpark Job Trends in London

PySpark - Spark Python API
England > London

The table below provides summary statistics and salary benchmarking for jobs advertised in London requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 12 August 2026, with comparisons to the same periods in the previous two years.

6 months to
12 Aug 2026
Same period 2025 Same period 2024
Rank 323 229 222
Rank change year-on-year -94 -7 +176
Permanent jobs citing PySpark 119 168 274
As % of all permanent jobs in London 0.50% 1.38% 1.40%
As % of the Libraries, Frameworks & Software Standards category 3.36% 5.22% 5.60%
Number of salaries quoted 83 115 210
10th Percentile £54,200 £51,750 £62,500
25th Percentile £65,625 £76,875 £77,500
Median annual salary (50th Percentile) £80,000 £92,500 £105,000
Median % change year-on-year -13.51% -11.90% +13.51%
75th Percentile £100,000 £122,500 £142,500
90th Percentile £107,500 £148,750 £147,500
England median annual salary £72,500 £85,000 £90,000
% change year-on-year -14.71% -5.56% +12.50%

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,538 3,217 4,893
As % of all permanent jobs advertised in London 14.87% 26.38% 24.97%
Number of salaries quoted 2,318 2,214 3,609
10th Percentile £51,250 £51,250 £50,000
25th Percentile £66,250 £63,750 £62,500
Median annual salary (50th Percentile) £82,500 £82,500 £85,000
Median % change year-on-year - -2.94% +6.25%
75th Percentile £100,000 £111,250 £115,000
90th Percentile £120,000 £135,000 £142,500
England median annual salary £65,000 £67,500 £62,500
% change year-on-year -3.70% +8.00% -7.41%

PySpark
Job Vacancy Trend in London

Historical trend showing the proportion of permanent IT job postings citing PySpark relative to all permanent IT jobs advertised in London.

PySpark job vacancy trend in London

PySpark
Salary Trend in London

Salary distribution trend for jobs in London citing PySpark.

Salary distribution trend for jobs in London citing PySpark

PySpark
Salary Histogram in London

Salary distribution for jobs citing PySpark in London over the 6 months to 12 August 2026.

Salary histogram for PySpark in London

PySpark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the London region over the 6 months to 12 August 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London -20 17 £80,000 -5.88% 3
East London - 6 - - 2
South London - 4 - -
West London -25 1 - - 2
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in London by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 33 (27.73%) Apache Spark
2 23 (19.33%) Apache Airflow
3 21 (17.65%) Apache
4 1 (0.84%) Jupyter
4 1 (0.84%) SharePoint
Applications
1 9 (7.56%) MS Visio
2 1 (0.84%) Microsoft PowerPoint
Cloud Services
1 73 (61.34%) Azure
2 42 (35.29%) AWS
3 39 (32.77%) Azure Data Factory
4 30 (25.21%) Microsoft Purview
4 30 (25.21%) Power Platform
5 26 (21.85%) Amazon S3
6 24 (20.17%) Azure Synapse Analytics
7 23 (19.33%) Azure DevOps
8 18 (15.13%) Snowflake
9 17 (14.29%) OpenShift
10 16 (13.45%) Serverless
11 15 (12.61%) GitHub
12 11 (9.24%) GCP
13 9 (7.56%) Azure Functions
14 8 (6.72%) Amazon EMR
14 8 (6.72%) GitHub Actions
15 7 (5.88%) SaaS
16 5 (4.20%) Azure Key Vault
16 5 (4.20%) Azure Machine Learning
17 4 (3.36%) dbt
Database & Business Intelligence
1 43 (36.13%) Delta Lake
2 32 (26.89%) Spark SQL
3 30 (25.21%) Tableau
4 26 (21.85%) Data Lake
4 26 (21.85%) Power BI
5 24 (20.17%) Metadata
6 19 (15.97%) Data Warehouse
7 18 (15.13%) Data Vault
7 18 (15.13%) Parquet
8 17 (14.29%) Apache Hive
8 17 (14.29%) Relational Database
9 16 (13.45%) Impala
9 16 (13.45%) Oracle Database
10 13 (10.92%) Azure SQL Database
11 7 (5.88%) NoSQL
12 6 (5.04%) Big Data
13 5 (4.20%) Amazon Redshift
13 5 (4.20%) Star Schema
14 2 (1.68%) Snowflake Schema
14 2 (1.68%) SQL Server
Development Applications
1 32 (26.89%) Git
2 16 (13.45%) IBM UrbanCode
3 5 (4.20%) Jenkins
4 3 (2.52%) MLflow
General
1 47 (39.50%) Finance
2 22 (18.49%) Social Skills
3 21 (17.65%) Analytical Skills
3 21 (17.65%) Banking
4 16 (13.45%) Investment Banking
5 8 (6.72%) Legal
6 3 (2.52%) Retail
7 2 (1.68%) Financial Institution
8 1 (0.84%) Documentation Skills
8 1 (0.84%) Law
8 1 (0.84%) Organisational Skills
8 1 (0.84%) Public Sector
8 1 (0.84%) Retail Banking
8 1 (0.84%) Telecoms
Job Titles
1 56 (47.06%) Data Engineer
2 33 (27.73%) Senior
3 29 (24.37%) Architect
4 25 (21.01%) Senior Data Engineer
5 19 (15.97%) Analyst
5 19 (15.97%) Data Architect
6 14 (11.76%) Transformation Analyst
7 13 (10.92%) Banking Analyst
8 11 (9.24%) Lead
9 10 (8.40%) Business Analyst
10 8 (6.72%) Azure Engineer
10 8 (6.72%) Data Business Analyst
10 8 (6.72%) Technical Analyst
11 7 (5.88%) Investment Banking Business Analyst
11 7 (5.88%) Python Data Engineer
11 7 (5.88%) Python Engineer
12 6 (5.04%) Technical Architect
13 5 (4.20%) Azure Data Engineer
14 3 (2.52%) AWS Data Engineer
14 3 (2.52%) Microsoft Engineer
Libraries, Frameworks & Software Standards
1 22 (18.49%) Kafka
2 14 (11.76%) Pandas
3 3 (2.52%) REST
3 3 (2.52%) YAML
4 2 (1.68%) Django
4 2 (1.68%) FastAPI
4 2 (1.68%) Flask
4 2 (1.68%) JSON
4 2 (1.68%) NumPy
4 2 (1.68%) React
5 1 (0.84%) Apache Avro
5 1 (0.84%) AWS CDK
5 1 (0.84%) D3.js
5 1 (0.84%) jQuery
5 1 (0.84%) Plotly
5 1 (0.84%) RESTful
Miscellaneous
1 27 (22.69%) Cloud Native
2 8 (6.72%) Product Ownership
2 8 (6.72%) Reinsurance
3 5 (4.20%) Data Fabric
4 4 (3.36%) Distributed Computing
5 3 (2.52%) Data Protection Act
5 3 (2.52%) Onboarding
6 1 (0.84%) Analytical Mindset
6 1 (0.84%) Data Structures
6 1 (0.84%) Derivative
6 1 (0.84%) Enterprise Cloud
6 1 (0.84%) Management Information System
6 1 (0.84%) Market Risk
6 1 (0.84%) Virtual Team
Operating Systems
1 1 (0.84%) Linux
1 1 (0.84%) Unix
Processes & Methodologies
1 80 (67.23%) Analytics
2 75 (63.03%) CI/CD
3 62 (52.10%) AI
4 61 (51.26%) Data Pipeline
5 59 (49.58%) Data Modelling
6 57 (47.90%) Data Engineering
7 56 (47.06%) Business Intelligence
8 44 (36.97%) ETL
9 42 (35.29%) Data Governance
10 38 (31.93%) DevOps
11 37 (31.09%) Data Architecture
12 35 (29.41%) Agile
13 34 (28.57%) Data Transformation
14 28 (23.53%) Infrastructure as Code
14 28 (23.53%) Machine Learning
15 25 (21.01%) Technical Leadership
16 24 (20.17%) Data Science
17 23 (19.33%) Data Strategy
17 23 (19.33%) Translating Business Requirements
18 20 (16.81%) Validation
Programming Languages
1 112 (94.12%) Python
2 103 (86.55%) SQL
3 26 (21.85%) Scala
4 15 (12.61%) Bicep
5 4 (3.36%) Data Analysis Expressions
6 3 (2.52%) T-SQL
7 2 (1.68%) Java
7 2 (1.68%) JavaScript
7 2 (1.68%) Kusto Query Language
7 2 (1.68%) R
8 1 (0.84%) Bash
8 1 (0.84%) Shell Script
Qualifications
1 28 (23.53%) Azure Certification
2 17 (14.29%) Microsoft Certification
3 15 (12.61%) SC Cleared
3 15 (12.61%) Security Cleared
4 13 (10.92%) SnowPro
5 9 (7.56%) Degree
6 5 (4.20%) Computer Science Degree
7 4 (3.36%) Master's Degree
8 1 (0.84%) AWS Certification
Quality Assurance & Compliance
1 59 (49.58%) Data Quality
2 11 (9.24%) GDPR
3 7 (5.88%) California Consumer Privacy Act
3 7 (5.88%) HIPAA
4 4 (3.36%) Solvency II
5 3 (2.52%) QA
System Software
1 12 (10.08%) Docker
Systems Management
1 29 (24.37%) Terraform
2 11 (9.24%) Kubernetes
3 3 (2.52%) Ansible
Vendors
1 77 (64.71%) Databricks
2 55 (46.22%) Microsoft
3 16 (13.45%) Oracle
3 16 (13.45%) Red Hat
4 5 (4.20%) OpenAI
5 1 (0.84%) Cloudera
5 1 (0.84%) Foundry
5 1 (0.84%) Google
5 1 (0.84%) Salesforce
5 1 (0.84%) Talend