PySpark Jobs in England

PySpark - Spark Python API
UK > England

The table below provides summary statistics for permanent job vacancies advertised in England requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 28 May 2025, comparing them to the same period in the previous two years.

6 months to
28 May 2025
Same period 2024 Same period 2023
Rank 435 595 673
Rank change year-on-year +160 +78 +67
Permanent jobs citing PySpark 262 254 251
As % of all permanent jobs advertised in England 0.54% 0.29% 0.29%
As % of the Libraries, Frameworks & Software Standards category 3.12% 1.44% 0.96%
Number of salaries quoted 210 166 202
10th Percentile £50,000 £52,500 £50,000
25th Percentile £72,500 £56,250 £63,125
Median annual salary (50th Percentile) £110,000 £70,000 £80,294
Median % change year-on-year +57.14% -12.82% +14.71%
75th Percentile £122,500 £90,000 £105,000
90th Percentile £139,250 £100,000 £160,000
UK median annual salary £110,000 £70,000 £80,000
% change year-on-year +57.14% -12.50% +14.29%

All Software Libraries and Frameworks
England

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in England.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 8,391 17,586 26,013
As % of all permanent jobs advertised in England 17.35% 19.89% 29.87%
Number of salaries quoted 5,177 14,228 16,256
10th Percentile £40,000 £36,250 £41,250
25th Percentile £51,698 £45,000 £51,250
Median annual salary (50th Percentile) £67,037 £60,000 £67,500
Median % change year-on-year +11.73% -11.11% +3.85%
75th Percentile £87,500 £80,000 £88,750
90th Percentile £115,000 £100,019 £110,000
UK median annual salary £66,254 £60,000 £67,500
% change year-on-year +10.42% -11.11% +3.85%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Salary Trend in England

3-month moving average salary quoted in jobs citing PySpark in England.

Salary trend for PySpark in England

PySpark
Salary Histogram in England

Salary distribution for jobs citing PySpark in England over the 6 months to 28 May 2025.

Salary histogram for PySpark in England

PySpark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the England region over the 6 months to 28 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +128 203 £110,000 +57.14% 125
South East +106 18 £52,500 +31.25% 119
Midlands +62 16 £65,000 +4.00% 60
North of England +10 11 £72,500 -12.12% 74
East of England +52 10 £50,000 -9.09% 44
West Midlands +63 9 £62,500 - 26
East Midlands +42 7 £75,000 - 31
North West -31 4 £75,000 -11.76% 37
North East - 4 £62,500 - 8
South West +111 3 £115,000 +109.09% 46
Yorkshire +59 3 £85,000 +6.25% 29
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 130 (49.62%) Apache Airflow
2 114 (43.51%) Apache
3 88 (33.59%) Apache Spark
4 2 (0.76%) SAS
Applications
1 3 (1.15%) Microsoft Excel
2 1 (0.38%) Microsoft Office
Cloud Services
1 163 (62.21%) AWS
2 120 (45.80%) dbt
3 98 (37.40%) Azure
4 79 (30.15%) Serverless
5 72 (27.48%) Amazon ECS
6 69 (26.34%) AWS Lambda
7 65 (24.81%) OpenShift
8 60 (22.90%) Snowflake
9 48 (18.32%) GCP
10 47 (17.94%) Azure Data Factory
11 35 (13.36%) Power Platform
12 30 (11.45%) Azure DevOps
13 24 (9.16%) Azure Synapse Analytics
14 23 (8.78%) Dagster
15 17 (6.49%) Amazon EC2
16 16 (6.11%) Amazon S3
17 13 (4.96%) Amazon EKS
18 12 (4.58%) Amazon Kinesis
18 12 (4.58%) Microsoft Purview
19 11 (4.20%) Power Automate
Communications & Networking
1 1 (0.38%) PuTTY
Database & Business Intelligence
1 125 (47.71%) Amazon Athena
2 120 (45.80%) Apache Iceberg
3 114 (43.51%) Dremio
4 103 (39.31%) Apache Arrow
5 71 (27.10%) Apache Ignite
6 53 (20.23%) Data Warehouse
7 48 (18.32%) Data Lake
8 31 (11.83%) Power BI
9 20 (7.63%) Big Data
10 19 (7.25%) Tableau
11 15 (5.73%) NoSQL
12 14 (5.34%) Delta Lake
12 14 (5.34%) Hadoop
13 13 (4.96%) Amazon Redshift
13 13 (4.96%) Spark SQL
14 8 (3.05%) Metadata
14 8 (3.05%) Parquet
14 8 (3.05%) PostgreSQL
15 7 (2.67%) BigQuery
16 6 (2.29%) Apache Hudi
Development Applications
1 60 (22.90%) Artifactory
2 25 (9.54%) Git
3 8 (3.05%) Jenkins
4 7 (2.67%) Bitbucket
5 5 (1.91%) CircleCI
6 4 (1.53%) GitLab
7 1 (0.38%) JIRA
7 1 (0.38%) kappa
7 1 (0.38%) Octopus Deploy
7 1 (0.38%) SpecFlow
7 1 (0.38%) Spinnaker
General
1 136 (51.91%) Finance
2 114 (43.51%) Front Office
3 67 (25.57%) Banking
4 44 (16.79%) Investment Banking
5 41 (15.65%) Social Skills
6 22 (8.40%) Analytical Skills
7 14 (5.34%) Public Sector
8 13 (4.96%) Inclusion and Diversity
9 11 (4.20%) Law
10 8 (3.05%) Retail
11 6 (2.29%) Marketing
12 3 (1.15%) Games
12 3 (1.15%) Presentation Skills
13 1 (0.38%) Financial Institution
13 1 (0.38%) Legal
13 1 (0.38%) Manufacturing
13 1 (0.38%) Tech for Good
Job Titles
1 168 (64.12%) Data Engineer
2 108 (41.22%) AWS Engineer
3 96 (36.64%) Python Engineer
4 61 (23.28%) DevOps Engineer
5 59 (22.52%) AWS DevOps
5 59 (22.52%) AWS DevOps Engineer
6 47 (17.94%) Software Engineer
7 46 (17.56%) Senior
8 44 (16.79%) AWS Software Engineer
9 38 (14.50%) Developer
10 33 (12.60%) AWS Developer
11 32 (12.21%) Developer/Software Engineer
11 32 (12.21%) Snowflake Developer
11 32 (12.21%) Snowflake Engineer
11 32 (12.21%) Software Developer
12 29 (11.07%) Java Engineer
13 28 (10.69%) Java Software Engineer
14 23 (8.78%) Senior Data Engineer
15 22 (8.40%) Python Developer
16 21 (8.02%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 81 (30.92%) Kafka
2 59 (22.52%) J2EE
3 39 (14.89%) Pandas
4 25 (9.54%) NumPy
5 23 (8.78%) SciPy
6 12 (4.58%) gRPC
6 12 (4.58%) Protocol Buffers
7 11 (4.20%) scikit-learn
7 11 (4.20%) TensorFlow
8 8 (3.05%) Spark Streaming
9 7 (2.67%) Flask
10 6 (2.29%) PyArrow
11 5 (1.91%) OAuth
12 4 (1.53%) Django
13 3 (1.15%) pytest
13 3 (1.15%) XGBoost
13 3 (1.15%) YAML
14 2 (0.76%) PyTorch
14 2 (0.76%) Smart Contracts
15 1 (0.38%) Shiny
Miscellaneous
1 54 (20.61%) Equities
1 54 (20.61%) Fixed Income
2 44 (16.79%) Derivative
2 44 (16.79%) Foreign Exchange (FX)
2 44 (16.79%) Hedge funds
3 15 (5.73%) Algorithms
4 12 (4.58%) Product Ownership
5 11 (4.20%) Credit Risk
6 6 (2.29%) Data Structures
7 5 (1.91%) Distributed Applications
7 5 (1.91%) Greenfield Project
7 5 (1.91%) Reinsurance
8 4 (1.53%) Low-Code
9 3 (1.15%) Cloud Native
10 2 (0.76%) Blockchain
10 2 (0.76%) Data Fabric
10 2 (0.76%) Life Science
11 1 (0.38%) e-Learning
11 1 (0.38%) Legacy Systems
Operating Systems
1 7 (2.67%) Unix
Processes & Methodologies
1 143 (54.58%) Data Engineering
2 140 (53.44%) Agile
3 130 (49.62%) Software Engineering
4 119 (45.42%) Asset Management
5 106 (40.46%) DevOps
6 100 (38.17%) CI/CD
7 71 (27.10%) ETL
8 66 (25.19%) Analytics
8 66 (25.19%) Data Pipeline
9 60 (22.90%) Open Source
10 59 (22.52%) Site Reliability Engineering
11 53 (20.23%) Data Science
12 47 (17.94%) Data Modelling
13 38 (14.50%) Machine Learning
14 36 (13.74%) Visualisation
15 35 (13.36%) Data Management
15 35 (13.36%) Data Transformation
15 35 (13.36%) Problem-Solving
16 32 (12.21%) Business Intelligence
17 29 (11.07%) Data Analysis
Programming Languages
1 251 (95.80%) Python
2 147 (56.11%) SQL
3 133 (50.76%) Java
4 59 (22.52%) Go
5 18 (6.87%) Scala
6 15 (5.73%) JavaScript
7 12 (4.58%) TypeScript
8 7 (2.67%) T-SQL
9 3 (1.15%) Cypher
10 2 (0.76%) R
11 1 (0.38%) Bash
11 1 (0.38%) Bicep
11 1 (0.38%) C#
11 1 (0.38%) C++
11 1 (0.38%) Kotlin
11 1 (0.38%) PowerShell
11 1 (0.38%) PROC SQL
11 1 (0.38%) VB
Qualifications
1 30 (11.45%) Degree
2 23 (8.78%) Security Cleared
3 21 (8.02%) SC Cleared
4 13 (4.96%) DBS Check
5 11 (4.20%) Azure Certification
5 11 (4.20%) Master's Degree
6 3 (1.15%) AWS Certification
7 2 (0.76%) Computer Science Degree
8 1 (0.38%) Numerate Degree
Quality Assurance & Compliance
1 39 (14.89%) Data Quality
2 8 (3.05%) GDPR
3 7 (2.67%) Accessibility
4 1 (0.38%) QA
System Software
1 78 (29.77%) Docker
2 7 (2.67%) HDFS
3 6 (2.29%) Apache Flume
Systems Management
1 91 (34.73%) Terraform
2 82 (31.30%) Kubernetes
3 6 (2.29%) Oozie
4 2 (0.76%) Ansible
5 1 (0.38%) Kibana
5 1 (0.38%) logstash
Vendors
1 81 (30.92%) Databricks
2 17 (6.49%) Microsoft
3 7 (2.67%) Cloudera
4 6 (2.29%) Red Hat
5 5 (1.91%) Google
6 2 (0.76%) Foundry
6 2 (0.76%) Informatica
6 2 (0.76%) Palantir
7 1 (0.38%) CheckPoint
7 1 (0.38%) MicroStrategy
7 1 (0.38%) Oracle
7 1 (0.38%) SAP
7 1 (0.38%) Splunk