PySpark Jobs in England

PySpark - Spark Python API
UK > England

The table below provides summary statistics for permanent job vacancies advertised in England requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 382 607 697
Rank change year-on-year +225 +90 +55
Permanent jobs citing PySpark 300 220 256
As % of all permanent jobs advertised in England 0.65% 0.26% 0.28%
As % of the Libraries, Frameworks & Software Standards category 3.96% 1.26% 0.92%
Number of salaries quoted 246 149 211
10th Percentile £50,625 £52,500 £52,500
25th Percentile £77,500 £57,500 £62,500
Median annual salary (50th Percentile) £110,000 £70,000 £80,000
Median % change year-on-year +57.14% -12.50% +16.36%
75th Percentile £138,750 £90,000 £105,000
90th Percentile £147,500 £100,000 £160,000
UK median annual salary £110,000 £70,000 £80,000
% change year-on-year +57.14% -12.50% +18.52%

All Software Libraries and Frameworks
England

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in England.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 7,585 17,421 27,765
As % of all permanent jobs advertised in England 16.47% 20.45% 30.01%
Number of salaries quoted 5,824 14,139 17,222
10th Percentile £38,825 £36,250 £41,250
25th Percentile £51,250 £45,700 £51,250
Median annual salary (50th Percentile) £66,253 £60,000 £67,500
Median % change year-on-year +10.42% -11.11% +3.85%
75th Percentile £87,500 £80,000 £88,750
90th Percentile £112,500 £100,064 £107,500
UK median annual salary £65,000 £60,000 £67,500
% change year-on-year +8.33% -11.11% +8.00%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Salary Trend in England

3-month moving average salary quoted in jobs citing PySpark in England.

Salary trend for PySpark in England

PySpark
Salary Histogram in England

Salary distribution for jobs citing PySpark in England over the 6 months to 1 May 2025.

Salary histogram for PySpark in England

PySpark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the England region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +166 241 £110,000 +57.14% 89
South East +127 21 £52,500 +31.25% 27
Midlands +82 12 £65,000 +3.17% 4
East of England +67 11 £50,000 -9.09% 1
North of England +51 9 £75,000 -9.09% 15
West Midlands +49 7 £58,750 -6.75% 3
South West +110 5 £110,000 +69.23% 12
East Midlands +51 5 £75,000 - 1
North West +2 5 £75,000 -11.76% 9
Yorkshire +71 2 £85,000 +6.25% 1
North East +51 2 £62,500 +13.64% 5
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 177 (59.00%) Apache Airflow
2 150 (50.00%) Apache
3 101 (33.67%) Apache Spark
4 1 (0.33%) SAS
Applications
1 3 (1.00%) Microsoft Excel
2 1 (0.33%) Microsoft Office
Business Applications
1 2 (0.67%) Dynamics CRM
Cloud Services
1 205 (68.33%) AWS
2 166 (55.33%) dbt
3 106 (35.33%) Amazon ECS
4 99 (33.00%) Azure
5 91 (30.33%) Serverless
6 81 (27.00%) AWS Lambda
7 80 (26.67%) OpenShift
8 79 (26.33%) GCP
8 79 (26.33%) Snowflake
9 57 (19.00%) Dagster
10 44 (14.67%) Azure Data Factory
11 39 (13.00%) Amazon EC2
12 34 (11.33%) Amazon EKS
13 29 (9.67%) Power Platform
14 26 (8.67%) Azure DevOps
15 23 (7.67%) Azure Synapse Analytics
16 16 (5.33%) Amazon S3
17 14 (4.67%) Power Automate
18 11 (3.67%) Amazon Kinesis
19 10 (3.33%) Azure Functions
Communications & Networking
1 2 (0.67%) ADSL
1 2 (0.67%) Internet
Database & Business Intelligence
1 169 (56.33%) Amazon Athena
1 169 (56.33%) Apache Iceberg
2 160 (53.33%) Dremio
3 137 (45.67%) Apache Arrow
4 105 (35.00%) Apache Ignite
5 75 (25.00%) Data Lake
6 53 (17.67%) Data Warehouse
7 25 (8.33%) Power BI
8 18 (6.00%) Hadoop
9 16 (5.33%) Big Data
9 16 (5.33%) Delta Lake
9 16 (5.33%) NoSQL
9 16 (5.33%) Tableau
10 14 (4.67%) Spark SQL
11 12 (4.00%) Amazon Redshift
12 9 (3.00%) Apache Hudi
13 8 (2.67%) Parquet
14 7 (2.33%) Metadata
14 7 (2.33%) PostgreSQL
15 6 (2.00%) BigQuery
Development Applications
1 72 (24.00%) Artifactory
2 24 (8.00%) Git
3 10 (3.33%) Bitbucket
4 8 (2.67%) Jenkins
5 5 (1.67%) CircleCI
6 4 (1.33%) GitLab
7 1 (0.33%) JIRA
7 1 (0.33%) JMeter
7 1 (0.33%) kappa
7 1 (0.33%) Octopus Deploy
7 1 (0.33%) SpecFlow
7 1 (0.33%) Spinnaker
General
1 182 (60.67%) Finance
2 160 (53.33%) Front Office
3 96 (32.00%) Banking
4 66 (22.00%) Investment Banking
5 43 (14.33%) Social Skills
6 23 (7.67%) Analytical Skills
7 12 (4.00%) Law
8 10 (3.33%) Inclusion and Diversity
9 8 (2.67%) Public Sector
10 7 (2.33%) Retail
11 6 (2.00%) Marketing
12 5 (1.67%) Presentation Skills
13 3 (1.00%) Games
14 2 (0.67%) Advertising
14 2 (0.67%) Influencing Skills
15 1 (0.33%) Legal
15 1 (0.33%) Manufacturing
Job Titles
1 185 (61.67%) Data Engineer
2 141 (47.00%) AWS Engineer
3 131 (43.67%) Python Engineer
4 73 (24.33%) DevOps Engineer
5 71 (23.67%) AWS DevOps
5 71 (23.67%) AWS DevOps Engineer
6 69 (23.00%) Software Engineer
7 66 (22.00%) AWS Software Engineer
8 59 (19.67%) Senior
9 40 (13.33%) Java Engineer
10 39 (13.00%) Java Software Engineer
11 35 (11.67%) Developer
12 33 (11.00%) AWS Developer
12 33 (11.00%) Python Data Engineer
13 32 (10.67%) Developer/Software Engineer
13 32 (10.67%) Snowflake Developer
13 32 (10.67%) Snowflake Engineer
13 32 (10.67%) Software Developer
14 28 (9.33%) Senior Data Engineer
15 27 (9.00%) Python Software Engineer
Libraries, Frameworks & Software Standards
1 96 (32.00%) Kafka
2 72 (24.00%) Pandas
3 71 (23.67%) J2EE
4 57 (19.00%) NumPy
4 57 (19.00%) SciPy
5 34 (11.33%) gRPC
5 34 (11.33%) Protocol Buffers
6 11 (3.67%) scikit-learn
6 11 (3.67%) TensorFlow
7 9 (3.00%) PyArrow
8 8 (2.67%) Spark Streaming
9 5 (1.67%) OAuth
10 3 (1.00%) Flask
10 3 (1.00%) pytest
10 3 (1.00%) XGBoost
10 3 (1.00%) YAML
11 2 (0.67%) PyTorch
12 1 (0.33%) JSON
12 1 (0.33%) REST
12 1 (0.33%) Spring
Miscellaneous
1 84 (28.00%) Equities
1 84 (28.00%) Fixed Income
2 66 (22.00%) Derivative
2 66 (22.00%) Foreign Exchange (FX)
2 66 (22.00%) Hedge funds
3 24 (8.00%) Product Ownership
4 15 (5.00%) Algorithms
5 11 (3.67%) Credit Risk
6 7 (2.33%) Data Structures
6 7 (2.33%) Reinsurance
7 6 (2.00%) Low-Code
8 5 (1.67%) Distributed Applications
8 5 (1.67%) Greenfield Project
9 3 (1.00%) Data Fabric
9 3 (1.00%) Life Science
10 2 (0.67%) Cloud Native
10 2 (0.67%) Distributed Computing
10 2 (0.67%) Management Information System
11 1 (0.33%) Blockchain
Operating Systems
1 9 (3.00%) Unix
Processes & Methodologies
1 183 (61.00%) Agile
2 176 (58.67%) Software Engineering
3 171 (57.00%) Data Engineering
4 165 (55.00%) Asset Management
5 117 (39.00%) DevOps
6 115 (38.33%) CI/CD
7 75 (25.00%) Analytics
8 74 (24.67%) Open Source
9 71 (23.67%) Site Reliability Engineering
10 66 (22.00%) ETL
11 62 (20.67%) Data Pipeline
12 54 (18.00%) Data Science
13 48 (16.00%) Migration
14 45 (15.00%) Data Modelling
15 41 (13.67%) Data Transformation
16 38 (12.67%) Problem-Solving
17 36 (12.00%) Machine Learning
18 34 (11.33%) Data Management
19 29 (9.67%) Visualisation
20 28 (9.33%) Business Intelligence
Programming Languages
1 288 (96.00%) Python
2 177 (59.00%) Java
3 141 (47.00%) SQL
4 71 (23.67%) Go
5 37 (12.33%) JavaScript
6 34 (11.33%) TypeScript
7 16 (5.33%) Scala
8 5 (1.67%) T-SQL
9 3 (1.00%) Cypher
9 3 (1.00%) R
10 1 (0.33%) Bicep
10 1 (0.33%) C#
10 1 (0.33%) C++
10 1 (0.33%) Data Analysis Expressions
10 1 (0.33%) Groovy
10 1 (0.33%) Kotlin
10 1 (0.33%) PowerShell
10 1 (0.33%) VB
Qualifications
1 41 (13.67%) Degree
2 21 (7.00%) Security Cleared
3 20 (6.67%) SC Cleared
4 14 (4.67%) DBS Check
5 11 (3.67%) Master's Degree
6 9 (3.00%) Azure Certification
7 3 (1.00%) Computer Science Degree
8 2 (0.67%) AWS Certification
9 1 (0.33%) Numerate Degree
Quality Assurance & Compliance
1 35 (11.67%) Data Quality
2 11 (3.67%) Accessibility
3 8 (2.67%) GDPR
4 1 (0.33%) QA
System Software
1 90 (30.00%) Docker
2 9 (3.00%) HDFS
3 5 (1.67%) Apache Flume
Systems Management
1 98 (32.67%) Kubernetes
1 98 (32.67%) Terraform
2 5 (1.67%) Oozie
3 2 (0.67%) Ansible
Vendors
1 73 (24.33%) Databricks
2 20 (6.67%) Microsoft
3 9 (3.00%) Red Hat
4 7 (2.33%) Cloudera
5 6 (2.00%) Foundry
5 6 (2.00%) Palantir
6 5 (1.67%) Google
7 2 (0.67%) Apple
8 1 (0.33%) CheckPoint
8 1 (0.33%) Oracle
8 1 (0.33%) Splunk
8 1 (0.33%) StreamSets