PySpark Jobs in the South East

PySpark - Spark Python API
England > South East

The table below provides summary statistics for permanent job vacancies advertised in the South East requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 31 May 2025, comparing them to the same period in the previous two years.

6 months to
31 May 2025
Same period 2024 Same period 2023
Rank 297 391 366
Rank change year-on-year +94 -25 +104
Permanent jobs citing PySpark 18 2 33
As % of all permanent jobs advertised in the South East 0.19% 0.011% 0.24%
As % of the Libraries, Frameworks & Software Standards category 1.33% 0.063% 0.84%
Number of salaries quoted 7 2 28
10th Percentile £34,650 - £47,500
25th Percentile £40,125 £38,750 £52,500
Median annual salary (50th Percentile) £52,500 £40,000 £63,750
Median % change year-on-year +31.25% -37.25% +10.87%
75th Percentile £61,875 £41,250 £71,250
90th Percentile £70,500 - £86,875
England median annual salary £110,000 £70,000 £80,294
% change year-on-year +57.14% -12.82% +14.71%

All Software Libraries and Frameworks
South East

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in the South East.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 1,349 3,179 3,947
As % of all permanent jobs advertised in the South East 13.93% 18.04% 28.38%
Number of salaries quoted 873 2,514 2,702
10th Percentile £32,700 £36,250 £36,250
25th Percentile £45,000 £45,000 £47,500
Median annual salary (50th Percentile) £60,000 £55,000 £60,000
Median % change year-on-year +9.09% -8.33% +4.35%
75th Percentile £73,000 £70,000 £75,000
90th Percentile £83,750 £83,750 £92,500
England median annual salary £66,274 £60,000 £67,500
% change year-on-year +10.46% -11.11% +3.85%

PySpark
Job Vacancy Trend in the South East

Job postings citing PySpark as a proportion of all IT jobs advertised in the South East.

Job vacancy trend for PySpark in the South East

PySpark
Salary Trend in the South East

3-month moving average salary quoted in jobs citing PySpark in the South East.

Salary trend for PySpark in the South East

PySpark
Salary Histogram in the South East

Salary distribution for jobs citing PySpark in the South East over the 6 months to 31 May 2025.

Salary histogram for PySpark in the South East

PySpark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the South East region over the 6 months to 31 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Middlesex - 6 - -
Hampshire - 5 £50,000 - 2
Surrey - 4 - - 1
Thames Valley +65 1 £65,000 +62.50% 5
West Sussex - 1 £75,000 - 3
Kent - 1 - - 3
Oxfordshire - 1 £65,000 -
PySpark
England

PySpark
Co-occurring Skills and Capabilities in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (33.33%) Apache
1 6 (33.33%) Apache Airflow
1 6 (33.33%) Apache Spark
Cloud Services
1 6 (33.33%) AWS
1 6 (33.33%) OpenShift
2 5 (27.78%) SaaS
3 3 (16.67%) Alation
3 3 (16.67%) Amazon Kinesis
3 3 (16.67%) Amazon S3
3 3 (16.67%) Azure
3 3 (16.67%) dbt
3 3 (16.67%) GCP
3 3 (16.67%) Power Platform
4 2 (11.11%) Microsoft Purview
4 2 (11.11%) Power Automate
4 2 (11.11%) PowerApps
5 1 (5.56%) Cloud Computing
Database & Business Intelligence
1 10 (55.56%) Data Warehouse
2 7 (38.89%) Data Lake
3 6 (33.33%) Apache Hudi
3 6 (33.33%) Apache Iceberg
3 6 (33.33%) Big Data
3 6 (33.33%) Delta Lake
3 6 (33.33%) Hadoop
3 6 (33.33%) NoSQL
4 3 (16.67%) Amazon RDS
4 3 (16.67%) Amazon Redshift
5 2 (11.11%) Geospatial Data
5 2 (11.11%) Metadata
5 2 (11.11%) Metadata Repository
5 2 (11.11%) Spark SQL
6 1 (5.56%) Power BI
6 1 (5.56%) Relational Database
Development Applications
1 6 (33.33%) Bitbucket
General
1 6 (33.33%) Law
2 4 (22.22%) Analytical Skills
3 3 (16.67%) Social Skills
4 1 (5.56%) Inclusion and Diversity
4 1 (5.56%) Manufacturing
Job Titles
1 9 (50.00%) Data Engineer
2 4 (22.22%) Analyst
2 4 (22.22%) Data Analyst
2 4 (22.22%) Lead
2 4 (22.22%) Lead Data Engineer
2 4 (22.22%) Python Data Engineer
2 4 (22.22%) Python Engineer
3 3 (16.67%) Architect
3 3 (16.67%) Data Architect
4 2 (11.11%) AWS Data Engineer
4 2 (11.11%) AWS Engineer
4 2 (11.11%) Big Data Engineer
4 2 (11.11%) Senior
4 2 (11.11%) Senior Data Engineer
5 1 (5.56%) Data Scientist
5 1 (5.56%) Geospatial Analyst
5 1 (5.56%) Java Engineer
5 1 (5.56%) Research Analyst
Libraries, Frameworks & Software Standards
1 7 (38.89%) Kafka
2 6 (33.33%) PyArrow
3 5 (27.78%) Pandas
4 1 (5.56%) Spring
4 1 (5.56%) Spring Boot
Miscellaneous
1 2 (11.11%) Low-Code
2 1 (5.56%) Algorithms
Operating Systems
1 6 (33.33%) Unix
Processes & Methodologies
1 10 (55.56%) Data Architecture
1 10 (55.56%) Data Governance
2 9 (50.00%) Data Modelling
3 7 (38.89%) Data Engineering
3 7 (38.89%) Data Science
4 6 (33.33%) Collaborative Working
4 6 (33.33%) Data Analysis
4 6 (33.33%) ETL
5 5 (27.78%) Analytics
5 5 (27.78%) Data Analytics
6 3 (16.67%) Agile
6 3 (16.67%) Data Pipeline
6 3 (16.67%) Data Security
6 3 (16.67%) Migration
6 3 (16.67%) Problem-Solving
7 2 (11.11%) Metadata Management
7 2 (11.11%) Problem Management
7 2 (11.11%) Reverse Engineering
7 2 (11.11%) Strategic Planning
8 1 (5.56%) DevOps
Programming Languages
1 15 (83.33%) Python
2 11 (61.11%) SQL
3 3 (16.67%) Java
4 1 (5.56%) Kotlin
Qualifications
1 2 (11.11%) Degree
2 1 (5.56%) Master's Degree
Quality Assurance & Compliance
1 7 (38.89%) Data Quality
2 6 (33.33%) Accessibility
System Software
1 6 (33.33%) HDFS
Systems Management
1 6 (33.33%) Kubernetes
Vendors
1 6 (33.33%) Red Hat
2 2 (11.11%) Google
2 2 (11.11%) Microsoft
3 1 (5.56%) Databricks