PySpark Jobs in the South East

PySpark - Spark Python API
England > South East

The table below provides summary statistics for permanent job vacancies advertised in the South East requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 27 June 2025, comparing them to the same period in the previous two years.

6 months to
27 Jun 2025
Same period 2024 Same period 2023
Rank 296 385 343
Rank change year-on-year +89 -42 +151
Permanent jobs citing PySpark 17 2 35
As % of all permanent jobs advertised in the South East 0.18% 0.011% 0.27%
As % of the Libraries, Frameworks & Software Standards category 1.30% 0.061% 0.94%
Number of salaries quoted 7 2 29
10th Percentile £34,650 - £47,500
25th Percentile £40,125 £38,750 £52,500
Median annual salary (50th Percentile) £52,500 £40,000 £62,500
Median % change year-on-year +31.25% -36.00% +8.70%
75th Percentile £61,875 £41,250 £75,000
90th Percentile £70,500 - £90,250
England median annual salary £105,000 £85,000 £80,294
% change year-on-year +23.53% +5.86% +14.71%

All Software Libraries and Frameworks
South East

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in the South East.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 1,310 3,264 3,732
As % of all permanent jobs advertised in the South East 13.52% 17.83% 28.77%
Number of salaries quoted 850 2,569 2,621
10th Percentile £33,750 £36,250 £36,450
25th Percentile £45,000 £45,000 £47,500
Median annual salary (50th Percentile) £62,500 £55,000 £60,000
Median % change year-on-year +13.64% -8.33% +7.14%
75th Percentile £73,000 £68,750 £75,000
90th Percentile £83,750 £82,500 £92,500
England median annual salary £67,500 £60,000 £67,500
% change year-on-year +12.50% -11.11% +3.85%

PySpark
Job Vacancy Trend in the South East

Job postings citing PySpark as a proportion of all IT jobs advertised in the South East.

Job vacancy trend for PySpark in the South East

PySpark
Salary Trend in the South East

3-month moving average salary quoted in jobs citing PySpark in the South East.

Salary trend for PySpark in the South East

PySpark
Salary Histogram in the South East

Salary distribution for jobs citing PySpark in the South East over the 6 months to 27 June 2025.

Salary histogram for PySpark in the South East

PySpark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the South East region over the 6 months to 27 June 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Hampshire - 7 £50,000 - 7
Middlesex - 5 - -
Surrey - 3 - -
Thames Valley +53 1 £65,000 +62.50% 10
West Sussex - 1 £75,000 - 2
Oxfordshire - 1 £65,000 - 1
PySpark
England

PySpark
Co-occurring Skills and Capabilities in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (41.18%) Apache Spark
2 5 (29.41%) Apache
2 5 (29.41%) Apache Airflow
Cloud Services
1 6 (35.29%) AWS
2 5 (29.41%) OpenShift
2 5 (29.41%) SaaS
3 3 (17.65%) Amazon S3
3 3 (17.65%) Azure
3 3 (17.65%) GCP
3 3 (17.65%) Power Platform
4 2 (11.76%) Amazon EKS
4 2 (11.76%) Amazon ELB
4 2 (11.76%) Microsoft Purview
4 2 (11.76%) Power Automate
4 2 (11.76%) PowerApps
5 1 (5.88%) Alation
5 1 (5.88%) Amazon Kinesis
5 1 (5.88%) Cloud Computing
5 1 (5.88%) dbt
Database & Business Intelligence
1 7 (41.18%) Data Warehouse
1 7 (41.18%) Delta Lake
2 6 (35.29%) Big Data
3 5 (29.41%) Apache Hudi
3 5 (29.41%) Apache Iceberg
3 5 (29.41%) Data Lake
3 5 (29.41%) Hadoop
3 5 (29.41%) NoSQL
4 4 (23.53%) Metadata
4 4 (23.53%) Spark SQL
5 2 (11.76%) DynamoDB
5 2 (11.76%) Geospatial Data
5 2 (11.76%) Metadata Repository
6 1 (5.88%) Amazon RDS
6 1 (5.88%) Amazon Redshift
6 1 (5.88%) Power BI
6 1 (5.88%) Relational Database
Development Applications
1 5 (29.41%) Bitbucket
2 2 (11.76%) MLflow
General
1 5 (29.41%) Law
1 5 (29.41%) Social Skills
2 4 (23.53%) Analytical Skills
3 1 (5.88%) Inclusion and Diversity
3 1 (5.88%) Manufacturing
Job Titles
1 7 (41.18%) Data Engineer
2 4 (23.53%) Analyst
2 4 (23.53%) Data Analyst
3 3 (17.65%) Lead
3 3 (17.65%) Lead Data Engineer
3 3 (17.65%) Python Data Engineer
3 3 (17.65%) Python Engineer
4 2 (11.76%) Architect
4 2 (11.76%) Big Data Engineer
4 2 (11.76%) Data Architect
4 2 (11.76%) Machine Learning Engineer
4 2 (11.76%) Operations Engineer
5 1 (5.88%) AWS Data Engineer
5 1 (5.88%) AWS Engineer
5 1 (5.88%) Data Scientist
5 1 (5.88%) Geospatial Analyst
5 1 (5.88%) Java Engineer
5 1 (5.88%) Research Analyst
5 1 (5.88%) Senior
5 1 (5.88%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 7 (41.18%) Pandas
2 6 (35.29%) Kafka
3 5 (29.41%) PyArrow
4 2 (11.76%) Keras
4 2 (11.76%) Lambda Expressions
4 2 (11.76%) Metaflow
4 2 (11.76%) NumPy
4 2 (11.76%) PyTorch
4 2 (11.76%) scikit-learn
4 2 (11.76%) TensorFlow
4 2 (11.76%) YAML
5 1 (5.88%) Spring
5 1 (5.88%) Spring Boot
Miscellaneous
1 2 (11.76%) Linux Command Line
1 2 (11.76%) Low-Code
2 1 (5.88%) Algorithms
Operating Systems
1 7 (41.18%) Unix
Processes & Methodologies
1 8 (47.06%) Data Modelling
1 8 (47.06%) Data Science
2 7 (41.18%) Data Architecture
2 7 (41.18%) Data Governance
3 6 (35.29%) Data Analysis
3 6 (35.29%) Data Engineering
4 5 (29.41%) Analytics
4 5 (29.41%) Collaborative Working
4 5 (29.41%) Data Analytics
4 5 (29.41%) ETL
5 4 (23.53%) Metadata Management
6 3 (17.65%) Agile
6 3 (17.65%) Data Pipeline
6 3 (17.65%) Problem-Solving
7 2 (11.76%) CI/CD
7 2 (11.76%) Containerisation
7 2 (11.76%) Deployment Automation
7 2 (11.76%) MLOps
7 2 (11.76%) Problem Management
7 2 (11.76%) Strategic Planning
Programming Languages
1 14 (82.35%) Python
2 12 (70.59%) SQL
3 3 (17.65%) Java
4 1 (5.88%) Kotlin
Qualifications
1 2 (11.76%) Degree
2 1 (5.88%) Master's Degree
Quality Assurance & Compliance
1 6 (35.29%) Data Quality
2 5 (29.41%) Accessibility
System Software
1 5 (29.41%) HDFS
2 2 (11.76%) Docker
Systems Management
1 7 (41.18%) Kubernetes
2 2 (11.76%) Kubeflow
2 2 (11.76%) Terraform
Vendors
1 5 (29.41%) Red Hat
2 3 (17.65%) Databricks
3 2 (11.76%) Google
3 2 (11.76%) Microsoft