PySpark Contract Job Trends in the South East

PySpark - Spark Python API
England > South East

The table below provides summary statistics and contractor rates for jobs advertised in the South East requiring PySpark skills. It covers contract job vacancies from the 6 months leading up to 17 December 2025, with comparisons to the same periods in the previous two years.

6 months to
17 Dec 2025
Same period 2024 Same period 2023
Rank 167 141 191
Rank change year-on-year -26 +50 +43
Contract jobs citing PySpark 21 33 12
As % of all contract jobs in the South East 0.48% 0.87% 0.24%
As % of the Libraries, Frameworks & Software Standards category 3.03% 5.37% 1.48%
Number of daily rates quoted 13 12 12
10th Percentile £487 £500 £282
25th Percentile £525 £519 £522
Median daily rate (50th Percentile) £560 £575 £575
Median % change year-on-year -2.61% - +9.52%
75th Percentile £575 £641 £653
90th Percentile £595 £689 £696
England median daily rate £525 £600 £550
% change year-on-year -12.50% +9.09% -

All Software Libraries and Frameworks
South East

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in the South East.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 694 614 812
As % of all contract IT jobs advertised in the South East 15.89% 16.24% 16.23%
Number of daily rates quoted 497 397 465
10th Percentile £285 £300 £313
25th Percentile £400 £406 £414
Median daily rate (50th Percentile) £480 £525 £525
Median % change year-on-year -8.57% - -4.55%
75th Percentile £575 £638 £625
90th Percentile £648 £675 £680
England median daily rate £513 £550 £550
% change year-on-year -6.82% - -5.09%
Number of hourly rates quoted 20 12 35
10th Percentile £38.75 £54.83 £46.76
25th Percentile £46.25 £58.79 £55.00
Median hourly rate £48.75 £62.50 £62.50
Median % change year-on-year -22.00% - -2.09%
75th Percentile £78.38 £65.31 £76.53
90th Percentile £81.10 £70.00 £78.00
England median hourly rate £61.00 £62.50 £52.50
% change year-on-year -2.40% +19.05% -19.23%

PySpark
Job Vacancy Trend in the South East

Historical trend showing the proportion of contract IT job postings citing PySpark relative to all contract IT jobs advertised in the South East.

PySpark job vacancy trend in the South East

PySpark
Daily Rate Trend in the South East

Contractor daily rate distribution trend for jobs in the South East citing PySpark.

Contractor daily rate distribution trend for jobs in the South East citing PySpark

PySpark
Daily Rate Histogram in the South East

Daily rate distribution for jobs citing PySpark in the South East over the 6 months to 17 December 2025.

Daily rate histogram for PySpark in the South East

PySpark
Hourly Rate Trend in the South East

Contractor hourly rate distribution trend for jobs in the South East citing PySpark.

Contractor hourly rate distribution trend for jobs in the South East citing PySpark

PySpark
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the South East region over the 6 months to 17 December 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Thames Valley -13 13 £560 -6.67% 2
Berkshire -17 8 £563 -6.25%
Buckinghamshire +11 5 £560 +3.23% 1
West Sussex - 4 £515 -
Surrey +2 3 £575 - 4
Hampshire -24 1 £375 +150.00% 5
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in the South East by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 1 (4.76%) Apache Airflow
1 1 (4.76%) Apache Spark
Cloud Services
1 17 (80.95%) Azure
2 5 (23.81%) Azure Data Factory
3 4 (19.05%) Azure DevOps
3 4 (19.05%) Azure Key Vault
3 4 (19.05%) Azure Synapse Analytics
4 3 (14.29%) dbt
4 3 (14.29%) Snowflake
5 2 (9.52%) AWS
5 2 (9.52%) Azure Cognitive Services
5 2 (9.52%) Azure Machine Learning
5 2 (9.52%) GCP
5 2 (9.52%) GitHub
5 2 (9.52%) GitHub Actions
6 1 (4.76%) Amazon S3
6 1 (4.76%) AWS Lambda
6 1 (4.76%) AWS Step Functions
6 1 (4.76%) Dagster
6 1 (4.76%) Entra ID
6 1 (4.76%) Power Platform
6 1 (4.76%) Serverless
Database & Business Intelligence
1 4 (19.05%) Delta Lake
2 3 (14.29%) Data Lake
2 3 (14.29%) Metadata
2 3 (14.29%) SQL Server
3 2 (9.52%) Data Warehouse
4 1 (4.76%) Amazon Athena
4 1 (4.76%) Amazon Redshift
4 1 (4.76%) Azure SQL Database
4 1 (4.76%) Big Data
4 1 (4.76%) MongoDB
4 1 (4.76%) Power BI
4 1 (4.76%) RDBMS
4 1 (4.76%) Relational Database
4 1 (4.76%) Snowflake Schema
4 1 (4.76%) SQL Server Integration Services
4 1 (4.76%) Tableau
Development Applications
1 3 (14.29%) MLflow
2 2 (9.52%) Git
3 1 (4.76%) Bitbucket
3 1 (4.76%) Poetry
3 1 (4.76%) Pylint
3 1 (4.76%) SonarQube
3 1 (4.76%) Visual Studio
General
1 6 (28.57%) Social Skills
2 3 (14.29%) Finance
3 2 (9.52%) Public Sector
4 1 (4.76%) Analytical Skills
4 1 (4.76%) Documentation Skills
4 1 (4.76%) Telecoms
Job Titles
1 10 (47.62%) Data Engineer
2 9 (42.86%) Senior
3 6 (28.57%) Senior Data Engineer
4 5 (23.81%) Architect
5 3 (14.29%) Artificial Intelligence Architect
5 3 (14.29%) Senior Architect
5 3 (14.29%) Senior Technical Architect
5 3 (14.29%) Technical Architect
6 2 (9.52%) Data Architect
6 2 (9.52%) Lead
6 2 (9.52%) Support Engineer
7 1 (4.76%) Analyst
7 1 (4.76%) Applications Support
7 1 (4.76%) Applications Support Engineer
7 1 (4.76%) AWS Data Engineer
7 1 (4.76%) Azure Data Engineer
7 1 (4.76%) Consultant
7 1 (4.76%) Data Analyst
7 1 (4.76%) Lead Data Scientist
7 1 (4.76%) Microsoft Consultant
Libraries, Frameworks & Software Standards
1 3 (14.29%) OpenTelemetry
1 3 (14.29%) PyTorch
1 3 (14.29%) scikit-learn
1 3 (14.29%) TensorFlow
2 2 (9.52%) Kafka
3 1 (4.76%) JSON
3 1 (4.76%) pytest
3 1 (4.76%) XML
Miscellaneous
1 3 (14.29%) Data Protection Act
2 1 (4.76%) Data Structures
2 1 (4.76%) Legacy Systems
2 1 (4.76%) Onboarding
2 1 (4.76%) Product Ownership
Processes & Methodologies
1 8 (38.10%) CI/CD
1 8 (38.10%) Data Pipeline
2 6 (28.57%) DevOps
3 5 (23.81%) Data Architecture
3 5 (23.81%) ETL
4 4 (19.05%) Analytics
4 4 (19.05%) Data Modelling
4 4 (19.05%) Machine Learning
4 4 (19.05%) Migration
5 3 (14.29%) AI
5 3 (14.29%) Data Engineering
5 3 (14.29%) Data Protection
5 3 (14.29%) Generative AI
5 3 (14.29%) LLM
5 3 (14.29%) MLOps
5 3 (14.29%) Natural Language Processing
5 3 (14.29%) Observability
5 3 (14.29%) Problem-Solving
5 3 (14.29%) Retrieval-Augmented Generation
5 3 (14.29%) Stakeholder Engagement
Programming Languages
1 17 (80.95%) Python
2 12 (57.14%) SQL
3 3 (14.29%) T-SQL
3 3 (14.29%) TypeScript
4 2 (9.52%) PL/SQL
5 1 (4.76%) Bicep
5 1 (4.76%) Java
5 1 (4.76%) Scala
Qualifications
1 2 (9.52%) Security Cleared
2 1 (4.76%) Azure Certification
2 1 (4.76%) Microsoft Certification
Quality Assurance & Compliance
1 3 (14.29%) Data Quality
2 1 (4.76%) GDPR
2 1 (4.76%) QA
Systems Management
1 3 (14.29%) Terraform
Vendors
1 13 (61.90%) Databricks
2 4 (19.05%) Foundry
2 4 (19.05%) Palantir
3 3 (14.29%) Microsoft
4 2 (9.52%) Ab Initio
4 2 (9.52%) Informatica
4 2 (9.52%) OpenAI
5 1 (4.76%) Google
5 1 (4.76%) Oracle
5 1 (4.76%) RedGate
5 1 (4.76%) Virgin Media