PySpark Contract Job Trends in London

PySpark - Spark Python API
England > London

The table below provides summary statistics and contractor rates for jobs advertised in London requiring PySpark skills. It covers contract job vacancies from the 6 months leading up to 11 October 2026, with comparisons to the same periods in the previous two years.

6 months to
11 Oct 2026
Same period 2025 Same period 2024
Rank 210 244 207
Rank change year-on-year +34 -37 +102
Contract jobs citing PySpark 283 133 200
As % of all contract jobs in London 1.40% 0.99% 1.24%
As % of the Libraries, Frameworks & Software Standards category 5.29% 3.36% 4.12%
Number of daily rates quoted 220 93 155
10th Percentile £399 £365 £435
25th Percentile £447 £413 £500
Median daily rate (50th Percentile) £550 £500 £600
Median % change year-on-year +10.00% -16.67% -
75th Percentile £664 £609 £825
90th Percentile £750 £720 £888
England median daily rate £530 £495 £575
% change year-on-year +7.07% -13.91% -2.34%
Number of hourly rates quoted 0 0 1
Median hourly rate - - £80.00
England median hourly rate £72.66 - £21.75

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 5,345 3,962 4,853
As % of all contract IT jobs advertised in London 26.44% 29.59% 30.05%
Number of daily rates quoted 3,614 2,716 3,285
10th Percentile £400 £366 £385
25th Percentile £456 £430 £466
Median daily rate (50th Percentile) £550 £550 £575
Median % change year-on-year - -4.35% -4.17%
75th Percentile £663 £675 £700
90th Percentile £752 £788 £850
England median daily rate £537 £520 £550
% change year-on-year +3.27% -5.45% -
Number of hourly rates quoted 35 32 24
10th Percentile £31.20 £31.77 £23.91
25th Percentile £36.25 £34.17 £36.25
Median hourly rate £50.00 £51.97 £42.50
Median % change year-on-year -3.79% +22.28% -32.00%
75th Percentile £62.25 £61.56 £61.70
90th Percentile £81.25 £85.95 £73.80
England median hourly rate £65.83 £54.00 £65.00
% change year-on-year +21.91% -16.92% +8.33%

PySpark
Job Vacancy Trend in London

Historical trend showing the proportion of contract IT job postings citing PySpark relative to all contract IT jobs advertised in London.

PySpark job vacancy trend in London

PySpark
Daily Rate Trend in London

Contractor daily rate distribution trend for jobs in London citing PySpark.

Contractor daily rate distribution trend for jobs in London citing PySpark

PySpark
Daily Rate Histogram in London

Daily rate distribution for jobs citing PySpark in London over the 6 months to 11 October 2026.

Daily rate histogram for PySpark in London

PySpark
Hourly Rate Trend in London

Contractor hourly rate distribution trend for jobs in London citing PySpark.

Contractor hourly rate distribution trend for jobs in London citing PySpark

PySpark
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the London region over the 6 months to 11 October 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +9 43 £550 +2.33% 13
West London - 2 £703 - 4
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in London by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 74 (26.15%) Apache Spark
2 61 (21.55%) Apache
3 59 (20.85%) Apache Airflow
4 9 (3.18%) Confluence
4 9 (3.18%) Palantir Foundry
5 5 (1.77%) SAS
6 2 (0.71%) SugarCRM
7 1 (0.35%) Oracle Workflow
7 1 (0.35%) PowerExchange
7 1 (0.35%) SharePoint
Applications
1 1 (0.35%) Microsoft Excel
Business Applications
1 2 (0.71%) Aladdin
2 1 (0.35%) FIS Private Capital Suite
Cloud Services
1 163 (57.60%) Azure
2 111 (39.22%) AWS
3 65 (22.97%) Power Platform
4 63 (22.26%) Azure Data Factory
5 59 (20.85%) Azure DevOps
6 43 (15.19%) Amazon S3
7 42 (14.84%) dbt
8 38 (13.43%) Azure Synapse Analytics
8 38 (13.43%) Serverless
9 36 (12.72%) Azure Databricks
9 36 (12.72%) GCP
10 34 (12.01%) GitHub
11 29 (10.25%) AWS Lambda
11 29 (10.25%) Snowflake
12 26 (9.19%) Amazon EMR
12 26 (9.19%) GitHub Actions
13 13 (4.59%) Amazon EC2
13 13 (4.59%) Microsoft Purview
14 11 (3.89%) Amazon CloudWatch
14 11 (3.89%) Azure AI
Communications & Networking
1 1 (0.35%) Firewall
1 1 (0.35%) Network Security
Database & Business Intelligence
1 70 (24.73%) Delta Lake
2 62 (21.91%) Data Warehouse
2 62 (21.91%) Power BI
3 48 (16.96%) Data Lake
4 40 (14.13%) Metadata
5 38 (13.43%) Amazon Redshift
6 24 (8.48%) Spark SQL
7 19 (6.71%) BigQuery
8 17 (6.01%) Big Data
9 16 (5.65%) Amazon Athena
10 13 (4.59%) Star Schema
11 12 (4.24%) SQL Server
12 10 (3.53%) NoSQL
13 9 (3.18%) Apache Iceberg
13 9 (3.18%) Azure SQL Database
13 9 (3.18%) Data Vault
13 9 (3.18%) PostgreSQL
13 9 (3.18%) Relational Database
14 8 (2.83%) Hadoop
14 8 (2.83%) Snowflake Schema
Development Applications
1 45 (15.90%) Git
2 27 (9.54%) GitLab
3 14 (4.95%) MLflow
4 10 (3.53%) JIRA
5 5 (1.77%) ER Studio
5 5 (1.77%) ERwin
6 4 (1.41%) Claude Code
6 4 (1.41%) RStudio
6 4 (1.41%) Selenium
6 4 (1.41%) SonarQube
7 2 (0.71%) CircleCI
8 1 (0.35%) Jenkins
8 1 (0.35%) Postman
8 1 (0.35%) PowerDesigner
8 1 (0.35%) REST Assured
8 1 (0.35%) Robot Framework
8 1 (0.35%) Visual Studio Code
General
1 118 (41.70%) Finance
2 79 (27.92%) Social Skills
3 43 (15.19%) Banking
4 39 (13.78%) Analytical Skills
5 23 (8.13%) Public Sector
6 14 (4.95%) Investment Banking
7 10 (3.53%) Inclusion and Diversity
8 9 (3.18%) Financial Institution
9 8 (2.83%) Retail
10 5 (1.77%) Marketing
11 4 (1.41%) Automotive
11 4 (1.41%) Billing
11 4 (1.41%) Front Office
12 3 (1.06%) Presentation Skills
13 2 (0.71%) Influencing Skills
13 2 (0.71%) Local Government
13 2 (0.71%) Publishing
13 2 (0.71%) Telecoms
14 1 (0.35%) Law
14 1 (0.35%) Military
Job Titles
1 155 (54.77%) Data Engineer
2 76 (26.86%) Senior
3 56 (19.79%) Senior Data Engineer
4 36 (12.72%) Lead
5 34 (12.01%) Architect
6 32 (11.31%) Databricks Engineer
7 22 (7.77%) Databricks Data Engineer
8 21 (7.42%) Developer
9 20 (7.07%) Data Architect
10 16 (5.65%) Python Engineer
11 15 (5.30%) Platform Engineer
12 14 (4.95%) Python Data Engineer
13 13 (4.59%) Lead Data Engineer
14 12 (4.24%) AWS Engineer
14 12 (4.24%) Senior Developer
15 11 (3.89%) Senior Databricks Data Engineer
16 10 (3.53%) Azure Engineer
17 9 (3.18%) AWS Data Engineer
18 8 (2.83%) Artificial Intelligence Engineer
18 8 (2.83%) Databricks Architect
Libraries, Frameworks & Software Standards
1 62 (21.91%) Terraform
2 42 (14.84%) Kafka
3 25 (8.83%) REST
4 23 (8.13%) Pandas
5 18 (6.36%) NumPy
6 13 (4.59%) React
7 12 (4.24%) pytest
8 11 (3.89%) Great Expectations
9 10 (3.53%) .NET
10 9 (3.18%) FastAPI
11 8 (2.83%) .NET Core
11 8 (2.83%) RESTful
12 7 (2.47%) Django
12 7 (2.47%) Flask
12 7 (2.47%) scikit-learn
13 6 (2.12%) Redux
13 6 (2.12%) Spring
13 6 (2.12%) Spring Boot
14 5 (1.77%) PyTorch
15 4 (1.41%) TensorFlow
Miscellaneous
1 38 (13.43%) Cloud Native
2 18 (6.36%) Product Ownership
3 17 (6.01%) Legacy Systems
3 17 (6.01%) Onboarding
4 15 (5.30%) Distributed Systems
5 12 (4.24%) Data Structures
6 10 (3.53%) Algorithms
6 10 (3.53%) Fixed Income
6 10 (3.53%) Reference Data
7 9 (3.18%) Derivative
8 8 (2.83%) AI Agents
8 8 (2.83%) Distributed Computing
8 8 (2.83%) NHS
9 7 (2.47%) Market Risk
10 5 (1.77%) Management Information System
10 5 (1.77%) Pricing Data
11 4 (1.41%) Equities
11 4 (1.41%) Greenfield Project
11 4 (1.41%) Robotics
11 4 (1.41%) Virtual Team
Operating Systems
1 11 (3.89%) Linux
2 10 (3.53%) Unix
3 1 (0.35%) Robot Operating System
3 1 (0.35%) Windows
Processes & Methodologies
1 157 (55.48%) Data Engineering
2 155 (54.77%) Data Pipeline
3 149 (52.65%) CI/CD
4 137 (48.41%) Analytics
5 116 (40.99%) Data Modelling
6 106 (37.46%) ETL
7 102 (36.04%) DevOps
8 93 (32.86%) Agile
9 90 (31.80%) AI
10 83 (29.33%) Business Intelligence
11 80 (28.27%) Lakehouse
12 77 (27.21%) Data Governance
13 68 (24.03%) Machine Learning
14 58 (20.49%) Infrastructure as Code
14 58 (20.49%) Migration
15 55 (19.43%) Validation
16 54 (19.08%) Stakeholder Management
17 52 (18.37%) Data Transformation
18 49 (17.31%) Data Science
19 47 (16.61%) Performance Optimisation
Programming Languages
1 233 (82.33%) Python
2 214 (75.62%) SQL
3 21 (7.42%) Data Analysis Expressions
4 13 (4.59%) JavaScript
5 12 (4.24%) Scala
6 10 (3.53%) C#
6 10 (3.53%) Java
7 9 (3.18%) Shell Script
7 9 (3.18%) TypeScript
8 7 (2.47%) T-SQL
9 5 (1.77%) Bicep
9 5 (1.77%) R
10 3 (1.06%) SPARQL
11 2 (0.71%) Bash
11 2 (0.71%) Korn
11 2 (0.71%) PowerShell
12 1 (0.35%) C
12 1 (0.35%) COBOL
12 1 (0.35%) Kotlin
12 1 (0.35%) PL/SQL
Qualifications
1 51 (18.02%) Security Cleared
2 45 (15.90%) SC Cleared
3 12 (4.24%) Azure Certification
4 11 (3.89%) Degree
5 9 (3.18%) AWS Certification
6 8 (2.83%) AWS Certified Cloud Practitioner
7 6 (2.12%) BPSS Clearance
7 6 (2.12%) Master's Degree
8 4 (1.41%) Computer Science Degree
8 4 (1.41%) DV Cleared
8 4 (1.41%) Microsoft Certification
8 4 (1.41%) PhD
9 2 (0.71%) DBS Check
10 1 (0.35%) SnowPro
Quality Assurance & Compliance
1 127 (44.88%) Data Quality
2 11 (3.89%) GDPR
3 7 (2.47%) QA
4 4 (1.41%) SLA
5 1 (0.35%) Disclosure Scotland
5 1 (0.35%) Government Security Classifications
5 1 (0.35%) GRC
5 1 (0.35%) MiFID
System Software
1 35 (12.37%) Docker
2 1 (0.35%) Active Directory
Systems Management
1 31 (10.95%) Kubernetes
2 4 (1.41%) Ansible
3 1 (0.35%) Control-M
3 1 (0.35%) Grafana
3 1 (0.35%) Prometheus
Vendors
1 147 (51.94%) Databricks
2 70 (24.73%) Microsoft
3 17 (6.01%) Palantir
4 15 (5.30%) Informatica
5 9 (3.18%) Foundry
5 9 (3.18%) OpenAI
5 9 (3.18%) Oracle
6 6 (2.12%) Google
7 5 (1.77%) Salesforce
8 2 (0.71%) Cloudera
8 2 (0.71%) HubSpot
8 2 (0.71%) Sage
8 2 (0.71%) SAP
8 2 (0.71%) Teradata
9 1 (0.35%) Anaplan
9 1 (0.35%) Confluent
9 1 (0.35%) Hortonworks
9 1 (0.35%) NVIDIA
9 1 (0.35%) PagerDuty
9 1 (0.35%) Tagetik