PySpark Contract Job Trends in London

PySpark - Spark Python API
England > London

The table below provides summary statistics and contractor rates for jobs advertised in London requiring PySpark skills. It covers contract job vacancies from the 6 months leading up to 4 October 2026, with comparisons to the same periods in the previous two years.

6 months to
4 Oct 2026
Same period 2025 Same period 2024
Rank 210 231 206
Rank change year-on-year +21 -25 +99
Contract jobs citing PySpark 275 133 201
As % of all contract jobs in London 1.36% 0.99% 1.24%
As % of the Libraries, Frameworks & Software Standards category 5.16% 3.32% 4.12%
Number of daily rates quoted 217 92 155
10th Percentile £391 £364 £435
25th Percentile £447 £413 £500
Median daily rate (50th Percentile) £550 £500 £600
Median % change year-on-year +10.00% -16.67% -
75th Percentile £663 £608 £825
90th Percentile £743 £723 £888
England median daily rate £530 £495 £575
% change year-on-year +7.07% -13.91% -2.34%
Number of hourly rates quoted 0 0 1
Median hourly rate - - £80.00
England median hourly rate £71.33 - £22.00

All Software Libraries and Frameworks
London

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring technical specification, industry standards, software libraries and framework skills in London.

Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 5,329 4,012 4,884
As % of all contract IT jobs advertised in London 26.30% 29.72% 30.18%
Number of daily rates quoted 3,593 2,741 3,331
10th Percentile £400 £366 £385
25th Percentile £455 £431 £468
Median daily rate (50th Percentile) £550 £550 £575
Median % change year-on-year - -4.35% -4.17%
75th Percentile £664 £675 £700
90th Percentile £763 £800 £850
England median daily rate £538 £520 £550
% change year-on-year +3.37% -5.45% -
Number of hourly rates quoted 36 32 22
10th Percentile £28.00 £31.77 £23.84
25th Percentile £36.25 £34.17 £36.25
Median hourly rate £47.00 £51.97 £42.50
Median % change year-on-year -9.56% +22.28% -32.54%
75th Percentile £66.06 £61.56 £62.23
90th Percentile £81.25 £85.95 £74.60
England median hourly rate £65.00 £55.00 £65.00
% change year-on-year +18.18% -15.38% +8.33%

PySpark
Job Vacancy Trend in London

Historical trend showing the proportion of contract IT job postings citing PySpark relative to all contract IT jobs advertised in London.

PySpark job vacancy trend in London

PySpark
Daily Rate Trend in London

Contractor daily rate distribution trend for jobs in London citing PySpark.

Contractor daily rate distribution trend for jobs in London citing PySpark

PySpark
Daily Rate Histogram in London

Daily rate distribution for jobs citing PySpark in London over the 6 months to 4 October 2026.

Daily rate histogram for PySpark in London

PySpark
Hourly Rate Trend in London

Contractor hourly rate distribution trend for jobs in London citing PySpark.

Contractor hourly rate distribution trend for jobs in London citing PySpark

PySpark
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing PySpark within the London region over the 6 months to 4 October 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +9 42 £550 +2.33% 13
West London - 2 £703 - 6
PySpark
England

PySpark
Co-Occurring Skills & Capabilities in London by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 70 (25.45%) Apache Spark
2 57 (20.73%) Apache
3 55 (20.00%) Apache Airflow
4 9 (3.27%) Confluence
4 9 (3.27%) Palantir Foundry
5 5 (1.82%) SAS
6 2 (0.73%) SugarCRM
7 1 (0.36%) Oracle Workflow
7 1 (0.36%) PowerExchange
7 1 (0.36%) SharePoint
Applications
1 1 (0.36%) Microsoft Excel
Business Applications
1 2 (0.73%) Aladdin
2 1 (0.36%) FIS Private Capital Suite
Cloud Services
1 159 (57.82%) Azure
2 106 (38.55%) AWS
3 65 (23.64%) Power Platform
4 59 (21.45%) Azure Data Factory
5 57 (20.73%) Azure DevOps
6 44 (16.00%) Amazon S3
7 39 (14.18%) dbt
7 39 (14.18%) Serverless
8 37 (13.45%) Azure Synapse Analytics
9 34 (12.36%) GCP
9 34 (12.36%) GitHub
10 33 (12.00%) Azure Databricks
11 31 (11.27%) AWS Lambda
12 28 (10.18%) Snowflake
13 25 (9.09%) Amazon EMR
13 25 (9.09%) GitHub Actions
14 13 (4.73%) Amazon CloudWatch
14 13 (4.73%) Amazon EC2
14 13 (4.73%) Microsoft Purview
15 11 (4.00%) Azure AI
Communications & Networking
1 1 (0.36%) Firewall
1 1 (0.36%) Network Security
Database & Business Intelligence
1 66 (24.00%) Delta Lake
2 62 (22.55%) Power BI
3 57 (20.73%) Data Warehouse
4 44 (16.00%) Data Lake
5 37 (13.45%) Metadata
6 36 (13.09%) Amazon Redshift
7 25 (9.09%) Spark SQL
8 19 (6.91%) BigQuery
9 18 (6.55%) Amazon Athena
10 17 (6.18%) Big Data
11 13 (4.73%) SQL Server
11 13 (4.73%) Star Schema
12 9 (3.27%) Azure SQL Database
12 9 (3.27%) PostgreSQL
13 8 (2.91%) Data Vault
13 8 (2.91%) Hadoop
13 8 (2.91%) NoSQL
13 8 (2.91%) Parquet
13 8 (2.91%) Relational Database
13 8 (2.91%) Snowflake Schema
Development Applications
1 44 (16.00%) Git
2 27 (9.82%) GitLab
3 14 (5.09%) MLflow
4 10 (3.64%) JIRA
5 5 (1.82%) ER Studio
5 5 (1.82%) ERwin
6 4 (1.45%) RStudio
6 4 (1.45%) Selenium
6 4 (1.45%) SonarQube
7 3 (1.09%) Claude Code
8 1 (0.36%) Jenkins
8 1 (0.36%) Postman
8 1 (0.36%) PowerDesigner
8 1 (0.36%) REST Assured
8 1 (0.36%) Robot Framework
8 1 (0.36%) Visual Studio Code
General
1 114 (41.45%) Finance
2 77 (28.00%) Social Skills
3 40 (14.55%) Analytical Skills
4 39 (14.18%) Banking
5 23 (8.36%) Public Sector
6 12 (4.36%) Investment Banking
7 10 (3.64%) Inclusion and Diversity
8 8 (2.91%) Financial Institution
8 8 (2.91%) Retail
9 4 (1.45%) Automotive
9 4 (1.45%) Billing
9 4 (1.45%) Front Office
9 4 (1.45%) Marketing
10 3 (1.09%) Presentation Skills
11 2 (0.73%) Influencing Skills
11 2 (0.73%) Local Government
11 2 (0.73%) Publishing
11 2 (0.73%) Telecoms
12 1 (0.36%) Aerospace
12 1 (0.36%) Law
Job Titles
1 148 (53.82%) Data Engineer
2 73 (26.55%) Senior
3 52 (18.91%) Senior Data Engineer
4 35 (12.73%) Architect
4 35 (12.73%) Lead
5 30 (10.91%) Databricks Engineer
6 21 (7.64%) Databricks Data Engineer
7 20 (7.27%) Data Architect
7 20 (7.27%) Developer
8 15 (5.45%) Platform Engineer
9 14 (5.09%) Python Engineer
10 13 (4.73%) Lead Data Engineer
11 12 (4.36%) Python Data Engineer
11 12 (4.36%) Senior Developer
12 11 (4.00%) Azure Engineer
13 10 (3.64%) Data Scientist
13 10 (3.64%) Senior Databricks Data Engineer
14 9 (3.27%) AWS Engineer
15 8 (2.91%) Artificial Intelligence Engineer
16 7 (2.55%) Full-Stack Developer
Libraries, Frameworks & Software Standards
1 62 (22.55%) Terraform
2 40 (14.55%) Kafka
3 24 (8.73%) Pandas
3 24 (8.73%) REST
4 17 (6.18%) NumPy
5 12 (4.36%) pytest
5 12 (4.36%) React
6 11 (4.00%) Great Expectations
7 9 (3.27%) .NET
7 9 (3.27%) scikit-learn
8 8 (2.91%) .NET Core
8 8 (2.91%) FastAPI
8 8 (2.91%) PyTorch
8 8 (2.91%) RESTful
9 6 (2.18%) Django
9 6 (2.18%) Flask
9 6 (2.18%) Redux
9 6 (2.18%) Spring
9 6 (2.18%) Spring Boot
10 5 (1.82%) JSON
Miscellaneous
1 36 (13.09%) Cloud Native
2 17 (6.18%) Product Ownership
3 16 (5.82%) Legacy Systems
4 15 (5.45%) Distributed Systems
4 15 (5.45%) Onboarding
5 12 (4.36%) Data Structures
6 10 (3.64%) Reference Data
7 9 (3.27%) Fixed Income
8 8 (2.91%) AI Agents
8 8 (2.91%) Algorithms
8 8 (2.91%) Derivative
8 8 (2.91%) NHS
9 7 (2.55%) Distributed Computing
10 6 (2.18%) Market Risk
11 5 (1.82%) Management Information System
11 5 (1.82%) Pricing Data
12 4 (1.45%) Equities
12 4 (1.45%) Greenfield Project
12 4 (1.45%) Robotics
12 4 (1.45%) Virtual Team
Operating Systems
1 10 (3.64%) Linux
2 9 (3.27%) Unix
3 1 (0.36%) Robot Operating System
3 1 (0.36%) Windows
Processes & Methodologies
1 151 (54.91%) Data Engineering
2 145 (52.73%) Data Pipeline
3 142 (51.64%) CI/CD
4 131 (47.64%) Analytics
5 110 (40.00%) Data Modelling
6 98 (35.64%) DevOps
6 98 (35.64%) ETL
7 92 (33.45%) Agile
8 90 (32.73%) AI
9 83 (30.18%) Business Intelligence
10 74 (26.91%) Lakehouse
11 71 (25.82%) Data Governance
12 67 (24.36%) Machine Learning
13 58 (21.09%) Infrastructure as Code
13 58 (21.09%) Migration
14 54 (19.64%) Validation
15 53 (19.27%) Stakeholder Management
16 51 (18.55%) Data Science
17 50 (18.18%) Data Transformation
18 46 (16.73%) Data Architecture
Programming Languages
1 224 (81.45%) Python
2 203 (73.82%) SQL
3 20 (7.27%) Data Analysis Expressions
4 13 (4.73%) JavaScript
5 12 (4.36%) Scala
6 10 (3.64%) C#
6 10 (3.64%) Java
7 8 (2.91%) Shell Script
7 8 (2.91%) TypeScript
8 7 (2.55%) T-SQL
9 5 (1.82%) R
10 4 (1.45%) Bicep
11 3 (1.09%) SPARQL
12 2 (0.73%) Bash
12 2 (0.73%) Korn
12 2 (0.73%) PowerShell
13 1 (0.36%) C
13 1 (0.36%) COBOL
13 1 (0.36%) Kotlin
13 1 (0.36%) PL/SQL
Qualifications
1 53 (19.27%) Security Cleared
2 48 (17.45%) SC Cleared
3 11 (4.00%) Azure Certification
4 10 (3.64%) Degree
5 8 (2.91%) AWS Certification
5 8 (2.91%) AWS Certified Cloud Practitioner
6 6 (2.18%) BPSS Clearance
6 6 (2.18%) Master's Degree
7 4 (1.45%) Computer Science Degree
7 4 (1.45%) PhD
8 3 (1.09%) Microsoft Certification
9 2 (0.73%) DBS Check
9 2 (0.73%) DV Cleared
10 1 (0.36%) SnowPro
Quality Assurance & Compliance
1 123 (44.73%) Data Quality
2 10 (3.64%) GDPR
3 7 (2.55%) QA
4 4 (1.45%) SLA
5 1 (0.36%) Disclosure Scotland
5 1 (0.36%) Government Security Classifications
5 1 (0.36%) GRC
5 1 (0.36%) MiFID
System Software
1 34 (12.36%) Docker
2 1 (0.36%) Active Directory
Systems Management
1 32 (11.64%) Kubernetes
2 4 (1.45%) Ansible
3 1 (0.36%) Control-M
3 1 (0.36%) Grafana
3 1 (0.36%) Prometheus
Vendors
1 141 (51.27%) Databricks
2 67 (24.36%) Microsoft
3 17 (6.18%) Palantir
4 15 (5.45%) Informatica
5 9 (3.27%) Foundry
5 9 (3.27%) OpenAI
6 8 (2.91%) Oracle
7 6 (2.18%) Google
8 5 (1.82%) Salesforce
9 2 (0.73%) Cloudera
9 2 (0.73%) HubSpot
9 2 (0.73%) Sage
9 2 (0.73%) SAP
9 2 (0.73%) Teradata
10 1 (0.36%) Anaplan
10 1 (0.36%) Confluent
10 1 (0.36%) Hortonworks
10 1 (0.36%) NVIDIA
10 1 (0.36%) PagerDuty
10 1 (0.36%) Tagetik