Hybrid/Remote PySpark Job Trends

PySpark - Spark Python API
UK > Work from Home

The table below provides summary statistics and salary benchmarking for remote or hybrid work requiring PySpark skills. It covers permanent job vacancies from the 6 months leading up to 7 March 2026, with comparisons to the same periods in the previous two years.

6 months to
7 Mar 2026
Same period 2025 Same period 2024
Rank 326 230 483
Rank change year-on-year -96 +253 +85
Permanent jobs citing PySpark 57 205 67
As % of all permanent jobs with remote/hybrid work options 0.34% 1.39% 0.23%
As % of the Libraries, Frameworks & Software Standards category 1.91% 4.26% 0.79%
Number of salaries quoted 45 167 61
10th Percentile £42,500 £71,500 £52,500
25th Percentile £52,400 £94,375 £55,000
Median annual salary (50th Percentile) £80,000 £110,000 £67,500
Median % change year-on-year -27.27% +62.96% -15.63%
75th Percentile £100,000 £138,750 £82,500
90th Percentile £120,000 £147,500 £100,000
UK median annual salary £75,000 £110,000 £70,000
% change year-on-year -31.82% +57.14% -12.50%

All Software Libraries and Frameworks
Work from Home

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies with remote or hybrid options requiring technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 2,982 4,812 8,434
As % of all permanent jobs with a WFH option 17.79% 32.62% 28.84%
Number of salaries quoted 2,187 3,377 7,320
10th Percentile £42,500 £41,250 £39,750
25th Percentile £52,500 £51,250 £47,500
Median annual salary (50th Percentile) £67,500 £66,230 £60,000
Median % change year-on-year +1.92% +10.38% -7.69%
75th Percentile £85,000 £85,000 £80,000
90th Percentile £105,000 £110,000 £97,500
UK median annual salary £65,000 £66,000 £60,000
% change year-on-year -1.52% +10.00% -11.11%

PySpark
Job Vacancy Trend for Remote/Hybrid Jobs

Historical trend showing the proportion of permanent IT job postings citing PySpark and offering remote or hybrid work options relative to all permanent IT jobs advertised.

PySpark job vacancy trend for remote/hybrid jobs

PySpark
Salary Trend for Remote/Hybrid Jobs

Salary distribution trend for jobs with remote/hybrid work options citing PySpark.

Salary distribution trend for jobs with remote/hybrid work options citing PySpark

PySpark
Salary Histogram for Remote/Hybrid Jobs

Salary distribution for jobs with remote/hybrid work options citing PySpark over the 6 months to 7 March 2026.

PySpark salary histogram for jobs with remote/hybrid work options

PySpark
Co-Occurring Skills & Capabilities in Remote/Hybrid Jobs by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 9 (15.79%) Apache Spark
2 5 (8.77%) Apache
3 3 (5.26%) Apache Airflow
4 1 (1.75%) Palantir Foundry
4 1 (1.75%) SAS
Cloud Services
1 43 (75.44%) Azure
2 27 (47.37%) Azure Data Factory
3 16 (28.07%) Azure DevOps
4 14 (24.56%) Azure Synapse Analytics
5 13 (22.81%) GitHub
6 12 (21.05%) Amazon S3
7 11 (19.30%) Power Platform
8 10 (17.54%) AWS
9 9 (15.79%) Azure Monitor
9 9 (15.79%) Serverless
10 7 (12.28%) AWS Lambda
11 6 (10.53%) Amazon SageMaker
11 6 (10.53%) dbt
11 6 (10.53%) GCP
12 4 (7.02%) Amazon EMR
12 4 (7.02%) SaaS
13 3 (5.26%) Azure App Service
13 3 (5.26%) GitHub Actions
13 3 (5.26%) Microsoft Purview
14 2 (3.51%) AWS Step Functions
Database & Business Intelligence
1 17 (29.82%) Data Lake
2 16 (28.07%) Delta Lake
3 14 (24.56%) Data Warehouse
4 13 (22.81%) Azure SQL Database
5 12 (21.05%) Metadata
6 11 (19.30%) Power BI
6 11 (19.30%) SQL Server
7 6 (10.53%) Amazon Redshift
8 5 (8.77%) Tableau
9 4 (7.02%) SQL Server Integration Services
10 3 (5.26%) DB2
10 3 (5.26%) IBM InfoSphere
10 3 (5.26%) MySQL
10 3 (5.26%) Parquet
10 3 (5.26%) Relational Database
11 2 (3.51%) Amazon Athena
11 2 (3.51%) Apache Iceberg
12 1 (1.75%) Azure SQL Data Warehouse
12 1 (1.75%) Data Vault
12 1 (1.75%) Spark SQL
Development Applications
1 14 (24.56%) Git
2 3 (5.26%) Jenkins
3 1 (1.75%) Team Foundation Server
General
1 16 (28.07%) Finance
2 12 (21.05%) Social Skills
3 7 (12.28%) Public Sector
4 6 (10.53%) Automotive
4 6 (10.53%) Documentation Skills
5 3 (5.26%) Analytical Skills
5 3 (5.26%) Organisational Skills
6 2 (3.51%) Manufacturing
6 2 (3.51%) Retail
7 1 (1.75%) Front Office
7 1 (1.75%) Law
Job Titles
1 45 (78.95%) Data Engineer
2 14 (24.56%) Senior
3 13 (22.81%) Senior Data Engineer
4 8 (14.04%) Platform Engineer
5 6 (10.53%) Lead
6 5 (8.77%) AWS Data Engineer
6 5 (8.77%) AWS Engineer
6 5 (8.77%) Lead Data Engineer
6 5 (8.77%) Python Engineer
7 4 (7.02%) Python Software Engineer
7 4 (7.02%) Software Engineer
8 3 (5.26%) Artificial Intelligence Engineer
8 3 (5.26%) Azure Data Engineer
8 3 (5.26%) Azure Engineer
9 2 (3.51%) Architect
9 2 (3.51%) Data Manager
10 1 (1.75%) Cloud Architect
10 1 (1.75%) Cloud Engineer
10 1 (1.75%) Full-Stack Developer
10 1 (1.75%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 8 (14.04%) Kafka
2 2 (3.51%) Pandas
3 1 (1.75%) .NET
3 1 (1.75%) .NET Framework
3 1 (1.75%) ARM Templates
3 1 (1.75%) ASP.NET
3 1 (1.75%) NumPy
3 1 (1.75%) Playwright
3 1 (1.75%) pytest
3 1 (1.75%) REST
Miscellaneous
1 9 (15.79%) Cloud Native
2 8 (14.04%) Legacy Systems
3 3 (5.26%) Enterprise Cloud
4 2 (3.51%) Distributed Systems
5 1 (1.75%) Greenfield Project
5 1 (1.75%) Hedge funds
Processes & Methodologies
1 39 (68.42%) Data Pipeline
2 37 (64.91%) Analytics
3 35 (61.40%) DevOps
4 34 (59.65%) Data Engineering
4 34 (59.65%) ETL
5 27 (47.37%) CI/CD
6 25 (43.86%) Data Modelling
7 22 (38.60%) Data Governance
8 17 (29.82%) Business Intelligence
8 17 (29.82%) Data Science
9 14 (24.56%) Agile
10 13 (22.81%) Infrastructure as Code
11 12 (21.05%) Problem-Solving
12 10 (17.54%) Data Analytics
12 10 (17.54%) Machine Learning
12 10 (17.54%) Platform Engineering
13 9 (15.79%) Data Visualisation
13 9 (15.79%) High Availability
13 9 (15.79%) Migration
13 9 (15.79%) Visualisation
Programming Languages
1 54 (94.74%) Python
2 38 (66.67%) SQL
3 21 (36.84%) Scala
4 3 (5.26%) PowerShell
5 2 (3.51%) Java
5 2 (3.51%) R
6 1 (1.75%) Bicep
6 1 (1.75%) C#
6 1 (1.75%) Data Analysis Expressions
6 1 (1.75%) Kusto Query Language
6 1 (1.75%) SPARQL
Qualifications
1 5 (8.77%) Degree
2 4 (7.02%) Azure Certification
2 4 (7.02%) Computer Science Degree
3 3 (5.26%) SC Cleared
3 3 (5.26%) Security Cleared
4 2 (3.51%) AWS Certification
5 1 (1.75%) BPSS Clearance
Quality Assurance & Compliance
1 31 (54.39%) Data Quality
System Software
1 7 (12.28%) Docker
Systems Management
1 20 (35.09%) Terraform
2 6 (10.53%) Kubernetes
3 3 (5.26%) Control-M
Vendors
1 37 (64.91%) Databricks
2 10 (17.54%) Microsoft
3 3 (5.26%) BMC
3 3 (5.26%) IBM
3 3 (5.26%) Talend
4 2 (3.51%) Foundry
5 1 (1.75%) Palantir