PySpark Jobs with Hybrid/Remote/WFH Options

PySpark - Spark Python API
UK > Work from Home

The table below provides summary statistics for permanent remote or hybrid work requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 2 May 2025, comparing them to the same period in the previous two years.

6 months to
2 May 2025
Same period 2024 Same period 2023
Rank 228 472 528
Rank change year-on-year +244 +56 +112
Permanent jobs citing PySpark 194 117 145
As % of all permanent jobs with a WFH option 1.30% 0.35% 0.34%
As % of the Libraries, Frameworks & Software Standards category 4.93% 1.30% 1.00%
Number of salaries quoted 162 81 127
10th Percentile £61,250 £52,500 £52,500
25th Percentile £97,500 £55,000 £58,125
Median annual salary (50th Percentile) £110,000 £67,500 £80,294
Median % change year-on-year +62.96% -15.93% +20.74%
75th Percentile £138,750 £82,500 £105,000
90th Percentile £147,500 £100,000 £160,000
UK median annual salary £110,000 £70,000 £80,000
% change year-on-year +57.14% -12.50% +18.52%

All Software Libraries and Frameworks
Work from Home

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies with remote or hybrid options requiring technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,933 8,978 14,466
As % of all permanent jobs with a WFH option 26.28% 26.53% 33.88%
Number of salaries quoted 3,186 7,510 10,860
10th Percentile £40,000 £39,225 £41,250
25th Percentile £51,250 £47,500 £51,000
Median annual salary (50th Percentile) £65,000 £60,000 £65,000
Median % change year-on-year +8.33% -7.69% +4.00%
75th Percentile £86,250 £79,500 £86,250
90th Percentile £115,000 £100,000 £102,500
UK median annual salary £65,000 £60,000 £67,500
% change year-on-year +8.33% -11.11% +8.00%

PySpark
Trend for Jobs with a WFH Option

Job vacancies with remote working options citing PySpark as a proportion of all IT jobs advertised.

PySpark trend for jobs with Hybrid/Remote/WFH options

PySpark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with remote working options citing PySpark.

PySpark salary trend for jobs with a WFH option

PySpark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with remote working options citing PySpark over the 6 months to 2 May 2025.

PySpark salary histogram for jobs with a WFH option

PySpark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 136 (70.10%) Apache Airflow
2 131 (67.53%) Apache
3 90 (46.39%) Apache Spark
4 1 (0.52%) SAS
Business Applications
1 2 (1.03%) Dynamics CRM
Cloud Services
1 147 (75.77%) AWS
2 129 (66.49%) dbt
3 105 (54.12%) Amazon ECS
4 81 (41.75%) Serverless
5 80 (41.24%) OpenShift
6 78 (40.21%) AWS Lambda
7 50 (25.77%) Snowflake
8 42 (21.65%) GCP
9 39 (20.10%) Dagster
10 38 (19.59%) Amazon EC2
11 34 (17.53%) Amazon EKS
12 28 (14.43%) Azure
13 11 (5.67%) Azure Data Factory
13 11 (5.67%) Azure Synapse Analytics
13 11 (5.67%) Power Platform
14 9 (4.64%) Amazon S3
15 5 (2.58%) Amazon Kinesis
15 5 (2.58%) Azure DevOps
16 3 (1.55%) Amazon SageMaker
16 3 (1.55%) Azure Functions
Communications & Networking
1 2 (1.03%) ADSL
1 2 (1.03%) Internet
Database & Business Intelligence
1 135 (69.59%) Apache Iceberg
2 130 (67.01%) Amazon Athena
3 126 (64.95%) Dremio
4 121 (62.37%) Apache Arrow
5 105 (54.12%) Apache Ignite
6 55 (28.35%) Data Lake
7 26 (13.40%) Data Warehouse
8 13 (6.70%) Hadoop
8 13 (6.70%) Tableau
9 12 (6.19%) Delta Lake
10 11 (5.67%) Power BI
11 9 (4.64%) Apache Hudi
11 9 (4.64%) NoSQL
12 8 (4.12%) Spark SQL
13 6 (3.09%) Amazon Redshift
13 6 (3.09%) Big Data
14 5 (2.58%) PostgreSQL
15 4 (2.06%) Parquet
16 3 (1.55%) Amazon RDS
16 3 (1.55%) Data Mining
Development Applications
1 71 (36.60%) Artifactory
2 13 (6.70%) Git
3 9 (4.64%) Bitbucket
4 3 (1.55%) GitLab
General
1 131 (67.53%) Finance
2 126 (64.95%) Front Office
3 58 (29.90%) Banking
4 50 (25.77%) Investment Banking
5 23 (11.86%) Social Skills
6 9 (4.64%) Law
7 7 (3.61%) Analytical Skills
8 6 (3.09%) Retail
9 5 (2.58%) Presentation Skills
10 3 (1.55%) Marketing
10 3 (1.55%) Public Sector
11 2 (1.03%) Advertising
11 2 (1.03%) Games
12 1 (0.52%) Billing
12 1 (0.52%) Inclusion and Diversity
12 1 (0.52%) Influencing Skills
12 1 (0.52%) Manufacturing
12 1 (0.52%) Telecoms
Job Titles
1 124 (63.92%) AWS Engineer
2 117 (60.31%) Data Engineer
3 102 (52.58%) Python Engineer
4 71 (36.60%) AWS DevOps
4 71 (36.60%) AWS DevOps Engineer
4 71 (36.60%) DevOps Engineer
5 50 (25.77%) AWS Software Engineer
5 50 (25.77%) Software Engineer
6 42 (21.65%) Senior
7 31 (15.98%) Java Engineer
7 31 (15.98%) Java Software Engineer
8 19 (9.79%) Python Software Engineer
9 18 (9.28%) Developer
9 18 (9.28%) Senior Software Engineer
10 17 (8.76%) AWS Developer
11 16 (8.25%) Developer/Software Engineer
11 16 (8.25%) Snowflake Developer
11 16 (8.25%) Snowflake Engineer
11 16 (8.25%) Software Developer
12 12 (6.19%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 84 (43.30%) Kafka
2 71 (36.60%) J2EE
3 48 (24.74%) Pandas
4 39 (20.10%) NumPy
4 39 (20.10%) SciPy
5 34 (17.53%) gRPC
5 34 (17.53%) Protocol Buffers
6 11 (5.67%) scikit-learn
6 11 (5.67%) TensorFlow
7 9 (4.64%) PyArrow
8 3 (1.55%) XGBoost
9 2 (1.03%) PyTorch
10 1 (0.52%) Django
10 1 (0.52%) Flask
10 1 (0.52%) JSON
Miscellaneous
1 50 (25.77%) Derivative
1 50 (25.77%) Equities
1 50 (25.77%) Fixed Income
1 50 (25.77%) Foreign Exchange (FX)
1 50 (25.77%) Hedge funds
2 9 (4.64%) Algorithms
2 9 (4.64%) Credit Risk
3 5 (2.58%) Product Ownership
4 3 (1.55%) Life Science
5 2 (1.03%) Data Fabric
5 2 (1.03%) Distributed Computing
5 2 (1.03%) Low-Code
5 2 (1.03%) Management Information System
5 2 (1.03%) Reinsurance
6 1 (0.52%) Greenfield Project
Operating Systems
1 9 (4.64%) Unix
Processes & Methodologies
1 129 (66.49%) Software Engineering
2 126 (64.95%) Agile
2 126 (64.95%) Asset Management
3 108 (55.67%) Data Engineering
4 86 (44.33%) CI/CD
5 83 (42.78%) DevOps
6 73 (37.63%) Open Source
7 71 (36.60%) Site Reliability Engineering
8 43 (22.16%) Migration
9 37 (19.07%) Data Science
10 28 (14.43%) ETL
11 25 (12.89%) Analytics
12 22 (11.34%) Machine Learning
13 20 (10.31%) Data Pipeline
13 20 (10.31%) Visualisation
14 18 (9.28%) Data Management
15 15 (7.73%) Data Governance
15 15 (7.73%) Data Modelling
16 14 (7.22%) Artificial Intelligence
16 14 (7.22%) Data Architecture
Programming Languages
1 188 (96.91%) Python
2 130 (67.01%) Java
3 71 (36.60%) Go
4 70 (36.08%) SQL
5 34 (17.53%) JavaScript
5 34 (17.53%) TypeScript
6 4 (2.06%) Scala
7 3 (1.55%) R
8 1 (0.52%) PowerShell
8 1 (0.52%) T-SQL
Qualifications
1 13 (6.70%) DBS Check
2 12 (6.19%) Degree
3 10 (5.15%) Master's Degree
4 7 (3.61%) SC Cleared
4 7 (3.61%) Security Cleared
5 2 (1.03%) AWS Certification
5 2 (1.03%) Azure Certification
6 1 (0.52%) Computer Science Degree
Quality Assurance & Compliance
1 23 (11.86%) Data Quality
2 9 (4.64%) Accessibility
System Software
1 76 (39.18%) Docker
2 9 (4.64%) HDFS
Systems Management
1 84 (43.30%) Kubernetes
2 78 (40.21%) Terraform
3 2 (1.03%) Ansible
Vendors
1 32 (16.49%) Databricks
2 10 (5.15%) Microsoft
3 9 (4.64%) Red Hat
4 5 (2.58%) Foundry
4 5 (2.58%) Palantir
5 2 (1.03%) Apple
5 2 (1.03%) Cloudera