PySpark Jobs in Middlesex

PySpark - Spark Python API
South East > Middlesex

The table below provides summary statistics for permanent job vacancies advertised in Middlesex requiring PySpark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited PySpark over the 6 months leading up to 2 May 2025, comparing them to the same period in the previous two years.

6 months to
2 May 2025
Same period 2024 Same period 2023
Rank 43 - -
Rank change year-on-year - - -
Permanent jobs citing PySpark 9 0 0
As % of all permanent jobs advertised in Middlesex 3.40% - -
As % of the Libraries, Frameworks & Software Standards category 10.98% - -
Number of salaries quoted 0 0 0
Median annual salary (50th Percentile) - - -
South East median annual salary £52,500 £40,000 £65,000
% change year-on-year +31.25% -38.46% +13.04%

All Software Libraries and Frameworks
Middlesex

PySpark falls under the Software Libraries and Frameworks category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring technical specification, industry standards, software libraries and framework skills in Middlesex.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 82 15 72
As % of all permanent jobs advertised in Middlesex 30.94% 6.64% 53.33%
Number of salaries quoted 11 11 61
10th Percentile - £41,000 £47,500
25th Percentile £57,500 £41,250 £66,250
Median annual salary (50th Percentile) £62,500 £60,000 £87,500
Median % change year-on-year +4.17% -31.43% +75.00%
75th Percentile £66,250 £66,250 £105,000
90th Percentile - £67,500 -
South East median annual salary £60,000 £57,500 £60,000
% change year-on-year +4.35% -4.17% +4.35%

PySpark
Job Vacancy Trend in Middlesex

Job postings citing PySpark as a proportion of all IT jobs advertised in Middlesex.

Job vacancy trend for PySpark in Middlesex

PySpark
Co-occurring Skills and Capabilities in Middlesex by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 9 (100.00%) Apache
1 9 (100.00%) Apache Airflow
1 9 (100.00%) Apache Spark
Cloud Services
1 9 (100.00%) OpenShift
Database & Business Intelligence
1 9 (100.00%) Apache Hudi
1 9 (100.00%) Apache Iceberg
1 9 (100.00%) Data Warehouse
1 9 (100.00%) Delta Lake
1 9 (100.00%) Hadoop
1 9 (100.00%) NoSQL
2 2 (22.22%) Big Data
Development Applications
1 9 (100.00%) Bitbucket
General
1 9 (100.00%) Law
Job Titles
1 9 (100.00%) Data Engineer
2 7 (77.78%) Python Data Engineer
2 7 (77.78%) Python Engineer
3 4 (44.44%) Lead
3 4 (44.44%) Lead Data Engineer
4 3 (33.33%) Senior
4 3 (33.33%) Senior Data Engineer
5 2 (22.22%) Big Data Engineer
Libraries, Frameworks & Software Standards
1 9 (100.00%) Kafka
1 9 (100.00%) PyArrow
Operating Systems
1 9 (100.00%) Unix
Processes & Methodologies
1 9 (100.00%) Collaborative Working
1 9 (100.00%) Data Architecture
1 9 (100.00%) Data Engineering
1 9 (100.00%) Data Governance
1 9 (100.00%) Data Modelling
1 9 (100.00%) Data Science
1 9 (100.00%) ETL
Programming Languages
1 9 (100.00%) SQL
2 7 (77.78%) Python
Quality Assurance & Compliance
1 9 (100.00%) Accessibility
1 9 (100.00%) Data Quality
System Software
1 9 (100.00%) HDFS
Systems Management
1 9 (100.00%) Kubernetes
Vendors
1 9 (100.00%) Red Hat