PySpark Jobs in the North of England

PySpark - Spark Python API
England > North of England

The following table provides summary statistics for permanent job vacancies advertised in the North of England with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 17 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
17 May 2024
Same period 2023 Same period 2022
Rank 348 417 433
Rank change year-on-year +69 +16 -78
Permanent jobs citing PySpark 42 20 32
As % of all permanent jobs advertised in the North of England 0.24% 0.12% 0.18%
As % of the Libraries, Frameworks & Software Standards category 1.21% 0.41% 0.55%
Number of salaries quoted 38 11 3
10th Percentile £54,000 £47,500 £60,000
25th Percentile £75,000 £57,500 £67,500
Median annual salary (50th Percentile) £82,500 £65,000 £80,000
Median % change year-on-year +26.92% -18.75% +39.13%
75th Percentile £90,000 £80,000 -
90th Percentile - £112,500 -
England median annual salary £70,000 £81,147 £70,000
% change year-on-year -13.74% +15.92% +7.69%

All Software Libraries and Frameworks
North of England

PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the North of England with a requirement for technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 3,459 4,823 5,826
As % of all permanent jobs advertised in the North of England 19.59% 28.65% 32.20%
Number of salaries quoted 2,773 2,331 3,780
10th Percentile £34,000 £37,500 £33,750
25th Percentile £42,500 £45,000 £41,250
Median annual salary (50th Percentile) £55,000 £57,500 £53,112
Median % change year-on-year -4.35% +8.26% +11.81%
75th Percentile £70,000 £72,500 £67,500
90th Percentile £80,000 £85,000 £82,500
England median annual salary £60,000 £67,500 £65,000
% change year-on-year -11.11% +3.85% +13.04%

PySpark
Job Vacancy Trend in the North of England

Job postings citing PySpark as a proportion of all IT jobs advertised in the North of England.

Job vacancy trend for PySpark in the North of England

PySpark
Salary Trend in the North of England

3-month moving average salary quoted in jobs citing PySpark in the North of England.

Salary trend for PySpark in the North of England

PySpark
Salary Histogram in the North of England

Salary distribution for jobs citing PySpark in the North of England over the 6 months to 17 May 2024.

Salary histogram for PySpark in the North of England

PySpark
Job Locations in the North of England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the North of England region over the 6 months to 17 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
North West +26 36 £85,000 +6.25% 2
Yorkshire +69 6 £80,000 +45.45% 4
PySpark
England

PySpark
Co-occurring Skills and Capabilities in the North of England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (9.52%) SAS
2 3 (7.14%) Apache Spark
Cloud Services
1 37 (88.10%) Azure
2 23 (54.76%) Azure DevOps
3 7 (16.67%) Azure Data Factory
3 7 (16.67%) Azure Synapse Analytics
3 7 (16.67%) Power Platform
4 1 (2.38%) AWS
Database & Business Intelligence
1 29 (69.05%) SQL Server
2 20 (47.62%) Data Vault
3 18 (42.86%) Delta Lake
4 7 (16.67%) Data Lake
4 7 (16.67%) Data Warehouse
4 7 (16.67%) Power BI
5 4 (9.52%) Semantic Layer
6 3 (7.14%) Azure SQL Database
6 3 (7.14%) Big Data
6 3 (7.14%) Data Mart
6 3 (7.14%) Hadoop
7 1 (2.38%) Riak
Development Applications
1 20 (47.62%) JIRA
General
1 9 (21.43%) Retail
2 8 (19.05%) Finance
3 6 (14.29%) Social Skills
4 4 (9.52%) Analytical Skills
5 1 (2.38%) Legal
5 1 (2.38%) Public Sector
Job Titles
1 35 (83.33%) Data Engineer
2 19 (45.24%) Senior
3 13 (30.95%) Senior Data Engineer
4 5 (11.90%) Customer Engineer
4 5 (11.90%) Lead
4 5 (11.90%) Lead Data Engineer
5 4 (9.52%) Analyst
5 4 (9.52%) Pricing Analyst
5 4 (9.52%) Senior Analyst
5 4 (9.52%) Senior Pricing Analyst
6 3 (7.14%) Azure Data Engineer
6 3 (7.14%) Azure Engineer
6 3 (7.14%) Informatica Engineer
7 1 (2.38%) Data Scientist
7 1 (2.38%) Developer
7 1 (2.38%) Python Developer
Miscellaneous
1 25 (59.52%) Public Cloud
1 25 (59.52%) Reinsurance
2 20 (47.62%) Data Structures
3 5 (11.90%) Product Ownership
4 4 (9.52%) Self-Motivation
Operating Systems
1 1 (2.38%) Linux
1 1 (2.38%) Ubuntu
Processes & Methodologies
1 29 (69.05%) Agile
1 29 (69.05%) Data Modelling
2 26 (61.90%) ETL
3 25 (59.52%) Data Integration
3 25 (59.52%) Migration
4 20 (47.62%) Data Analysis
4 20 (47.62%) Scaled Agile Framework
4 20 (47.62%) Scrum
5 12 (28.57%) Analytics
5 12 (28.57%) Data Engineering
6 9 (21.43%) CI/CD
6 9 (21.43%) Coaching
6 9 (21.43%) Decision-Making
6 9 (21.43%) Mentoring
7 8 (19.05%) DevOps
8 7 (16.67%) Business Intelligence
8 7 (16.67%) Data Pipeline
8 7 (16.67%) Visualisation
9 5 (11.90%) Machine Learning
9 5 (11.90%) Predictive Analytics
Programming Languages
1 36 (85.71%) SQL
2 30 (71.43%) Python
3 4 (9.52%) R
Qualifications
1 4 (9.52%) Degree
2 3 (7.14%) Azure Certification
2 3 (7.14%) Microsoft Certification
3 1 (2.38%) SC Cleared
3 1 (2.38%) Security Cleared
Quality Assurance & Compliance
1 24 (57.14%) Data Quality
Systems Management
1 2 (4.76%) Terraform
Vendors
1 28 (66.67%) Databricks
2 25 (59.52%) Informatica
2 25 (59.52%) Oracle
3 3 (7.14%) Microsoft