PySpark Jobs in England

PySpark - Spark Python API
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for PySpark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited PySpark over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 626 701 760
Rank change year-on-year +75 +59 +5
Permanent jobs citing PySpark 217 254 396
As % of all permanent jobs advertised in England 0.26% 0.27% 0.30%
As % of the Libraries, Frameworks & Software Standards category 1.25% 0.90% 0.77%
Number of salaries quoted 146 209 166
10th Percentile £52,500 £52,000 £47,500
25th Percentile £57,813 £62,500 £50,000
Median annual salary (50th Percentile) £71,500 £80,000 £68,750
Median % change year-on-year -10.63% +16.36% +5.77%
75th Percentile £90,000 £105,000 £80,000
90th Percentile £100,000 £160,000 £85,000
UK median annual salary £70,000 £80,000 £67,500
% change year-on-year -12.50% +18.52% +3.85%

All Software Libraries and Frameworks
England

PySpark is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 17,316 28,085 51,178
As % of all permanent jobs advertised in England 20.42% 30.13% 39.15%
Number of salaries quoted 14,047 17,318 26,934
10th Percentile £36,250 £41,250 £37,750
25th Percentile £45,500 £51,250 £47,500
Median annual salary (50th Percentile) £60,000 £67,500 £65,000
Median % change year-on-year -11.11% +3.85% +13.04%
75th Percentile £80,000 £88,750 £85,000
90th Percentile £100,000 £107,500 £100,000
UK median annual salary £60,000 £67,500 £62,500
% change year-on-year -11.11% +8.00% +13.64%

PySpark
Job Vacancy Trend in England

Job postings citing PySpark as a proportion of all IT jobs advertised in England.

Job vacancy trend for PySpark in England

PySpark
Salary Trend in England

3-month moving average salary quoted in jobs citing PySpark in England.

Salary trend for PySpark in England

PySpark
Salary Histogram in England

Salary distribution for jobs citing PySpark in England over the 6 months to 27 April 2024.

Salary histogram for PySpark in England

PySpark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing PySpark within the England region over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +118 155 £70,000 -22.22% 33
North of England +73 42 £85,000 +25.93% 5
North West +39 34 £85,000 +6.25% 2
Midlands +10 12 £63,000 +14.55% 2
West Midlands +29 8 £63,000 +5.00% 2
Yorkshire +90 7 £80,000 +28.00% 3
East Midlands -15 4 - -
South East -5 3 £40,000 -38.46% 3
South West -7 2 £65,000 -20.00% 4
East of England +11 1 £55,000 - 1
North East -4 1 £55,000 -15.38%
PySpark
UK

PySpark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 46 (21.20%) Apache Spark
2 26 (11.98%) Apache
3 21 (9.68%) Apache Airflow
4 4 (1.84%) SAS
5 1 (0.46%) Apache Pig
5 1 (0.46%) SharePoint
Applications
1 7 (3.23%) Microsoft Excel
Business Applications
1 4 (1.84%) Primavera
Cloud Services
1 144 (66.36%) Azure
2 67 (30.88%) AWS
3 50 (23.04%) Azure DevOps
4 47 (21.66%) Azure Data Factory
5 37 (17.05%) GCP
6 35 (16.13%) Azure Synapse Analytics
7 34 (15.67%) Power Platform
8 24 (11.06%) GitHub
9 14 (6.45%) Serverless
9 14 (6.45%) Snowflake
10 12 (5.53%) Amazon S3
10 12 (5.53%) AWS Lambda
10 12 (5.53%) Power Automate
10 12 (5.53%) PowerApps
11 11 (5.07%) AWS CloudFormation
12 10 (4.61%) GitHub Actions
13 9 (4.15%) Amazon Kinesis
14 8 (3.69%) Azure Cosmos DB
15 6 (2.76%) dbt
15 6 (2.76%) SaaS
Database & Business Intelligence
1 62 (28.57%) Data Warehouse
2 58 (26.73%) Data Lake
3 51 (23.50%) SQL Server
4 45 (20.74%) Big Data
5 34 (15.67%) Power BI
6 33 (15.21%) Delta Lake
7 30 (13.82%) Tableau
8 21 (9.68%) Data Vault
8 21 (9.68%) NoSQL
9 19 (8.76%) Hadoop
10 18 (8.29%) Spark SQL
11 15 (6.91%) Azure SQL Database
12 11 (5.07%) Amazon Redshift
13 10 (4.61%) Apache Hive
14 9 (4.15%) SQL Server Integration Services
15 8 (3.69%) Flink
15 8 (3.69%) MySQL
15 8 (3.69%) Parquet
16 7 (3.23%) Data Mining
17 5 (2.30%) DynamoDB
Development Applications
1 50 (23.04%) Git
2 23 (10.60%) JIRA
3 17 (7.83%) Jenkins
4 8 (3.69%) CircleCI
5 4 (1.84%) Octopus Deploy
6 2 (0.92%) JMeter
6 2 (0.92%) Postman
6 2 (0.92%) SpecFlow
7 1 (0.46%) Selenium
7 1 (0.46%) SoapUI
7 1 (0.46%) Team Foundation Server
7 1 (0.46%) TeamCity
General
1 69 (31.80%) Social Skills
2 51 (23.50%) Finance
3 19 (8.76%) Analytical Skills
4 13 (5.99%) Banking
5 11 (5.07%) Inclusion and Diversity
5 11 (5.07%) Legal
5 11 (5.07%) Retail
6 8 (3.69%) Retail Banking
7 6 (2.76%) Law
8 4 (1.84%) Influencing Skills
8 4 (1.84%) Presentation Skills
9 3 (1.38%) Public Sector
10 2 (0.92%) Publishing
11 1 (0.46%) Automotive
11 1 (0.46%) Aviation
11 1 (0.46%) Financial Institution
11 1 (0.46%) Marketing
Job Titles
1 130 (59.91%) Data Engineer
2 112 (51.61%) Senior
3 62 (28.57%) Senior Data Engineer
4 33 (15.21%) Data Scientist
5 29 (13.36%) Senior Data Scientist
6 24 (11.06%) Azure Engineer
7 21 (9.68%) Lead
8 17 (7.83%) Azure Data Engineer
9 11 (5.07%) Lead Data Engineer
10 7 (3.23%) Architect
10 7 (3.23%) Consultant
10 7 (3.23%) Data Consultant
10 7 (3.23%) Python Engineer
10 7 (3.23%) Software Engineer
10 7 (3.23%) Technical Leader
11 6 (2.76%) Customer Engineer
11 6 (2.76%) Principal Consultant
11 6 (2.76%) Senior Consultant
12 5 (2.30%) Analyst
12 5 (2.30%) Data Architect
Libraries, Frameworks & Software Standards
1 40 (18.43%) Pandas
2 30 (13.82%) scikit-learn
3 28 (12.90%) TensorFlow
4 12 (5.53%) Kafka
5 10 (4.61%) AWS CDK
6 8 (3.69%) Apache Avro
6 8 (3.69%) Apache Beam
6 8 (3.69%) Spark Streaming
7 3 (1.38%) NumPy
8 2 (0.92%) MDX
8 2 (0.92%) Plotly
8 2 (0.92%) PyTorch
8 2 (0.92%) React
8 2 (0.92%) SciPy
9 1 (0.46%) .NET Framework
9 1 (0.46%) ARM Templates
9 1 (0.46%) CSS
9 1 (0.46%) HTML
9 1 (0.46%) jQuery
9 1 (0.46%) Lambda Expressions
Miscellaneous
1 37 (17.05%) Algorithms
2 28 (12.90%) Reinsurance
3 26 (11.98%) Data Structures
3 26 (11.98%) Public Cloud
4 14 (6.45%) Greenfield Project
5 9 (4.15%) Distributed Systems
5 9 (4.15%) Product Ownership
6 8 (3.69%) Distributed Applications
7 5 (2.30%) Low-Code
8 4 (1.84%) Self-Motivation
9 2 (0.92%) Cloud Native
9 2 (0.92%) Hybrid Cloud
9 2 (0.92%) Management Information System
9 2 (0.92%) PropTech
10 1 (0.46%) Data Protection Act
10 1 (0.46%) Legacy Applications
10 1 (0.46%) Team-Oriented Environment
Operating Systems
1 2 (0.92%) Linux
2 1 (0.46%) Ubuntu
Processes & Methodologies
1 106 (48.85%) ETL
2 78 (35.94%) Data Engineering
3 75 (34.56%) Data Science
4 73 (33.64%) Agile
4 73 (33.64%) Data Modelling
5 66 (30.41%) CI/CD
6 65 (29.95%) Data Pipeline
6 65 (29.95%) Machine Learning
7 57 (26.27%) DevOps
8 52 (23.96%) Data Integration
9 44 (20.28%) Analytics
10 42 (19.35%) Artificial Intelligence
10 42 (19.35%) MLOps
11 41 (18.89%) Decision-Making
12 40 (18.43%) Migration
13 39 (17.97%) Visualisation
14 38 (17.51%) Business Intelligence
15 34 (15.67%) Statistics
16 33 (15.21%) Mathematics
17 32 (14.75%) Physics
Programming Languages
1 186 (85.71%) Python
2 183 (84.33%) SQL
3 16 (7.37%) Scala
4 14 (6.45%) R
5 11 (5.07%) Java
6 8 (3.69%) T-SQL
7 7 (3.23%) Data Analysis Expressions
8 5 (2.30%) C#
9 2 (0.92%) PL/SQL
10 1 (0.46%) C++
10 1 (0.46%) Shell Script
10 1 (0.46%) TypeScript
Qualifications
1 48 (22.12%) Degree
2 30 (13.82%) DBS Check
2 30 (13.82%) Master's Degree
3 13 (5.99%) Microsoft Certification
4 8 (3.69%) Azure Certification
5 7 (3.23%) Computer Science Degree
6 4 (1.84%) CIMA
7 3 (1.38%) SC Cleared
7 3 (1.38%) Security Cleared
8 1 (0.46%) PhD
Quality Assurance & Compliance
1 38 (17.51%) Data Quality
2 4 (1.84%) QA
System Software
1 8 (3.69%) HDFS
2 6 (2.76%) Docker
3 1 (0.46%) Apache Flume
Systems Management
1 18 (8.29%) Terraform
2 5 (2.30%) Kubernetes
Vendors
1 145 (66.82%) Databricks
2 30 (13.82%) Informatica
2 30 (13.82%) Microsoft
3 29 (13.36%) Oracle
4 11 (5.07%) Cloudera
5 5 (2.30%) OpenAI
6 4 (1.84%) Google
6 4 (1.84%) SAP
6 4 (1.84%) SnapLogic
6 4 (1.84%) Splunk
7 3 (1.38%) Teradata
8 2 (0.92%) ServiceNow
9 1 (0.46%) Facebook
9 1 (0.46%) Twitter