Apache Spark Job Trends

Apache Spark
UK

The table below provides summary statistics and salary benchmarking for jobs requiring Apache Spark skills. It covers permanent job vacancies from the 6 months leading up to 24 November 2025, with comparisons to the same periods in the previous two years.

6 months to
24 Nov 2025
Same period 2024 Same period 2023
Rank 430 483 381
Rank change year-on-year +53 -102 -67
Permanent jobs citing Apache Spark 225 274 375
As % of all permanent jobs in the UK 0.42% 0.40% 0.73%
As % of the Application Platforms category 5.88% 4.84% 6.40%
Number of salaries quoted 98 189 261
10th Percentile £55,875 £47,500 £52,500
25th Percentile £65,000 £56,250 £68,718
Median annual salary (50th Percentile) £81,000 £75,000 £80,000
Median % change year-on-year +8.00% -6.25% -
75th Percentile £116,875 £101,250 £97,290
90th Percentile £140,000 £120,000 £115,000
UK excluding London median annual salary £60,000 £57,500 £75,000
% change year-on-year +4.35% -23.33% +15.38%

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills.

Permanent vacancies with a requirement for application platform skills 3,826 5,660 5,859
As % of all permanent jobs advertised in the UK 7.20% 8.36% 11.33%
Number of salaries quoted 2,593 3,470 4,656
10th Percentile £28,500 £31,250 £31,250
25th Percentile £35,000 £39,813 £38,000
Median annual salary (50th Percentile) £52,500 £55,938 £55,000
Median % change year-on-year -6.15% +1.70% -
75th Percentile £73,750 £82,500 £75,000
90th Percentile £96,250 £115,000 £91,934
UK excluding London median annual salary £42,500 £47,000 £47,500
% change year-on-year -9.57% -1.05% -

Apache Spark
Job Vacancy Trend

Historical trend showing the proportion of permanent IT job postings citing Apache Spark relative to all permanent IT jobs advertised.

Apache Spark job vacancy trend in the UK

Apache Spark
Salary Trend

Salary distribution trend for jobs in the UK citing Apache Spark.

Salary distribution trend for jobs in the UK citing Apache Spark

Apache Spark
Salary Histogram

Salary distribution for jobs citing Apache Spark over the 6 months to 24 November 2025.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 6 months to 24 November 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +57 202 £81,000 +6.23% 74
London +47 141 £95,000 - 46
UK excluding London +61 77 £60,000 +4.35% 63
Work from Home +9 41 £76,000 +9.35% 123
North of England +35 30 £60,000 +20.00% 15
Yorkshire +27 19 £60,000 +21.77% 6
Scotland +26 19 - - 7
Midlands +72 12 £55,000 -8.33% 4
South East +21 8 £65,000 +13.04% 27
East Midlands +35 7 - - 2
North West +31 6 £54,250 -1.36% 7
West Midlands +59 5 £55,000 -15.38% 1
North East +19 5 £47,500 -3.60% 2
South West +9 4 £55,000 -29.03% 3
East of England +30 3 - - 1
Wales +13 2 £50,124 -24.28% 4

Apache Spark
Co-Occurring Skills & Capabilities by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 56 (24.89%) Apache
2 44 (19.56%) Apache Airflow
3 5 (2.22%) SAS
4 4 (1.78%) Apache Synapse
5 3 (1.33%) Apache Pulsar
5 3 (1.33%) Luigi
6 1 (0.44%) Apache Superset
6 1 (0.44%) Appian
Business Applications
1 13 (5.78%) SAP S/4HANA
2 1 (0.44%) SAP ERP
Cloud Services
1 161 (71.56%) AWS
2 112 (49.78%) Azure
3 75 (33.33%) GCP
4 43 (19.11%) Amazon S3
5 33 (14.67%) Serverless
6 29 (12.89%) Amazon EKS
7 25 (11.11%) AWS Lambda
8 22 (9.78%) Azure Synapse Analytics
9 20 (8.89%) Snowflake
10 19 (8.44%) Amazon ELB
11 17 (7.56%) Amazon EMR
12 16 (7.11%) Amazon Kinesis
12 16 (7.11%) Power Platform
13 14 (6.22%) AWS Step Functions
13 14 (6.22%) dbt
14 13 (5.78%) GitHub
15 11 (4.89%) Azure Data Factory
16 9 (4.00%) Prefect
17 8 (3.56%) Azure Machine Learning
17 8 (3.56%) OpenShift
Communications & Networking
1 4 (1.78%) Kerberos
2 2 (0.89%) AMQP
2 2 (0.89%) PuTTY
Database & Business Intelligence
1 107 (47.56%) Big Data
2 76 (33.78%) Hadoop
3 66 (29.33%) Data Warehouse
4 59 (26.22%) Amazon Redshift
5 54 (24.00%) NoSQL
6 40 (17.78%) Metadata
7 37 (16.44%) Data Lake
8 32 (14.22%) Delta Lake
8 32 (14.22%) DynamoDB
9 27 (12.00%) Spark SQL
10 23 (10.22%) Apache Hive
10 23 (10.22%) PostgreSQL
10 23 (10.22%) SQL Server
11 20 (8.89%) Apache Iceberg
12 17 (7.56%) Relational Database
13 15 (6.67%) Power BI
14 14 (6.22%) BigQuery
14 14 (6.22%) MySQL
15 13 (5.78%) MongoDB
16 12 (5.33%) Apache Cassandra
Development Applications
1 29 (12.89%) MLflow
2 13 (5.78%) Git
3 9 (4.00%) Jenkins
4 5 (2.22%) Gradle
5 4 (1.78%) Maven
6 3 (1.33%) GitLab
6 3 (1.33%) JUnit
6 3 (1.33%) Terragrunt
7 2 (0.89%) CircleCI
8 1 (0.44%) Cucumber
8 1 (0.44%) Deequ
8 1 (0.44%) Mercurial
8 1 (0.44%) Robot Framework
8 1 (0.44%) Selenium
8 1 (0.44%) Snyk
General
1 109 (48.44%) Social Skills
2 79 (35.11%) Finance
3 60 (26.67%) Law
4 51 (22.67%) Analytical Skills
5 33 (14.67%) Inclusion and Diversity
6 25 (11.11%) Banking
7 18 (8.00%) Financial Institution
7 18 (8.00%) Marketing
8 11 (4.89%) Public Sector
9 8 (3.56%) Investment Banking
10 5 (2.22%) Legal
10 5 (2.22%) Manufacturing
10 5 (2.22%) Tech for Good
11 4 (1.78%) Front Office
12 3 (1.33%) Publishing
12 3 (1.33%) Retail
13 2 (0.89%) Aerospace
13 2 (0.89%) Electronics
13 2 (0.89%) Telecoms
14 1 (0.44%) Pharmaceutical
Job Titles
1 78 (34.67%) Data Engineer
2 50 (22.22%) Senior
3 34 (15.11%) Software Engineer
4 32 (14.22%) Senior Data Engineer
5 29 (12.89%) Lead
6 21 (9.33%) Developer
7 20 (8.89%) Architect
7 20 (8.89%) Machine Learning Engineer
8 19 (8.44%) AWS Engineer
8 19 (8.44%) Operations Engineer
8 19 (8.44%) Python Engineer
9 15 (6.67%) Python Software Engineer
10 13 (5.78%) AWS Data Engineer
10 13 (5.78%) Data Architect
10 13 (5.78%) Data Scientist
10 13 (5.78%) Product Lead
11 11 (4.89%) Java Engineer
11 11 (4.89%) Principal Engineer
11 11 (4.89%) Python Developer
12 10 (4.44%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 97 (43.11%) Kafka
2 44 (19.56%) PySpark
3 36 (16.00%) PyTorch
3 36 (16.00%) TensorFlow
4 33 (14.67%) scikit-learn
5 29 (12.89%) Pandas
6 23 (10.22%) NumPy
7 19 (8.44%) Keras
7 19 (8.44%) Lambda Expressions
7 19 (8.44%) Metaflow
7 19 (8.44%) YAML
8 16 (7.11%) REST
9 13 (5.78%) Spark Streaming
10 10 (4.44%) React
11 9 (4.00%) Spring
12 8 (3.56%) boto
13 7 (3.11%) RabbitMQ
13 7 (3.11%) SpaCy
14 5 (2.22%) Google JAX
14 5 (2.22%) Hugging Face
Miscellaneous
1 52 (23.11%) Distributed Systems
2 35 (15.56%) Cloud Native
3 22 (9.78%) Linux Command Line
4 20 (8.89%) Product Ownership
5 19 (8.44%) Algorithms
6 17 (7.56%) e-Learning
7 14 (6.22%) FMCG
8 12 (5.33%) Data Structures
9 11 (4.89%) Legacy Systems
9 11 (4.89%) Management Information System
10 8 (3.56%) Greenfield Project
11 7 (3.11%) Hybrid Cloud
12 5 (2.22%) Distributed Computing
13 3 (1.33%) Equities
13 3 (1.33%) Mobile Banking
13 3 (1.33%) Public Cloud
13 3 (1.33%) Robotics
13 3 (1.33%) Virtual Team
14 2 (0.89%) Distributed Architecture
14 2 (0.89%) Mainframe
Operating Systems
1 34 (15.11%) Unix
2 11 (4.89%) Linux
3 2 (0.89%) CentOS
3 2 (0.89%) Debian
3 2 (0.89%) Red Hat Enterprise Linux
3 2 (0.89%) Ubuntu
Processes & Methodologies
1 115 (51.11%) CI/CD
2 109 (48.44%) Machine Learning
3 103 (45.78%) Data Pipeline
4 101 (44.89%) Data Engineering
5 94 (41.78%) Analytics
6 89 (39.56%) Data Science
7 87 (38.67%) ETL
8 82 (36.44%) AI
9 78 (34.67%) Data Modelling
10 75 (33.33%) DevOps
11 73 (32.44%) Software Engineering
12 62 (27.56%) Problem-Solving
13 58 (25.78%) Agile
14 52 (23.11%) Containerisation
14 52 (23.11%) Data Governance
15 47 (20.89%) Business Intelligence
15 47 (20.89%) Visualisation
16 46 (20.44%) MLOps
17 44 (19.56%) Decision-Making
18 43 (19.11%) Mentoring
Programming Languages
1 185 (82.22%) Python
2 162 (72.00%) SQL
3 68 (30.22%) Java
4 32 (14.22%) Scala
5 8 (3.56%) R
6 6 (2.67%) JavaScript
7 4 (1.78%) Bash
7 4 (1.78%) Kotlin
7 4 (1.78%) PL/SQL
7 4 (1.78%) TypeScript
8 3 (1.33%) C#
8 3 (1.33%) C++
9 2 (0.89%) PROC SQL
9 2 (0.89%) T-SQL
10 1 (0.44%) C
10 1 (0.44%) Data Analysis Expressions
10 1 (0.44%) Ruby
Qualifications
1 39 (17.33%) Degree
2 23 (10.22%) Master's Degree
3 16 (7.11%) Computer Science Degree
4 15 (6.67%) PhD
5 9 (4.00%) Azure Certification
5 9 (4.00%) Security Cleared
6 8 (3.56%) AWS Certification
7 7 (3.11%) SC Cleared
8 4 (1.78%) DV Cleared
9 2 (0.89%) TOGAF Certification
10 1 (0.44%) Microsoft Certification
Quality Assurance & Compliance
1 56 (24.89%) Data Quality
2 19 (8.44%) QA
3 13 (5.78%) GDPR
4 3 (1.33%) California Consumer Privacy Act
5 2 (0.89%) ISO/IEC 27001
6 1 (0.44%) Accessibility
6 1 (0.44%) HIPAA
6 1 (0.44%) SOC 2
System Software
1 61 (27.11%) Docker
2 15 (6.67%) HDFS
3 6 (2.67%) Active Directory
4 2 (0.89%) Apache Flume
5 1 (0.44%) VMware Infrastructure
Systems Management
1 65 (28.89%) Kubernetes
2 44 (19.56%) Terraform
3 26 (11.56%) Kubeflow
4 13 (5.78%) Ansible
5 7 (3.11%) Prometheus
6 6 (2.67%) Grafana
7 5 (2.22%) Kibana
7 5 (2.22%) logstash
8 4 (1.78%) Puppet
9 2 (0.89%) Oozie
9 2 (0.89%) Progress Chef
10 1 (0.44%) Argo
Vendors
1 95 (42.22%) Databricks
2 18 (8.00%) Microsoft
2 18 (8.00%) Oracle
2 18 (8.00%) SAP
3 11 (4.89%) Google
4 10 (4.44%) Informatica
5 7 (3.11%) Dell
5 7 (3.11%) Talend
6 5 (2.22%) Cloudera
7 3 (1.33%) IBM
7 3 (1.33%) Palantir
7 3 (1.33%) Red Hat
8 2 (0.89%) MicroStrategy
8 2 (0.89%) SaltStack
9 1 (0.44%) BiZZdesign
9 1 (0.44%) Black Duck
9 1 (0.44%) OpenAI
9 1 (0.44%) Salesforce
9 1 (0.44%) UiPath
9 1 (0.44%) VMware