Apache Spark Job Trends

Apache Spark
UK

The table below provides summary statistics and salary benchmarking for jobs requiring Apache Spark skills. It covers permanent job vacancies from the 6 months leading up to 30 November 2025, with comparisons to the same periods in the previous two years.

6 months to
30 Nov 2025
Same period 2024 Same period 2023
Rank 418 479 371
Rank change year-on-year +61 -108 -54
Permanent jobs citing Apache Spark 219 279 395
As % of all permanent jobs in the UK 0.40% 0.43% 0.77%
As % of the Application Platforms category 5.83% 4.95% 6.79%
Number of salaries quoted 100 197 265
10th Percentile £49,925 £48,250 £52,500
25th Percentile £64,063 £56,250 £67,500
Median annual salary (50th Percentile) £81,000 £77,500 £80,000
Median % change year-on-year +4.52% -3.13% -
75th Percentile £115,625 £102,500 £97,290
90th Percentile £140,000 £121,000 £113,500
UK excluding London median annual salary £60,000 £57,500 £75,000
% change year-on-year +4.35% -23.33% +15.38%

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills.

Permanent vacancies with a requirement for application platform skills 3,759 5,641 5,815
As % of all permanent jobs advertised in the UK 6.95% 8.62% 11.41%
Number of salaries quoted 2,555 3,473 4,600
10th Percentile £28,500 £31,250 £31,250
25th Percentile £35,000 £39,750 £38,000
Median annual salary (50th Percentile) £52,000 £55,762 £55,000
Median % change year-on-year -6.75% +1.39% -
75th Percentile £73,750 £82,500 £75,000
90th Percentile £97,500 £115,000 £91,934
UK excluding London median annual salary £42,500 £47,500 £47,500
% change year-on-year -10.53% - -

Apache Spark
Job Vacancy Trend

Historical trend showing the proportion of permanent IT job postings citing Apache Spark relative to all permanent IT jobs advertised.

Apache Spark job vacancy trend in the UK

Apache Spark
Salary Trend

Salary distribution trend for jobs in the UK citing Apache Spark.

Salary distribution trend for jobs in the UK citing Apache Spark

Apache Spark
Salary Histogram

Salary distribution for jobs citing Apache Spark over the 6 months to 30 November 2025.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 6 months to 30 November 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +49 200 £81,000 +4.52% 60
London +48 138 £95,000 - 46
UK excluding London +52 74 £60,000 +4.35% 53
Work from Home +5 43 £80,000 +15.11% 42
North of England +49 33 £60,000 +20.00% 9
Yorkshire +28 22 £60,000 +21.77% 5
Scotland +19 15 £90,000 - 5
Midlands +55 12 £55,000 -8.33% 2
East Midlands +29 7 - - 1
North West +30 6 £54,250 -1.36% 1
West Midlands +52 5 £55,000 -15.38% 1
South East +27 5 £65,000 +13.04% 32
North East +12 5 £47,500 -3.60% 3
East of England +32 4 - -
South West +10 4 £55,000 -29.03% 1
Wales +9 2 £50,124 -24.28% 3

Apache Spark
Co-Occurring Skills & Capabilities by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 54 (24.66%) Apache
2 46 (21.00%) Apache Airflow
3 5 (2.28%) Apache Synapse
3 5 (2.28%) SAS
4 3 (1.37%) Luigi
5 2 (0.91%) Apache Pulsar
6 1 (0.46%) Apache Superset
6 1 (0.46%) Appian
Business Applications
1 13 (5.94%) SAP S/4HANA
2 1 (0.46%) SAP ERP
Cloud Services
1 155 (70.78%) AWS
2 112 (51.14%) Azure
3 74 (33.79%) GCP
4 42 (19.18%) Amazon S3
5 33 (15.07%) Serverless
6 27 (12.33%) Amazon EKS
7 25 (11.42%) AWS Lambda
7 25 (11.42%) Azure Synapse Analytics
8 20 (9.13%) Snowflake
9 19 (8.68%) Amazon ELB
9 19 (8.68%) Power Platform
10 17 (7.76%) Amazon EMR
10 17 (7.76%) Amazon Kinesis
11 16 (7.31%) dbt
12 14 (6.39%) AWS Step Functions
13 13 (5.94%) Azure Data Factory
13 13 (5.94%) GitHub
14 9 (4.11%) Prefect
15 8 (3.65%) OpenShift
16 7 (3.20%) Azure Machine Learning
Communications & Networking
1 4 (1.83%) Kerberos
2 2 (0.91%) AMQP
2 2 (0.91%) PuTTY
Database & Business Intelligence
1 99 (45.21%) Big Data
2 73 (33.33%) Hadoop
3 65 (29.68%) Data Warehouse
4 59 (26.94%) Amazon Redshift
5 49 (22.37%) NoSQL
6 40 (18.26%) Metadata
7 34 (15.53%) Data Lake
8 32 (14.61%) Delta Lake
8 32 (14.61%) DynamoDB
9 26 (11.87%) Spark SQL
10 24 (10.96%) PostgreSQL
11 23 (10.50%) SQL Server
12 21 (9.59%) Apache Hive
13 18 (8.22%) MySQL
13 18 (8.22%) Power BI
14 16 (7.31%) Apache Iceberg
14 16 (7.31%) MongoDB
14 16 (7.31%) Relational Database
15 15 (6.85%) BigQuery
16 12 (5.48%) Apache Cassandra
Development Applications
1 29 (13.24%) MLflow
2 16 (7.31%) Git
3 11 (5.02%) Jenkins
4 4 (1.83%) Gradle
5 3 (1.37%) GitLab
5 3 (1.37%) Maven
6 2 (0.91%) CircleCI
6 2 (0.91%) JUnit
6 2 (0.91%) Terragrunt
7 1 (0.46%) Cucumber
7 1 (0.46%) Deequ
7 1 (0.46%) Mercurial
7 1 (0.46%) Robot Framework
7 1 (0.46%) Selenium
7 1 (0.46%) Snyk
General
1 108 (49.32%) Social Skills
2 72 (32.88%) Finance
3 52 (23.74%) Analytical Skills
4 49 (22.37%) Law
5 24 (10.96%) Inclusion and Diversity
6 20 (9.13%) Banking
7 18 (8.22%) Financial Institution
8 14 (6.39%) Marketing
9 13 (5.94%) Public Sector
10 6 (2.74%) Investment Banking
11 5 (2.28%) Manufacturing
11 5 (2.28%) Tech for Good
12 4 (1.83%) Front Office
12 4 (1.83%) Legal
13 3 (1.37%) Retail
14 2 (0.91%) Aerospace
14 2 (0.91%) Electronics
14 2 (0.91%) Publishing
14 2 (0.91%) Telecoms
15 1 (0.46%) Pharmaceutical
Job Titles
1 80 (36.53%) Data Engineer
2 51 (23.29%) Senior
3 33 (15.07%) Senior Data Engineer
4 26 (11.87%) Lead
4 26 (11.87%) Software Engineer
5 20 (9.13%) Developer
5 20 (9.13%) Machine Learning Engineer
6 19 (8.68%) Architect
6 19 (8.68%) Operations Engineer
7 17 (7.76%) AWS Engineer
8 14 (6.39%) Python Engineer
9 13 (5.94%) AWS Data Engineer
9 13 (5.94%) Data Scientist
9 13 (5.94%) Product Lead
10 12 (5.48%) Data Architect
10 12 (5.48%) Principal Engineer
11 11 (5.02%) Python Developer
12 10 (4.57%) Python Software Engineer
13 8 (3.65%) Java Engineer
13 8 (3.65%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 92 (42.01%) Kafka
2 45 (20.55%) PySpark
3 37 (16.89%) PyTorch
3 37 (16.89%) TensorFlow
4 33 (15.07%) scikit-learn
5 29 (13.24%) Pandas
6 23 (10.50%) NumPy
7 19 (8.68%) Keras
7 19 (8.68%) Lambda Expressions
7 19 (8.68%) Metaflow
7 19 (8.68%) YAML
8 15 (6.85%) REST
9 12 (5.48%) Spark Streaming
10 10 (4.57%) React
11 8 (3.65%) boto
11 8 (3.65%) Spring
12 7 (3.20%) SpaCy
13 6 (2.74%) RabbitMQ
14 5 (2.28%) Apache Beam
14 5 (2.28%) OAuth2
Miscellaneous
1 50 (22.83%) Distributed Systems
2 29 (13.24%) Cloud Native
3 22 (10.05%) Linux Command Line
4 21 (9.59%) Product Ownership
5 17 (7.76%) Algorithms
5 17 (7.76%) e-Learning
6 14 (6.39%) FMCG
7 11 (5.02%) Legacy Systems
8 10 (4.57%) Data Structures
9 9 (4.11%) Management Information System
10 8 (3.65%) Greenfield Project
10 8 (3.65%) Hybrid Cloud
11 6 (2.74%) Distributed Computing
12 3 (1.37%) Equities
12 3 (1.37%) Robotics
12 3 (1.37%) Virtual Team
13 2 (0.91%) Distributed Architecture
13 2 (0.91%) Mainframe
13 2 (0.91%) Mobile Banking
13 2 (0.91%) Public Cloud
Operating Systems
1 33 (15.07%) Unix
2 11 (5.02%) Linux
3 2 (0.91%) CentOS
3 2 (0.91%) Debian
3 2 (0.91%) Red Hat Enterprise Linux
3 2 (0.91%) Ubuntu
Processes & Methodologies
1 111 (50.68%) CI/CD
2 106 (48.40%) Machine Learning
3 105 (47.95%) Data Pipeline
4 101 (46.12%) Data Engineering
5 94 (42.92%) Analytics
6 90 (41.10%) Data Science
7 86 (39.27%) ETL
8 77 (35.16%) Data Modelling
9 76 (34.70%) AI
10 72 (32.88%) DevOps
11 65 (29.68%) Software Engineering
12 60 (27.40%) Problem-Solving
13 51 (23.29%) Agile
14 50 (22.83%) Data Governance
15 49 (22.37%) Containerisation
16 47 (21.46%) Business Intelligence
17 45 (20.55%) MLOps
17 45 (20.55%) Visualisation
18 44 (20.09%) Mentoring
19 39 (17.81%) Decision-Making
Programming Languages
1 183 (83.56%) Python
2 157 (71.69%) SQL
3 64 (29.22%) Java
4 34 (15.53%) Scala
5 8 (3.65%) R
6 6 (2.74%) JavaScript
7 4 (1.83%) Bash
7 4 (1.83%) TypeScript
8 3 (1.37%) C#
8 3 (1.37%) C++
8 3 (1.37%) Kotlin
8 3 (1.37%) PL/SQL
8 3 (1.37%) T-SQL
9 2 (0.91%) Data Analysis Expressions
9 2 (0.91%) PROC SQL
10 1 (0.46%) C
10 1 (0.46%) Ruby
Qualifications
1 36 (16.44%) Degree
2 19 (8.68%) Master's Degree
3 16 (7.31%) PhD
4 12 (5.48%) Computer Science Degree
5 10 (4.57%) Security Cleared
6 8 (3.65%) SC Cleared
7 6 (2.74%) Azure Certification
8 5 (2.28%) AWS Certification
9 4 (1.83%) DV Cleared
10 2 (0.91%) TOGAF Certification
11 1 (0.46%) Microsoft Certification
Quality Assurance & Compliance
1 55 (25.11%) Data Quality
2 19 (8.68%) QA
3 10 (4.57%) GDPR
4 2 (0.91%) ISO/IEC 27001
5 1 (0.46%) Accessibility
System Software
1 58 (26.48%) Docker
2 14 (6.39%) HDFS
3 5 (2.28%) Active Directory
4 2 (0.91%) Apache Flume
5 1 (0.46%) VMware Infrastructure
Systems Management
1 61 (27.85%) Kubernetes
2 44 (20.09%) Terraform
3 26 (11.87%) Kubeflow
4 13 (5.94%) Ansible
5 7 (3.20%) Prometheus
6 6 (2.74%) Grafana
7 5 (2.28%) Kibana
7 5 (2.28%) logstash
8 4 (1.83%) Puppet
9 2 (0.91%) Oozie
9 2 (0.91%) Progress Chef
10 1 (0.46%) Argo
Vendors
1 95 (43.38%) Databricks
2 20 (9.13%) Oracle
3 18 (8.22%) SAP
4 17 (7.76%) Microsoft
5 11 (5.02%) Informatica
6 8 (3.65%) Google
6 8 (3.65%) Talend
7 7 (3.20%) Dell
8 5 (2.28%) Palantir
9 4 (1.83%) Cloudera
10 3 (1.37%) IBM
10 3 (1.37%) Red Hat
11 2 (0.91%) MicroStrategy
11 2 (0.91%) SaltStack
12 1 (0.46%) BiZZdesign
12 1 (0.46%) Black Duck
12 1 (0.46%) OpenAI
12 1 (0.46%) Salesforce
12 1 (0.46%) UiPath
12 1 (0.46%) VMware