Apache Spark Job Trends

Apache Spark
UK

The table below provides summary statistics and salary benchmarking for jobs requiring Apache Spark skills. It covers vacancies from the 6 months leading up to 16 September 2025, with comparisons to the same periods in the previous two years.

6 months to
16 Sep 2025
Same period 2024 Same period 2023
Rank 432 414 357
Rank change year-on-year -18 -57 -92
Permanent jobs citing Apache Spark 258 437 526
As % of all permanent jobs advertised in the UK 0.52% 0.56% 0.85%
As % of the Application Platforms category 6.40% 6.39% 7.65%
Number of salaries quoted 110 202 410
10th Percentile £46,975 £46,375 £60,000
25th Percentile £60,000 £56,250 £67,500
Median annual salary (50th Percentile) £75,000 £80,000 £79,816
Median % change year-on-year -6.25% +0.23% +2.99%
75th Percentile £95,000 £102,500 £100,000
90th Percentile £115,500 £124,750 £130,000
UK excluding London median annual salary £63,750 £63,750 £75,000
% change year-on-year - -15.00% +20.00%

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills.

Permanent vacancies with a requirement for application platform skills 4,029 6,835 6,875
As % of all permanent jobs advertised in the UK 8.18% 8.79% 11.17%
Number of salaries quoted 2,674 4,088 5,611
10th Percentile £29,625 £31,250 £31,250
25th Percentile £36,250 £39,500 £39,250
Median annual salary (50th Percentile) £53,844 £55,000 £56,000
Median % change year-on-year -2.10% -1.79% +1.82%
75th Percentile £75,000 £90,000 £77,000
90th Percentile £107,500 £122,500 £93,750
UK excluding London median annual salary £45,000 £47,500 £47,500
% change year-on-year -5.26% - -

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Salary Trend

Salary distribution trend for jobs in the UK citing Apache Spark.

Salary distribution trend for jobs in the UK citing Apache Spark

Apache Spark
Salary Histogram

Salary distribution for jobs citing Apache Spark over the 6 months to 16 September 2025.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 6 months to 16 September 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +53 218 £75,000 -6.25% 139
London +45 143 £90,000 -5.26% 98
UK excluding London -48 109 £63,750 - 66
Work from Home +21 57 £75,000 - 80
North of England +47 28 £60,000 +20.00% 16
Scotland -45 28 - -
South East +57 20 £67,500 +22.73% 41
Midlands +64 17 £64,000 -1.54% 3
Yorkshire +30 16 £60,000 +21.77% 5
East Midlands +19 10 £75,000 +50.00% 1
West Midlands +56 7 £60,500 -15.38% 2
North West -16 7 £80,000 +45.45% 11
Northern Ireland - 6 - - 3
North East +20 5 £47,500 -3.60%
East of England -4 5 £71,500 -35.00% 3
South West +27 4 £55,000 -31.25%
Wales +21 2 £50,124 -24.28%

Apache Spark
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 69 (26.74%) Apache
2 44 (17.05%) Apache Airflow
3 5 (1.94%) Appian
3 5 (1.94%) SAS
4 4 (1.55%) Apache Pulsar
4 4 (1.55%) Apache Synapse
5 3 (1.16%) Luigi
6 1 (0.39%) Apache Superset
6 1 (0.39%) Oracle SOA Suite
6 1 (0.39%) SharePoint
Applications
1 3 (1.16%) Microsoft Excel
2 2 (0.78%) Maya
Business Applications
1 13 (5.04%) SAP S/4HANA
2 1 (0.39%) SAP ERP
Cloud Services
1 175 (67.83%) AWS
2 142 (55.04%) Azure
3 78 (30.23%) GCP
4 43 (16.67%) Amazon S3
5 37 (14.34%) Azure Synapse Analytics
6 32 (12.40%) Power Platform
7 29 (11.24%) Serverless
8 27 (10.47%) Amazon EKS
9 22 (8.53%) Snowflake
10 21 (8.14%) Azure Data Factory
11 19 (7.36%) Amazon ELB
11 19 (7.36%) AWS Lambda
12 18 (6.98%) Amazon Kinesis
13 16 (6.20%) Amazon EMR
14 14 (5.43%) Azure DevOps
14 14 (5.43%) GitHub
15 9 (3.49%) AWS CloudFormation
15 9 (3.49%) AWS Step Functions
16 8 (3.10%) Prefect
17 7 (2.71%) Azure Functions
Communications & Networking
1 3 (1.16%) PuTTY
2 2 (0.78%) HTTP
Database & Business Intelligence
1 128 (49.61%) Big Data
2 88 (34.11%) Hadoop
3 75 (29.07%) Data Warehouse
4 70 (27.13%) NoSQL
5 64 (24.81%) Amazon Redshift
6 47 (18.22%) Metadata
7 38 (14.73%) Data Lake
8 33 (12.79%) DynamoDB
9 32 (12.40%) Delta Lake
10 30 (11.63%) Spark SQL
11 29 (11.24%) Apache Hive
12 27 (10.47%) Power BI
13 25 (9.69%) SQL Server
14 22 (8.53%) BigQuery
15 21 (8.14%) Relational Database
16 19 (7.36%) Apache Iceberg
17 17 (6.59%) MySQL
18 16 (6.20%) Amazon Athena
19 15 (5.81%) PostgreSQL
20 12 (4.65%) MongoDB
Development Applications
1 28 (10.85%) MLflow
2 16 (6.20%) Git
3 12 (4.65%) Jenkins
4 9 (3.49%) Robot Framework
4 9 (3.49%) Selenium
5 6 (2.33%) Gradle
6 5 (1.94%) JUnit
6 5 (1.94%) Maven
6 5 (1.94%) Snyk
7 4 (1.55%) JMeter
7 4 (1.55%) Locust
7 4 (1.55%) Postman
7 4 (1.55%) Terragrunt
8 2 (0.78%) CircleCI
9 1 (0.39%) Cucumber
9 1 (0.39%) GitLab
9 1 (0.39%) JIRA
9 1 (0.39%) Mercurial
General
1 107 (41.47%) Social Skills
2 85 (32.95%) Law
3 82 (31.78%) Finance
4 63 (24.42%) Analytical Skills
5 50 (19.38%) Inclusion and Diversity
6 31 (12.02%) Banking
7 23 (8.91%) Marketing
8 15 (5.81%) Financial Institution
9 9 (3.49%) Investment Banking
9 9 (3.49%) Public Sector
10 6 (2.33%) Legal
11 5 (1.94%) Retail
11 5 (1.94%) Tech for Good
12 4 (1.55%) Games
12 4 (1.55%) Manufacturing
12 4 (1.55%) Publishing
13 3 (1.16%) Advertising
13 3 (1.16%) Front Office
14 2 (0.78%) Documentation Skills
14 2 (0.78%) Retail Banking
Job Titles
1 76 (29.46%) Data Engineer
2 65 (25.19%) Senior
3 42 (16.28%) Software Engineer
4 40 (15.50%) Lead
5 38 (14.73%) Senior Data Engineer
6 33 (12.79%) Architect
7 29 (11.24%) Python Engineer
8 21 (8.14%) Python Software Engineer
9 20 (7.75%) AWS Engineer
9 20 (7.75%) Data Architect
9 20 (7.75%) Machine Learning Engineer
10 19 (7.36%) Data Scientist
10 19 (7.36%) Operations Engineer
11 16 (6.20%) Developer
11 16 (6.20%) Java Engineer
12 13 (5.04%) Java Software Engineer
12 13 (5.04%) Product Lead
12 13 (5.04%) Senior Data Scientist
13 12 (4.65%) Lead Software Engineer
14 11 (4.26%) Java Developer
Libraries, Frameworks & Software Standards
1 108 (41.86%) Kafka
2 49 (18.99%) PySpark
3 45 (17.44%) TensorFlow
4 43 (16.67%) PyTorch
5 38 (14.73%) scikit-learn
6 27 (10.47%) Pandas
7 26 (10.08%) YAML
8 23 (8.91%) NumPy
9 21 (8.14%) Keras
10 19 (7.36%) Lambda Expressions
10 19 (7.36%) Metaflow
11 14 (5.43%) Spark Streaming
12 12 (4.65%) Spring
13 9 (3.49%) Apache NiFi
14 8 (3.10%) pytest
15 7 (2.71%) Hugging Face
15 7 (2.71%) REST
15 7 (2.71%) SpaCy
16 6 (2.33%) RabbitMQ
16 6 (2.33%) React
Miscellaneous
1 46 (17.83%) Distributed Systems
2 40 (15.50%) Cloud Native
3 31 (12.02%) Product Ownership
4 24 (9.30%) Algorithms
5 19 (7.36%) Linux Command Line
6 16 (6.20%) Data Structures
6 16 (6.20%) FMCG
7 13 (5.04%) e-Learning
7 13 (5.04%) Legacy Systems
7 13 (5.04%) Management Information System
8 6 (2.33%) Greenfield Project
8 6 (2.33%) Hybrid Cloud
9 5 (1.94%) Low-Code
10 4 (1.55%) Mobile Banking
10 4 (1.55%) Public Cloud
11 3 (1.16%) Robotics
12 2 (0.78%) Distributed Computing
12 2 (0.78%) Equities
12 2 (0.78%) Onboarding
13 1 (0.39%) Enterprise Software
Operating Systems
1 30 (11.63%) Unix
2 6 (2.33%) Linux
Processes & Methodologies
1 137 (53.10%) CI/CD
2 126 (48.84%) Machine Learning
3 109 (42.25%) Data Pipeline
4 105 (40.70%) Analytics
4 105 (40.70%) ETL
5 99 (38.37%) Data Science
6 97 (37.60%) Data Modelling
7 94 (36.43%) Artificial Intelligence
7 94 (36.43%) Data Engineering
8 92 (35.66%) Agile
9 90 (34.88%) DevOps
10 82 (31.78%) Software Engineering
11 77 (29.84%) Problem-Solving
12 68 (26.36%) Data Governance
13 67 (25.97%) Visualisation
14 54 (20.93%) Decision-Making
15 53 (20.54%) Business Intelligence
16 52 (20.16%) MLOps
17 51 (19.77%) Containerisation
18 47 (18.22%) Mentoring
Programming Languages
1 196 (75.97%) SQL
2 195 (75.58%) Python
3 73 (28.29%) Java
4 39 (15.12%) Scala
5 11 (4.26%) R
6 9 (3.49%) PL/SQL
7 8 (3.10%) Bash
8 7 (2.71%) C#
9 5 (1.94%) T-SQL
10 4 (1.55%) Data Analysis Expressions
10 4 (1.55%) JavaScript
10 4 (1.55%) Kotlin
10 4 (1.55%) TypeScript
11 3 (1.16%) PowerShell
11 3 (1.16%) PROC SQL
12 2 (0.78%) C
12 2 (0.78%) C++
13 1 (0.39%) Go
13 1 (0.39%) Shell Script
Qualifications
1 43 (16.67%) Degree
2 30 (11.63%) Master's Degree
3 18 (6.98%) PhD
4 16 (6.20%) Computer Science Degree
5 15 (5.81%) Azure Certification
6 14 (5.43%) Security Cleared
7 12 (4.65%) AWS Certification
8 9 (3.49%) SC Cleared
9 5 (1.94%) DV Cleared
10 4 (1.55%) ISTQB
11 1 (0.39%) Microsoft Certification
Quality Assurance & Compliance
1 52 (20.16%) Data Quality
2 21 (8.14%) GDPR
2 21 (8.14%) QA
3 7 (2.71%) California Consumer Privacy Act
4 3 (1.16%) HIPAA
5 2 (0.78%) ISO/IEC 27001
6 1 (0.39%) Cyber Essentials
6 1 (0.39%) Cyber Essentials PLUS
6 1 (0.39%) SOC 2
System Software
1 60 (23.26%) Docker
2 20 (7.75%) HDFS
3 5 (1.94%) VMware Infrastructure
4 3 (1.16%) Apache Flume
5 1 (0.39%) Active Directory
Systems Management
1 63 (24.42%) Kubernetes
1 63 (24.42%) Terraform
2 27 (10.47%) Kubeflow
3 8 (3.10%) Ansible
4 3 (1.16%) Kibana
4 3 (1.16%) logstash
4 3 (1.16%) Oozie
5 2 (0.78%) Progress Chef
5 2 (0.78%) Prometheus
5 2 (0.78%) Puppet
6 1 (0.39%) Bugsnag
6 1 (0.39%) Grafana
Vendors
1 124 (48.06%) Databricks
2 30 (11.63%) Microsoft
3 25 (9.69%) Google
4 22 (8.53%) SAP
5 21 (8.14%) Oracle
6 12 (4.65%) Informatica
7 8 (3.10%) Talend
8 6 (2.33%) Cloudera
9 5 (1.94%) BiZZdesign
9 5 (1.94%) Black Duck
9 5 (1.94%) UiPath
9 5 (1.94%) VMware
10 4 (1.55%) Sybase
10 4 (1.55%) Teradata
11 3 (1.16%) MicroStrategy
11 3 (1.16%) Palantir
12 2 (0.78%) Apple
13 1 (0.39%) OpenAI
13 1 (0.39%) Salesforce