Apache Spark Job Trends

Apache Spark
UK

The table below provides summary statistics and salary benchmarking for jobs requiring Apache Spark skills. It covers permanent job vacancies from the 6 months leading up to 17 October 2025, with comparisons to the same periods in the previous two years.

6 months to
17 Oct 2025
Same period 2024 Same period 2023
Rank 448 492 383
Rank change year-on-year +44 -109 -98
Permanent jobs citing Apache Spark 237 283 426
As % of all permanent jobs in the UK 0.49% 0.41% 0.76%
As % of the Application Platforms category 5.96% 4.88% 6.71%
Number of salaries quoted 103 190 327
10th Percentile £52,400 £47,500 £60,000
25th Percentile £61,250 £56,250 £68,718
Median annual salary (50th Percentile) £82,500 £80,000 £79,632
Median % change year-on-year +3.13% +0.46% -0.46%
75th Percentile £100,625 £102,500 £97,290
90th Percentile £140,000 £120,000 £115,500
UK excluding London median annual salary £60,000 £60,000 £75,000
% change year-on-year - -20.00% +15.38%

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills.

Permanent vacancies with a requirement for application platform skills 3,974 5,799 6,347
As % of all permanent jobs advertised in the UK 8.14% 8.31% 11.25%
Number of salaries quoted 2,602 3,546 5,098
10th Percentile £29,000 £31,250 £31,250
25th Percentile £35,000 £40,000 £39,000
Median annual salary (50th Percentile) £52,500 £57,500 £55,000
Median % change year-on-year -8.70% +4.55% -
75th Percentile £73,750 £90,000 £75,000
90th Percentile £100,674 £122,500 £92,500
UK excluding London median annual salary £44,000 £47,500 £47,500
% change year-on-year -7.37% - -

Apache Spark
Job Vacancy Trend

Historical trend showing the proportion of permanent IT job postings citing Apache Spark relative to all permanent IT jobs advertised.

Apache Spark job vacancy trend in the UK

Apache Spark
Salary Trend

Salary distribution trend for jobs in the UK citing Apache Spark.

Salary distribution trend for jobs in the UK citing Apache Spark

Apache Spark
Salary Histogram

Salary distribution for jobs citing Apache Spark over the 6 months to 17 October 2025.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 6 months to 17 October 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +36 208 £83,750 +4.69% 146
London +39 143 £92,500 -2.63% 90
UK excluding London +47 91 £60,000 - 92
Work from Home -2 42 £75,000 -6.25% 120
North of England +7 28 £60,000 +20.00% 23
Scotland +5 25 - -
Yorkshire +24 17 £60,000 +21.77% 5
Midlands +55 14 £53,500 -12.65% 4
South East +27 14 £67,500 +17.39% 59
East Midlands +18 9 £73,750 +47.50% 1
North West -13 6 £67,500 +25.58% 14
West Midlands +54 5 £53,500 -23.57% 2
North East +14 5 £47,500 -3.60% 4
East of England +8 5 £71,500 -37.83% 2
South West +21 4 £55,000 -30.16% 2
Wales +15 2 £50,124 -24.28%

Apache Spark
Co-Occurring Skills & Capabilities by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 57 (24.05%) Apache
2 44 (18.57%) Apache Airflow
3 5 (2.11%) Appian
3 5 (2.11%) SAS
4 4 (1.69%) Apache Pulsar
4 4 (1.69%) Apache Synapse
5 3 (1.27%) Luigi
6 1 (0.42%) Apache Superset
6 1 (0.42%) SharePoint
Business Applications
1 13 (5.49%) SAP S/4HANA
2 1 (0.42%) SAP ERP
Cloud Services
1 176 (74.26%) AWS
2 123 (51.90%) Azure
3 76 (32.07%) GCP
4 46 (19.41%) Amazon S3
5 30 (12.66%) Serverless
6 27 (11.39%) Amazon EKS
7 24 (10.13%) Azure Synapse Analytics
8 22 (9.28%) AWS Lambda
8 22 (9.28%) Power Platform
8 22 (9.28%) Snowflake
9 20 (8.44%) Amazon Kinesis
10 19 (8.02%) Amazon ELB
10 19 (8.02%) Amazon EMR
11 16 (6.75%) GitHub
12 12 (5.06%) AWS Step Functions
13 11 (4.64%) Azure Data Factory
14 9 (3.80%) dbt
15 8 (3.38%) AWS CloudFormation
15 8 (3.38%) Azure DevOps
15 8 (3.38%) Prefect
Communications & Networking
1 3 (1.27%) Kerberos
1 3 (1.27%) PuTTY
Database & Business Intelligence
1 115 (48.52%) Big Data
2 77 (32.49%) Hadoop
3 68 (28.69%) Data Warehouse
4 66 (27.85%) NoSQL
5 63 (26.58%) Amazon Redshift
6 41 (17.30%) Metadata
7 38 (16.03%) Data Lake
8 34 (14.35%) DynamoDB
9 31 (13.08%) Delta Lake
10 30 (12.66%) Spark SQL
11 23 (9.70%) Apache Hive
11 23 (9.70%) SQL Server
12 22 (9.28%) Apache Iceberg
13 20 (8.44%) PostgreSQL
14 18 (7.59%) Relational Database
15 17 (7.17%) Power BI
16 16 (6.75%) Amazon Athena
16 16 (6.75%) BigQuery
17 13 (5.49%) MongoDB
17 13 (5.49%) MySQL
Development Applications
1 28 (11.81%) MLflow
2 11 (4.64%) Jenkins
3 10 (4.22%) Git
4 6 (2.53%) Gradle
5 5 (2.11%) JUnit
5 5 (2.11%) Maven
5 5 (2.11%) Robot Framework
5 5 (2.11%) Selenium
5 5 (2.11%) Snyk
6 4 (1.69%) Terragrunt
7 3 (1.27%) GitLab
8 2 (0.84%) CircleCI
9 1 (0.42%) Cucumber
9 1 (0.42%) Deequ
9 1 (0.42%) Mercurial
General
1 109 (45.99%) Social Skills
2 82 (34.60%) Finance
3 77 (32.49%) Law
4 55 (23.21%) Analytical Skills
5 45 (18.99%) Inclusion and Diversity
6 30 (12.66%) Banking
7 21 (8.86%) Marketing
8 17 (7.17%) Financial Institution
9 10 (4.22%) Investment Banking
9 10 (4.22%) Public Sector
10 6 (2.53%) Legal
10 6 (2.53%) Tech for Good
11 4 (1.69%) Front Office
11 4 (1.69%) Manufacturing
11 4 (1.69%) Publishing
12 2 (0.84%) Games
12 2 (0.84%) Retail
13 1 (0.42%) Advertising
13 1 (0.42%) Czech Language
13 1 (0.42%) Electronics
Job Titles
1 76 (32.07%) Data Engineer
2 57 (24.05%) Senior
3 42 (17.72%) Software Engineer
4 35 (14.77%) Senior Data Engineer
5 33 (13.92%) Lead
6 27 (11.39%) Architect
6 27 (11.39%) Python Engineer
7 22 (9.28%) AWS Engineer
8 21 (8.86%) Python Software Engineer
9 20 (8.44%) Machine Learning Engineer
10 19 (8.02%) Operations Engineer
11 17 (7.17%) Data Scientist
12 16 (6.75%) Data Architect
12 16 (6.75%) Developer
13 15 (6.33%) Java Engineer
14 13 (5.49%) AWS Data Engineer
14 13 (5.49%) Java Software Engineer
14 13 (5.49%) Product Lead
15 12 (5.06%) Lead Software Engineer
16 11 (4.64%) Principal Engineer
Libraries, Frameworks & Software Standards
1 106 (44.73%) Kafka
2 44 (18.57%) PySpark
3 40 (16.88%) PyTorch
3 40 (16.88%) TensorFlow
4 35 (14.77%) scikit-learn
5 24 (10.13%) Pandas
6 20 (8.44%) NumPy
6 20 (8.44%) YAML
7 19 (8.02%) Keras
7 19 (8.02%) Lambda Expressions
7 19 (8.02%) Metaflow
8 12 (5.06%) Spark Streaming
9 11 (4.64%) REST
10 9 (3.80%) Apache NiFi
11 8 (3.38%) Spring
12 7 (2.95%) Hugging Face
12 7 (2.95%) React
12 7 (2.95%) SpaCy
13 6 (2.53%) boto
13 6 (2.53%) RabbitMQ
Miscellaneous
1 53 (22.36%) Distributed Systems
2 48 (20.25%) Cloud Native
3 25 (10.55%) Algorithms
3 25 (10.55%) Product Ownership
4 21 (8.86%) Linux Command Line
5 16 (6.75%) e-Learning
6 14 (5.91%) Legacy Systems
6 14 (5.91%) Management Information System
7 13 (5.49%) Data Structures
7 13 (5.49%) FMCG
8 7 (2.95%) Hybrid Cloud
9 6 (2.53%) Greenfield Project
10 5 (2.11%) Low-Code
11 4 (1.69%) Mobile Banking
11 4 (1.69%) Public Cloud
12 3 (1.27%) Distributed Computing
12 3 (1.27%) Equities
12 3 (1.27%) Robotics
13 2 (0.84%) Distributed Architecture
13 2 (0.84%) Virtual Team
Operating Systems
1 34 (14.35%) Unix
2 8 (3.38%) Linux
Processes & Methodologies
1 124 (52.32%) CI/CD
2 118 (49.79%) Machine Learning
3 102 (43.04%) Data Pipeline
4 101 (42.62%) Analytics
5 99 (41.77%) Data Engineering
5 99 (41.77%) Data Science
6 95 (40.08%) ETL
7 91 (38.40%) AI
8 87 (36.71%) Data Modelling
9 81 (34.18%) Software Engineering
10 79 (33.33%) DevOps
11 75 (31.65%) Agile
12 64 (27.00%) Problem-Solving
13 58 (24.47%) Data Governance
14 54 (22.78%) Visualisation
15 49 (20.68%) Business Intelligence
15 49 (20.68%) Containerisation
16 48 (20.25%) Decision-Making
16 48 (20.25%) MLOps
17 46 (19.41%) Mentoring
Programming Languages
1 191 (80.59%) Python
2 177 (74.68%) SQL
3 69 (29.11%) Java
4 33 (13.92%) Scala
5 9 (3.80%) R
6 6 (2.53%) PL/SQL
7 5 (2.11%) Bash
7 5 (2.11%) C#
7 5 (2.11%) JavaScript
7 5 (2.11%) Kotlin
8 3 (1.27%) PROC SQL
8 3 (1.27%) T-SQL
8 3 (1.27%) TypeScript
9 2 (0.84%) C++
10 1 (0.42%) C
10 1 (0.42%) Data Analysis Expressions
Qualifications
1 39 (16.46%) Degree
2 26 (10.97%) Master's Degree
3 17 (7.17%) Computer Science Degree
3 17 (7.17%) PhD
4 14 (5.91%) Azure Certification
5 13 (5.49%) AWS Certification
6 8 (3.38%) Security Cleared
7 6 (2.53%) DV Cleared
8 3 (1.27%) SC Cleared
9 2 (0.84%) TOGAF Certification
10 1 (0.42%) Microsoft Certification
Quality Assurance & Compliance
1 50 (21.10%) Data Quality
2 20 (8.44%) GDPR
2 20 (8.44%) QA
3 7 (2.95%) California Consumer Privacy Act
4 3 (1.27%) ISO/IEC 27001
5 2 (0.84%) HIPAA
6 1 (0.42%) Accessibility
6 1 (0.42%) Cyber Essentials
6 1 (0.42%) Cyber Essentials PLUS
6 1 (0.42%) SOC 2
System Software
1 58 (24.47%) Docker
2 16 (6.75%) HDFS
3 5 (2.11%) Active Directory
3 5 (2.11%) VMware Infrastructure
4 3 (1.27%) Apache Flume
Systems Management
1 62 (26.16%) Kubernetes
2 54 (22.78%) Terraform
3 26 (10.97%) Kubeflow
4 12 (5.06%) Ansible
5 6 (2.53%) Kibana
5 6 (2.53%) logstash
6 5 (2.11%) Prometheus
7 4 (1.69%) Grafana
8 3 (1.27%) Oozie
9 2 (0.84%) Progress Chef
9 2 (0.84%) Puppet
Vendors
1 104 (43.88%) Databricks
2 19 (8.02%) Oracle
2 19 (8.02%) SAP
3 18 (7.59%) Microsoft
4 13 (5.49%) Google
4 13 (5.49%) Informatica
5 9 (3.80%) Talend
6 6 (2.53%) Cloudera
6 6 (2.53%) Dell
7 5 (2.11%) BiZZdesign
7 5 (2.11%) Black Duck
7 5 (2.11%) UiPath
7 5 (2.11%) VMware
8 3 (1.27%) MicroStrategy
9 2 (0.84%) Palantir
10 1 (0.42%) IBM
10 1 (0.42%) OpenAI
10 1 (0.42%) Salesforce
10 1 (0.42%) Teradata