Apache Spark Jobs

Apache Spark
UK

The table below provides summary statistics for permanent job vacancies requiring Apache Spark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Apache Spark over the 6 months leading up to 30 April 2025, comparing them to the same period in the previous two years.

6 months to
30 Apr 2025
Same period 2024 Same period 2023
Rank 405 279 252
Rank change year-on-year -126 -27 -1
Permanent jobs citing Apache Spark 302 1,032 1,514
As % of all permanent jobs advertised in the UK 0.58% 1.05% 1.46%
As % of the Application Platforms category 6.80% 9.62% 12.67%
Number of salaries quoted 208 286 612
10th Percentile £52,275 £49,500 £57,250
25th Percentile £56,250 £61,180 £65,938
Median annual salary (50th Percentile) £82,500 £80,000 £87,500
Median % change year-on-year +3.13% -8.57% +12.90%
75th Percentile £115,000 £105,000 £110,000
90th Percentile £138,750 £116,875 £150,000
UK excluding London median annual salary £65,000 £69,447 £69,447
% change year-on-year -6.40% - +12.46%

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills.

Permanent vacancies with a requirement for application platform skills 4,444 10,730 11,949
As % of all permanent jobs advertised in the UK 8.52% 10.91% 11.49%
Number of salaries quoted 3,060 7,087 7,898
10th Percentile £30,000 £27,500 £31,250
25th Percentile £37,500 £34,000 £40,000
Median annual salary (50th Percentile) £55,000 £50,000 £55,000
Median % change year-on-year +10.00% -9.09% +1.85%
75th Percentile £75,000 £67,500 £77,500
90th Percentile £106,500 £92,295 £96,750
UK excluding London median annual salary £45,628 £42,500 £47,500
% change year-on-year +7.36% -10.53% +5.56%

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Salary Trend

3-month moving average salary quoted in jobs citing Apache Spark.

Salary trend for Apache Spark in the UK

Apache Spark
Salary Histogram

Salary distribution for jobs citing Apache Spark over the 6 months to 30 April 2025.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 6 months to 30 April 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +87 275 £82,865 +3.58% 346
London +48 186 £110,000 +22.22% 250
Work from Home +169 178 £110,000 +37.50% 182
UK excluding London -187 99 £65,000 -6.40% 104
South East +136 36 £65,000 +32.65% 20
North of England +60 26 £57,500 +4.55% 29
North West +12 16 £60,000 -4.00% 15
Midlands +64 15 £64,000 -12.33% 18
East Midlands +51 9 £75,000 +25.00% 6
Scotland -100 9 £100,000 +110.53% 13
Yorkshire +66 8 £57,500 +11.59% 11
Northern Ireland +42 7 £55,000 -21.43% 2
West Midlands +52 6 £60,250 -17.47% 11
East of England +55 3 £81,250 -19.75% 9
North East +53 2 £80,000 +6.67% 3
Wales +35 2 £64,000 +24.20% 1
South West +66 1 £50,000 -37.50% 14

Apache Spark
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 143 (47.35%) Apache
2 111 (36.75%) Apache Airflow
3 1 (0.33%) Oracle SOA Suite
Applications
1 9 (2.98%) Microsoft Excel
2 3 (0.99%) Maya
3 1 (0.33%) Microsoft Office
3 1 (0.33%) Simulink
Cloud Services
1 166 (54.97%) AWS
2 101 (33.44%) Azure
3 90 (29.80%) Serverless
4 88 (29.14%) AWS Lambda
5 84 (27.81%) dbt
6 83 (27.48%) OpenShift
7 71 (23.51%) Amazon ECS
8 47 (15.56%) GCP
9 46 (15.23%) Power Platform
10 31 (10.26%) Snowflake
11 26 (8.61%) Azure Data Factory
12 24 (7.95%) Amazon S3
12 24 (7.95%) Azure Synapse Analytics
13 17 (5.63%) Amazon EMR
14 12 (3.97%) Azure DevOps
15 11 (3.64%) Amazon SageMaker
15 11 (3.64%) AWS CloudFormation
16 9 (2.98%) Amazon EC2
16 9 (2.98%) Amazon Kinesis
16 9 (2.98%) SaaS
Communications & Networking
1 22 (7.28%) HTTP
2 1 (0.33%) DNS
Database & Business Intelligence
1 92 (30.46%) Big Data
2 85 (28.15%) Amazon Athena
3 83 (27.48%) Data Warehouse
4 81 (26.82%) Apache Iceberg
4 81 (26.82%) Hadoop
5 74 (24.50%) Apache Ignite
6 72 (23.84%) Dremio
7 71 (23.51%) Apache Arrow
8 48 (15.89%) Data Lake
9 47 (15.56%) NoSQL
10 46 (15.23%) Power BI
11 36 (11.92%) Apache Hive
12 33 (10.93%) Amazon Redshift
13 32 (10.60%) Tableau
14 22 (7.28%) BigQuery
15 21 (6.95%) SQL Server
16 20 (6.62%) Relational Database
17 19 (6.29%) Delta Lake
18 18 (5.96%) Metadata
19 15 (4.97%) MongoDB
Development Applications
1 71 (23.51%) Artifactory
2 29 (9.60%) Git
3 20 (6.62%) Jenkins
4 9 (2.98%) Bitbucket
4 9 (2.98%) CircleCI
5 8 (2.65%) GitLab
6 5 (1.66%) MLflow
7 4 (1.32%) JMeter
7 4 (1.32%) Locust
7 4 (1.32%) Postman
7 4 (1.32%) Robot Framework
7 4 (1.32%) Selenium
8 2 (0.66%) JIRA
8 2 (0.66%) Oracle Forms
8 2 (0.66%) Spinnaker
9 1 (0.33%) ERwin
9 1 (0.33%) Octopus Deploy
9 1 (0.33%) TeamCity
General
1 136 (45.03%) Finance
2 86 (28.48%) Social Skills
3 72 (23.84%) Front Office
4 43 (14.24%) Analytical Skills
5 36 (11.92%) Inclusion and Diversity
6 31 (10.26%) Retail
7 27 (8.94%) Law
8 26 (8.61%) Advertising
9 22 (7.28%) Games
10 18 (5.96%) Banking
11 9 (2.98%) Influencing Skills
12 8 (2.65%) Public Sector
13 7 (2.32%) Financial Institution
14 6 (1.99%) Marketing
15 4 (1.32%) Retail Banking
16 3 (0.99%) Pharmaceutical
16 3 (0.99%) Presentation Skills
17 2 (0.66%) Automotive
17 2 (0.66%) Legal
17 2 (0.66%) Manufacturing
Job Titles
1 154 (50.99%) Data Engineer
2 92 (30.46%) Senior
3 82 (27.15%) Python Engineer
4 78 (25.83%) AWS Engineer
5 75 (24.83%) DevOps Engineer
6 71 (23.51%) AWS DevOps
6 71 (23.51%) AWS DevOps Engineer
7 41 (13.58%) Senior Data Engineer
8 32 (10.60%) Lead
9 27 (8.94%) Architect
10 24 (7.95%) Software Engineer
11 22 (7.28%) Senior Software Engineer
12 20 (6.62%) Developer
13 17 (5.63%) Data Architect
13 17 (5.63%) Data Scientist
14 14 (4.64%) Analyst
14 14 (4.64%) Lead Data Engineer
15 11 (3.64%) Python Data Engineer
15 11 (3.64%) Senior Data Scientist
16 10 (3.31%) Full-Stack Developer
Libraries, Frameworks & Software Standards
1 165 (54.64%) Kafka
2 101 (33.44%) PySpark
3 75 (24.83%) J2EE
4 16 (5.30%) REST
4 16 (5.30%) TensorFlow
5 13 (4.30%) Pandas
6 12 (3.97%) PyTorch
6 12 (3.97%) React
7 10 (3.31%) scikit-learn
7 10 (3.31%) Spring
7 10 (3.31%) Spring Boot
8 9 (2.98%) PyArrow
8 9 (2.98%) Spark Streaming
9 8 (2.65%) GraphQL
9 8 (2.65%) NumPy
9 8 (2.65%) Redux
10 7 (2.32%) YAML
11 6 (1.99%) pytest
11 6 (1.99%) SciPy
12 5 (1.66%) Flask
Miscellaneous
1 26 (8.61%) Distributed Systems
2 14 (4.64%) Data Structures
3 13 (4.30%) Product Ownership
4 11 (3.64%) Algorithms
4 11 (3.64%) Cloud Native
5 8 (2.65%) Greenfield Project
6 6 (1.99%) FMCG
6 6 (1.99%) Management Information System
7 5 (1.66%) Data Fabric
7 5 (1.66%) Distributed Applications
7 5 (1.66%) Distributed Computing
8 3 (0.99%) Enterprise Software
8 3 (0.99%) Hybrid Cloud
8 3 (0.99%) Reinsurance
9 2 (0.66%) Analytical Mindset
9 2 (0.66%) Linux Command Line
9 2 (0.66%) Onboarding
9 2 (0.66%) Public Cloud
9 2 (0.66%) Renewable Energy
10 1 (0.33%) Legacy Systems
Operating Systems
1 14 (4.64%) Linux
2 12 (3.97%) Unix
Processes & Methodologies
1 159 (52.65%) Agile
2 140 (46.36%) CI/CD
3 139 (46.03%) Data Engineering
4 118 (39.07%) Software Engineering
5 116 (38.41%) DevOps
6 109 (36.09%) Machine Learning
7 91 (30.13%) ETL
8 88 (29.14%) Data Pipeline
9 80 (26.49%) Asset Management
10 78 (25.83%) Open Source
11 77 (25.50%) Data Modelling
11 77 (25.50%) Data Science
12 75 (24.83%) Analytics
13 71 (23.51%) Problem-Solving
13 71 (23.51%) Site Reliability Engineering
14 64 (21.19%) Data Governance
15 54 (17.88%) Visualisation
16 52 (17.22%) Artificial Intelligence
17 48 (15.89%) Computer Science
18 46 (15.23%) Business Intelligence
Programming Languages
1 254 (84.11%) Python
2 156 (51.66%) SQL
3 123 (40.73%) Java
4 74 (24.50%) Go
5 54 (17.88%) Scala
6 13 (4.30%) PL/SQL
7 12 (3.97%) Bash
8 11 (3.64%) R
9 9 (2.98%) Data Analysis Expressions
10 8 (2.65%) PowerShell
11 7 (2.32%) C#
12 5 (1.66%) C++
13 4 (1.32%) JavaScript
13 4 (1.32%) TypeScript
14 3 (0.99%) T-SQL
15 2 (0.66%) C
15 2 (0.66%) Ruby
15 2 (0.66%) Shell Script
16 1 (0.33%) Bicep
16 1 (0.33%) MATLAB
Qualifications
1 60 (19.87%) Degree
2 19 (6.29%) Master's Degree
3 17 (5.63%) Security Cleared
4 15 (4.97%) Computer Science Degree
4 15 (4.97%) SC Cleared
5 12 (3.97%) Azure Certification
6 8 (2.65%) DBS Check
6 8 (2.65%) PhD
7 6 (1.99%) AWS Certification
8 4 (1.32%) ISTQB
9 3 (0.99%) DV Cleared
9 3 (0.99%) Microsoft Certification
10 2 (0.66%) Tableau Certification
Quality Assurance & Compliance
1 52 (17.22%) Data Quality
2 18 (5.96%) GDPR
3 17 (5.63%) Accessibility
4 9 (2.98%) California Consumer Privacy Act
5 6 (1.99%) PCI DSS
6 5 (1.66%) QA
7 3 (0.99%) HIPAA
System Software
1 102 (33.77%) Docker
2 19 (6.29%) HDFS
3 5 (1.66%) Apache Flume
4 2 (0.66%) Virtual Machines
Systems Management
1 116 (38.41%) Kubernetes
2 102 (33.77%) Terraform
3 5 (1.66%) Oozie
4 4 (1.32%) Grafana
4 4 (1.32%) Prometheus
5 3 (0.99%) Ansible
6 2 (0.66%) Hadoop YARN
6 2 (0.66%) Kubeflow
7 1 (0.33%) Bugsnag
7 1 (0.33%) Control-M
7 1 (0.33%) Kibana
Vendors
1 79 (26.16%) Databricks
2 51 (16.89%) Google
2 51 (16.89%) Microsoft
3 22 (7.28%) Apple
4 20 (6.62%) Oracle
5 13 (4.30%) Cloudera
6 10 (3.31%) Red Hat
7 9 (2.98%) Informatica
8 7 (2.32%) SAP
9 6 (1.99%) Teradata
10 5 (1.66%) Palantir
11 4 (1.32%) Sybase
11 4 (1.32%) Talend
12 3 (0.99%) StreamSets
13 2 (0.66%) Dataiku
13 2 (0.66%) MapR
14 1 (0.33%) AppDynamics
14 1 (0.33%) Dell
14 1 (0.33%) Dynatrace
14 1 (0.33%) Foundry