Apache Spark Jobs in London

Apache Spark
England > London

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 28 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 May 2024
Same period 2023 Same period 2022
Rank 269 139 198
Rank change year-on-year -130 +59 -38
Permanent jobs citing Apache Spark 248 860 1,668
As % of all permanent jobs advertised in London 1.04% 2.62% 2.31%
As % of the Application Platforms category 7.73% 19.24% 16.09%
Number of salaries quoted 174 436 530
10th Percentile £62,875 £62,500 £51,475
25th Percentile £72,500 £70,000 £65,000
Median annual salary (50th Percentile) £90,000 £95,000 £80,000
Median % change year-on-year -5.26% +18.75% +3.23%
75th Percentile £110,000 £130,000 £95,000
90th Percentile £124,250 £157,500 £115,000
England median annual salary £80,000 £89,500 £80,000
% change year-on-year -10.61% +11.88% +6.67%

All Application Platform Skills
London

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,209 4,471 10,365
As % of all permanent jobs advertised in London 13.44% 13.60% 14.36%
Number of salaries quoted 2,276 3,241 4,943
10th Percentile £35,000 £37,500 £35,750
25th Percentile £49,062 £51,250 £48,125
Median annual salary (50th Percentile) £72,500 £69,447 £65,000
Median % change year-on-year +4.40% +6.84% -
75th Percentile £102,500 £90,000 £85,000
90th Percentile £142,500 £116,250 £101,250
England median annual salary £50,000 £56,500 £55,000
% change year-on-year -11.50% +2.73% +4.76%

Apache Spark
Job Vacancy Trend in London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in London.

Job vacancy trend for Apache Spark in London

Apache Spark
Salary Trend in London

3-month moving average salary quoted in jobs citing Apache Spark in London.

Salary trend for Apache Spark in London

Apache Spark
Salary Histogram in London

Salary distribution for jobs citing Apache Spark in London over the 6 months to 28 May 2024.

Salary histogram for Apache Spark in London

Apache Spark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the London region over the 6 months to 28 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +23 13 £85,000 -5.56% 6
West London -4 3 £90,000 +20.00% 5
Apache Spark
England

Apache Spark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 92 (37.10%) Apache
2 47 (18.95%) Apache Airflow
3 8 (3.23%) Jupyter
4 5 (2.02%) Apache Pulsar
5 2 (0.81%) Luigi
6 1 (0.40%) Apache Pig
6 1 (0.40%) Apache Solr
6 1 (0.40%) Confluence
6 1 (0.40%) SAS
Applications
1 7 (2.82%) Microsoft Excel
2 1 (0.40%) Microsoft Office
Business Applications
1 4 (1.61%) Primavera
Cloud Services
1 154 (62.10%) AWS
2 135 (54.44%) Azure
3 90 (36.29%) GCP
4 30 (12.10%) Snowflake
5 28 (11.29%) Azure Synapse Analytics
6 22 (8.87%) Azure Data Factory
7 20 (8.06%) Amazon Kinesis
8 15 (6.05%) Amazon S3
8 15 (6.05%) Power Platform
9 13 (5.24%) GitHub
10 12 (4.84%) Azure DevOps
11 11 (4.44%) Amazon EMR
11 11 (4.44%) Serverless
12 8 (3.23%) Stackdriver
13 7 (2.82%) GitHub Actions
13 7 (2.82%) Power Automate
13 7 (2.82%) PowerApps
14 6 (2.42%) AWS CloudFormation
14 6 (2.42%) AWS Lambda
15 5 (2.02%) dbt
Communications & Networking
1 16 (6.45%) Wireless
2 2 (0.81%) HTTP
Database & Business Intelligence
1 107 (43.15%) Big Data
2 82 (33.06%) Hadoop
3 55 (22.18%) Data Lake
3 55 (22.18%) NoSQL
4 50 (20.16%) Data Warehouse
5 36 (14.52%) Data Mining
6 26 (10.48%) Apache Hive
6 26 (10.48%) Elasticsearch
7 24 (9.68%) Flink
8 23 (9.27%) SQL Server
9 21 (8.47%) Amazon Redshift
10 19 (7.66%) BigQuery
11 17 (6.85%) Apache Ignite
12 15 (6.05%) PostgreSQL
12 15 (6.05%) Power BI
13 14 (5.65%) Relational Database
14 12 (4.84%) Presto
15 11 (4.44%) DynamoDB
15 11 (4.44%) MySQL
16 10 (4.03%) Neo4j
Development Applications
1 32 (12.90%) Git
2 21 (8.47%) Jenkins
3 8 (3.23%) Visual Studio
4 7 (2.82%) CircleCI
5 4 (1.61%) Bitbucket
6 3 (1.21%) MLflow
6 3 (1.21%) Spinnaker
7 2 (0.81%) JIRA
7 2 (0.81%) Team Foundation Server
8 1 (0.40%) Ant
8 1 (0.40%) GitLab
8 1 (0.40%) Gradle
8 1 (0.40%) JUnit
8 1 (0.40%) Maven
8 1 (0.40%) Oracle Forms
General
1 62 (25.00%) Social Skills
2 54 (21.77%) Analytical Skills
3 38 (15.32%) Finance
4 22 (8.87%) Inclusion and Diversity
5 14 (5.65%) Banking
5 14 (5.65%) Electronics
5 14 (5.65%) Marketing
5 14 (5.65%) Retail
6 13 (5.24%) Games
7 12 (4.84%) Public Sector
8 11 (4.44%) Presentation Skills
9 10 (4.03%) Law
9 10 (4.03%) Legal
10 7 (2.82%) Retail Banking
11 4 (1.61%) Music Industry
12 3 (1.21%) German Language
12 3 (1.21%) Investment Banking
12 3 (1.21%) Manufacturing
13 2 (0.81%) Advertising
13 2 (0.81%) Publishing
Job Titles
1 100 (40.32%) Senior
2 68 (27.42%) Data Engineer
3 40 (16.13%) Architect
4 36 (14.52%) Software Engineer
5 34 (13.71%) Lead
6 32 (12.90%) Senior Data Engineer
7 22 (8.87%) Cloud Architect
8 20 (8.06%) Data Architect
9 18 (7.26%) Data Manager
10 17 (6.85%) Data Scientist
10 17 (6.85%) Developer
10 17 (6.85%) IT Architect
10 17 (6.85%) Senior Architect
10 17 (6.85%) Senior Cloud Architect
10 17 (6.85%) Senior Data Scientist
10 17 (6.85%) Senior Software Engineer
11 16 (6.45%) Python Engineer
12 12 (4.84%) Python Data Engineer
13 11 (4.44%) Scala Engineer
13 11 (4.44%) Scala Software Engineer
Libraries, Frameworks & Software Standards
1 88 (35.48%) Kafka
2 34 (13.71%) PySpark
3 18 (7.26%) Apache Beam
4 13 (5.24%) TensorFlow
5 12 (4.84%) Lambda Expressions
5 12 (4.84%) React
6 11 (4.44%) http4s
6 11 (4.44%) Pandas
7 10 (4.03%) Flask
7 10 (4.03%) Spark Streaming
8 7 (2.82%) Apache Avro
8 7 (2.82%) PyTorch
8 7 (2.82%) RabbitMQ
8 7 (2.82%) Spring
8 7 (2.82%) Spring Boot
9 6 (2.42%) .NET
9 6 (2.42%) JSON
9 6 (2.42%) scikit-learn
9 6 (2.42%) XML
10 5 (2.02%) FastAPI
Miscellaneous
1 27 (10.89%) Algorithms
2 22 (8.87%) Distributed Systems
3 19 (7.66%) Data Structures
4 15 (6.05%) Management Information System
5 10 (4.03%) Cloud Native
6 9 (3.63%) Greenfield Project
7 8 (3.23%) BBC
7 8 (3.23%) Distributed Applications
7 8 (3.23%) Legacy Systems
8 6 (2.42%) Product Ownership
9 3 (1.21%) Distributed Computing
9 3 (1.21%) IoT
10 2 (0.81%) Data Fabric
10 2 (0.81%) Hybrid Cloud
10 2 (0.81%) Onboarding
10 2 (0.81%) Social Network
11 1 (0.40%) Educational Technology
11 1 (0.40%) Hedge funds
11 1 (0.40%) Linux Command Line
11 1 (0.40%) Mainframe
Operating Systems
1 15 (6.05%) Linux
2 3 (1.21%) Unix
Processes & Methodologies
1 80 (32.26%) Data Engineering
2 75 (30.24%) Analytics
3 74 (29.84%) Data Pipeline
4 72 (29.03%) Agile
5 71 (28.63%) Data Science
5 71 (28.63%) ETL
6 69 (27.82%) Machine Learning
6 69 (27.82%) Software Engineering
7 66 (26.61%) Data Modelling
8 64 (25.81%) Computer Science
9 61 (24.60%) CI/CD
10 54 (21.77%) Visualisation
11 46 (18.55%) Data Integration
12 43 (17.34%) Data Visualisation
13 42 (16.94%) Mathematics
14 38 (15.32%) Migration
15 37 (14.92%) Data Governance
15 37 (14.92%) DevOps
16 35 (14.11%) Problem-Solving
17 34 (13.71%) Data Strategy
Programming Languages
1 159 (64.11%) Python
2 129 (52.02%) SQL
3 73 (29.44%) Java
4 55 (22.18%) Scala
5 31 (12.50%) Kotlin
6 20 (8.06%) R
7 19 (7.66%) C
8 15 (6.05%) C++
9 13 (5.24%) C#
10 12 (4.84%) Go
11 10 (4.03%) TypeScript
12 8 (3.23%) Clojure
12 8 (3.23%) Data Analysis Expressions
12 8 (3.23%) MATLAB
13 6 (2.42%) Rust
14 4 (1.61%) Shell Script
14 4 (1.61%) VB
15 2 (0.81%) JavaScript
16 1 (0.40%) F#
16 1 (0.40%) JCL
Qualifications
1 82 (33.06%) Degree
2 26 (10.48%) Computer Science Degree
3 14 (5.65%) Master's Degree
4 8 (3.23%) PhD
5 6 (2.42%) BPSS Clearance
5 6 (2.42%) Microsoft Certification
6 4 (1.61%) CIMA
7 3 (1.21%) Azure Certification
8 2 (0.81%) Security Cleared
9 1 (0.40%) SC Cleared
Quality Assurance & Compliance
1 21 (8.47%) QA
2 20 (8.06%) Data Quality
3 4 (1.61%) Solvency II
4 3 (1.21%) Accessibility
4 3 (1.21%) SLA
System Software
1 35 (14.11%) Docker
2 17 (6.85%) Virtual Machines
3 10 (4.03%) HDFS
4 6 (2.42%) Ceph
5 3 (1.21%) Virtual Servers
6 2 (0.81%) IAG
7 1 (0.40%) Apache Flume
7 1 (0.40%) Slurm Workload Manager
Systems Management
1 45 (18.15%) Kubernetes
2 41 (16.53%) Terraform
3 12 (4.84%) Ansible
4 6 (2.42%) Knative
5 2 (0.81%) Kubeflow
6 1 (0.40%) Kibana
6 1 (0.40%) logstash
6 1 (0.40%) Podman
6 1 (0.40%) Prometheus
Vendors
1 83 (33.47%) Databricks
2 51 (20.56%) Microsoft
3 50 (20.16%) Google
4 13 (5.24%) Cloudera
5 6 (2.42%) Oracle
5 6 (2.42%) YouTube
6 4 (1.61%) Apple
6 4 (1.61%) Atlassian
6 4 (1.61%) SAP
7 3 (1.21%) Facebook
7 3 (1.21%) Hortonworks
8 2 (0.81%) Cognos
8 2 (0.81%) IBM
8 2 (0.81%) Intel
8 2 (0.81%) MicroStrategy
8 2 (0.81%) Teradata
9 1 (0.40%) Ab Initio
9 1 (0.40%) BEA
9 1 (0.40%) Informatica
9 1 (0.40%) Twitter