Apache Spark Jobs in London

Apache Spark
England > London

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 8 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
8 May 2024
Same period 2023 Same period 2022
Rank 279 146 189
Rank change year-on-year -133 +43 -31
Permanent jobs citing Apache Spark 250 906 1,549
As % of all permanent jobs advertised in London 1.06% 2.63% 2.30%
As % of the Application Platforms category 7.95% 19.34% 16.11%
Number of salaries quoted 173 461 540
10th Percentile £62,500 £60,000 £51,250
25th Percentile £72,500 £70,000 £65,000
Median annual salary (50th Percentile) £90,000 £95,000 £80,000
Median % change year-on-year -5.26% +18.75% +3.23%
75th Percentile £110,000 £130,000 £97,500
90th Percentile £124,500 £150,000 £115,000
England median annual salary £80,000 £88,000 £80,000
% change year-on-year -9.09% +10.00% +6.67%

All Application Platform Skills
London

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,146 4,684 9,617
As % of all permanent jobs advertised in London 13.32% 13.59% 14.25%
Number of salaries quoted 2,201 3,365 4,915
10th Percentile £35,000 £37,500 £35,750
25th Percentile £47,500 £51,250 £47,500
Median annual salary (50th Percentile) £70,000 £68,823 £65,000
Median % change year-on-year +1.71% +5.88% -
75th Percentile £96,250 £90,000 £85,000
90th Percentile £136,250 £116,250 £101,250
England median annual salary £50,000 £56,500 £55,000
% change year-on-year -11.50% +2.73% +4.76%

Apache Spark
Job Vacancy Trend in London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in London.

Job vacancy trend for Apache Spark in London

Apache Spark
Salary Trend in London

3-month moving average salary quoted in jobs citing Apache Spark in London.

Salary trend for Apache Spark in London

Apache Spark
Salary Histogram in London

Salary distribution for jobs citing Apache Spark in London over the 6 months to 8 May 2024.

Salary histogram for Apache Spark in London

Apache Spark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the London region over the 6 months to 8 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +32 16 £77,500 -18.42% 6
West London -2 3 £90,000 +20.00% 3
Apache Spark
England

Apache Spark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 89 (35.60%) Apache
2 45 (18.00%) Apache Airflow
3 8 (3.20%) Jupyter
4 3 (1.20%) Apache Pulsar
5 2 (0.80%) Apache Solr
5 2 (0.80%) Luigi
6 1 (0.40%) Apache Pig
6 1 (0.40%) Confluence
Applications
1 7 (2.80%) Microsoft Excel
Business Applications
1 4 (1.60%) Primavera
Cloud Services
1 153 (61.20%) AWS
2 138 (55.20%) Azure
3 86 (34.40%) GCP
4 29 (11.60%) Snowflake
5 28 (11.20%) Azure Synapse Analytics
6 22 (8.80%) Azure Data Factory
7 19 (7.60%) Amazon Kinesis
8 16 (6.40%) Amazon S3
8 16 (6.40%) Power Platform
9 15 (6.00%) GitHub
10 12 (4.80%) Azure DevOps
10 12 (4.80%) Serverless
11 10 (4.00%) Amazon EMR
12 8 (3.20%) GitHub Actions
12 8 (3.20%) Stackdriver
13 7 (2.80%) AWS Lambda
13 7 (2.80%) Power Automate
13 7 (2.80%) PowerApps
14 5 (2.00%) dbt
15 4 (1.60%) AWS CloudFormation
Communications & Networking
1 20 (8.00%) Wireless
2 2 (0.80%) HTTP
Database & Business Intelligence
1 110 (44.00%) Big Data
2 88 (35.20%) Hadoop
3 62 (24.80%) Data Lake
4 57 (22.80%) NoSQL
5 51 (20.40%) Data Warehouse
6 42 (16.80%) Data Mining
7 34 (13.60%) Elasticsearch
8 26 (10.40%) Apache Hive
9 23 (9.20%) Apache Ignite
9 23 (9.20%) Flink
10 21 (8.40%) Amazon Redshift
10 21 (8.40%) SQL Server
11 16 (6.40%) BigQuery
11 16 (6.40%) Power BI
12 13 (5.20%) MySQL
12 13 (5.20%) PostgreSQL
12 13 (5.20%) Relational Database
13 10 (4.00%) Spark SQL
14 9 (3.60%) DynamoDB
14 9 (3.60%) Parquet
Development Applications
1 32 (12.80%) Git
2 19 (7.60%) Jenkins
3 8 (3.20%) CircleCI
3 8 (3.20%) Visual Studio
4 4 (1.60%) Bitbucket
5 3 (1.20%) JIRA
6 2 (0.80%) MLflow
6 2 (0.80%) Team Foundation Server
7 1 (0.40%) Ant
7 1 (0.40%) Gradle
7 1 (0.40%) JUnit
7 1 (0.40%) Maven
7 1 (0.40%) Oracle Forms
7 1 (0.40%) Spinnaker
General
1 60 (24.00%) Analytical Skills
1 60 (24.00%) Social Skills
2 41 (16.40%) Finance
3 22 (8.80%) Inclusion and Diversity
4 15 (6.00%) Games
5 13 (5.20%) Banking
5 13 (5.20%) Marketing
6 12 (4.80%) Public Sector
6 12 (4.80%) Retail
7 10 (4.00%) Electronics
8 9 (3.60%) Legal
8 9 (3.60%) Presentation Skills
9 8 (3.20%) Law
9 8 (3.20%) Retail Banking
10 4 (1.60%) Music Industry
11 3 (1.20%) German Language
11 3 (1.20%) Manufacturing
12 2 (0.80%) Advertising
12 2 (0.80%) Investment Banking
12 2 (0.80%) Publishing
Job Titles
1 101 (40.40%) Senior
2 74 (29.60%) Data Engineer
3 43 (17.20%) Architect
4 36 (14.40%) Senior Data Engineer
5 32 (12.80%) Lead
6 28 (11.20%) Cloud Architect
7 27 (10.80%) Software Engineer
8 23 (9.20%) IT Architect
9 21 (8.40%) Data Manager
9 21 (8.40%) Senior Architect
9 21 (8.40%) Senior Cloud Architect
10 18 (7.20%) Data Architect
11 17 (6.80%) Data Scientist
11 17 (6.80%) Python Engineer
12 16 (6.40%) Developer
12 16 (6.40%) Senior Data Scientist
13 14 (5.60%) Senior Software Engineer
14 13 (5.20%) Python Data Engineer
15 11 (4.40%) Big Data Manager
16 10 (4.00%) Big Data Architect
Libraries, Frameworks & Software Standards
1 90 (36.00%) Kafka
2 36 (14.40%) PySpark
3 19 (7.60%) Apache Beam
4 14 (5.60%) Pandas
5 11 (4.40%) TensorFlow
6 10 (4.00%) Flask
6 10 (4.00%) React
7 9 (3.60%) JSON
7 9 (3.60%) Spark Streaming
7 9 (3.60%) XML
8 8 (3.20%) .NET
8 8 (3.20%) Apache Avro
8 8 (3.20%) Lambda Expressions
9 7 (2.80%) http4s
10 6 (2.40%) Spring
10 6 (2.40%) Spring Boot
11 5 (2.00%) FastAPI
11 5 (2.00%) PyTorch
11 5 (2.00%) scikit-learn
12 4 (1.60%) REST
Miscellaneous
1 28 (11.20%) Algorithms
2 24 (9.60%) Distributed Systems
3 19 (7.60%) Data Structures
4 11 (4.40%) Management Information System
5 10 (4.00%) Greenfield Project
6 9 (3.60%) Cloud Native
6 9 (3.60%) Distributed Applications
7 8 (3.20%) BBC
7 8 (3.20%) Legacy Systems
8 7 (2.80%) Product Ownership
9 3 (1.20%) Distributed Computing
9 3 (1.20%) IoT
9 3 (1.20%) Onboarding
10 2 (0.80%) Social Network
11 1 (0.40%) Educational Technology
11 1 (0.40%) Enterprise Software
11 1 (0.40%) Hedge funds
11 1 (0.40%) Hybrid Cloud
11 1 (0.40%) Linux Command Line
11 1 (0.40%) Mainframe
Operating Systems
1 15 (6.00%) Linux
2 2 (0.80%) Unix
Processes & Methodologies
1 75 (30.00%) Agile
1 75 (30.00%) Data Engineering
2 74 (29.60%) Analytics
3 71 (28.40%) Data Science
3 71 (28.40%) ETL
4 68 (27.20%) Data Pipeline
5 66 (26.40%) Data Modelling
6 63 (25.20%) Machine Learning
7 60 (24.00%) Software Engineering
7 60 (24.00%) Visualisation
8 59 (23.60%) Computer Science
9 51 (20.40%) CI/CD
10 50 (20.00%) Data Integration
10 50 (20.00%) Mathematics
11 49 (19.60%) Data Visualisation
12 43 (17.20%) Migration
13 40 (16.00%) Data Governance
14 38 (15.20%) Project Management
15 36 (14.40%) Data Strategy
15 36 (14.40%) DevOps
Programming Languages
1 160 (64.00%) Python
2 138 (55.20%) SQL
3 64 (25.60%) Java
4 50 (20.00%) Scala
5 23 (9.20%) Kotlin
6 21 (8.40%) R
7 16 (6.40%) C
8 15 (6.00%) C#
9 12 (4.80%) C++
10 10 (4.00%) Go
11 9 (3.60%) Data Analysis Expressions
12 8 (3.20%) MATLAB
12 8 (3.20%) TypeScript
13 7 (2.80%) VB
14 6 (2.40%) Clojure
15 4 (1.60%) Rust
16 3 (1.20%) Shell Script
17 2 (0.80%) F#
17 2 (0.80%) JavaScript
17 2 (0.80%) XPath
Qualifications
1 82 (32.80%) Degree
2 21 (8.40%) Computer Science Degree
3 12 (4.80%) Master's Degree
4 7 (2.80%) PhD
5 6 (2.40%) BPSS Clearance
5 6 (2.40%) Microsoft Certification
6 4 (1.60%) CIMA
7 3 (1.20%) Azure Certification
8 2 (0.80%) Security Cleared
9 1 (0.40%) SC Cleared
Quality Assurance & Compliance
1 17 (6.80%) Data Quality
1 17 (6.80%) QA
2 4 (1.60%) Solvency II
3 3 (1.20%) SLA
4 2 (0.80%) Accessibility
System Software
1 33 (13.20%) Docker
2 11 (4.40%) Virtual Machines
3 10 (4.00%) HDFS
4 4 (1.60%) Ceph
5 2 (0.80%) IAG
5 2 (0.80%) Virtual Servers
6 1 (0.40%) Apache Flume
6 1 (0.40%) Slurm Workload Manager
Systems Management
1 39 (15.60%) Kubernetes
2 35 (14.00%) Terraform
3 7 (2.80%) Ansible
4 4 (1.60%) Knative
5 2 (0.80%) Kubeflow
6 1 (0.40%) Kibana
6 1 (0.40%) logstash
6 1 (0.40%) Podman
6 1 (0.40%) Prometheus
Vendors
1 86 (34.40%) Databricks
2 53 (21.20%) Microsoft
3 49 (19.60%) Google
4 12 (4.80%) Cloudera
5 8 (3.20%) YouTube
6 7 (2.80%) Atlassian
7 5 (2.00%) Apple
8 4 (1.60%) Facebook
8 4 (1.60%) Oracle
8 4 (1.60%) SAP
9 3 (1.20%) IBM
10 2 (0.80%) Cognos
10 2 (0.80%) Intel
10 2 (0.80%) MicroStrategy
10 2 (0.80%) Talend
10 2 (0.80%) Teradata
11 1 (0.40%) BEA
11 1 (0.40%) Hortonworks
11 1 (0.40%) Spotify
11 1 (0.40%) Twitter