Apache Spark Jobs in London

Apache Spark
England > London

The table below provides summary statistics for permanent job vacancies advertised in London requiring Apache Spark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Apache Spark over the 6 months leading up to 26 July 2024, comparing them to the same period in the previous two years.

6 months to
26 Jul 2024
Same period 2023 Same period 2022
Rank 327 215 199
Rank change year-on-year -112 -16 -34
Permanent jobs citing Apache Spark 154 439 1,726
As % of all permanent jobs advertised in London 0.74% 1.62% 2.30%
As % of the Application Platforms category 5.37% 12.64% 16.21%
Number of salaries quoted 105 358 561
10th Percentile £64,250 £64,625 £51,750
25th Percentile £75,000 £70,000 £67,500
Median annual salary (50th Percentile) £92,500 £92,500 £82,500
Median % change year-on-year - +12.12% +6.45%
75th Percentile £110,000 £130,000 £97,500
90th Percentile £144,000 £160,000 £115,000
England median annual salary £80,000 £85,000 £80,000
% change year-on-year -5.88% +6.25% +3.80%

All Application Platform Skills
London

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills in London.

Permanent vacancies with a requirement for application platform skills 2,866 3,473 10,645
As % of all permanent jobs advertised in London 13.82% 12.81% 14.19%
Number of salaries quoted 2,104 2,882 4,949
10th Percentile £38,825 £37,050 £36,250
25th Percentile £51,250 £51,250 £50,000
Median annual salary (50th Percentile) £85,000 £67,500 £65,000
Median % change year-on-year +25.93% +3.85% -
75th Percentile £118,750 £90,000 £87,500
90th Percentile £146,750 £116,250 £103,750
England median annual salary £52,500 £57,500 £55,000
% change year-on-year -8.70% +4.55% +4.76%

Apache Spark
Job Vacancy Trend in London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in London.

Job vacancy trend for Apache Spark in London

Apache Spark
Salary Trend in London

3-month moving average salary quoted in jobs citing Apache Spark in London.

Salary trend for Apache Spark in London

Apache Spark
Salary Histogram in London

Salary distribution for jobs citing Apache Spark in London over the 6 months to 26 July 2024.

Salary histogram for Apache Spark in London

Apache Spark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the London region over the 6 months to 26 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +29 19 £75,000 -16.67% 2
West London -7 4 £90,000 +20.00% 1
East London +21 1 - -
Apache Spark
England

Apache Spark
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 61 (39.61%) Apache
2 41 (26.62%) Apache Airflow
3 5 (3.25%) Apache Pulsar
4 3 (1.95%) Confluence
5 2 (1.30%) Apache Pig
6 1 (0.65%) SAS
Applications
1 5 (3.25%) Microsoft Excel
2 2 (1.30%) Microsoft Office
Business Applications
1 2 (1.30%) Primavera
Cloud Services
1 97 (62.99%) AWS
2 84 (54.55%) Azure
3 67 (43.51%) GCP
4 28 (18.18%) Snowflake
5 27 (17.53%) Azure Synapse Analytics
6 20 (12.99%) Amazon Kinesis
7 13 (8.44%) Azure Data Factory
7 13 (8.44%) Stackdriver
8 12 (7.79%) Power Platform
9 10 (6.49%) Azure DevOps
10 8 (5.19%) Amazon EMR
11 7 (4.55%) Amazon S3
11 7 (4.55%) GitHub
11 7 (4.55%) PowerApps
12 6 (3.90%) dbt
13 5 (3.25%) Azure Machine Learning
13 5 (3.25%) Cloud Computing
13 5 (3.25%) Power Automate
14 4 (2.60%) AWS CloudFormation
14 4 (2.60%) AWS Lambda
Communications & Networking
1 6 (3.90%) HTTP
2 3 (1.95%) Wireless
Database & Business Intelligence
1 63 (40.91%) Big Data
2 37 (24.03%) Hadoop
2 37 (24.03%) NoSQL
3 27 (17.53%) Data Lake
4 26 (16.88%) Data Mining
4 26 (16.88%) Data Warehouse
5 24 (15.58%) BigQuery
6 19 (12.34%) Apache Hive
7 17 (11.04%) Amazon Redshift
8 16 (10.39%) Flink
9 12 (7.79%) Power BI
10 11 (7.14%) Presto
11 9 (5.84%) Neo4j
11 9 (5.84%) Spark SQL
12 7 (4.55%) Apache Cassandra
13 6 (3.90%) Amazon Athena
13 6 (3.90%) Metadata
13 6 (3.90%) MongoDB
13 6 (3.90%) PostgreSQL
14 5 (3.25%) DynamoDB
Development Applications
1 22 (14.29%) Jenkins
2 20 (12.99%) Git
3 4 (2.60%) Bitbucket
3 4 (2.60%) MLflow
4 3 (1.95%) JIRA
4 3 (1.95%) Spinnaker
5 2 (1.30%) CircleCI
5 2 (1.30%) Flyway
5 2 (1.30%) GitLab
5 2 (1.30%) Liquibase
5 2 (1.30%) Team Foundation Server
6 1 (0.65%) JMeter
6 1 (0.65%) TestCafe
6 1 (0.65%) Zephyr
General
1 52 (33.77%) Social Skills
2 36 (23.38%) Finance
3 26 (16.88%) Analytical Skills
4 20 (12.99%) Inclusion and Diversity
5 12 (7.79%) Law
6 11 (7.14%) Electronics
6 11 (7.14%) Retail
7 9 (5.84%) Banking
8 8 (5.19%) Games
8 8 (5.19%) Legal
9 6 (3.90%) Advertising
9 6 (3.90%) Presentation Skills
10 4 (2.60%) Marketing
10 4 (2.60%) Music Industry
10 4 (2.60%) Public Sector
11 3 (1.95%) Manufacturing
12 2 (1.30%) Retail Banking
13 1 (0.65%) Automotive
13 1 (0.65%) Investment Banking
13 1 (0.65%) Publishing
Job Titles
1 63 (40.91%) Senior
2 39 (25.32%) Software Engineer
3 38 (24.68%) Data Engineer
4 29 (18.83%) Architect
5 25 (16.23%) Lead
6 22 (14.29%) Senior Software Engineer
7 21 (13.64%) Data Architect
8 14 (9.09%) Senior Data Engineer
9 12 (7.79%) Cloud Architect
9 12 (7.79%) Senior Architect
9 12 (7.79%) Senior Cloud Architect
10 10 (6.49%) Developer
10 10 (6.49%) Scala Engineer
10 10 (6.49%) Scala Software Engineer
10 10 (6.49%) Technical Leader
11 9 (5.84%) Data Scientist
11 9 (5.84%) Senior Data Architect
12 7 (4.55%) Java Developer
12 7 (4.55%) Lead Software Engineer
12 7 (4.55%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 69 (44.81%) Kafka
2 17 (11.04%) PySpark
3 15 (9.74%) Apache Beam
4 14 (9.09%) React
5 10 (6.49%) http4s
5 10 (6.49%) Lambda Expressions
6 8 (5.19%) PyTorch
7 7 (4.55%) RabbitMQ
7 7 (4.55%) scikit-learn
8 6 (3.90%) Pandas
8 6 (3.90%) Spring
8 6 (3.90%) Spring Boot
8 6 (3.90%) TensorFlow
9 5 (3.25%) Spark Streaming
10 4 (2.60%) .NET
10 4 (2.60%) JSON
10 4 (2.60%) XML
11 3 (1.95%) Keras
11 3 (1.95%) Node.js
11 3 (1.95%) REST
Miscellaneous
1 20 (12.99%) Algorithms
2 18 (11.69%) Distributed Systems
3 14 (9.09%) Data Structures
4 13 (8.44%) Legacy Systems
5 10 (6.49%) Management Information System
6 5 (3.25%) Cloud Native
6 5 (3.25%) Greenfield Project
7 2 (1.30%) Data Fabric
7 2 (1.30%) Distributed Applications
7 2 (1.30%) Distributed Computing
7 2 (1.30%) Hybrid Cloud
7 2 (1.30%) IoT
7 2 (1.30%) Social Network
7 2 (1.30%) Virtual Team
8 1 (0.65%) Educational Technology
8 1 (0.65%) Linux Command Line
8 1 (0.65%) Mainframe
8 1 (0.65%) Mobile App
8 1 (0.65%) Private Cloud
8 1 (0.65%) Public Cloud
Operating Systems
1 12 (7.79%) Linux
2 3 (1.95%) Unix
Processes & Methodologies
1 55 (35.71%) Machine Learning
2 52 (33.77%) Software Engineering
3 50 (32.47%) Analytics
4 47 (30.52%) Data Modelling
4 47 (30.52%) Data Pipeline
4 47 (30.52%) ETL
5 46 (29.87%) CI/CD
6 44 (28.57%) Agile
7 40 (25.97%) Data Engineering
8 39 (25.32%) Computer Science
9 36 (23.38%) Visualisation
10 35 (22.73%) Data Science
11 33 (21.43%) DevOps
12 32 (20.78%) Data Visualisation
13 24 (15.58%) Microservices
13 24 (15.58%) Migration
14 23 (14.94%) Artificial Intelligence
14 23 (14.94%) Data Management
14 23 (14.94%) Infrastructure as Code
14 23 (14.94%) Problem-Solving
Programming Languages
1 91 (59.09%) Python
2 77 (50.00%) SQL
3 55 (35.71%) Java
4 47 (30.52%) Scala
5 28 (18.18%) Kotlin
6 15 (9.74%) C++
7 13 (8.44%) TypeScript
8 12 (7.79%) R
9 11 (7.14%) C
10 10 (6.49%) Clojure
11 6 (3.90%) C#
11 6 (3.90%) Go
11 6 (3.90%) Rust
12 5 (3.25%) Data Analysis Expressions
13 4 (2.60%) JavaScript
13 4 (2.60%) Shell Script
13 4 (2.60%) T-SQL
14 2 (1.30%) PL/SQL
14 2 (1.30%) PowerShell
14 2 (1.30%) VB
Qualifications
1 51 (33.12%) Degree
2 21 (13.64%) Computer Science Degree
3 11 (7.14%) Master's Degree
4 8 (5.19%) PhD
5 4 (2.60%) BPSS Clearance
6 2 (1.30%) CIMA
6 2 (1.30%) SC Cleared
6 2 (1.30%) Security Cleared
7 1 (0.65%) Azure Certification
Quality Assurance & Compliance
1 19 (12.34%) Data Quality
2 11 (7.14%) QA
3 3 (1.95%) Accessibility
4 1 (0.65%) ISO 20022
System Software
1 16 (10.39%) Virtual Machines
2 15 (9.74%) Docker
3 6 (3.90%) Ceph
4 4 (2.60%) HDFS
5 3 (1.95%) Virtual Servers
6 2 (1.30%) IAG
7 1 (0.65%) Apache Flume
Systems Management
1 40 (25.97%) Terraform
2 34 (22.08%) Kubernetes
3 12 (7.79%) Ansible
4 6 (3.90%) Knative
5 2 (1.30%) Kubeflow
6 1 (0.65%) Apache Ranger
6 1 (0.65%) Hadoop YARN
Vendors
1 58 (37.66%) Databricks
2 35 (22.73%) Microsoft
3 31 (20.13%) Google
4 6 (3.90%) Apple
4 6 (3.90%) Cloudera
5 5 (3.25%) Oracle
6 3 (1.95%) Atlassian
6 3 (1.95%) Hortonworks
6 3 (1.95%) StreamSets
7 2 (1.30%) Alteryx
7 2 (1.30%) Informatica
7 2 (1.30%) RedGate
7 2 (1.30%) SAP
7 2 (1.30%) Splunk
7 2 (1.30%) YouTube
8 1 (0.65%) Ab Initio
8 1 (0.65%) Confluent
8 1 (0.65%) IBM