Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 27 February 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Feb 2024
Same period 2023 Same period 2022
Rank 344 230 331
Rank change year-on-year -114 +101 -99
Permanent jobs citing Apache Spark 220 705 582
As % of all permanent jobs with a WFH option 0.75% 1.50% 1.00%
As % of the Application Platforms category 6.88% 11.67% 7.48%
Number of salaries quoted 152 279 390
10th Percentile £50,172 £56,250 £50,000
25th Percentile £62,500 £61,875 £61,313
Median annual salary (50th Percentile) £85,000 £82,500 £80,000
Median % change year-on-year +3.03% +3.13% +6.67%
75th Percentile £110,000 £105,000 £97,500
90th Percentile - £140,000 £115,000
UK median annual salary £80,000 £82,500 £80,000
% change year-on-year -3.03% +3.13% +11.11%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,198 6,039 7,776
As % of all permanent jobs with a WFH option 10.84% 12.87% 13.33%
Number of salaries quoted 2,433 4,121 4,931
10th Percentile £31,250 £32,000 £31,250
25th Percentile £38,750 £42,500 £40,000
Median annual salary (50th Percentile) £54,000 £59,191 £55,000
Median % change year-on-year -8.77% +7.62% +4.76%
75th Percentile £75,000 £77,715 £73,675
90th Percentile £90,000 £95,000 £92,500
UK median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% -

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 27 February 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 79 (35.91%) Apache
2 12 (5.45%) Apache Airflow
3 6 (2.73%) SAS
4 3 (1.36%) Confluence
4 3 (1.36%) Jupyter
5 2 (0.91%) Apache Solr
5 2 (0.91%) Luigi
Applications
1 4 (1.82%) Microsoft Excel
Business Applications
1 4 (1.82%) Primavera
Cloud Services
1 95 (43.18%) GCP
2 91 (41.36%) Azure
3 76 (34.55%) AWS
4 45 (20.45%) GitHub
5 42 (19.09%) Power Platform
6 33 (15.00%) GitHub Actions
7 32 (14.55%) Amazon S3
7 32 (14.55%) Vertex AI
8 25 (11.36%) SaaS
9 23 (10.45%) Amazon SQS
10 22 (10.00%) Google Docs
10 22 (10.00%) Lucidchart
10 22 (10.00%) Miro
10 22 (10.00%) Slack
11 12 (5.45%) Azure Data Factory
12 10 (4.55%) Azure Synapse Analytics
12 10 (4.55%) Google Kubernetes Engine
13 9 (4.09%) Snowflake
14 7 (3.18%) dbt
15 6 (2.73%) Serverless
Communications & Networking
1 38 (17.27%) Wireless
2 10 (4.55%) Firewall
3 2 (0.91%) HTTP
3 2 (0.91%) Network Security
4 1 (0.45%) Internet
Database & Business Intelligence
1 156 (70.91%) Big Data
2 96 (43.64%) Data Lake
3 77 (35.00%) Hadoop
4 63 (28.64%) Data Warehouse
5 56 (25.45%) NoSQL
6 50 (22.73%) BigQuery
6 50 (22.73%) Relational Database
7 42 (19.09%) MySQL
7 42 (19.09%) Power BI
8 41 (18.64%) PostgreSQL
9 36 (16.36%) Tableau
10 35 (15.91%) Looker
11 32 (14.55%) Bigtable
12 28 (12.73%) Elasticsearch
13 26 (11.82%) SQL Server
14 22 (10.00%) Redis
14 22 (10.00%) Scylla
15 21 (9.55%) Flink
16 11 (5.00%) Amazon Redshift
16 11 (5.00%) Apache Hive
Development Applications
1 49 (22.27%) Jenkins
2 11 (5.00%) Oracle Forms
2 11 (5.00%) Spinnaker
3 3 (1.36%) Deequ
3 3 (1.36%) JIRA
4 2 (0.91%) Git
5 1 (0.45%) JUnit
5 1 (0.45%) MLflow
General
1 75 (34.09%) Finance
2 64 (29.09%) Banking
3 63 (28.64%) Social Skills
4 40 (18.18%) Analytical Skills
5 34 (15.45%) Retail
6 23 (10.45%) Inclusion and Diversity
7 18 (8.18%) Games
8 14 (6.36%) Influencing Skills
9 6 (2.73%) Presentation Skills
10 3 (1.36%) Advertising
10 3 (1.36%) Legal
11 1 (0.45%) Manufacturing
11 1 (0.45%) Marketing
11 1 (0.45%) Telecoms
Job Titles
1 58 (26.36%) Data Engineer
2 47 (21.36%) Senior
3 39 (17.73%) Software Engineer
4 33 (15.00%) Principal Engineer
5 30 (13.64%) Data Manager
6 29 (13.18%) Lead
7 28 (12.73%) Architect
8 27 (12.27%) Cloud Engineer
9 26 (11.82%) Data Architect
10 23 (10.45%) Principal Software Engineer
11 20 (9.09%) Big Data Manager
12 19 (8.64%) Big Data Architect
13 18 (8.18%) Senior Data Engineer
14 17 (7.73%) GCP Engineer
15 16 (7.27%) Head of Engineering
15 16 (7.27%) Python Data Engineer
15 16 (7.27%) Python Engineer
16 13 (5.91%) Developer
16 13 (5.91%) Lead Data Engineer
17 11 (5.00%) Engineering Manager
Libraries, Frameworks & Software Standards
1 108 (49.09%) Kafka
2 22 (10.00%) GraphQL
3 19 (8.64%) Apache Beam
4 14 (6.36%) PySpark
5 6 (2.73%) Spring
6 5 (2.27%) .NET
6 5 (2.27%) Spring Boot
7 4 (1.82%) JSON
8 3 (1.36%) Great Expectations
9 2 (0.91%) ActiveMQ
9 2 (0.91%) Apache Avro
9 2 (0.91%) Apache Camel
9 2 (0.91%) Apache NiFi
9 2 (0.91%) FastAPI
9 2 (0.91%) Lucene
9 2 (0.91%) Protocol Buffers
9 2 (0.91%) React
9 2 (0.91%) Regular Expression
9 2 (0.91%) REST
9 2 (0.91%) XML
Miscellaneous
1 40 (18.18%) Data Structures
2 39 (17.73%) Algorithms
3 16 (7.27%) Cloud Native
4 12 (5.45%) Public Cloud
5 10 (4.55%) Greenfield Project
5 10 (4.55%) Product Ownership
6 7 (3.18%) Distributed Systems
7 6 (2.73%) Credit Risk
8 3 (1.36%) Mainframe
9 2 (0.91%) Cyberattack
9 2 (0.91%) Data Centre
9 2 (0.91%) Distributed Architecture
9 2 (0.91%) Self-Motivation
9 2 (0.91%) Virtual Team
10 1 (0.45%) Analytical Mindset
10 1 (0.45%) Distributed Computing
10 1 (0.45%) Grid Computing
10 1 (0.45%) IoT
10 1 (0.45%) Mobile Payment
10 1 (0.45%) Virtual Reality
Operating Systems
1 2 (0.91%) Linux
2 1 (0.45%) Unix
Processes & Methodologies
1 87 (39.55%) Agile
2 85 (38.64%) Data Pipeline
3 77 (35.00%) Data Engineering
4 72 (32.73%) Analytics
5 71 (32.27%) CI/CD
6 67 (30.45%) ETL
7 61 (27.73%) Machine Learning
8 52 (23.64%) Data Science
9 50 (22.73%) Business Intelligence
10 49 (22.27%) Artificial Intelligence
10 49 (22.27%) Software Engineering
11 46 (20.91%) Data Integration
12 44 (20.00%) Problem-Solving
12 44 (20.00%) Stakeholder Management
13 43 (19.55%) Visualisation
14 42 (19.09%) Data Visualisation
15 40 (18.18%) Data Analytics
16 38 (17.27%) Technical Leadership
17 37 (16.82%) Data Modelling
18 35 (15.91%) Infrastructure as Code
Programming Languages
1 114 (51.82%) Python
2 76 (34.55%) SQL
3 71 (32.27%) Java
4 55 (25.00%) Scala
5 41 (18.64%) Go
6 23 (10.45%) Bash
7 17 (7.73%) R
8 9 (4.09%) C#
9 5 (2.27%) Kotlin
10 4 (1.82%) C
10 4 (1.82%) Data Analysis Expressions
11 2 (0.91%) TypeScript
11 2 (0.91%) XPath
12 1 (0.45%) Shell Script
Qualifications
1 22 (10.00%) Degree
2 5 (2.27%) Security Cleared
3 4 (1.82%) CIMA
3 4 (1.82%) SC Cleared
4 3 (1.36%) Computer Science Degree
4 3 (1.36%) DV Cleared
4 3 (1.36%) ISTQB
4 3 (1.36%) Microsoft Certification
5 2 (0.91%) Master's Degree
6 1 (0.45%) Azure Certification
Quality Assurance & Compliance
1 13 (5.91%) Data Quality
2 6 (2.73%) CRD IV
2 6 (2.73%) IFRS
2 6 (2.73%) IFRS 9
3 4 (1.82%) Solvency II
4 3 (1.36%) QA
5 2 (0.91%) Accessibility
6 1 (0.45%) GDPR
System Software
1 20 (9.09%) Docker
2 2 (0.91%) Apache Flume
3 1 (0.45%) HDFS
Systems Management
1 64 (29.09%) Kubernetes
2 45 (20.45%) Terraform
3 3 (1.36%) Kibana
3 3 (1.36%) Progress Chef
4 2 (0.91%) Ansible
4 2 (0.91%) Argo
5 1 (0.45%) Oozie
5 1 (0.45%) Puppet
5 1 (0.45%) Rancher
Vendors
1 72 (32.73%) Databricks
2 65 (29.55%) Google
3 23 (10.45%) Dell
4 16 (7.27%) Teradata
5 14 (6.36%) Microsoft
5 14 (6.36%) Oracle
6 10 (4.55%) Confluent
7 8 (3.64%) YouTube
8 4 (1.82%) SAP
9 2 (0.91%) Apple
9 2 (0.91%) Cloudera
9 2 (0.91%) CrowdStrike
9 2 (0.91%) Talend
10 1 (0.45%) Adobe
10 1 (0.45%) Hortonworks
10 1 (0.45%) Informatica
10 1 (0.45%) StreamSets