Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 9 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
9 May 2024
Same period 2023 Same period 2022
Rank 408 197 310
Rank change year-on-year -211 +113 -42
Permanent jobs citing Apache Spark 190 730 803
As % of all permanent jobs with a WFH option 0.56% 1.76% 1.17%
As % of the Application Platforms category 4.77% 14.15% 8.67%
Number of salaries quoted 148 302 469
10th Percentile £50,172 £57,500 £50,000
25th Percentile £61,180 £65,000 £60,625
Median annual salary (50th Percentile) £80,000 £100,000 £80,000
Median % change year-on-year -20.00% +25.00% +3.23%
75th Percentile £110,000 £130,000 £95,000
90th Percentile £111,625 £160,000 £113,000
UK median annual salary £80,000 £87,500 £80,000
% change year-on-year -8.57% +9.38% +10.34%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,981 5,160 9,267
As % of all permanent jobs with a WFH option 11.79% 12.44% 13.54%
Number of salaries quoted 2,841 3,724 5,254
10th Percentile £31,250 £32,500 £31,250
25th Percentile £40,000 £44,033 £41,000
Median annual salary (50th Percentile) £55,000 £60,000 £55,000
Median % change year-on-year -8.33% +9.09% +4.76%
75th Percentile £75,772 £78,750 £75,000
90th Percentile £110,000 £100,000 £92,500
UK median annual salary £50,000 £55,000 £54,653
% change year-on-year -9.09% +0.64% +4.10%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 9 May 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 56 (29.47%) Apache
2 23 (12.11%) Apache Airflow
3 6 (3.16%) SAS
4 5 (2.63%) Confluence
5 2 (1.05%) Apache Solr
5 2 (1.05%) Jupyter
Applications
1 7 (3.68%) Microsoft Excel
Business Applications
1 4 (2.11%) Primavera
Cloud Services
1 90 (47.37%) AWS
2 73 (38.42%) Azure
3 59 (31.05%) GCP
4 37 (19.47%) Amazon S3
5 30 (15.79%) SaaS
6 24 (12.63%) Amazon SQS
7 23 (12.11%) Google Docs
7 23 (12.11%) Lucidchart
7 23 (12.11%) Miro
7 23 (12.11%) Slack
7 23 (12.11%) Snowflake
8 19 (10.00%) Power Platform
9 16 (8.42%) Azure Data Factory
9 16 (8.42%) dbt
10 12 (6.32%) Azure Synapse Analytics
11 11 (5.79%) GitHub
12 10 (5.26%) Serverless
13 9 (4.74%) Azure DevOps
14 8 (4.21%) Amazon EMR
15 7 (3.68%) Power Automate
Communications & Networking
1 20 (10.53%) Wireless
2 7 (3.68%) Firewall
3 2 (1.05%) HTTP
3 2 (1.05%) Network Security
Database & Business Intelligence
1 104 (54.74%) Big Data
2 63 (33.16%) Hadoop
3 49 (25.79%) Data Warehouse
4 47 (24.74%) Data Lake
5 28 (14.74%) Elasticsearch
6 27 (14.21%) NoSQL
7 23 (12.11%) Redis
7 23 (12.11%) Scylla
8 21 (11.05%) SQL Server
9 19 (10.00%) Power BI
10 16 (8.42%) Flink
11 15 (7.89%) Amazon Redshift
11 15 (7.89%) Relational Database
12 14 (7.37%) BigQuery
13 11 (5.79%) MySQL
14 10 (5.26%) Data Mining
14 10 (5.26%) PostgreSQL
15 8 (4.21%) Apache Hive
15 8 (4.21%) Delta Lake
15 8 (4.21%) Spark SQL
Development Applications
1 14 (7.37%) Jenkins
2 12 (6.32%) Git
3 9 (4.74%) Spinnaker
4 6 (3.16%) Oracle Forms
5 5 (2.63%) JIRA
6 4 (2.11%) Bitbucket
7 3 (1.58%) Deequ
7 3 (1.58%) Octopus Deploy
8 2 (1.05%) MLflow
9 1 (0.53%) JUnit
General
1 59 (31.05%) Social Skills
2 41 (21.58%) Finance
3 32 (16.84%) Analytical Skills
4 25 (13.16%) Inclusion and Diversity
5 22 (11.58%) Banking
6 19 (10.00%) Games
7 9 (4.74%) Retail
8 7 (3.68%) Presentation Skills
9 4 (2.11%) Influencing Skills
9 4 (2.11%) Music Industry
10 3 (1.58%) Legal
10 3 (1.58%) Manufacturing
11 2 (1.05%) Advertising
11 2 (1.05%) French Language
11 2 (1.05%) Marketing
11 2 (1.05%) Spanish Language
12 1 (0.53%) Automotive
12 1 (0.53%) Telecoms
Job Titles
1 60 (31.58%) Data Engineer
2 57 (30.00%) Senior
3 44 (23.16%) Software Engineer
4 29 (15.26%) Principal Engineer
5 26 (13.68%) Principal Software Engineer
6 24 (12.63%) Senior Data Engineer
7 21 (11.05%) Data Manager
8 17 (8.95%) Lead
9 16 (8.42%) Architect
9 16 (8.42%) Cloud Engineer
10 15 (7.89%) Python Data Engineer
10 15 (7.89%) Python Engineer
11 14 (7.37%) Data Architect
12 12 (6.32%) Developer
13 11 (5.79%) Big Data Manager
13 11 (5.79%) Engineering Manager
14 10 (5.26%) Big Data Architect
14 10 (5.26%) Senior Software Engineer
15 9 (4.74%) Analyst
15 9 (4.74%) Senior Analyst
Libraries, Frameworks & Software Standards
1 81 (42.63%) Kafka
2 23 (12.11%) GraphQL
3 19 (10.00%) PySpark
4 16 (8.42%) Apache Beam
5 8 (4.21%) React
6 6 (3.16%) Pandas
7 5 (2.63%) Spring
7 5 (2.63%) Spring Boot
8 4 (2.11%) Apache NiFi
9 3 (1.58%) .NET
9 3 (1.58%) Great Expectations
9 3 (1.58%) JSON
10 2 (1.05%) ActiveMQ
10 2 (1.05%) Apache Camel
10 2 (1.05%) Flask
10 2 (1.05%) Lucene
10 2 (1.05%) NumPy
10 2 (1.05%) Regular Expression
10 2 (1.05%) REST
10 2 (1.05%) XML
Miscellaneous
1 44 (23.16%) Data Structures
2 37 (19.47%) Algorithms
3 14 (7.37%) Cloud Native
4 9 (4.74%) Product Ownership
5 8 (4.21%) Greenfield Project
6 6 (3.16%) Credit Risk
7 5 (2.63%) Distributed Systems
7 5 (2.63%) Mainframe
8 4 (2.11%) Renewable Energy
9 2 (1.05%) Cyberattack
9 2 (1.05%) Data Centre
9 2 (1.05%) Distributed Computing
9 2 (1.05%) Social Media
9 2 (1.05%) Taxonomies
9 2 (1.05%) Virtual Team
10 1 (0.53%) IoT
10 1 (0.53%) Mobile Payment
10 1 (0.53%) Virtual Reality
Operating Systems
1 5 (2.63%) Linux
Processes & Methodologies
1 66 (34.74%) Data Pipeline
2 62 (32.63%) Data Engineering
3 56 (29.47%) Software Engineering
4 54 (28.42%) Data Science
5 52 (27.37%) Agile
6 47 (24.74%) Data Modelling
7 44 (23.16%) Problem-Solving
8 40 (21.05%) Analytics
8 40 (21.05%) CI/CD
9 35 (18.42%) ETL
10 34 (17.89%) Machine Learning
11 32 (16.84%) High Availability
12 31 (16.32%) Stakeholder Management
13 27 (14.21%) Business Intelligence
14 26 (13.68%) Cybersecurity
14 26 (13.68%) Technical Leadership
15 25 (13.16%) Data Management
15 25 (13.16%) DevOps
15 25 (13.16%) User Experience
16 24 (12.63%) Threat Intelligence
Programming Languages
1 124 (65.26%) Python
2 85 (44.74%) SQL
3 67 (35.26%) Java
4 57 (30.00%) Scala
5 37 (19.47%) Go
6 24 (12.63%) Bash
7 12 (6.32%) R
8 11 (5.79%) Kotlin
9 10 (5.26%) TypeScript
10 9 (4.74%) C#
11 7 (3.68%) Data Analysis Expressions
12 6 (3.16%) Clojure
13 5 (2.63%) C
14 2 (1.05%) JavaScript
14 2 (1.05%) PHP
14 2 (1.05%) XPath
15 1 (0.53%) PL/SQL
Qualifications
1 25 (13.16%) Degree
2 7 (3.68%) Security Cleared
3 5 (2.63%) DV Cleared
4 4 (2.11%) CIMA
4 4 (2.11%) DBS Check
4 4 (2.11%) SC Cleared
5 3 (1.58%) ISTQB
6 2 (1.05%) Master's Degree
6 2 (1.05%) Microsoft Certification
7 1 (0.53%) Computer Science Degree
Quality Assurance & Compliance
1 17 (8.95%) Data Quality
2 6 (3.16%) CRD IV
2 6 (3.16%) IFRS
2 6 (3.16%) IFRS 9
3 4 (2.11%) QA
3 4 (2.11%) Solvency II
4 2 (1.05%) GDPR
5 1 (0.53%) Accessibility
System Software
1 16 (8.42%) Docker
2 2 (1.05%) Apache Flume
3 1 (0.53%) HDFS
Systems Management
1 66 (34.74%) Kubernetes
2 17 (8.95%) Terraform
3 3 (1.58%) Kibana
4 2 (1.05%) Ansible
4 2 (1.05%) Argo
4 2 (1.05%) Progress Chef
5 1 (0.53%) Rancher
Vendors
1 66 (34.74%) Databricks
2 40 (21.05%) Google
3 24 (12.63%) Dell
4 17 (8.95%) Microsoft
5 13 (6.84%) Teradata
6 10 (5.26%) Oracle
7 8 (4.21%) YouTube
8 7 (3.68%) Confluent
9 4 (2.11%) SAP
10 3 (1.58%) Cloudera
10 3 (1.58%) SnapLogic
11 2 (1.05%) Apple
11 2 (1.05%) CrowdStrike
11 2 (1.05%) Hootsuite
11 2 (1.05%) Hortonworks
11 2 (1.05%) Informatica
11 2 (1.05%) Talend
12 1 (0.53%) StreamSets