Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 19 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
19 May 2024
Same period 2023 Same period 2022
Rank 410 199 312
Rank change year-on-year -211 +113 -22
Permanent jobs citing Apache Spark 185 705 852
As % of all permanent jobs with a WFH option 0.55% 1.74% 1.21%
As % of the Application Platforms category 4.63% 14.09% 8.84%
Number of salaries quoted 144 295 483
10th Percentile £50,172 £60,000 £50,000
25th Percentile £62,438 £65,000 £60,625
Median annual salary (50th Percentile) £80,000 £100,000 £80,000
Median % change year-on-year -20.00% +25.00% +3.23%
75th Percentile £110,000 £130,000 £95,000
90th Percentile £112,125 £160,000 £109,750
UK median annual salary £80,000 £87,500 £77,500
% change year-on-year -8.57% +12.90% +3.33%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,997 5,003 9,633
As % of all permanent jobs with a WFH option 11.81% 12.33% 13.66%
Number of salaries quoted 2,846 3,663 5,265
10th Percentile £31,250 £32,500 £31,250
25th Percentile £40,031 £44,750 £41,250
Median annual salary (50th Percentile) £55,000 £60,000 £55,000
Median % change year-on-year -8.33% +9.09% +4.76%
75th Percentile £76,250 £80,000 £75,000
90th Percentile £115,000 £100,000 £92,500
UK median annual salary £50,000 £55,667 £55,000
% change year-on-year -10.18% +1.21% +4.76%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 19 May 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (28.65%) Apache
2 23 (12.43%) Apache Airflow
3 5 (2.70%) Confluence
4 3 (1.62%) SAS
5 2 (1.08%) Apache Solr
5 2 (1.08%) Jupyter
Applications
1 7 (3.78%) Microsoft Excel
Business Applications
1 4 (2.16%) Primavera
Cloud Services
1 90 (48.65%) AWS
2 71 (38.38%) Azure
3 58 (31.35%) GCP
4 37 (20.00%) Amazon S3
5 29 (15.68%) SaaS
6 24 (12.97%) Amazon SQS
7 23 (12.43%) Google Docs
7 23 (12.43%) Lucidchart
7 23 (12.43%) Miro
7 23 (12.43%) Slack
7 23 (12.43%) Snowflake
8 19 (10.27%) Power Platform
9 16 (8.65%) Azure Data Factory
9 16 (8.65%) dbt
10 12 (6.49%) Azure Synapse Analytics
11 11 (5.95%) GitHub
12 10 (5.41%) Serverless
13 9 (4.86%) Azure DevOps
14 8 (4.32%) Amazon EMR
15 7 (3.78%) PowerApps
Communications & Networking
1 18 (9.73%) Wireless
2 7 (3.78%) Firewall
3 2 (1.08%) HTTP
3 2 (1.08%) Network Security
Database & Business Intelligence
1 101 (54.59%) Big Data
2 62 (33.51%) Hadoop
3 46 (24.86%) Data Warehouse
4 45 (24.32%) Data Lake
5 28 (15.14%) Elasticsearch
6 26 (14.05%) NoSQL
7 23 (12.43%) Redis
7 23 (12.43%) Scylla
8 21 (11.35%) SQL Server
9 19 (10.27%) Power BI
10 15 (8.11%) Amazon Redshift
10 15 (8.11%) Flink
10 15 (8.11%) Relational Database
11 14 (7.57%) BigQuery
12 11 (5.95%) MySQL
13 10 (5.41%) Data Mining
13 10 (5.41%) PostgreSQL
14 8 (4.32%) Apache Hive
14 8 (4.32%) Delta Lake
14 8 (4.32%) Spark SQL
Development Applications
1 14 (7.57%) Jenkins
2 12 (6.49%) Git
3 9 (4.86%) Spinnaker
4 6 (3.24%) Oracle Forms
5 5 (2.70%) JIRA
6 4 (2.16%) Bitbucket
7 3 (1.62%) Deequ
7 3 (1.62%) Octopus Deploy
8 2 (1.08%) MLflow
General
1 56 (30.27%) Social Skills
2 38 (20.54%) Finance
3 29 (15.68%) Analytical Skills
4 24 (12.97%) Inclusion and Diversity
5 19 (10.27%) Banking
5 19 (10.27%) Games
6 6 (3.24%) Retail
7 4 (2.16%) Influencing Skills
7 4 (2.16%) Music Industry
7 4 (2.16%) Presentation Skills
8 3 (1.62%) Legal
8 3 (1.62%) Manufacturing
9 2 (1.08%) Advertising
9 2 (1.08%) French Language
9 2 (1.08%) Marketing
9 2 (1.08%) Spanish Language
10 1 (0.54%) Automotive
10 1 (0.54%) Telecoms
Job Titles
1 60 (32.43%) Data Engineer
2 55 (29.73%) Senior
3 44 (23.78%) Software Engineer
4 28 (15.14%) Principal Engineer
5 25 (13.51%) Principal Software Engineer
6 24 (12.97%) Senior Data Engineer
7 20 (10.81%) Data Manager
8 17 (9.19%) Lead
9 16 (8.65%) Cloud Engineer
10 15 (8.11%) Architect
10 15 (8.11%) Python Data Engineer
10 15 (8.11%) Python Engineer
11 13 (7.03%) Data Architect
12 12 (6.49%) Developer
13 11 (5.95%) Engineering Manager
13 11 (5.95%) Senior Software Engineer
14 10 (5.41%) Big Data Manager
15 9 (4.86%) Big Data Architect
15 9 (4.86%) Lead Data Engineer
16 7 (3.78%) Cloud Software Engineer
Libraries, Frameworks & Software Standards
1 81 (43.78%) Kafka
2 23 (12.43%) GraphQL
3 19 (10.27%) PySpark
4 16 (8.65%) Apache Beam
5 9 (4.86%) React
6 6 (3.24%) Pandas
7 5 (2.70%) Spring
7 5 (2.70%) Spring Boot
8 3 (1.62%) .NET
8 3 (1.62%) Apache NiFi
8 3 (1.62%) Great Expectations
8 3 (1.62%) JSON
9 2 (1.08%) ActiveMQ
9 2 (1.08%) Apache Camel
9 2 (1.08%) FastAPI
9 2 (1.08%) Flask
9 2 (1.08%) Lucene
9 2 (1.08%) REST
9 2 (1.08%) Spark Streaming
9 2 (1.08%) XML
Miscellaneous
1 44 (23.78%) Data Structures
2 37 (20.00%) Algorithms
3 13 (7.03%) Cloud Native
4 9 (4.86%) Product Ownership
5 8 (4.32%) Greenfield Project
6 5 (2.70%) Mainframe
7 4 (2.16%) Distributed Systems
7 4 (2.16%) Renewable Energy
8 3 (1.62%) Credit Risk
9 2 (1.08%) Cyberattack
9 2 (1.08%) Data Centre
9 2 (1.08%) Distributed Computing
9 2 (1.08%) Social Media
9 2 (1.08%) Taxonomies
9 2 (1.08%) Virtual Team
10 1 (0.54%) IoT
10 1 (0.54%) Mobile Payment
10 1 (0.54%) Virtual Reality
Operating Systems
1 4 (2.16%) Linux
Processes & Methodologies
1 67 (36.22%) Data Pipeline
2 61 (32.97%) Data Engineering
3 56 (30.27%) Software Engineering
4 53 (28.65%) Data Science
5 49 (26.49%) Agile
6 46 (24.86%) Data Modelling
7 44 (23.78%) Problem-Solving
8 39 (21.08%) Analytics
8 39 (21.08%) CI/CD
9 34 (18.38%) ETL
10 33 (17.84%) Machine Learning
11 32 (17.30%) High Availability
12 29 (15.68%) Stakeholder Management
13 27 (14.59%) Business Intelligence
14 25 (13.51%) Cybersecurity
14 25 (13.51%) Data Management
14 25 (13.51%) User Experience
15 24 (12.97%) DevOps
15 24 (12.97%) Technical Leadership
16 23 (12.43%) Threat Intelligence
Programming Languages
1 120 (64.86%) Python
2 85 (45.95%) SQL
3 67 (36.22%) Java
4 57 (30.81%) Scala
5 36 (19.46%) Go
6 23 (12.43%) Bash
7 12 (6.49%) Kotlin
8 11 (5.95%) TypeScript
9 9 (4.86%) C#
9 9 (4.86%) R
10 7 (3.78%) Clojure
10 7 (3.78%) Data Analysis Expressions
11 5 (2.70%) C
12 2 (1.08%) JavaScript
12 2 (1.08%) PHP
12 2 (1.08%) XPath
13 1 (0.54%) PL/SQL
Qualifications
1 22 (11.89%) Degree
2 7 (3.78%) Security Cleared
3 5 (2.70%) DV Cleared
4 4 (2.16%) CIMA
4 4 (2.16%) DBS Check
4 4 (2.16%) SC Cleared
5 3 (1.62%) ISTQB
6 2 (1.08%) Master's Degree
6 2 (1.08%) Microsoft Certification
7 1 (0.54%) Computer Science Degree
Quality Assurance & Compliance
1 17 (9.19%) Data Quality
2 4 (2.16%) QA
2 4 (2.16%) Solvency II
3 3 (1.62%) CRD IV
3 3 (1.62%) IFRS
3 3 (1.62%) IFRS 9
4 2 (1.08%) GDPR
5 1 (0.54%) Accessibility
System Software
1 15 (8.11%) Docker
2 2 (1.08%) Apache Flume
3 1 (0.54%) HDFS
Systems Management
1 66 (35.68%) Kubernetes
2 17 (9.19%) Terraform
3 3 (1.62%) Kibana
4 2 (1.08%) Ansible
4 2 (1.08%) Argo
4 2 (1.08%) Progress Chef
Vendors
1 64 (34.59%) Databricks
2 39 (21.08%) Google
3 23 (12.43%) Dell
4 17 (9.19%) Microsoft
5 13 (7.03%) Teradata
6 10 (5.41%) Oracle
7 8 (4.32%) YouTube
8 7 (3.78%) Confluent
9 4 (2.16%) SAP
10 3 (1.62%) Cloudera
10 3 (1.62%) SnapLogic
11 2 (1.08%) Apple
11 2 (1.08%) CrowdStrike
11 2 (1.08%) Hootsuite
11 2 (1.08%) Hortonworks
11 2 (1.08%) Informatica
11 2 (1.08%) Talend