Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 406 208 319
Rank change year-on-year -198 +111 -43
Permanent jobs citing Apache Spark 194 730 748
As % of all permanent jobs with a WFH option 0.57% 1.69% 1.12%
As % of the Application Platforms category 4.90% 13.57% 8.36%
Number of salaries quoted 147 300 464
10th Percentile £50,172 £57,500 £50,000
25th Percentile £61,180 £65,000 £60,625
Median annual salary (50th Percentile) £80,000 £100,000 £80,000
Median % change year-on-year -20.00% +25.00% +3.23%
75th Percentile £110,000 £130,000 £95,000
90th Percentile £111,750 £160,000 £115,000
UK median annual salary £80,000 £87,500 £77,500
% change year-on-year -8.57% +12.90% +6.16%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,957 5,380 8,949
As % of all permanent jobs with a WFH option 11.73% 12.47% 13.40%
Number of salaries quoted 2,798 3,833 5,293
10th Percentile £31,250 £32,500 £31,250
25th Percentile £40,000 £43,750 £41,185
Median annual salary (50th Percentile) £55,000 £60,000 £55,000
Median % change year-on-year -8.33% +9.09% +4.76%
75th Percentile £75,772 £79,500 £75,000
90th Percentile £107,500 £100,000 £92,500
UK median annual salary £50,000 £55,000 £54,000
% change year-on-year -9.09% +1.85% +2.86%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 27 April 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 65 (33.51%) Apache
2 23 (11.86%) Apache Airflow
3 6 (3.09%) SAS
4 5 (2.58%) Confluence
5 2 (1.03%) Apache Solr
5 2 (1.03%) Jupyter
Applications
1 7 (3.61%) Microsoft Excel
Business Applications
1 4 (2.06%) Primavera
Cloud Services
1 88 (45.36%) AWS
2 74 (38.14%) Azure
3 69 (35.57%) GCP
4 37 (19.07%) Amazon S3
5 30 (15.46%) SaaS
6 26 (13.40%) Power Platform
7 24 (12.37%) Amazon SQS
8 23 (11.86%) Google Docs
8 23 (11.86%) Lucidchart
8 23 (11.86%) Miro
8 23 (11.86%) Slack
8 23 (11.86%) Snowflake
9 20 (10.31%) GitHub
10 17 (8.76%) Azure Data Factory
11 16 (8.25%) dbt
12 13 (6.70%) Azure Synapse Analytics
13 10 (5.15%) Serverless
14 9 (4.64%) Azure DevOps
15 8 (4.12%) GitHub Actions
15 8 (4.12%) Vertex AI
Communications & Networking
1 22 (11.34%) Wireless
2 8 (4.12%) Firewall
3 2 (1.03%) HTTP
3 2 (1.03%) Network Security
Database & Business Intelligence
1 112 (57.73%) Big Data
2 64 (32.99%) Hadoop
3 57 (29.38%) Data Lake
4 48 (24.74%) Data Warehouse
5 35 (18.04%) NoSQL
6 28 (14.43%) Elasticsearch
7 26 (13.40%) Power BI
8 23 (11.86%) Redis
8 23 (11.86%) Relational Database
8 23 (11.86%) Scylla
9 22 (11.34%) BigQuery
10 20 (10.31%) SQL Server
11 19 (9.79%) MySQL
12 18 (9.28%) PostgreSQL
13 16 (8.25%) Flink
14 15 (7.73%) Amazon Redshift
14 15 (7.73%) Tableau
15 14 (7.22%) Looker
16 10 (5.15%) Data Mining
17 8 (4.12%) Bigtable
Development Applications
1 23 (11.86%) Jenkins
2 12 (6.19%) Git
3 10 (5.15%) Spinnaker
4 6 (3.09%) Oracle Forms
5 5 (2.58%) JIRA
6 4 (2.06%) Bitbucket
7 3 (1.55%) Deequ
7 3 (1.55%) Octopus Deploy
8 2 (1.03%) MLflow
9 1 (0.52%) JUnit
General
1 60 (30.93%) Social Skills
2 50 (25.77%) Finance
3 35 (18.04%) Analytical Skills
4 31 (15.98%) Banking
5 25 (12.89%) Inclusion and Diversity
6 19 (9.79%) Games
7 18 (9.28%) Retail
8 8 (4.12%) Influencing Skills
9 7 (3.61%) Presentation Skills
10 4 (2.06%) Music Industry
11 3 (1.55%) Legal
11 3 (1.55%) Manufacturing
12 2 (1.03%) Advertising
12 2 (1.03%) French Language
12 2 (1.03%) Marketing
12 2 (1.03%) Spanish Language
13 1 (0.52%) Automotive
13 1 (0.52%) Telecoms
Job Titles
1 58 (29.90%) Data Engineer
2 55 (28.35%) Senior
3 42 (21.65%) Software Engineer
4 28 (14.43%) Principal Engineer
5 25 (12.89%) Principal Software Engineer
6 24 (12.37%) Senior Data Engineer
7 22 (11.34%) Data Manager
7 22 (11.34%) Lead
8 17 (8.76%) Architect
8 17 (8.76%) Cloud Engineer
9 15 (7.73%) Data Architect
9 15 (7.73%) Python Data Engineer
9 15 (7.73%) Python Engineer
10 12 (6.19%) Big Data Manager
10 12 (6.19%) Developer
11 11 (5.67%) Big Data Architect
11 11 (5.67%) Engineering Manager
12 10 (5.15%) Head of Engineering
12 10 (5.15%) Lead Data Engineer
13 9 (4.64%) Analyst
Libraries, Frameworks & Software Standards
1 86 (44.33%) Kafka
2 23 (11.86%) GraphQL
3 19 (9.79%) PySpark
4 16 (8.25%) Apache Beam
5 5 (2.58%) Pandas
5 5 (2.58%) React
5 5 (2.58%) Spring
5 5 (2.58%) Spring Boot
6 3 (1.55%) .NET
6 3 (1.55%) Apache NiFi
6 3 (1.55%) Great Expectations
6 3 (1.55%) JSON
7 2 (1.03%) ActiveMQ
7 2 (1.03%) Apache Camel
7 2 (1.03%) FastAPI
7 2 (1.03%) Flask
7 2 (1.03%) Lucene
7 2 (1.03%) Regular Expression
7 2 (1.03%) Spark Streaming
7 2 (1.03%) XML
Miscellaneous
1 41 (21.13%) Data Structures
2 36 (18.56%) Algorithms
3 14 (7.22%) Cloud Native
4 9 (4.64%) Product Ownership
5 8 (4.12%) Greenfield Project
6 6 (3.09%) Credit Risk
7 5 (2.58%) Distributed Systems
7 5 (2.58%) Mainframe
8 2 (1.03%) Cyberattack
8 2 (1.03%) Data Centre
8 2 (1.03%) Distributed Computing
8 2 (1.03%) Social Media
8 2 (1.03%) Taxonomies
8 2 (1.03%) Virtual Team
9 1 (0.52%) Distributed Architecture
9 1 (0.52%) IoT
9 1 (0.52%) Mobile Payment
9 1 (0.52%) Renewable Energy
9 1 (0.52%) Self-Motivation
9 1 (0.52%) Virtual Reality
Operating Systems
1 2 (1.03%) Linux
Processes & Methodologies
1 70 (36.08%) Data Pipeline
2 68 (35.05%) Data Engineering
3 62 (31.96%) Agile
4 52 (26.80%) Data Science
4 52 (26.80%) Software Engineering
5 49 (25.26%) Analytics
5 49 (25.26%) CI/CD
6 45 (23.20%) Problem-Solving
7 44 (22.68%) Data Modelling
8 43 (22.16%) ETL
9 40 (20.62%) Machine Learning
10 34 (17.53%) Business Intelligence
11 33 (17.01%) Stakeholder Management
12 32 (16.49%) High Availability
13 28 (14.43%) Technical Leadership
14 26 (13.40%) Artificial Intelligence
14 26 (13.40%) Cybersecurity
14 26 (13.40%) Data Integration
14 26 (13.40%) Data Management
15 25 (12.89%) DevOps
Programming Languages
1 120 (61.86%) Python
2 81 (41.75%) SQL
3 65 (33.51%) Java
4 55 (28.35%) Scala
5 37 (19.07%) Go
6 24 (12.37%) Bash
7 13 (6.70%) R
8 9 (4.64%) C#
9 8 (4.12%) Kotlin
10 7 (3.61%) Data Analysis Expressions
10 7 (3.61%) TypeScript
11 4 (2.06%) C
12 3 (1.55%) Clojure
13 2 (1.03%) PHP
13 2 (1.03%) XPath
14 1 (0.52%) JavaScript
14 1 (0.52%) PL/SQL
Qualifications
1 25 (12.89%) Degree
2 6 (3.09%) Security Cleared
3 4 (2.06%) CIMA
3 4 (2.06%) DV Cleared
3 4 (2.06%) SC Cleared
4 3 (1.55%) ISTQB
5 2 (1.03%) Master's Degree
5 2 (1.03%) Microsoft Certification
6 1 (0.52%) Computer Science Degree
6 1 (0.52%) DBS Check
Quality Assurance & Compliance
1 14 (7.22%) Data Quality
2 6 (3.09%) CRD IV
2 6 (3.09%) IFRS
2 6 (3.09%) IFRS 9
3 4 (2.06%) QA
3 4 (2.06%) Solvency II
4 2 (1.03%) GDPR
5 1 (0.52%) Accessibility
System Software
1 15 (7.73%) Docker
2 2 (1.03%) Apache Flume
3 1 (0.52%) HDFS
Systems Management
1 63 (32.47%) Kubernetes
2 25 (12.89%) Terraform
3 3 (1.55%) Kibana
4 2 (1.03%) Ansible
4 2 (1.03%) Argo
4 2 (1.03%) Progress Chef
5 1 (0.52%) Rancher
Vendors
1 64 (32.99%) Databricks
2 48 (24.74%) Google
3 24 (12.37%) Dell
4 17 (8.76%) Microsoft
5 13 (6.70%) Teradata
6 10 (5.15%) Oracle
7 8 (4.12%) Confluent
7 8 (4.12%) YouTube
8 4 (2.06%) SAP
9 3 (1.55%) Cloudera
9 3 (1.55%) SnapLogic
10 2 (1.03%) Apple
10 2 (1.03%) CrowdStrike
10 2 (1.03%) Hootsuite
10 2 (1.03%) Hortonworks
10 2 (1.03%) Informatica
10 2 (1.03%) Talend
11 1 (0.52%) StreamSets