Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 14 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
14 May 2024
Same period 2023 Same period 2022
Rank 408 198 308
Rank change year-on-year -210 +110 -27
Permanent jobs citing Apache Spark 189 727 830
As % of all permanent jobs with a WFH option 0.56% 1.77% 1.19%
As % of the Application Platforms category 4.74% 14.42% 8.74%
Number of salaries quoted 147 299 482
10th Percentile £50,172 £57,500 £50,000
25th Percentile £61,180 £65,000 £60,625
Median annual salary (50th Percentile) £80,000 £100,000 £80,000
Median % change year-on-year -20.00% +25.00% +3.23%
75th Percentile £110,000 £130,000 £95,000
90th Percentile £111,750 £160,000 £110,000
UK median annual salary £80,000 £87,500 £77,500
% change year-on-year -8.57% +12.90% +3.33%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 3,989 5,043 9,493
As % of all permanent jobs with a WFH option 11.85% 12.31% 13.59%
Number of salaries quoted 2,842 3,666 5,286
10th Percentile £31,250 £32,500 £31,250
25th Percentile £40,800 £44,313 £41,250
Median annual salary (50th Percentile) £55,000 £60,000 £55,000
Median % change year-on-year -8.33% +9.09% +4.76%
75th Percentile £76,000 £79,313 £75,000
90th Percentile £114,750 £100,000 £92,500
UK median annual salary £50,000 £55,000 £54,550
% change year-on-year -9.09% +0.82% +3.90%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 14 May 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 56 (29.63%) Apache
2 23 (12.17%) Apache Airflow
3 6 (3.17%) SAS
4 5 (2.65%) Confluence
5 2 (1.06%) Apache Solr
5 2 (1.06%) Jupyter
Applications
1 7 (3.70%) Microsoft Excel
Business Applications
1 4 (2.12%) Primavera
Cloud Services
1 91 (48.15%) AWS
2 71 (37.57%) Azure
3 59 (31.22%) GCP
4 37 (19.58%) Amazon S3
5 30 (15.87%) SaaS
6 24 (12.70%) Amazon SQS
7 23 (12.17%) Google Docs
7 23 (12.17%) Lucidchart
7 23 (12.17%) Miro
7 23 (12.17%) Slack
7 23 (12.17%) Snowflake
8 19 (10.05%) Power Platform
9 16 (8.47%) Azure Data Factory
9 16 (8.47%) dbt
10 12 (6.35%) Azure Synapse Analytics
11 11 (5.82%) GitHub
12 10 (5.29%) Serverless
13 9 (4.76%) Azure DevOps
14 8 (4.23%) Amazon EMR
15 7 (3.70%) PowerApps
Communications & Networking
1 18 (9.52%) Wireless
2 7 (3.70%) Firewall
3 2 (1.06%) HTTP
3 2 (1.06%) Network Security
Database & Business Intelligence
1 102 (53.97%) Big Data
2 63 (33.33%) Hadoop
3 47 (24.87%) Data Warehouse
4 45 (23.81%) Data Lake
5 28 (14.81%) Elasticsearch
6 27 (14.29%) NoSQL
7 23 (12.17%) Redis
7 23 (12.17%) Scylla
8 21 (11.11%) SQL Server
9 19 (10.05%) Power BI
10 16 (8.47%) Flink
11 15 (7.94%) Amazon Redshift
11 15 (7.94%) Relational Database
12 14 (7.41%) BigQuery
13 11 (5.82%) MySQL
14 10 (5.29%) Data Mining
14 10 (5.29%) PostgreSQL
15 8 (4.23%) Apache Hive
15 8 (4.23%) Delta Lake
15 8 (4.23%) Spark SQL
Development Applications
1 14 (7.41%) Jenkins
2 12 (6.35%) Git
3 9 (4.76%) Spinnaker
4 6 (3.17%) Oracle Forms
5 5 (2.65%) JIRA
6 4 (2.12%) Bitbucket
7 3 (1.59%) Deequ
7 3 (1.59%) Octopus Deploy
8 2 (1.06%) MLflow
9 1 (0.53%) JUnit
General
1 59 (31.22%) Social Skills
2 41 (21.69%) Finance
3 32 (16.93%) Analytical Skills
4 25 (13.23%) Inclusion and Diversity
5 22 (11.64%) Banking
6 19 (10.05%) Games
7 9 (4.76%) Retail
8 7 (3.70%) Presentation Skills
9 4 (2.12%) Influencing Skills
9 4 (2.12%) Music Industry
10 3 (1.59%) Legal
10 3 (1.59%) Manufacturing
11 2 (1.06%) Advertising
11 2 (1.06%) French Language
11 2 (1.06%) Marketing
11 2 (1.06%) Spanish Language
12 1 (0.53%) Automotive
12 1 (0.53%) Telecoms
Job Titles
1 60 (31.75%) Data Engineer
2 58 (30.69%) Senior
3 45 (23.81%) Software Engineer
4 29 (15.34%) Principal Engineer
5 26 (13.76%) Principal Software Engineer
6 24 (12.70%) Senior Data Engineer
7 20 (10.58%) Data Manager
8 17 (8.99%) Lead
9 16 (8.47%) Cloud Engineer
10 15 (7.94%) Architect
10 15 (7.94%) Python Data Engineer
10 15 (7.94%) Python Engineer
11 13 (6.88%) Data Architect
12 12 (6.35%) Developer
13 11 (5.82%) Engineering Manager
13 11 (5.82%) Senior Software Engineer
14 10 (5.29%) Big Data Manager
15 9 (4.76%) Big Data Architect
15 9 (4.76%) Lead Data Engineer
15 9 (4.76%) Senior Analyst
Libraries, Frameworks & Software Standards
1 82 (43.39%) Kafka
2 23 (12.17%) GraphQL
3 19 (10.05%) PySpark
4 16 (8.47%) Apache Beam
5 9 (4.76%) React
6 6 (3.17%) Pandas
7 5 (2.65%) Spring
7 5 (2.65%) Spring Boot
8 4 (2.12%) Apache NiFi
9 3 (1.59%) .NET
9 3 (1.59%) Great Expectations
9 3 (1.59%) JSON
10 2 (1.06%) Apache Camel
10 2 (1.06%) FastAPI
10 2 (1.06%) Flask
10 2 (1.06%) NumPy
10 2 (1.06%) Regular Expression
10 2 (1.06%) REST
10 2 (1.06%) Spark Streaming
10 2 (1.06%) XML
Miscellaneous
1 44 (23.28%) Data Structures
2 37 (19.58%) Algorithms
3 14 (7.41%) Cloud Native
4 9 (4.76%) Product Ownership
5 8 (4.23%) Greenfield Project
6 6 (3.17%) Credit Risk
7 5 (2.65%) Distributed Systems
7 5 (2.65%) Mainframe
8 4 (2.12%) Renewable Energy
9 2 (1.06%) Cyberattack
9 2 (1.06%) Data Centre
9 2 (1.06%) Distributed Computing
9 2 (1.06%) Social Media
9 2 (1.06%) Taxonomies
9 2 (1.06%) Virtual Team
10 1 (0.53%) IoT
10 1 (0.53%) Mobile Payment
10 1 (0.53%) Virtual Reality
Operating Systems
1 5 (2.65%) Linux
Processes & Methodologies
1 67 (35.45%) Data Pipeline
2 62 (32.80%) Data Engineering
3 57 (30.16%) Software Engineering
4 54 (28.57%) Data Science
5 52 (27.51%) Agile
6 47 (24.87%) Data Modelling
7 44 (23.28%) Problem-Solving
8 40 (21.16%) Analytics
8 40 (21.16%) CI/CD
9 35 (18.52%) ETL
10 34 (17.99%) Machine Learning
11 32 (16.93%) High Availability
12 29 (15.34%) Stakeholder Management
13 27 (14.29%) Business Intelligence
14 26 (13.76%) Cybersecurity
15 25 (13.23%) Data Management
15 25 (13.23%) DevOps
15 25 (13.23%) User Experience
16 24 (12.70%) Technical Leadership
16 24 (12.70%) Threat Intelligence
Programming Languages
1 124 (65.61%) Python
2 85 (44.97%) SQL
3 68 (35.98%) Java
4 58 (30.69%) Scala
5 37 (19.58%) Go
6 24 (12.70%) Bash
7 12 (6.35%) Kotlin
7 12 (6.35%) R
8 11 (5.82%) TypeScript
9 9 (4.76%) C#
10 7 (3.70%) Clojure
10 7 (3.70%) Data Analysis Expressions
11 5 (2.65%) C
12 2 (1.06%) JavaScript
12 2 (1.06%) PHP
12 2 (1.06%) XPath
13 1 (0.53%) PL/SQL
Qualifications
1 25 (13.23%) Degree
2 7 (3.70%) Security Cleared
3 5 (2.65%) DV Cleared
4 4 (2.12%) CIMA
4 4 (2.12%) DBS Check
4 4 (2.12%) SC Cleared
5 3 (1.59%) ISTQB
6 2 (1.06%) Master's Degree
6 2 (1.06%) Microsoft Certification
7 1 (0.53%) Computer Science Degree
Quality Assurance & Compliance
1 17 (8.99%) Data Quality
2 6 (3.17%) CRD IV
2 6 (3.17%) IFRS
2 6 (3.17%) IFRS 9
3 4 (2.12%) QA
3 4 (2.12%) Solvency II
4 2 (1.06%) GDPR
5 1 (0.53%) Accessibility
System Software
1 16 (8.47%) Docker
2 2 (1.06%) Apache Flume
3 1 (0.53%) HDFS
Systems Management
1 67 (35.45%) Kubernetes
2 17 (8.99%) Terraform
3 3 (1.59%) Kibana
4 2 (1.06%) Ansible
4 2 (1.06%) Argo
4 2 (1.06%) Progress Chef
5 1 (0.53%) Rancher
Vendors
1 64 (33.86%) Databricks
2 40 (21.16%) Google
3 24 (12.70%) Dell
4 17 (8.99%) Microsoft
5 13 (6.88%) Teradata
6 10 (5.29%) Oracle
7 8 (4.23%) YouTube
8 7 (3.70%) Confluent
9 4 (2.12%) SAP
10 3 (1.59%) Cloudera
10 3 (1.59%) SnapLogic
11 2 (1.06%) Apple
11 2 (1.06%) CrowdStrike
11 2 (1.06%) Hootsuite
11 2 (1.06%) Hortonworks
11 2 (1.06%) Informatica
11 2 (1.06%) Talend
12 1 (0.53%) StreamSets