Apache Spark Contracts with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for contract job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 16 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
16 May 2024
Same period 2023 Same period 2022
Rank 281 308 180
Rank change year-on-year +27 -128 +21
Contract jobs citing Apache Spark 66 164 686
As % of all contract jobs with a WFH option 0.45% 0.67% 1.56%
As % of the Application Platforms category 4.22% 5.85% 12.58%
Number of daily rates quoted 44 115 495
10th Percentile £400 £480 £450
25th Percentile £463 £529 £513
Median daily rate (50th Percentile) £512 £650 £580
Median % change year-on-year -21.17% +12.07% +5.45%
75th Percentile £607 £750 £694
90th Percentile £725 £788 £800
UK median daily rate £520 £600 £600
% change year-on-year -13.33% - +8.11%
Number of hourly rates quoted 1 0 1
10th Percentile - - -
25th Percentile £66.25 - -
Median hourly rate £67.50 - £78.75
75th Percentile £68.75 - -
90th Percentile - - -
UK median hourly rate £30.50 £78.00 £78.75
% change year-on-year -60.90% -0.95% +191.67%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a WFH option and a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 1,565 2,803 5,451
As % of all contract jobs with a WFH option 10.57% 11.37% 12.40%
Number of daily rates quoted 1,119 1,965 3,956
10th Percentile £300 £313 £315
25th Percentile £400 £413 £413
Median daily rate (50th Percentile) £500 £520 £515
Median % change year-on-year -3.85% +0.97% +8.42%
75th Percentile £625 £639 £619
90th Percentile £825 £750 £700
UK median daily rate £500 £513 £513
% change year-on-year -2.44% - +7.89%
Number of hourly rates quoted 36 71 84
10th Percentile £16.50 £20.00 £15.40
25th Percentile £22.61 £22.27 £20.94
Median hourly rate £30.16 £55.00 £50.00
Median % change year-on-year -45.16% +10.00% +85.32%
75th Percentile £45.41 £66.00 £65.66
90th Percentile £73.75 £81.50 £77.45
UK median hourly rate £29.25 £45.00 £26.17
% change year-on-year -35.00% +71.95% +17.86%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark daily rate for jobs with a WFH option

Apache Spark
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with a work from home option citing Apache Spark over the 6 months to 16 May 2024.

Apache Spark daily rate histogram for jobs with a WFH option

Apache Spark
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark hourly rate for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 12 (18.18%) Apache
2 5 (7.58%) Apache Airflow
Applications
1 1 (1.52%) Microsoft Excel
Business Applications
1 1 (1.52%) Dynamics CRM
Cloud Services
1 39 (59.09%) Azure
2 21 (31.82%) AWS
3 15 (22.73%) GCP
4 9 (13.64%) Azure Data Factory
4 9 (13.64%) Serverless
5 7 (10.61%) Amazon Kinesis
5 7 (10.61%) Azure Synapse Analytics
6 6 (9.09%) Azure Logic Apps
7 5 (7.58%) Amazon S3
8 4 (6.06%) Cloud Computing
9 3 (4.55%) Azure Cosmos DB
9 3 (4.55%) Azure Data Lake Analytics
9 3 (4.55%) Azure Monitor
9 3 (4.55%) GitHub
10 2 (3.03%) Amazon EMR
10 2 (3.03%) AWS Lambda
10 2 (3.03%) Azure DevOps
10 2 (3.03%) Azure Functions
10 2 (3.03%) Azure Sentinel
10 2 (3.03%) Azure Stack
Database & Business Intelligence
1 31 (46.97%) Big Data
2 17 (25.76%) Hadoop
3 16 (24.24%) Data Lake
4 12 (18.18%) Data Warehouse
5 11 (16.67%) Delta Lake
6 9 (13.64%) Flink
7 7 (10.61%) BigQuery
7 7 (10.61%) NoSQL
8 6 (9.09%) Amazon Redshift
9 5 (7.58%) Azure SQL Database
9 5 (7.58%) Relational Database
9 5 (7.58%) Spark SQL
10 4 (6.06%) Amazon Athena
10 4 (6.06%) Tableau
11 3 (4.55%) Amazon RDS
11 3 (4.55%) Apache Hive
11 3 (4.55%) Presto
11 3 (4.55%) SQL Server
12 2 (3.03%) Data Mining
12 2 (3.03%) PostgreSQL
Development Applications
1 6 (9.09%) Git
2 5 (7.58%) Jenkins
3 1 (1.52%) Cypress.io
3 1 (1.52%) Deequ
3 1 (1.52%) GitLab
3 1 (1.52%) Gradle
3 1 (1.52%) JIRA
3 1 (1.52%) RStudio
General
1 18 (27.27%) Finance
2 14 (21.21%) Social Skills
3 9 (13.64%) Analytical Skills
4 4 (6.06%) Marketing
4 4 (6.06%) Public Sector
5 3 (4.55%) Banking
6 2 (3.03%) Czech Language
7 1 (1.52%) Inclusion and Diversity
7 1 (1.52%) Investment Banking
7 1 (1.52%) Legal
7 1 (1.52%) Presentation Skills
7 1 (1.52%) Publishing
Job Titles
1 28 (42.42%) Data Engineer
2 14 (21.21%) Developer
3 12 (18.18%) Senior
4 9 (13.64%) Java Developer
5 7 (10.61%) Azure Engineer
6 6 (9.09%) Architect
6 6 (9.09%) Azure Data Engineer
7 5 (7.58%) Full Stack Developer
7 5 (7.58%) Full Stack Java Developer
7 5 (7.58%) Senior Data Engineer
8 4 (6.06%) Analyst
8 4 (6.06%) Data Analyst
8 4 (6.06%) Lead
8 4 (6.06%) Lead Data Engineer
8 4 (6.06%) Software Engineer
8 4 (6.06%) Solutions Architect
9 3 (4.55%) Data Scientist
9 3 (4.55%) Senior Analyst
9 3 (4.55%) Senior Data Analyst
10 2 (3.03%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 27 (40.91%) Kafka
2 17 (25.76%) PySpark
3 5 (7.58%) Spark Streaming
3 5 (7.58%) Spring Boot
4 4 (6.06%) Elastic Stack
4 4 (6.06%) Pandas
4 4 (6.06%) RESTful
4 4 (6.06%) Spring
5 3 (4.55%) OpenTracing
6 2 (3.03%) ADO
6 2 (3.03%) Apache Avro
6 2 (3.03%) JSON
6 2 (3.03%) JSON Schema
6 2 (3.03%) TensorFlow
6 2 (3.03%) Web Services
7 1 (1.52%) .NET
7 1 (1.52%) Middleware
7 1 (1.52%) pytest
7 1 (1.52%) RabbitMQ
7 1 (1.52%) REST
Miscellaneous
1 4 (6.06%) Data Structures
1 4 (6.06%) Distributed Systems
2 3 (4.55%) Algorithms
2 3 (4.55%) Multi-touch
2 3 (4.55%) Self-Motivation
3 2 (3.03%) Hedge funds
4 1 (1.52%) Cloud Native
4 1 (1.52%) Enterprise Software
4 1 (1.52%) Mobile App
4 1 (1.52%) NHS
Operating Systems
1 4 (6.06%) Linux
2 1 (1.52%) Unix
Processes & Methodologies
1 28 (42.42%) Analytics
2 24 (36.36%) Data Pipeline
2 24 (36.36%) ETL
3 21 (31.82%) Agile
3 21 (31.82%) Data Engineering
4 20 (30.30%) CI/CD
5 19 (28.79%) DevOps
6 16 (24.24%) Continuous Integration
7 14 (21.21%) Data Modelling
8 13 (19.70%) Machine Learning
9 12 (18.18%) Data Science
9 12 (18.18%) Software Engineering
10 11 (16.67%) Data Analysis
11 9 (13.64%) Business Intelligence
11 9 (13.64%) Computer Science
12 8 (12.12%) Data Integration
12 8 (12.12%) SDLC
12 8 (12.12%) Test Automation
12 8 (12.12%) Visualisation
13 7 (10.61%) Containerisation
Programming Languages
1 43 (65.15%) Python
2 39 (59.09%) SQL
3 29 (43.94%) Java
4 15 (22.73%) Scala
5 6 (9.09%) R
6 3 (4.55%) C#
6 3 (4.55%) C++
6 3 (4.55%) Kotlin
7 2 (3.03%) Bash
7 2 (3.03%) Perl
7 2 (3.03%) T-SQL
8 1 (1.52%) Bicep
8 1 (1.52%) JavaScript
Qualifications
1 9 (13.64%) Security Cleared
2 8 (12.12%) SC Cleared
3 6 (9.09%) Degree
4 3 (4.55%) Azure Certification
5 2 (3.03%) BPSS Clearance
5 2 (3.03%) Computer Science Degree
5 2 (3.03%) Microsoft Certification
5 2 (3.03%) PhD
6 1 (1.52%) DV Cleared
6 1 (1.52%) Numerate Degree
Quality Assurance & Compliance
1 8 (12.12%) Data Quality
2 1 (1.52%) Accessibility
2 1 (1.52%) QA
System Software
1 7 (10.61%) Docker
2 1 (1.52%) HDFS
Systems Management
1 9 (13.64%) Kubernetes
2 7 (10.61%) Terraform
3 3 (4.55%) Prometheus
3 3 (4.55%) Zipkin
4 1 (1.52%) Ansible
4 1 (1.52%) Hadoop YARN
4 1 (1.52%) Oozie
4 1 (1.52%) Puppet
Vendors
1 20 (30.30%) Databricks
2 11 (16.67%) Microsoft
3 6 (9.09%) Google
4 3 (4.55%) Splunk
4 3 (4.55%) Teradata
5 2 (3.03%) Oracle
6 1 (1.52%) Bloomberg
6 1 (1.52%) Informatica
6 1 (1.52%) Sage