Apache Spark Contracts with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for contract job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 9 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
9 May 2024
Same period 2023 Same period 2022
Rank 270 305 181
Rank change year-on-year +35 -124 +7
Contract jobs citing Apache Spark 71 166 680
As % of all contract jobs with a WFH option 0.47% 0.66% 1.55%
As % of the Application Platforms category 4.53% 5.83% 12.56%
Number of daily rates quoted 46 115 485
10th Percentile £400 £480 £450
25th Percentile £463 £535 £513
Median daily rate (50th Percentile) £515 £650 £580
Median % change year-on-year -20.74% +12.07% +4.50%
75th Percentile £620 £750 £688
90th Percentile £729 £788 £800
UK median daily rate £519 £600 £600
% change year-on-year -13.51% - +6.67%
Number of hourly rates quoted 1 0 1
10th Percentile - - -
25th Percentile £66.25 - -
Median hourly rate £67.50 - £78.75
75th Percentile £68.75 - -
90th Percentile - - -
UK median hourly rate £30.50 £78.00 £78.75
% change year-on-year -60.90% -0.95% +205.83%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a WFH option and a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 1,568 2,846 5,413
As % of all contract jobs with a WFH option 10.40% 11.34% 12.34%
Number of daily rates quoted 1,113 1,998 3,913
10th Percentile £300 £313 £315
25th Percentile £400 £413 £413
Median daily rate (50th Percentile) £500 £513 £515
Median % change year-on-year -2.44% -0.49% +8.42%
75th Percentile £613 £638 £618
90th Percentile £800 £750 £700
UK median daily rate £500 £513 £513
% change year-on-year -2.44% - +7.89%
Number of hourly rates quoted 38 71 72
10th Percentile £16.50 £20.00 £14.60
25th Percentile £22.61 £22.16 £18.69
Median hourly rate £30.16 £55.00 £37.50
Median % change year-on-year -45.16% +46.67% +41.51%
75th Percentile £50.47 £66.00 £56.25
90th Percentile £72.25 £81.50 £68.48
UK median hourly rate £27.52 £46.25 £22.50
% change year-on-year -40.51% +105.56% +5.14%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark daily rate for jobs with a WFH option

Apache Spark
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with a work from home option citing Apache Spark over the 6 months to 9 May 2024.

Apache Spark daily rate histogram for jobs with a WFH option

Apache Spark
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark hourly rate for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 12 (16.90%) Apache
2 6 (8.45%) Apache Airflow
Applications
1 1 (1.41%) Microsoft Excel
Business Applications
1 1 (1.41%) Dynamics CRM
Cloud Services
1 39 (54.93%) Azure
2 20 (28.17%) AWS
3 13 (18.31%) GCP
4 9 (12.68%) Azure Data Factory
5 7 (9.86%) Amazon Kinesis
5 7 (9.86%) Azure Synapse Analytics
6 6 (8.45%) Serverless
7 5 (7.04%) Azure Logic Apps
8 3 (4.23%) Amazon EMR
8 3 (4.23%) Amazon S3
8 3 (4.23%) Azure Cosmos DB
8 3 (4.23%) Azure Monitor
8 3 (4.23%) GitHub
9 2 (2.82%) Amazon EC2
9 2 (2.82%) AWS Lambda
9 2 (2.82%) Azure DevOps
9 2 (2.82%) Azure Sentinel
9 2 (2.82%) Azure Stack
9 2 (2.82%) dbt
9 2 (2.82%) PaaS
Database & Business Intelligence
1 33 (46.48%) Big Data
2 14 (19.72%) Hadoop
3 13 (18.31%) Data Lake
4 12 (16.90%) Data Warehouse
5 11 (15.49%) Delta Lake
6 9 (12.68%) Flink
7 7 (9.86%) NoSQL
8 6 (8.45%) Apache Hive
8 6 (8.45%) Spark SQL
9 5 (7.04%) Azure SQL Database
9 5 (7.04%) Relational Database
9 5 (7.04%) Tableau
10 4 (5.63%) BigQuery
11 3 (4.23%) Amazon Redshift
11 3 (4.23%) Impala
11 3 (4.23%) Presto
11 3 (4.23%) SQL Server
12 2 (2.82%) Apache Cassandra
12 2 (2.82%) Data Mining
12 2 (2.82%) PostgreSQL
Development Applications
1 3 (4.23%) Git
2 2 (2.82%) Jenkins
3 1 (1.41%) Cypress.io
3 1 (1.41%) Deequ
3 1 (1.41%) GitLab
3 1 (1.41%) Gradle
3 1 (1.41%) JIRA
3 1 (1.41%) RStudio
General
1 19 (26.76%) Finance
2 15 (21.13%) Social Skills
3 11 (15.49%) Analytical Skills
4 6 (8.45%) Marketing
5 4 (5.63%) Banking
6 3 (4.23%) Investment Banking
6 3 (4.23%) Public Sector
7 2 (2.82%) Czech Language
8 1 (1.41%) Inclusion and Diversity
8 1 (1.41%) Legal
8 1 (1.41%) Presentation Skills
8 1 (1.41%) Publishing
Job Titles
1 29 (40.85%) Data Engineer
2 17 (23.94%) Developer
3 11 (15.49%) Senior
4 9 (12.68%) Azure Engineer
4 9 (12.68%) Java Developer
5 8 (11.27%) Azure Data Engineer
6 5 (7.04%) Data Scientist
6 5 (7.04%) Full Stack Developer
6 5 (7.04%) Full Stack Java Developer
6 5 (7.04%) Software Engineer
7 4 (5.63%) Analyst
7 4 (5.63%) Cloud Engineer
7 4 (5.63%) Data Analyst
7 4 (5.63%) Lead
7 4 (5.63%) Lead Data Engineer
7 4 (5.63%) Python Developer
7 4 (5.63%) Senior Data Engineer
8 3 (4.23%) AWS Engineer
8 3 (4.23%) Python Data Engineer
8 3 (4.23%) Python Engineer
Libraries, Frameworks & Software Standards
1 25 (35.21%) Kafka
2 17 (23.94%) PySpark
3 6 (8.45%) Pandas
4 5 (7.04%) Spark Streaming
4 5 (7.04%) Spring Boot
5 4 (5.63%) Elastic Stack
5 4 (5.63%) RESTful
5 4 (5.63%) Spring
6 3 (4.23%) OpenTracing
7 2 (2.82%) ADO
7 2 (2.82%) Apache Avro
7 2 (2.82%) JSON
7 2 (2.82%) JSON Schema
7 2 (2.82%) TensorFlow
7 2 (2.82%) Web Services
8 1 (1.41%) .NET
8 1 (1.41%) .NET Core
8 1 (1.41%) pytest
8 1 (1.41%) RabbitMQ
8 1 (1.41%) REST
Miscellaneous
1 5 (7.04%) Multi-touch
2 4 (5.63%) Data Structures
2 4 (5.63%) Distributed Systems
3 3 (4.23%) Algorithms
3 3 (4.23%) Self-Motivation
4 2 (2.82%) Data Fabric
4 2 (2.82%) Hedge funds
5 1 (1.41%) Cloud Native
5 1 (1.41%) Enterprise Software
5 1 (1.41%) Greenfield Project
5 1 (1.41%) Mobile App
5 1 (1.41%) NHS
Operating Systems
1 7 (9.86%) Linux
2 4 (5.63%) Unix
Processes & Methodologies
1 28 (39.44%) Data Pipeline
2 26 (36.62%) Analytics
3 22 (30.99%) Data Engineering
3 22 (30.99%) ETL
4 20 (28.17%) Agile
4 20 (28.17%) CI/CD
5 16 (22.54%) Machine Learning
6 15 (21.13%) Continuous Integration
6 15 (21.13%) Data Science
6 15 (21.13%) DevOps
6 15 (21.13%) Software Engineering
7 13 (18.31%) Data Analysis
8 11 (15.49%) Data Modelling
9 9 (12.68%) Computer Science
10 8 (11.27%) Business Intelligence
10 8 (11.27%) SDLC
10 8 (11.27%) Test Automation
10 8 (11.27%) Visualisation
11 7 (9.86%) Data Extraction
11 7 (9.86%) Validation
Programming Languages
1 46 (64.79%) Python
2 41 (57.75%) SQL
3 27 (38.03%) Java
4 20 (28.17%) Scala
5 9 (12.68%) R
6 3 (4.23%) C#
6 3 (4.23%) C++
6 3 (4.23%) Kotlin
7 2 (2.82%) Bash
7 2 (2.82%) Perl
7 2 (2.82%) T-SQL
8 1 (1.41%) Bicep
8 1 (1.41%) JavaScript
Qualifications
1 9 (12.68%) Security Cleared
2 8 (11.27%) SC Cleared
3 7 (9.86%) Degree
4 3 (4.23%) Azure Certification
4 3 (4.23%) PhD
5 2 (2.82%) BPSS Clearance
5 2 (2.82%) Computer Science Degree
5 2 (2.82%) Microsoft Certification
6 1 (1.41%) DV Cleared
6 1 (1.41%) Master's Degree
6 1 (1.41%) Numerate Degree
Quality Assurance & Compliance
1 8 (11.27%) Data Quality
2 1 (1.41%) Accessibility
2 1 (1.41%) QA
System Software
1 7 (9.86%) Docker
2 1 (1.41%) HDFS
Systems Management
1 9 (12.68%) Kubernetes
2 4 (5.63%) Terraform
3 3 (4.23%) Prometheus
3 3 (4.23%) Zipkin
4 1 (1.41%) Ansible
4 1 (1.41%) Hadoop YARN
4 1 (1.41%) Oozie
4 1 (1.41%) Puppet
Vendors
1 20 (28.17%) Databricks
2 8 (11.27%) Microsoft
3 3 (4.23%) Google
3 3 (4.23%) Splunk
3 3 (4.23%) Teradata
4 2 (2.82%) Bloomberg
4 2 (2.82%) Oracle
5 1 (1.41%) Informatica
5 1 (1.41%) Sage