Apache Spark Contracts

Apache Spark
UK

The table below provides summary statistics for contract job vacancies requiring Apache Spark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Apache Spark over the 6 months leading up to 30 April 2025, comparing them to the same period in the previous two years.

6 months to
30 Apr 2025
Same period 2024 Same period 2023
Rank 240 387 353
Rank change year-on-year +147 -34 -123
Contract jobs citing Apache Spark 328 217 410
As % of all contract jobs advertised in the UK 1.12% 0.50% 0.69%
As % of the Application Platforms category 9.92% 5.19% 6.25%
Number of daily rates quoted 224 154 268
10th Percentile £400 £377 £475
25th Percentile £472 £433 £513
Median daily rate (50th Percentile) £575 £510 £600
Median % change year-on-year +12.75% -15.00% -
75th Percentile £675 £644 £738
90th Percentile £838 £775 £788
UK excluding London median daily rate £550 £450 £550
% change year-on-year +22.22% -18.18% +0.32%
Number of hourly rates quoted 3 3 5
10th Percentile - £22.93 -
25th Percentile £51.25 £24.74 £70.50
Median hourly rate £52.50 £30.50 £78.00
Median % change year-on-year +72.13% -60.90% -0.95%
75th Percentile £66.23 £51.00 -
90th Percentile £73.71 £61.65 -
UK excluding London median hourly rate £78.70 £30.50 £78.00
% change year-on-year +158.03% -60.90% -

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring application platform skills.

Contract vacancies with a requirement for application platform skills 3,308 4,179 6,556
As % of all contract IT jobs advertised in the UK 11.31% 9.59% 10.98%
Number of daily rates quoted 2,205 2,874 4,603
10th Percentile £275 £250 £263
25th Percentile £400 £363 £400
Median daily rate (50th Percentile) £500 £500 £513
Median % change year-on-year - -2.44% -0.97%
75th Percentile £600 £600 £638
90th Percentile £713 £750 £750
UK excluding London median daily rate £453 £450 £475
% change year-on-year +0.72% -5.26% +5.56%
Number of hourly rates quoted 79 161 147
10th Percentile £16.65 £13.00 £15.50
25th Percentile £22.25 £15.42 £18.50
Median hourly rate £41.00 £27.52 £40.00
Median % change year-on-year +49.01% -31.21% +81.82%
75th Percentile £64.13 £46.18 £66.00
90th Percentile £75.50 £68.00 £78.48
UK excluding London median hourly rate £46.18 £23.75 £26.24
% change year-on-year +94.44% -9.49% +41.84%

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Apache Spark.

Daily rate trend for Apache Spark in the UK

Apache Spark
Daily Rate Histogram

Daily rate distribution for jobs citing Apache Spark over the 6 months to 30 April 2025.

Daily rate histogram for Apache Spark in the UK

Apache Spark
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Apache Spark.

Hourly rate trend for Apache Spark in the UK

Apache Spark
Hourly Rate Histogram

Hourly rate distribution of jobs citing Apache Spark over the 6 months to 30 April 2025.

Hourly rate histogram for Apache Spark in the UK

Apache Spark
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the UK over the 6 months to 30 April 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +156 302 £600 +14.29% 346
London +102 205 £600 +9.09% 250
Work from Home +87 109 £600 +20.00% 182
UK excluding London +74 85 £550 +22.22% 104
North of England +33 25 £550 +7.84% 29
South East +57 20 £550 +46.67% 20
East of England +40 14 £650 +83.10% 9
Yorkshire +22 12 £600 +41.18% 11
Midlands +22 11 £389 -8.47% 18
North West +8 11 £528 +3.43% 15
East Midlands +11 10 £389 -11.09% 6
Northern Ireland -6 7 £410 -16.96% 2
South West +50 6 £613 +15.02% 14
Scotland -1 3 £469 +17.19% 13
North East +1 2 £525 - 3
West Midlands +13 1 - - 11

Apache Spark
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 119 (36.28%) Apache
2 54 (16.46%) Apache Airflow
3 10 (3.05%) nginx
4 7 (2.13%) Jupyter
5 2 (0.61%) Confluence
5 2 (0.61%) Oracle SOA Suite
6 1 (0.30%) Apache Pulsar
6 1 (0.30%) Luigi
6 1 (0.30%) Tomcat
Applications
1 4 (1.22%) Microsoft Excel
2 2 (0.61%) Microsoft Project
3 1 (0.30%) Microsoft Office
3 1 (0.30%) Microsoft PowerPoint
Business Applications
1 2 (0.61%) Dynamics CRM
Cloud Services
1 141 (42.99%) AWS
2 110 (33.54%) Azure
3 51 (15.55%) Serverless
4 49 (14.94%) AWS Lambda
5 48 (14.63%) GCP
6 42 (12.80%) Amazon S3
7 37 (11.28%) dbt
8 35 (10.67%) OpenShift
9 32 (9.76%) Power Platform
10 29 (8.84%) Amazon ECS
11 26 (7.93%) Azure Data Factory
12 25 (7.62%) Azure DevOps
13 21 (6.40%) Snowflake
14 17 (5.18%) AWS CloudFormation
15 15 (4.57%) Amazon EMR
16 14 (4.27%) Amazon EC2
17 12 (3.66%) GitHub
18 10 (3.05%) Amazon Kinesis
19 9 (2.74%) Amazon CloudWatch
19 9 (2.74%) Azure Synapse Analytics
Communications & Networking
1 6 (1.83%) SSH
2 5 (1.52%) Firewall
2 5 (1.52%) HTTP
2 5 (1.52%) Reverse Proxy
2 5 (1.52%) TCP/IP
3 2 (0.61%) Kerberos
4 1 (0.30%) VPN
4 1 (0.30%) Wireless
Database & Business Intelligence
1 155 (47.26%) Big Data
2 130 (39.63%) Hadoop
3 54 (16.46%) Apache Hive
4 41 (12.50%) Data Warehouse
5 36 (10.98%) Data Lake
6 35 (10.67%) Apache Iceberg
7 33 (10.06%) Amazon Athena
8 32 (9.76%) Power BI
9 31 (9.45%) Tableau
10 28 (8.54%) Apache Arrow
10 28 (8.54%) Apache Ignite
10 28 (8.54%) Dremio
11 27 (8.23%) PostgreSQL
12 26 (7.93%) Delta Lake
12 26 (7.93%) Flink
12 26 (7.93%) Relational Database
13 23 (7.01%) NoSQL
14 19 (5.79%) Impala
15 18 (5.49%) BigQuery
15 18 (5.49%) MongoDB
Development Applications
1 40 (12.20%) Git
2 31 (9.45%) Artifactory
3 25 (7.62%) Jenkins
4 15 (4.57%) JIRA
5 14 (4.27%) GitLab
6 6 (1.83%) RStudio
7 5 (1.52%) MLflow
7 5 (1.52%) Poetry
7 5 (1.52%) TeamCity
8 4 (1.22%) Cucumber
9 3 (0.91%) Atlassian Bamboo
9 3 (0.91%) git-flow
9 3 (0.91%) Gradle
10 2 (0.61%) Jaeger
10 2 (0.61%) JUnit
11 1 (0.30%) JMeter
11 1 (0.30%) Locust
11 1 (0.30%) Postman
11 1 (0.30%) ScalaTest
11 1 (0.30%) Subversion
General
1 112 (34.15%) Finance
2 68 (20.73%) Analytical Skills
3 59 (17.99%) Social Skills
4 56 (17.07%) Banking
5 39 (11.89%) Front Office
6 21 (6.40%) Investment Banking
7 16 (4.88%) Financial Institution
7 16 (4.88%) Marketing
8 11 (3.35%) Public Sector
9 9 (2.74%) Retail
10 6 (1.83%) Inclusion and Diversity
10 6 (1.83%) Presentation Skills
11 2 (0.61%) French Language
11 2 (0.61%) Law
11 2 (0.61%) Wholesale Banking
12 1 (0.30%) Advertising
12 1 (0.30%) Dutch Language
12 1 (0.30%) International Banking
12 1 (0.30%) Manufacturing
12 1 (0.30%) Retail Banking
Job Titles
1 116 (35.37%) Data Engineer
2 58 (17.68%) Developer
3 51 (15.55%) AWS Engineer
3 51 (15.55%) DevOps Engineer
4 48 (14.63%) Senior
5 46 (14.02%) Python Engineer
6 36 (10.98%) AWS DevOps
6 36 (10.98%) AWS DevOps Engineer
7 32 (9.76%) Data Scientist
8 30 (9.15%) Architect
9 27 (8.23%) Java Developer
10 21 (6.40%) Lead
11 19 (5.79%) Senior Developer
12 17 (5.18%) Machine Learning Engineer
12 17 (5.18%) Senior Data Scientist
13 16 (4.88%) Kubernetes Engineer
14 15 (4.57%) Senior Data Engineer
15 14 (4.27%) Data Architect
16 13 (3.96%) Apache Spark Developer
16 13 (3.96%) Java Engineer
Libraries, Frameworks & Software Standards
1 101 (30.79%) Kafka
2 81 (24.70%) PySpark
3 31 (9.45%) TensorFlow
4 29 (8.84%) scikit-learn
5 28 (8.54%) J2EE
6 26 (7.93%) Pandas
7 22 (6.71%) PyTorch
8 21 (6.40%) Spark Streaming
9 18 (5.49%) OpenTelemetry
10 17 (5.18%) JSON
10 17 (5.18%) NumPy
11 15 (4.57%) Matplotlib
11 15 (4.57%) YAML
12 14 (4.27%) Seaborn
13 12 (3.66%) Apache Beam
13 12 (3.66%) Spring
14 11 (3.35%) React
15 8 (2.44%) Apache Avro
15 8 (2.44%) Elastic Stack
15 8 (2.44%) pydantic
Miscellaneous
1 38 (11.59%) Distributed Computing
2 36 (10.98%) Algorithms
3 14 (4.27%) Data Structures
4 13 (3.96%) Distributed Systems
5 12 (3.66%) Multi-touch
6 10 (3.05%) Market Risk
7 9 (2.74%) Cloud Native
8 8 (2.44%) Analytical Mindset
8 8 (2.44%) Linux Command Line
9 7 (2.13%) Credit Risk
9 7 (2.13%) Reference Data
10 5 (1.52%) Greenfield Project
11 4 (1.22%) Equities
11 4 (1.22%) Fixed Income
11 4 (1.22%) IoT
11 4 (1.22%) Tandem
12 3 (0.91%) Management Information System
12 3 (0.91%) Onboarding
12 3 (0.91%) Public Cloud
13 2 (0.61%) Product Ownership
Operating Systems
1 50 (15.24%) Linux
2 21 (6.40%) Red Hat Enterprise Linux
3 11 (3.35%) Unix
4 1 (0.30%) Windows
Processes & Methodologies
1 123 (37.50%) CI/CD
2 110 (33.54%) DevOps
3 104 (31.71%) Machine Learning
4 102 (31.10%) Data Pipeline
5 100 (30.49%) Analytics
6 94 (28.66%) Data Engineering
7 90 (27.44%) Data Science
8 86 (26.22%) Agile
9 84 (25.61%) ETL
10 76 (23.17%) Problem-Solving
11 67 (20.43%) Artificial Intelligence
12 50 (15.24%) Computer Science
13 46 (14.02%) Data Analysis
14 45 (13.72%) Software Engineering
15 43 (13.11%) Data Modelling
15 43 (13.11%) Visualisation
16 41 (12.50%) Data Governance
17 38 (11.59%) Decision-Making
18 36 (10.98%) Infrastructure as Code
18 36 (10.98%) Open Source
Programming Languages
1 235 (71.65%) Python
2 144 (43.90%) SQL
3 108 (32.93%) Java
4 52 (15.85%) Scala
5 34 (10.37%) R
6 28 (8.54%) Go
7 20 (6.10%) JavaScript
8 17 (5.18%) Shell Script
9 16 (4.88%) C++
9 16 (4.88%) TypeScript
10 14 (4.27%) C
11 13 (3.96%) Bash
12 10 (3.05%) PowerShell
13 9 (2.74%) C#
14 8 (2.44%) T-SQL
15 5 (1.52%) Perl
16 4 (1.22%) Data Analysis Expressions
17 2 (0.61%) Bicep
17 2 (0.61%) Kusto Query Language
18 1 (0.30%) Rust
Qualifications
1 54 (16.46%) Degree
2 40 (12.20%) PhD
3 37 (11.28%) Security Cleared
4 32 (9.76%) Master's Degree
5 29 (8.84%) SC Cleared
6 10 (3.05%) Computer Science Degree
7 6 (1.83%) DV Cleared
8 5 (1.52%) AWS Certification
9 4 (1.22%) AWS Certified Solutions Architect
10 3 (0.91%) Azure Certification
11 2 (0.61%) BPSS Clearance
12 1 (0.30%) CSPO
12 1 (0.30%) ISTQB
12 1 (0.30%) Numerate Degree
12 1 (0.30%) PMI Certification
12 1 (0.30%) PMP
12 1 (0.30%) Tableau Certification
Quality Assurance & Compliance
1 57 (17.38%) Data Quality
2 14 (4.27%) GDPR
3 6 (1.83%) QA
4 3 (0.91%) Accessibility
4 3 (0.91%) PCI DSS
5 2 (0.61%) Actionable Recommendations
6 1 (0.30%) California Consumer Privacy Act
6 1 (0.30%) HIPAA
6 1 (0.30%) PMO
System Software
1 67 (20.43%) Docker
2 7 (2.13%) HDFS
3 6 (1.83%) Virtual Machines
4 1 (0.30%) Apache Flume
4 1 (0.30%) Apache ZooKeeper
4 1 (0.30%) Tivoli Workload Scheduler
Systems Management
1 91 (27.74%) Terraform
2 90 (27.44%) Kubernetes
3 28 (8.54%) Ansible
4 26 (7.93%) Grafana
5 16 (4.88%) Argo
6 13 (3.96%) Prometheus
7 3 (0.91%) HAProxy
8 2 (0.61%) Apache Ranger
8 2 (0.61%) Hadoop YARN
8 2 (0.61%) Kubeflow
8 2 (0.61%) Zipkin
9 1 (0.30%) Istio
9 1 (0.30%) Kibana
9 1 (0.30%) Kustomize
9 1 (0.30%) linkerd
9 1 (0.30%) logstash
9 1 (0.30%) Oozie
9 1 (0.30%) Progress Chef
9 1 (0.30%) Puppet
9 1 (0.30%) Tivoli
Vendors
1 63 (19.21%) Databricks
2 20 (6.10%) Microsoft
3 15 (4.57%) Cloudera
3 15 (4.57%) Google
4 13 (3.96%) Oracle
5 7 (2.13%) Palantir
6 6 (1.83%) Talend
7 4 (1.22%) Informatica
7 4 (1.22%) Sybase
8 3 (0.91%) Alteryx
8 3 (0.91%) AppDynamics
8 3 (0.91%) Foundry
8 3 (0.91%) IBM
8 3 (0.91%) Splunk
8 3 (0.91%) StreamSets
9 2 (0.61%) MuleSoft
10 1 (0.30%) CA Agile Central
10 1 (0.30%) Criteo
10 1 (0.30%) Dynatrace
10 1 (0.30%) Virgin Media