Apache Spark Contracts

Apache Spark
UK

The table below provides summary statistics for contract job vacancies requiring Apache Spark skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Apache Spark over the 6 months leading up to 17 May 2025, comparing them to the same period in the previous two years.

6 months to
17 May 2025
Same period 2024 Same period 2023
Rank 243 373 341
Rank change year-on-year +130 -32 -106
Contract jobs citing Apache Spark 317 217 394
As % of all contract jobs advertised in the UK 1.08% 0.51% 0.69%
As % of the Application Platforms category 9.69% 5.24% 6.34%
Number of daily rates quoted 217 157 260
10th Percentile £400 £387 £474
25th Percentile £463 £438 £513
Median daily rate (50th Percentile) £570 £520 £600
Median % change year-on-year +9.62% -13.33% -
75th Percentile £675 £638 £738
90th Percentile £838 £775 £800
UK excluding London median daily rate £540 £475 £550
% change year-on-year +13.68% -13.64% -
Number of hourly rates quoted 3 3 7
10th Percentile - £22.93 £70.50
25th Percentile £51.25 £24.74 £74.25
Median hourly rate £52.50 £30.50 £78.00
Median % change year-on-year +72.13% -60.90% -0.95%
75th Percentile £66.23 £51.00 £84.00
90th Percentile £73.71 £61.65 £90.00
UK excluding London median hourly rate £78.70 £30.50 £78.00
% change year-on-year +158.03% -60.90% -

All Application Platform Skills
UK

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring application platform skills.

Contract vacancies with a requirement for application platform skills 3,272 4,145 6,216
As % of all contract IT jobs advertised in the UK 11.12% 9.74% 10.91%
Number of daily rates quoted 2,172 2,869 4,362
10th Percentile £278 £258 £263
25th Percentile £400 £363 £400
Median daily rate (50th Percentile) £500 £500 £513
Median % change year-on-year - -2.44% -
75th Percentile £600 £613 £638
90th Percentile £713 £750 £750
UK excluding London median daily rate £450 £450 £475
% change year-on-year - -5.26% +5.56%
Number of hourly rates quoted 69 160 147
10th Percentile £16.26 £13.00 £16.09
25th Percentile £22.50 £15.45 £19.75
Median hourly rate £46.18 £29.25 £45.00
Median % change year-on-year +57.88% -35.00% +71.95%
75th Percentile £64.50 £46.18 £66.00
90th Percentile £77.50 £70.00 £79.19
UK excluding London median hourly rate £52.50 £24.50 £27.50
% change year-on-year +114.29% -10.91% +37.50%

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Apache Spark.

Daily rate trend for Apache Spark in the UK

Apache Spark
Daily Rate Histogram

Daily rate distribution for jobs citing Apache Spark over the 6 months to 17 May 2025.

Daily rate histogram for Apache Spark in the UK

Apache Spark
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Apache Spark.

Hourly rate trend for Apache Spark in the UK

Apache Spark
Hourly Rate Histogram

Hourly rate distribution of jobs citing Apache Spark over the 6 months to 17 May 2025.

Hourly rate histogram for Apache Spark in the UK

Apache Spark
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the UK over the 6 months to 17 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +142 290 £575 +9.52% 366
London +77 191 £600 +7.62% 250
Work from Home +81 105 £600 +17.09% 206
UK excluding London +68 88 £540 +13.68% 192
North of England +17 28 £550 +7.84% 44
South East +56 17 £505 +34.67% 80
Yorkshire +15 15 £600 +18.34% 14
East of England +40 14 £650 +58.54% 6
Midlands +19 13 £410 -6.29% 15
East Midlands +13 11 £410 -6.29% 7
North West +13 11 £528 +3.43% 21
Northern Ireland -3 7 £410 -3.53% 6
South West +47 5 £625 +17.37% 18
Scotland -3 5 £469 +17.19% 27
West Midlands +6 2 - - 7
North East -2 2 £525 - 9

Apache Spark
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 114 (35.96%) Apache
2 51 (16.09%) Apache Airflow
3 9 (2.84%) nginx
4 7 (2.21%) Jupyter
5 2 (0.63%) Confluence
5 2 (0.63%) Oracle SOA Suite
6 1 (0.32%) Apache Pulsar
6 1 (0.32%) Luigi
6 1 (0.32%) Tomcat
Applications
1 4 (1.26%) Microsoft Excel
2 2 (0.63%) Microsoft Project
3 1 (0.32%) Microsoft Office
3 1 (0.32%) Microsoft PowerPoint
Business Applications
1 2 (0.63%) Dynamics CRM
Cloud Services
1 139 (43.85%) AWS
2 113 (35.65%) Azure
3 52 (16.40%) GCP
4 49 (15.46%) Serverless
5 47 (14.83%) AWS Lambda
6 41 (12.93%) Amazon S3
7 33 (10.41%) dbt
7 33 (10.41%) OpenShift
8 31 (9.78%) Power Platform
9 27 (8.52%) Amazon ECS
10 25 (7.89%) Azure Data Factory
11 23 (7.26%) Azure DevOps
12 21 (6.62%) Snowflake
13 16 (5.05%) AWS CloudFormation
14 13 (4.10%) Amazon EC2
15 12 (3.79%) Amazon EMR
16 10 (3.15%) GitHub
16 10 (3.15%) Google Kubernetes Engine
17 9 (2.84%) Amazon CloudWatch
18 8 (2.52%) Amazon Kinesis
Communications & Networking
1 6 (1.89%) SSH
2 5 (1.58%) Firewall
2 5 (1.58%) HTTP
2 5 (1.58%) Reverse Proxy
2 5 (1.58%) TCP/IP
3 2 (0.63%) Kerberos
4 1 (0.32%) VPN
4 1 (0.32%) Wireless
Database & Business Intelligence
1 147 (46.37%) Big Data
2 128 (40.38%) Hadoop
3 50 (15.77%) Apache Hive
4 39 (12.30%) Data Warehouse
5 33 (10.41%) Apache Iceberg
5 33 (10.41%) Data Lake
5 33 (10.41%) Tableau
6 31 (9.78%) Amazon Athena
6 31 (9.78%) Power BI
7 29 (9.15%) PostgreSQL
8 28 (8.83%) Flink
8 28 (8.83%) Relational Database
9 27 (8.52%) Delta Lake
10 26 (8.20%) Apache Arrow
10 26 (8.20%) Apache Ignite
10 26 (8.20%) Dremio
10 26 (8.20%) NoSQL
11 20 (6.31%) MongoDB
12 18 (5.68%) BigQuery
13 17 (5.36%) Elasticsearch
Development Applications
1 43 (13.56%) Git
2 30 (9.46%) Artifactory
3 25 (7.89%) Jenkins
4 15 (4.73%) JIRA
5 12 (3.79%) GitLab
6 7 (2.21%) MLflow
7 6 (1.89%) RStudio
8 5 (1.58%) Cucumber
8 5 (1.58%) Poetry
9 4 (1.26%) git-flow
9 4 (1.26%) Gradle
9 4 (1.26%) TeamCity
10 2 (0.63%) Atlassian Bamboo
10 2 (0.63%) Jaeger
10 2 (0.63%) JUnit
11 1 (0.32%) JMeter
11 1 (0.32%) ScalaTest
11 1 (0.32%) Selenium
11 1 (0.32%) Subversion
11 1 (0.32%) WebDriver
General
1 111 (35.02%) Finance
2 69 (21.77%) Analytical Skills
3 65 (20.50%) Social Skills
4 54 (17.03%) Banking
5 37 (11.67%) Front Office
6 20 (6.31%) Investment Banking
7 16 (5.05%) Financial Institution
7 16 (5.05%) Marketing
8 11 (3.47%) Public Sector
9 7 (2.21%) Inclusion and Diversity
10 6 (1.89%) Retail
11 5 (1.58%) Presentation Skills
12 4 (1.26%) Organisational Skills
12 4 (1.26%) Telecoms
13 2 (0.63%) French Language
13 2 (0.63%) Law
13 2 (0.63%) Wholesale Banking
14 1 (0.32%) Dutch Language
14 1 (0.32%) International Banking
14 1 (0.32%) Retail Banking
Job Titles
1 106 (33.44%) Data Engineer
2 62 (19.56%) Developer
3 46 (14.51%) DevOps Engineer
4 45 (14.20%) Senior
5 43 (13.56%) AWS Engineer
6 38 (11.99%) Python Engineer
7 34 (10.73%) AWS DevOps
7 34 (10.73%) AWS DevOps Engineer
8 32 (10.09%) Data Scientist
9 30 (9.46%) Architect
10 28 (8.83%) Java Developer
11 20 (6.31%) Lead
12 18 (5.68%) Senior Data Scientist
12 18 (5.68%) Senior Developer
13 16 (5.05%) Kubernetes Engineer
14 14 (4.42%) Data Architect
15 13 (4.10%) Apache Spark Developer
15 13 (4.10%) Data Science Developer
15 13 (4.10%) Machine Learning Engineer
16 12 (3.79%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 98 (30.91%) Kafka
2 74 (23.34%) PySpark
3 30 (9.46%) TensorFlow
4 29 (9.15%) Pandas
5 28 (8.83%) scikit-learn
6 26 (8.20%) J2EE
7 23 (7.26%) Spark Streaming
8 21 (6.62%) PyTorch
9 19 (5.99%) OpenTelemetry
10 17 (5.36%) JSON
10 17 (5.36%) NumPy
11 15 (4.73%) Matplotlib
12 14 (4.42%) Apache Beam
12 14 (4.42%) Seaborn
12 14 (4.42%) Spring
13 12 (3.79%) YAML
14 11 (3.47%) React
15 8 (2.52%) Apache Avro
15 8 (2.52%) pydantic
15 8 (2.52%) Spring Boot
Miscellaneous
1 37 (11.67%) Algorithms
2 36 (11.36%) Distributed Computing
3 14 (4.42%) Data Structures
4 13 (4.10%) Cloud Native
4 13 (4.10%) Distributed Systems
5 11 (3.47%) Multi-touch
6 10 (3.15%) Market Risk
7 8 (2.52%) Analytical Mindset
7 8 (2.52%) Linux Command Line
8 7 (2.21%) Credit Risk
8 7 (2.21%) Reference Data
9 5 (1.58%) Greenfield Project
10 4 (1.26%) Equities
10 4 (1.26%) Fixed Income
10 4 (1.26%) Self-Motivation
11 3 (0.95%) Data Protection Act
11 3 (0.95%) Management Information System
11 3 (0.95%) Onboarding
11 3 (0.95%) Product Ownership
11 3 (0.95%) Tandem
Operating Systems
1 48 (15.14%) Linux
2 21 (6.62%) Red Hat Enterprise Linux
3 13 (4.10%) Unix
4 1 (0.32%) Windows
Processes & Methodologies
1 124 (39.12%) CI/CD
2 109 (34.38%) DevOps
3 102 (32.18%) Data Pipeline
4 100 (31.55%) Analytics
4 100 (31.55%) Machine Learning
5 88 (27.76%) Data Science
6 87 (27.44%) Agile
7 84 (26.50%) Data Engineering
8 82 (25.87%) Problem-Solving
9 76 (23.97%) ETL
10 63 (19.87%) Artificial Intelligence
11 51 (16.09%) Computer Science
12 45 (14.20%) Software Engineering
13 44 (13.88%) Data Modelling
14 43 (13.56%) Data Analysis
15 42 (13.25%) Visualisation
16 39 (12.30%) Data Governance
17 37 (11.67%) Decision-Making
18 34 (10.73%) Open Source
18 34 (10.73%) Statistical Modelling
Programming Languages
1 220 (69.40%) Python
2 137 (43.22%) SQL
3 100 (31.55%) Java
4 50 (15.77%) Scala
5 33 (10.41%) R
6 29 (9.15%) Go
7 19 (5.99%) JavaScript
8 16 (5.05%) TypeScript
9 14 (4.42%) Shell Script
10 12 (3.79%) Bash
11 11 (3.47%) C++
12 9 (2.84%) C
13 8 (2.52%) C#
13 8 (2.52%) T-SQL
14 7 (2.21%) PowerShell
15 5 (1.58%) Perl
16 4 (1.26%) Data Analysis Expressions
17 2 (0.63%) Bicep
17 2 (0.63%) Kusto Query Language
18 1 (0.32%) Rust
Qualifications
1 56 (17.67%) Degree
2 38 (11.99%) PhD
3 35 (11.04%) Security Cleared
4 29 (9.15%) Master's Degree
4 29 (9.15%) SC Cleared
5 13 (4.10%) Computer Science Degree
6 4 (1.26%) AWS Certification
6 4 (1.26%) DV Cleared
7 3 (0.95%) AWS Certified Solutions Architect
8 2 (0.63%) Azure Certification
8 2 (0.63%) BPSS Clearance
9 1 (0.32%) CSPO
9 1 (0.32%) ISTQB
9 1 (0.32%) Numerate Degree
9 1 (0.32%) PMI Certification
9 1 (0.32%) PMP
9 1 (0.32%) Tableau Certification
Quality Assurance & Compliance
1 56 (17.67%) Data Quality
2 14 (4.42%) GDPR
3 6 (1.89%) QA
4 4 (1.26%) PCI DSS
5 3 (0.95%) Accessibility
6 2 (0.63%) Actionable Recommendations
7 1 (0.32%) California Consumer Privacy Act
7 1 (0.32%) HIPAA
7 1 (0.32%) PMO
7 1 (0.32%) SLA
System Software
1 65 (20.50%) Docker
2 5 (1.58%) HDFS
3 4 (1.26%) Virtual Machines
4 1 (0.32%) Apache Flume
4 1 (0.32%) Apache ZooKeeper
4 1 (0.32%) Tivoli Workload Scheduler
Systems Management
1 87 (27.44%) Kubernetes
1 87 (27.44%) Terraform
2 31 (9.78%) Ansible
3 28 (8.83%) Grafana
4 17 (5.36%) Argo
5 14 (4.42%) Prometheus
6 3 (0.95%) Kibana
6 3 (0.95%) Kubeflow
7 2 (0.63%) Apache Ranger
7 2 (0.63%) Hadoop YARN
7 2 (0.63%) HAProxy
7 2 (0.63%) Zipkin
8 1 (0.32%) Control-M
8 1 (0.32%) Docker Swarm
8 1 (0.32%) Istio
8 1 (0.32%) Kustomize
8 1 (0.32%) linkerd
8 1 (0.32%) logstash
8 1 (0.32%) Puppet
8 1 (0.32%) Tivoli
Vendors
1 64 (20.19%) Databricks
2 22 (6.94%) Microsoft
3 16 (5.05%) Google
4 12 (3.79%) Cloudera
4 12 (3.79%) Oracle
5 6 (1.89%) Palantir
6 5 (1.58%) Talend
7 4 (1.26%) IBM
7 4 (1.26%) Sybase
8 3 (0.95%) AppDynamics
8 3 (0.95%) Foundry
8 3 (0.95%) Informatica
8 3 (0.95%) Splunk
9 2 (0.63%) MuleSoft
9 2 (0.63%) StreamSets
10 1 (0.32%) CA Agile Central
10 1 (0.32%) Criteo
10 1 (0.32%) Dynatrace
10 1 (0.32%) OpenAI
10 1 (0.32%) Virgin Media