Spark SQL Contract Job Trends

Apache Spark SQL
UK

The table below provides summary statistics and contractor rates for jobs requiring Spark SQL skills. It covers vacancies from the 6 months leading up to 21 September 2025, with comparisons to the same periods in the previous two years.

6 months to
21 Sep 2025
Same period 2024 Same period 2023
Rank 547 510 609
Rank change year-on-year -37 +99 +192
Contract jobs citing Spark SQL 18 56 37
As % of all contract jobs advertised in the UK 0.055% 0.15% 0.074%
As % of the Database & Business Intelligence category 0.30% 0.81% 0.44%
Number of daily rates quoted 12 25 29
10th Percentile £425 £334 £455
25th Percentile £444 £400 £500
Median daily rate (50th Percentile) £475 £430 £545
Median % change year-on-year +10.47% -21.10% -9.92%
75th Percentile £553 £496 £588
90th Percentile £623 £788 £600
UK excluding London median daily rate £600 £389 £600
% change year-on-year +54.24% -35.17% +83.21%

All Database and Business Intelligence Skills
UK

Spark SQL falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 5,970 6,885 8,368
As % of all contract IT jobs advertised in the UK 18.28% 17.94% 16.78%
Number of daily rates quoted 3,993 4,732 5,839
10th Percentile £340 £350 £363
25th Percentile £413 £425 £450
Median daily rate (50th Percentile) £500 £535 £540
Median % change year-on-year -6.54% -0.93% -1.82%
75th Percentile £625 £650 £650
90th Percentile £738 £800 £750
UK excluding London median daily rate £475 £488 £500
% change year-on-year -2.56% -2.50% -
Number of hourly rates quoted 86 89 156
10th Percentile £21.23 £17.50 £20.94
25th Percentile £29.02 £21.25 £32.32
Median hourly rate £40.25 £35.00 £55.00
Median % change year-on-year +14.99% -36.36% +22.22%
75th Percentile £65.00 £59.95 £73.75
90th Percentile £83.75 £71.95 £78.00
UK excluding London median hourly rate £36.00 £30.00 £55.00
% change year-on-year +20.00% -45.45% +57.14%

Spark SQL
Job Vacancy Trend

Job postings citing Spark SQL as a proportion of all IT jobs advertised.

Job vacancy trend for Spark SQL in the UK

Spark SQL
Daily Rate Trend

Contractor daily rate distribution trend for jobs in the UK citing Spark SQL.

Contractor daily rate distribution trend for jobs in the UK citing Spark SQL

Spark SQL
Daily Rate Histogram

Daily rate distribution for jobs citing Spark SQL over the 6 months to 21 September 2025.

Daily rate histogram for Spark SQL in the UK

Spark SQL
Top 6 Contract Job Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Spark SQL within the UK over the 6 months to 21 September 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -17 17 £475 +5.56% 2
London +10 15 £475 +7.95%
Work from Home +9 3 £625 +27.55% 5
UK excluding London -13 2 £600 +54.24% 3
Yorkshire -37 2 £600 -9.43%
North of England -44 2 £600 +33.33% 1

Spark SQL
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (22.22%) Apache Spark
2 3 (16.67%) Apache Airflow
3 2 (11.11%) Apache
Cloud Services
1 16 (88.89%) Azure
2 8 (44.44%) Power Platform
3 6 (33.33%) Microsoft Purview
4 4 (22.22%) AWS
5 2 (11.11%) Azure Data Factory
5 2 (11.11%) Azure Synapse Analytics
5 2 (11.11%) dbt
5 2 (11.11%) GCP
5 2 (11.11%) GitHub
6 1 (5.56%) Amazon EMR
6 1 (5.56%) Amazon SageMaker
6 1 (5.56%) Azure DevOps
6 1 (5.56%) Azure Monitor
6 1 (5.56%) Cloud Composer
6 1 (5.56%) Cloud Run
6 1 (5.56%) GitHub Actions
6 1 (5.56%) Google Data Studio
6 1 (5.56%) Prefect
Database & Business Intelligence
1 8 (44.44%) Metadata
2 7 (38.89%) Data Lake
3 6 (33.33%) PostgreSQL
4 5 (27.78%) Data Warehouse
5 3 (16.67%) Apache Hive
5 3 (16.67%) Delta Lake
5 3 (16.67%) Hadoop
6 2 (11.11%) BigQuery
6 2 (11.11%) Power BI
7 1 (5.56%) Amazon Athena
Development Applications
1 2 (11.11%) Git
General
1 12 (66.67%) Social Skills
2 6 (33.33%) Inclusion and Diversity
2 6 (33.33%) Public Sector
3 5 (27.78%) Analytical Skills
3 5 (27.78%) Finance
4 1 (5.56%) Banking
4 1 (5.56%) Corporate Banking
4 1 (5.56%) Investment Banking
4 1 (5.56%) Publishing
4 1 (5.56%) Retail
4 1 (5.56%) Retail Banking
Job Titles
1 8 (44.44%) Data Engineer
2 6 (33.33%) Architect
2 6 (33.33%) Data Architect
3 2 (11.11%) Developer
4 1 (5.56%) Analyst
4 1 (5.56%) Business Intelligence Developer
4 1 (5.56%) Data Analyst
4 1 (5.56%) GCP Data Engineer
4 1 (5.56%) GCP Engineer
4 1 (5.56%) Java Engineer
4 1 (5.56%) Lead
4 1 (5.56%) Lead Developer
4 1 (5.56%) Python Data Engineer
4 1 (5.56%) Python Engineer
4 1 (5.56%) Senior
4 1 (5.56%) Senior Data Engineer
4 1 (5.56%) SQL Developer
Libraries, Frameworks & Software Standards
1 15 (83.33%) PySpark
2 3 (16.67%) CSS
2 3 (16.67%) HTML
Miscellaneous
1 6 (33.33%) Low-Code
2 3 (16.67%) Distributed Computing
2 3 (16.67%) Product Ownership
2 3 (16.67%) Virtual Team
3 1 (5.56%) Cloud Native
3 1 (5.56%) Reinsurance
Operating Systems
1 1 (5.56%) Linux
1 1 (5.56%) Unix
Processes & Methodologies
1 14 (77.78%) Data Modelling
2 11 (61.11%) Problem-Solving
3 9 (50.00%) Data Governance
3 9 (50.00%) Data Pipeline
4 8 (44.44%) Agile
5 7 (38.89%) Data Architecture
5 7 (38.89%) ETL
5 7 (38.89%) Metadata Management
6 6 (33.33%) Analytics
6 6 (33.33%) Strategic Planning
6 6 (33.33%) Strategic Thinking
7 5 (27.78%) Data Transformation
7 5 (27.78%) Scrum
8 4 (22.22%) Data Analytics
8 4 (22.22%) Data Ingestion
8 4 (22.22%) Data Science
9 3 (16.67%) Computer Science
9 3 (16.67%) Customer Requirements
9 3 (16.67%) Data Engineering
9 3 (16.67%) Data Management
Programming Languages
1 16 (88.89%) Python
2 11 (61.11%) SQL
3 7 (38.89%) Java
4 3 (16.67%) JavaScript
5 1 (5.56%) Data Analysis Expressions
Qualifications
1 3 (16.67%) Degree
2 1 (5.56%) SC Cleared
2 1 (5.56%) Security Cleared
Quality Assurance & Compliance
1 2 (11.11%) Data Quality
2 1 (5.56%) Accessibility
Systems Management
1 3 (16.67%) Kubernetes
2 1 (5.56%) Terraform
Vendors
1 7 (38.89%) Databricks
2 6 (33.33%) Microsoft
3 4 (22.22%) Foundry
3 4 (22.22%) Palantir
4 1 (5.56%) Google