Spark SQL Contract Job Trends

Apache Spark SQL
UK

The table below provides summary statistics and contractor rates for jobs requiring Spark SQL skills. It covers contract job vacancies from the 6 months leading up to 9 September 2026, with comparisons to the same periods in the previous two years.

6 months to
9 Sep 2026
Same period 2025 Same period 2024
Rank 630 534 508
Rank change year-on-year -96 -26 +101
Contract jobs citing Spark SQL 55 19 55
As % of all contract jobs in the UK 0.10% 0.058% 0.14%
As % of the Database & Business Intelligence category 0.66% 0.32% 0.80%
Number of daily rates quoted 35 13 24
10th Percentile £378 £425 £331
25th Percentile £425 £450 £397
Median daily rate (50th Percentile) £475 £475 £430
Median % change year-on-year - +10.47% -20.74%
75th Percentile £550 £538 £492
90th Percentile £648 £620 £726
UK excluding London median daily rate £440 £538 £389
% change year-on-year -18.14% +38.17% -35.17%

All Database & BI Skills
UK

Spark SQL falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 8,294 5,896 6,840
As % of all contract IT jobs advertised in the UK 15.23% 18.01% 17.95%
Number of daily rates quoted 5,536 3,934 4,736
10th Percentile £358 £336 £350
25th Percentile £421 £413 £425
Median daily rate (50th Percentile) £500 £500 £526
Median % change year-on-year - -4.90% -2.64%
75th Percentile £613 £625 £651
90th Percentile £700 £750 £800
UK excluding London median daily rate £475 £475 £476
% change year-on-year - -0.21% -4.80%
Number of hourly rates quoted 266 94 85
10th Percentile £15.97 £22.86 £17.50
25th Percentile £23.05 £30.24 £20.75
Median hourly rate £39.50 £39.48 £33.93
Median % change year-on-year +0.05% +16.36% -36.58%
75th Percentile £60.75 £65.00 £59.95
90th Percentile £75.50 £80.00 £73.60
UK excluding London median hourly rate £38.38 £35.49 £30.00
% change year-on-year +8.13% +18.30% -42.86%

Spark SQL
Job Vacancy Trend

Historical trend showing the proportion of contract IT job postings citing Spark SQL relative to all contract IT jobs advertised.

Spark SQL job vacancy trend in the UK

Spark SQL
Daily Rate Trend

Contractor daily rate distribution trend for jobs in the UK citing Spark SQL.

Contractor daily rate distribution trend for jobs in the UK citing Spark SQL

Spark SQL
Daily Rate Histogram

Daily rate distribution for jobs citing Spark SQL over the 6 months to 9 September 2026.

Daily rate histogram for Spark SQL in the UK

Spark SQL
Top 12 Contract Job Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Spark SQL within the UK over the 6 months to 9 September 2026. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -79 54 £468 -1.58% 15
London -66 36 £488 +2.63% 12
UK excluding London -91 19 £440 -18.14% 8
Work from Home -66 12 £488 +2.63% 6
South East - 7 £425 - 4
Midlands -46 5 £431 -9.21% 1
West Midlands - 5 £431 - 1
North of England -65 4 £550 -8.33%
Yorkshire -33 3 £550 -8.33%
South West - 2 £425 - 1
Scotland - 1 £545 - 1
North West - 1 - -

Spark SQL
Co-Occurring Skills & Capabilities by Category

The following tables expand on the one above by listing co-occurrences grouped by category. They cover the same employment type, locality and period, with up to 20 co-occurrences shown in each category:

Application Platforms
1 18 (32.73%) Apache Spark
2 7 (12.73%) Apache
3 6 (10.91%) Apache Airflow
4 1 (1.82%) Palantir Foundry
4 1 (1.82%) SharePoint
Cloud Services
1 41 (74.55%) Azure
2 22 (40.00%) Power Platform
3 19 (34.55%) AWS
4 17 (30.91%) Azure DevOps
5 15 (27.27%) Azure Synapse Analytics
6 12 (21.82%) Azure Data Factory
7 9 (16.36%) Azure Databricks
8 8 (14.55%) Microsoft Purview
9 7 (12.73%) GCP
10 6 (10.91%) AWS Lambda
10 6 (10.91%) Dynamics 365
10 6 (10.91%) Serverless
11 5 (9.09%) PowerApps
12 4 (7.27%) Azure Functions
12 4 (7.27%) dbt
12 4 (7.27%) GitHub
13 3 (5.45%) Amazon S3
13 3 (5.45%) Power Automate
14 2 (3.64%) AWS CodeCommit
14 2 (3.64%) AWS Step Functions
Database & Business Intelligence
1 22 (40.00%) Power BI
2 19 (34.55%) Delta Lake
3 14 (25.45%) Data Lake
4 11 (20.00%) Data Warehouse
5 10 (18.18%) Metadata
6 8 (14.55%) SQL Server
7 5 (9.09%) Big Data
7 5 (9.09%) Parquet
7 5 (9.09%) Star Schema
8 4 (7.27%) Apache Iceberg
8 4 (7.27%) Azure SQL Database
8 4 (7.27%) Data Vault
8 4 (7.27%) Tableau
9 3 (5.45%) Snowflake Schema
10 2 (3.64%) Amazon Athena
10 2 (3.64%) Amazon RDS
10 2 (3.64%) Semantic Layer
11 1 (1.82%) Amazon Redshift
11 1 (1.82%) SQL Server Integration Services
11 1 (1.82%) SQL Server Reporting Services
Development Applications
1 12 (21.82%) Git
2 4 (7.27%) MLflow
2 4 (7.27%) Selenium
3 1 (1.82%) GitLab
3 1 (1.82%) SonarQube
General
1 18 (32.73%) Finance
2 11 (20.00%) Social Skills
3 10 (18.18%) Analytical Skills
4 5 (9.09%) Public Sector
5 4 (7.27%) Military
6 3 (5.45%) Publishing
6 3 (5.45%) Retail
7 2 (3.64%) Documentation Skills
7 2 (3.64%) Inclusion and Diversity
8 1 (1.82%) Local Government
8 1 (1.82%) Pharmaceutical
Job Titles
1 33 (60.00%) Data Engineer
2 14 (25.45%) Senior
3 10 (18.18%) Senior Data Engineer
4 9 (16.36%) Databricks Engineer
5 8 (14.55%) Databricks Data Engineer
6 7 (12.73%) Architect
7 6 (10.91%) Lead
8 5 (9.09%) Analyst
8 5 (9.09%) Data Analyst
8 5 (9.09%) Databricks Architect
8 5 (9.09%) Platform Engineer
8 5 (9.09%) Tester
9 4 (7.27%) Data Analytics Engineer
9 4 (7.27%) Lead Data Engineer
10 3 (5.45%) Data Architect
10 3 (5.45%) Senior Tester
11 2 (3.64%) Data Scientist
11 2 (3.64%) Developer
11 2 (3.64%) Enterprise Architect
11 2 (3.64%) Migration Engineer
Libraries, Frameworks & Software Standards
1 50 (90.91%) PySpark
2 13 (23.64%) Terraform
3 8 (14.55%) Kafka
4 5 (9.09%) Great Expectations
4 5 (9.09%) JSON
5 4 (7.27%) Playwright
5 4 (7.27%) pytest
5 4 (7.27%) React
6 2 (3.64%) Jinja
6 2 (3.64%) XML
7 1 (1.82%) Spark Streaming
Miscellaneous
1 5 (9.09%) Cloud Native
2 4 (7.27%) Low-Code
3 3 (5.45%) Algorithms
3 3 (5.45%) Greenfield Project
4 2 (3.64%) AI Agents
4 2 (3.64%) Data Fabric
4 2 (3.64%) Enterprise Cloud
4 2 (3.64%) Legacy Systems
4 2 (3.64%) Video\Live Streaming
5 1 (1.82%) Educational Technology
5 1 (1.82%) EPoS
5 1 (1.82%) IoT
5 1 (1.82%) Life Science
5 1 (1.82%) Product Ownership
5 1 (1.82%) Reference Data
5 1 (1.82%) Renewable Energy
5 1 (1.82%) Self-Motivation
5 1 (1.82%) Virtual Team
Processes & Methodologies
1 32 (58.18%) CI/CD
2 29 (52.73%) Analytics
2 29 (52.73%) Business Intelligence
2 29 (52.73%) Data Pipeline
3 27 (49.09%) Lakehouse
4 26 (47.27%) Data Governance
5 25 (45.45%) Data Engineering
6 23 (41.82%) DevOps
7 22 (40.00%) Data Modelling
8 19 (34.55%) ETL
9 18 (32.73%) Validation
10 17 (30.91%) Infrastructure as Code
11 16 (29.09%) Migration
12 15 (27.27%) AI
13 12 (21.82%) Agile
13 12 (21.82%) Continuous Improvement
14 9 (16.36%) Data Ingestion
15 8 (14.55%) Decision-Making
15 8 (14.55%) Test Automation
15 8 (14.55%) Use Case
Programming Languages
1 55 (100.00%) SQL
2 35 (63.64%) Python
3 7 (12.73%) T-SQL
4 6 (10.91%) Data Analysis Expressions
5 4 (7.27%) JavaScript
6 3 (5.45%) PowerShell
7 2 (3.64%) Java
8 1 (1.82%) Bicep
8 1 (1.82%) R
8 1 (1.82%) Scala
Qualifications
1 6 (10.91%) Security Cleared
2 3 (5.45%) SC Cleared
3 2 (3.64%) DBS Check
4 1 (1.82%) BPSS Clearance
4 1 (1.82%) DV Cleared
4 1 (1.82%) Microsoft Certification
Quality Assurance & Compliance
1 27 (49.09%) Data Quality
2 7 (12.73%) QA
3 2 (3.64%) GDPR
4 1 (1.82%) Disclosure Scotland
4 1 (1.82%) MiFID
4 1 (1.82%) Sarbanes-Oxley
4 1 (1.82%) SLA
System Software
1 6 (10.91%) Docker
Systems Management
1 4 (7.27%) Ansible
2 2 (3.64%) Kubernetes
3 1 (1.82%) Grafana
Vendors
1 38 (69.09%) Databricks
2 21 (38.18%) Microsoft
3 2 (3.64%) Hitachi
3 2 (3.64%) Teradata
4 1 (1.82%) Bloomberg
4 1 (1.82%) Foundry
4 1 (1.82%) OpenAI
4 1 (1.82%) Palantir
4 1 (1.82%) Reuters
4 1 (1.82%) Trayport