Spark SQL Contracts

Apache Spark SQL
UK

The table below provides summary statistics for contract job vacancies requiring Spark SQL skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Spark SQL over the 6 months leading up to 4 May 2025, comparing them to the same period in the previous two years.

6 months to
4 May 2025
Same period 2024 Same period 2023
Rank 513 561 690
Rank change year-on-year +48 +129 +122
Contract jobs citing Spark SQL 17 29 13
As % of all contract jobs advertised in the UK 0.058% 0.067% 0.022%
As % of the Database & Business Intelligence category 0.31% 0.40% 0.12%
Number of daily rates quoted 13 15 9
10th Percentile £371 £420 £525
25th Percentile £413 £475 £563
Median daily rate (50th Percentile) £500 £550 £600
Median % change year-on-year -9.09% -8.33% +9.09%
75th Percentile £538 £663 £688
90th Percentile £781 £753 £700
UK excluding London median daily rate £444 £400 £700
% change year-on-year +10.94% -42.86% +33.33%

All Database and Business Intelligence Skills
UK

Spark SQL falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 5,553 7,314 10,646
As % of all contract IT jobs advertised in the UK 18.95% 16.86% 17.97%
Number of daily rates quoted 3,835 5,221 7,562
10th Percentile £357 £350 £375
25th Percentile £420 £425 £450
Median daily rate (50th Percentile) £525 £525 £540
Median % change year-on-year - -2.78% -1.74%
75th Percentile £643 £650 £663
90th Percentile £763 £765 £750
UK excluding London median daily rate £488 £475 £500
% change year-on-year +2.63% -5.00% +1.01%
Number of hourly rates quoted 103 144 188
10th Percentile £19.84 £14.00 £21.24
25th Percentile £23.88 £20.98 £34.35
Median hourly rate £32.81 £40.00 £58.59
Median % change year-on-year -17.98% -31.73% +37.86%
75th Percentile £65.31 £58.81 £72.80
90th Percentile £75.50 £72.50 £80.75
UK excluding London median hourly rate £30.00 £40.00 £55.00
% change year-on-year -25.00% -27.27% +57.14%

Spark SQL
Job Vacancy Trend

Job postings citing Spark SQL as a proportion of all IT jobs advertised.

Job vacancy trend for Spark SQL in the UK

Spark SQL
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Spark SQL.

Daily rate trend for Spark SQL in the UK

Spark SQL
Daily Rate Histogram

Daily rate distribution for jobs citing Spark SQL over the 6 months to 4 May 2025.

Daily rate histogram for Spark SQL in the UK

Spark SQL
Top 8 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Spark SQL within the UK over the 6 months to 4 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +55 16 £493 -10.45% 30
London +37 10 £500 -9.09% 26
UK excluding London +69 6 £444 +10.94% 9
South East - 4 £459 - 4
Work from Home +43 3 £475 - 15
Midlands - 2 £425 - 1
West Midlands - 1 £375 -
East Midlands - 1 £475 - 1

Spark SQL
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 8 (47.06%) Apache Spark
2 4 (23.53%) Apache
3 3 (17.65%) Apache Airflow
Cloud Services
1 7 (41.18%) Azure
2 4 (23.53%) Amazon S3
2 4 (23.53%) GCP
2 4 (23.53%) GitHub
3 3 (17.65%) Azure DevOps
3 3 (17.65%) dbt
4 2 (11.76%) AWS
4 2 (11.76%) AWS Data Pipeline
4 2 (11.76%) AWS Lambda
4 2 (11.76%) Azure Data Factory
4 2 (11.76%) Power Platform
4 2 (11.76%) Serverless
5 1 (5.88%) Amazon EC2
5 1 (5.88%) AWS CloudFormation
5 1 (5.88%) Cloud Composer
5 1 (5.88%) Cloud Run
5 1 (5.88%) GitHub Actions
5 1 (5.88%) Google Data Studio
5 1 (5.88%) Prefect
5 1 (5.88%) Snowflake
Database & Business Intelligence
1 9 (52.94%) Data Warehouse
2 5 (29.41%) Apache Hive
2 5 (29.41%) Big Data
2 5 (29.41%) Data Lake
2 5 (29.41%) Hadoop
3 4 (23.53%) BigQuery
3 4 (23.53%) MongoDB
4 3 (17.65%) Amazon Athena
4 3 (17.65%) Amazon Redshift
4 3 (17.65%) Impala
5 2 (11.76%) Delta Lake
5 2 (11.76%) MySQL
5 2 (11.76%) PostgreSQL
5 2 (11.76%) Power BI
5 2 (11.76%) Relational Database
5 2 (11.76%) Sqoop
6 1 (5.88%) Azure SQL Database
6 1 (5.88%) HBase
6 1 (5.88%) Metadata
6 1 (5.88%) NoSQL
Development Applications
1 3 (17.65%) Git
2 1 (5.88%) Artifactory
2 1 (5.88%) JIRA
General
1 5 (29.41%) Finance
1 5 (29.41%) Social Skills
2 2 (11.76%) Banking
2 2 (11.76%) Investment Banking
2 2 (11.76%) Public Sector
3 1 (5.88%) Analytical Skills
3 1 (5.88%) Electronics
3 1 (5.88%) Manufacturing
3 1 (5.88%) Marketing
3 1 (5.88%) Telecoms
Job Titles
1 13 (76.47%) Data Engineer
2 3 (17.65%) Developer
3 2 (11.76%) Big Data Developer
3 2 (11.76%) Hadoop Developer
3 2 (11.76%) Lead
3 2 (11.76%) Lead Data Engineer
3 2 (11.76%) Senior
4 1 (5.88%) Analyst
4 1 (5.88%) Azure Data Engineer
4 1 (5.88%) Azure Engineer
4 1 (5.88%) Data Analyst
4 1 (5.88%) GCP Data Engineer
4 1 (5.88%) GCP Engineer
4 1 (5.88%) Python Data Engineer
4 1 (5.88%) Python Engineer
4 1 (5.88%) Senior Analyst
4 1 (5.88%) Senior Data Analyst
4 1 (5.88%) Senior Data Engineer
4 1 (5.88%) SQL Analyst
4 1 (5.88%) SQL Data Analyst
Libraries, Frameworks & Software Standards
1 13 (76.47%) PySpark
2 4 (23.53%) Kafka
3 2 (11.76%) JDBC
4 1 (5.88%) AWS CDK
4 1 (5.88%) boto
4 1 (5.88%) pytest
Miscellaneous
1 2 (11.76%) Distributed Computing
1 2 (11.76%) Hybrid Cloud
2 1 (5.88%) Cloud Native
2 1 (5.88%) Legacy Code
2 1 (5.88%) Reinsurance
Operating Systems
1 1 (5.88%) Linux
1 1 (5.88%) Unix
Processes & Methodologies
1 15 (88.24%) Data Pipeline
1 15 (88.24%) ETL
2 9 (52.94%) Data Engineering
3 6 (35.29%) Agile
3 6 (35.29%) Business Intelligence
3 6 (35.29%) Data Integration
4 5 (29.41%) CI/CD
4 5 (29.41%) Data Ingestion
4 5 (29.41%) Data Modelling
5 4 (23.53%) Code Quality
5 4 (23.53%) Data Governance
5 4 (23.53%) Data Security
5 4 (23.53%) Problem-Solving
6 3 (17.65%) Artificial Intelligence
6 3 (17.65%) Data Management
6 3 (17.65%) Data Science
6 3 (17.65%) DevOps
6 3 (17.65%) Machine Learning
6 3 (17.65%) Mentoring
7 2 (11.76%) Dashboard Development
Programming Languages
1 16 (94.12%) SQL
2 15 (88.24%) Python
3 3 (17.65%) T-SQL
4 2 (11.76%) ANSI SQL
5 1 (5.88%) Data Analysis Expressions
5 1 (5.88%) Java
5 1 (5.88%) Scala
Qualifications
1 1 (5.88%) Azure Certification
1 1 (5.88%) Computer Science Degree
1 1 (5.88%) Degree
Quality Assurance & Compliance
1 7 (41.18%) Data Quality
System Software
1 2 (11.76%) HDFS
Systems Management
1 1 (5.88%) Terraform
Vendors
1 6 (35.29%) Databricks
2 2 (11.76%) Google
3 1 (5.88%) Microsoft
3 1 (5.88%) SAP