Spark SQL Contracts

Apache Spark SQL
UK

The table below provides summary statistics for contract job vacancies requiring Spark SQL skills. It includes a benchmarking guide to the contractor rates offered in vacancies that cited Spark SQL over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 505 555 704
Rank change year-on-year +50 +149 +104
Contract jobs citing Spark SQL 15 27 14
As % of all contract jobs advertised in the UK 0.051% 0.062% 0.023%
As % of the Database & Business Intelligence category 0.27% 0.37% 0.13%
Number of daily rates quoted 12 14 9
10th Percentile £367 £458 £525
25th Percentile £448 £488 £563
Median daily rate (50th Percentile) £500 £550 £600
Median % change year-on-year -9.09% -8.33% +9.09%
75th Percentile £583 £694 £688
90th Percentile £784 £755 £700
UK excluding London median daily rate £475 £425 £700
% change year-on-year +11.76% -39.29% +33.33%

All Database and Business Intelligence Skills
UK

Spark SQL falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all contract job vacancies requiring database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 5,552 7,317 10,769
As % of all contract IT jobs advertised in the UK 18.96% 16.80% 18.04%
Number of daily rates quoted 3,834 5,210 7,665
10th Percentile £356 £350 £375
25th Percentile £420 £425 £450
Median daily rate (50th Percentile) £525 £525 £540
Median % change year-on-year - -2.78% -1.64%
75th Percentile £640 £650 £660
90th Percentile £763 £763 £750
UK excluding London median daily rate £489 £480 £500
% change year-on-year +1.88% -4.00% +2.56%
Number of hourly rates quoted 104 143 183
10th Percentile £19.97 £14.00 £21.24
25th Percentile £24.06 £20.98 £35.00
Median hourly rate £32.96 £40.00 £60.00
Median % change year-on-year -17.60% -33.33% +41.18%
75th Percentile £65.15 £58.62 £70.88
90th Percentile £75.13 £72.50 £79.19
UK excluding London median hourly rate £30.00 £40.00 £58.05
% change year-on-year -25.00% -31.09% +65.84%

Spark SQL
Job Vacancy Trend

Job postings citing Spark SQL as a proportion of all IT jobs advertised.

Job vacancy trend for Spark SQL in the UK

Spark SQL
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Spark SQL.

Daily rate trend for Spark SQL in the UK

Spark SQL
Daily Rate Histogram

Daily rate distribution for jobs citing Spark SQL over the 6 months to 1 May 2025.

Daily rate histogram for Spark SQL in the UK

Spark SQL
Top 9 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Spark SQL within the UK over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +48 14 £500 -9.09% 26
London +28 8 £500 -9.09% 23
UK excluding London +65 7 £475 +11.76% 5
South East - 4 £459 - 3
Work from Home +39 3 £475 - 10
Midlands - 2 £425 - 1
East Midlands - 1 £475 -
Wales - 1 £525 -
West Midlands - 1 £375 - 1

Spark SQL
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 8 (53.33%) Apache Spark
2 4 (26.67%) Apache
3 2 (13.33%) Apache Airflow
Cloud Services
1 6 (40.00%) Azure
2 4 (26.67%) Amazon S3
3 3 (20.00%) GCP
4 2 (13.33%) AWS
4 2 (13.33%) AWS Data Pipeline
4 2 (13.33%) AWS Lambda
4 2 (13.33%) Azure DevOps
4 2 (13.33%) GitHub
4 2 (13.33%) Power Platform
4 2 (13.33%) Serverless
5 1 (6.67%) Amazon EC2
5 1 (6.67%) AWS CloudFormation
5 1 (6.67%) Azure Data Factory
5 1 (6.67%) dbt
5 1 (6.67%) Snowflake
Database & Business Intelligence
1 8 (53.33%) Data Warehouse
2 5 (33.33%) Apache Hive
2 5 (33.33%) Big Data
2 5 (33.33%) Data Lake
2 5 (33.33%) Hadoop
3 4 (26.67%) MongoDB
4 3 (20.00%) Amazon Athena
4 3 (20.00%) Amazon Redshift
4 3 (20.00%) BigQuery
4 3 (20.00%) Impala
5 2 (13.33%) MySQL
5 2 (13.33%) PostgreSQL
5 2 (13.33%) Power BI
5 2 (13.33%) Relational Database
5 2 (13.33%) Sqoop
6 1 (6.67%) Azure SQL Data Warehouse
6 1 (6.67%) Azure SQL Database
6 1 (6.67%) HBase
6 1 (6.67%) Metadata
6 1 (6.67%) NoSQL
Development Applications
1 2 (13.33%) Git
2 1 (6.67%) Artifactory
2 1 (6.67%) JIRA
General
1 4 (26.67%) Finance
1 4 (26.67%) Social Skills
2 2 (13.33%) Banking
2 2 (13.33%) Investment Banking
2 2 (13.33%) Public Sector
3 1 (6.67%) Analytical Skills
3 1 (6.67%) Electronics
3 1 (6.67%) Manufacturing
3 1 (6.67%) Marketing
3 1 (6.67%) Telecoms
Job Titles
1 12 (80.00%) Data Engineer
2 2 (13.33%) Big Data Developer
2 2 (13.33%) Developer
2 2 (13.33%) Hadoop Developer
2 2 (13.33%) Lead
2 2 (13.33%) Lead Data Engineer
2 2 (13.33%) Senior
3 1 (6.67%) Analyst
3 1 (6.67%) Azure Data Engineer
3 1 (6.67%) Azure Engineer
3 1 (6.67%) Banking Analyst
3 1 (6.67%) Data Analyst
3 1 (6.67%) Senior Analyst
3 1 (6.67%) Senior Data Analyst
3 1 (6.67%) Senior Data Engineer
3 1 (6.67%) SQL Analyst
3 1 (6.67%) SQL Data Analyst
Libraries, Frameworks & Software Standards
1 11 (73.33%) PySpark
2 4 (26.67%) Kafka
3 2 (13.33%) JDBC
4 1 (6.67%) AWS CDK
4 1 (6.67%) boto
4 1 (6.67%) Handlebars
4 1 (6.67%) pytest
Miscellaneous
1 2 (13.33%) Distributed Computing
1 2 (13.33%) Hybrid Cloud
2 1 (6.67%) Cloud Native
2 1 (6.67%) Legacy Code
Processes & Methodologies
1 13 (86.67%) Data Pipeline
2 12 (80.00%) ETL
3 9 (60.00%) Data Engineering
4 6 (40.00%) Business Intelligence
4 6 (40.00%) Data Integration
5 4 (26.67%) Agile
5 4 (26.67%) CI/CD
5 4 (26.67%) Code Quality
5 4 (26.67%) Data Ingestion
5 4 (26.67%) Problem-Solving
6 3 (20.00%) Artificial Intelligence
6 3 (20.00%) Data Management
6 3 (20.00%) Data Modelling
6 3 (20.00%) Data Science
6 3 (20.00%) Data Security
6 3 (20.00%) Machine Learning
6 3 (20.00%) Mentoring
7 2 (13.33%) Data Governance
7 2 (13.33%) High Availability
7 2 (13.33%) Predictive Modelling
Programming Languages
1 15 (100.00%) SQL
2 13 (86.67%) Python
3 3 (20.00%) T-SQL
4 2 (13.33%) ANSI SQL
5 1 (6.67%) Ruby
5 1 (6.67%) Scala
Qualifications
1 1 (6.67%) Azure Certification
1 1 (6.67%) Computer Science Degree
1 1 (6.67%) Degree
Quality Assurance & Compliance
1 6 (40.00%) Data Quality
System Software
1 2 (13.33%) HDFS
Systems Management
1 1 (6.67%) Terraform
Vendors
1 5 (33.33%) Databricks
2 1 (6.67%) Google
2 1 (6.67%) Microsoft
2 1 (6.67%) SAP