Spark SQL Jobs

Apache Spark SQL
UK

The table below provides summary statistics for permanent job vacancies requiring Spark SQL skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Spark SQL over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 677 873 961
Rank change year-on-year +196 +88 +168
Permanent jobs citing Spark SQL 15 23 28
As % of all permanent jobs advertised in the UK 0.029% 0.023% 0.027%
As % of the Database & Business Intelligence category 0.20% 0.13% 0.13%
Number of salaries quoted 3 17 18
10th Percentile £66,000 - £59,500
25th Percentile £73,125 £52,500 £62,500
Median annual salary (50th Percentile) £90,000 £60,000 £80,000
Median % change year-on-year +50.00% -25.00% +21.21%
75th Percentile £92,500 £62,500 £87,500
90th Percentile £94,000 £76,500 £90,000
UK excluding London median annual salary £62,500 £60,000 £65,000
% change year-on-year +4.17% -7.69% +36.84%

All Database and Business Intelligence Skills
UK

Spark SQL falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 7,431 18,186 22,342
As % of all permanent jobs advertised in the UK 14.28% 18.47% 21.50%
Number of salaries quoted 5,213 12,623 13,902
10th Percentile £37,500 £35,000 £37,500
25th Percentile £47,500 £42,725 £47,500
Median annual salary (50th Percentile) £62,500 £57,500 £65,000
Median % change year-on-year +8.70% -11.54% +8.33%
75th Percentile £83,750 £76,250 £83,750
90th Percentile £115,000 £95,000 £103,750
UK excluding London median annual salary £55,000 £52,500 £55,000
% change year-on-year +4.76% -4.55% +4.76%

Spark SQL
Job Vacancy Trend

Job postings citing Spark SQL as a proportion of all IT jobs advertised.

Job vacancy trend for Spark SQL in the UK

Spark SQL
Salary Trend

3-month moving average salary quoted in jobs citing Spark SQL.

Salary trend for Spark SQL in the UK

Spark SQL
Salary Histogram

Salary distribution for jobs citing Spark SQL over the 6 months to 1 May 2025.

Salary histogram for Spark SQL in the UK

Spark SQL
Top 8 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Spark SQL within the UK over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +166 15 £90,000 +50.00% 23
Work from Home +191 9 - - 10
London +100 9 £90,000 +56.52% 20
UK excluding London +211 6 £62,500 +4.17% 5
Midlands - 4 £62,500 - 1
East Midlands - 3 - -
South East +108 2 - - 3
West Midlands - 1 £62,500 - 1

Spark SQL
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (26.67%) Apache Spark
Cloud Services
1 8 (53.33%) AWS
2 7 (46.67%) Azure
3 6 (40.00%) Power Platform
4 5 (33.33%) GCP
4 5 (33.33%) Microsoft Purview
5 3 (20.00%) Amazon EC2
5 3 (20.00%) Amazon S3
5 3 (20.00%) Amazon SageMaker
5 3 (20.00%) AWS Lambda
5 3 (20.00%) GitHub
5 3 (20.00%) Power Automate
5 3 (20.00%) PowerApps
5 3 (20.00%) Serverless
6 2 (13.33%) Azure Data Factory
6 2 (13.33%) Cloud Computing
7 1 (6.67%) Azure DevOps
Database & Business Intelligence
1 5 (33.33%) Metadata
2 4 (26.67%) Tableau
3 3 (20.00%) Amazon Athena
3 3 (20.00%) Metadata Repository
3 3 (20.00%) Parquet
3 3 (20.00%) PostgreSQL
4 2 (13.33%) Data Warehouse
4 2 (13.33%) Delta Lake
4 2 (13.33%) Power BI
5 1 (6.67%) Azure SQL Data Warehouse
5 1 (6.67%) Azure SQL Database
5 1 (6.67%) Big Data
5 1 (6.67%) Data Lake
5 1 (6.67%) NoSQL
5 1 (6.67%) Relational Database
Development Applications
1 4 (26.67%) Git
2 3 (20.00%) GitLab
3 1 (6.67%) Jenkins
General
1 9 (60.00%) Social Skills
2 5 (33.33%) Analytical Skills
3 3 (20.00%) Marketing
3 3 (20.00%) Presentation Skills
3 3 (20.00%) Retail
4 2 (13.33%) Finance
5 1 (6.67%) Banking
5 1 (6.67%) Public Sector
Job Titles
1 8 (53.33%) Data Engineer
2 5 (33.33%) Architect
2 5 (33.33%) Data Architect
3 3 (20.00%) Data Manager
4 1 (6.67%) Azure Data Engineer
4 1 (6.67%) Azure Engineer
4 1 (6.67%) Data Migration Architect
4 1 (6.67%) Lead
4 1 (6.67%) Lead Data Engineer
4 1 (6.67%) Migration Architect
4 1 (6.67%) Senior
4 1 (6.67%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 14 (93.33%) PySpark
2 3 (20.00%) XGBoost
3 1 (6.67%) Kafka
3 1 (6.67%) YAML
Miscellaneous
1 5 (33.33%) Product Ownership
2 4 (26.67%) Low-Code
3 1 (6.67%) Cloud Native
Processes & Methodologies
1 11 (73.33%) Data Pipeline
2 9 (60.00%) Data Transformation
3 7 (46.67%) Data Engineering
3 7 (46.67%) Data Integration
3 7 (46.67%) Data Modelling
3 7 (46.67%) Migration
4 6 (40.00%) Agile
4 6 (40.00%) CI/CD
4 6 (40.00%) Data Governance
4 6 (40.00%) Problem-Solving
5 5 (33.33%) Data Architecture
5 5 (33.33%) Metadata Management
5 5 (33.33%) Ontologies
6 4 (26.67%) Analytics
6 4 (26.67%) Artificial Intelligence
6 4 (26.67%) Data Analysis
6 4 (26.67%) Data Science
6 4 (26.67%) Machine Learning
6 4 (26.67%) Reverse Engineering
6 4 (26.67%) Stakeholder Management
Programming Languages
1 15 (100.00%) SQL
2 14 (93.33%) Python
3 4 (26.67%) Java
4 1 (6.67%) JavaScript
4 1 (6.67%) R
4 1 (6.67%) Scala
Qualifications
1 7 (46.67%) SC Cleared
1 7 (46.67%) Security Cleared
2 3 (20.00%) Azure Certification
2 3 (20.00%) DBS Check
3 1 (6.67%) Computer Science Degree
3 1 (6.67%) Degree
Quality Assurance & Compliance
1 3 (20.00%) Data Quality
System Software
1 1 (6.67%) Docker
Systems Management
1 1 (6.67%) Kubernetes
Vendors
1 6 (40.00%) Databricks
2 5 (33.33%) Foundry
2 5 (33.33%) Palantir
3 4 (26.67%) Google
3 4 (26.67%) Microsoft