Apache Spark Contracts in England

Apache Spark
UK > England

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 363 329 245
Rank change year-on-year -34 -84 -65
Contract jobs citing Apache Spark 174 379 836
As % of all contract jobs advertised in England 0.47% 0.75% 1.18%
As % of the Application Platforms category 5.07% 6.92% 9.39%
Number of daily rates quoted 128 257 525
10th Percentile £375 £470 £438
25th Percentile £450 £513 £525
Median daily rate (50th Percentile) £525 £600 £613
Median % change year-on-year -12.50% -2.04% +6.52%
75th Percentile £675 £725 £711
90th Percentile £775 £788 £815
UK median daily rate £510 £600 £600
% change year-on-year -15.00% - +6.67%
Number of hourly rates quoted 3 5 3
10th Percentile £22.93 - £62.35
25th Percentile £24.74 £70.50 £68.50
Median hourly rate £30.50 £78.00 £78.75
Median % change year-on-year -60.90% -0.95% +86.39%
75th Percentile £51.00 - £84.83
90th Percentile £61.65 - £88.47
UK median hourly rate £30.50 £78.00 £78.75
% change year-on-year -60.90% -0.95% +86.39%

All Application Platform Skills
England

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 3,433 5,476 8,907
As % of all contract IT jobs advertised in England 9.29% 10.83% 12.52%
Number of daily rates quoted 2,453 3,934 6,115
10th Percentile £250 £261 £263
25th Percentile £358 £400 £405
Median daily rate (50th Percentile) £500 £525 £513
Median % change year-on-year -4.76% +2.44% +7.89%
75th Percentile £600 £650 £625
90th Percentile £750 £755 £725
UK median daily rate £500 £510 £520
% change year-on-year -1.96% -1.92% +9.47%
Number of hourly rates quoted 139 131 189
10th Percentile £13.00 £15.10 £13.97
25th Percentile £15.00 £18.00 £16.00
Median hourly rate £27.50 £32.50 £21.00
Median % change year-on-year -15.38% +54.76% -1.89%
75th Percentile £45.59 £66.00 £45.00
90th Percentile £65.00 £80.25 £65.90
UK median hourly rate £27.52 £42.50 £22.00
% change year-on-year -35.26% +93.18% -2.22%

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Apache Spark in England.

Daily rate trend for Apache Spark in England

Apache Spark
Daily Rate Histogram in England

Daily rate distribution for jobs citing Apache Spark in England over the 6 months to 27 April 2024.

Daily rate histogram for Apache Spark in England

Apache Spark
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Apache Spark in England.

Hourly rate trend for Apache Spark in England

Apache Spark
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Apache Spark in England over the 6 months to 27 April 2024.

Hourly rate histogram for Apache Spark in England

Apache Spark
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the England region over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London -44 124 £550 -8.33% 79
North of England +42 20 £510 +7.37% 14
North West +23 14 £510 +7.37% 8
Midlands +30 12 £425 -32.00% 5
East Midlands - 8 £438 - 2
East of England +16 7 £355 -38.26% 9
South East +13 6 £375 -42.31% 6
Yorkshire +21 5 £425 -19.05% 3
West Midlands +29 4 £420 -32.80% 3
South West +4 1 £533 +2.90% 9
North East - 1 - - 3
Apache Spark
UK

Apache Spark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 55 (31.61%) Apache
2 26 (14.94%) Apache Airflow
3 2 (1.15%) SAS
4 1 (0.57%) Apache Pulsar
4 1 (0.57%) Luigi
Applications
1 5 (2.87%) Microsoft Excel
2 2 (1.15%) Microsoft Office
2 2 (1.15%) Microsoft PowerPoint
Business Applications
1 2 (1.15%) Dynamics CRM
2 1 (0.57%) Aladdin
2 1 (0.57%) SAP GRC
Cloud Services
1 70 (40.23%) AWS
2 67 (38.51%) Azure
3 31 (17.82%) Amazon EMR
4 28 (16.09%) Serverless
5 24 (13.79%) Amazon S3
5 24 (13.79%) AWS Lambda
6 23 (13.22%) Azure Data Factory
7 20 (11.49%) GCP
7 20 (11.49%) Power Platform
8 19 (10.92%) Snowflake
9 18 (10.34%) Azure Synapse Analytics
10 17 (9.77%) Amazon EC2
11 11 (6.32%) Amazon Kinesis
12 10 (5.75%) Amazon SQS
13 9 (5.17%) Entra ID
14 7 (4.02%) GitHub
15 6 (3.45%) Azure Logic Apps
15 6 (3.45%) Azure Monitor
16 5 (2.87%) AWS CloudFormation
16 5 (2.87%) Azure Cosmos DB
Communications & Networking
1 5 (2.87%) FTP
Database & Business Intelligence
1 97 (55.75%) Big Data
2 54 (31.03%) Hadoop
3 38 (21.84%) Data Lake
3 38 (21.84%) Data Warehouse
4 32 (18.39%) NoSQL
5 31 (17.82%) Apache Hive
6 22 (12.64%) Amazon Redshift
7 20 (11.49%) Power BI
8 18 (10.34%) Relational Database
9 16 (9.20%) Impala
10 15 (8.62%) SQL Server
10 15 (8.62%) Tableau
11 13 (7.47%) Delta Lake
11 13 (7.47%) HBase
11 13 (7.47%) Spark SQL
12 9 (5.17%) Apache Cassandra
13 8 (4.60%) BigQuery
13 8 (4.60%) Flink
13 8 (4.60%) Sqoop
14 7 (4.02%) MongoDB
Development Applications
1 27 (15.52%) Git
2 19 (10.92%) JIRA
3 14 (8.05%) Jenkins
4 12 (6.90%) Maven
5 8 (4.60%) Subversion
6 5 (2.87%) TeamCity
7 4 (2.30%) JUnit
8 3 (1.72%) Cypress.io
8 3 (1.72%) Deequ
8 3 (1.72%) GitLab
8 3 (1.72%) Gradle
9 2 (1.15%) Android Studio
9 2 (1.15%) Ant
9 2 (1.15%) Jaeger
9 2 (1.15%) Liquibase
9 2 (1.15%) Mockito
9 2 (1.15%) ScalaTest
9 2 (1.15%) Visual Studio Code
10 1 (0.57%) CircleCI
10 1 (0.57%) ERwin
General
1 54 (31.03%) Social Skills
2 44 (25.29%) Analytical Skills
3 43 (24.71%) Finance
4 15 (8.62%) Banking
5 8 (4.60%) Public Sector
6 7 (4.02%) Investment Banking
7 6 (3.45%) Pharmaceutical
8 5 (2.87%) Manufacturing
8 5 (2.87%) Marketing
8 5 (2.87%) Presentation Skills
9 4 (2.30%) Inclusion and Diversity
10 3 (1.72%) Legal
11 2 (1.15%) Czech Language
11 2 (1.15%) Telecoms
12 1 (0.57%) Back Office
12 1 (0.57%) Corporate Banking
12 1 (0.57%) Games
12 1 (0.57%) Law
12 1 (0.57%) Public Speaking
12 1 (0.57%) Retail
Job Titles
1 67 (38.51%) Data Engineer
2 36 (20.69%) Developer
3 27 (15.52%) Senior
4 26 (14.94%) Architect
5 14 (8.05%) Solutions Architect
6 13 (7.47%) Lead
6 13 (7.47%) Senior Data Engineer
7 12 (6.90%) Java Developer
7 12 (6.90%) Scala Developer
8 11 (6.32%) Azure Engineer
9 10 (5.75%) Azure Data Engineer
9 10 (5.75%) Data Architect
10 9 (5.17%) Cloud Engineer
11 8 (4.60%) AWS Architect
11 8 (4.60%) AWS Solution Architect
11 8 (4.60%) Lead Data Engineer
12 6 (3.45%) Analyst
12 6 (3.45%) Data Analyst
12 6 (3.45%) Software Engineer
13 5 (2.87%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 65 (37.36%) Kafka
2 37 (21.26%) PySpark
3 9 (5.17%) JSON
4 8 (4.60%) SAML
5 7 (4.02%) Apache NiFi
6 6 (3.45%) Apache Avro
6 6 (3.45%) Spark Streaming
7 5 (2.87%) Elastic Stack
7 5 (2.87%) XML
8 4 (2.30%) JSON Schema
8 4 (2.30%) Pandas
8 4 (2.30%) Spring Boot
8 4 (2.30%) Web Services
9 3 (1.72%) .NET
9 3 (1.72%) .NET Core
9 3 (1.72%) ARM Templates
9 3 (1.72%) Great Expectations
9 3 (1.72%) REST
9 3 (1.72%) Spring
9 3 (1.72%) TensorFlow
Miscellaneous
1 14 (8.05%) Algorithms
2 7 (4.02%) Cloud Native
2 7 (4.02%) Data Structures
3 5 (2.87%) Hedge funds
4 4 (2.30%) Distributed Computing
4 4 (2.30%) Distributed Systems
4 4 (2.30%) Self-Motivation
5 3 (1.72%) Data Protection Act
5 3 (1.72%) Onboarding
6 2 (1.15%) Cyber Threat
6 2 (1.15%) Derivative
6 2 (1.15%) Life Science
6 2 (1.15%) Market Risk
6 2 (1.15%) Multi-touch
7 1 (0.57%) Analytical Mindset
7 1 (0.57%) Enterprise Software
7 1 (0.57%) Low-Code
7 1 (0.57%) Mobile App
7 1 (0.57%) NHS
7 1 (0.57%) Public Cloud
Operating Systems
1 15 (8.62%) Linux
2 10 (5.75%) Unix
3 2 (1.15%) Android
3 2 (1.15%) Red Hat Enterprise Linux
Processes & Methodologies
1 75 (43.10%) ETL
2 69 (39.66%) Data Pipeline
3 59 (33.91%) CI/CD
4 57 (32.76%) Agile
5 46 (26.44%) Analytics
6 44 (25.29%) Data Engineering
7 38 (21.84%) Problem-Solving
8 36 (20.69%) Data Modelling
9 30 (17.24%) Data Science
9 30 (17.24%) DevOps
10 29 (16.67%) Business Intelligence
11 23 (13.22%) Continuous Integration
11 23 (13.22%) Machine Learning
12 21 (12.07%) Software Engineering
13 20 (11.49%) Data Integration
14 18 (10.34%) SDLC
14 18 (10.34%) Test Automation
15 17 (9.77%) Scrum
16 16 (9.20%) Computer Science
17 15 (8.62%) Data Analysis
Programming Languages
1 118 (67.82%) Python
2 94 (54.02%) SQL
3 71 (40.80%) Java
4 65 (37.36%) Scala
5 12 (6.90%) C#
6 9 (5.17%) Shell Script
7 7 (4.02%) R
8 6 (3.45%) Bash
8 6 (3.45%) C++
9 5 (2.87%) Perl
10 4 (2.30%) T-SQL
11 3 (1.72%) JavaScript
12 2 (1.15%) C
12 2 (1.15%) Groovy
12 2 (1.15%) Haskell
12 2 (1.15%) U-SQL
13 1 (0.57%) ANSI SQL
13 1 (0.57%) Bicep
13 1 (0.57%) Gremlin
13 1 (0.57%) TypeScript
Qualifications
1 17 (9.77%) Security Cleared
2 15 (8.62%) Degree
3 13 (7.47%) SC Cleared
4 8 (4.60%) Computer Science Degree
5 4 (2.30%) Numerate Degree
6 3 (1.72%) AWS Certification
6 3 (1.72%) DV Cleared
6 3 (1.72%) Master's Degree
7 2 (1.15%) AWS Certified Solutions Architect
7 2 (1.15%) Azure Certification
7 2 (1.15%) BPSS Clearance
8 1 (0.57%) Microsoft Certification
8 1 (0.57%) OCP
8 1 (0.57%) Oracle Certification
Quality Assurance & Compliance
1 26 (14.94%) Data Quality
2 4 (2.30%) GDPR
2 4 (2.30%) QA
3 2 (1.15%) California Consumer Privacy Act
4 1 (0.57%) Accessibility
4 1 (0.57%) GRC
System Software
1 15 (8.62%) HDFS
2 13 (7.47%) Docker
3 1 (0.57%) Apache Flume
3 1 (0.57%) Apache ZooKeeper
3 1 (0.57%) Ceph
3 1 (0.57%) NFS
Systems Management
1 19 (10.92%) Kubernetes
2 14 (8.05%) Terraform
3 9 (5.17%) Hadoop YARN
4 4 (2.30%) Ansible
5 3 (1.72%) Grafana
5 3 (1.72%) Oozie
6 2 (1.15%) Ambari
6 2 (1.15%) Prometheus
6 2 (1.15%) Puppet
7 1 (0.57%) Docker Swarm
7 1 (0.57%) Ganglia
7 1 (0.57%) Kibana
7 1 (0.57%) Mesos
7 1 (0.57%) Podman
7 1 (0.57%) Progress Chef
7 1 (0.57%) RSA Archer
Vendors
1 44 (25.29%) Databricks
2 20 (11.49%) Microsoft
3 18 (10.34%) Talend
4 17 (9.77%) Informatica
5 11 (6.32%) Cloudera
5 11 (6.32%) Oracle
6 10 (5.75%) Google
7 7 (4.02%) Teradata
8 5 (2.87%) Splunk
9 4 (2.30%) SAP
10 3 (1.72%) Ab Initio
11 2 (1.15%) AppDynamics
11 2 (1.15%) CyberArk
12 1 (0.57%) Ariba
12 1 (0.57%) Confluent
12 1 (0.57%) Okta
12 1 (0.57%) OneTrust
12 1 (0.57%) Sybase
12 1 (0.57%) Symantec
12 1 (0.57%) Varonis