Apache Spark Contracts in England

Apache Spark
UK > England

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 14 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
14 May 2024
Same period 2023 Same period 2022
Rank 352 319 248
Rank change year-on-year -33 -71 -72
Contract jobs citing Apache Spark 186 370 800
As % of all contract jobs advertised in England 0.51% 0.76% 1.13%
As % of the Application Platforms category 5.36% 7.10% 9.03%
Number of daily rates quoted 137 254 505
10th Percentile £375 £463 £438
25th Percentile £456 £513 £525
Median daily rate (50th Percentile) £525 £600 £600
Median % change year-on-year -12.50% - +6.67%
75th Percentile £650 £738 £711
90th Percentile £775 £796 £825
UK median daily rate £520 £600 £600
% change year-on-year -13.33% - +8.11%
Number of hourly rates quoted 3 7 3
10th Percentile £22.93 £70.50 £62.35
25th Percentile £24.74 £74.25 £68.50
Median hourly rate £30.50 £78.00 £78.75
Median % change year-on-year -60.90% -0.95% +110.00%
75th Percentile £51.00 £84.00 £84.83
90th Percentile £61.65 £90.00 £88.47
UK median hourly rate £30.50 £78.00 £78.75
% change year-on-year -60.90% -0.95% +191.67%

All Application Platform Skills
England

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 3,467 5,210 8,859
As % of all contract IT jobs advertised in England 9.51% 10.69% 12.51%
Number of daily rates quoted 2,482 3,730 6,095
10th Percentile £250 £263 £263
25th Percentile £363 £400 £405
Median daily rate (50th Percentile) £500 £525 £510
Median % change year-on-year -4.76% +2.94% +7.37%
75th Percentile £615 £650 £625
90th Percentile £775 £763 £725
UK median daily rate £500 £513 £513
% change year-on-year -2.44% - +7.89%
Number of hourly rates quoted 140 132 201
10th Percentile £13.00 £15.55 £13.50
25th Percentile £15.00 £18.50 £16.00
Median hourly rate £26.50 £35.00 £22.50
Median % change year-on-year -24.29% +55.56% +12.50%
75th Percentile £45.30 £66.00 £52.70
90th Percentile £68.88 £79.19 £75.00
UK median hourly rate £28.50 £45.00 £24.50
% change year-on-year -36.67% +83.67% +8.89%

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Apache Spark in England.

Daily rate trend for Apache Spark in England

Apache Spark
Daily Rate Histogram in England

Daily rate distribution for jobs citing Apache Spark in England over the 6 months to 14 May 2024.

Daily rate histogram for Apache Spark in England

Apache Spark
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Apache Spark in England.

Hourly rate trend for Apache Spark in England

Apache Spark
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Apache Spark in England over the 6 months to 14 May 2024.

Hourly rate histogram for Apache Spark in England

Apache Spark
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the England region over the 6 months to 14 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London -38 134 £555 -7.50% 77
North of England +45 29 £510 +7.37% 13
North West +37 15 £510 +7.37% 6
Yorkshire +31 13 £507 -3.43% 5
Midlands +32 12 £438 -30.00% 8
East Midlands - 9 £438 - 3
South East +14 6 £375 -41.75% 9
West Midlands +20 3 £535 -14.40% 5
East of England +7 1 £410 -28.70% 8
South West -12 1 £533 +2.90% 15
North East - 1 - - 2
Apache Spark
UK

Apache Spark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 54 (29.03%) Apache
2 24 (12.90%) Apache Airflow
3 1 (0.54%) Apache Pulsar
3 1 (0.54%) SAS
3 1 (0.54%) SharePoint
Applications
1 5 (2.69%) Microsoft Excel
2 2 (1.08%) Microsoft Office
2 2 (1.08%) Microsoft PowerPoint
Business Applications
1 2 (1.08%) Dynamics CRM
2 1 (0.54%) Aladdin
2 1 (0.54%) SAP GRC
Cloud Services
1 83 (44.62%) Azure
2 77 (41.40%) AWS
3 31 (16.67%) Serverless
4 27 (14.52%) Amazon EMR
5 26 (13.98%) Azure Data Factory
6 25 (13.44%) Amazon S3
6 25 (13.44%) GCP
7 22 (11.83%) Azure Synapse Analytics
8 21 (11.29%) Power Platform
9 20 (10.75%) AWS Lambda
9 20 (10.75%) Snowflake
10 12 (6.45%) Amazon EC2
11 11 (5.91%) Amazon Kinesis
12 10 (5.38%) Entra ID
13 9 (4.84%) Azure Logic Apps
13 9 (4.84%) Cloud Computing
14 8 (4.30%) GitHub
15 7 (3.76%) Azure Monitor
16 6 (3.23%) Azure Cosmos DB
16 6 (3.23%) Azure Data Lake Analytics
Communications & Networking
1 5 (2.69%) FTP
Database & Business Intelligence
1 105 (56.45%) Big Data
2 58 (31.18%) Hadoop
3 49 (26.34%) Data Lake
4 46 (24.73%) Data Warehouse
5 33 (17.74%) NoSQL
6 30 (16.13%) Amazon Redshift
6 30 (16.13%) Apache Hive
7 21 (11.29%) Power BI
8 17 (9.14%) Delta Lake
8 17 (9.14%) Impala
8 17 (9.14%) Relational Database
9 15 (8.06%) Spark SQL
9 15 (8.06%) SQL Server
10 14 (7.53%) BigQuery
11 13 (6.99%) Tableau
12 12 (6.45%) HBase
13 11 (5.91%) Amazon Athena
13 11 (5.91%) Azure SQL Database
14 9 (4.84%) Flink
14 9 (4.84%) Parquet
Development Applications
1 31 (16.67%) Git
2 18 (9.68%) Jenkins
3 14 (7.53%) JIRA
4 9 (4.84%) Maven
5 8 (4.30%) Subversion
6 5 (2.69%) TeamCity
7 4 (2.15%) Deequ
7 4 (2.15%) JUnit
8 3 (1.61%) Cypress.io
8 3 (1.61%) GitLab
8 3 (1.61%) Gradle
9 2 (1.08%) Android Studio
9 2 (1.08%) Ant
9 2 (1.08%) Jaeger
9 2 (1.08%) Liquibase
9 2 (1.08%) Mockito
9 2 (1.08%) ScalaTest
9 2 (1.08%) Visual Studio Code
10 1 (0.54%) CircleCI
10 1 (0.54%) Terragrunt
General
1 53 (28.49%) Social Skills
2 48 (25.81%) Finance
3 45 (24.19%) Analytical Skills
4 19 (10.22%) Banking
5 8 (4.30%) Investment Banking
5 8 (4.30%) Public Sector
6 6 (3.23%) Pharmaceutical
6 6 (3.23%) Presentation Skills
7 5 (2.69%) Manufacturing
7 5 (2.69%) Marketing
8 4 (2.15%) Inclusion and Diversity
9 3 (1.61%) Legal
10 2 (1.08%) Czech Language
10 2 (1.08%) Telecoms
11 1 (0.54%) Back Office
11 1 (0.54%) Corporate Banking
11 1 (0.54%) Games
11 1 (0.54%) Law
11 1 (0.54%) Police
11 1 (0.54%) Retail
Job Titles
1 71 (38.17%) Data Engineer
2 36 (19.35%) Developer
3 33 (17.74%) Architect
4 30 (16.13%) Senior
5 21 (11.29%) Solutions Architect
6 16 (8.60%) Azure Engineer
6 16 (8.60%) Senior Data Engineer
7 15 (8.06%) Azure Data Engineer
8 14 (7.53%) Scala Developer
9 13 (6.99%) Lead
10 11 (5.91%) Java Developer
11 10 (5.38%) Data Architect
12 9 (4.84%) AWS Architect
13 8 (4.30%) Analyst
13 8 (4.30%) AWS Solution Architect
13 8 (4.30%) Cloud Engineer
13 8 (4.30%) Data Analyst
13 8 (4.30%) Lead Data Engineer
14 6 (3.23%) AWS Engineer
14 6 (3.23%) Snowflake Data Engineer
Libraries, Frameworks & Software Standards
1 72 (38.71%) Kafka
2 47 (25.27%) PySpark
3 10 (5.38%) JSON
3 10 (5.38%) Spark Streaming
4 9 (4.84%) Apache Avro
5 8 (4.30%) SAML
6 7 (3.76%) Apache NiFi
7 5 (2.69%) JSON Schema
7 5 (2.69%) Web Services
7 5 (2.69%) XML
8 4 (2.15%) .NET
8 4 (2.15%) ARM Templates
8 4 (2.15%) Elastic Stack
8 4 (2.15%) Great Expectations
8 4 (2.15%) Pandas
8 4 (2.15%) Spring Boot
9 3 (1.61%) .NET Core
9 3 (1.61%) ADO
9 3 (1.61%) Spring
9 3 (1.61%) TensorFlow
Miscellaneous
1 14 (7.53%) Algorithms
2 8 (4.30%) Hedge funds
3 7 (3.76%) Cloud Native
4 6 (3.23%) Data Structures
5 4 (2.15%) Distributed Systems
6 3 (1.61%) Onboarding
6 3 (1.61%) Self-Motivation
7 2 (1.08%) Cyber Threat
7 2 (1.08%) Data Protection Act
7 2 (1.08%) Derivative
7 2 (1.08%) Distributed Computing
7 2 (1.08%) Life Science
7 2 (1.08%) Market Risk
7 2 (1.08%) Multi-touch
8 1 (0.54%) Analytical Mindset
8 1 (0.54%) Enterprise Software
8 1 (0.54%) Low-Code
8 1 (0.54%) Mobile App
8 1 (0.54%) NHS
8 1 (0.54%) Public Cloud
Operating Systems
1 13 (6.99%) Linux
2 8 (4.30%) Unix
3 2 (1.08%) Android
3 2 (1.08%) Red Hat Enterprise Linux
Processes & Methodologies
1 82 (44.09%) ETL
2 73 (39.25%) Data Pipeline
3 61 (32.80%) CI/CD
4 59 (31.72%) Agile
5 56 (30.11%) Analytics
6 50 (26.88%) Data Engineering
7 42 (22.58%) Data Modelling
7 42 (22.58%) DevOps
8 38 (20.43%) Problem-Solving
9 32 (17.20%) Business Intelligence
10 29 (15.59%) Continuous Integration
11 28 (15.05%) Data Science
12 26 (13.98%) Machine Learning
13 22 (11.83%) Data Integration
13 22 (11.83%) Test Automation
14 20 (10.75%) Containerisation
14 20 (10.75%) Software Engineering
15 18 (9.68%) Data Governance
16 17 (9.14%) Scrum
17 16 (8.60%) Unit Testing
Programming Languages
1 126 (67.74%) Python
2 103 (55.38%) SQL
3 74 (39.78%) Java
4 66 (35.48%) Scala
5 14 (7.53%) C#
6 9 (4.84%) Shell Script
7 8 (4.30%) C++
8 7 (3.76%) T-SQL
9 6 (3.23%) Bash
9 6 (3.23%) R
10 5 (2.69%) Perl
11 4 (2.15%) JavaScript
12 3 (1.61%) C
13 2 (1.08%) Groovy
13 2 (1.08%) Haskell
13 2 (1.08%) U-SQL
14 1 (0.54%) Bicep
14 1 (0.54%) Gremlin
14 1 (0.54%) PHP
14 1 (0.54%) TypeScript
Qualifications
1 15 (8.06%) Security Cleared
2 13 (6.99%) Degree
3 10 (5.38%) SC Cleared
4 7 (3.76%) Computer Science Degree
5 4 (2.15%) AWS Certification
5 4 (2.15%) Numerate Degree
6 3 (1.61%) Azure Certification
6 3 (1.61%) DV Cleared
7 2 (1.08%) AWS Certified Solutions Architect
7 2 (1.08%) BPSS Clearance
7 2 (1.08%) Master's Degree
7 2 (1.08%) Microsoft Certification
8 1 (0.54%) OCP
8 1 (0.54%) Oracle Certification
Quality Assurance & Compliance
1 27 (14.52%) Data Quality
2 4 (2.15%) GDPR
3 3 (1.61%) QA
4 2 (1.08%) California Consumer Privacy Act
5 1 (0.54%) Accessibility
5 1 (0.54%) GRC
System Software
1 14 (7.53%) HDFS
2 13 (6.99%) Docker
3 1 (0.54%) Apache Flume
3 1 (0.54%) Ceph
3 1 (0.54%) NFS
Systems Management
1 20 (10.75%) Terraform
2 19 (10.22%) Kubernetes
3 8 (4.30%) Hadoop YARN
4 4 (2.15%) Ansible
5 3 (1.61%) Grafana
5 3 (1.61%) Oozie
6 2 (1.08%) Ambari
6 2 (1.08%) Prometheus
6 2 (1.08%) Puppet
7 1 (0.54%) Docker Swarm
7 1 (0.54%) Ganglia
7 1 (0.54%) Kibana
7 1 (0.54%) Mesos
7 1 (0.54%) Podman
7 1 (0.54%) Progress Chef
7 1 (0.54%) RSA Archer
Vendors
1 51 (27.42%) Databricks
2 29 (15.59%) Microsoft
3 16 (8.60%) Google
3 16 (8.60%) Talend
4 14 (7.53%) Informatica
5 11 (5.91%) Oracle
6 9 (4.84%) Cloudera
7 6 (3.23%) Teradata
8 5 (2.69%) Splunk
9 3 (1.61%) Ab Initio
10 2 (1.08%) AppDynamics
10 2 (1.08%) CyberArk
10 2 (1.08%) SAP
11 1 (0.54%) Ariba
11 1 (0.54%) Confluent
11 1 (0.54%) Okta
11 1 (0.54%) OneTrust
11 1 (0.54%) Sage
11 1 (0.54%) Symantec
11 1 (0.54%) Varonis