Apache Spark Contracts in England

Apache Spark
UK > England

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 13 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
13 May 2024
Same period 2023 Same period 2022
Rank 365 314 248
Rank change year-on-year -51 -66 -70
Contract jobs citing Apache Spark 180 372 801
As % of all contract jobs advertised in England 0.49% 0.76% 1.13%
As % of the Application Platforms category 5.20% 7.04% 9.04%
Number of daily rates quoted 132 256 505
10th Percentile £375 £463 £438
25th Percentile £456 £513 £525
Median daily rate (50th Percentile) £529 £600 £600
Median % change year-on-year -11.88% - +6.67%
75th Percentile £675 £738 £711
90th Percentile £775 £794 £825
UK median daily rate £525 £600 £600
% change year-on-year -12.50% - +8.11%
Number of hourly rates quoted 3 7 3
10th Percentile £22.93 £70.50 £62.35
25th Percentile £24.74 £74.25 £68.50
Median hourly rate £30.50 £78.00 £78.75
Median % change year-on-year -60.90% -0.95% +110.00%
75th Percentile £51.00 £84.00 £84.83
90th Percentile £61.65 £90.00 £88.47
UK median hourly rate £30.50 £78.00 £78.75
% change year-on-year -60.90% -0.95% +191.67%

All Application Platform Skills
England

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 3,463 5,281 8,862
As % of all contract IT jobs advertised in England 9.47% 10.74% 12.52%
Number of daily rates quoted 2,484 3,782 6,097
10th Percentile £250 £263 £263
25th Percentile £363 £400 £405
Median daily rate (50th Percentile) £500 £525 £510
Median % change year-on-year -4.76% +2.94% +7.37%
75th Percentile £613 £650 £625
90th Percentile £775 £763 £725
UK median daily rate £500 £513 £513
% change year-on-year -2.44% - +7.89%
Number of hourly rates quoted 137 133 201
10th Percentile £13.00 £15.61 £13.50
25th Percentile £15.00 £18.50 £16.00
Median hourly rate £25.50 £35.00 £22.50
Median % change year-on-year -27.14% +55.56% +12.50%
75th Percentile £46.18 £66.00 £52.70
90th Percentile £69.25 £79.19 £75.00
UK median hourly rate £28.01 £45.00 £24.50
% change year-on-year -37.76% +83.67% +8.89%

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Apache Spark in England.

Daily rate trend for Apache Spark in England

Apache Spark
Daily Rate Histogram in England

Daily rate distribution for jobs citing Apache Spark in England over the 6 months to 13 May 2024.

Daily rate histogram for Apache Spark in England

Apache Spark
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Apache Spark in England.

Hourly rate trend for Apache Spark in England

Apache Spark
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Apache Spark in England over the 6 months to 13 May 2024.

Hourly rate histogram for Apache Spark in England

Apache Spark
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the England region over the 6 months to 13 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London -38 135 £558 -7.08% 93
North of England +35 22 £510 +7.37% 12
North West +33 15 £510 +7.37% 5
Midlands +40 12 £438 -30.00% 7
East Midlands - 9 £438 - 2
Yorkshire +23 6 £450 -14.29% 5
South East +10 6 £375 -41.75% 10
West Midlands +21 3 £535 -14.40% 5
East of England +1 1 £410 -28.70% 7
South West -5 1 £533 +2.90% 15
North East - 1 - - 2
Apache Spark
UK

Apache Spark
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (29.44%) Apache
2 24 (13.33%) Apache Airflow
3 1 (0.56%) Apache Pulsar
3 1 (0.56%) SAS
3 1 (0.56%) SharePoint
Applications
1 5 (2.78%) Microsoft Excel
2 2 (1.11%) Microsoft Office
2 2 (1.11%) Microsoft PowerPoint
Business Applications
1 2 (1.11%) Dynamics CRM
2 1 (0.56%) Aladdin
2 1 (0.56%) SAP GRC
Cloud Services
1 77 (42.78%) Azure
2 71 (39.44%) AWS
3 28 (15.56%) Amazon EMR
4 26 (14.44%) Azure Data Factory
4 26 (14.44%) Serverless
5 22 (12.22%) Azure Synapse Analytics
6 21 (11.67%) Amazon S3
6 21 (11.67%) Power Platform
7 20 (11.11%) AWS Lambda
7 20 (11.11%) Snowflake
8 19 (10.56%) GCP
9 13 (7.22%) Amazon EC2
10 11 (6.11%) Amazon Kinesis
11 10 (5.56%) Entra ID
12 9 (5.00%) Azure Logic Apps
13 8 (4.44%) GitHub
14 7 (3.89%) Azure Monitor
15 6 (3.33%) Amazon SQS
15 6 (3.33%) AWS CloudFormation
15 6 (3.33%) Azure Cosmos DB
Communications & Networking
1 5 (2.78%) FTP
Database & Business Intelligence
1 98 (54.44%) Big Data
2 52 (28.89%) Hadoop
3 45 (25.00%) Data Warehouse
4 44 (24.44%) Data Lake
5 33 (18.33%) NoSQL
6 30 (16.67%) Apache Hive
7 25 (13.89%) Amazon Redshift
8 21 (11.67%) Power BI
9 17 (9.44%) Delta Lake
9 17 (9.44%) Impala
9 17 (9.44%) Relational Database
10 15 (8.33%) Spark SQL
10 15 (8.33%) SQL Server
11 13 (7.22%) Tableau
12 12 (6.67%) HBase
13 11 (6.11%) Azure SQL Database
14 9 (5.00%) BigQuery
14 9 (5.00%) Parquet
15 8 (4.44%) Apache Cassandra
15 8 (4.44%) Flink
Development Applications
1 25 (13.89%) Git
2 14 (7.78%) JIRA
3 12 (6.67%) Jenkins
4 9 (5.00%) Maven
5 8 (4.44%) Subversion
6 5 (2.78%) TeamCity
7 4 (2.22%) Deequ
7 4 (2.22%) JUnit
8 3 (1.67%) Cypress.io
8 3 (1.67%) GitLab
8 3 (1.67%) Gradle
9 2 (1.11%) Android Studio
9 2 (1.11%) Ant
9 2 (1.11%) Jaeger
9 2 (1.11%) Liquibase
9 2 (1.11%) Mockito
9 2 (1.11%) ScalaTest
9 2 (1.11%) Visual Studio Code
10 1 (0.56%) GoCD
10 1 (0.56%) RStudio
General
1 53 (29.44%) Social Skills
2 49 (27.22%) Finance
3 45 (25.00%) Analytical Skills
4 17 (9.44%) Banking
5 8 (4.44%) Investment Banking
5 8 (4.44%) Public Sector
6 6 (3.33%) Pharmaceutical
6 6 (3.33%) Presentation Skills
7 5 (2.78%) Manufacturing
7 5 (2.78%) Marketing
8 4 (2.22%) Inclusion and Diversity
9 3 (1.67%) Legal
10 2 (1.11%) Czech Language
10 2 (1.11%) Telecoms
11 1 (0.56%) Back Office
11 1 (0.56%) Corporate Banking
11 1 (0.56%) Games
11 1 (0.56%) Law
11 1 (0.56%) Police
11 1 (0.56%) Retail
Job Titles
1 71 (39.44%) Data Engineer
2 36 (20.00%) Developer
3 30 (16.67%) Senior
4 26 (14.44%) Architect
5 16 (8.89%) Azure Engineer
5 16 (8.89%) Senior Data Engineer
6 15 (8.33%) Azure Data Engineer
6 15 (8.33%) Solutions Architect
7 14 (7.78%) Scala Developer
8 13 (7.22%) Lead
9 11 (6.11%) Java Developer
10 9 (5.00%) Cloud Engineer
10 9 (5.00%) Data Architect
11 8 (4.44%) Analyst
11 8 (4.44%) AWS Architect
11 8 (4.44%) AWS Solution Architect
11 8 (4.44%) Data Analyst
11 8 (4.44%) Lead Data Engineer
12 7 (3.89%) AWS Engineer
13 6 (3.33%) Snowflake Data Engineer
Libraries, Frameworks & Software Standards
1 66 (36.67%) Kafka
2 47 (26.11%) PySpark
3 10 (5.56%) JSON
3 10 (5.56%) Spark Streaming
4 9 (5.00%) Apache Avro
5 8 (4.44%) SAML
6 7 (3.89%) Apache NiFi
7 5 (2.78%) JSON Schema
7 5 (2.78%) Web Services
7 5 (2.78%) XML
8 4 (2.22%) .NET
8 4 (2.22%) ARM Templates
8 4 (2.22%) Elastic Stack
8 4 (2.22%) Great Expectations
8 4 (2.22%) Pandas
8 4 (2.22%) Spring Boot
9 3 (1.67%) .NET Core
9 3 (1.67%) ADO
9 3 (1.67%) Spring
9 3 (1.67%) TensorFlow
Miscellaneous
1 14 (7.78%) Algorithms
2 8 (4.44%) Hedge funds
3 7 (3.89%) Cloud Native
4 6 (3.33%) Data Structures
5 4 (2.22%) Distributed Systems
6 3 (1.67%) Onboarding
6 3 (1.67%) Self-Motivation
7 2 (1.11%) Cyber Threat
7 2 (1.11%) Data Protection Act
7 2 (1.11%) Derivative
7 2 (1.11%) Distributed Computing
7 2 (1.11%) Life Science
7 2 (1.11%) Market Risk
7 2 (1.11%) Multi-touch
8 1 (0.56%) Enterprise Software
8 1 (0.56%) Low-Code
8 1 (0.56%) Mobile App
8 1 (0.56%) NHS
8 1 (0.56%) Public Cloud
8 1 (0.56%) Virtual Team
Operating Systems
1 13 (7.22%) Linux
2 8 (4.44%) Unix
3 2 (1.11%) Android
3 2 (1.11%) Red Hat Enterprise Linux
Processes & Methodologies
1 77 (42.78%) ETL
2 74 (41.11%) Data Pipeline
3 62 (34.44%) CI/CD
4 59 (32.78%) Agile
5 52 (28.89%) Analytics
6 51 (28.33%) Data Engineering
7 38 (21.11%) Problem-Solving
8 36 (20.00%) Data Modelling
8 36 (20.00%) DevOps
9 32 (17.78%) Business Intelligence
10 29 (16.11%) Continuous Integration
11 28 (15.56%) Data Science
12 26 (14.44%) Machine Learning
13 22 (12.22%) Test Automation
14 21 (11.67%) Software Engineering
15 17 (9.44%) Scrum
16 16 (8.89%) Data Integration
16 16 (8.89%) Performance Tuning
16 16 (8.89%) Unit Testing
17 15 (8.33%) SDLC
Programming Languages
1 120 (66.67%) Python
2 98 (54.44%) SQL
3 68 (37.78%) Java
4 66 (36.67%) Scala
5 14 (7.78%) C#
6 9 (5.00%) Shell Script
7 8 (4.44%) C++
8 7 (3.89%) T-SQL
9 6 (3.33%) Bash
9 6 (3.33%) R
10 5 (2.78%) Perl
11 4 (2.22%) JavaScript
12 3 (1.67%) C
13 2 (1.11%) Groovy
13 2 (1.11%) Haskell
13 2 (1.11%) U-SQL
14 1 (0.56%) Bicep
14 1 (0.56%) Gremlin
14 1 (0.56%) PHP
14 1 (0.56%) TypeScript
Qualifications
1 15 (8.33%) Security Cleared
2 13 (7.22%) Degree
3 10 (5.56%) SC Cleared
4 7 (3.89%) Computer Science Degree
5 4 (2.22%) Numerate Degree
6 3 (1.67%) AWS Certification
6 3 (1.67%) Azure Certification
6 3 (1.67%) DV Cleared
7 2 (1.11%) AWS Certified Solutions Architect
7 2 (1.11%) BPSS Clearance
7 2 (1.11%) Master's Degree
7 2 (1.11%) Microsoft Certification
8 1 (0.56%) OCP
8 1 (0.56%) Oracle Certification
Quality Assurance & Compliance
1 27 (15.00%) Data Quality
2 4 (2.22%) GDPR
3 3 (1.67%) QA
4 2 (1.11%) California Consumer Privacy Act
5 1 (0.56%) Accessibility
5 1 (0.56%) GRC
System Software
1 14 (7.78%) HDFS
2 13 (7.22%) Docker
3 1 (0.56%) Apache Flume
3 1 (0.56%) Ceph
3 1 (0.56%) NFS
Systems Management
1 19 (10.56%) Kubernetes
2 14 (7.78%) Terraform
3 8 (4.44%) Hadoop YARN
4 4 (2.22%) Ansible
5 3 (1.67%) Grafana
5 3 (1.67%) Oozie
6 2 (1.11%) Ambari
6 2 (1.11%) Prometheus
6 2 (1.11%) Puppet
7 1 (0.56%) Docker Swarm
7 1 (0.56%) Ganglia
7 1 (0.56%) Kibana
7 1 (0.56%) Mesos
7 1 (0.56%) Podman
7 1 (0.56%) Progress Chef
7 1 (0.56%) RSA Archer
Vendors
1 51 (28.33%) Databricks
2 24 (13.33%) Microsoft
3 16 (8.89%) Talend
4 14 (7.78%) Informatica
5 11 (6.11%) Google
5 11 (6.11%) Oracle
6 9 (5.00%) Cloudera
7 6 (3.33%) Teradata
8 5 (2.78%) Splunk
9 3 (1.67%) Ab Initio
10 2 (1.11%) AppDynamics
10 2 (1.11%) CyberArk
10 2 (1.11%) SAP
11 1 (0.56%) Ariba
11 1 (0.56%) Confluent
11 1 (0.56%) Okta
11 1 (0.56%) OneTrust
11 1 (0.56%) Sage
11 1 (0.56%) Symantec
11 1 (0.56%) Varonis