Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 8 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
8 May 2024
Same period 2023 Same period 2022
Rank 243 225 145
Rank change year-on-year -18 -80 -31
Contract jobs citing Big Data 412 686 1,660
As % of all contract jobs advertised in the UK 0.96% 1.18% 1.89%
As % of the Database & Business Intelligence category 5.64% 6.57% 9.40%
Number of daily rates quoted 305 463 1,059
10th Percentile £388 £463 £450
25th Percentile £469 £509 £513
Median daily rate (50th Percentile) £588 £600 £600
Median % change year-on-year -2.08% - +6.67%
75th Percentile £744 £719 £700
90th Percentile £838 £800 £788
UK excluding London median daily rate £550 £550 £550
% change year-on-year - - +3.53%
Number of hourly rates quoted 12 20 3
10th Percentile £18.20 £35.00 £59.40
25th Percentile £23.30 £57.41 £59.63
Median hourly rate £35.25 £78.00 £60.50
Median % change year-on-year -54.81% +28.93% +77.94%
75th Percentile £44.69 £84.38 £76.33
90th Percentile £52.00 £90.00 £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,303 10,437 17,652
As % of all contract IT jobs advertised in the UK 16.94% 17.97% 20.07%
Number of daily rates quoted 5,214 7,433 12,551
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £550
Median % change year-on-year -2.78% -1.82% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.00%
Number of hourly rates quoted 145 186 184
10th Percentile £14.00 £21.24 £14.69
25th Percentile £20.98 £33.05 £21.69
Median hourly rate £40.00 £59.30 £42.92
Median % change year-on-year -32.54% +38.16% +59.07%
75th Percentile £61.60 £73.41 £62.24
90th Percentile £74.00 £81.25 £74.85
UK excluding London median hourly rate £40.00 £55.70 £35.00
% change year-on-year -28.19% +59.14% +42.86%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 8 May 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 8 May 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 8 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -42 358 £600 - 193
London -33 241 £650 +8.33% 109
Work from Home +9 143 £616 +4.89% 91
UK excluding London +63 126 £550 - 100
Midlands +47 35 £650 +23.81% 20
North of England +39 32 £550 - 17
South East -4 26 £437 -16.86% 15
West Midlands +34 23 £675 +22.73% 17
Scotland +49 18 £550 -21.43% 14
North West +25 17 £510 +7.37% 8
Yorkshire +36 15 £563 +2.27% 6
East Midlands +27 12 £513 +2.50% 3
East of England -2 5 £400 -33.33% 11
South West -11 5 £450 -21.74% 16
Northern Ireland - 5 £494 - 7

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 120 (29.13%) Apache Spark
2 46 (11.17%) Apache Airflow
3 42 (10.19%) Apache
4 6 (1.46%) Confluence
5 4 (0.97%) IIS
5 4 (0.97%) Microsoft Exchange
6 2 (0.49%) ArcGIS
6 2 (0.49%) Jupyter
7 1 (0.24%) Apache Pulsar
7 1 (0.24%) Apache Solr
7 1 (0.24%) Cloud Foundry
7 1 (0.24%) nginx
7 1 (0.24%) SAS
7 1 (0.24%) Tornado
Applications
1 13 (3.16%) Microsoft Excel
2 3 (0.73%) Spreadsheet
3 1 (0.24%) Microsoft PowerPoint
Cloud Services
1 149 (36.17%) AWS
2 144 (34.95%) Azure
3 65 (15.78%) GCP
4 52 (12.62%) Power Platform
5 45 (10.92%) Serverless
6 35 (8.50%) Snowflake
7 31 (7.52%) AWS Lambda
7 31 (7.52%) Azure Data Factory
8 26 (6.31%) Amazon S3
9 23 (5.58%) Azure Synapse Analytics
10 21 (5.10%) dbt
11 20 (4.85%) Amazon EMR
12 16 (3.88%) Azure DevOps
13 15 (3.64%) Azure Logic Apps
14 12 (2.91%) Amazon EC2
14 12 (2.91%) Entra ID
14 12 (2.91%) GitHub
15 11 (2.67%) Azure Key Vault
16 9 (2.18%) Azure Service Bus
16 9 (2.18%) Power Automate
Communications & Networking
1 15 (3.64%) Intrusion Detection
1 15 (3.64%) Network Security
2 5 (1.21%) FTP
3 4 (0.97%) SAN
4 2 (0.49%) Internet
5 1 (0.24%) Broadband
5 1 (0.24%) Firewall
5 1 (0.24%) Wireless
Database & Business Intelligence
1 100 (24.27%) Data Warehouse
2 97 (23.54%) Data Lake
3 70 (16.99%) Hadoop
4 46 (11.17%) Power BI
5 39 (9.47%) Apache Hive
6 34 (8.25%) Tableau
7 30 (7.28%) Amazon Athena
7 30 (7.28%) Amazon Redshift
8 24 (5.83%) BigQuery
8 24 (5.83%) NoSQL
8 24 (5.83%) SQL Server
9 22 (5.34%) Impala
10 21 (5.10%) Relational Database
11 19 (4.61%) Delta Lake
12 16 (3.88%) Spark SQL
13 15 (3.64%) Metadata
14 14 (3.40%) Apache Arrow
14 14 (3.40%) Dremio
15 12 (2.91%) HBase
15 12 (2.91%) OLTP
Development Applications
1 38 (9.22%) Git
2 24 (5.83%) JIRA
3 8 (1.94%) Maven
4 6 (1.46%) Subversion
4 6 (1.46%) Visual Studio Team System
5 5 (1.21%) Cypress.io
5 5 (1.21%) ERwin
5 5 (1.21%) Jenkins
5 5 (1.21%) TeamCity
6 4 (0.97%) Bitbucket
6 4 (0.97%) Team Foundation Server
7 3 (0.73%) GitLab
7 3 (0.73%) JMeter
7 3 (0.73%) LoadRunner
7 3 (0.73%) RStudio
7 3 (0.73%) Selenium
8 2 (0.49%) CircleCI
8 2 (0.49%) kappa
8 2 (0.49%) Liquibase
8 2 (0.49%) Poetry
General
1 102 (24.76%) Analytical Skills
1 102 (24.76%) Social Skills
2 90 (21.84%) Finance
3 36 (8.74%) Banking
4 29 (7.04%) Public Sector
5 16 (3.88%) Investment Banking
6 10 (2.43%) Presentation Skills
7 9 (2.18%) Pharmaceutical
8 8 (1.94%) Marketing
9 7 (1.70%) Financial Institution
9 7 (1.70%) Health Technology
9 7 (1.70%) Manufacturing
10 6 (1.46%) Retail
11 5 (1.21%) Legal
11 5 (1.21%) Telecoms
12 4 (0.97%) Publishing
13 3 (0.73%) Back Office
13 3 (0.73%) Documentation Skills
13 3 (0.73%) Police
14 2 (0.49%) German Language
Job Titles
1 96 (23.30%) Architect
2 91 (22.09%) Data Engineer
3 52 (12.62%) Developer
4 46 (11.17%) Data Architect
5 36 (8.74%) Solutions Architect
6 35 (8.50%) Senior
7 34 (8.25%) Analyst
8 24 (5.83%) Big Data Engineer
9 23 (5.58%) Cloud Architect
9 23 (5.58%) Lead
10 21 (5.10%) AWS Engineer
10 21 (5.10%) Data Analyst
11 19 (4.61%) Cloud Solutions Architect
12 18 (4.37%) Azure Architect
12 18 (4.37%) Data Scientist
13 16 (3.88%) AWS Architect
13 16 (3.88%) Azure Engineer
13 16 (3.88%) Consultant
14 15 (3.64%) Site Engineer
14 15 (3.64%) Site Reliability Engineer
Libraries, Frameworks & Software Standards
1 66 (16.02%) PySpark
2 43 (10.44%) Kafka
3 22 (5.34%) Apache NiFi
4 16 (3.88%) JSON
4 16 (3.88%) XML
5 14 (3.40%) gRPC
5 14 (3.40%) Pandas
5 14 (3.40%) Protocol Buffers
6 11 (2.67%) .NET
7 10 (2.43%) TensorFlow
7 10 (2.43%) Web Services
8 8 (1.94%) Apache Avro
8 8 (1.94%) SAML
9 7 (1.70%) REST
9 7 (1.70%) scikit-learn
10 6 (1.46%) ARM Templates
10 6 (1.46%) Elastic Stack
10 6 (1.46%) NumPy
11 5 (1.21%) React
12 4 (0.97%) .NET Core
Miscellaneous
1 31 (7.52%) Algorithms
2 23 (5.58%) Hedge funds
2 23 (5.58%) Management Information System
3 19 (4.61%) Clustering
4 15 (3.64%) Cyber Defence
4 15 (3.64%) Distributed Applications
5 14 (3.40%) Data Structures
6 13 (3.16%) Data Centre
6 13 (3.16%) Data Protection Act
6 13 (3.16%) Greenfield Project
7 11 (2.67%) Cloud Native
7 11 (2.67%) Distributed Computing
8 9 (2.18%) Freedom of Information
8 9 (2.18%) Freedom of Information Act
8 9 (2.18%) Virtual Team
9 7 (1.70%) Product Ownership
10 6 (1.46%) Analytical Mindset
10 6 (1.46%) Distributed Systems
10 6 (1.46%) Onboarding
11 5 (1.21%) Self-Motivation
Operating Systems
1 48 (11.65%) Linux
2 30 (7.28%) Unix
3 17 (4.13%) Windows
4 13 (3.16%) Android
4 13 (3.16%) Apple iOS
5 8 (1.94%) VMS
6 4 (0.97%) Windows Server
6 4 (0.97%) Windows Server 2016
6 4 (0.97%) Windows Server 2019
Processes & Methodologies
1 128 (31.07%) Analytics
2 127 (30.83%) Data Modelling
3 118 (28.64%) Data Pipeline
4 111 (26.94%) ETL
5 106 (25.73%) Agile
6 88 (21.36%) Business Intelligence
7 81 (19.66%) Data Engineering
8 77 (18.69%) Machine Learning
9 67 (16.26%) Problem-Solving
10 66 (16.02%) Data Science
11 64 (15.53%) Data Analysis
11 64 (15.53%) DevOps
12 62 (15.05%) CI/CD
13 48 (11.65%) Data Management
14 46 (11.17%) Computer Science
14 46 (11.17%) Migration
15 43 (10.44%) Data Governance
16 41 (9.95%) Visualisation
17 40 (9.71%) Data Architecture
18 38 (9.22%) Scrum
Programming Languages
1 223 (54.13%) Python
2 182 (44.17%) SQL
3 77 (18.69%) Java
4 62 (15.05%) Scala
5 22 (5.34%) JavaScript
6 21 (5.10%) R
7 19 (4.61%) PowerShell
8 17 (4.13%) Go
9 16 (3.88%) C#
10 12 (2.91%) Shell Script
11 7 (1.70%) Perl
12 5 (1.21%) Bash
13 3 (0.73%) Data Analysis Expressions
13 3 (0.73%) PL/SQL
14 2 (0.49%) T-SQL
14 2 (0.49%) U-SQL
14 2 (0.49%) VBA
15 1 (0.24%) C++
15 1 (0.24%) Groovy
15 1 (0.24%) Tcl
Qualifications
1 53 (12.86%) Degree
1 53 (12.86%) Security Cleared
2 31 (7.52%) DV Cleared
3 30 (7.28%) SC Cleared
4 21 (5.10%) Computer Science Degree
5 18 (4.37%) AWS Certification
6 11 (2.67%) Master's Degree
7 8 (1.94%) Azure Certification
8 5 (1.21%) AWS Certified Solutions Architect
8 5 (1.21%) Microsoft Certification
9 4 (0.97%) CISSP
10 3 (0.73%) AWS Certified Developer
10 3 (0.73%) AWS Certified DevOps Engineer
10 3 (0.73%) BPSS Clearance
11 2 (0.49%) Numerate Degree
12 1 (0.24%) PhD
Quality Assurance & Compliance
1 64 (15.53%) Data Quality
2 15 (3.64%) Actionable Recommendations
3 9 (2.18%) QA
4 5 (1.21%) Accessibility
5 4 (0.97%) ISO/IEC 27001
5 4 (0.97%) NIST
6 3 (0.73%) GDPR
7 2 (0.49%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.49%) MiFID
7 2 (0.49%) NCSC
7 2 (0.49%) PCI DSS
7 2 (0.49%) PMO
7 2 (0.49%) SLA
8 1 (0.24%) EMIR
8 1 (0.24%) FATCA
System Software
1 16 (3.88%) Docker
2 15 (3.64%) HDFS
3 4 (0.97%) Active Directory
4 2 (0.49%) Apache ZooKeeper
5 1 (0.24%) Apache Flume
5 1 (0.24%) KVM
5 1 (0.24%) VMware ESXi
5 1 (0.24%) VMware Infrastructure
Systems Management
1 53 (12.86%) Terraform
2 42 (10.19%) Kubernetes
3 21 (5.10%) Ansible
4 15 (3.64%) Prometheus
4 15 (3.64%) Puppet
5 9 (2.18%) Hadoop YARN
6 4 (0.97%) Argo
7 3 (0.73%) Oozie
8 2 (0.49%) Ambari
8 2 (0.49%) Consul
8 2 (0.49%) Packer
8 2 (0.49%) Progress Chef
9 1 (0.24%) Ganglia
9 1 (0.24%) ITRS Geneos
9 1 (0.24%) Kibana
9 1 (0.24%) Nagios
9 1 (0.24%) vCenter Server
9 1 (0.24%) vRealize
Vendors
1 76 (18.45%) Databricks
2 44 (10.68%) Microsoft
3 24 (5.83%) Google
4 22 (5.34%) Talend
5 21 (5.10%) Oracle
6 20 (4.85%) Informatica
7 10 (2.43%) Red Hat
8 8 (1.94%) Teradata
9 6 (1.46%) Salesforce
9 6 (1.46%) SAP
10 5 (1.21%) Cloudera
11 4 (0.97%) Brio
11 4 (0.97%) Foundry
11 4 (0.97%) IBM
11 4 (0.97%) Okta
11 4 (0.97%) Palantir
11 4 (0.97%) Sage
11 4 (0.97%) Splunk
11 4 (0.97%) Symantec
11 4 (0.97%) Varonis