Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 14 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
14 May 2024
Same period 2023 Same period 2022
Rank 246 235 153
Rank change year-on-year -11 -82 -39
Contract jobs citing Big Data 413 674 1,637
As % of all contract jobs advertised in the UK 0.97% 1.17% 1.86%
As % of the Database & Business Intelligence category 5.69% 6.54% 9.28%
Number of daily rates quoted 306 457 1,049
10th Percentile £388 £456 £450
25th Percentile £468 £500 £513
Median daily rate (50th Percentile) £600 £588 £600
Median % change year-on-year +2.09% -2.08% +6.67%
75th Percentile £748 £713 £700
90th Percentile £850 £800 £788
UK excluding London median daily rate £534 £550 £550
% change year-on-year -2.95% - +4.76%
Number of hourly rates quoted 12 20 3
10th Percentile £18.20 £35.00 £59.40
25th Percentile £23.30 £57.41 £59.63
Median hourly rate £35.25 £78.00 £60.50
Median % change year-on-year -54.81% +28.93% +61.33%
75th Percentile £44.69 £84.38 £76.33
90th Percentile £48.63 £90.00 £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,261 10,311 17,646
As % of all contract IT jobs advertised in the UK 17.02% 17.89% 20.02%
Number of daily rates quoted 5,194 7,338 12,554
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £545
Median % change year-on-year -2.78% -0.92% +9.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.31%
Number of hourly rates quoted 144 184 194
10th Percentile £14.00 £21.24 £15.37
25th Percentile £20.98 £32.37 £22.43
Median hourly rate £40.00 £59.30 £45.00
Median % change year-on-year -32.54% +31.77% +69.81%
75th Percentile £61.53 £73.75 £64.94
90th Percentile £74.25 £81.75 £75.00
UK excluding London median hourly rate £40.00 £55.00 £35.00
% change year-on-year -27.27% +57.14% +43.44%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 14 May 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 14 May 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 14 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -20 365 £600 +2.04% 196
London -32 243 £650 +8.33% 114
Work from Home +15 142 £638 +8.51% 92
UK excluding London +65 129 £534 -2.95% 99
North of England +43 40 £530 -3.64% 21
Midlands +41 35 £650 +23.81% 17
South East +11 27 £425 -20.93% 10
Yorkshire +38 23 £556 +1.14% 8
West Midlands +30 23 £675 +22.73% 14
Scotland +46 19 £550 -21.43% 12
North West +29 17 £510 +7.37% 10
East Midlands +26 12 £513 +2.50% 3
South West -19 5 £450 -21.74% 19
East of England +5 2 £400 -31.91% 9
Northern Ireland - 1 £425 - 8

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 117 (28.33%) Apache Spark
2 46 (11.14%) Apache Airflow
3 41 (9.93%) Apache
4 6 (1.45%) Confluence
5 4 (0.97%) IIS
5 4 (0.97%) Microsoft Exchange
6 2 (0.48%) Apache Solr
6 2 (0.48%) ArcGIS
6 2 (0.48%) Jupyter
6 2 (0.48%) nginx
7 1 (0.24%) Apache Pulsar
7 1 (0.24%) Cloud Foundry
7 1 (0.24%) SAS
7 1 (0.24%) SharePoint
7 1 (0.24%) Tornado
Applications
1 13 (3.15%) Microsoft Excel
2 3 (0.73%) Spreadsheet
3 1 (0.24%) Microsoft PowerPoint
Cloud Services
1 156 (37.77%) AWS
2 149 (36.08%) Azure
3 71 (17.19%) GCP
4 53 (12.83%) Power Platform
5 49 (11.86%) Serverless
6 37 (8.96%) Snowflake
7 31 (7.51%) Azure Data Factory
8 30 (7.26%) Amazon S3
9 29 (7.02%) AWS Lambda
10 23 (5.57%) Azure Synapse Analytics
10 23 (5.57%) dbt
11 18 (4.36%) Amazon EMR
12 17 (4.12%) Azure DevOps
13 16 (3.87%) Cloud Computing
14 15 (3.63%) Azure Logic Apps
15 13 (3.15%) GitHub
16 12 (2.91%) Entra ID
17 11 (2.66%) Azure Key Vault
18 10 (2.42%) Power Automate
19 9 (2.18%) PowerApps
Communications & Networking
1 15 (3.63%) Intrusion Detection
1 15 (3.63%) Network Security
2 5 (1.21%) FTP
3 4 (0.97%) SAN
4 2 (0.48%) Internet
5 1 (0.24%) Broadband
5 1 (0.24%) Firewall
5 1 (0.24%) HTTPS
5 1 (0.24%) Wireless
Database & Business Intelligence
1 103 (24.94%) Data Lake
2 102 (24.70%) Data Warehouse
3 75 (18.16%) Hadoop
4 47 (11.38%) Power BI
5 37 (8.96%) Amazon Athena
6 36 (8.72%) Amazon Redshift
7 32 (7.75%) Apache Hive
8 31 (7.51%) BigQuery
8 31 (7.51%) Tableau
9 25 (6.05%) SQL Server
10 24 (5.81%) NoSQL
11 19 (4.60%) Relational Database
12 18 (4.36%) Delta Lake
13 17 (4.12%) Impala
14 16 (3.87%) Apache Arrow
14 16 (3.87%) Dremio
15 15 (3.63%) Metadata
15 15 (3.63%) Spark SQL
16 12 (2.91%) OLTP
17 11 (2.66%) PostgreSQL
Development Applications
1 45 (10.90%) Git
2 22 (5.33%) JIRA
3 12 (2.91%) Jenkins
4 6 (1.45%) Cypress.io
4 6 (1.45%) Maven
4 6 (1.45%) Subversion
4 6 (1.45%) Visual Studio Team System
5 5 (1.21%) ERwin
5 5 (1.21%) TeamCity
6 4 (0.97%) Bitbucket
6 4 (0.97%) Team Foundation Server
7 3 (0.73%) GitLab
7 3 (0.73%) JMeter
7 3 (0.73%) LoadRunner
7 3 (0.73%) RStudio
7 3 (0.73%) Selenium
7 3 (0.73%) Visual Studio
8 2 (0.48%) CircleCI
8 2 (0.48%) kappa
8 2 (0.48%) Liquibase
General
1 102 (24.70%) Analytical Skills
2 101 (24.46%) Social Skills
3 92 (22.28%) Finance
4 34 (8.23%) Banking
5 29 (7.02%) Public Sector
6 12 (2.91%) Investment Banking
7 10 (2.42%) Presentation Skills
8 9 (2.18%) Pharmaceutical
9 8 (1.94%) Marketing
10 7 (1.69%) Financial Institution
10 7 (1.69%) Health Technology
10 7 (1.69%) Manufacturing
11 6 (1.45%) Retail
12 5 (1.21%) Legal
12 5 (1.21%) Telecoms
13 4 (0.97%) Publishing
14 3 (0.73%) Back Office
14 3 (0.73%) Documentation Skills
14 3 (0.73%) Police
15 2 (0.48%) German Language
Job Titles
1 103 (24.94%) Architect
2 88 (21.31%) Data Engineer
3 48 (11.62%) Developer
4 47 (11.38%) Data Architect
5 42 (10.17%) Solutions Architect
6 35 (8.47%) Senior
7 34 (8.23%) Analyst
8 26 (6.30%) Big Data Engineer
9 23 (5.57%) AWS Engineer
9 23 (5.57%) Lead
10 22 (5.33%) Cloud Architect
10 22 (5.33%) Data Analyst
11 18 (4.36%) Azure Architect
11 18 (4.36%) Cloud Solutions Architect
11 18 (4.36%) Data Scientist
12 17 (4.12%) AWS Architect
12 17 (4.12%) Site Engineer
12 17 (4.12%) Site Reliability Engineer
13 16 (3.87%) Consultant
14 14 (3.39%) Azure Engineer
Libraries, Frameworks & Software Standards
1 65 (15.74%) PySpark
2 50 (12.11%) Kafka
3 22 (5.33%) Apache NiFi
4 16 (3.87%) gRPC
4 16 (3.87%) JSON
4 16 (3.87%) Protocol Buffers
4 16 (3.87%) XML
5 14 (3.39%) Pandas
6 12 (2.91%) .NET
7 10 (2.42%) TensorFlow
7 10 (2.42%) Web Services
8 8 (1.94%) Apache Avro
8 8 (1.94%) SAML
9 7 (1.69%) React
9 7 (1.69%) scikit-learn
10 6 (1.45%) ARM Templates
10 6 (1.45%) NumPy
11 5 (1.21%) Elastic Stack
11 5 (1.21%) REST
11 5 (1.21%) Spring
Miscellaneous
1 31 (7.51%) Algorithms
2 25 (6.05%) Hedge funds
3 23 (5.57%) Management Information System
4 21 (5.08%) Clustering
5 15 (3.63%) Cyber Defence
5 15 (3.63%) Distributed Applications
6 14 (3.39%) Data Centre
7 13 (3.15%) Data Protection Act
7 13 (3.15%) Data Structures
7 13 (3.15%) Greenfield Project
8 11 (2.66%) Cloud Native
8 11 (2.66%) Distributed Computing
9 9 (2.18%) Freedom of Information
9 9 (2.18%) Freedom of Information Act
9 9 (2.18%) Virtual Team
10 7 (1.69%) Distributed Systems
10 7 (1.69%) Onboarding
10 7 (1.69%) Product Ownership
11 6 (1.45%) Analytical Mindset
12 5 (1.21%) Self-Motivation
Operating Systems
1 42 (10.17%) Linux
2 22 (5.33%) Unix
3 17 (4.12%) Windows
4 13 (3.15%) Android
4 13 (3.15%) Apple iOS
5 8 (1.94%) VMS
6 4 (0.97%) Windows Server
6 4 (0.97%) Windows Server 2016
6 4 (0.97%) Windows Server 2019
Processes & Methodologies
1 134 (32.45%) Data Modelling
2 133 (32.20%) Analytics
3 115 (27.85%) ETL
4 111 (26.88%) Data Pipeline
5 104 (25.18%) Agile
6 88 (21.31%) Business Intelligence
7 80 (19.37%) Data Engineering
8 77 (18.64%) Machine Learning
9 75 (18.16%) DevOps
10 70 (16.95%) Problem-Solving
11 66 (15.98%) Data Science
12 63 (15.25%) CI/CD
12 63 (15.25%) Data Analysis
13 49 (11.86%) Computer Science
13 49 (11.86%) Data Governance
14 48 (11.62%) Migration
15 47 (11.38%) Data Management
16 41 (9.93%) Visualisation
17 40 (9.69%) Data Integration
18 35 (8.47%) Data Architecture
Programming Languages
1 222 (53.75%) Python
2 182 (44.07%) SQL
3 84 (20.34%) Java
4 53 (12.83%) Scala
5 26 (6.30%) JavaScript
6 20 (4.84%) Go
6 20 (4.84%) R
7 18 (4.36%) PowerShell
8 17 (4.12%) C#
9 11 (2.66%) Shell Script
10 7 (1.69%) Perl
11 5 (1.21%) Bash
12 3 (0.73%) Data Analysis Expressions
12 3 (0.73%) PL/SQL
12 3 (0.73%) Rust
13 2 (0.48%) T-SQL
13 2 (0.48%) U-SQL
13 2 (0.48%) VBA
14 1 (0.24%) C++
14 1 (0.24%) Gremlin
Qualifications
1 55 (13.32%) Degree
2 52 (12.59%) Security Cleared
3 30 (7.26%) DV Cleared
4 29 (7.02%) SC Cleared
5 23 (5.57%) Computer Science Degree
6 19 (4.60%) AWS Certification
7 11 (2.66%) Master's Degree
8 8 (1.94%) Azure Certification
9 5 (1.21%) AWS Certified Solutions Architect
9 5 (1.21%) Microsoft Certification
10 4 (0.97%) CISSP
11 3 (0.73%) AWS Certified Developer
11 3 (0.73%) AWS Certified DevOps Engineer
11 3 (0.73%) BPSS Clearance
12 2 (0.48%) Numerate Degree
Quality Assurance & Compliance
1 64 (15.50%) Data Quality
2 15 (3.63%) Actionable Recommendations
3 8 (1.94%) QA
4 5 (1.21%) Accessibility
5 4 (0.97%) ISO/IEC 27001
5 4 (0.97%) NIST
6 3 (0.73%) GDPR
7 2 (0.48%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.48%) MiFID
7 2 (0.48%) NCSC
7 2 (0.48%) PCI DSS
7 2 (0.48%) PMO
7 2 (0.48%) SLA
8 1 (0.24%) EMIR
8 1 (0.24%) FATCA
System Software
1 18 (4.36%) Docker
2 14 (3.39%) HDFS
3 4 (0.97%) Active Directory
4 1 (0.24%) Apache Flume
4 1 (0.24%) Apache ZooKeeper
4 1 (0.24%) KVM
4 1 (0.24%) VMware ESXi
4 1 (0.24%) VMware Infrastructure
Systems Management
1 61 (14.77%) Terraform
2 45 (10.90%) Kubernetes
3 20 (4.84%) Ansible
4 17 (4.12%) Prometheus
5 14 (3.39%) Puppet
6 8 (1.94%) Hadoop YARN
7 4 (0.97%) Argo
8 3 (0.73%) Oozie
9 2 (0.48%) Ambari
9 2 (0.48%) Consul
9 2 (0.48%) Packer
9 2 (0.48%) Progress Chef
10 1 (0.24%) Ganglia
10 1 (0.24%) ITRS Geneos
10 1 (0.24%) Kibana
10 1 (0.24%) Nagios
10 1 (0.24%) vCenter Server
10 1 (0.24%) vRealize
Vendors
1 75 (18.16%) Databricks
2 51 (12.35%) Microsoft
3 31 (7.51%) Google
4 21 (5.08%) Oracle
4 21 (5.08%) Talend
5 19 (4.60%) Informatica
6 10 (2.42%) Red Hat
7 8 (1.94%) Teradata
8 6 (1.45%) Salesforce
9 5 (1.21%) Cloudera
9 5 (1.21%) SAP
10 4 (0.97%) Brio
10 4 (0.97%) Foundry
10 4 (0.97%) IBM
10 4 (0.97%) Okta
10 4 (0.97%) Palantir
10 4 (0.97%) Sage
10 4 (0.97%) Splunk
10 4 (0.97%) Symantec
10 4 (0.97%) Varonis