Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 265 220 147
Rank change year-on-year -45 -73 -37
Contract jobs citing Big Data 398 737 1,708
As % of all contract jobs advertised in the UK 0.92% 1.23% 1.92%
As % of the Database & Business Intelligence category 5.49% 6.84% 9.53%
Number of daily rates quoted 296 508 1,086
10th Percentile £389 £463 £450
25th Percentile £468 £513 £513
Median daily rate (50th Percentile) £579 £600 £600
Median % change year-on-year -3.50% - +6.67%
75th Percentile £744 £713 £700
90th Percentile £831 £797 £788
UK excluding London median daily rate £550 £575 £550
% change year-on-year -4.35% +4.55% +4.76%
Number of hourly rates quoted 12 18 4
10th Percentile £18.20 £35.00 £59.48
25th Percentile £23.30 £40.91 £59.81
Median hourly rate £35.25 £73.00 £65.25
Median % change year-on-year -51.71% +11.88% +52.63%
75th Percentile £44.69 £78.00 £75.23
90th Percentile £52.00 £84.75 £84.63
UK excluding London median hourly rate £19.38 £75.50 £65.00
% change year-on-year -74.34% +16.15% +101.55%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,245 10,781 17,916
As % of all contract IT jobs advertised in the UK 16.73% 18.03% 20.17%
Number of daily rates quoted 5,147 7,685 12,759
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £545
Median % change year-on-year -2.78% -0.92% +9.00%
75th Percentile £650 £658 £650
90th Percentile £763 £750 £750
UK excluding London median daily rate £483 £500 £488
% change year-on-year -3.40% +2.56% +9.86%
Number of hourly rates quoted 144 185 187
10th Percentile £14.00 £21.24 £15.00
25th Percentile £20.98 £35.00 £22.40
Median hourly rate £40.00 £60.00 £42.50
Median % change year-on-year -33.33% +41.18% +57.52%
75th Percentile £58.55 £71.50 £60.00
90th Percentile £72.50 £79.19 £69.05
UK excluding London median hourly rate £40.00 £57.50 £35.00
% change year-on-year -30.43% +64.29% +45.83%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 27 April 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 27 April 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -39 344 £585 -2.50% 226
London -49 228 £650 +8.33% 117
Work from Home +1 135 £620 +6.21% 78
UK excluding London +40 125 £550 -4.35% 132
Midlands +39 34 £650 +18.18% 27
North of England +38 32 £550 - 25
South East -1 25 £448 -25.33% 16
West Midlands +38 23 £650 +18.18% 21
Scotland +39 17 £575 -17.86% 19
North West +16 16 £510 +7.37% 16
Yorkshire +24 15 £563 +2.27% 9
East Midlands +26 11 £513 -10.87% 6
East of England +8 7 £300 -53.85% 18
South West -6 5 £450 -18.18% 19
Northern Ireland - 5 £494 - 4
North East - 1 £454 -

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (29.65%) Apache Spark
2 47 (11.81%) Apache
3 46 (11.56%) Apache Airflow
4 6 (1.51%) Confluence
5 4 (1.01%) IIS
5 4 (1.01%) Microsoft Exchange
6 2 (0.50%) ArcGIS
6 2 (0.50%) Jupyter
6 2 (0.50%) SAS
7 1 (0.25%) Apache Pulsar
7 1 (0.25%) Cloud Foundry
7 1 (0.25%) Luigi
7 1 (0.25%) Tornado
Applications
1 10 (2.51%) Microsoft Excel
2 3 (0.75%) Spreadsheet
3 1 (0.25%) Microsoft PowerPoint
Cloud Services
1 144 (36.18%) AWS
2 133 (33.42%) Azure
3 64 (16.08%) GCP
4 45 (11.31%) Power Platform
4 45 (11.31%) Serverless
5 32 (8.04%) AWS Lambda
6 30 (7.54%) Snowflake
7 29 (7.29%) Azure Data Factory
8 28 (7.04%) Amazon S3
9 22 (5.53%) Amazon EMR
10 21 (5.28%) Azure Synapse Analytics
11 19 (4.77%) dbt
12 15 (3.77%) Azure DevOps
13 13 (3.27%) Amazon EC2
13 13 (3.27%) GitHub
14 12 (3.02%) Azure Logic Apps
14 12 (3.02%) Entra ID
15 11 (2.76%) Amazon Kinesis
15 11 (2.76%) Azure Key Vault
16 9 (2.26%) Cloud Computing
Communications & Networking
1 15 (3.77%) Intrusion Detection
1 15 (3.77%) Network Security
2 5 (1.26%) FTP
3 4 (1.01%) SAN
4 2 (0.50%) Internet
5 1 (0.25%) Broadband
5 1 (0.25%) Firewall
5 1 (0.25%) Wireless
Database & Business Intelligence
1 98 (24.62%) Data Warehouse
2 87 (21.86%) Data Lake
3 74 (18.59%) Hadoop
4 39 (9.80%) Power BI
5 38 (9.55%) Apache Hive
6 34 (8.54%) Tableau
7 33 (8.29%) Amazon Redshift
8 28 (7.04%) NoSQL
9 26 (6.53%) Amazon Athena
10 23 (5.78%) BigQuery
10 23 (5.78%) SQL Server
11 19 (4.77%) Impala
11 19 (4.77%) Relational Database
12 15 (3.77%) Delta Lake
13 14 (3.52%) Metadata
14 13 (3.27%) PostgreSQL
14 13 (3.27%) Spark SQL
15 12 (3.02%) HBase
16 10 (2.51%) Apache Arrow
16 10 (2.51%) Dremio
Development Applications
1 38 (9.55%) Git
2 25 (6.28%) JIRA
3 8 (2.01%) Maven
4 6 (1.51%) Subversion
4 6 (1.51%) Visual Studio Team System
5 5 (1.26%) Cypress.io
5 5 (1.26%) ERwin
5 5 (1.26%) Jenkins
5 5 (1.26%) TeamCity
6 4 (1.01%) Bitbucket
6 4 (1.01%) Team Foundation Server
7 3 (0.75%) GitLab
7 3 (0.75%) JMeter
7 3 (0.75%) LoadRunner
7 3 (0.75%) Poetry
7 3 (0.75%) RStudio
7 3 (0.75%) Selenium
8 2 (0.50%) CircleCI
8 2 (0.50%) kappa
8 2 (0.50%) Liquibase
General
1 98 (24.62%) Analytical Skills
2 95 (23.87%) Social Skills
3 77 (19.35%) Finance
4 35 (8.79%) Banking
5 28 (7.04%) Public Sector
6 15 (3.77%) Investment Banking
7 10 (2.51%) Presentation Skills
8 8 (2.01%) Pharmaceutical
9 7 (1.76%) Health Technology
9 7 (1.76%) Manufacturing
9 7 (1.76%) Marketing
9 7 (1.76%) Retail
10 6 (1.51%) Financial Institution
11 5 (1.26%) Legal
11 5 (1.26%) Publishing
11 5 (1.26%) Telecoms
12 3 (0.75%) Back Office
12 3 (0.75%) Police
13 2 (0.50%) Documentation Skills
13 2 (0.50%) German Language
Job Titles
1 97 (24.37%) Architect
2 88 (22.11%) Data Engineer
3 50 (12.56%) Developer
4 46 (11.56%) Data Architect
5 35 (8.79%) Solutions Architect
6 32 (8.04%) Senior
7 30 (7.54%) Analyst
8 22 (5.53%) Lead
9 21 (5.28%) Cloud Architect
10 20 (5.03%) Big Data Engineer
11 18 (4.52%) Cloud Solutions Architect
11 18 (4.52%) Data Scientist
12 17 (4.27%) AWS Architect
12 17 (4.27%) AWS Engineer
12 17 (4.27%) Azure Architect
13 16 (4.02%) Data Analyst
14 15 (3.77%) Azure Engineer
14 15 (3.77%) Consultant
14 15 (3.77%) Python Engineer
15 14 (3.52%) Azure Data Engineer
Libraries, Frameworks & Software Standards
1 60 (15.08%) PySpark
2 50 (12.56%) Kafka
3 22 (5.53%) Apache NiFi
4 18 (4.52%) Pandas
5 16 (4.02%) JSON
5 16 (4.02%) XML
6 11 (2.76%) .NET
7 10 (2.51%) gRPC
7 10 (2.51%) Protocol Buffers
7 10 (2.51%) TensorFlow
8 9 (2.26%) NumPy
8 9 (2.26%) scikit-learn
8 9 (2.26%) Web Services
9 8 (2.01%) Apache Avro
9 8 (2.01%) SAML
10 7 (1.76%) REST
11 6 (1.51%) ARM Templates
11 6 (1.51%) Elastic Stack
11 6 (1.51%) Lambda Expressions
12 5 (1.26%) React
Miscellaneous
1 32 (8.04%) Algorithms
2 23 (5.78%) Management Information System
3 19 (4.77%) Hedge funds
4 15 (3.77%) Clustering
4 15 (3.77%) Cyber Defence
4 15 (3.77%) Distributed Applications
5 14 (3.52%) Data Protection Act
6 13 (3.27%) Data Centre
6 13 (3.27%) Data Structures
6 13 (3.27%) Distributed Computing
7 12 (3.02%) Greenfield Project
8 10 (2.51%) Cloud Native
9 9 (2.26%) Freedom of Information
9 9 (2.26%) Freedom of Information Act
10 8 (2.01%) Product Ownership
11 7 (1.76%) Virtual Team
12 6 (1.51%) Analytical Mindset
12 6 (1.51%) Onboarding
13 5 (1.26%) Distributed Systems
13 5 (1.26%) Self-Motivation
Operating Systems
1 48 (12.06%) Linux
2 28 (7.04%) Unix
3 17 (4.27%) Windows
4 13 (3.27%) Android
4 13 (3.27%) Apple iOS
5 8 (2.01%) VMS
6 4 (1.01%) Windows Server
6 4 (1.01%) Windows Server 2016
6 4 (1.01%) Windows Server 2019
Processes & Methodologies
1 129 (32.41%) Data Modelling
2 119 (29.90%) Analytics
3 115 (28.89%) Data Pipeline
4 110 (27.64%) ETL
5 104 (26.13%) Agile
6 78 (19.60%) Business Intelligence
6 78 (19.60%) Machine Learning
7 74 (18.59%) Data Engineering
8 69 (17.34%) Data Science
9 67 (16.83%) Problem-Solving
10 63 (15.83%) Data Analysis
11 59 (14.82%) CI/CD
12 55 (13.82%) DevOps
13 49 (12.31%) Data Management
14 46 (11.56%) Computer Science
15 45 (11.31%) Migration
16 41 (10.30%) Data Governance
17 40 (10.05%) Data Architecture
17 40 (10.05%) Scrum
18 36 (9.05%) Data Integration
Programming Languages
1 213 (53.52%) Python
2 174 (43.72%) SQL
3 74 (18.59%) Java
4 65 (16.33%) Scala
5 22 (5.53%) R
6 19 (4.77%) PowerShell
7 17 (4.27%) JavaScript
8 16 (4.02%) C#
9 13 (3.27%) Go
10 11 (2.76%) Shell Script
11 7 (1.76%) Perl
12 4 (1.01%) Bash
13 3 (0.75%) PL/SQL
13 3 (0.75%) T-SQL
14 2 (0.50%) Data Analysis Expressions
14 2 (0.50%) U-SQL
15 1 (0.25%) ANSI SQL
15 1 (0.25%) Gremlin
15 1 (0.25%) Kotlin
15 1 (0.25%) TypeScript
Qualifications
1 55 (13.82%) Degree
2 51 (12.81%) Security Cleared
3 31 (7.79%) DV Cleared
4 30 (7.54%) SC Cleared
5 22 (5.53%) Computer Science Degree
6 18 (4.52%) AWS Certification
7 12 (3.02%) Master's Degree
8 7 (1.76%) Azure Certification
9 5 (1.26%) AWS Certified Solutions Architect
10 4 (1.01%) CISSP
10 4 (1.01%) Microsoft Certification
11 3 (0.75%) AWS Certified Developer
11 3 (0.75%) AWS Certified DevOps Engineer
11 3 (0.75%) BPSS Clearance
12 2 (0.50%) Numerate Degree
13 1 (0.25%) PhD
Quality Assurance & Compliance
1 65 (16.33%) Data Quality
2 15 (3.77%) Actionable Recommendations
3 7 (1.76%) QA
4 5 (1.26%) Accessibility
5 4 (1.01%) ISO/IEC 27001
5 4 (1.01%) NIST
6 3 (0.75%) GDPR
7 2 (0.50%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.50%) MiFID
7 2 (0.50%) NCSC
7 2 (0.50%) PCI DSS
7 2 (0.50%) PMO
7 2 (0.50%) SLA
8 1 (0.25%) EMIR
8 1 (0.25%) FATCA
System Software
1 18 (4.52%) Docker
2 15 (3.77%) HDFS
3 4 (1.01%) Active Directory
4 2 (0.50%) Apache ZooKeeper
5 1 (0.25%) Apache Flume
5 1 (0.25%) KVM
5 1 (0.25%) VMware ESXi
5 1 (0.25%) VMware Infrastructure
Systems Management
1 51 (12.81%) Terraform
2 41 (10.30%) Kubernetes
3 22 (5.53%) Ansible
4 16 (4.02%) Puppet
5 11 (2.76%) Prometheus
6 9 (2.26%) Hadoop YARN
7 4 (1.01%) Argo
8 3 (0.75%) Consul
8 3 (0.75%) Oozie
8 3 (0.75%) Packer
8 3 (0.75%) Progress Chef
9 2 (0.50%) Ambari
10 1 (0.25%) Ganglia
10 1 (0.25%) ITRS Geneos
10 1 (0.25%) Kibana
10 1 (0.25%) Nagios
10 1 (0.25%) vCenter Server
10 1 (0.25%) vRealize
Vendors
1 66 (16.58%) Databricks
2 40 (10.05%) Microsoft
3 22 (5.53%) Google
3 22 (5.53%) Talend
4 21 (5.28%) Informatica
5 18 (4.52%) Oracle
6 10 (2.51%) Red Hat
7 9 (2.26%) Teradata
8 6 (1.51%) SAP
9 5 (1.26%) Cloudera
10 4 (1.01%) Brio
10 4 (1.01%) Foundry
10 4 (1.01%) IBM
10 4 (1.01%) Okta
10 4 (1.01%) Palantir
10 4 (1.01%) Salesforce
10 4 (1.01%) Splunk
10 4 (1.01%) Symantec
10 4 (1.01%) Varonis
11 3 (0.75%) Phenom