Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 31 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
31 May 2024
Same period 2023 Same period 2022
Rank 224 241 157
Rank change year-on-year +17 -84 -39
Contract jobs citing Big Data 436 622 1,570
As % of all contract jobs advertised in the UK 1.01% 1.11% 1.79%
As % of the Database & Business Intelligence category 5.98% 6.28% 9.09%
Number of daily rates quoted 331 415 1,013
10th Percentile £363 £450 £450
25th Percentile £463 £505 £513
Median daily rate (50th Percentile) £575 £588 £600
Median % change year-on-year -2.13% -2.08% +5.73%
75th Percentile £747 £725 £700
90th Percentile £850 £825 £775
UK excluding London median daily rate £523 £575 £550
% change year-on-year -9.13% +4.55% +0.92%
Number of hourly rates quoted 11 24 3
10th Percentile £18.20 £36.50 £59.40
25th Percentile £21.60 £68.38 £59.63
Median hourly rate £40.00 £78.00 £60.50
Median % change year-on-year -48.72% +28.93% +54.14%
75th Percentile £45.63 £90.00 £76.33
90th Percentile £48.75 - £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,296 9,911 17,275
As % of all contract IT jobs advertised in the UK 16.97% 17.68% 19.71%
Number of daily rates quoted 5,232 7,035 12,309
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £548 £550
Median % change year-on-year -4.11% -0.45% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £755 £750
UK excluding London median daily rate £475 £500 £500
% change year-on-year -5.00% - +11.11%
Number of hourly rates quoted 150 179 179
10th Percentile £14.00 £21.24 £15.98
25th Percentile £20.77 £33.70 £22.08
Median hourly rate £40.00 £60.00 £45.00
Median % change year-on-year -33.33% +33.33% +69.81%
75th Percentile £56.88 £73.75 £63.60
90th Percentile £72.75 £80.50 £75.00
UK excluding London median hourly rate £35.00 £58.59 £35.00
% change year-on-year -40.26% +67.40% +42.86%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 31 May 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 31 May 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 31 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -3 390 £600 +2.13% 213
London -5 260 £650 +8.33% 110
Work from Home +31 149 £613 +6.52% 118
UK excluding London +57 138 £523 -9.13% 118
North of England +51 43 £525 -4.55% 28
South East +8 33 £425 -22.73% 26
Midlands +31 30 £650 +28.71% 18
Yorkshire +35 26 £550 - 5
West Midlands +21 21 £650 +23.81% 16
Scotland +46 19 £494 -29.46% 15
North West +25 17 £510 +7.37% 19
East Midlands +18 9 £463 -8.42% 2
South West -13 9 £615 -5.38% 14
East of England +1 3 £500 -14.89% 11
Northern Ireland - 1 £425 - 6

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 132 (30.28%) Apache Spark
2 47 (10.78%) Apache
2 47 (10.78%) Apache Airflow
3 9 (2.06%) Confluence
4 4 (0.92%) IIS
4 4 (0.92%) Microsoft Exchange
5 3 (0.69%) SAS
6 2 (0.46%) Apache Solr
6 2 (0.46%) ArcGIS
6 2 (0.46%) Jupyter
6 2 (0.46%) nginx
7 1 (0.23%) Apache Pulsar
7 1 (0.23%) SharePoint
Applications
1 13 (2.98%) Microsoft Excel
2 3 (0.69%) Spreadsheet
3 1 (0.23%) Microsoft PowerPoint
Business Applications
1 1 (0.23%) Oracle Financials
1 1 (0.23%) Oracle Payables
Cloud Services
1 159 (36.47%) AWS
2 157 (36.01%) Azure
3 72 (16.51%) GCP
4 65 (14.91%) Power Platform
5 48 (11.01%) Snowflake
6 45 (10.32%) Serverless
7 33 (7.57%) Amazon S3
8 30 (6.88%) Azure Data Factory
9 28 (6.42%) dbt
10 23 (5.28%) AWS Lambda
10 23 (5.28%) Azure Synapse Analytics
11 19 (4.36%) Amazon EMR
12 18 (4.13%) Azure DevOps
12 18 (4.13%) Cloud Computing
13 16 (3.67%) Azure Logic Apps
14 11 (2.52%) Entra ID
14 11 (2.52%) PaaS
15 10 (2.29%) Azure Key Vault
15 10 (2.29%) GitHub
15 10 (2.29%) Power Automate
Communications & Networking
1 18 (4.13%) Intrusion Detection
1 18 (4.13%) Network Security
2 5 (1.15%) FTP
3 4 (0.92%) SAN
4 2 (0.46%) Internet
5 1 (0.23%) 5G
5 1 (0.23%) Broadband
5 1 (0.23%) Firewall
5 1 (0.23%) HTTPS
5 1 (0.23%) Wireless
Database & Business Intelligence
1 116 (26.61%) Data Lake
2 108 (24.77%) Data Warehouse
3 80 (18.35%) Hadoop
4 59 (13.53%) Power BI
5 40 (9.17%) Amazon Athena
6 39 (8.94%) Tableau
7 35 (8.03%) Amazon Redshift
8 34 (7.80%) Apache Hive
9 31 (7.11%) BigQuery
10 24 (5.50%) Apache Arrow
10 24 (5.50%) Dremio
11 23 (5.28%) SQL Server
12 21 (4.82%) Impala
13 20 (4.59%) NoSQL
14 19 (4.36%) Spark SQL
15 17 (3.90%) Delta Lake
15 17 (3.90%) Relational Database
16 14 (3.21%) Metadata
17 12 (2.75%) Azure SQL Database
17 12 (2.75%) OLTP
Development Applications
1 45 (10.32%) Git
2 25 (5.73%) JIRA
3 15 (3.44%) Jenkins
4 7 (1.61%) Cypress.io
4 7 (1.61%) Maven
5 6 (1.38%) Subversion
5 6 (1.38%) Visual Studio Team System
6 5 (1.15%) Bitbucket
6 5 (1.15%) ERwin
6 5 (1.15%) TeamCity
7 4 (0.92%) Team Foundation Server
8 3 (0.69%) GitLab
8 3 (0.69%) JMeter
8 3 (0.69%) LoadRunner
8 3 (0.69%) RStudio
8 3 (0.69%) Selenium
8 3 (0.69%) Visual Studio
8 3 (0.69%) Visual Studio Code
9 2 (0.46%) CircleCI
9 2 (0.46%) kappa
General
1 102 (23.39%) Analytical Skills
2 101 (23.17%) Social Skills
3 98 (22.48%) Finance
4 41 (9.40%) Banking
5 32 (7.34%) Public Sector
6 20 (4.59%) Investment Banking
7 11 (2.52%) Marketing
8 10 (2.29%) Pharmaceutical
9 8 (1.83%) Presentation Skills
10 7 (1.61%) Financial Institution
10 7 (1.61%) Health Technology
10 7 (1.61%) Retail
11 6 (1.38%) Front Office
11 6 (1.38%) Manufacturing
11 6 (1.38%) Telecoms
12 5 (1.15%) Legal
13 4 (0.92%) Publishing
14 3 (0.69%) Back Office
14 3 (0.69%) Documentation Skills
14 3 (0.69%) Police
Job Titles
1 97 (22.25%) Architect
2 95 (21.79%) Data Engineer
3 55 (12.61%) Developer
4 47 (10.78%) Data Architect
5 42 (9.63%) Solutions Architect
6 40 (9.17%) Senior
7 37 (8.49%) Analyst
8 30 (6.88%) Big Data Engineer
9 29 (6.65%) AWS Engineer
10 22 (5.05%) Consultant
10 22 (5.05%) Data Analyst
11 20 (4.59%) Lead
12 18 (4.13%) Cloud Architect
12 18 (4.13%) Site Engineer
12 18 (4.13%) Site Reliability Engineer
13 16 (3.67%) Senior Data Engineer
14 15 (3.44%) Azure Architect
15 14 (3.21%) Azure Engineer
15 14 (3.21%) Cloud Solutions Architect
15 14 (3.21%) Data Scientist
Libraries, Frameworks & Software Standards
1 65 (14.91%) PySpark
2 52 (11.93%) Kafka
3 25 (5.73%) Apache NiFi
4 18 (4.13%) gRPC
4 18 (4.13%) Protocol Buffers
5 16 (3.67%) JSON
5 16 (3.67%) XML
6 12 (2.75%) .NET
7 10 (2.29%) Web Services
8 9 (2.06%) Pandas
8 9 (2.06%) React
8 9 (2.06%) TensorFlow
9 8 (1.83%) Apache Avro
9 8 (1.83%) Elastic Stack
9 8 (1.83%) SAML
10 7 (1.61%) REST
11 6 (1.38%) ARM Templates
11 6 (1.38%) Spring
12 5 (1.15%) .NET Core
12 5 (1.15%) scikit-learn
Miscellaneous
1 34 (7.80%) Hedge funds
2 26 (5.96%) Management Information System
3 25 (5.73%) Algorithms
4 23 (5.28%) Clustering
5 18 (4.13%) Cyber Defence
5 18 (4.13%) Distributed Applications
6 15 (3.44%) Data Centre
7 14 (3.21%) Data Protection Act
7 14 (3.21%) Greenfield Project
8 13 (2.98%) Data Structures
9 12 (2.75%) Product Ownership
10 11 (2.52%) Cloud Native
10 11 (2.52%) Distributed Computing
10 11 (2.52%) Virtual Team
11 9 (2.06%) Freedom of Information
11 9 (2.06%) Freedom of Information Act
12 7 (1.61%) Onboarding
13 6 (1.38%) Analytical Mindset
13 6 (1.38%) Distributed Systems
13 6 (1.38%) Equities
Operating Systems
1 46 (10.55%) Linux
2 28 (6.42%) Unix
3 20 (4.59%) Windows
4 16 (3.67%) Android
4 16 (3.67%) Apple iOS
5 8 (1.83%) VMS
6 4 (0.92%) Windows Server
6 4 (0.92%) Windows Server 2016
6 4 (0.92%) Windows Server 2019
Processes & Methodologies
1 150 (34.40%) Analytics
2 133 (30.50%) Data Modelling
3 118 (27.06%) ETL
4 112 (25.69%) Agile
5 109 (25.00%) Data Pipeline
6 93 (21.33%) Business Intelligence
7 82 (18.81%) Data Engineering
8 81 (18.58%) DevOps
9 72 (16.51%) Machine Learning
10 70 (16.06%) Problem-Solving
11 67 (15.37%) Data Analysis
12 66 (15.14%) Data Science
13 59 (13.53%) CI/CD
14 55 (12.61%) Computer Science
14 55 (12.61%) Data Governance
15 51 (11.70%) Data Management
16 47 (10.78%) Migration
17 40 (9.17%) Data Integration
18 39 (8.94%) Data Analytics
19 38 (8.72%) Scrum
Programming Languages
1 223 (51.15%) Python
2 189 (43.35%) SQL
3 89 (20.41%) Java
4 55 (12.61%) Scala
5 30 (6.88%) JavaScript
6 20 (4.59%) Go
7 18 (4.13%) PowerShell
8 17 (3.90%) C#
8 17 (3.90%) R
9 10 (2.29%) Bash
9 10 (2.29%) Shell Script
10 9 (2.06%) PL/SQL
11 8 (1.83%) Perl
12 3 (0.69%) C++
12 3 (0.69%) Data Analysis Expressions
12 3 (0.69%) Ruby
12 3 (0.69%) Rust
12 3 (0.69%) TypeScript
13 2 (0.46%) T-SQL
13 2 (0.46%) VBA
Qualifications
1 61 (13.99%) Degree
1 61 (13.99%) Security Cleared
2 39 (8.94%) DV Cleared
3 29 (6.65%) SC Cleared
4 23 (5.28%) Computer Science Degree
5 17 (3.90%) AWS Certification
6 11 (2.52%) Master's Degree
7 10 (2.29%) Azure Certification
8 6 (1.38%) Microsoft Certification
9 4 (0.92%) AWS Certified Solutions Architect
9 4 (0.92%) CISSP
10 3 (0.69%) BPSS Clearance
11 2 (0.46%) AWS Certified Developer
11 2 (0.46%) AWS Certified DevOps Engineer
11 2 (0.46%) Numerate Degree
Quality Assurance & Compliance
1 63 (14.45%) Data Quality
2 18 (4.13%) Actionable Recommendations
3 8 (1.83%) QA
4 6 (1.38%) Accessibility
5 4 (0.92%) ISO/IEC 27001
5 4 (0.92%) NIST
6 3 (0.69%) GDPR
7 2 (0.46%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.46%) MiFID
7 2 (0.46%) NCSC
7 2 (0.46%) PCI DSS
7 2 (0.46%) PMO
7 2 (0.46%) SLA
8 1 (0.23%) EMIR
8 1 (0.23%) FATCA
System Software
1 21 (4.82%) Docker
2 12 (2.75%) HDFS
3 4 (0.92%) Active Directory
4 1 (0.23%) Apache Flume
4 1 (0.23%) KVM
4 1 (0.23%) VMware ESXi
4 1 (0.23%) VMware Infrastructure
Systems Management
1 56 (12.84%) Terraform
2 46 (10.55%) Kubernetes
3 19 (4.36%) Prometheus
4 17 (3.90%) Ansible
5 11 (2.52%) Puppet
6 6 (1.38%) Hadoop YARN
7 4 (0.92%) Argo
7 4 (0.92%) Kibana
8 3 (0.69%) logstash
8 3 (0.69%) Rancher
9 2 (0.46%) Ambari
9 2 (0.46%) Oozie
10 1 (0.23%) Control-M
10 1 (0.23%) Ganglia
10 1 (0.23%) Nagios
10 1 (0.23%) vCenter Server
10 1 (0.23%) vRealize
Vendors
1 76 (17.43%) Databricks
2 54 (12.39%) Microsoft
3 36 (8.26%) Google
4 24 (5.50%) Oracle
5 20 (4.59%) Talend
6 18 (4.13%) Informatica
7 14 (3.21%) Red Hat
8 11 (2.52%) Cloudera
9 8 (1.83%) Teradata
10 7 (1.61%) Salesforce
11 6 (1.38%) ServiceNow
12 5 (1.15%) SAP
13 4 (0.92%) Brio
13 4 (0.92%) Foundry
13 4 (0.92%) Palantir
14 3 (0.69%) Atlassian
14 3 (0.69%) IBM
14 3 (0.69%) Sage
14 3 (0.69%) Splunk
14 3 (0.69%) Varonis