Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 29 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
29 Apr 2024
Same period 2023 Same period 2022
Rank 258 222 146
Rank change year-on-year -36 -76 -36
Contract jobs citing Big Data 407 725 1,704
As % of all contract jobs advertised in the UK 0.93% 1.21% 1.92%
As % of the Database & Business Intelligence category 5.57% 6.74% 9.53%
Number of daily rates quoted 302 498 1,089
10th Percentile £388 £463 £450
25th Percentile £468 £513 £513
Median daily rate (50th Percentile) £579 £600 £600
Median % change year-on-year -3.50% - +7.14%
75th Percentile £744 £713 £700
90th Percentile £838 £797 £788
UK excluding London median daily rate £550 £575 £550
% change year-on-year -4.35% +4.55% +4.76%
Number of hourly rates quoted 12 18 4
10th Percentile £18.20 £35.00 £59.48
25th Percentile £23.30 £40.91 £59.81
Median hourly rate £35.25 £73.00 £65.25
Median % change year-on-year -51.71% +11.88% +91.91%
75th Percentile £44.69 £78.00 £75.23
90th Percentile £52.00 £84.75 £84.63
UK excluding London median hourly rate £19.38 £75.50 £65.00
% change year-on-year -74.34% +16.15% +165.31%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,303 10,763 17,880
As % of all contract IT jobs advertised in the UK 16.75% 18.03% 20.15%
Number of daily rates quoted 5,193 7,663 12,744
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £550
Median % change year-on-year -2.78% -1.78% +9.96%
75th Percentile £650 £660 £650
90th Percentile £763 £750 £750
UK excluding London median daily rate £480 £500 £488
% change year-on-year -4.00% +2.56% +9.55%
Number of hourly rates quoted 144 183 187
10th Percentile £14.00 £21.24 £15.00
25th Percentile £20.98 £35.00 £22.40
Median hourly rate £40.00 £60.00 £42.50
Median % change year-on-year -33.33% +41.18% +59.00%
75th Percentile £58.55 £70.88 £61.75
90th Percentile £72.50 £79.19 £69.43
UK excluding London median hourly rate £40.00 £58.05 £35.00
% change year-on-year -31.09% +65.84% +45.83%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 29 April 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 29 April 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 29 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -38 352 £584 -2.67% 241
London -45 234 £650 +8.33% 130
Work from Home +3 139 £625 +8.70% 86
UK excluding London +46 126 £550 -4.35% 132
Midlands +45 35 £650 +18.18% 27
North of England +35 32 £550 - 25
South East -7 25 £448 -22.09% 20
West Midlands +36 23 £650 +18.18% 21
Scotland +41 17 £575 -17.86% 19
North West +24 16 £510 +7.37% 16
Yorkshire +28 15 £563 +2.27% 9
East Midlands +31 12 £513 -10.87% 6
East of England +5 7 £300 -52.00% 17
South West -16 5 £450 -18.18% 17
Northern Ireland - 5 £494 - 5
North East - 1 £454 -

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 120 (29.48%) Apache Spark
2 48 (11.79%) Apache Airflow
3 47 (11.55%) Apache
4 6 (1.47%) Confluence
5 4 (0.98%) IIS
5 4 (0.98%) Microsoft Exchange
6 2 (0.49%) ArcGIS
6 2 (0.49%) Jupyter
6 2 (0.49%) SAS
7 1 (0.25%) Apache Pulsar
7 1 (0.25%) Cloud Foundry
7 1 (0.25%) Luigi
7 1 (0.25%) Tornado
Applications
1 11 (2.70%) Microsoft Excel
2 3 (0.74%) Spreadsheet
3 1 (0.25%) Microsoft PowerPoint
Cloud Services
1 148 (36.36%) AWS
2 137 (33.66%) Azure
3 64 (15.72%) GCP
4 49 (12.04%) Power Platform
5 46 (11.30%) Serverless
6 33 (8.11%) AWS Lambda
7 32 (7.86%) Snowflake
8 30 (7.37%) Azure Data Factory
9 28 (6.88%) Amazon S3
10 22 (5.41%) Amazon EMR
11 21 (5.16%) Azure Synapse Analytics
11 21 (5.16%) dbt
12 16 (3.93%) Azure DevOps
13 13 (3.19%) Amazon EC2
13 13 (3.19%) Azure Logic Apps
13 13 (3.19%) GitHub
14 12 (2.95%) Entra ID
15 11 (2.70%) Amazon Kinesis
15 11 (2.70%) Azure Key Vault
16 9 (2.21%) Azure Service Bus
Communications & Networking
1 15 (3.69%) Intrusion Detection
1 15 (3.69%) Network Security
2 5 (1.23%) FTP
3 4 (0.98%) SAN
4 2 (0.49%) Internet
5 1 (0.25%) Broadband
5 1 (0.25%) Firewall
5 1 (0.25%) Wireless
Database & Business Intelligence
1 101 (24.82%) Data Warehouse
2 93 (22.85%) Data Lake
3 75 (18.43%) Hadoop
4 43 (10.57%) Power BI
5 38 (9.34%) Apache Hive
6 34 (8.35%) Amazon Redshift
6 34 (8.35%) Tableau
7 29 (7.13%) Amazon Athena
8 28 (6.88%) NoSQL
9 24 (5.90%) SQL Server
10 23 (5.65%) BigQuery
11 20 (4.91%) Relational Database
12 19 (4.67%) Impala
13 16 (3.93%) Delta Lake
14 14 (3.44%) Metadata
15 13 (3.19%) PostgreSQL
15 13 (3.19%) Spark SQL
16 12 (2.95%) Apache Arrow
16 12 (2.95%) Dremio
16 12 (2.95%) HBase
Development Applications
1 38 (9.34%) Git
2 25 (6.14%) JIRA
3 8 (1.97%) Maven
4 6 (1.47%) Subversion
4 6 (1.47%) Visual Studio Team System
5 5 (1.23%) Cypress.io
5 5 (1.23%) ERwin
5 5 (1.23%) Jenkins
5 5 (1.23%) TeamCity
6 4 (0.98%) Bitbucket
6 4 (0.98%) Team Foundation Server
7 3 (0.74%) GitLab
7 3 (0.74%) JMeter
7 3 (0.74%) LoadRunner
7 3 (0.74%) Poetry
7 3 (0.74%) RStudio
7 3 (0.74%) Selenium
8 2 (0.49%) CircleCI
8 2 (0.49%) kappa
8 2 (0.49%) Liquibase
General
1 100 (24.57%) Social Skills
2 99 (24.32%) Analytical Skills
3 80 (19.66%) Finance
4 35 (8.60%) Banking
5 28 (6.88%) Public Sector
6 15 (3.69%) Investment Banking
7 11 (2.70%) Presentation Skills
8 9 (2.21%) Pharmaceutical
9 7 (1.72%) Financial Institution
9 7 (1.72%) Health Technology
9 7 (1.72%) Manufacturing
9 7 (1.72%) Marketing
9 7 (1.72%) Retail
10 5 (1.23%) Legal
10 5 (1.23%) Publishing
10 5 (1.23%) Telecoms
11 3 (0.74%) Back Office
11 3 (0.74%) Documentation Skills
11 3 (0.74%) Police
12 2 (0.49%) German Language
Job Titles
1 99 (24.32%) Architect
2 90 (22.11%) Data Engineer
3 50 (12.29%) Developer
4 48 (11.79%) Data Architect
5 36 (8.85%) Solutions Architect
6 34 (8.35%) Senior
7 31 (7.62%) Analyst
8 23 (5.65%) Cloud Architect
8 23 (5.65%) Lead
9 22 (5.41%) Big Data Engineer
10 19 (4.67%) AWS Engineer
10 19 (4.67%) Cloud Solutions Architect
11 18 (4.42%) Azure Architect
11 18 (4.42%) Data Scientist
12 17 (4.18%) AWS Architect
12 17 (4.18%) Data Analyst
13 16 (3.93%) Azure Engineer
14 15 (3.69%) Azure Data Engineer
14 15 (3.69%) Consultant
14 15 (3.69%) Python Engineer
Libraries, Frameworks & Software Standards
1 62 (15.23%) PySpark
2 50 (12.29%) Kafka
3 22 (5.41%) Apache NiFi
4 18 (4.42%) Pandas
5 16 (3.93%) JSON
5 16 (3.93%) XML
6 12 (2.95%) gRPC
6 12 (2.95%) Protocol Buffers
7 11 (2.70%) .NET
8 10 (2.46%) TensorFlow
8 10 (2.46%) Web Services
9 9 (2.21%) NumPy
9 9 (2.21%) scikit-learn
10 8 (1.97%) Apache Avro
10 8 (1.97%) SAML
11 7 (1.72%) REST
12 6 (1.47%) ARM Templates
12 6 (1.47%) Elastic Stack
12 6 (1.47%) Lambda Expressions
13 5 (1.23%) React
Miscellaneous
1 32 (7.86%) Algorithms
2 23 (5.65%) Management Information System
3 21 (5.16%) Hedge funds
4 17 (4.18%) Clustering
5 15 (3.69%) Cyber Defence
5 15 (3.69%) Distributed Applications
6 14 (3.44%) Data Protection Act
7 13 (3.19%) Data Centre
7 13 (3.19%) Data Structures
7 13 (3.19%) Distributed Computing
8 12 (2.95%) Greenfield Project
9 10 (2.46%) Cloud Native
10 9 (2.21%) Freedom of Information
10 9 (2.21%) Freedom of Information Act
11 8 (1.97%) Product Ownership
12 7 (1.72%) Virtual Team
13 6 (1.47%) Analytical Mindset
13 6 (1.47%) Onboarding
14 5 (1.23%) Distributed Systems
14 5 (1.23%) Self-Motivation
Operating Systems
1 48 (11.79%) Linux
2 28 (6.88%) Unix
3 17 (4.18%) Windows
4 13 (3.19%) Android
4 13 (3.19%) Apple iOS
5 8 (1.97%) VMS
6 4 (0.98%) Windows Server
6 4 (0.98%) Windows Server 2016
6 4 (0.98%) Windows Server 2019
Processes & Methodologies
1 131 (32.19%) Data Modelling
2 122 (29.98%) Analytics
3 117 (28.75%) Data Pipeline
4 112 (27.52%) ETL
5 106 (26.04%) Agile
6 81 (19.90%) Business Intelligence
7 80 (19.66%) Machine Learning
8 76 (18.67%) Data Engineering
9 70 (17.20%) Data Science
10 68 (16.71%) Problem-Solving
11 63 (15.48%) Data Analysis
12 62 (15.23%) CI/CD
13 59 (14.50%) DevOps
14 49 (12.04%) Data Management
15 47 (11.55%) Computer Science
16 46 (11.30%) Migration
17 43 (10.57%) Data Governance
18 40 (9.83%) Data Architecture
18 40 (9.83%) Scrum
19 38 (9.34%) Visualisation
Programming Languages
1 219 (53.81%) Python
2 178 (43.73%) SQL
3 76 (18.67%) Java
4 65 (15.97%) Scala
5 22 (5.41%) R
6 19 (4.67%) JavaScript
6 19 (4.67%) PowerShell
7 16 (3.93%) C#
8 15 (3.69%) Go
9 11 (2.70%) Shell Script
10 7 (1.72%) Perl
11 4 (0.98%) Bash
12 3 (0.74%) PL/SQL
12 3 (0.74%) T-SQL
13 2 (0.49%) Data Analysis Expressions
13 2 (0.49%) U-SQL
14 1 (0.25%) Gremlin
14 1 (0.25%) Groovy
14 1 (0.25%) Tcl
14 1 (0.25%) VBA
Qualifications
1 56 (13.76%) Degree
2 52 (12.78%) Security Cleared
3 31 (7.62%) DV Cleared
3 31 (7.62%) SC Cleared
4 23 (5.65%) Computer Science Degree
5 18 (4.42%) AWS Certification
6 12 (2.95%) Master's Degree
7 7 (1.72%) Azure Certification
8 5 (1.23%) AWS Certified Solutions Architect
9 4 (0.98%) CISSP
9 4 (0.98%) Microsoft Certification
10 3 (0.74%) AWS Certified Developer
10 3 (0.74%) AWS Certified DevOps Engineer
10 3 (0.74%) BPSS Clearance
11 2 (0.49%) Numerate Degree
12 1 (0.25%) PhD
Quality Assurance & Compliance
1 67 (16.46%) Data Quality
2 15 (3.69%) Actionable Recommendations
3 7 (1.72%) QA
4 5 (1.23%) Accessibility
5 4 (0.98%) ISO/IEC 27001
5 4 (0.98%) NIST
6 3 (0.74%) GDPR
7 2 (0.49%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.49%) MiFID
7 2 (0.49%) NCSC
7 2 (0.49%) PCI DSS
7 2 (0.49%) PMO
7 2 (0.49%) SLA
8 1 (0.25%) EMIR
8 1 (0.25%) FATCA
System Software
1 18 (4.42%) Docker
2 15 (3.69%) HDFS
3 4 (0.98%) Active Directory
4 2 (0.49%) Apache ZooKeeper
5 1 (0.25%) Apache Flume
5 1 (0.25%) KVM
5 1 (0.25%) VMware ESXi
5 1 (0.25%) VMware Infrastructure
Systems Management
1 53 (13.02%) Terraform
2 43 (10.57%) Kubernetes
3 22 (5.41%) Ansible
4 16 (3.93%) Puppet
5 13 (3.19%) Prometheus
6 9 (2.21%) Hadoop YARN
7 4 (0.98%) Argo
8 3 (0.74%) Consul
8 3 (0.74%) Oozie
8 3 (0.74%) Packer
8 3 (0.74%) Progress Chef
9 2 (0.49%) Ambari
10 1 (0.25%) Ganglia
10 1 (0.25%) ITRS Geneos
10 1 (0.25%) Kibana
10 1 (0.25%) Nagios
10 1 (0.25%) vCenter Server
10 1 (0.25%) vRealize
Vendors
1 71 (17.44%) Databricks
2 42 (10.32%) Microsoft
3 22 (5.41%) Google
3 22 (5.41%) Talend
4 21 (5.16%) Informatica
5 19 (4.67%) Oracle
6 10 (2.46%) Red Hat
7 9 (2.21%) Teradata
8 6 (1.47%) SAP
9 5 (1.23%) Cloudera
9 5 (1.23%) Salesforce
10 4 (0.98%) Brio
10 4 (0.98%) Foundry
10 4 (0.98%) IBM
10 4 (0.98%) Okta
10 4 (0.98%) Palantir
10 4 (0.98%) Sage
10 4 (0.98%) Splunk
10 4 (0.98%) Symantec
10 4 (0.98%) Varonis