Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 2 July 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
2 Jul 2022		 Same period 2021 Same period 2020
Rank 158 111 89
Rank change year-on-year -47 -22 -14
Contract jobs citing Big Data 1,523 1,526 1,077
As % of all contract jobs advertised in the UK 1.71% 2.30% 2.61%
As % of the Database & Business Intelligence category 8.80% 10.79% 11.64%
Number of daily rates quoted 983 1,029 795
10th Percentile £453 £425 £400
25th Percentile £513 £488 £463
Median daily rate (50th Percentile) £600 £575 £550
Median % change year-on-year +4.35% +4.55% -
75th Percentile £700 £675 £650
90th Percentile £779 £750 £725
UK excluding London median daily rate £550 £545 £538
% change year-on-year +0.92% +1.40% +2.38%
Number of hourly rates quoted 2 10 5
10th Percentile £63.09 £22.80 £25.60
25th Percentile £67.73 £24.56 £37.75
Median hourly rate £75.45 £39.25 £46.50
Median % change year-on-year +92.23% -15.59% -6.87%
75th Percentile £83.18 £51.69 £48.00
90th Percentile £87.81 £53.38 £55.95
UK excluding London median hourly rate £60.00 £24.50 £38.75
% change year-on-year +144.90% -36.77% -26.19%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 17,303 14,140 9,249
As % of all contract IT jobs advertised in the UK 19.45% 21.32% 22.40%
Number of daily rates quoted 12,322 9,678 6,454
10th Percentile £380 £329 £325
25th Percentile £450 £413 £406
Median daily rate (50th Percentile) £550 £500 £500
Median % change year-on-year +10.00% - +5.26%
75th Percentile £650 £600 £588
90th Percentile £750 £700 £675
UK excluding London median daily rate £500 £450 £450
% change year-on-year +11.11% - +4.65%
Number of hourly rates quoted 181 213 130
10th Percentile £14.25 £12.90 £14.09
25th Percentile £21.25 £19.25 £18.85
Median hourly rate £37.80 £26.50 £25.00
Median % change year-on-year +42.64% +6.00% -16.67%
75th Percentile £63.00 £45.00 £45.31
90th Percentile £75.00 £61.16 £61.03
UK excluding London median hourly rate £35.00 £24.90 £24.70
% change year-on-year +40.56% +0.81% -17.67%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 2 July 2022.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 2 July 2022.

Hourly rate histogram for Big Data in the UK

Big Data
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 2 July 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Jobs
England -65 1,182 £600 +4.35% 301
London -47 848 £625 +7.76% 164
Work from Home -21 805 £600 +6.90% 107
UK excluding London -61 319 £550 +0.92% 149
South East -10 103 £525 -4.55% 35
South West -26 64 £600 +10.09% 12
North of England -81 41 £600 +6.19% 50
Midlands -38 38 £500 -9.50% 24
Scotland -30 37 £500 +8.11% 9
West Midlands -36 33 £513 +3.54% 15
East of England -22 25 £475 -10.80% 12
North West -60 20 £613 +5.60% 21
Yorkshire -48 12 £613 +8.12% 26
Wales -2 11 £550 +15.79% 2
North East -4 9 £600 -1.23% 3
East Midlands -10 5 £350 -51.72% 9
Northern Ireland -7 1 £540 +13.68% 5

For the 6 months to 2 July 2022, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 659 (43.27%) Python
2 649 (42.61%) Agile
3 570 (37.43%) Azure
4 561 (36.84%) Analytics
5 539 (35.39%) SQL
6 538 (35.33%) Apache Spark
7 472 (30.99%) AWS
8 428 (28.10%) DevOps
9 397 (26.07%) Java
10 355 (23.31%) Finance
11 354 (23.24%) Kafka
12 340 (22.32%) Data Modelling
13 338 (22.19%) Data Warehouse
14 328 (21.54%) Hadoop
15 325 (21.34%) ETL
16 313 (20.55%) Social Skills
17 300 (19.70%) CI/CD
17 300 (19.70%) Scala
18 294 (19.30%) Databricks
19 280 (18.38%) Business Intelligence
20 275 (18.06%) Data Lake
21 268 (17.60%) Data Science
22 256 (16.81%) Data Engineering
23 251 (16.48%) GCP
24 245 (16.09%) Machine Learning
25 234 (15.36%) Data Pipeline
26 221 (14.51%) Kubernetes
27 210 (13.79%) Docker
28 205 (13.46%) Security Cleared
29 199 (13.07%) NoSQL

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 538 (35.33%) Apache Spark
2 178 (11.69%) Apache
3 105 (6.89%) Apache Airflow
4 63 (4.14%) Confluence
5 20 (1.31%) SAS
6 19 (1.25%) Apache Pig
7 18 (1.18%) Jupyter
8 15 (0.98%) Oracle Coherence
9 10 (0.66%) Luigi
10 9 (0.59%) Camunda
10 9 (0.59%) Tomcat
11 8 (0.53%) Apache Pulsar
12 6 (0.39%) WebLogic
13 5 (0.33%) JBoss
13 5 (0.33%) WebSphere
14 4 (0.26%) CMS
15 3 (0.20%) nginx
15 3 (0.20%) Oracle Service Bus
15 3 (0.20%) Oracle SOA Suite
15 3 (0.20%) WebLogic Portal
Applications
1 33 (2.17%) Microsoft Excel
2 8 (0.53%) Microsoft Office
2 8 (0.53%) Microsoft PowerPoint
3 6 (0.39%) Microsoft Project
4 4 (0.26%) MS Visio
5 2 (0.13%) Spreadsheet
5 2 (0.13%) SPSS
Business Applications
1 10 (0.66%) Sparx Enterprise Architect
2 8 (0.53%) Oracle Financials
3 7 (0.46%) SAP Oil and Gas
4 5 (0.33%) Maximo
4 5 (0.33%) SAP BPC
4 5 (0.33%) SAP CO
4 5 (0.33%) SAP FI
4 5 (0.33%) SAP FI/CO
5 4 (0.26%) Oracle AML
6 3 (0.20%) Avolution ABACUS
6 3 (0.20%) Oracle BPM
7 2 (0.13%) Dynamics CRM
7 2 (0.13%) Primavera
7 2 (0.13%) SAP CRM
8 1 (0.066%) assyst
8 1 (0.066%) SAP S/4HANA
8 1 (0.066%) Shopify
Cloud Services
1 570 (37.43%) Azure
2 472 (30.99%) AWS
3 251 (16.48%) GCP
4 159 (10.44%) Power Platform
5 138 (9.06%) Serverless
6 134 (8.80%) Azure Data Factory
7 88 (5.78%) Azure Synapse Analytics
8 85 (5.58%) Azure DevOps
9 69 (4.53%) GitHub
10 67 (4.40%) AWS Lambda
11 60 (3.94%) Amazon S3
12 57 (3.74%) Snowflake
13 45 (2.95%) Amazon EMR
13 45 (2.95%) PaaS
14 44 (2.89%) Azure Monitor
15 43 (2.82%) Azure AKS
16 42 (2.76%) Azure Cosmos DB
17 33 (2.17%) Azure Functions
18 32 (2.10%) AWS CloudFormation
19 30 (1.97%) Amazon EC2
Communications & Networking
1 16 (1.05%) Firewall
2 15 (0.98%) Internet
3 8 (0.53%) SSL
4 6 (0.39%) SSH
5 4 (0.26%) FTP
5 4 (0.26%) Radio Access Network
5 4 (0.26%) Software-Defined Networking
5 4 (0.26%) Wireless
6 3 (0.20%) 4G
6 3 (0.20%) AMQP
6 3 (0.20%) DNS
6 3 (0.20%) HTTP
6 3 (0.20%) Intrusion Detection
6 3 (0.20%) Kerberos
7 2 (0.13%) Cisco IPT
7 2 (0.13%) Modbus
7 2 (0.13%) MQTT
7 2 (0.13%) Network Security
7 2 (0.13%) SAN
7 2 (0.13%) ZigBee
Database & Business Intelligence
1 338 (22.19%) Data Warehouse
2 328 (21.54%) Hadoop
3 275 (18.06%) Data Lake
4 199 (13.07%) NoSQL
5 159 (10.44%) Power BI
6 142 (9.32%) Apache Hive
7 108 (7.09%) Relational Database
8 92 (6.04%) BigQuery
8 92 (6.04%) Tableau
9 88 (5.78%) Metadata
9 88 (5.78%) SQL Server
10 84 (5.52%) HBase
11 75 (4.92%) Amazon Redshift
12 64 (4.20%) RDBMS
13 63 (4.14%) MongoDB
13 63 (4.14%) Pentaho
14 59 (3.87%) Azure SQL Database
15 58 (3.81%) Apache Cassandra
16 55 (3.61%) Flink
17 50 (3.28%) SQL Server Integration Services
Development Applications
1 182 (11.95%) Git (software)
2 159 (10.44%) JIRA
3 105 (6.89%) Jenkins
4 79 (5.19%) GitLab
5 57 (3.74%) Maven
6 51 (3.35%) kappa
7 43 (2.82%) PowerDesigner
8 40 (2.63%) MLflow
9 33 (2.17%) Gradle
10 30 (1.97%) TeamCity
11 28 (1.84%) Sonatype Nexus
12 23 (1.51%) ERwin
13 17 (1.12%) Selenium
14 15 (0.98%) JUnit
15 14 (0.92%) Cucumber
16 13 (0.85%) Artifactory
17 12 (0.79%) Bitbucket
18 10 (0.66%) Mockito
19 9 (0.59%) JBehave
19 9 (0.59%) Team Foundation Server
General
1 355 (23.31%) Finance
2 313 (20.55%) Social Skills
3 182 (11.95%) Analytical Skills
4 181 (11.88%) Banking
5 76 (4.99%) Public Sector
6 55 (3.61%) Investment Banking
7 54 (3.55%) Retail
8 45 (2.95%) Presentation Skills
9 42 (2.76%) Front Office
10 39 (2.56%) Legal
11 38 (2.50%) Marketing
12 30 (1.97%) Financial Institution
12 30 (1.97%) Telecoms
13 23 (1.51%) Influencing Skills
13 23 (1.51%) Law
14 14 (0.92%) Manufacturing
15 13 (0.85%) Games
16 12 (0.79%) Publishing
17 9 (0.59%) German Language
18 8 (0.53%) Organisational Skills
Job Titles
1 428 (28.10%) Data Engineer
2 319 (20.95%) Architect
3 257 (16.87%) Developer
4 194 (12.74%) Data Architect
5 133 (8.73%) Big Data Engineer
6 106 (6.96%) Solutions Architect
7 84 (5.52%) Azure Engineer
8 66 (4.33%) Java Developer
8 66 (4.33%) Python Developer
9 64 (4.20%) Azure Data Engineer
10 63 (4.14%) Big Data Developer
11 62 (4.07%) Analyst
12 61 (4.01%) Software Engineer
13 60 (3.94%) DevOps Engineer
14 59 (3.87%) Senior Data Engineer
15 58 (3.81%) AWS Engineer
16 55 (3.61%) Data Scientist
17 54 (3.55%) Java Engineer
18 50 (3.28%) Senior Developer
19 49 (3.22%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 354 (23.24%) Kafka
2 116 (7.62%) PySpark
3 78 (5.12%) Pandas
4 74 (4.86%) NumPy
5 58 (3.81%) HTML
6 57 (3.74%) React
7 52 (3.41%) Apache Beam
7 52 (3.41%) Spring
8 48 (3.15%) CSS
9 46 (3.02%) Apache NiFi
9 46 (3.02%) RabbitMQ
9 46 (3.02%) TensorFlow
10 42 (2.76%) .NET
10 42 (2.76%) REST
11 36 (2.36%) Flask
12 35 (2.30%) PyTorch
13 34 (2.23%) Spark Streaming
14 33 (2.17%) Django
15 32 (2.10%) jQuery
16 31 (2.04%) Celery
Miscellaneous
1 84 (5.52%) Algorithms
2 81 (5.32%) Data Structures
3 55 (3.61%) Management Information System
4 51 (3.35%) Cloud Native
5 40 (2.63%) Virtual Team
6 37 (2.43%) Enterprise Software
7 34 (2.23%) Public Cloud
8 33 (2.17%) Self-Motivation
9 30 (1.97%) Legacy Systems
10 29 (1.90%) User Experience
11 28 (1.84%) Reference Data
12 25 (1.64%) Greenfield Project
12 25 (1.64%) Hedge funds
13 21 (1.38%) Equities
13 21 (1.38%) Linux Command Line
14 20 (1.31%) IoT
15 19 (1.25%) Market Risk
16 18 (1.18%) Credit Risk
17 16 (1.05%) Data Protection Act
17 16 (1.05%) Hybrid Cloud
Operating Systems
1 176 (11.56%) Linux
2 47 (3.09%) Unix
3 25 (1.64%) Windows
4 9 (0.59%) Red Hat Enterprise Linux
5 7 (0.46%) VMS
6 6 (0.39%) Ubuntu
7 5 (0.33%) Apple iOS
7 5 (0.33%) CentOS
8 1 (0.066%) Android
8 1 (0.066%) VxWorks
Processes & Methodologies
1 649 (42.61%) Agile
2 561 (36.84%) Analytics
3 428 (28.10%) DevOps
4 340 (22.32%) Data Modelling
5 325 (21.34%) ETL
6 300 (19.70%) CI/CD
7 280 (18.38%) Business Intelligence
8 268 (17.60%) Data Science
9 256 (16.81%) Data Engineering
10 245 (16.09%) Machine Learning
11 234 (15.36%) Data Pipeline
12 198 (13.00%) Microservices
13 185 (12.15%) Scrum
14 179 (11.75%) Data Architecture
14 179 (11.75%) Software Engineering
15 165 (10.83%) Data Management
16 161 (10.57%) Migration
17 156 (10.24%) Test Automation
18 141 (9.26%) Problem-Solving
19 140 (9.19%) Data Analysis
Programming Languages
1 659 (43.27%) Python
2 539 (35.39%) SQL
3 397 (26.07%) Java
4 300 (19.70%) Scala
5 86 (5.65%) R
6 73 (4.79%) JavaScript
7 57 (3.74%) C#
8 52 (3.41%) C
9 39 (2.56%) Bash
10 34 (2.23%) PowerShell
11 30 (1.97%) Shell Script
12 23 (1.51%) C++
13 20 (1.31%) T-SQL
14 19 (1.25%) PL/SQL
15 17 (1.12%) Data Analysis Expressions (DAX)
16 12 (0.79%) Go
17 11 (0.72%) Perl
18 10 (0.66%) Ruby
19 9 (0.59%) TypeScript
20 8 (0.53%) Groovy
Qualifications
1 205 (13.46%) Security Cleared
2 166 (10.90%) SC Cleared
3 115 (7.55%) Degree
4 83 (5.45%) DV Cleared
5 43 (2.82%) PhD
6 27 (1.77%) Computer Science Degree
7 19 (1.25%) TOGAF Certification
8 18 (1.18%) Master's Degree
9 15 (0.98%) AWS Certification
10 14 (0.92%) Microsoft Certification
11 13 (0.85%) CISSP
12 10 (0.66%) PMP
13 9 (0.59%) PMI Certification
14 8 (0.53%) CASP
14 8 (0.53%) ISTQB
15 7 (0.46%) ISEB
16 5 (0.33%) Cisco Certification
17 4 (0.26%) BPSS Clearance
17 4 (0.26%) CISM
18 3 (0.20%) CREST Certified
Quality Assurance & Compliance
1 88 (5.78%) Data Quality
2 70 (4.60%) QA
3 39 (2.56%) GDPR
4 14 (0.92%) Accessibility
5 12 (0.79%) SLA
6 9 (0.59%) ISO/IEC 27001
7 8 (0.53%) NIST
8 7 (0.46%) IFRS
9 4 (0.26%) GRC
10 3 (0.20%) IFRS 17
10 3 (0.20%) IFRS 9
11 2 (0.13%) COBIT
11 2 (0.13%) PMO
11 2 (0.13%) Sarbanes-Oxley
System Software
1 210 (13.79%) Docker
2 75 (4.92%) HDFS
3 11 (0.72%) Apache Flume
4 8 (0.53%) VMware Infrastructure
5 6 (0.39%) Virtual Machines
6 4 (0.26%) Apache ZooKeeper
6 4 (0.26%) VMware ESXi
6 4 (0.26%) vSphere
7 3 (0.20%) Platform Symphony
8 2 (0.13%) Active Directory
8 2 (0.13%) EMC RecoverPoint
9 1 (0.066%) Firmware
9 1 (0.066%) KVM
9 1 (0.066%) Oracle RAC
9 1 (0.066%) Tivoli Workload Scheduler
Systems Management
1 221 (14.51%) Kubernetes
2 153 (10.05%) Terraform
3 82 (5.38%) Ansible
4 28 (1.84%) Kubeflow
5 22 (1.44%) Grafana
6 19 (1.25%) Kibana
7 18 (1.18%) Hadoop YARN
7 18 (1.18%) Puppet
8 15 (0.98%) Istio
9 13 (0.85%) Prometheus
10 11 (0.72%) Argo
10 11 (0.72%) logstash
10 11 (0.72%) Packer
11 9 (0.59%) Opscode Chef
12 8 (0.53%) Docker Swarm
13 7 (0.46%) Failover Clustering
13 7 (0.46%) Oozie
13 7 (0.46%) Rancher
14 5 (0.33%) ITRS Geneos
14 5 (0.33%) Mesos
Vendors
1 294 (19.30%) Databricks
2 175 (11.49%) Microsoft
3 134 (8.80%) Oracle
4 119 (7.81%) Google
5 85 (5.58%) Talend
6 59 (3.87%) Cloudera
7 55 (3.61%) SAP
8 45 (2.95%) BiZZdesign
9 43 (2.82%) Informatica
10 33 (2.17%) IBM
11 31 (2.04%) Teradata
12 28 (1.84%) AppDynamics
13 25 (1.64%) Alteryx
14 23 (1.51%) VMware
15 21 (1.38%) Netezza
15 21 (1.38%) Splunk
16 17 (1.12%) Adobe
17 16 (1.05%) Hortonworks
18 14 (0.92%) Salesforce.com
19 12 (0.79%) MuleSoft
324 Big Data job vacancies Nationwide