Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 20 April 2021

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 20 April 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
20 Apr 2021		 Same period 2020 Same period 2019
Rank 102 93 81
Rank change year-on-year -9 -12 +4
Contract jobs citing Big Data 1,233 1,391 2,915
As % of all contract jobs advertised in the UK 2.30% 2.42% 3.05%
As % of the Database & Business Intelligence category 10.92% 11.49% 13.64%
Number of daily rates quoted 833 994 2,054
10th Percentile £413 £400 £413
25th Percentile £475 £463 £475
Median daily rate (50th Percentile) £551 £550 £550
Median % change year-on-year +0.09% - -
75th Percentile £638 £650 £638
90th Percentile £716 £725 £713
UK excluding London median daily rate £525 £550 £525
% change year-on-year -4.55% +4.76% +7.14%
Number of hourly rates quoted 6 3 7
10th Percentile £19.00 £39.25 £20.65
25th Percentile £27.00 £41.50 £29.63
Median hourly rate £47.25 £46.50 £45.00
Median % change year-on-year +1.61% +3.33% +20.81%
75th Percentile £54.31 £47.88 £52.50
90th Percentile £60.75 £47.95 £59.00
UK excluding London median hourly rate £50.00 - £45.00

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 11,296 12,105 21,377
As % of all contract IT jobs advertised in the UK 21.09% 21.08% 22.34%
Number of daily rates quoted 7,749 8,267 14,850
10th Percentile £320 £320 £320
25th Percentile £405 £400 £390
Median daily rate (50th Percentile) £500 £475 £475
Median % change year-on-year +5.26% - +2.15%
75th Percentile £588 £575 £575
90th Percentile £675 £675 £650
UK excluding London median daily rate £438 £450 £430
% change year-on-year -2.78% +4.65% +4.24%
Number of hourly rates quoted 193 182 236
10th Percentile £13.50 £14.37 £14.00
25th Percentile £19.00 £18.25 £18.14
Median hourly rate £26.00 £24.70 £30.00
Median % change year-on-year +5.26% -17.67% -0.83%
75th Percentile £45.20 £44.85 £47.50
90th Percentile £58.75 £57.95 £57.50
UK excluding London median hourly rate £23.50 £22.50 £30.00
% change year-on-year +4.44% -25.00% -14.94%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 20 April 2021.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 20 April 2021.

Hourly rate histogram for Big Data in the UK

Big Data
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 20 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -12 1,002 £555 +0.91% 404
London -15 665 £575 - 231
Work from Home -43 358 £575 -11.54% 75
UK excluding London -18 327 £525 -4.55% 191
South West +55 84 £525 -5.75% 18
South East -32 73 £519 +3.75% 50
North of England -40 68 £550 -1.79% 48
Scotland +11 45 £425 -26.09% 17
North West -29 40 £550 -2.22% 34
East of England +29 26 £600 +41.18% 36
Midlands +18 24 £565 +7.62% 20
Yorkshire -1 24 £550 +3.77% 11
West Midlands +6 16 £550 +10.00% 13
East Midlands +20 8 £725 +31.82% 7
North East +19 4 £700 +1.82% 3
Northern Ireland +12 4 £450 - 1
Wales -3 4 £475 -5.00% 2

For the 6 months to 20 April 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 423 (34.31%) Python
2 420 (34.06%) Agile Software Development
3 412 (33.41%) Apache Spark
4 369 (29.93%) SQL
5 366 (29.68%) AWS
6 365 (29.60%) Hadoop
7 339 (27.49%) Analytics
8 333 (27.01%) Java
9 320 (25.95%) Azure
10 301 (24.41%) Finance
11 289 (23.44%) DevOps
12 277 (22.47%) Kafka
13 242 (19.63%) ETL
14 239 (19.38%) Data Warehouse
14 239 (19.38%) Scala
15 227 (18.41%) Data Modelling
16 213 (17.27%) Security Cleared
17 203 (16.46%) Apache Hive
18 190 (15.41%) SC Cleared
19 187 (15.17%) GCP
20 184 (14.92%) Docker
21 175 (14.19%) Kubernetes
22 170 (13.79%) Data Engineering
22 170 (13.79%) Apache
23 164 (13.30%) Data Lake
24 158 (12.81%) Business Intelligence
24 158 (12.81%) Banking
25 157 (12.73%) Software Engineering
26 154 (12.49%) Analytical Skills
27 153 (12.41%) Linux

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 412 (33.41%) Apache Spark
2 170 (13.79%) Apache
3 54 (4.38%) Apache Airflow
4 45 (3.65%) Confluence
5 38 (3.08%) Elasticsearch
6 22 (1.78%) Oracle Coherence
7 21 (1.70%) SAS
8 14 (1.14%) Jupyter
9 13 (1.05%) SharePoint
10 7 (0.57%) Apache Pig
11 6 (0.49%) Luigi
11 6 (0.49%) OpenStack
12 5 (0.41%) Apache Pulsar
12 5 (0.41%) BizTalk Server
13 4 (0.32%) Apache Solr
13 4 (0.32%) nginx
14 3 (0.24%) Cloud Foundry
14 3 (0.24%) Oracle Workflow
14 3 (0.24%) WebLogic
15 2 (0.16%) Oracle SOA Suite
Applications
1 11 (0.89%) Microsoft Excel
2 9 (0.73%) Microsoft Office
3 5 (0.41%) Chatbot
3 5 (0.41%) SPSS
4 3 (0.24%) MS Visio
5 2 (0.16%) Microsoft PowerPoint
5 2 (0.16%) Microsoft Project
6 1 (0.081%) Spreadsheet
Business Applications
1 13 (1.05%) Dynamics CRM
2 5 (0.41%) Dynamics AX
3 4 (0.32%) Oracle EBS
3 4 (0.32%) Sparx Enterprise Architect
4 3 (0.24%) NetSuite
5 2 (0.16%) SAP ERP
5 2 (0.16%) SAP IS-U
5 2 (0.16%) SAP MDM
5 2 (0.16%) Temenos T24
6 1 (0.081%) Adobe Campaign
6 1 (0.081%) BusinessWorks
6 1 (0.081%) Eloqua
6 1 (0.081%) Oracle BPM
6 1 (0.081%) Oracle ERP
6 1 (0.081%) Oracle Payables
6 1 (0.081%) Oracle Receivables
6 1 (0.081%) SAP CRM
6 1 (0.081%) SAP Hybris
6 1 (0.081%) SAP MDG
6 1 (0.081%) SAP S/4HANA
Cloud Services
1 366 (29.68%) AWS
2 320 (25.95%) Azure
3 187 (15.17%) GCP
4 143 (11.60%) Serverless
5 84 (6.81%) AWS Lambda
6 76 (6.16%) Amazon S3
6 76 (6.16%) GitHub
7 70 (5.68%) Power Platform
8 56 (4.54%) Amazon EMR
9 37 (3.00%) Cloud Computing
10 34 (2.76%) PaaS
11 32 (2.60%) Azure Data Factory
12 30 (2.43%) Azure Synapse Analytics
13 28 (2.27%) Amazon EC2
14 21 (1.70%) Amazon Kinesis
15 18 (1.46%) SaaS
16 17 (1.38%) Amazon EKS
17 16 (1.30%) Amazon ECS
17 16 (1.30%) IaaS
17 16 (1.30%) OpenShift
Communications & Networking
1 24 (1.95%) HTTP
2 13 (1.05%) Firewall
3 8 (0.65%) Internet
3 8 (0.65%) Kerberos
3 8 (0.65%) Network Security
4 6 (0.49%) DNS
5 5 (0.41%) Remote Desktop
6 4 (0.32%) Intrusion Detection
6 4 (0.32%) SSL
7 3 (0.24%) SMTP
8 2 (0.16%) 2G
8 2 (0.16%) 3G
8 2 (0.16%) 4G
8 2 (0.16%) 5G
8 2 (0.16%) Cisco IOS
8 2 (0.16%) DHCP
8 2 (0.16%) FTP
8 2 (0.16%) Radio Access Network
8 2 (0.16%) VLAN
8 2 (0.16%) VPN
Database & Business Intelligence
1 365 (29.60%) Hadoop
2 239 (19.38%) Data Warehouse
3 203 (16.46%) Apache Hive
4 164 (13.30%) Data Lake
5 116 (9.41%) NoSQL
6 88 (7.14%) Relational Database
7 79 (6.41%) BigQuery
8 75 (6.08%) HBase
9 69 (5.60%) MongoDB
9 69 (5.60%) Power BI
10 65 (5.27%) Impala
11 57 (4.62%) SQL Server
12 55 (4.46%) Tableau
13 52 (4.22%) PostgreSQL
14 47 (3.81%) Data Mining
15 43 (3.49%) Amazon Redshift
16 38 (3.08%) Apache Cassandra
16 38 (3.08%) Bigtable
17 33 (2.68%) Snowflake Schema
18 32 (2.60%) Cloud Spanner
Development Applications
1 101 (8.19%) Jenkins
2 86 (6.97%) JIRA
3 83 (6.73%) Git (software)
4 66 (5.35%) GitLab
5 51 (4.14%) Maven
6 32 (2.60%) PowerDesigner
6 32 (2.60%) Sonatype Nexus
7 23 (1.87%) IBM UrbanCode
7 23 (1.87%) kappa
8 16 (1.30%) Artifactory
8 16 (1.30%) Cucumber
8 16 (1.30%) Gradle
8 16 (1.30%) Selenium
9 13 (1.05%) ERwin
10 12 (0.97%) Bitbucket
11 9 (0.73%) TeamCity
12 8 (0.65%) RStudio
13 7 (0.57%) Protractor
14 6 (0.49%) SonarQube
14 6 (0.49%) Visual Studio Team System
General
1 301 (24.41%) Finance
2 158 (12.81%) Banking
3 52 (4.22%) Investment Banking
4 48 (3.89%) Public Sector
5 38 (3.08%) Retail
6 36 (2.92%) Marketing
7 32 (2.60%) Telecoms
8 22 (1.78%) Front Office
9 19 (1.54%) Legal
10 15 (1.22%) Manufacturing
11 12 (0.97%) Pharmaceutical
12 10 (0.81%) Retail Banking
13 8 (0.65%) Electronics
13 8 (0.65%) French Language
13 8 (0.65%) Games
14 6 (0.49%) Multimedia
15 5 (0.41%) Automotive
15 5 (0.41%) Law
16 4 (0.32%) Financial Institution
17 3 (0.24%) Publishing
Job Titles
1 291 (23.60%) Data Engineer
2 259 (21.01%) Developer
3 230 (18.65%) Architect
4 139 (11.27%) Data Architect
5 116 (9.41%) Big Data Engineer
6 96 (7.79%) AWS Engineer
7 90 (7.30%) DevOps Engineer
8 74 (6.00%) Scala Developer
9 70 (5.68%) Solutions Architect
10 65 (5.27%) Analyst
11 61 (4.95%) Software Engineer
12 56 (4.54%) Big Data Developer
13 46 (3.73%) AWS DevOps
14 44 (3.57%) Senior Developer
15 42 (3.41%) AWS DevOps Engineer
15 42 (3.41%) Cloud Engineer
15 42 (3.41%) Java Developer
16 40 (3.24%) Cloud Architect
16 40 (3.24%) Data Analyst
16 40 (3.24%) Data Scientist
Libraries, Frameworks & Software Standards
1 277 (22.47%) Kafka
2 80 (6.49%) PySpark
3 62 (5.03%) Apache NiFi
4 52 (4.22%) Web Services
5 46 (3.73%) RESTful
6 31 (2.51%) .NET
6 31 (2.51%) JSON
7 29 (2.35%) HTML
8 26 (2.11%) Node.js
9 24 (1.95%) REST
10 23 (1.87%) React
10 23 (1.87%) Spark Streaming
10 23 (1.87%) Spring
10 23 (1.87%) XML
11 22 (1.78%) NumPy
12 21 (1.70%) Akka
13 20 (1.62%) Velocity
14 18 (1.46%) CSS
15 17 (1.38%) TensorFlow
16 16 (1.30%) Pandas
Miscellaneous
1 154 (12.49%) Analytical Skills
2 46 (3.73%) Data Structures
3 45 (3.65%) Algorithms
4 44 (3.57%) Greenfield Project
5 32 (2.60%) Self-Motivation
6 28 (2.27%) Cloud Native
6 28 (2.27%) Virtual Team
7 26 (2.11%) Linux Command Line
8 22 (1.78%) Market Risk
9 21 (1.70%) User Experience
10 19 (1.54%) Grid Computing
11 17 (1.38%) Public Cloud
12 15 (1.22%) Enterprise Software
12 15 (1.22%) iPad
13 14 (1.14%) Hedge funds
14 13 (1.05%) Analytical Mindset
15 12 (0.97%) Reference Data
16 11 (0.89%) Data Centre
17 10 (0.81%) FMCG
17 10 (0.81%) Hybrid Cloud
Operating Systems
1 153 (12.41%) Linux
2 39 (3.16%) Unix
3 25 (2.03%) Windows
4 7 (0.57%) Red Hat Enterprise Linux
5 5 (0.41%) AIX
6 4 (0.32%) Android
6 4 (0.32%) Apple iOS
7 3 (0.24%) Windows Server
8 2 (0.16%) CoreOS
8 2 (0.16%) HPUX
8 2 (0.16%) Solaris
8 2 (0.16%) SUSE Linux Enterprise Server
8 2 (0.16%) VMS
8 2 (0.16%) Windows 10
9 1 (0.081%) CentOS
9 1 (0.081%) Mac OS X
9 1 (0.081%) MVS
9 1 (0.081%) Ubuntu
Processes & Methodologies
1 420 (34.06%) Agile Software Development
2 339 (27.49%) Analytics
3 289 (23.44%) DevOps
4 242 (19.63%) ETL
5 227 (18.41%) Data Modelling
6 170 (13.79%) Data Engineering
7 158 (12.81%) Business Intelligence
8 157 (12.73%) Software Engineering
9 144 (11.68%) Data Science
10 137 (11.11%) Migration
11 131 (10.62%) TDD
12 129 (10.46%) Microservices
13 120 (9.73%) Scrum
14 119 (9.65%) Machine Learning
15 118 (9.57%) Data Management
16 113 (9.16%) Data Analytics
17 111 (9.00%) Data Architecture
17 111 (9.00%) Test Automation
18 109 (8.84%) Problem-Solving
19 92 (7.46%) Visualisation
Programming Languages
1 423 (34.31%) Python
2 369 (29.93%) SQL
3 333 (27.01%) Java
4 239 (19.38%) Scala
5 57 (4.62%) R
6 49 (3.97%) Shell Script
7 47 (3.81%) JavaScript
8 29 (2.35%) C#
9 21 (1.70%) Bash Shell
10 20 (1.62%) C
10 20 (1.62%) TypeScript
11 19 (1.54%) C++
12 18 (1.46%) Haskell
13 17 (1.38%) PL/SQL
14 16 (1.30%) Groovy
14 16 (1.30%) T-SQL
15 10 (0.81%) PowerShell
16 9 (0.73%) Elm
16 9 (0.73%) Go
17 8 (0.65%) Perl
Qualifications
1 213 (17.27%) Security Cleared
2 190 (15.41%) SC Cleared
3 67 (5.43%) DV Cleared
4 54 (4.38%) Degree
5 19 (1.54%) Computer Science Degree
6 15 (1.22%) AWS Certification
7 9 (0.73%) Microsoft Certification
8 8 (0.65%) Master's Degree
8 8 (0.65%) PhD
9 6 (0.49%) TOGAF Certification
10 5 (0.41%) CISM
10 5 (0.41%) CISSP
11 4 (0.32%) BPSS Clearance
11 4 (0.32%) CCA
11 4 (0.32%) Numerate Degree
12 3 (0.24%) CESG Certified Professional
13 2 (0.16%) Cisco Certification
13 2 (0.16%) DBS Check
13 2 (0.16%) MCP
14 1 (0.081%) PMP
Quality Assurance & Compliance
1 79 (6.41%) Data Quality
2 66 (5.35%) QA
3 13 (1.05%) SLA
4 10 (0.81%) GDPR
5 4 (0.32%) IFRS
5 4 (0.32%) PMO
6 3 (0.24%) IFRS 9
6 3 (0.24%) MiFID
6 3 (0.24%) NCSC
7 2 (0.16%) Basel II
7 2 (0.16%) ISO 20022
7 2 (0.16%) ISO/IEC 20000
7 2 (0.16%) Section 508
7 2 (0.16%) WAI
8 1 (0.081%) Actionable Recommendations
8 1 (0.081%) Disclosure Scotland
8 1 (0.081%) Government Security Classifications
8 1 (0.081%) PCI DSS
8 1 (0.081%) Sarbanes-Oxley
System Software
1 184 (14.92%) Docker
2 101 (8.19%) HDFS
3 15 (1.22%) Active Directory
4 13 (1.05%) Apache Flume
5 11 (0.89%) Apache ZooKeeper
6 10 (0.81%) Virtual Machines
7 6 (0.49%) VMware Infrastructure
8 2 (0.16%) VMware NSX
9 1 (0.081%) Active Directory Lightweight Directory Services
9 1 (0.081%) Platform Symphony
Systems Management
1 175 (14.19%) Kubernetes
2 118 (9.57%) Terraform
3 111 (9.00%) Ansible
4 44 (3.57%) Oozie
5 37 (3.00%) Hadoop YARN
6 19 (1.54%) Puppet
7 14 (1.14%) Opscode Chef
8 12 (0.97%) Packer
9 7 (0.57%) Control-M
10 6 (0.49%) Kibana
11 4 (0.32%) Argo
11 4 (0.32%) Docker Swarm
12 3 (0.24%) Ambari
12 3 (0.24%) MIIS
12 3 (0.24%) Prometheus
12 3 (0.24%) Single Sign-On
13 2 (0.16%) Grafana
13 2 (0.16%) HP Fortify
13 2 (0.16%) Mesos
13 2 (0.16%) WebInspect
Vendors
1 129 (10.46%) Oracle
2 122 (9.89%) Cloudera
3 113 (9.16%) Google
4 96 (7.79%) Microsoft
5 89 (7.22%) Databricks
6 42 (3.41%) Hortonworks
7 40 (3.24%) SAP
8 36 (2.92%) Informatica
9 31 (2.51%) BiZZdesign
10 28 (2.27%) IBM
11 20 (1.62%) MuleSoft
11 20 (1.62%) Talend
12 19 (1.54%) Alteryx
12 19 (1.54%) Teradata
13 16 (1.30%) Salesforce.com
14 15 (1.22%) StreamSets
15 14 (1.14%) VMware
16 13 (1.05%) MapR
17 10 (0.81%) Splunk
18 8 (0.65%) Ab Initio
437 Big Data job vacancies Nationwide