Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 18 January 2021

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 18 January 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
18 Jan 2021		 Same period 2020 Same period 2019
Rank 104 97 93
Rank change year-on-year -7 -4 -2
Contract jobs citing Big Data 926 1,750 2,642
As % of all contract jobs advertised in the UK 2.26% 2.42% 2.66%
As % of the Database & Business Intelligence category 10.42% 11.40% 11.72%
Number of daily rates quoted 832 1,248 1,858
Median daily rate £535 £550 £550
Median daily rate % change year-on-year -2.73% - -
10th Percentile £365 £400 £413
90th Percentile £675 £725 £713
UK excluding London median daily rate £500 £525 £515
% change year-on-year -4.76% +1.94% +5.64%
Number of hourly rates quoted 12 0 10
Median hourly rate £21.50 - £45.00
10th Percentile £10.35 - £24.08
90th Percentile £69.65 - £57.75
UK excluding London median hourly rate £21.50 - £42.50

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 8,883 15,350 22,552
As % of all contract IT jobs advertised in the UK 21.67% 21.24% 22.67%
Number of daily rates quoted 6,058 10,449 15,711
Median daily rate £480 £475 £475
Median daily rate % change year-on-year +1.05% - +5.56%
10th Percentile £313 £319 £319
90th Percentile £650 £663 £644
UK excluding London median daily rate £425 £438 £425
% change year-on-year -2.86% +2.94% +6.25%
Number of hourly rates quoted 159 211 230
Median hourly rate £26.00 £26.00 £26.38
Median hourly rate % change year-on-year - -1.43% -11.34%
10th Percentile £13.47 £12.50 £13.25
90th Percentile £60.05 £57.50 £55.10
Median hourly rate £23.45 £22.55 £26.05
% change year-on-year +4.01% -13.46% -21.05%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 18 January 2021.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 18 January 2021.

Hourly rate histogram for Big Data in the UK

Big Data
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 18 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -11 768 £525 -4.55% 324
London -13 482 £550 -4.35% 185
UK excluding London -21 279 £500 -4.76% 155
Work from Home -34 253 £550 - 51
North of England +7 81 £525 -4.55% 39
North West +21 63 £525 -3.23% 22
South East -13 62 £500 - 29
South West +26 49 £475 -14.18% 18
East of England +46 33 £450 -14.29% 22
Midlands +33 26 £388 -18.42% 28
Scotland -1 24 £400 -25.58% 12
East Midlands +35 17 £380 -28.56% 15
Yorkshire +6 15 £550 +5.52% 17
West Midlands +27 9 £525 +11.70% 12
Wales +19 4 - - 6
Northern Ireland +6 4 £440 -26.67% 1
North East +21 3 £700 +3.70%

For the 6 months to 18 January 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 362 (39.09%) Python
2 306 (33.05%) Agile Software Development
3 295 (31.86%) Apache Spark
4 291 (31.43%) SQL
5 274 (29.59%) Hadoop
6 271 (29.27%) Java
7 246 (26.57%) Azure
7 246 (26.57%) AWS
8 239 (25.81%) DevOps
9 231 (24.95%) Analytics
10 199 (21.49%) ETL
11 185 (19.98%) Kafka
12 179 (19.33%) Finance
13 175 (18.90%) Security Cleared
14 158 (17.06%) Apache Hive
15 155 (16.74%) SC Cleared
16 154 (16.63%) Scala
17 148 (15.98%) Docker
18 146 (15.77%) Data Engineering
19 144 (15.55%) Data Warehouse
20 143 (15.44%) Data Science
21 133 (14.36%) Data Modelling
22 132 (14.25%) Business Intelligence
23 122 (13.17%) Analytical Skills
24 115 (12.42%) Machine Learning
25 113 (12.20%) Linux
26 111 (11.99%) Data Lake
26 111 (11.99%) Terraform
27 107 (11.56%) Kubernetes
28 106 (11.45%) GCP

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 295 (31.86%) Apache Spark
2 90 (9.72%) Apache
3 29 (3.13%) Confluence
4 28 (3.02%) Elasticsearch
5 25 (2.70%) Apache Airflow
6 20 (2.16%) SAS
7 14 (1.51%) Jupyter
8 11 (1.19%) SharePoint
9 9 (0.97%) Tomcat
10 5 (0.54%) Apache Pig
11 4 (0.43%) BizTalk Server
11 4 (0.43%) Cloud Foundry
11 4 (0.43%) nginx
12 3 (0.32%) Oracle Coherence
12 3 (0.32%) Skype for Business
12 3 (0.32%) Tornado
13 2 (0.22%) Apache Pulsar
13 2 (0.22%) ArcGIS
13 2 (0.22%) Luigi
13 2 (0.22%) OpenStack
Applications
1 10 (1.08%) Microsoft Excel
2 9 (0.97%) Microsoft Office
3 7 (0.76%) Chatbot
4 5 (0.54%) MS Visio
5 4 (0.43%) Microsoft PowerPoint
6 3 (0.32%) SPSS
7 1 (0.11%) Microsoft Project
7 1 (0.11%) Spreadsheet
7 1 (0.11%) Stata
Business Applications
1 4 (0.43%) Dynamics AX
1 4 (0.43%) Dynamics CRM
1 4 (0.43%) Sparx Enterprise Architect
2 3 (0.32%) SAP IS-U
3 2 (0.22%) Cognos Business Intelligence
3 2 (0.22%) SAP ERP
4 1 (0.11%) BusinessWorks
4 1 (0.11%) NetSuite
4 1 (0.11%) PeopleSoft HCM
4 1 (0.11%) SAP CRM
4 1 (0.11%) SAP MDM
4 1 (0.11%) SAP S/4HANA
Cloud Services
1 246 (26.57%) AWS
1 246 (26.57%) Azure
2 106 (11.45%) GCP
3 87 (9.40%) Serverless
4 65 (7.02%) GitHub
5 54 (5.83%) AWS Lambda
6 46 (4.97%) Amazon S3
7 45 (4.86%) Power Platform
8 41 (4.43%) Amazon EMR
9 32 (3.46%) PaaS
10 29 (3.13%) Azure Data Factory
11 15 (1.62%) Amazon EC2
11 15 (1.62%) Amazon EKS
12 14 (1.51%) SaaS
13 13 (1.40%) Amazon CloudWatch
13 13 (1.40%) Amazon Kinesis
13 13 (1.40%) Cloud Computing
14 11 (1.19%) IaaS
14 11 (1.19%) Virtual Private Cloud
15 9 (0.97%) Office 365
Communications & Networking
1 15 (1.62%) Firewall
2 8 (0.86%) HTTP
3 7 (0.76%) Kerberos
3 7 (0.76%) SSL
4 5 (0.54%) DNS
4 5 (0.54%) Internet
4 5 (0.54%) VPN
5 3 (0.32%) Intrusion Detection
6 2 (0.22%) 2G
6 2 (0.22%) 3G
6 2 (0.22%) 4G
6 2 (0.22%) 5G
6 2 (0.22%) Radio Access Network
6 2 (0.22%) Skype
6 2 (0.22%) SMTP
6 2 (0.22%) Unified Communications
7 1 (0.11%) LAN
7 1 (0.11%) PuTTY
7 1 (0.11%) Software-Defined Networking
7 1 (0.11%) WAN
Database & Business Intelligence
1 274 (29.59%) Hadoop
2 158 (17.06%) Apache Hive
3 144 (15.55%) Data Warehouse
4 111 (11.99%) Data Lake
5 88 (9.50%) NoSQL
6 65 (7.02%) Impala
6 65 (7.02%) Relational Database
7 56 (6.05%) BigQuery
8 43 (4.64%) Power BI
9 40 (4.32%) HBase
9 40 (4.32%) Tableau
10 33 (3.56%) PostgreSQL
11 31 (3.35%) Cloud Spanner
11 31 (3.35%) MySQL
12 30 (3.24%) Amazon Redshift
12 30 (3.24%) Bigtable
13 29 (3.13%) RDBMS
14 27 (2.92%) SQL Server
15 25 (2.70%) Apache Cassandra
16 23 (2.48%) Data Mining
Development Applications
1 93 (10.04%) Jenkins
2 62 (6.70%) GitLab
3 57 (6.16%) JIRA
4 55 (5.94%) Git (software)
5 32 (3.46%) Maven
6 17 (1.84%) Sonatype Nexus
7 14 (1.51%) Selenium
8 11 (1.19%) kappa
9 9 (0.97%) Gradle
9 9 (0.97%) IBM UrbanCode
9 9 (0.97%) PowerDesigner
10 7 (0.76%) SonarQube
11 6 (0.65%) Artifactory
11 6 (0.65%) Atlassian Bamboo
12 5 (0.54%) CircleCI
12 5 (0.54%) ERwin
12 5 (0.54%) JUnit
12 5 (0.54%) ProC
13 4 (0.43%) gulp
13 4 (0.43%) Travis CI
General
1 179 (19.33%) Finance
2 98 (10.58%) Banking
3 43 (4.64%) Public Sector
4 36 (3.89%) Marketing
5 32 (3.46%) Retail
6 30 (3.24%) Telecoms
7 27 (2.92%) Manufacturing
8 22 (2.38%) Front Office
9 21 (2.27%) Investment Banking
10 10 (1.08%) Pharmaceutical
11 6 (0.65%) Automotive
11 6 (0.65%) Electronics
11 6 (0.65%) Games
11 6 (0.65%) Law
11 6 (0.65%) Retail Banking
12 5 (0.54%) Aerospace
12 5 (0.54%) Financial Institution
12 5 (0.54%) Legal
13 4 (0.43%) Publishing
14 3 (0.32%) Military
Job Titles
1 201 (21.71%) Data Engineer
2 192 (20.73%) Developer
3 140 (15.12%) Architect
4 90 (9.72%) Big Data Engineer
5 88 (9.50%) Data Architect
6 87 (9.40%) DevOps Engineer
7 66 (7.13%) AWS Engineer
8 47 (5.08%) Analyst
9 43 (4.64%) Azure Engineer
10 40 (4.32%) AWS DevOps
11 39 (4.21%) Cloud Engineer
11 39 (4.21%) Data Scientist
12 38 (4.10%) Software Engineer
13 36 (3.89%) Solutions Architect
14 35 (3.78%) AWS DevOps Engineer
14 35 (3.78%) Big Data Developer
14 35 (3.78%) Scala Developer
15 33 (3.56%) Python Engineer
16 29 (3.13%) Senior Developer
17 28 (3.02%) Consultant
Libraries, Frameworks & Software Standards
1 185 (19.98%) Kafka
2 55 (5.94%) PySpark
3 43 (4.64%) Web Services
4 35 (3.78%) HTML
5 33 (3.56%) Apache NiFi
6 28 (3.02%) RESTful
7 26 (2.81%) REST
7 26 (2.81%) Spring
8 24 (2.59%) NumPy
9 23 (2.48%) .NET
9 23 (2.48%) CSS
10 22 (2.38%) HTML5
10 22 (2.38%) Pandas
11 21 (2.27%) Node.js
11 21 (2.27%) React
11 21 (2.27%) Spark Streaming
12 19 (2.05%) JSON
13 16 (1.73%) XML
14 14 (1.51%) Spring Boot
14 14 (1.51%) TensorFlow
Miscellaneous
1 122 (13.17%) Analytical Skills
2 47 (5.08%) Greenfield Project
3 44 (4.75%) Algorithms
4 31 (3.35%) Data Structures
5 25 (2.70%) User Experience
6 24 (2.59%) Cloud Native
7 20 (2.16%) Self-Motivation
8 19 (2.05%) Linux Command Line
9 18 (1.94%) Virtual Team
10 14 (1.51%) Data Centre
11 13 (1.40%) iPad
12 12 (1.30%) Analytical Mindset
12 12 (1.30%) FMCG
12 12 (1.30%) Foreign Exchange (FX)
13 11 (1.19%) Enterprise Software
14 10 (1.08%) Hedge funds
14 10 (1.08%) Public Cloud
15 9 (0.97%) Hybrid Cloud
15 9 (0.97%) Video Conferencing
16 8 (0.86%) Reference Data
Operating Systems
1 113 (12.20%) Linux
2 46 (4.97%) Unix
3 16 (1.73%) Windows
4 6 (0.65%) Apple iOS
5 4 (0.43%) Android
5 4 (0.43%) Solaris
5 4 (0.43%) Windows Server
6 2 (0.22%) Windows 10
7 1 (0.11%) CentOS
7 1 (0.11%) VMS
Processes & Methodologies
1 306 (33.05%) Agile Software Development
2 239 (25.81%) DevOps
3 231 (24.95%) Analytics
4 199 (21.49%) ETL
5 146 (15.77%) Data Engineering
6 143 (15.44%) Data Science
7 133 (14.36%) Data Modelling
8 132 (14.25%) Business Intelligence
9 115 (12.42%) Machine Learning
10 106 (11.45%) Test Automation
11 103 (11.12%) Microservices
12 99 (10.69%) Software Engineering
13 90 (9.72%) Scrum
14 87 (9.40%) Migration
14 87 (9.40%) TDD
15 75 (8.10%) Visualisation
16 74 (7.99%) Data Analytics
17 67 (7.24%) Problem-Solving
18 65 (7.02%) Artificial Intelligence
18 65 (7.02%) Data Management
Programming Languages
1 362 (39.09%) Python
2 291 (31.43%) SQL
3 271 (29.27%) Java
4 154 (16.63%) Scala
5 45 (4.86%) R
6 42 (4.54%) Shell Script
7 41 (4.43%) JavaScript
8 38 (4.10%) Bash Shell
9 27 (2.92%) C#
10 21 (2.27%) C++
11 18 (1.94%) Haskell
11 18 (1.94%) PowerShell
11 18 (1.94%) TypeScript
12 15 (1.62%) Perl
13 12 (1.30%) C
13 12 (1.30%) Ruby
14 8 (0.86%) Elm
14 8 (0.86%) Go
15 7 (0.76%) PL/SQL
15 7 (0.76%) T-SQL
Qualifications
1 175 (18.90%) Security Cleared
2 155 (16.74%) SC Cleared
3 56 (6.05%) Degree
4 41 (4.43%) DV Cleared
5 18 (1.94%) Master's Degree
6 17 (1.84%) Computer Science Degree
7 16 (1.73%) Numerate Degree
8 15 (1.62%) AWS Certification
9 13 (1.40%) Microsoft Certification
10 11 (1.19%) TOGAF Certification
11 9 (0.97%) PhD
12 8 (0.86%) CCA
13 3 (0.32%) DBS Check
14 2 (0.22%) CISM
14 2 (0.22%) CISSP
14 2 (0.22%) MCP
15 1 (0.11%) BPSS Clearance
15 1 (0.11%) CGEIT
15 1 (0.11%) CISA
15 1 (0.11%) ISEB
Quality Assurance & Compliance
1 59 (6.37%) QA
2 53 (5.72%) Data Quality
3 11 (1.19%) SLA
4 6 (0.65%) MiFID
5 5 (0.54%) PCI DSS
6 4 (0.43%) Section 508
6 4 (0.43%) WAI
7 2 (0.22%) GDPR
7 2 (0.22%) ISO/IEC 20000
7 2 (0.22%) PMO
7 2 (0.22%) Sarbanes-Oxley
8 1 (0.11%) Basel II
8 1 (0.11%) Disclosure Scotland
8 1 (0.11%) Government Security Classifications
8 1 (0.11%) GxP
8 1 (0.11%) IFRS
8 1 (0.11%) Solvency II
System Software
1 148 (15.98%) Docker
2 79 (8.53%) HDFS
3 23 (2.48%) Apache ZooKeeper
4 14 (1.51%) Active Directory
5 11 (1.19%) Apache Flume
6 7 (0.76%) Virtual Machines
7 4 (0.43%) Active Directory Lightweight Directory Services
8 2 (0.22%) VMware Infrastructure
Systems Management
1 111 (11.99%) Terraform
2 107 (11.56%) Kubernetes
3 101 (10.91%) Ansible
4 31 (3.35%) Hadoop YARN
5 24 (2.59%) Opscode Chef
6 22 (2.38%) Oozie
7 21 (2.27%) Puppet
8 17 (1.84%) Packer
9 9 (0.97%) Nagios
10 6 (0.65%) Kibana
11 5 (0.54%) Argo
12 4 (0.43%) Control-M
12 4 (0.43%) Docker Swarm
13 3 (0.32%) Single Sign-On
14 1 (0.11%) Kubeflow
14 1 (0.11%) logstash
Vendors
1 97 (10.48%) Cloudera
2 81 (8.75%) Google
3 71 (7.67%) Oracle
4 68 (7.34%) Microsoft
5 62 (6.70%) Databricks
6 41 (4.43%) Hortonworks
7 28 (3.02%) Informatica
8 23 (2.48%) IBM
9 20 (2.16%) SAP
10 18 (1.94%) Splunk
10 18 (1.94%) Teradata
11 17 (1.84%) Ab Initio
12 13 (1.40%) StreamSets
12 13 (1.40%) Talend
13 10 (1.08%) Alteryx
13 10 (1.08%) BiZZdesign
13 10 (1.08%) MuleSoft
14 9 (0.97%) NetApp
14 9 (0.97%) Sparx
15 8 (0.86%) Dataiku
362 Big Data job vacancies Nationwide