Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 12 August 2020

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 12 August 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
12 Aug 2020		 Same period 2019 Same period 2018
Rank 89 75 87
Rank change year-on-year -14 +12 +12
Contract jobs citing Big Data 885 2,802 2,960
As % of all contract jobs advertised in the UK 2.56% 3.08% 2.89%
As % of the Database & Business Intelligence category 11.82% 14.04% 12.65%
Number of daily rates quoted 654 2,011 2,087
Median daily rate £550 £550 £550
10th Percentile £381 £413 £398
90th Percentile £725 £710 £688
UK excluding London median daily rate £528 £525 £500
% change year-on-year +0.48% +5.00% +11.11%
Number of hourly rates quoted 24 22 14
Median hourly rate £35.00 £49.13 £44.25
Median hourly rate % change year-on-year -28.76% +11.03% +41.60%
10th Percentile £16.28 £35.00 £15.78
90th Percentile £45.20 £60.50 £71.13
UK excluding London median hourly rate £35.00 £44.25 £44.25
% change year-on-year -20.90% - +60.91%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 7,487 19,961 23,390
As % of all contract IT jobs advertised in the UK 21.67% 21.97% 22.80%
Number of daily rates quoted 4,850 13,652 16,338
Median daily rate £500 £475 £463
Median daily rate % change year-on-year +5.26% +2.70% +2.78%
10th Percentile £325 £325 £313
90th Percentile £688 £650 £638
UK excluding London median daily rate £450 £435 £415
% change year-on-year +3.45% +4.82% +3.75%
Number of hourly rates quoted 158 263 241
Median hourly rate £35.00 £35.00 £30.00
Median hourly rate % change year-on-year - +16.67% -4.76%
10th Percentile £15.13 £14.05 £13.50
90th Percentile £53.83 £60.00 £53.50
Median hourly rate £35.00 £35.00 £32.50
% change year-on-year - +7.69% -6.12%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 12 August 2020.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 12 August 2020.

Hourly rate histogram for Big Data in the UK

Big Data
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 12 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -12 831 £550 - 195
London -21 491 £550 -4.35% 98
UK excluding London -7 348 £528 +0.48% 118
North of England +29 136 £550 +2.33% 31
South East +37 118 £505 +1.00% 29
North West +49 100 £538 -2.27% 18
Work from Home +10 73 £545 +3.81% 30
Yorkshire -1 28 £600 +20.00% 7
Wales +58 22 £500 -4.76% 9
Midlands +21 22 £450 -14.29% 18
South West +10 22 £550 - 8
East of England +30 19 £575 +6.98% 11
West Midlands +40 12 £450 -25.00% 5
Scotland -49 11 £425 -10.53% 11
East Midlands +31 9 £485 -3.00% 13
Northern Ireland -3 3 £430 -18.87% 1
North East +28 1 £850 +54.55% 6

For the 6 months to 12 August 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 407 (45.99%) Python
2 303 (34.24%) Apache Spark
3 298 (33.67%) SQL
4 292 (32.99%) Hadoop
5 288 (32.54%) Agile Software Development
6 273 (30.85%) AWS
7 246 (27.80%) Analytics
8 244 (27.57%) Azure
9 232 (26.21%) DevOps
10 202 (22.82%) Java
11 168 (18.98%) Data Science
12 165 (18.64%) Machine Learning
13 164 (18.53%) Security Cleared
14 162 (18.31%) Docker
15 146 (16.50%) ETL
16 145 (16.38%) Finance
16 145 (16.38%) Kafka
17 144 (16.27%) Cloudera
18 143 (16.16%) Data Modelling
19 139 (15.71%) Scala
20 137 (15.48%) Kubernetes
21 129 (14.58%) Apache Hive
22 127 (14.35%) Jenkins
23 126 (14.24%) Business Intelligence
24 121 (13.67%) SC Cleared
25 119 (13.45%) Analytical Skills
26 112 (12.66%) Data Warehouse
27 111 (12.54%) GCP
28 104 (11.75%) Terraform
29 102 (11.53%) Data Lake

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 303 (34.24%) Apache Spark
2 51 (5.76%) Apache
3 31 (3.50%) Elasticsearch
4 22 (2.49%) Confluence
5 21 (2.37%) Tomcat
6 18 (2.03%) SAS
7 17 (1.92%) Apache Airflow
8 8 (0.90%) Apache Pig
8 8 (0.90%) Jupyter
9 6 (0.68%) Tornado
9 6 (0.68%) WebLogic
10 5 (0.56%) CMS
10 5 (0.56%) SharePoint
11 3 (0.34%) BizTalk Server
11 3 (0.34%) Cloud Foundry
11 3 (0.34%) nginx
12 2 (0.23%) IIS
12 2 (0.23%) Luigi
12 2 (0.23%) TIBCO ActiveMatrix
13 1 (0.11%) Apache Solr
Applications
1 9 (1.02%) Microsoft Excel
2 3 (0.34%) Figma
2 3 (0.34%) InVision
2 3 (0.34%) Spreadsheet
3 2 (0.23%) SPSS
3 2 (0.23%) Zeplin
4 1 (0.11%) Chatbot
4 1 (0.11%) Microsoft Office
4 1 (0.11%) Microsoft PowerPoint
4 1 (0.11%) Microsoft Project
4 1 (0.11%) MS Visio
4 1 (0.11%) Sketch
4 1 (0.11%) Stata
Business Applications
1 4 (0.45%) Dynamics CRM
2 3 (0.34%) Dynamics AX
2 3 (0.34%) Oracle Procure-to-Pay
2 3 (0.34%) Sparx Enterprise Architect
3 2 (0.23%) BusinessWorks
3 2 (0.23%) Distributed Ledger
3 2 (0.23%) Oracle EBS
3 2 (0.23%) Oracle Payroll
4 1 (0.11%) Dynamics NAV
4 1 (0.11%) FINCAD Analytics
4 1 (0.11%) NetSuite
4 1 (0.11%) PeopleSoft HCM
4 1 (0.11%) SAP CRM
4 1 (0.11%) SAP ERP
4 1 (0.11%) SAP IS-U
4 1 (0.11%) SAP Oil and Gas
4 1 (0.11%) SAP S/4HANA
4 1 (0.11%) Shopify
Cloud Services
1 273 (30.85%) AWS
2 244 (27.57%) Azure
3 111 (12.54%) GCP
4 58 (6.55%) Power Platform
5 39 (4.41%) Amazon S3
6 36 (4.07%) Serverless
7 30 (3.39%) Amazon CloudWatch
8 28 (3.16%) Amazon EMR
9 25 (2.82%) AWS Lambda
10 24 (2.71%) Amazon EC2
10 24 (2.71%) Azure Data Factory
11 21 (2.37%) SaaS
12 20 (2.26%) Cloud Computing
12 20 (2.26%) GitHub
13 18 (2.03%) PaaS
14 17 (1.92%) Amazon Kinesis
15 14 (1.58%) Datadog
16 12 (1.36%) Amazon Cognito
17 11 (1.24%) Logic Apps
18 10 (1.13%) IaaS
Communications & Networking
1 14 (1.58%) 5G
2 12 (1.36%) DNS
2 12 (1.36%) Firewall
3 10 (1.13%) Kerberos
4 9 (1.02%) Internet
5 8 (0.90%) 4G
5 8 (0.90%) HTTP
6 7 (0.79%) 3G
6 7 (0.79%) RTMP
7 5 (0.56%) Network Security
8 4 (0.45%) Skype
9 3 (0.34%) DHCP
9 3 (0.34%) IPsec
9 3 (0.34%) TCP/IP
10 2 (0.23%) SSL
11 1 (0.11%) 2G
11 1 (0.11%) Diameter Protocol
11 1 (0.11%) DSL
11 1 (0.11%) Intranet
11 1 (0.11%) Wi-Fi
Database & Business Intelligence
1 292 (32.99%) Hadoop
2 129 (14.58%) Apache Hive
3 112 (12.66%) Data Warehouse
4 102 (11.53%) Data Lake
5 100 (11.30%) NoSQL
6 74 (8.36%) Relational Database
7 64 (7.23%) Impala
8 53 (5.99%) SQL Server
9 51 (5.76%) Power BI
10 48 (5.42%) HBase
10 48 (5.42%) MongoDB
11 43 (4.86%) Apache Cassandra
12 31 (3.50%) Amazon Redshift
13 30 (3.39%) MySQL
13 30 (3.39%) SQL Server Integration Services
14 28 (3.16%) BigQuery
15 26 (2.94%) Data Mining
16 24 (2.71%) PostgreSQL
16 24 (2.71%) RDBMS
17 19 (2.15%) Spark SQL
Development Applications
1 127 (14.35%) Jenkins
2 99 (11.19%) Git (software)
3 58 (6.55%) GitLab
4 32 (3.62%) JIRA
5 25 (2.82%) Maven
6 20 (2.26%) Bitbucket
7 12 (1.36%) Artifactory
8 10 (1.13%) JUnit
9 9 (1.02%) Gradle
10 8 (0.90%) Visual Studio Team System
11 7 (0.79%) Mockito
11 7 (0.79%) NUnit
11 7 (0.79%) ProC
11 7 (0.79%) Selenium
11 7 (0.79%) Sonatype Nexus
12 6 (0.68%) Hudson
12 6 (0.68%) TeamCity
13 5 (0.56%) CircleCI
14 4 (0.45%) Eclipse
14 4 (0.45%) Snyk
General
1 145 (16.38%) Finance
2 73 (8.25%) Banking
3 71 (8.02%) Public Sector
4 51 (5.76%) Telecoms
5 44 (4.97%) Marketing
6 36 (4.07%) Retail
7 30 (3.39%) Investment Banking
8 28 (3.16%) Legal
9 25 (2.82%) Front Office
10 23 (2.60%) Manufacturing
11 14 (1.58%) Electronics
12 10 (1.13%) Pharmaceutical
13 9 (1.02%) Games
14 8 (0.90%) Billing
14 8 (0.90%) Law
15 4 (0.45%) Aerospace
16 2 (0.23%) Financial Institution
16 2 (0.23%) French Language
16 2 (0.23%) General Ledger
16 2 (0.23%) Military
Job Titles
1 188 (21.24%) Data Engineer
2 177 (20.00%) Developer
3 136 (15.37%) Architect
4 96 (10.85%) Big Data Engineer
5 84 (9.49%) Data Architect
6 69 (7.80%) Data Scientist
6 69 (7.80%) DevOps Engineer
7 44 (4.97%) Analyst
8 43 (4.86%) Python Engineer
9 37 (4.18%) Cloud Engineer
10 36 (4.07%) AWS Engineer
10 36 (4.07%) C# Developer
11 33 (3.73%) Consultant
12 32 (3.62%) Big Data Developer
13 29 (3.28%) Azure Engineer
14 27 (3.05%) Java Developer
14 27 (3.05%) Python Developer
15 25 (2.82%) Big Data Architect
15 25 (2.82%) Hadoop Engineer
16 24 (2.71%) Senior Developer
Libraries, Frameworks & Software Standards
1 145 (16.38%) Kafka
2 78 (8.81%) PySpark
3 72 (8.14%) Web Services
4 53 (5.99%) HTML
5 52 (5.88%) TensorFlow
6 50 (5.65%) .NET
7 36 (4.07%) HTML5
8 30 (3.39%) React
8 30 (3.39%) REST
8 30 (3.39%) RESTful
9 28 (3.16%) Pandas
10 27 (3.05%) Node.js
11 26 (2.94%) Spring
12 24 (2.71%) AngularJS
12 24 (2.71%) scikit-learn
13 23 (2.60%) CSS
14 21 (2.37%) XML
15 20 (2.26%) Velocity
16 19 (2.15%) SciPy
17 18 (2.03%) MLlib
Miscellaneous
1 119 (13.45%) Analytical Skills
2 54 (6.10%) Algorithms
3 48 (5.42%) Greenfield Project
4 22 (2.49%) Public Cloud
5 21 (2.37%) Data Structures
6 20 (2.26%) Cloud Native
7 18 (2.03%) Credit Risk
7 18 (2.03%) Enterprise Software
8 17 (1.92%) Management Information System
9 16 (1.81%) Foreign Exchange (FX)
10 13 (1.47%) Linux Command Line
11 12 (1.36%) User Experience
12 11 (1.24%) Analytical Mindset
12 11 (1.24%) Data Centre
12 11 (1.24%) FMCG
13 10 (1.13%) Self-Motivation
14 9 (1.02%) Hedge funds
15 8 (0.90%) Mobile App
15 8 (0.90%) PMI
15 8 (0.90%) Reference Data
Operating Systems
1 70 (7.91%) Linux
2 47 (5.31%) Unix
3 17 (1.92%) VMS
4 11 (1.24%) Windows
5 4 (0.45%) CentOS
6 3 (0.34%) Red Hat Enterprise Linux
6 3 (0.34%) Solaris
6 3 (0.34%) Windows Server
7 2 (0.23%) Debian
7 2 (0.23%) Windows 10
8 1 (0.11%) Amazon Linux
Processes & Methodologies
1 288 (32.54%) Agile Software Development
2 246 (27.80%) Analytics
3 232 (26.21%) DevOps
4 168 (18.98%) Data Science
5 165 (18.64%) Machine Learning
6 146 (16.50%) ETL
7 143 (16.16%) Data Modelling
8 126 (14.24%) Business Intelligence
9 94 (10.62%) Data Engineering
10 89 (10.06%) Scrum
11 79 (8.93%) Data Architecture
12 76 (8.59%) Data Analytics
13 75 (8.47%) Microservices
14 74 (8.36%) Computer Science
15 72 (8.14%) Artificial Intelligence
16 69 (7.80%) Continuous Integration
17 63 (7.12%) Software Engineering
18 62 (7.01%) Visualisation
19 55 (6.21%) Open Source
19 55 (6.21%) Problem-Solving
Programming Languages
1 407 (45.99%) Python
2 298 (33.67%) SQL
3 202 (22.82%) Java
4 139 (15.71%) Scala
5 74 (8.36%) C#
6 71 (8.02%) JavaScript
7 46 (5.20%) R
8 43 (4.86%) Bash Shell
9 36 (4.07%) Ruby
10 31 (3.50%) Go
10 31 (3.50%) PowerShell
11 27 (3.05%) C++
11 27 (3.05%) Shell Script
12 18 (2.03%) C
13 15 (1.69%) PL/SQL
14 14 (1.58%) T-SQL
15 13 (1.47%) Groovy
16 12 (1.36%) Java 8
17 9 (1.02%) Haskell
17 9 (1.02%) TypeScript
Qualifications
1 164 (18.53%) Security Cleared
2 121 (13.67%) SC Cleared
3 85 (9.60%) Degree
4 37 (4.18%) DV Cleared
5 28 (3.16%) Master's Degree
6 26 (2.94%) Computer Science Degree
7 24 (2.71%) CCA
8 13 (1.47%) AWS Certification
8 13 (1.47%) Numerate Degree
9 11 (1.24%) PMI Certification
10 10 (1.13%) PhD
11 9 (1.02%) CISSP
11 9 (1.02%) Microsoft Certification
12 8 (0.90%) TOGAF Certification
13 7 (0.79%) CESG Certified Professional
13 7 (0.79%) CISM
13 7 (0.79%) CRISC
14 5 (0.56%) BPSS Clearance
15 3 (0.34%) ISTQB
15 3 (0.34%) PMP
Quality Assurance & Compliance
1 24 (2.71%) QA
2 18 (2.03%) Data Quality
3 11 (1.24%) GDPR
4 9 (1.02%) MiFID
5 6 (0.68%) PCI DSS
5 6 (0.68%) SLA
6 4 (0.45%) GxP
7 2 (0.23%) Basel III
7 2 (0.23%) Sarbanes-Oxley
8 1 (0.11%) CDISC
8 1 (0.11%) Government Security Classifications
8 1 (0.11%) IFRS
8 1 (0.11%) ISO/IEC 27001
System Software
1 162 (18.31%) Docker
2 52 (5.88%) HDFS
3 11 (1.24%) Apache ZooKeeper
4 10 (1.13%) Apache Flume
5 7 (0.79%) Active Directory
6 3 (0.34%) Virtual Machines
6 3 (0.34%) VMware ESXi
6 3 (0.34%) VMware Infrastructure
6 3 (0.34%) vSphere
Systems Management
1 137 (15.48%) Kubernetes
2 104 (11.75%) Terraform
3 66 (7.46%) Ansible
4 31 (3.50%) Puppet
5 18 (2.03%) Nagios
6 17 (1.92%) Oozie
7 14 (1.58%) Hadoop YARN
8 13 (1.47%) Packer
9 11 (1.24%) Opscode Chef
10 5 (0.56%) logstash
11 4 (0.45%) Kibana
12 3 (0.34%) Ambari
12 3 (0.34%) Grafana
12 3 (0.34%) HP ALM
12 3 (0.34%) Kubeflow
13 2 (0.23%) SCCM
14 1 (0.11%) Docker Swarm
14 1 (0.11%) ITRS Geneos
14 1 (0.11%) Rancher
14 1 (0.11%) Single Sign-On
Vendors
1 144 (16.27%) Cloudera
2 99 (11.19%) Microsoft
3 74 (8.36%) Oracle
4 71 (8.02%) Hortonworks
5 69 (7.80%) Databricks
6 65 (7.34%) Tableau
7 44 (4.97%) Google
8 34 (3.84%) StreamSets
9 26 (2.94%) Teradata
10 24 (2.71%) Informatica
11 23 (2.60%) Splunk
12 20 (2.26%) SAP
13 14 (1.58%) Talend
14 11 (1.24%) IBM
15 10 (1.13%) Atlassian
15 10 (1.13%) MapR
16 7 (0.79%) Ab Initio
16 7 (0.79%) Sybase
17 6 (0.68%) CA
18 5 (0.56%) MicroStrategy