Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 20 September 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 20 September 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
20 Sep 2020		 Same period 2019 Same period 2018
Rank 89 79 89
Rank change year-on-year -10 +10 +4
Contract jobs citing Big Data 678 2,363 2,676
As % of all contract jobs advertised in England 2.67% 2.91% 2.85%
As % of the Database & Business Intelligence category 11.75% 13.37% 12.41%
Number of daily rates quoted 500 1,742 1,915
Median daily rate £550 £550 £550
10th Percentile £387 £413 £406
90th Percentile £713 £725 £700
UK median daily rate £550 £550 £540
% change year-on-year - +1.85% +0.47%
Number of hourly rates quoted 18 17 13
Median hourly rate £35.00 £49.13 £40.00
Median hourly rate % change year-on-year -28.76% +22.83% -
10th Percentile £13.95 £35.00 £15.60
90th Percentile £47.83 £60.25 £71.00
UK median hourly rate £35.00 £49.13 £42.25
% change year-on-year -28.76% +16.28% +5.63%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 5,770 17,674 21,566
As % of all contract IT jobs advertised in England 22.69% 21.78% 22.93%
Number of daily rates quoted 3,812 12,175 15,259
Median daily rate £500 £475 £475
Median daily rate % change year-on-year +5.26% - +5.56%
10th Percentile £315 £325 £313
90th Percentile £688 £663 £638
UK median daily rate £500 £475 £475
% change year-on-year +5.26% - +5.56%
Number of hourly rates quoted 121 232 228
Median hourly rate £35.00 £35.00 £29.75
Median hourly rate % change year-on-year - +17.65% -0.83%
10th Percentile £14.00 £13.99 £13.90
90th Percentile £51.75 £60.68 £56.00
Median hourly rate £35.00 £35.00 £28.75
% change year-on-year - +21.74% -2.74%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 20 September 2020.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 20 September 2020.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 20 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -27 404 £550 -4.35% 120
North of England +56 103 £550 +2.33% 40
North West +50 91 £550 +2.33% 26
South East +50 79 £500 - 24
East of England +54 26 £450 -14.29% 13
Midlands +50 23 £388 -26.04% 21
East Midlands +45 15 £388 -26.13% 14
South West +6 12 £325 -40.91% 11
West Midlands +32 8 £481 -6.19% 7
Yorkshire +18 7 £509 -3.10% 7
North East +32 1 £850 +47.83% 7
Big Data
UK

For the 6 months to 20 September 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 312 (46.02%) Python
2 252 (37.17%) Hadoop
3 243 (35.84%) Apache Spark
4 222 (32.74%) SQL
5 209 (30.83%) Azure
6 203 (29.94%) AWS
7 193 (28.47%) Agile Software Development
7 193 (28.47%) DevOps
8 174 (25.66%) Analytics
9 165 (24.34%) Java
10 132 (19.47%) Docker
11 127 (18.73%) Cloudera
11 127 (18.73%) ETL
12 122 (17.99%) Security Cleared
13 118 (17.40%) Kubernetes
14 116 (17.11%) Data Science
14 116 (17.11%) Finance
15 114 (16.81%) Kafka
16 109 (16.08%) Apache Hive
17 107 (15.78%) Machine Learning
18 105 (15.49%) Jenkins
18 105 (15.49%) Scala
19 104 (15.34%) SC Cleared
20 96 (14.16%) Data Modelling
21 93 (13.72%) Business Intelligence
22 86 (12.68%) Analytical Skills
23 85 (12.54%) Terraform
24 84 (12.39%) Microsoft
25 81 (11.95%) Databricks
26 75 (11.06%) Git (software)

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 243 (35.84%) Apache Spark
2 34 (5.01%) Apache
3 23 (3.39%) Tomcat
4 15 (2.21%) Elasticsearch
5 14 (2.06%) SAS
6 12 (1.77%) Apache Airflow
7 9 (1.33%) Confluence
8 7 (1.03%) Jupyter
8 7 (1.03%) SharePoint
9 6 (0.88%) Apache Pig
10 5 (0.74%) Tornado
11 4 (0.59%) BizTalk Server
11 4 (0.59%) CMS
12 2 (0.29%) Cloud Foundry
12 2 (0.29%) IIS
12 2 (0.29%) WebLogic
13 1 (0.15%) Luigi
13 1 (0.15%) Oracle Coherence
13 1 (0.15%) Oracle Self-Service HR
13 1 (0.15%) R Markdown
Applications
1 4 (0.59%) Microsoft Excel
2 3 (0.44%) Chatbot
2 3 (0.44%) SPSS
3 2 (0.29%) Figma
3 2 (0.29%) InVision
3 2 (0.29%) Zeplin
4 1 (0.15%) Microsoft Office
4 1 (0.15%) Microsoft PowerPoint
4 1 (0.15%) Microsoft Project
4 1 (0.15%) Spreadsheet
4 1 (0.15%) Stata
Business Applications
1 5 (0.74%) Dynamics CRM
2 4 (0.59%) Dynamics AX
3 2 (0.29%) Oracle Procure-to-Pay
3 2 (0.29%) PeopleSoft HCM
3 2 (0.29%) Sparx Enterprise Architect
4 1 (0.15%) Dynamics NAV
4 1 (0.15%) FINCAD Analytics
4 1 (0.15%) NetSuite
4 1 (0.15%) Oracle Payroll
4 1 (0.15%) SAP S/4HANA
Cloud Services
1 209 (30.83%) Azure
2 203 (29.94%) AWS
3 65 (9.59%) GCP
4 31 (4.57%) Power Platform
5 24 (3.54%) Serverless
6 23 (3.39%) Azure Data Factory
7 21 (3.10%) Amazon S3
7 21 (3.10%) PaaS
8 20 (2.95%) Amazon CloudWatch
9 17 (2.51%) Datadog
10 16 (2.36%) Amazon EC2
11 15 (2.21%) Amazon EMR
11 15 (2.21%) SaaS
12 13 (1.92%) Virtual Private Cloud
13 12 (1.77%) AWS Lambda
13 12 (1.77%) Cloud Computing
14 11 (1.62%) IaaS
15 10 (1.47%) Amazon Kinesis
16 9 (1.33%) Amazon EKS
16 9 (1.33%) Logic Apps
Communications & Networking
1 17 (2.51%) Firewall
2 9 (1.33%) Kerberos
3 7 (1.03%) HTTP
4 6 (0.88%) 5G
4 6 (0.88%) DNS
4 6 (0.88%) Internet
5 5 (0.74%) SSL
6 4 (0.59%) Skype
7 3 (0.44%) 3G
7 3 (0.44%) 4G
7 3 (0.44%) Network Security
7 3 (0.44%) RTMP
7 3 (0.44%) VPN
8 2 (0.29%) Unified Communications
9 1 (0.15%) Diameter Protocol
9 1 (0.15%) GSM
9 1 (0.15%) LTE
9 1 (0.15%) PuTTY
9 1 (0.15%) Radio Access Network
9 1 (0.15%) VoLTE
Database & Business Intelligence
1 252 (37.17%) Hadoop
2 109 (16.08%) Apache Hive
3 70 (10.32%) Data Lake
4 69 (10.18%) Data Warehouse
4 69 (10.18%) NoSQL
5 54 (7.96%) Relational Database
6 51 (7.52%) Impala
7 36 (5.31%) MySQL
8 32 (4.72%) Apache Cassandra
8 32 (4.72%) HBase
9 31 (4.57%) SQL Server
10 30 (4.42%) Power BI
11 27 (3.98%) Amazon Redshift
11 27 (3.98%) MongoDB
12 22 (3.24%) PostgreSQL
13 21 (3.10%) Data Mining
14 20 (2.95%) BigQuery
15 19 (2.80%) RDBMS
16 18 (2.65%) SQL Server Integration Services
17 15 (2.21%) Amazon RDS
Development Applications
1 105 (15.49%) Jenkins
2 75 (11.06%) Git (software)
3 43 (6.34%) GitLab
4 16 (2.36%) JIRA
5 10 (1.47%) Artifactory
5 10 (1.47%) Maven
6 8 (1.18%) Visual Studio Team System
7 7 (1.03%) ProC
8 5 (0.74%) Hudson
8 5 (0.74%) Selenium
9 4 (0.59%) Gradle
9 4 (0.59%) JUnit
9 4 (0.59%) Mockito
10 3 (0.44%) Bitbucket
10 3 (0.44%) LoadRunner
10 3 (0.44%) NUnit
10 3 (0.44%) SoapUI
10 3 (0.44%) Sonatype Nexus
11 2 (0.29%) Bitbucket Server
11 2 (0.29%) CircleCI
General
1 116 (17.11%) Finance
2 60 (8.85%) Banking
3 42 (6.19%) Public Sector
4 37 (5.46%) Marketing
5 33 (4.87%) Telecoms
6 25 (3.69%) Retail
7 22 (3.24%) Front Office
8 21 (3.10%) Manufacturing
9 17 (2.51%) Investment Banking
10 14 (2.06%) Legal
11 10 (1.47%) Electronics
12 9 (1.33%) Pharmaceutical
13 8 (1.18%) Games
14 6 (0.88%) Law
15 4 (0.59%) Aerospace
15 4 (0.59%) Billing
16 3 (0.44%) Financial Institution
17 2 (0.29%) Automotive
17 2 (0.29%) French Language
17 2 (0.29%) General Ledger
Job Titles
1 148 (21.83%) Developer
2 140 (20.65%) Data Engineer
3 102 (15.04%) Architect
4 79 (11.65%) Big Data Engineer
5 65 (9.59%) Data Architect
6 51 (7.52%) DevOps Engineer
7 40 (5.90%) Data Scientist
8 37 (5.46%) Azure Engineer
9 36 (5.31%) Python Engineer
10 34 (5.01%) Cloud Engineer
11 28 (4.13%) Big Data Developer
12 27 (3.98%) Consultant
12 27 (3.98%) Senior Developer
13 26 (3.83%) Analyst
14 25 (3.69%) C# Developer
15 24 (3.54%) AWS Engineer
16 23 (3.39%) Azure Developer
16 23 (3.39%) Solutions Architect
17 21 (3.10%) Administrator
17 21 (3.10%) Cloud Architect
Libraries, Frameworks & Software Standards
1 114 (16.81%) Kafka
2 62 (9.14%) PySpark
3 54 (7.96%) Web Services
4 46 (6.78%) .NET
5 39 (5.75%) TensorFlow
6 38 (5.60%) HTML
7 30 (4.42%) HTML5
8 22 (3.24%) REST
8 22 (3.24%) scikit-learn
9 21 (3.10%) RESTful
10 19 (2.80%) LAMP
10 19 (2.80%) Pandas
11 18 (2.65%) Keras
11 18 (2.65%) Velocity
12 16 (2.36%) React
12 16 (2.36%) Sensu
13 15 (2.21%) NumPy
13 15 (2.21%) Spark Streaming
14 14 (2.06%) Akka
14 14 (2.06%) Elastic Stack
Miscellaneous
1 86 (12.68%) Analytical Skills
2 37 (5.46%) Algorithms
3 33 (4.87%) Greenfield Project
4 18 (2.65%) Data Structures
5 16 (2.36%) Public Cloud
6 15 (2.21%) Linux Command Line
7 14 (2.06%) Cloud Native
8 13 (1.92%) Enterprise Software
8 13 (1.92%) Foreign Exchange (FX)
9 12 (1.77%) Credit Risk
9 12 (1.77%) FMCG
9 12 (1.77%) Virtual Team
10 10 (1.47%) Analytical Mindset
11 9 (1.33%) Management Information System
12 8 (1.18%) PMI
12 8 (1.18%) Renewable Energy
12 8 (1.18%) Smart City
13 7 (1.03%) Fixed Income
13 7 (1.03%) Mobile App
13 7 (1.03%) User Experience
Operating Systems
1 74 (10.91%) Linux
2 54 (7.96%) Unix
3 9 (1.33%) Windows
4 8 (1.18%) VMS
5 4 (0.59%) Solaris
6 2 (0.29%) Android
6 2 (0.29%) Debian
6 2 (0.29%) Windows 10
6 2 (0.29%) Windows Server
7 1 (0.15%) Amazon Linux
7 1 (0.15%) Apple iOS
Processes & Methodologies
1 193 (28.47%) Agile Software Development
1 193 (28.47%) DevOps
2 174 (25.66%) Analytics
3 127 (18.73%) ETL
4 116 (17.11%) Data Science
5 107 (15.78%) Machine Learning
6 96 (14.16%) Data Modelling
7 93 (13.72%) Business Intelligence
8 74 (10.91%) Data Engineering
9 70 (10.32%) Computer Science
9 70 (10.32%) Scrum
10 58 (8.55%) Data Architecture
10 58 (8.55%) Visualisation
11 57 (8.41%) Microservices
12 56 (8.26%) Problem-Solving
13 48 (7.08%) Data Analytics
14 47 (6.93%) Artificial Intelligence
14 47 (6.93%) Software Engineering
15 42 (6.19%) Migration
15 42 (6.19%) Test Automation
Programming Languages
1 312 (46.02%) Python
2 222 (32.74%) SQL
3 165 (24.34%) Java
4 105 (15.49%) Scala
5 61 (9.00%) C#
6 45 (6.64%) Bash Shell
7 39 (5.75%) JavaScript
7 39 (5.75%) R
8 33 (4.87%) Shell Script
9 31 (4.57%) Ruby
10 30 (4.42%) C++
11 26 (3.83%) PowerShell
12 11 (1.62%) Perl
13 10 (1.47%) Go
13 10 (1.47%) Groovy
13 10 (1.47%) Haskell
14 7 (1.03%) C
14 7 (1.03%) T-SQL
15 6 (0.88%) Java 8
16 4 (0.59%) Kotlin
Qualifications
1 122 (17.99%) Security Cleared
2 104 (15.34%) SC Cleared
3 70 (10.32%) Degree
4 33 (4.87%) Master's Degree
5 24 (3.54%) Computer Science Degree
6 22 (3.24%) CCA
7 17 (2.51%) DV Cleared
8 14 (2.06%) Numerate Degree
9 13 (1.92%) Microsoft Certification
10 12 (1.77%) TOGAF Certification
11 10 (1.47%) AWS Certification
12 8 (1.18%) PMI Certification
13 7 (1.03%) PhD
14 3 (0.44%) BPSS Clearance
14 3 (0.44%) CESG Certified Professional
14 3 (0.44%) CISM
14 3 (0.44%) CISSP
14 3 (0.44%) CRISC
15 2 (0.29%) BC Cleared
16 1 (0.15%) CSPO
Quality Assurance & Compliance
1 21 (3.10%) QA
2 19 (2.80%) Data Quality
3 9 (1.33%) MiFID
4 8 (1.18%) PCI DSS
5 6 (0.88%) GDPR
6 5 (0.74%) GxP
7 3 (0.44%) SLA
8 2 (0.29%) Sarbanes-Oxley
9 1 (0.15%) CDISC
9 1 (0.15%) ISO/IEC 27001
9 1 (0.15%) Section 508
9 1 (0.15%) WAI
System Software
1 132 (19.47%) Docker
2 42 (6.19%) HDFS
3 18 (2.65%) Apache ZooKeeper
4 10 (1.47%) Active Directory
5 7 (1.03%) Apache Flume
6 3 (0.44%) VMware Infrastructure
7 2 (0.29%) Active Directory Lightweight Directory Services
7 2 (0.29%) Virtual Machines
Systems Management
1 118 (17.40%) Kubernetes
2 85 (12.54%) Terraform
3 63 (9.29%) Ansible
4 32 (4.72%) Puppet
5 20 (2.95%) Nagios
6 15 (2.21%) Packer
7 12 (1.77%) Oozie
8 10 (1.47%) Hadoop YARN
8 10 (1.47%) Opscode Chef
9 6 (0.88%) Kibana
10 4 (0.59%) logstash
11 2 (0.29%) Ambari
11 2 (0.29%) Kubeflow
11 2 (0.29%) SCCM
12 1 (0.15%) Argo
12 1 (0.15%) Grafana
12 1 (0.15%) Istio
12 1 (0.15%) Knative
12 1 (0.15%) Single Sign-On
Vendors
1 127 (18.73%) Cloudera
2 84 (12.39%) Microsoft
3 81 (11.95%) Databricks
4 68 (10.03%) Oracle
5 65 (9.59%) Hortonworks
6 55 (8.11%) Tableau
7 35 (5.16%) StreamSets
8 27 (3.98%) Splunk
9 26 (3.83%) Google
10 24 (3.54%) Teradata
11 20 (2.95%) Informatica
12 19 (2.80%) Talend
13 17 (2.51%) Ab Initio
14 15 (2.21%) IBM
14 15 (2.21%) SAP
15 7 (1.03%) MapR
16 5 (0.74%) Sybase
16 5 (0.74%) TIBCO
17 4 (0.59%) BMC
17 4 (0.59%) CA