Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 2 July 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 2 July 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
2 Jul 2020		 Same period 2019 Same period 2018
Rank 81 74 78
Rank change year-on-year -7 +4 +14
Contract jobs citing Big Data 1,010 2,745 2,908
As % of all contract jobs advertised in England 2.74% 3.25% 3.11%
As % of the Database & Business Intelligence category 12.48% 14.55% 13.66%
Number of daily rates quoted 766 2,013 2,062
Median daily rate £550 £550 £550
10th Percentile £404 £413 £400
90th Percentile £725 £713 £688
UK median daily rate £550 £550 £545
% change year-on-year - +0.92% +3.81%
Number of hourly rates quoted 16 19 12
Median hourly rate £35.00 £49.13 £44.25
Median hourly rate % change year-on-year -28.76% +11.03% +1.72%
UK median hourly rate £35.00 £49.13 £44.50
% change year-on-year -28.76% +10.40% +2.30%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 8,093 18,860 21,290
As % of all contract IT jobs advertised in England 21.95% 22.35% 22.78%
Number of daily rates quoted 5,390 13,083 14,951
Median daily rate £500 £483 £475
Median daily rate % change year-on-year +3.63% +1.58% +5.56%
10th Percentile £330 £325 £313
90th Percentile £688 £650 £638
UK median daily rate £500 £475 £463
% change year-on-year +5.26% +2.70% +2.78%
Number of hourly rates quoted 167 229 220
Median hourly rate £35.00 £35.00 £33.50
Median hourly rate % change year-on-year - +4.48% +11.67%
10th Percentile £15.97 £14.41 £14.00
90th Percentile £53.40 £60.00 £55.00
Median hourly rate £35.00 £35.00 £33.50
% change year-on-year - +4.48% +11.67%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 2 July 2020.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 2 July 2020.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 2 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -15 612 £550 -4.35% 111
South East +28 153 £503 +0.50% 28
North of England +17 144 £625 +13.64% 19
North West +38 92 £650 +18.18% 14
Yorkshire -1 38 £538 +13.16% 2
South West +19 32 £550 - 17
East of England +13 28 £438 -20.45% 10
Midlands +19 22 £550 +4.76% 20
West Midlands +29 17 £450 -26.41% 11
North East +27 7 £750 +30.43% 3
East Midlands +21 4 £550 +14.29% 9
Big Data
UK

For the 6 months to 2 July 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 433 (42.87%) Python
2 352 (34.85%) Agile Software Development
3 331 (32.77%) SQL
4 325 (32.18%) Apache Spark
5 319 (31.58%) AWS
6 311 (30.79%) Hadoop
7 296 (29.31%) Analytics
8 288 (28.51%) DevOps
9 281 (27.82%) Azure
10 226 (22.38%) Java
11 188 (18.61%) Data Science
12 187 (18.51%) Machine Learning
13 184 (18.22%) Docker
14 175 (17.33%) Kubernetes
15 171 (16.93%) Kafka
15 171 (16.93%) Finance
16 166 (16.44%) Data Modelling
17 156 (15.45%) Scala
17 156 (15.45%) GCP
18 154 (15.25%) Business Intelligence
19 150 (14.85%) Security Cleared
20 146 (14.46%) Cloudera
21 142 (14.06%) Data Warehouse
22 139 (13.76%) ETL
23 135 (13.37%) Jenkins
24 132 (13.07%) NoSQL
25 125 (12.38%) Apache Hive
26 122 (12.08%) Data Lake
27 120 (11.88%) Terraform
28 117 (11.58%) Analytical Skills

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 325 (32.18%) Apache Spark
2 67 (6.63%) Apache
3 36 (3.56%) Elasticsearch
4 28 (2.77%) Confluence
5 26 (2.57%) Apache Airflow
6 22 (2.18%) SAS
7 21 (2.08%) Tomcat
8 13 (1.29%) Apache Pig
9 10 (0.99%) Jupyter
10 5 (0.50%) SharePoint
10 5 (0.50%) Tornado
10 5 (0.50%) WebLogic
11 4 (0.40%) CMS
11 4 (0.40%) nginx
11 4 (0.40%) WebSphere
12 3 (0.30%) Apache Pulsar
12 3 (0.30%) Cloud Foundry
12 3 (0.30%) Oracle Workflow
13 2 (0.20%) ArcGIS
13 2 (0.20%) IIS
Applications
1 15 (1.49%) Microsoft Excel
2 5 (0.50%) Spreadsheet
3 3 (0.30%) Microsoft Office
3 3 (0.30%) Microsoft PowerPoint
3 3 (0.30%) SPSS
3 3 (0.30%) Stata
4 2 (0.20%) Chatbot
4 2 (0.20%) Figma
4 2 (0.20%) InVision
4 2 (0.20%) Zeplin
5 1 (0.099%) Maya
5 1 (0.099%) Microsoft Project
5 1 (0.099%) MS Visio
Business Applications
1 4 (0.40%) Oracle EBS
1 4 (0.40%) Oracle Payroll
1 4 (0.40%) SAP ERP
1 4 (0.40%) Sparx Enterprise Architect
2 3 (0.30%) SAP CRM
2 3 (0.30%) SAP IS-U
3 2 (0.20%) Distributed Ledger
3 2 (0.20%) NetSuite
3 2 (0.20%) Oracle Procure-to-Pay
3 2 (0.20%) SAP Oil and Gas
4 1 (0.099%) Dynamics CRM
4 1 (0.099%) Dynamics NAV
4 1 (0.099%) FINCAD Analytics
4 1 (0.099%) Oracle Applications
4 1 (0.099%) PeopleSoft HCM
4 1 (0.099%) SAP LE
4 1 (0.099%) SAP S/4HANA
4 1 (0.099%) Shopify
Cloud Services
1 319 (31.58%) AWS
2 281 (27.82%) Azure
3 156 (15.45%) GCP
4 76 (7.52%) Power Platform
5 48 (4.75%) Amazon S3
6 42 (4.16%) Serverless
7 33 (3.27%) Amazon EC2
7 33 (3.27%) Amazon EMR
7 33 (3.27%) AWS Lambda
8 31 (3.07%) Amazon CloudWatch
9 28 (2.77%) Amazon Kinesis
9 28 (2.77%) Azure Data Factory
10 26 (2.57%) GitHub
11 24 (2.38%) SaaS
12 22 (2.18%) Cloud Computing
13 16 (1.58%) IaaS
14 14 (1.39%) Amazon Cognito
14 14 (1.39%) PaaS
15 13 (1.29%) AWS CloudFormation
16 11 (1.09%) Datadog
Communications & Networking
1 19 (1.88%) Kerberos
2 16 (1.58%) 5G
3 13 (1.29%) Firewall
3 13 (1.29%) HTTP
4 12 (1.19%) Internet
5 11 (1.09%) DNS
6 9 (0.89%) 4G
7 8 (0.79%) 3G
7 8 (0.79%) RTMP
8 5 (0.50%) Network Security
8 5 (0.50%) VPN
9 4 (0.40%) Skype
9 4 (0.40%) SSL
9 4 (0.40%) TCP/IP
10 3 (0.30%) DHCP
10 3 (0.30%) HTTPS
10 3 (0.30%) IPsec
10 3 (0.30%) MQTT
11 2 (0.20%) Intranet
11 2 (0.20%) Wireshark
Database & Business Intelligence
1 311 (30.79%) Hadoop
2 142 (14.06%) Data Warehouse
3 132 (13.07%) NoSQL
4 125 (12.38%) Apache Hive
5 122 (12.08%) Data Lake
6 83 (8.22%) SQL Server
7 77 (7.62%) Relational Database
8 70 (6.93%) Power BI
9 69 (6.83%) HBase
10 60 (5.94%) MongoDB
11 59 (5.84%) Apache Cassandra
12 42 (4.16%) Impala
13 41 (4.06%) SQL Server Integration Services
14 39 (3.86%) BigQuery
15 38 (3.76%) Amazon Redshift
16 34 (3.37%) PostgreSQL
17 27 (2.67%) MySQL
18 24 (2.38%) Data Mining
18 24 (2.38%) Flink
18 24 (2.38%) Sqoop
Development Applications
1 135 (13.37%) Jenkins
2 108 (10.69%) Git (software)
3 56 (5.54%) GitLab
4 45 (4.46%) JIRA
5 36 (3.56%) Maven
6 20 (1.98%) Bitbucket
7 14 (1.39%) Artifactory
8 12 (1.19%) Sonatype Nexus
9 11 (1.09%) JUnit
9 11 (1.09%) Visual Studio Team System
10 10 (0.99%) Gradle
10 10 (0.99%) TeamCity
10 10 (0.99%) Visual Studio
11 8 (0.79%) CircleCI
11 8 (0.79%) Mockito
11 8 (0.79%) NUnit
12 7 (0.69%) ERwin
12 7 (0.69%) IBM UrbanCode
12 7 (0.69%) ProC
12 7 (0.69%) Selenium
General
1 171 (16.93%) Finance
2 83 (8.22%) Banking
3 73 (7.23%) Public Sector
4 56 (5.54%) Telecoms
5 41 (4.06%) Marketing
5 41 (4.06%) Retail
6 32 (3.17%) Investment Banking
7 30 (2.97%) Legal
8 27 (2.67%) Front Office
9 23 (2.28%) Manufacturing
10 11 (1.09%) Pharmaceutical
11 10 (0.99%) Electronics
12 9 (0.89%) Billing
13 6 (0.59%) Games
14 5 (0.50%) Law
15 3 (0.30%) Publishing
16 2 (0.20%) Automotive
16 2 (0.20%) Local Government
16 2 (0.20%) Retail Banking
16 2 (0.20%) Social Science
Job Titles
1 220 (21.78%) Data Engineer
2 187 (18.51%) Developer
3 159 (15.74%) Architect
4 117 (11.58%) Big Data Engineer
5 88 (8.71%) Data Architect
6 78 (7.72%) DevOps Engineer
7 77 (7.62%) Data Scientist
8 62 (6.14%) Analyst
9 47 (4.65%) AWS Engineer
10 46 (4.55%) Python Engineer
11 43 (4.26%) Java Developer
12 40 (3.96%) Big Data Developer
13 39 (3.86%) Cloud Engineer
14 38 (3.76%) Consultant
15 33 (3.27%) C# Developer
16 32 (3.17%) Big Data Architect
17 31 (3.07%) Cloud Architect
18 28 (2.77%) Azure Engineer
18 28 (2.77%) Head of DevOps
19 26 (2.57%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 171 (16.93%) Kafka
2 88 (8.71%) Web Services
3 86 (8.51%) PySpark
4 62 (6.14%) TensorFlow
5 46 (4.55%) HTML
6 45 (4.46%) .NET
7 41 (4.06%) REST
8 32 (3.17%) RESTful
9 31 (3.07%) Node.js
9 31 (3.07%) Pandas
9 31 (3.07%) Spring
10 29 (2.87%) HTML5
10 29 (2.87%) React
11 27 (2.67%) Natural Language Processing
12 24 (2.38%) scikit-learn
13 23 (2.28%) AngularJS
13 23 (2.28%) SciPy
13 23 (2.28%) XML
14 22 (2.18%) CSS
15 21 (2.08%) Spring Boot
Miscellaneous
1 117 (11.58%) Analytical Skills
2 59 (5.84%) Algorithms
3 41 (4.06%) Greenfield Project
4 34 (3.37%) Data Structures
5 32 (3.17%) Public Cloud
6 23 (2.28%) Enterprise Software
6 23 (2.28%) Management Information System
7 21 (2.08%) Cloud Native
8 18 (1.78%) Self-Motivation
9 17 (1.68%) Credit Risk
10 15 (1.49%) User Experience
11 14 (1.39%) Foreign Exchange (FX)
12 13 (1.29%) Data Centre
13 11 (1.09%) Linux Command Line
14 9 (0.89%) FMCG
14 9 (0.89%) Hedge funds
14 9 (0.89%) Market Risk
15 8 (0.79%) Life Science
15 8 (0.79%) PMI
15 8 (0.79%) Social Media
Operating Systems
1 101 (10.00%) Linux
2 52 (5.15%) Unix
3 19 (1.88%) VMS
4 14 (1.39%) Windows
5 7 (0.69%) CentOS
5 7 (0.69%) Red Hat Enterprise Linux
6 5 (0.50%) Debian
6 5 (0.50%) Ubuntu
7 2 (0.20%) Fedora
7 2 (0.20%) Windows 10
7 2 (0.20%) Windows Server
8 1 (0.099%) Amazon Linux
8 1 (0.099%) DC/OS
8 1 (0.099%) VME
8 1 (0.099%) Windows Server 2016
Processes & Methodologies
1 352 (34.85%) Agile Software Development
2 296 (29.31%) Analytics
3 288 (28.51%) DevOps
4 188 (18.61%) Data Science
5 187 (18.51%) Machine Learning
6 166 (16.44%) Data Modelling
7 154 (15.25%) Business Intelligence
8 139 (13.76%) ETL
9 100 (9.90%) Scrum
10 97 (9.60%) Artificial Intelligence
11 95 (9.41%) Microservices
12 94 (9.31%) Data Analytics
12 94 (9.31%) Data Engineering
13 90 (8.91%) Software Engineering
14 85 (8.42%) Data Architecture
15 84 (8.32%) Continuous Integration
16 75 (7.43%) Computer Science
16 75 (7.43%) Visualisation
17 66 (6.53%) Open Source
18 64 (6.34%) Stakeholder Management
Programming Languages
1 433 (42.87%) Python
2 331 (32.77%) SQL
3 226 (22.38%) Java
4 156 (15.45%) Scala
5 82 (8.12%) C#
6 74 (7.33%) JavaScript
7 48 (4.75%) Bash Shell
8 46 (4.55%) R
9 43 (4.26%) Ruby
10 35 (3.47%) PowerShell
11 32 (3.17%) Go
12 25 (2.48%) Shell Script
13 24 (2.38%) C++
14 23 (2.28%) C
15 22 (2.18%) Groovy
15 22 (2.18%) Java 8
16 16 (1.58%) T-SQL
17 15 (1.49%) PL/SQL
18 11 (1.09%) TypeScript
19 7 (0.69%) Perl
Qualifications
1 150 (14.85%) Security Cleared
2 106 (10.50%) SC Cleared
3 95 (9.41%) Degree
4 38 (3.76%) DV Cleared
5 32 (3.17%) Computer Science Degree
6 23 (2.28%) CCA
7 22 (2.18%) Master's Degree
8 17 (1.68%) AWS Certification
9 12 (1.19%) PhD
10 11 (1.09%) PMI Certification
11 9 (0.89%) CISSP
11 9 (0.89%) Numerate Degree
12 8 (0.79%) Microsoft Certification
13 7 (0.69%) BPSS Clearance
13 7 (0.69%) CESG Certified Professional
13 7 (0.69%) CISM
13 7 (0.69%) CRISC
14 5 (0.50%) CCNA
14 5 (0.50%) Cisco Certification
15 4 (0.40%) ISEB
Quality Assurance & Compliance
1 30 (2.97%) QA
2 22 (2.18%) Data Quality
3 13 (1.29%) GDPR
4 9 (0.89%) MiFID
5 6 (0.59%) PCI DSS
6 4 (0.40%) GxP
7 3 (0.30%) Basel III
8 2 (0.20%) SLA
9 1 (0.099%) CDISC
9 1 (0.099%) IFRS
9 1 (0.099%) ISO/IEC 27001
System Software
1 184 (18.22%) Docker
2 55 (5.45%) HDFS
3 13 (1.29%) Apache Flume
4 7 (0.69%) Active Directory
5 6 (0.59%) Apache ZooKeeper
6 5 (0.50%) VMware ESXi
6 5 (0.50%) VMware Infrastructure
7 4 (0.40%) Virtual Machines
8 3 (0.30%) vSphere
9 2 (0.20%) NFS
9 2 (0.20%) Samba
9 2 (0.20%) VirtualBox
9 2 (0.20%) Xen
Systems Management
1 175 (17.33%) Kubernetes
2 120 (11.88%) Terraform
3 75 (7.43%) Ansible
4 30 (2.97%) Puppet
5 23 (2.28%) Hadoop YARN
5 23 (2.28%) Oozie
6 20 (1.98%) Nagios
7 14 (1.39%) Opscode Chef
8 11 (1.09%) Packer
9 9 (0.89%) logstash
10 8 (0.79%) Kibana
11 7 (0.69%) Ambari
12 5 (0.50%) SCCM
12 5 (0.50%) Single Sign-On
13 4 (0.40%) Docker Swarm
13 4 (0.40%) Grafana
14 3 (0.30%) CFEngine
14 3 (0.30%) HP ALM
14 3 (0.30%) HP SiteScope
14 3 (0.30%) Kubeflow
Vendors
1 146 (14.46%) Cloudera
2 108 (10.69%) Microsoft
3 82 (8.12%) Hortonworks
4 69 (6.83%) Google
5 63 (6.24%) Tableau
6 62 (6.14%) Oracle
7 59 (5.84%) Databricks
8 33 (3.27%) Informatica
9 30 (2.97%) SAP
9 30 (2.97%) StreamSets
10 27 (2.67%) Splunk
11 23 (2.28%) Talend
12 20 (1.98%) MapR
13 15 (1.49%) Teradata
14 10 (0.99%) Atlassian
15 9 (0.89%) IBM
16 8 (0.79%) Sybase
17 7 (0.69%) Ab Initio
17 7 (0.69%) CA
17 7 (0.69%) Red Hat