Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 4 December 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 4 December 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
4 Dec 2020		 Same period 2019 Same period 2018
Rank 104 94 95
Rank change year-on-year -10 +1 -6
Contract jobs citing Big Data 728 1,916 2,557
As % of all contract jobs advertised in England 2.29% 2.56% 2.69%
As % of the Database & Business Intelligence category 10.36% 11.74% 11.77%
Number of daily rates quoted 555 1,372 1,795
Median daily rate £550 £550 £550
10th Percentile £363 £413 £406
90th Percentile £688 £725 £713
UK median daily rate £550 £550 £550
Number of hourly rates quoted 11 2 13
Median hourly rate £35.00 £43.75 £44.50
Median hourly rate % change year-on-year -20.00% -1.69% +45.90%
UK median hourly rate £35.00 £36.00 £44.50
% change year-on-year -2.78% -19.10% +45.90%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 7,030 16,315 21,727
As % of all contract IT jobs advertised in England 22.13% 21.78% 22.85%
Number of daily rates quoted 4,558 11,105 15,306
Median daily rate £488 £475 £475
Median daily rate % change year-on-year +2.63% - +2.70%
10th Percentile £313 £325 £319
90th Percentile £675 £663 £638
UK median daily rate £480 £475 £475
% change year-on-year +1.05% - +5.56%
Number of hourly rates quoted 146 240 231
Median hourly rate £35.00 £30.50 £33.50
Median hourly rate % change year-on-year +14.75% -8.96% +7.54%
10th Percentile £14.25 £13.73 £14.00
90th Percentile £55.50 £71.33 £57.33
Median hourly rate £35.00 £30.00 £32.24
% change year-on-year +16.67% -6.94% +5.70%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 4 December 2020.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 4 December 2020.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 4 December 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -18 464 £555 -3.48% 152
North of England +2 79 £525 -2.33% 38
North West +16 66 £525 -2.33% 18
South East -14 52 £500 -2.44% 29
South West +13 38 £450 -18.18% 29
East of England +50 29 £463 -15.91% 12
Midlands +45 27 £405 -22.94% 13
East Midlands +34 17 £388 -26.13% 8
West Midlands +38 10 £488 -2.50% 5
Yorkshire -7 10 £513 +1.23% 17
North East +21 3 £700 +21.74% 3
Big Data
UK

For the 6 months to 4 December 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 296 (40.66%) Python
2 237 (32.55%) Apache Spark
3 223 (30.63%) SQL
4 218 (29.95%) Hadoop
5 211 (28.98%) Agile Software Development
6 201 (27.61%) Azure
7 200 (27.47%) Java
8 181 (24.86%) AWS
9 176 (24.18%) Analytics
10 159 (21.84%) DevOps
11 150 (20.60%) Security Cleared
12 146 (20.05%) ETL
13 136 (18.68%) Data Science
14 132 (18.13%) Docker
15 128 (17.58%) Kafka
16 127 (17.45%) SC Cleared
17 123 (16.90%) Finance
18 118 (16.21%) Data Modelling
19 115 (15.80%) Business Intelligence
20 113 (15.52%) Apache Hive
21 108 (14.84%) Kubernetes
22 106 (14.56%) Scala
23 104 (14.29%) Machine Learning
24 97 (13.32%) Data Engineering
25 93 (12.77%) Analytical Skills
26 89 (12.23%) Jenkins
27 87 (11.95%) Data Warehouse
28 85 (11.68%) Data Lake
29 84 (11.54%) Cloudera
30 83 (11.40%) GCP

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 237 (32.55%) Apache Spark
2 50 (6.87%) Apache
3 23 (3.16%) Elasticsearch
4 20 (2.75%) Confluence
5 17 (2.34%) Apache Airflow
6 16 (2.20%) SAS
7 12 (1.65%) Tomcat
8 10 (1.37%) SharePoint
9 5 (0.69%) Tornado
10 4 (0.55%) BizTalk Server
10 4 (0.55%) Cloud Foundry
10 4 (0.55%) Jupyter
10 4 (0.55%) nginx
11 3 (0.41%) Oracle Coherence
11 3 (0.41%) Skype for Business
12 2 (0.27%) Apache Pig
12 2 (0.27%) ArcGIS
12 2 (0.27%) Luigi
12 2 (0.27%) WebLogic
13 1 (0.14%) IIS
Applications
1 8 (1.10%) Microsoft Excel
2 7 (0.96%) Microsoft Office
3 6 (0.82%) Chatbot
4 5 (0.69%) Microsoft PowerPoint
4 5 (0.69%) MS Visio
5 3 (0.41%) SPSS
6 2 (0.27%) Microsoft Project
7 1 (0.14%) Spreadsheet
7 1 (0.14%) Stata
Business Applications
1 6 (0.82%) Sparx Enterprise Architect
2 4 (0.55%) Dynamics AX
2 4 (0.55%) Dynamics CRM
3 2 (0.27%) PeopleSoft HCM
3 2 (0.27%) SAP IS-U
3 2 (0.27%) SAP S/4HANA
4 1 (0.14%) Cognos Business Intelligence
4 1 (0.14%) NetSuite
4 1 (0.14%) Oracle Payroll
4 1 (0.14%) SAP ERP
Cloud Services
1 201 (27.61%) Azure
2 181 (24.86%) AWS
3 83 (11.40%) GCP
4 39 (5.36%) Serverless
5 38 (5.22%) Power Platform
6 29 (3.98%) Amazon S3
7 28 (3.85%) Amazon EMR
8 26 (3.57%) GitHub
9 24 (3.30%) PaaS
10 22 (3.02%) AWS Lambda
11 21 (2.88%) Azure Data Factory
12 14 (1.92%) Amazon EKS
13 13 (1.79%) Virtual Private Cloud
14 12 (1.65%) Amazon CloudWatch
14 12 (1.65%) Cloud Computing
15 11 (1.51%) Amazon EC2
15 11 (1.51%) Datadog
16 10 (1.37%) SaaS
17 8 (1.10%) IaaS
18 7 (0.96%) Office 365
Communications & Networking
1 14 (1.92%) Firewall
2 7 (0.96%) Internet
3 5 (0.69%) Kerberos
4 4 (0.55%) 3G
4 4 (0.55%) 4G
4 4 (0.55%) HTTP
4 4 (0.55%) Skype
4 4 (0.55%) VPN
5 3 (0.41%) 2G
5 3 (0.41%) 5G
5 3 (0.41%) Intrusion Detection
5 3 (0.41%) SSL
5 3 (0.41%) Unified Communications
6 2 (0.27%) DNS
6 2 (0.27%) Network Security
6 2 (0.27%) Radio Access Network
7 1 (0.14%) Diameter Protocol
7 1 (0.14%) PuTTY
7 1 (0.14%) VoLTE
7 1 (0.14%) Wi-Fi
Database & Business Intelligence
1 218 (29.95%) Hadoop
2 113 (15.52%) Apache Hive
3 87 (11.95%) Data Warehouse
4 85 (11.68%) Data Lake
5 76 (10.44%) NoSQL
6 40 (5.49%) Impala
7 39 (5.36%) Tableau
8 36 (4.95%) Power BI
9 34 (4.67%) Relational Database
10 33 (4.53%) BigQuery
11 31 (4.26%) PostgreSQL
12 26 (3.57%) MySQL
13 23 (3.16%) Data Mining
14 22 (3.02%) HBase
15 20 (2.75%) Amazon Redshift
16 19 (2.61%) Apache Cassandra
17 17 (2.34%) SQL Server
18 16 (2.20%) Azure SQL Database
18 16 (2.20%) MongoDB
19 13 (1.79%) RDBMS
Development Applications
1 89 (12.23%) Jenkins
2 54 (7.42%) Git (software)
3 33 (4.53%) GitLab
4 28 (3.85%) JIRA
5 14 (1.92%) Maven
6 11 (1.51%) Selenium
7 7 (0.96%) kappa
7 7 (0.96%) ProC
8 6 (0.82%) Atlassian Bamboo
8 6 (0.82%) SonarQube
8 6 (0.82%) Sonatype Nexus
9 5 (0.69%) CircleCI
9 5 (0.69%) Gradle
9 5 (0.69%) LoadRunner
9 5 (0.69%) PowerDesigner
9 5 (0.69%) SoapUI
10 4 (0.55%) ERwin
10 4 (0.55%) Hudson
10 4 (0.55%) JUnit
10 4 (0.55%) Vagrant
General
1 123 (16.90%) Finance
2 77 (10.58%) Banking
3 48 (6.59%) Marketing
4 41 (5.63%) Public Sector
5 31 (4.26%) Retail
6 30 (4.12%) Telecoms
7 27 (3.71%) Manufacturing
8 20 (2.75%) Front Office
9 16 (2.20%) Investment Banking
10 8 (1.10%) Electronics
10 8 (1.10%) Law
11 6 (0.82%) Games
11 6 (0.82%) Legal
12 5 (0.69%) Aerospace
12 5 (0.69%) Financial Institution
13 4 (0.55%) Pharmaceutical
14 3 (0.41%) Military
14 3 (0.41%) Retail Banking
15 2 (0.27%) French Language
15 2 (0.27%) General Ledger
Job Titles
1 155 (21.29%) Developer
2 134 (18.41%) Architect
2 134 (18.41%) Data Engineer
3 83 (11.40%) Data Architect
4 70 (9.62%) Big Data Engineer
5 44 (6.04%) DevOps Engineer
6 43 (5.91%) Data Scientist
7 37 (5.08%) Analyst
8 34 (4.67%) AWS Engineer
9 32 (4.40%) Solutions Architect
10 31 (4.26%) Python Engineer
11 30 (4.12%) Senior Developer
12 27 (3.71%) Cloud Engineer
13 26 (3.57%) Big Data Developer
14 24 (3.30%) Azure Engineer
15 23 (3.16%) Software Engineer
16 22 (3.02%) Azure Developer
16 22 (3.02%) Big Data Architect
16 22 (3.02%) Scala Developer
17 21 (2.88%) Python Developer
Libraries, Frameworks & Software Standards
1 128 (17.58%) Kafka
2 43 (5.91%) PySpark
3 37 (5.08%) HTML
4 33 (4.53%) Web Services
5 32 (4.40%) .NET
6 29 (3.98%) HTML5
7 23 (3.16%) REST
8 22 (3.02%) CSS
9 20 (2.75%) Apache NiFi
10 19 (2.61%) JSON
10 19 (2.61%) NumPy
11 18 (2.47%) Pandas
11 18 (2.47%) RESTful
11 18 (2.47%) scikit-learn
12 16 (2.20%) TensorFlow
13 15 (2.06%) Akka
13 15 (2.06%) Node.js
13 15 (2.06%) Velocity
14 14 (1.92%) GraphQL
14 14 (1.92%) XML
Miscellaneous
1 93 (12.77%) Analytical Skills
2 39 (5.36%) Algorithms
3 29 (3.98%) Data Structures
4 22 (3.02%) Greenfield Project
5 18 (2.47%) Cloud Native
5 18 (2.47%) User Experience
6 17 (2.34%) Virtual Team
7 15 (2.06%) Analytical Mindset
8 13 (1.79%) Foreign Exchange (FX)
9 11 (1.51%) FMCG
9 11 (1.51%) iPad
10 10 (1.37%) Data Centre
10 10 (1.37%) Linux Command Line
10 10 (1.37%) Renewable Energy
11 9 (1.24%) Public Cloud
12 8 (1.10%) Hybrid Cloud
12 8 (1.10%) Smart City
13 7 (0.96%) Enterprise Software
13 7 (0.96%) Hedge funds
13 7 (0.96%) Mobile App
Operating Systems
1 75 (10.30%) Linux
2 44 (6.04%) Unix
3 12 (1.65%) Windows
4 5 (0.69%) Apple iOS
5 4 (0.55%) Solaris
6 3 (0.41%) Android
6 3 (0.41%) Windows Server
7 1 (0.14%) CentOS
7 1 (0.14%) VMS
7 1 (0.14%) Windows 10
Processes & Methodologies
1 211 (28.98%) Agile Software Development
2 176 (24.18%) Analytics
3 159 (21.84%) DevOps
4 146 (20.05%) ETL
5 136 (18.68%) Data Science
6 118 (16.21%) Data Modelling
7 115 (15.80%) Business Intelligence
8 104 (14.29%) Machine Learning
9 97 (13.32%) Data Engineering
10 66 (9.07%) Microservices
11 65 (8.93%) Scrum
12 64 (8.79%) Visualisation
13 63 (8.65%) Data Architecture
14 62 (8.52%) Data Management
15 61 (8.38%) Problem-Solving
16 59 (8.10%) Migration
16 59 (8.10%) Software Engineering
17 56 (7.69%) Computer Science
17 56 (7.69%) Test Automation
18 51 (7.01%) Artificial Intelligence
Programming Languages
1 296 (40.66%) Python
2 223 (30.63%) SQL
3 200 (27.47%) Java
4 106 (14.56%) Scala
5 40 (5.49%) Bash Shell
6 39 (5.36%) R
7 36 (4.95%) JavaScript
8 35 (4.81%) C#
9 32 (4.40%) Shell Script
10 22 (3.02%) C++
11 18 (2.47%) PowerShell
11 18 (2.47%) Ruby
12 14 (1.92%) Haskell
13 11 (1.51%) Perl
13 11 (1.51%) TypeScript
14 10 (1.37%) Go
15 7 (0.96%) C
16 6 (0.82%) Java 8
17 5 (0.69%) MATLAB
17 5 (0.69%) T-SQL
Qualifications
1 150 (20.60%) Security Cleared
2 127 (17.45%) SC Cleared
3 69 (9.48%) Degree
4 27 (3.71%) Master's Degree
5 25 (3.43%) DV Cleared
6 19 (2.61%) Numerate Degree
7 17 (2.34%) Computer Science Degree
8 13 (1.79%) TOGAF Certification
9 12 (1.65%) Microsoft Certification
10 10 (1.37%) CCA
10 10 (1.37%) PhD
11 9 (1.24%) AWS Certification
12 2 (0.27%) BPSS Clearance
12 2 (0.27%) CISM
12 2 (0.27%) CISSP
12 2 (0.27%) DBS Check
13 1 (0.14%) CISA
13 1 (0.14%) ISEB
13 1 (0.14%) MCP
13 1 (0.14%) Postgraduate
Quality Assurance & Compliance
1 37 (5.08%) Data Quality
2 30 (4.12%) QA
3 9 (1.24%) MiFID
4 6 (0.82%) PCI DSS
5 4 (0.55%) Section 508
5 4 (0.55%) WAI
6 2 (0.27%) GDPR
6 2 (0.27%) ISO/IEC 20000
6 2 (0.27%) Sarbanes-Oxley
6 2 (0.27%) SLA
7 1 (0.14%) CDISC
7 1 (0.14%) Disclosure Scotland
7 1 (0.14%) Government Security Classifications
7 1 (0.14%) GxP
7 1 (0.14%) IFRS
7 1 (0.14%) ISO/IEC 27001
7 1 (0.14%) PMO
7 1 (0.14%) Solvency II
System Software
1 132 (18.13%) Docker
2 52 (7.14%) HDFS
3 23 (3.16%) Apache ZooKeeper
4 10 (1.37%) Active Directory
5 6 (0.82%) Apache Flume
6 5 (0.69%) Virtual Machines
7 4 (0.55%) Active Directory Lightweight Directory Services
8 2 (0.27%) VMware Infrastructure
Systems Management
1 108 (14.84%) Kubernetes
2 82 (11.26%) Terraform
3 76 (10.44%) Ansible
4 24 (3.30%) Puppet
5 22 (3.02%) Hadoop YARN
6 15 (2.06%) Packer
7 11 (1.51%) Nagios
7 11 (1.51%) Oozie
8 7 (0.96%) Kibana
8 7 (0.96%) Opscode Chef
9 5 (0.69%) Argo
10 4 (0.55%) Docker Swarm
11 3 (0.41%) Single Sign-On
12 2 (0.27%) logstash
13 1 (0.14%) Ambari
13 1 (0.14%) Control-M
13 1 (0.14%) Istio
13 1 (0.14%) Knative
13 1 (0.14%) Kubeflow
Vendors
1 84 (11.54%) Cloudera
2 73 (10.03%) Microsoft
3 65 (8.93%) Databricks
4 61 (8.38%) Oracle
5 58 (7.97%) Google
6 41 (5.63%) Hortonworks
7 23 (3.16%) IBM
7 23 (3.16%) SAP
8 20 (2.75%) Informatica
9 19 (2.61%) Ab Initio
9 19 (2.61%) Splunk
9 19 (2.61%) StreamSets
10 16 (2.20%) Teradata
11 11 (1.51%) Sparx
12 10 (1.37%) Talend
13 9 (1.24%) NetApp
14 8 (1.10%) Cisco
15 7 (0.96%) Dell
15 7 (0.96%) MuleSoft
16 6 (0.82%) BiZZdesign