Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 24 February 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 24 February 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
24 Feb 2021		 Same period 2020 Same period 2019
Rank 111 91 86
Rank change year-on-year -20 -5 +2
Contract jobs citing Big Data 852 1,544 2,555
As % of all contract jobs advertised in England 2.23% 2.52% 2.86%
As % of the Database & Business Intelligence category 10.61% 11.60% 12.57%
Number of daily rates quoted 698 1,137 1,850
Median daily rate £550 £550 £550
10th Percentile £400 £400 £413
90th Percentile £688 £725 £713
UK median daily rate £550 £550 £550
Number of hourly rates quoted 3 1 8
Median hourly rate £55.00 £38.50 £45.00
Median hourly rate % change year-on-year +42.86% -14.44% +19.51%
10th Percentile £51.00 £37.75 £31.78
90th Percentile £64.20 £39.25 £58.25
UK median hourly rate £60.75 £38.50 £45.00
% change year-on-year +57.79% -14.44% +19.51%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 8,027 13,306 20,331
As % of all contract IT jobs advertised in England 21.05% 21.68% 22.76%
Number of daily rates quoted 5,573 9,185 14,326
Median daily rate £488 £484 £485
Median daily rate % change year-on-year +0.72% -0.21% +2.11%
10th Percentile £313 £323 £325
90th Percentile £665 £675 £650
UK median daily rate £483 £475 £475
% change year-on-year +1.58% - +2.70%
Number of hourly rates quoted 138 187 203
Median hourly rate £24.75 £25.00 £30.00
Median hourly rate % change year-on-year -1.00% -16.67% -5.23%
10th Percentile £13.46 £13.40 £14.00
90th Percentile £60.55 £62.55 £55.00
Median hourly rate £26.00 £25.00 £27.50
% change year-on-year +4.00% -9.09% -12.17%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 24 February 2021.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 24 February 2021.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 24 February 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -13 565 £555 -3.48% 238
North of England -21 62 £550 - 30
South East -37 60 £515 +8.42% 39
South West +35 58 £509 -7.50% 20
North West -20 40 £550 - 17
East of England +39 31 £513 -2.38% 18
Midlands +32 30 £388 -13.89% 17
Yorkshire +14 19 £550 +7.32% 10
West Midlands +8 17 £450 -1.37% 9
East Midlands +30 13 £380 -15.67% 8
North East +17 3 £700 +3.70% 3
Big Data
UK

For the 6 months to 24 February 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 316 (37.09%) Python
2 286 (33.57%) Agile Software Development
3 282 (33.10%) Apache Spark
4 253 (29.69%) SQL
5 239 (28.05%) Analytics
6 238 (27.93%) AWS
7 237 (27.82%) Java
8 229 (26.88%) Azure
9 228 (26.76%) Hadoop
10 190 (22.30%) DevOps
11 176 (20.66%) Security Cleared
12 170 (19.95%) Finance
12 170 (19.95%) Kafka
13 163 (19.13%) ETL
14 156 (18.31%) SC Cleared
15 147 (17.25%) Data Warehouse
16 141 (16.55%) Data Modelling
17 136 (15.96%) Scala
17 136 (15.96%) Apache Hive
18 130 (15.26%) Data Science
19 121 (14.20%) Data Lake
20 115 (13.50%) Data Engineering
20 115 (13.50%) Business Intelligence
21 114 (13.38%) Docker
22 112 (13.15%) Analytical Skills
23 107 (12.56%) Kubernetes
24 105 (12.32%) Machine Learning
25 101 (11.85%) Apache
26 99 (11.62%) Software Engineering
27 96 (11.27%) Banking

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 282 (33.10%) Apache Spark
2 101 (11.85%) Apache
3 38 (4.46%) Apache Airflow
4 27 (3.17%) Confluence
5 23 (2.70%) Elasticsearch
6 18 (2.11%) SAS
7 12 (1.41%) Jupyter
8 8 (0.94%) SharePoint
9 5 (0.59%) Apache Pig
9 5 (0.59%) Oracle Coherence
10 4 (0.47%) Cloud Foundry
10 4 (0.47%) nginx
10 4 (0.47%) Tomcat
11 3 (0.35%) Luigi
11 3 (0.35%) Skype for Business
11 3 (0.35%) WebLogic
12 2 (0.23%) ArcGIS
12 2 (0.23%) OpenStack
12 2 (0.23%) Tornado
13 1 (0.12%) Oracle Workflow
Applications
1 10 (1.17%) Microsoft Excel
1 10 (1.17%) Microsoft Office
2 7 (0.82%) Chatbot
3 5 (0.59%) MS Visio
4 4 (0.47%) Microsoft PowerPoint
5 1 (0.12%) Microsoft Project
5 1 (0.12%) Spreadsheet
5 1 (0.12%) SPSS
Business Applications
1 4 (0.47%) Sparx Enterprise Architect
2 3 (0.35%) SAP IS-U
3 2 (0.23%) Oracle EBS
3 2 (0.23%) SAP ERP
4 1 (0.12%) Cognos Business Intelligence
4 1 (0.12%) Dynamics CRM
4 1 (0.12%) NetSuite
4 1 (0.12%) PeopleSoft HCM
4 1 (0.12%) SAP CRM
4 1 (0.12%) SAP MDM
4 1 (0.12%) SAP S/4HANA
Cloud Services
1 238 (27.93%) AWS
2 229 (26.88%) Azure
3 95 (11.15%) GCP
4 84 (9.86%) Serverless
5 51 (5.99%) Amazon S3
6 50 (5.87%) Power Platform
7 46 (5.40%) GitHub
8 40 (4.69%) Amazon EMR
8 40 (4.69%) AWS Lambda
9 24 (2.82%) PaaS
10 22 (2.58%) Amazon EC2
11 21 (2.46%) Azure Data Factory
12 19 (2.23%) Cloud Computing
13 17 (2.00%) Amazon Kinesis
14 16 (1.88%) Amazon EKS
15 11 (1.29%) Amazon CloudWatch
15 11 (1.29%) iPaaS
16 10 (1.17%) Amazon ECS
16 10 (1.17%) AWS CloudFormation
16 10 (1.17%) OpenShift
Communications & Networking
1 17 (2.00%) HTTP
2 16 (1.88%) Firewall
3 5 (0.59%) DNS
3 5 (0.59%) Network Security
3 5 (0.59%) VPN
4 4 (0.47%) Internet
4 4 (0.47%) Kerberos
5 3 (0.35%) Intrusion Detection
5 3 (0.35%) Remote Desktop
5 3 (0.35%) SMTP
5 3 (0.35%) SSL
6 2 (0.23%) 2G
6 2 (0.23%) 3G
6 2 (0.23%) 4G
6 2 (0.23%) 5G
6 2 (0.23%) Radio Access Network
6 2 (0.23%) Skype
6 2 (0.23%) Unified Communications
7 1 (0.12%) DHCP
7 1 (0.12%) PuTTY
Database & Business Intelligence
1 228 (26.76%) Hadoop
2 147 (17.25%) Data Warehouse
3 136 (15.96%) Apache Hive
4 121 (14.20%) Data Lake
5 85 (9.98%) NoSQL
6 58 (6.81%) Relational Database
7 49 (5.75%) Power BI
8 45 (5.28%) HBase
9 44 (5.16%) Impala
10 37 (4.34%) BigQuery
11 34 (3.99%) Amazon Redshift
12 33 (3.87%) PostgreSQL
13 31 (3.64%) Tableau
14 29 (3.40%) MongoDB
14 29 (3.40%) MySQL
15 26 (3.05%) SQL Server
16 25 (2.93%) Apache Cassandra
17 23 (2.70%) Amazon RDS
18 22 (2.58%) Data Mining
19 21 (2.46%) RDBMS
Development Applications
1 77 (9.04%) Jenkins
2 51 (5.99%) JIRA
3 42 (4.93%) Git (software)
4 35 (4.11%) GitLab
5 25 (2.93%) Maven
6 23 (2.70%) PowerDesigner
7 20 (2.35%) kappa
8 17 (2.00%) Sonatype Nexus
9 13 (1.53%) Gradle
10 9 (1.06%) IBM UrbanCode
11 8 (0.94%) Selenium
12 7 (0.82%) SonarQube
13 6 (0.70%) Atlassian Bamboo
14 5 (0.59%) Bitbucket
14 5 (0.59%) Cucumber
14 5 (0.59%) JUnit
15 4 (0.47%) ERwin
15 4 (0.47%) LoadRunner
15 4 (0.47%) ProC
15 4 (0.47%) SoapUI
General
1 170 (19.95%) Finance
2 96 (11.27%) Banking
3 36 (4.23%) Public Sector
4 33 (3.87%) Marketing
5 32 (3.76%) Investment Banking
6 27 (3.17%) Retail
7 25 (2.93%) Telecoms
8 19 (2.23%) Front Office
9 18 (2.11%) Manufacturing
10 12 (1.41%) Pharmaceutical
11 7 (0.82%) Law
12 5 (0.59%) Automotive
12 5 (0.59%) Electronics
12 5 (0.59%) Financial Institution
12 5 (0.59%) Legal
13 4 (0.47%) Games
14 3 (0.35%) French Language
14 3 (0.35%) Military
15 2 (0.23%) Publishing
15 2 (0.23%) Retail Banking
Job Titles
1 197 (23.12%) Data Engineer
2 174 (20.42%) Developer
3 169 (19.84%) Architect
4 99 (11.62%) Data Architect
5 83 (9.74%) Big Data Engineer
6 53 (6.22%) Solutions Architect
7 50 (5.87%) AWS Engineer
8 48 (5.63%) Software Engineer
9 46 (5.40%) Analyst
9 46 (5.40%) DevOps Engineer
10 35 (4.11%) Cloud Engineer
11 32 (3.76%) Data Scientist
12 31 (3.64%) Big Data Architect
12 31 (3.64%) Big Data Developer
12 31 (3.64%) Python Engineer
13 29 (3.40%) Senior Developer
14 28 (3.29%) Data Analyst
14 28 (3.29%) DV Cleared Software Engineer
15 27 (3.17%) Java Developer
16 25 (2.93%) Cloud Architect
Libraries, Frameworks & Software Standards
1 170 (19.95%) Kafka
2 48 (5.63%) PySpark
3 44 (5.16%) Web Services
4 42 (4.93%) Apache NiFi
5 35 (4.11%) HTML
6 23 (2.70%) .NET
6 23 (2.70%) NumPy
7 21 (2.46%) CSS
8 20 (2.35%) JSON
8 20 (2.35%) Node.js
8 20 (2.35%) Pandas
8 20 (2.35%) RESTful
8 20 (2.35%) Spring
9 19 (2.23%) HTML5
9 19 (2.23%) REST
10 18 (2.11%) React
11 17 (2.00%) XML
12 16 (1.88%) Spark Streaming
13 13 (1.53%) GraphQL
13 13 (1.53%) RabbitMQ
Miscellaneous
1 112 (13.15%) Analytical Skills
2 42 (4.93%) Algorithms
3 37 (4.34%) Data Structures
4 26 (3.05%) User Experience
5 24 (2.82%) Cloud Native
6 21 (2.46%) Greenfield Project
6 21 (2.46%) Virtual Team
7 17 (2.00%) Self-Motivation
8 15 (1.76%) Linux Command Line
9 14 (1.64%) Data Centre
10 13 (1.53%) iPad
11 12 (1.41%) Hedge funds
11 12 (1.41%) Public Cloud
12 11 (1.29%) Analytical Mindset
12 11 (1.29%) FMCG
12 11 (1.29%) Foreign Exchange (FX)
13 10 (1.17%) Enterprise Software
14 9 (1.06%) Reference Data
15 8 (0.94%) Grid Computing
16 6 (0.70%) Management Information System
Operating Systems
1 92 (10.80%) Linux
2 39 (4.58%) Unix
3 15 (1.76%) Windows
4 6 (0.70%) Apple iOS
5 5 (0.59%) AIX
5 5 (0.59%) Android
6 4 (0.47%) Red Hat Enterprise Linux
7 3 (0.35%) Windows Server
8 2 (0.23%) HPUX
8 2 (0.23%) Solaris
8 2 (0.23%) SUSE Linux Enterprise Server
8 2 (0.23%) Windows 10
9 1 (0.12%) CentOS
9 1 (0.12%) VMS
Processes & Methodologies
1 286 (33.57%) Agile Software Development
2 239 (28.05%) Analytics
3 190 (22.30%) DevOps
4 163 (19.13%) ETL
5 141 (16.55%) Data Modelling
6 130 (15.26%) Data Science
7 115 (13.50%) Business Intelligence
7 115 (13.50%) Data Engineering
8 105 (12.32%) Machine Learning
9 99 (11.62%) Software Engineering
10 94 (11.03%) Microservices
11 90 (10.56%) Migration
12 74 (8.69%) Data Analysis
13 73 (8.57%) Data Analytics
14 71 (8.33%) Data Architecture
15 70 (8.22%) Problem-Solving
16 69 (8.10%) Data Management
16 69 (8.10%) Scrum
17 67 (7.86%) Visualisation
18 64 (7.51%) TDD
Programming Languages
1 316 (37.09%) Python
2 253 (29.69%) SQL
3 237 (27.82%) Java
4 136 (15.96%) Scala
5 43 (5.05%) R
6 41 (4.81%) JavaScript
6 41 (4.81%) Shell Script
7 26 (3.05%) Bash Shell
8 22 (2.58%) C#
9 18 (2.11%) Haskell
10 17 (2.00%) TypeScript
11 16 (1.88%) C++
12 14 (1.64%) C
13 13 (1.53%) Perl
14 12 (1.41%) PowerShell
14 12 (1.41%) T-SQL
15 8 (0.94%) Elm
16 7 (0.82%) Groovy
16 7 (0.82%) PL/SQL
17 6 (0.70%) Go
Qualifications
1 176 (20.66%) Security Cleared
2 156 (18.31%) SC Cleared
3 49 (5.75%) DV Cleared
4 44 (5.16%) Degree
5 14 (1.64%) AWS Certification
6 12 (1.41%) Computer Science Degree
6 12 (1.41%) Master's Degree
7 10 (1.17%) Numerate Degree
8 9 (1.06%) PhD
9 8 (0.94%) Microsoft Certification
9 8 (0.94%) TOGAF Certification
10 4 (0.47%) BPSS Clearance
10 4 (0.47%) CCA
11 2 (0.23%) CISM
11 2 (0.23%) CISSP
11 2 (0.23%) DBS Check
12 1 (0.12%) CGEIT
12 1 (0.12%) CISA
12 1 (0.12%) MCP
Quality Assurance & Compliance
1 45 (5.28%) Data Quality
2 35 (4.11%) QA
3 5 (0.59%) GDPR
4 4 (0.47%) MiFID
4 4 (0.47%) Section 508
4 4 (0.47%) WAI
5 3 (0.35%) PCI DSS
5 3 (0.35%) SLA
6 2 (0.23%) ISO/IEC 20000
7 1 (0.12%) Basel II
7 1 (0.12%) Disclosure Scotland
7 1 (0.12%) Government Security Classifications
7 1 (0.12%) GxP
7 1 (0.12%) IFRS
7 1 (0.12%) PMO
7 1 (0.12%) Solvency II
System Software
1 114 (13.38%) Docker
2 71 (8.33%) HDFS
3 16 (1.88%) Apache ZooKeeper
4 8 (0.94%) Active Directory
4 8 (0.94%) Apache Flume
5 7 (0.82%) Virtual Machines
6 4 (0.47%) Active Directory Lightweight Directory Services
7 3 (0.35%) VMware Infrastructure
8 1 (0.12%) VMware NSX
Systems Management
1 107 (12.56%) Kubernetes
2 82 (9.62%) Terraform
3 71 (8.33%) Ansible
4 27 (3.17%) Hadoop YARN
5 22 (2.58%) Oozie
6 15 (1.76%) Packer
7 12 (1.41%) Puppet
8 6 (0.70%) Opscode Chef
9 5 (0.59%) Argo
10 4 (0.47%) Docker Swarm
11 3 (0.35%) Control-M
11 3 (0.35%) Kibana
11 3 (0.35%) MIIS
11 3 (0.35%) Nagios
11 3 (0.35%) Prometheus
11 3 (0.35%) Single Sign-On
12 1 (0.12%) Ambari
12 1 (0.12%) Grafana
12 1 (0.12%) Kubeflow
12 1 (0.12%) logstash
Vendors
1 89 (10.45%) Cloudera
2 68 (7.98%) Google
3 58 (6.81%) Databricks
3 58 (6.81%) Microsoft
4 54 (6.34%) Oracle
5 36 (4.23%) Hortonworks
6 27 (3.17%) SAP
7 26 (3.05%) Informatica
8 23 (2.70%) BiZZdesign
9 19 (2.23%) IBM
10 18 (2.11%) MuleSoft
10 18 (2.11%) Talend
11 14 (1.64%) Ab Initio
12 12 (1.41%) Splunk
12 12 (1.41%) Teradata
12 12 (1.41%) VMware
13 11 (1.29%) Alteryx
14 9 (1.06%) MapR
15 8 (0.94%) Cisco
15 8 (0.94%) NetApp