Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 24 July 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 24 July 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
24 Jul 2021		 Same period 2020 Same period 2019
Rank 101 88 73
Rank change year-on-year -13 -15 +9
Contract jobs citing Big Data 1,385 896 2,686
As % of all contract jobs advertised in England 2.45% 2.68% 3.21%
As % of the Database & Business Intelligence category 11.42% 11.98% 14.02%
Number of daily rates quoted 949 648 1,959
10th Percentile £425 £409 £413
25th Percentile £495 £475 £488
Median daily rate (50th Percentile) £575 £550 £550
Median % change year-on-year +4.55% - -
75th Percentile £675 £656 £638
90th Percentile £750 £725 £713
UK median daily rate £575 £550 £550
% change year-on-year +4.55% - -
Number of hourly rates quoted 8 6 12
10th Percentile £20.90 £9.75 £17.95
25th Percentile £33.13 £16.75 £46.14
Median hourly rate £40.88 £42.50 £49.93
Median % change year-on-year -3.82% -14.88% +18.88%
75th Percentile £49.63 £47.94 £53.75
90th Percentile £50.68 £54.63 £60.50
UK median hourly rate £41.00 £29.25 £49.93
% change year-on-year +40.17% -41.42% +13.48%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 12,129 7,478 19,154
As % of all contract IT jobs advertised in England 21.43% 22.40% 22.86%
Number of daily rates quoted 8,456 5,266 13,413
10th Percentile £335 £329 £325
25th Percentile £413 £413 £400
Median daily rate (50th Percentile) £513 £500 £480
Median % change year-on-year +2.50% +4.17% +1.05%
75th Percentile £620 £600 £575
90th Percentile £706 £700 £650
UK median daily rate £500 £500 £475
% change year-on-year - +5.26% +2.70%
Number of hourly rates quoted 184 101 230
10th Percentile £11.61 £12.63 £13.86
25th Percentile £19.00 £17.75 £17.66
Median hourly rate £26.00 £24.70 £30.00
Median % change year-on-year +5.26% -17.67% -6.25%
75th Percentile £47.31 £43.25 £52.22
90th Percentile £63.46 £66.00 £60.00
UK median hourly rate £27.00 £22.50 £30.00
% change year-on-year +20.00% -25.00% -6.25%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 24 July 2021.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 24 July 2021.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 24 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -9 944 £599 +8.91% 271
South East -58 91 £550 +4.76% 38
North of England -69 88 £575 -3.77% 48
South West +33 74 £550 - 30
Midlands +2 54 £550 - 21
North West -56 46 £588 +0.21% 25
West Midlands -13 39 £490 +8.89% 15
Yorkshire -15 34 £600 +9.09% 18
East of England -10 27 £551 -4.13% 22
East Midlands -5 15 £725 +31.82% 6
North East +4 9 £565 -33.53% 5
Big Data
UK

For the 6 months to 24 July 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 461 (33.29%) Python
2 453 (32.71%) SQL
3 450 (32.49%) Agile Software Development
4 444 (32.06%) AWS
5 431 (31.12%) Apache Spark
6 406 (29.31%) Azure
7 398 (28.74%) Analytics
8 384 (27.73%) Hadoop
9 359 (25.92%) Finance
10 327 (23.61%) DevOps
11 320 (23.10%) Social Skills
12 317 (22.89%) Java
13 267 (19.28%) Kafka
14 264 (19.06%) Data Warehouse
15 252 (18.19%) Data Modelling
16 236 (17.04%) Scala
17 232 (16.75%) GCP
18 227 (16.39%) Kubernetes
19 215 (15.52%) Apache Hive
20 213 (15.38%) ETL
21 204 (14.73%) Docker
22 203 (14.66%) Business Intelligence
23 181 (13.07%) Data Pipeline
24 179 (12.92%) Data Lake
25 177 (12.78%) Banking
26 169 (12.20%) Oracle
27 168 (12.13%) Analytical Skills
28 163 (11.77%) NoSQL
29 162 (11.70%) Software Engineering
30 161 (11.62%) Security Cleared

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 431 (31.12%) Apache Spark
2 142 (10.25%) Apache
3 84 (6.06%) Apache Airflow
4 50 (3.61%) Confluence
5 44 (3.18%) Elasticsearch
6 30 (2.17%) SAS
7 28 (2.02%) Luigi
8 24 (1.73%) Oracle Coherence
9 12 (0.87%) SharePoint
10 10 (0.72%) Tomcat
11 9 (0.65%) Apache Pig
12 6 (0.43%) Oracle Workflow
13 5 (0.36%) nginx
14 4 (0.29%) Apache Pulsar
14 4 (0.29%) CMS
14 4 (0.29%) Jupyter
14 4 (0.29%) OpenStack
15 3 (0.22%) Oracle SOA Suite
15 3 (0.22%) WebLogic
15 3 (0.22%) WordPress
Applications
1 9 (0.65%) Microsoft Excel
2 8 (0.58%) Microsoft Office
3 6 (0.43%) Spreadsheet
4 4 (0.29%) SPSS
5 2 (0.14%) Microsoft PowerPoint
5 2 (0.14%) Microsoft Project
5 2 (0.14%) MS Visio
Business Applications
1 10 (0.72%) Dynamics CRM
2 4 (0.29%) Oracle EBS
3 2 (0.14%) NetSuite
3 2 (0.14%) Oracle BPM
3 2 (0.14%) SAP R/3
4 1 (0.072%) Adobe Campaign
4 1 (0.072%) Dynamics AX
4 1 (0.072%) Eloqua
4 1 (0.072%) Oracle ERP
4 1 (0.072%) Oracle Payables
4 1 (0.072%) Oracle Procure-to-Pay
4 1 (0.072%) Oracle Receivables
4 1 (0.072%) Salesforce.com CRM
4 1 (0.072%) SAP ERP
4 1 (0.072%) SAP Hybris
4 1 (0.072%) SAP MDG
4 1 (0.072%) SAP MDM
4 1 (0.072%) Sentinel
Cloud Services
1 444 (32.06%) AWS
2 406 (29.31%) Azure
3 232 (16.75%) GCP
4 139 (10.04%) Serverless
5 92 (6.64%) Power Platform
6 82 (5.92%) PaaS
7 76 (5.49%) IaaS
8 59 (4.26%) Amazon S3
9 55 (3.97%) Azure Data Factory
10 54 (3.90%) AWS Lambda
11 42 (3.03%) Amazon EMR
12 41 (2.96%) Azure Cosmos DB
13 40 (2.89%) Cloud Computing
14 39 (2.82%) Azure Synapse Analytics
15 35 (2.53%) Snowflake
16 34 (2.45%) Azure Functions
17 28 (2.02%) Amazon EC2
18 25 (1.81%) GitHub
19 19 (1.37%) SaaS
20 18 (1.30%) Amazon EKS
Communications & Networking
1 26 (1.88%) Firewall
2 23 (1.66%) HTTP
3 9 (0.65%) Internet
4 8 (0.58%) FTP
5 6 (0.43%) SAN
6 5 (0.36%) Intrusion Detection
6 5 (0.36%) Network Security
6 5 (0.36%) TCP/IP
7 4 (0.29%) Remote Desktop
8 3 (0.22%) SSH
9 2 (0.14%) SMTP
9 2 (0.14%) SSL
9 2 (0.14%) Unified Communications
9 2 (0.14%) VLAN
9 2 (0.14%) Wireless
9 2 (0.14%) Wireshark
10 1 (0.072%) Cisco ASA
10 1 (0.072%) NAS
10 1 (0.072%) tcpdump
10 1 (0.072%) TETRA
Database & Business Intelligence
1 384 (27.73%) Hadoop
2 264 (19.06%) Data Warehouse
3 215 (15.52%) Apache Hive
4 179 (12.92%) Data Lake
5 163 (11.77%) NoSQL
6 126 (9.10%) Relational Database
7 105 (7.58%) Metadata
8 104 (7.51%) PostgreSQL
9 87 (6.28%) Power BI
10 84 (6.06%) SQL Server
11 81 (5.85%) MongoDB
12 80 (5.78%) BigQuery
13 69 (4.98%) HBase
14 66 (4.77%) Tableau
15 59 (4.26%) Apache Cassandra
16 44 (3.18%) Data Mining
17 41 (2.96%) Impala
18 40 (2.89%) Amazon Redshift
19 35 (2.53%) Amazon Athena
19 35 (2.53%) RDBMS
Development Applications
1 119 (8.59%) Jenkins
2 108 (7.80%) Git (software)
3 87 (6.28%) JIRA
4 43 (3.10%) GitLab
4 43 (3.10%) Maven
5 39 (2.82%) PowerDesigner
6 27 (1.95%) Bitbucket
7 24 (1.73%) TeamCity
8 21 (1.52%) kappa
9 20 (1.44%) Sonatype Nexus
10 17 (1.23%) Artifactory
10 17 (1.23%) Visual Studio Team System
11 14 (1.01%) Subversion
12 12 (0.87%) ERwin
12 12 (0.87%) Gradle
12 12 (0.87%) IntelliJ
13 11 (0.79%) IBM UrbanCode
14 10 (0.72%) Cucumber
14 10 (0.72%) Hudson
15 9 (0.65%) JUnit
General
1 359 (25.92%) Finance
2 320 (23.10%) Social Skills
3 177 (12.78%) Banking
4 168 (12.13%) Analytical Skills
5 54 (3.90%) Investment Banking
6 48 (3.47%) Public Sector
7 45 (3.25%) Presentation Skills
8 39 (2.82%) Retail
9 35 (2.53%) Marketing
10 25 (1.81%) Telecoms
11 23 (1.66%) Front Office
12 20 (1.44%) Legal
13 17 (1.23%) Documentation Skills
14 16 (1.16%) Influencing Skills
15 11 (0.79%) Games
16 10 (0.72%) Financial Institution
17 8 (0.58%) Multimedia
18 7 (0.51%) Electronics
18 7 (0.51%) French Language
19 6 (0.43%) Pharmaceutical
Job Titles
1 313 (22.60%) Data Engineer
2 303 (21.88%) Architect
3 253 (18.27%) Developer
4 174 (12.56%) Data Architect
5 114 (8.23%) Big Data Engineer
6 110 (7.94%) Solutions Architect
7 78 (5.63%) DevOps Engineer
8 68 (4.91%) AWS Engineer
9 62 (4.48%) Software Engineer
10 60 (4.33%) Cloud Architect
11 59 (4.26%) Analyst
12 56 (4.04%) Azure Architect
12 56 (4.04%) Scala Developer
13 52 (3.75%) Java Developer
14 45 (3.25%) Senior Developer
15 39 (2.82%) Big Data Developer
16 37 (2.67%) AWS Architect
16 37 (2.67%) Cloud Engineer
17 36 (2.60%) Azure Engineer
18 35 (2.53%) Big Data Architect
Libraries, Frameworks & Software Standards
1 267 (19.28%) Kafka
2 85 (6.14%) PySpark
3 79 (5.70%) Web Services
4 57 (4.12%) Apache NiFi
5 47 (3.39%) Spring
6 42 (3.03%) .NET
6 42 (3.03%) JSON
7 41 (2.96%) RESTful
8 31 (2.24%) REST
9 29 (2.09%) React
10 28 (2.02%) Spark Streaming
11 26 (1.88%) Velocity
12 25 (1.81%) Apache Avro
12 25 (1.81%) Node.js
13 24 (1.73%) Akka
13 24 (1.73%) HTML
14 22 (1.59%) Spring Boot
14 22 (1.59%) XML
15 21 (1.52%) AngularJS
16 20 (1.44%) Samza
Miscellaneous
1 79 (5.70%) Data Structures
2 52 (3.75%) Algorithms
3 40 (2.89%) Virtual Team
4 37 (2.67%) Data Centre
5 33 (2.38%) Cloud Native
6 32 (2.31%) Market Risk
7 29 (2.09%) Data Protection Act
8 23 (1.66%) Greenfield Project
9 22 (1.59%) Management Information System
10 21 (1.52%) Public Cloud
11 19 (1.37%) Hybrid Cloud
11 19 (1.37%) Legacy Applications
11 19 (1.37%) Self-Motivation
12 18 (1.30%) Linux Command Line
13 17 (1.23%) Reference Data
14 16 (1.16%) Grid Computing
14 16 (1.16%) iPad
15 14 (1.01%) Legacy Systems
16 11 (0.79%) Analytical Mindset
16 11 (0.79%) User Experience
Operating Systems
1 154 (11.12%) Linux
2 76 (5.49%) Unix
3 19 (1.37%) Windows
4 14 (1.01%) Red Hat Enterprise Linux
5 10 (0.72%) AIX
6 4 (0.29%) Android
6 4 (0.29%) VMS
7 3 (0.22%) Apple iOS
8 2 (0.14%) HPUX
8 2 (0.14%) Solaris
8 2 (0.14%) SUSE Linux Enterprise Server
8 2 (0.14%) Ubuntu
9 1 (0.072%) CoreOS
9 1 (0.072%) MVS
Processes & Methodologies
1 450 (32.49%) Agile Software Development
2 398 (28.74%) Analytics
3 327 (23.61%) DevOps
4 252 (18.19%) Data Modelling
5 213 (15.38%) ETL
6 203 (14.66%) Business Intelligence
7 181 (13.07%) Data Pipeline
8 162 (11.70%) Software Engineering
9 156 (11.26%) Data Science
9 156 (11.26%) Migration
10 154 (11.12%) Data Architecture
11 145 (10.47%) Data Engineering
12 141 (10.18%) Scrum
13 138 (9.96%) Data Management
14 136 (9.82%) Microservices
15 123 (8.88%) Machine Learning
16 116 (8.38%) Data Analytics
17 113 (8.16%) SDLC
18 112 (8.09%) Problem-Solving
18 112 (8.09%) Visualisation
Programming Languages
1 461 (33.29%) Python
2 453 (32.71%) SQL
3 317 (22.89%) Java
4 236 (17.04%) Scala
5 63 (4.55%) R
6 55 (3.97%) JavaScript
7 51 (3.68%) C#
8 44 (3.18%) Bash Shell
9 39 (2.82%) Groovy
10 32 (2.31%) Shell Script
11 29 (2.09%) Go
11 29 (2.09%) PL/SQL
12 24 (1.73%) C++
13 23 (1.66%) C
14 22 (1.59%) Ruby
15 21 (1.52%) PowerShell
16 15 (1.08%) Java 8
17 13 (0.94%) Kotlin
17 13 (0.94%) T-SQL
18 12 (0.87%) TypeScript
Qualifications
1 161 (11.62%) Security Cleared
2 120 (8.66%) SC Cleared
3 94 (6.79%) Degree
4 68 (4.91%) DV Cleared
5 37 (2.67%) Computer Science Degree
6 9 (0.65%) Master's Degree
6 9 (0.65%) TOGAF Certification
7 8 (0.58%) AWS Certification
8 7 (0.51%) CCA
8 7 (0.51%) CISM
8 7 (0.51%) CISSP
9 5 (0.36%) BPSS Clearance
9 5 (0.36%) PhD
10 4 (0.29%) BC Cleared
10 4 (0.29%) Microsoft Certification
10 4 (0.29%) SAS Certification
11 3 (0.22%) Cisco Certification
11 3 (0.22%) Numerate Degree
11 3 (0.22%) OCP
11 3 (0.22%) Oracle Certification
Quality Assurance & Compliance
1 96 (6.93%) Data Quality
2 46 (3.32%) QA
3 33 (2.38%) GDPR
4 12 (0.87%) IFRS
4 12 (0.87%) PMO
5 9 (0.65%) Sarbanes-Oxley
5 9 (0.65%) SLA
6 4 (0.29%) IFRS 9
7 3 (0.22%) ISO 20022
7 3 (0.22%) ISO/IEC 27001
7 3 (0.22%) MiFID
7 3 (0.22%) NCSC
8 2 (0.14%) COBIT
8 2 (0.14%) NIST
8 2 (0.14%) PCI DSS
8 2 (0.14%) SOC 1
8 2 (0.14%) SOC 2
9 1 (0.072%) Actionable Recommendations
9 1 (0.072%) Dodd-Frank
9 1 (0.072%) EMIR
System Software
1 204 (14.73%) Docker
2 61 (4.40%) HDFS
3 27 (1.95%) Active Directory
4 15 (1.08%) Apache ZooKeeper
5 11 (0.79%) VMware Infrastructure
6 8 (0.58%) Apache Flume
7 4 (0.29%) Oracle RAC
8 2 (0.14%) Platform Symphony
8 2 (0.14%) Virtual Machines
9 1 (0.072%) VMware NSX
Systems Management
1 227 (16.39%) Kubernetes
2 145 (10.47%) Terraform
3 109 (7.87%) Ansible
4 29 (2.09%) Oozie
5 28 (2.02%) Puppet
6 21 (1.52%) Hadoop YARN
7 13 (0.94%) Opscode Chef
8 12 (0.87%) Kibana
8 12 (0.87%) Prometheus
9 11 (0.79%) Control-M
9 11 (0.79%) Grafana
10 9 (0.65%) Single Sign-On
11 8 (0.58%) Ambari
11 8 (0.58%) Rancher
12 7 (0.51%) Docker Swarm
12 7 (0.51%) logstash
13 4 (0.29%) Active Directory Federation Services
14 3 (0.22%) Data Guard
14 3 (0.22%) Istio
14 3 (0.22%) MIIS
Vendors
1 169 (12.20%) Oracle
2 145 (10.47%) Databricks
3 144 (10.40%) Google
4 130 (9.39%) Cloudera
5 118 (8.52%) Microsoft
6 50 (3.61%) Informatica
7 42 (3.03%) Hortonworks
7 42 (3.03%) SAP
8 36 (2.60%) BiZZdesign
9 35 (2.53%) IBM
10 29 (2.09%) Salesforce.com
11 28 (2.02%) Teradata
12 24 (1.73%) VMware
13 17 (1.23%) Ab Initio
13 17 (1.23%) ServiceNow
14 16 (1.16%) Talend
15 15 (1.08%) MuleSoft
15 15 (1.08%) Red Hat
16 13 (0.94%) Alteryx
17 11 (0.79%) MapR