Period
to 1 August 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 1 August 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
1 Aug 2021
Same period 2020 Same period 2019
Rank 81 78 57
Rank change year-on-year -3 -21 +11
Contract jobs citing Big Data 958 517 1,764
As % of all contract jobs advertised in London 3.18% 3.28% 4.39%
As % of the Database & Business Intelligence category 13.20% 12.98% 17.33%
Number of daily rates quoted 648 363 1,349
10th Percentile £445 £419 £425
25th Percentile £500 £475 £510
Median daily rate (50th Percentile) £600 £550 £575
Median % change year-on-year +9.09% -4.35% +2.22%
75th Percentile £688 £653 £650
90th Percentile £750 £713 £725
England median daily rate £575 £550 £550
% change year-on-year +4.55% - -
Number of hourly rates quoted 5 3 5
10th Percentile " £39.25 £26.06
25th Percentile £36.25 £41.50 £42.28
Median hourly rate £44.25 £46.50 £49.13
Median % change year-on-year -4.84% -5.35% +78.65%
75th Percentile £49.50 £47.88 £50.00
90th Percentile £51.15 £47.95 "
England median hourly rate £37.50 £42.50 £49.93
% change year-on-year -11.76% -14.88% +13.48%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 7,260 3,984 10,178
As % of all contract IT jobs advertised in London 24.10% 25.29% 25.31%
Number of daily rates quoted 5,136 2,866 7,462
10th Percentile £388 £363 £363
25th Percentile £463 £438 £425
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - -
75th Percentile £650 £636 £608
90th Percentile £725 £725 £688
England median daily rate £520 £500 £480
% change year-on-year +4.00% +4.17% +1.05%
Number of hourly rates quoted 36 29 56
10th Percentile £11.00 £15.99 £15.55
25th Percentile £19.06 £20.50 £20.00
Median hourly rate £28.31 £27.50 £25.10
Median % change year-on-year +2.95% +9.58% -16.35%
75th Percentile £44.78 £39.25 £44.06
90th Percentile £57.72 £49.20 £51.63
England median hourly rate £26.25 £25.00 £30.00
% change year-on-year +5.00% -16.67% -

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 1 August 2021.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 1 August 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -20 94 £600 +9.09% 69
South London +22 13 £450 -15.69% 3
West London +2 11 £590 +15.12% 17
East London 0 1 - - 7
North London - 1 - -
Big Data
England

For the 6 months to 1 August 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 339 (35.39%) Python
2 331 (34.55%) Apache Spark
3 330 (34.45%) Agile Software Development
4 316 (32.99%) SQL
5 303 (31.63%) Analytics
6 289 (30.17%) AWS
7 287 (29.96%) Azure
8 276 (28.81%) Hadoop
9 267 (27.87%) Finance
10 237 (24.74%) DevOps
11 233 (24.32%) Java
12 228 (23.80%) Social Skills
13 207 (21.61%) Kafka
14 189 (19.73%) Data Modelling
15 183 (19.10%) GCP
16 182 (19.00%) Scala
17 180 (18.79%) Data Warehouse
18 163 (17.01%) Apache Hive
19 158 (16.49%) Banking
20 154 (16.08%) Kubernetes
21 149 (15.55%) Docker
22 147 (15.34%) ETL
23 134 (13.99%) Business Intelligence
24 126 (13.15%) Data Pipeline
25 125 (13.05%) Data Science
26 124 (12.94%) Databricks
27 116 (12.11%) Data Lake
28 114 (11.90%) Oracle
29 112 (11.69%) Google
30 111 (11.59%) Scrum

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 331 (34.55%) Apache Spark
2 100 (10.44%) Apache
3 67 (6.99%) Apache Airflow
4 29 (3.03%) Elasticsearch
5 25 (2.61%) Luigi
6 23 (2.40%) Confluence
7 20 (2.09%) Oracle Coherence
8 16 (1.67%) SAS
9 10 (1.04%) Apache Pig
9 10 (1.04%) Tomcat
10 5 (0.52%) Oracle Workflow
11 4 (0.42%) CMS
12 3 (0.31%) Apache Solr
12 3 (0.31%) Jupyter
12 3 (0.31%) SharePoint
12 3 (0.31%) WordPress
13 1 (0.10%) IBM HTTP Server
13 1 (0.10%) nginx
13 1 (0.10%) Oracle SOA Suite
13 1 (0.10%) Sitecore CMS
Applications
1 6 (0.63%) Microsoft Office
2 5 (0.52%) Microsoft Excel
3 2 (0.21%) Microsoft PowerPoint
3 2 (0.21%) Spreadsheet
3 2 (0.21%) SPSS
4 1 (0.10%) Microsoft Project
Business Applications
1 2 (0.21%) NetSuite
1 2 (0.21%) Oracle BPM
1 2 (0.21%) Oracle EBS
2 1 (0.10%) Oracle ERP
2 1 (0.10%) Oracle Payables
2 1 (0.10%) Oracle Receivables
2 1 (0.10%) SAP ERP
2 1 (0.10%) SAP MDG
2 1 (0.10%) SAP MDM
2 1 (0.10%) SAP R/3
2 1 (0.10%) SAP S/4HANA
2 1 (0.10%) Sentinel
Cloud Services
1 289 (30.17%) AWS
2 287 (29.96%) Azure
3 183 (19.10%) GCP
4 107 (11.17%) Serverless
5 62 (6.47%) Power Platform
6 51 (5.32%) Azure Data Factory
7 50 (5.22%) PaaS
8 47 (4.91%) AWS Lambda
9 46 (4.80%) Amazon S3
10 45 (4.70%) IaaS
11 39 (4.07%) Azure Cosmos DB
12 32 (3.34%) Amazon EMR
12 32 (3.34%) Azure Functions
13 28 (2.92%) Azure Synapse Analytics
14 22 (2.30%) Snowflake
15 21 (2.19%) Amazon EC2
16 17 (1.77%) GitHub
17 14 (1.46%) Amazon EKS
17 14 (1.46%) Cloud Computing
18 12 (1.25%) Amazon Kinesis
Communications & Networking
1 16 (1.67%) Firewall
2 10 (1.04%) HTTP
3 7 (0.73%) Internet
4 6 (0.63%) FTP
4 6 (0.63%) SAN
5 4 (0.42%) Network Security
6 3 (0.31%) Remote Desktop
7 2 (0.21%) Intranet
7 2 (0.21%) Intrusion Detection
7 2 (0.21%) SMTP
7 2 (0.21%) Wireless
8 1 (0.10%) Cisco ASA
8 1 (0.10%) ICMP
8 1 (0.10%) MPLS
8 1 (0.10%) NAS
8 1 (0.10%) SSL
8 1 (0.10%) TCP/IP
8 1 (0.10%) TETRA
8 1 (0.10%) VLAN
8 1 (0.10%) Wireshark
Database & Business Intelligence
1 276 (28.81%) Hadoop
2 180 (18.79%) Data Warehouse
3 163 (17.01%) Apache Hive
4 116 (12.11%) Data Lake
5 110 (11.48%) NoSQL
6 86 (8.98%) Relational Database
7 85 (8.87%) PostgreSQL
8 78 (8.14%) Metadata
9 75 (7.83%) BigQuery
10 68 (7.10%) SQL Server
11 57 (5.95%) Power BI
12 55 (5.74%) MongoDB
13 52 (5.43%) Tableau
14 48 (5.01%) Apache Cassandra
15 44 (4.59%) HBase
16 28 (2.92%) Looker
16 28 (2.92%) Parquet
17 27 (2.82%) Data Mining
18 26 (2.71%) Spark SQL
19 25 (2.61%) Amazon Redshift
Development Applications
1 86 (8.98%) Git (software)
2 84 (8.77%) Jenkins
3 50 (5.22%) JIRA
4 40 (4.18%) PowerDesigner
5 31 (3.24%) Maven
6 25 (2.61%) TeamCity
7 21 (2.19%) kappa
8 18 (1.88%) Bitbucket
8 18 (1.88%) GitLab
9 17 (1.77%) Visual Studio Team System
10 15 (1.57%) Subversion
11 14 (1.46%) IntelliJ
12 12 (1.25%) Artifactory
12 12 (1.25%) Sonatype Nexus
13 11 (1.15%) Hudson
14 10 (1.04%) Cucumber
15 8 (0.84%) ERwin
15 8 (0.84%) Selenium
16 7 (0.73%) Gatling
17 6 (0.63%) IBM UrbanCode
General
1 267 (27.87%) Finance
2 228 (23.80%) Social Skills
3 158 (16.49%) Banking
4 104 (10.86%) Analytical Skills
5 52 (5.43%) Investment Banking
6 38 (3.97%) Presentation Skills
7 29 (3.03%) Marketing
8 24 (2.51%) Public Sector
8 24 (2.51%) Retail
9 23 (2.40%) Front Office
10 15 (1.57%) Influencing Skills
10 15 (1.57%) Telecoms
11 14 (1.46%) Documentation Skills
12 13 (1.36%) Legal
13 11 (1.15%) Games
14 8 (0.84%) Financial Institution
14 8 (0.84%) Multimedia
15 5 (0.52%) French Language
15 5 (0.52%) Retail Banking
16 4 (0.42%) Electronics
Job Titles
1 231 (24.11%) Data Engineer
2 197 (20.56%) Architect
3 179 (18.68%) Developer
4 120 (12.53%) Data Architect
5 85 (8.87%) Big Data Engineer
6 80 (8.35%) Solutions Architect
7 62 (6.47%) DevOps Engineer
8 46 (4.80%) Scala Developer
9 42 (4.38%) AWS Engineer
9 42 (4.38%) Azure Architect
10 35 (3.65%) Cloud Architect
10 35 (3.65%) Java Developer
10 35 (3.65%) Software Engineer
11 33 (3.44%) Senior Developer
12 32 (3.34%) Analyst
13 30 (3.13%) Big Data Developer
14 29 (3.03%) Azure Engineer
15 25 (2.61%) Data Scientist
16 24 (2.51%) Python Developer
17 23 (2.40%) AWS Architect
Libraries, Frameworks & Software Standards
1 207 (21.61%) Kafka
2 61 (6.37%) PySpark
3 37 (3.86%) Spring
4 34 (3.55%) JSON
4 34 (3.55%) Web Services
5 31 (3.24%) .NET
6 28 (2.92%) Apache NiFi
6 28 (2.92%) RESTful
7 25 (2.61%) Velocity
8 23 (2.40%) Akka
8 23 (2.40%) Apache Avro
9 22 (2.30%) Spark Streaming
10 20 (2.09%) REST
11 17 (1.77%) Spring Boot
11 17 (1.77%) XML
12 16 (1.67%) Play Framework
13 15 (1.57%) AngularJS
13 15 (1.57%) Node.js
14 14 (1.46%) NumPy
15 13 (1.36%) OAuth
Miscellaneous
1 61 (6.37%) Data Structures
2 43 (4.49%) Algorithms
3 36 (3.76%) Virtual Team
4 31 (3.24%) Cloud Native
5 29 (3.03%) Data Centre
6 26 (2.71%) Market Risk
7 25 (2.61%) Data Protection Act
8 17 (1.77%) Legacy Applications
9 16 (1.67%) Management Information System
10 15 (1.57%) Greenfield Project
11 14 (1.46%) Hybrid Cloud
11 14 (1.46%) Self-Motivation
12 12 (1.25%) Legacy Systems
13 10 (1.04%) Reference Data
14 9 (0.94%) User Experience
15 8 (0.84%) Enterprise Software
15 8 (0.84%) Equities
15 8 (0.84%) Fixed Income
15 8 (0.84%) Linux Command Line
15 8 (0.84%) Public Cloud
Operating Systems
1 101 (10.54%) Linux
2 45 (4.70%) Unix
3 13 (1.36%) Windows
4 12 (1.25%) Red Hat Enterprise Linux
5 3 (0.31%) VMS
6 2 (0.21%) AIX
6 2 (0.21%) HPUX
6 2 (0.21%) Solaris
6 2 (0.21%) SUSE Linux Enterprise Server
6 2 (0.21%) Ubuntu
7 1 (0.10%) MVS
Processes & Methodologies
1 330 (34.45%) Agile Software Development
2 303 (31.63%) Analytics
3 237 (24.74%) DevOps
4 189 (19.73%) Data Modelling
5 147 (15.34%) ETL
6 134 (13.99%) Business Intelligence
7 126 (13.15%) Data Pipeline
8 125 (13.05%) Data Science
9 111 (11.59%) Scrum
10 110 (11.48%) Data Architecture
11 106 (11.06%) Data Management
12 105 (10.96%) Data Engineering
13 98 (10.23%) Software Engineering
14 97 (10.13%) Artificial Intelligence
15 95 (9.92%) Machine Learning
16 94 (9.81%) Migration
17 93 (9.71%) Data Analytics
18 87 (9.08%) Microservices
19 85 (8.87%) Visualisation
20 83 (8.66%) SDLC
Programming Languages
1 339 (35.39%) Python
2 316 (32.99%) SQL
3 233 (24.32%) Java
4 182 (19.00%) Scala
5 40 (4.18%) C#
6 37 (3.86%) R
7 33 (3.44%) Bash Shell
8 30 (3.13%) JavaScript
9 28 (2.92%) PL/SQL
10 25 (2.61%) Go
11 21 (2.19%) C++
12 19 (1.98%) Groovy
13 18 (1.88%) Shell Script
14 17 (1.77%) C
14 17 (1.77%) Ruby
15 15 (1.57%) PowerShell
16 14 (1.46%) Java 8
17 12 (1.25%) Kotlin
18 9 (0.94%) PHP
19 7 (0.73%) TypeScript
Qualifications
1 70 (7.31%) Security Cleared
2 64 (6.68%) Degree
3 54 (5.64%) SC Cleared
4 31 (3.24%) Computer Science Degree
4 31 (3.24%) DV Cleared
5 8 (0.84%) Master's Degree
6 7 (0.73%) AWS Certification
7 6 (0.63%) PhD
8 3 (0.31%) CISM
8 3 (0.31%) CISSP
8 3 (0.31%) TOGAF Certification
9 2 (0.21%) ISEB
9 2 (0.21%) OCP
9 2 (0.21%) Oracle Certification
9 2 (0.21%) SAS Certification
10 1 (0.10%) CCA
10 1 (0.10%) Cisco Certification
10 1 (0.10%) GIAC
10 1 (0.10%) PMI Certification
10 1 (0.10%) PMP
Quality Assurance & Compliance
1 67 (6.99%) Data Quality
2 34 (3.55%) QA
3 13 (1.36%) GDPR
3 13 (1.36%) IFRS
4 8 (0.84%) Sarbanes-Oxley
4 8 (0.84%) SLA
5 7 (0.73%) PMO
6 4 (0.42%) IFRS 9
7 3 (0.31%) ISO 20022
7 3 (0.31%) MiFID
8 2 (0.21%) COBIT
8 2 (0.21%) ISO/IEC 27001
8 2 (0.21%) NIST
9 1 (0.10%) Dodd-Frank
9 1 (0.10%) EMIR
9 1 (0.10%) NCSC
System Software
1 149 (15.55%) Docker
2 40 (4.18%) HDFS
3 21 (2.19%) Active Directory
4 7 (0.73%) VMware Infrastructure
5 4 (0.42%) Apache Flume
5 4 (0.42%) Apache ZooKeeper
6 3 (0.31%) Oracle RAC
7 2 (0.21%) Platform Symphony
Systems Management
1 154 (16.08%) Kubernetes
2 106 (11.06%) Terraform
3 87 (9.08%) Ansible
4 22 (2.30%) Oozie
5 21 (2.19%) Puppet
6 17 (1.77%) Hadoop YARN
7 10 (1.04%) Control-M
7 10 (1.04%) Single Sign-On
8 9 (0.94%) Kibana
9 8 (0.84%) Ambari
9 8 (0.84%) Docker Swarm
9 8 (0.84%) Opscode Chef
10 7 (0.73%) logstash
10 7 (0.73%) Prometheus
11 5 (0.52%) Grafana
12 4 (0.42%) Istio
12 4 (0.42%) Rancher
13 3 (0.31%) MIIS
14 2 (0.21%) Oracle RMAN
14 2 (0.21%) Tivoli
Vendors
1 124 (12.94%) Databricks
2 114 (11.90%) Oracle
3 112 (11.69%) Google
4 84 (8.77%) Microsoft
5 70 (7.31%) Cloudera
6 37 (3.86%) BiZZdesign
7 32 (3.34%) Hortonworks
8 31 (3.24%) SAP
9 29 (3.03%) Informatica
10 27 (2.82%) IBM
11 23 (2.40%) Salesforce.com
12 22 (2.30%) Teradata
13 19 (1.98%) VMware
14 14 (1.46%) Ab Initio
14 14 (1.46%) MuleSoft
15 13 (1.36%) Alteryx
16 12 (1.25%) MapR
17 11 (1.15%) Red Hat
18 9 (0.94%) Confluent
19 7 (0.73%) Splunk