Period
to 21 October 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 21 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
21 Oct 2021
Same period 2020 Same period 2019
Rank 84 93 63
Rank change year-on-year +9 -30 +13
Contract jobs citing Big Data 1,091 408 1,409
As % of all contract jobs advertised in London 3.04% 2.90% 3.82%
As % of the Database & Business Intelligence category 12.75% 11.51% 15.46%
Number of daily rates quoted 763 280 1,093
10th Percentile £450 £406 £425
25th Percentile £513 £463 £513
Median daily rate (50th Percentile) £600 £550 £575
Median % change year-on-year +9.09% -4.35% +4.55%
75th Percentile £700 £638 £656
90th Percentile £800 £700 £725
England median daily rate £600 £550 £550
% change year-on-year +9.09% - -
Number of hourly rates quoted 7 0 5
10th Percentile £36.25 " £26.06
25th Percentile £39.19 " £42.28
Median hourly rate £48.00 - £49.13
75th Percentile £61.25 " £50.00
90th Percentile £65.00 " "
England median hourly rate £46.13 £19.75 £49.93
% change year-on-year +133.54% -60.44% +18.18%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,554 3,545 9,112
As % of all contract IT jobs advertised in London 23.84% 25.18% 24.73%
Number of daily rates quoted 6,239 2,546 6,713
10th Percentile £394 £356 £363
25th Percentile £465 £425 £425
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - -
75th Percentile £671 £625 £610
90th Percentile £738 £713 £698
England median daily rate £525 £500 £480
% change year-on-year +5.00% +4.17% +1.05%
Number of hourly rates quoted 43 21 52
10th Percentile £15.84 £20.00 £15.27
25th Percentile £24.50 £27.00 £20.25
Median hourly rate £32.50 £37.93 £29.96
Median % change year-on-year -14.30% +26.59% +1.03%
75th Percentile £57.13 £41.50 £44.06
90th Percentile £64.70 £53.75 £51.13
England median hourly rate £34.25 £27.23 £30.00
% change year-on-year +25.78% -9.23% +1.69%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 21 October 2021.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Big Data in London over the 6 months to 21 October 2021.

Hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 21 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -16 100 £625 +13.64% 74
South London +10 17 £450 -14.08% 2
West London -23 12 £570 -2.98% 18
East London - 1 - - 12
North London - 1 - - 4
Big Data
England

For the 6 months to 21 October 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 421 (38.59%) Apache Spark
2 394 (36.11%) Agile Software Development
3 392 (35.93%) Python
4 386 (35.38%) SQL
5 363 (33.27%) Azure
6 357 (32.72%) Analytics
7 327 (29.97%) AWS
8 319 (29.24%) Hadoop
9 309 (28.32%) Finance
10 277 (25.39%) DevOps
11 270 (24.75%) Social Skills
12 265 (24.29%) Java
13 228 (20.90%) Kafka
14 225 (20.62%) Data Modelling
15 212 (19.43%) Data Warehouse
16 198 (18.15%) Scala
17 194 (17.78%) GCP
18 193 (17.69%) ETL
19 191 (17.51%) Banking
20 183 (16.77%) Apache Hive
21 182 (16.68%) Business Intelligence
22 158 (14.48%) NoSQL
23 155 (14.21%) Data Science
24 152 (13.93%) Kubernetes
25 145 (13.29%) Scrum
26 139 (12.74%) Docker
26 139 (12.74%) Databricks
27 138 (12.65%) Data Pipeline
28 136 (12.47%) Data Lake
29 135 (12.37%) Terraform

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 421 (38.59%) Apache Spark
2 89 (8.16%) Apache
3 66 (6.05%) Apache Airflow
4 44 (4.03%) Confluence
5 36 (3.30%) Elasticsearch
6 30 (2.75%) Luigi
7 18 (1.65%) SAS
8 12 (1.10%) Tomcat
9 9 (0.82%) Apache Pig
10 8 (0.73%) Oracle Coherence
11 5 (0.46%) Jupyter
12 3 (0.27%) CMS
12 3 (0.27%) Moodle
13 2 (0.18%) Apache Solr
13 2 (0.18%) Camunda
13 2 (0.18%) Oracle Workflow
13 2 (0.18%) SharePoint
13 2 (0.18%) WordPress
14 1 (0.092%) MQSeries
14 1 (0.092%) Sitecore CMS
Applications
1 13 (1.19%) Microsoft Excel
2 5 (0.46%) Microsoft Office
3 4 (0.37%) Microsoft PowerPoint
4 2 (0.18%) Spreadsheet
5 1 (0.092%) Chatbot
5 1 (0.092%) Figma
5 1 (0.092%) Microsoft Project
5 1 (0.092%) Sketch
Business Applications
1 5 (0.46%) SAP S/4HANA
2 4 (0.37%) SAP Oil and Gas
3 1 (0.092%) Oracle BPM
3 1 (0.092%) SAP ERP
3 1 (0.092%) SAP PLM
3 1 (0.092%) SAP R/3
3 1 (0.092%) Sentinel
3 1 (0.092%) Workday HCM
Cloud Services
1 363 (33.27%) Azure
2 327 (29.97%) AWS
3 194 (17.78%) GCP
4 95 (8.71%) Serverless
5 91 (8.34%) Power Platform
6 60 (5.50%) Azure Data Factory
7 52 (4.77%) PaaS
8 44 (4.03%) Azure Cosmos DB
8 44 (4.03%) IaaS
9 40 (3.67%) Amazon S3
10 39 (3.57%) Amazon EMR
10 39 (3.57%) Azure Functions
11 37 (3.39%) AWS Lambda
12 33 (3.02%) Azure Synapse Analytics
13 29 (2.66%) GitHub
14 22 (2.02%) Snowflake
15 18 (1.65%) Amazon Kinesis
15 18 (1.65%) Cloud Computing
16 15 (1.37%) Google Data Studio
17 14 (1.28%) Azure Machine Learning
Communications & Networking
1 11 (1.01%) Firewall
2 7 (0.64%) FTP
3 6 (0.55%) HTTP
3 6 (0.55%) SAN
4 5 (0.46%) Internet
5 3 (0.27%) Intranet
5 3 (0.27%) Intrusion Detection
6 2 (0.18%) Broadband
6 2 (0.18%) LAN
6 2 (0.18%) Multicast
6 2 (0.18%) Network Security
6 2 (0.18%) Remote Desktop
6 2 (0.18%) VPN
6 2 (0.18%) WAN
6 2 (0.18%) Wireless
7 1 (0.092%) Skype
7 1 (0.092%) SMTP
7 1 (0.092%) TCP/IP
7 1 (0.092%) TETRA
7 1 (0.092%) VoIP
Database & Business Intelligence
1 319 (29.24%) Hadoop
2 212 (19.43%) Data Warehouse
3 183 (16.77%) Apache Hive
4 158 (14.48%) NoSQL
5 136 (12.47%) Data Lake
6 102 (9.35%) Relational Database
7 99 (9.07%) PostgreSQL
8 86 (7.88%) Power BI
9 84 (7.70%) BigQuery
10 83 (7.61%) Tableau
11 78 (7.15%) SQL Server
12 73 (6.69%) HBase
13 69 (6.32%) Apache Cassandra
14 62 (5.68%) MongoDB
15 61 (5.59%) Metadata
16 44 (4.03%) Amazon Redshift
17 39 (3.57%) RDBMS
18 31 (2.84%) Spark SQL
19 29 (2.66%) Looker
20 28 (2.57%) Amazon Athena
Development Applications
1 117 (10.72%) Jenkins
2 116 (10.63%) Git (software)
3 80 (7.33%) JIRA
4 43 (3.94%) PowerDesigner
5 40 (3.67%) GitLab
6 36 (3.30%) Maven
7 29 (2.66%) TeamCity
8 21 (1.92%) Subversion
9 20 (1.83%) Hudson
9 20 (1.83%) IntelliJ
10 12 (1.10%) Bitbucket
10 12 (1.10%) kappa
10 12 (1.10%) Visual Studio Team System
11 11 (1.01%) Sonatype Nexus
12 9 (0.82%) Cucumber
13 8 (0.73%) Gradle
13 8 (0.73%) IBM UrbanCode
14 7 (0.64%) Atlassian Bamboo
14 7 (0.64%) GoCD
14 7 (0.64%) Mockito
General
1 309 (28.32%) Finance
2 270 (24.75%) Social Skills
3 191 (17.51%) Banking
4 121 (11.09%) Analytical Skills
5 80 (7.33%) Investment Banking
6 58 (5.32%) Presentation Skills
7 32 (2.93%) Public Sector
8 27 (2.47%) Influencing Skills
9 24 (2.20%) Marketing
10 23 (2.11%) Retail
11 19 (1.74%) Front Office
12 18 (1.65%) Games
13 15 (1.37%) Legal
14 14 (1.28%) Financial Institution
15 13 (1.19%) Documentation Skills
16 12 (1.10%) Telecoms
17 7 (0.64%) Aerospace
18 5 (0.46%) Law
18 5 (0.46%) Retail Banking
19 3 (0.27%) Manufacturing
Job Titles
1 275 (25.21%) Data Engineer
2 213 (19.52%) Architect
3 207 (18.97%) Developer
4 119 (10.91%) Data Architect
5 98 (8.98%) Big Data Engineer
6 88 (8.07%) Solutions Architect
7 80 (7.33%) DevOps Engineer
8 58 (5.32%) Java Developer
9 54 (4.95%) Azure Architect
10 44 (4.03%) AWS Engineer
11 43 (3.94%) Analyst
12 40 (3.67%) Azure Engineer
13 33 (3.02%) Scala Developer
13 33 (3.02%) Senior Developer
14 31 (2.84%) Big Data Developer
15 28 (2.57%) Cloud Engineer
15 28 (2.57%) Data Manager
16 27 (2.47%) Data Scientist
17 26 (2.38%) Software Engineer
18 25 (2.29%) Big Data Manager
Libraries, Frameworks & Software Standards
1 228 (20.90%) Kafka
2 81 (7.42%) PySpark
3 45 (4.12%) Spring
4 36 (3.30%) RESTful
4 36 (3.30%) Web Services
5 33 (3.02%) JSON
5 33 (3.02%) Spark Streaming
6 29 (2.66%) .NET
6 29 (2.66%) REST
7 27 (2.47%) Apache Avro
8 26 (2.38%) ARM Templates
9 25 (2.29%) Apache NiFi
10 21 (1.92%) HTML
10 21 (1.92%) Spring Boot
10 21 (1.92%) XML
11 19 (1.74%) Node.js
11 19 (1.74%) YAML
12 18 (1.65%) CSS
12 18 (1.65%) React
13 17 (1.56%) Elastic Stack
Miscellaneous
1 66 (6.05%) Data Structures
2 47 (4.31%) Algorithms
3 37 (3.39%) Data Protection Act
4 36 (3.30%) Virtual Team
5 31 (2.84%) Cloud Native
6 27 (2.47%) Data Centre
7 20 (1.83%) Market Risk
8 17 (1.56%) Legacy Applications
8 17 (1.56%) Management Information System
9 14 (1.28%) Legacy Systems
9 14 (1.28%) Public Cloud
10 13 (1.19%) Hybrid Cloud
11 12 (1.10%) Fixed Income
12 11 (1.01%) Foreign Exchange (FX)
12 11 (1.01%) Greenfield Project
12 11 (1.01%) User Experience
13 10 (0.92%) Reference Data
14 9 (0.82%) Enterprise Software
14 9 (0.82%) Self-Motivation
15 8 (0.73%) Equities
Operating Systems
1 119 (10.91%) Linux
2 54 (4.95%) Unix
3 13 (1.19%) Windows
4 11 (1.01%) Red Hat Enterprise Linux
5 7 (0.64%) VMS
6 2 (0.18%) Ubuntu
7 1 (0.092%) Apple iOS
Processes & Methodologies
1 394 (36.11%) Agile Software Development
2 357 (32.72%) Analytics
3 277 (25.39%) DevOps
4 225 (20.62%) Data Modelling
5 193 (17.69%) ETL
6 182 (16.68%) Business Intelligence
7 155 (14.21%) Data Science
8 145 (13.29%) Scrum
9 138 (12.65%) Data Pipeline
10 135 (12.37%) Data Engineering
11 124 (11.37%) Data Management
12 122 (11.18%) Machine Learning
13 115 (10.54%) Data Architecture
14 113 (10.36%) Artificial Intelligence
15 109 (9.99%) Visualisation
16 100 (9.17%) Data Analytics
17 97 (8.89%) Stakeholder Management
18 96 (8.80%) Migration
19 90 (8.25%) Microservices
20 81 (7.42%) Data Integration
Programming Languages
1 392 (35.93%) Python
2 386 (35.38%) SQL
3 265 (24.29%) Java
4 198 (18.15%) Scala
5 51 (4.67%) R
6 47 (4.31%) JavaScript
7 40 (3.67%) C#
8 39 (3.57%) PL/SQL
9 33 (3.02%) Bash Shell
10 30 (2.75%) Go
11 28 (2.57%) Shell Script
12 23 (2.11%) PowerShell
13 19 (1.74%) C++
13 19 (1.74%) Java 8
14 18 (1.65%) Ruby
15 16 (1.47%) C
16 15 (1.37%) Groovy
17 14 (1.28%) Kotlin
18 13 (1.19%) T-SQL
19 12 (1.10%) PHP
Qualifications
1 67 (6.14%) Degree
2 58 (5.32%) Security Cleared
3 42 (3.85%) SC Cleared
4 31 (2.84%) Computer Science Degree
5 21 (1.92%) DV Cleared
6 12 (1.10%) AWS Certification
7 8 (0.73%) Master's Degree
8 5 (0.46%) Microsoft Certification
8 5 (0.46%) OCP
8 5 (0.46%) Oracle Certification
9 4 (0.37%) BPSS Clearance
9 4 (0.37%) PhD
10 3 (0.27%) SAS Certification
10 3 (0.27%) TOGAF Certification
11 2 (0.18%) ISEB
12 1 (0.092%) CCA
12 1 (0.092%) CISM
12 1 (0.092%) CISSP
12 1 (0.092%) PMP
12 1 (0.092%) Postgraduate
Quality Assurance & Compliance
1 84 (7.70%) Data Quality
2 29 (2.66%) QA
3 27 (2.47%) GDPR
4 11 (1.01%) PMO
5 10 (0.92%) IFRS
6 8 (0.73%) Sarbanes-Oxley
7 6 (0.55%) NCSC
8 4 (0.37%) Accessibility
8 4 (0.37%) MiFID
8 4 (0.37%) SLA
9 3 (0.27%) ISO 20022
10 2 (0.18%) COBIT
10 2 (0.18%) IFRS 9
10 2 (0.18%) ISO/IEC 27001
10 2 (0.18%) NIST
11 1 (0.092%) Dodd-Frank
11 1 (0.092%) EMIR
System Software
1 139 (12.74%) Docker
2 52 (4.77%) HDFS
3 26 (2.38%) Active Directory
4 7 (0.64%) Apache ZooKeeper
4 7 (0.64%) VMware Infrastructure
5 6 (0.55%) Oracle RAC
6 3 (0.27%) Apache Flume
7 2 (0.18%) Active Directory Lightweight Directory Services
8 1 (0.092%) Platform Symphony
Systems Management
1 152 (13.93%) Kubernetes
2 135 (12.37%) Terraform
3 106 (9.72%) Ansible
4 25 (2.29%) Oozie
5 22 (2.02%) Puppet
6 20 (1.83%) Hadoop YARN
7 17 (1.56%) Kibana
8 12 (1.10%) Single Sign-On
9 10 (0.92%) Control-M
10 9 (0.82%) Docker Swarm
10 9 (0.82%) logstash
11 8 (0.73%) Grafana
11 8 (0.73%) Opscode Chef
12 7 (0.64%) Ambari
12 7 (0.64%) Prometheus
13 5 (0.46%) Data Guard
13 5 (0.46%) Istio
13 5 (0.46%) Oracle RMAN
14 2 (0.18%) WebInspect
14 2 (0.18%) ZABBIX
Vendors
1 139 (12.74%) Databricks
2 122 (11.18%) Google
3 109 (9.99%) Oracle
4 103 (9.44%) Microsoft
5 74 (6.78%) Cloudera
6 59 (5.41%) Hortonworks
7 38 (3.48%) Salesforce.com
8 37 (3.39%) BiZZdesign
9 32 (2.93%) Informatica
10 31 (2.84%) Ab Initio
10 31 (2.84%) SAP
10 31 (2.84%) Teradata
11 26 (2.38%) IBM
12 18 (1.65%) MapR
13 15 (1.37%) Red Hat
13 15 (1.37%) Splunk
13 15 (1.37%) VMware
14 12 (1.10%) Confluent
15 10 (0.92%) AppDynamics
16 9 (0.82%) MuleSoft