Period
to 24 October 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 24 October 2021 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
24 Oct 2021
Same period 2020 Same period 2019
Rank 57 48 54
Rank change year-on-year -9 +6 +6
Permanent jobs citing Big Data 280 191 482
As % of all permanent jobs advertised in the City of London 4.72% 5.30% 4.82%
As % of the Database & Business Intelligence category 15.73% 19.08% 15.74%
Number of salaries quoted 264 157 432
10th Percentile £52,500 £44,500 £51,250
25th Percentile £65,000 £57,500 £63,750
Median annual salary (50th Percentile) £82,500 £75,000 £77,500
Median % change year-on-year +10.00% -3.23% +3.33%
75th Percentile £95,000 £100,000 £97,500
90th Percentile £110,000 £107,750 £112,500
Central London median annual salary £80,000 £72,500 £75,000
% change year-on-year +10.34% -3.33% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,780 1,001 3,062
As % of all permanent IT jobs advertised in the City of London 29.98% 27.75% 30.61%
Number of salaries quoted 1,578 836 2,744
10th Percentile £46,250 £42,500 £42,875
25th Percentile £56,250 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £95,000 £85,500 £85,000
90th Percentile £108,750 £100,000 £100,000
Central London median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% -

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

Salary distribution for jobs citing Big Data in the City of London over the 6 months to 24 October 2021.

Salary histogram for Big Data in the City of London

For the 6 months to 24 October 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 154 (55.00%) Java
2 122 (43.57%) Hadoop
3 114 (40.71%) Agile Software Development
4 98 (35.00%) Analytics
5 94 (33.57%) Apache Spark
6 88 (31.43%) AWS
7 84 (30.00%) SQL
8 83 (29.64%) Python
9 71 (25.36%) Kafka
10 60 (21.43%) Kubernetes
11 57 (20.36%) Data Warehouse
12 52 (18.57%) Azure
13 50 (17.86%) Software Engineering
13 50 (17.86%) DevOps
14 49 (17.50%) Data Science
15 48 (17.14%) Multithreading
16 46 (16.43%) Scala
16 46 (16.43%) MongoDB
16 46 (16.43%) Finance
16 46 (16.43%) Microservices
17 43 (15.36%) Data Lake
18 42 (15.00%) Data Modelling
19 41 (14.64%) Data Pipeline
20 38 (13.57%) Data Quality
21 37 (13.21%) NoSQL
21 37 (13.21%) GCP
22 36 (12.86%) Data Engineering
23 35 (12.50%) Amazon Redshift
23 35 (12.50%) ETL
24 34 (12.14%) Business Intelligence

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 94 (33.57%) Apache Spark
2 28 (10.00%) Elasticsearch
3 18 (6.43%) Apache
4 8 (2.86%) Apache Airflow
5 3 (1.07%) Apache Pig
6 2 (0.71%) OpenStack
7 1 (0.36%) Apache Pulsar
7 1 (0.36%) Confluence
7 1 (0.36%) GemFire
7 1 (0.36%) nginx
Applications
1 7 (2.50%) Microsoft Excel
2 2 (0.71%) Chatbot
3 1 (0.36%) Spreadsheet
Business Applications
1 1 (0.36%) Distributed Ledger
Cloud Services
1 88 (31.43%) AWS
2 52 (18.57%) Azure
3 37 (13.21%) GCP
4 22 (7.86%) Snowflake
5 20 (7.14%) Power Platform
6 18 (6.43%) SaaS
7 12 (4.29%) Amazon EC2
8 6 (2.14%) PaaS
9 5 (1.79%) AWS Data Pipeline
9 5 (1.79%) AWS Step Functions
9 5 (1.79%) IaaS
9 5 (1.79%) Serverless
10 4 (1.43%) Amazon S3
10 4 (1.43%) AWS CloudFormation
10 4 (1.43%) Azure Data Factory
11 3 (1.07%) Amazon EMR
11 3 (1.07%) Amazon SageMaker
11 3 (1.07%) Amazon SQS
11 3 (1.07%) AWS Lambda
11 3 (1.07%) Cloud Computing
Communications & Networking
1 8 (2.86%) HTTP
2 3 (1.07%) Broadband
3 1 (0.36%) 5G
3 1 (0.36%) DNS
3 1 (0.36%) Firewall
3 1 (0.36%) Internet
3 1 (0.36%) VLAN
Database & Business Intelligence
1 122 (43.57%) Hadoop
2 57 (20.36%) Data Warehouse
3 46 (16.43%) MongoDB
4 43 (15.36%) Data Lake
5 37 (13.21%) NoSQL
6 35 (12.50%) Amazon Redshift
7 31 (11.07%) Apache Cassandra
8 28 (10.00%) Relational Database
9 23 (8.21%) Flink
10 20 (7.14%) Power BI
11 18 (6.43%) BigQuery
12 17 (6.07%) Amazon RDS
12 17 (6.07%) Apache Hive
12 17 (6.07%) Tableau
13 16 (5.71%) MySQL
14 13 (4.64%) PostgreSQL
14 13 (4.64%) SQL Server
15 9 (3.21%) Metadata
16 7 (2.50%) OLTP
16 7 (2.50%) Spark SQL
Development Applications
1 14 (5.00%) Jenkins
2 13 (4.64%) Atlassian Bamboo
3 12 (4.29%) JIRA
4 8 (2.86%) Git (software)
5 7 (2.50%) ER Studio
5 7 (2.50%) ERwin
5 7 (2.50%) Gradle
5 7 (2.50%) JMeter
5 7 (2.50%) JUnit
5 7 (2.50%) PowerDesigner
5 7 (2.50%) Subversion
6 5 (1.79%) REST Assured
6 5 (1.79%) Toad
6 5 (1.79%) TortoiseSVN
7 4 (1.43%) Selenium
7 4 (1.43%) WebDriver
8 2 (0.71%) GitLab
9 1 (0.36%) Bitbucket
9 1 (0.36%) Cypress.io
9 1 (0.36%) Travis CI
General
1 46 (16.43%) Finance
2 20 (7.14%) Advertising
3 19 (6.79%) Social Skills
4 17 (6.07%) Publishing
5 16 (5.71%) Analytical Skills
6 12 (4.29%) Public Sector
7 10 (3.57%) Law
8 7 (2.50%) Retail
9 6 (2.14%) Banking
10 5 (1.79%) Front Office
11 4 (1.43%) Investment Banking
11 4 (1.43%) Presentation Skills
12 3 (1.07%) Pharmaceutical
13 2 (0.71%) Documentation Skills
13 2 (0.71%) Mandarin Language
14 1 (0.36%) Financial Institution
14 1 (0.36%) Influencing Skills
Job Titles
1 70 (25.00%) Data Engineer
2 69 (24.64%) Developer
3 52 (18.57%) Java Developer
4 42 (15.00%) Big Data Engineer
5 30 (10.71%) Java Engineer
6 26 (9.29%) Senior Developer
6 26 (9.29%) Senior Java Developer
7 25 (8.93%) Architect
8 20 (7.14%) Analyst
9 17 (6.07%) AWS Engineer
10 16 (5.71%) Principal Engineer
11 15 (5.36%) Senior Data Engineer
12 14 (5.00%) Software Engineer
13 13 (4.64%) Consultant
13 13 (4.64%) Data Analyst
14 12 (4.29%) Data Architect
14 12 (4.29%) Java Software Engineer
15 11 (3.93%) Apache Spark Developer
15 11 (3.93%) Data Analytics Engineer
15 11 (3.93%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 71 (25.36%) Kafka
2 26 (9.29%) Node.js
2 26 (9.29%) React
3 21 (7.50%) GraphQL
4 20 (7.14%) Apollo GraphQL
4 20 (7.14%) Redux
5 18 (6.43%) ActiveMQ
5 18 (6.43%) JMS
6 12 (4.29%) Apache Thrift
7 11 (3.93%) Akka
8 10 (3.57%) AngularJS
8 10 (3.57%) Web Services
9 8 (2.86%) REST
9 8 (2.86%) Spring
10 7 (2.50%) JSON
11 5 (1.79%) Lucene
11 5 (1.79%) Protocol Buffers
12 4 (1.43%) RESTful
13 3 (1.07%) CSS
13 3 (1.07%) HTML5
Miscellaneous
1 22 (7.86%) User Experience
2 18 (6.43%) Self-Motivation
3 13 (4.64%) Greenfield Project
4 8 (2.86%) Data Centre
5 6 (2.14%) Algorithms
6 5 (1.79%) Cloud Native
6 5 (1.79%) Data Structures
7 3 (1.07%) Enterprise Software
7 3 (1.07%) Equities
7 3 (1.07%) Private Cloud
7 3 (1.07%) Reinsurance
8 2 (0.71%) Derivative
8 2 (0.71%) Enterprise Cloud
8 2 (0.71%) Mobile App
8 2 (0.71%) Public Cloud
9 1 (0.36%) Analytical Mindset
9 1 (0.36%) Market Risk
9 1 (0.36%) Media Streaming
9 1 (0.36%) Renewable Energy
9 1 (0.36%) Virtual Team
Operating Systems
1 12 (4.29%) Linux
2 7 (2.50%) Unix
3 1 (0.36%) CentOS
3 1 (0.36%) Windows
Processes & Methodologies
1 114 (40.71%) Agile Software Development
2 98 (35.00%) Analytics
3 50 (17.86%) DevOps
3 50 (17.86%) Software Engineering
4 49 (17.50%) Data Science
5 48 (17.14%) Multithreading
6 46 (16.43%) Microservices
7 42 (15.00%) Data Modelling
8 41 (14.64%) Data Pipeline
9 36 (12.86%) Data Engineering
10 35 (12.50%) ETL
11 34 (12.14%) Business Intelligence
12 33 (11.79%) Data Architecture
13 27 (9.64%) Fintech
13 27 (9.64%) OO
14 26 (9.29%) Migration
15 25 (8.93%) Computer Science
15 25 (8.93%) Data Management
16 24 (8.57%) Artificial Intelligence
17 21 (7.50%) Data Analysis
Programming Languages
1 154 (55.00%) Java
2 84 (30.00%) SQL
3 83 (29.64%) Python
4 46 (16.43%) Scala
5 25 (8.93%) TypeScript
6 21 (7.50%) C#
6 21 (7.50%) Java 8
7 15 (5.36%) JavaScript
7 15 (5.36%) R
8 8 (2.86%) Bash Shell
8 8 (2.86%) C++
9 6 (2.14%) Clojure
9 6 (2.14%) Go
9 6 (2.14%) MATLAB
10 5 (1.79%) PHP
11 4 (1.43%) Perl
11 4 (1.43%) Ruby
11 4 (1.43%) T-SQL
12 3 (1.07%) ES6
12 3 (1.07%) Kotlin
Qualifications
1 22 (7.86%) Degree
2 14 (5.00%) SC Cleared
2 14 (5.00%) Security Cleared
3 7 (2.50%) Computer Science Degree
4 6 (2.14%) Master's Degree
4 6 (2.14%) PhD
5 3 (1.07%) BPSS Clearance
5 3 (1.07%) DV Cleared
6 1 (0.36%) AWS Certification
6 1 (0.36%) IBM Certification
6 1 (0.36%) Microsoft Certification
Quality Assurance & Compliance
1 38 (13.57%) Data Quality
2 22 (7.86%) QA
3 1 (0.36%) GDPR
System Software
1 32 (11.43%) Docker
2 6 (2.14%) Apache ZooKeeper
3 3 (1.07%) HDFS
4 2 (0.71%) Apache Flume
5 1 (0.36%) Virtual Machines
5 1 (0.36%) VMware Infrastructure
Systems Management
1 60 (21.43%) Kubernetes
2 20 (7.14%) Terraform
3 10 (3.57%) Ansible
4 7 (2.50%) Puppet
5 2 (0.71%) Grafana
5 2 (0.71%) HAProxy
5 2 (0.71%) Prometheus
6 1 (0.36%) Docker Swarm
6 1 (0.36%) Graphite
6 1 (0.36%) Opscode Chef
6 1 (0.36%) Salt
Vendors
1 24 (8.57%) Oracle
2 17 (6.07%) Databricks
3 15 (5.36%) Talend
4 13 (4.64%) Microsoft
5 10 (3.57%) Cloudera
5 10 (3.57%) Informatica
6 9 (3.21%) Google
6 9 (3.21%) IBM
7 8 (2.86%) SAP
8 5 (1.79%) Alteryx
9 3 (1.07%) Salesforce.com
10 2 (0.71%) Splunk
11 1 (0.36%) F5
11 1 (0.36%) Greenplum
11 1 (0.36%) Palantir
11 1 (0.36%) VMware