Period
to 29 July 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 29 July 2021 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
29 Jul 2021
Same period 2020 Same period 2019
Rank 54 62 55
Rank change year-on-year +8 -7 +7
Permanent jobs citing Big Data 284 214 509
As % of all permanent jobs advertised in the City of London 5.08% 4.01% 4.97%
As % of the Database & Business Intelligence category 17.60% 16.59% 15.56%
Number of salaries quoted 276 178 455
10th Percentile £52,500 £41,250 £51,750
25th Percentile £60,000 £52,813 £61,250
Median annual salary (50th Percentile) £83,750 £72,500 £77,500
Median % change year-on-year +15.52% -6.45% +3.33%
75th Percentile £95,000 £91,250 £94,375
90th Percentile £110,000 £107,375 £112,500
Central London median annual salary £80,000 £73,250 £75,000
% change year-on-year +9.22% -2.33% +3.45%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,614 1,290 3,272
As % of all permanent IT jobs advertised in the City of London 28.88% 24.16% 31.96%
Number of salaries quoted 1,428 1,113 2,959
10th Percentile £45,000 £42,500 £42,500
25th Percentile £53,750 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £91,563 £85,000 £85,000
90th Percentile £108,750 £96,250 £100,000
Central London median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

Salary distribution for jobs citing Big Data in the City of London over the 6 months to 29 July 2021.

Salary histogram for Big Data in the City of London

For the 6 months to 29 July 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 165 (58.10%) Java
2 151 (53.17%) Hadoop
3 99 (34.86%) Agile Software Development
3 99 (34.86%) Apache Spark
4 97 (34.15%) Analytics
5 87 (30.63%) Kubernetes
6 82 (28.87%) SQL
7 78 (27.46%) Python
7 78 (27.46%) Kafka
8 75 (26.41%) AWS
9 67 (23.59%) Software Engineering
10 60 (21.13%) Microservices
11 59 (20.77%) DevOps
12 54 (19.01%) Docker
13 49 (17.25%) Finance
14 47 (16.55%) Azure
15 46 (16.20%) Data Engineering
15 46 (16.20%) GCP
16 45 (15.85%) NoSQL
17 44 (15.49%) MongoDB
17 44 (15.49%) React
18 43 (15.14%) Amazon Redshift
19 42 (14.79%) TypeScript
20 41 (14.44%) Multithreading
21 38 (13.38%) Open Source
21 38 (13.38%) Data Science
22 37 (13.03%) Node.js
22 37 (13.03%) Artificial Intelligence
23 35 (12.32%) Apache Cassandra
24 34 (11.97%) Scala

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 99 (34.86%) Apache Spark
2 21 (7.39%) Elasticsearch
3 14 (4.93%) Apache
4 10 (3.52%) Apache Airflow
5 3 (1.06%) OpenStack
6 2 (0.70%) Apache Pig
7 1 (0.35%) Apache Pulsar
7 1 (0.35%) Confluence
7 1 (0.35%) GemFire
7 1 (0.35%) Moodle
Applications
1 12 (4.23%) Microsoft Excel
2 11 (3.87%) Spreadsheet
3 1 (0.35%) Chatbot
3 1 (0.35%) Microsoft Office
Business Applications
1 1 (0.35%) Distributed Ledger
Cloud Services
1 75 (26.41%) AWS
2 47 (16.55%) Azure
3 46 (16.20%) GCP
4 22 (7.75%) Power Platform
5 21 (7.39%) SaaS
6 13 (4.58%) Amazon EC2
7 10 (3.52%) Snowflake
8 7 (2.46%) Cloud Computing
9 6 (2.11%) AWS Data Pipeline
10 4 (1.41%) PaaS
11 3 (1.06%) AWS Step Functions
11 3 (1.06%) Azure Data Factory
11 3 (1.06%) IaaS
11 3 (1.06%) Serverless
12 2 (0.70%) Amazon EMR
12 2 (0.70%) Amazon S3
12 2 (0.70%) AWS CloudFormation
12 2 (0.70%) Azure Synapse Analytics
13 1 (0.35%) Amazon SQS
13 1 (0.35%) Google Workspace
Communications & Networking
1 15 (5.28%) HTTP
2 4 (1.41%) Broadband
3 3 (1.06%) 5G
4 1 (0.35%) DNS
4 1 (0.35%) Firewall
4 1 (0.35%) VLAN
Database & Business Intelligence
1 151 (53.17%) Hadoop
2 45 (15.85%) NoSQL
3 44 (15.49%) MongoDB
4 43 (15.14%) Amazon Redshift
5 35 (12.32%) Apache Cassandra
6 34 (11.97%) Data Warehouse
7 32 (11.27%) Data Lake
8 27 (9.51%) Apache Hive
9 24 (8.45%) BigQuery
10 23 (8.10%) Relational Database
11 22 (7.75%) Power BI
12 19 (6.69%) Tableau
13 17 (5.99%) Amazon RDS
14 13 (4.58%) Flink
15 11 (3.87%) MySQL
16 9 (3.17%) PostgreSQL
16 9 (3.17%) SQL Server
17 8 (2.82%) Metadata
18 7 (2.46%) Spark SQL
19 6 (2.11%) OLTP
Development Applications
1 19 (6.69%) Jenkins
2 18 (6.34%) Atlassian Bamboo
3 17 (5.99%) Git (software)
4 12 (4.23%) JIRA
5 11 (3.87%) JMeter
5 11 (3.87%) JUnit
6 8 (2.82%) REST Assured
7 6 (2.11%) ER Studio
7 6 (2.11%) ERwin
7 6 (2.11%) PowerDesigner
8 5 (1.76%) Gradle
8 5 (1.76%) Selenium
8 5 (1.76%) WebDriver
9 4 (1.41%) Subversion
9 4 (1.41%) Toad
9 4 (1.41%) TortoiseSVN
10 3 (1.06%) Cypress.io
11 1 (0.35%) Bitbucket
11 1 (0.35%) Maven
11 1 (0.35%) Team Foundation Server
General
1 49 (17.25%) Finance
2 16 (5.63%) Banking
3 14 (4.93%) Social Skills
4 13 (4.58%) Analytical Skills
5 12 (4.23%) Advertising
6 10 (3.52%) Law
7 7 (2.46%) Front Office
7 7 (2.46%) Influencing Skills
8 6 (2.11%) Public Sector
9 5 (1.76%) Investment Banking
10 4 (1.41%) Presentation Skills
11 3 (1.06%) Documentation Skills
11 3 (1.06%) Inclusion and Diversity
12 2 (0.70%) Marketing
13 1 (0.35%) Retail
Job Titles
1 71 (25.00%) Developer
2 66 (23.24%) Big Data Engineer
3 59 (20.77%) Java Engineer
4 58 (20.42%) Java Developer
5 50 (17.61%) Data Engineer
6 30 (10.56%) Software Engineer
7 26 (9.15%) Cloud Engineer
7 26 (9.15%) Java Software Engineer
8 23 (8.10%) Data Analytics Engineer
9 22 (7.75%) Big Data Software Engineer
9 22 (7.75%) Kubernetes Engineer
10 21 (7.39%) Senior Developer
11 20 (7.04%) Senior Java Developer
12 19 (6.69%) Analyst
12 19 (6.69%) Data Analyst
13 18 (6.34%) AWS Engineer
14 15 (5.28%) Architect
15 14 (4.93%) Hadoop Engineer
16 13 (4.58%) Consultant
17 10 (3.52%) SQL Data Analyst
Libraries, Frameworks & Software Standards
1 78 (27.46%) Kafka
2 44 (15.49%) React
3 37 (13.03%) Node.js
4 27 (9.51%) GraphQL
5 24 (8.45%) Apollo GraphQL
5 24 (8.45%) Redux
6 22 (7.75%) AngularJS
7 20 (7.04%) ActiveMQ
7 20 (7.04%) JMS
8 16 (5.63%) Apache Thrift
8 16 (5.63%) CSS
8 16 (5.63%) HTML
8 16 (5.63%) RESTful
9 15 (5.28%) HTML5
10 12 (4.23%) REST
10 12 (4.23%) Web Services
11 11 (3.87%) JSON
12 9 (3.17%) Akka
13 5 (1.76%) Lucene
13 5 (1.76%) Protocol Buffers
Miscellaneous
1 25 (8.80%) User Experience
2 20 (7.04%) Self-Motivation
3 11 (3.87%) Greenfield Project
4 10 (3.52%) Data Centre
5 8 (2.82%) Data Structures
6 7 (2.46%) Private Cloud
7 6 (2.11%) Cloud Native
8 4 (1.41%) Algorithms
8 4 (1.41%) Equities
9 3 (1.06%) Derivative
9 3 (1.06%) Public Cloud
9 3 (1.06%) Social Media
10 2 (0.70%) Enterprise Cloud
10 2 (0.70%) Enterprise Software
11 1 (0.35%) Equity Derivative
11 1 (0.35%) Hedge funds
11 1 (0.35%) Linux Command Line
11 1 (0.35%) Market Risk
11 1 (0.35%) Mobile App
11 1 (0.35%) Smart Meter
Operating Systems
1 10 (3.52%) Linux
2 2 (0.70%) Unix
3 1 (0.35%) CentOS
3 1 (0.35%) Windows
Processes & Methodologies
1 99 (34.86%) Agile Software Development
2 97 (34.15%) Analytics
3 67 (23.59%) Software Engineering
4 60 (21.13%) Microservices
5 59 (20.77%) DevOps
6 46 (16.20%) Data Engineering
7 41 (14.44%) Multithreading
8 38 (13.38%) Data Science
8 38 (13.38%) Open Source
9 37 (13.03%) Artificial Intelligence
10 33 (11.62%) Business Intelligence
10 33 (11.62%) OO
11 32 (11.27%) Computer Science
12 30 (10.56%) Data Analysis
13 28 (9.86%) Fintech
14 27 (9.51%) Data Pipeline
15 26 (9.15%) Data Modelling
16 24 (8.45%) Infrastructure as Code
17 22 (7.75%) SOA
18 21 (7.39%) Clean Code
Programming Languages
1 165 (58.10%) Java
2 82 (28.87%) SQL
3 78 (27.46%) Python
4 42 (14.79%) TypeScript
5 34 (11.97%) Scala
6 27 (9.51%) JavaScript
7 26 (9.15%) Java 8
8 22 (7.75%) C#
9 16 (5.63%) PHP
10 15 (5.28%) Kotlin
11 14 (4.93%) ES6
12 8 (2.82%) Bash Shell
12 8 (2.82%) R
13 5 (1.76%) C++
14 4 (1.41%) C
15 2 (0.70%) Go
16 1 (0.35%) Perl
16 1 (0.35%) PowerShell
16 1 (0.35%) Ruby
Qualifications
1 33 (11.62%) Degree
2 21 (7.39%) Computer Science Degree
3 11 (3.87%) SC Cleared
3 11 (3.87%) Security Cleared
4 8 (2.82%) DV Cleared
5 4 (1.41%) Master's Degree
6 2 (0.70%) PhD
7 1 (0.35%) AWS Certification
Quality Assurance & Compliance
1 25 (8.80%) Data Quality
2 15 (5.28%) QA
System Software
1 54 (19.01%) Docker
2 6 (2.11%) Apache ZooKeeper
3 3 (1.06%) HDFS
4 2 (0.70%) Apache Flume
5 1 (0.35%) Virtual Machines
5 1 (0.35%) VMware Infrastructure
Systems Management
1 87 (30.63%) Kubernetes
2 34 (11.97%) Terraform
3 13 (4.58%) Ansible
4 8 (2.82%) Puppet
5 2 (0.70%) Prometheus
6 1 (0.35%) Docker Swarm
6 1 (0.35%) Grafana
6 1 (0.35%) Graphite
6 1 (0.35%) HAProxy
6 1 (0.35%) Opscode Chef
6 1 (0.35%) Salt
6 1 (0.35%) ZABBIX
Vendors
1 15 (5.28%) Oracle
2 12 (4.23%) Talend
3 10 (3.52%) Databricks
4 9 (3.17%) Microsoft
5 6 (2.11%) Cloudera
5 6 (2.11%) Google
6 4 (1.41%) Alteryx
6 4 (1.41%) VMware
7 2 (0.70%) Splunk
8 1 (0.35%) Greenplum
8 1 (0.35%) Informatica