Period
to 21 September 2021

The following table provides summary statistics for permanent job vacancies advertised in Central London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 September 2021 with a comparison to the same period in the previous 2 years.

Big Data
London > Central London
6 months to
21 Sep 2021
Same period 2020 Same period 2019
Rank 58 56 55
Rank change year-on-year -2 -1 +10
Permanent jobs citing Big Data 338 210 612
As % of all permanent jobs advertised in Central London 4.96% 4.68% 4.79%
As % of the Database & Business Intelligence category 16.95% 16.92% 15.42%
Number of salaries quoted 323 178 543
10th Percentile £52,500 £41,750 £48,950
25th Percentile £60,000 £55,088 £61,250
Median annual salary (50th Percentile) £82,500 £70,000 £76,000
Median % change year-on-year +17.86% -7.89% +1.33%
75th Percentile £95,000 £87,500 £93,750
90th Percentile £110,000 £105,000 £112,500
London median annual salary £80,000 £75,000 £77,500
% change year-on-year +6.67% -3.23% +10.71%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Permanent vacancies with a requirement for database or business intelligence skills 1,994 1,241 3,968
As % of all permanent IT jobs advertised in Central London 29.26% 27.68% 31.05%
Number of salaries quoted 1,759 1,051 3,597
10th Percentile £46,250 £42,500 £41,250
25th Percentile £56,250 £52,500 £51,250
Median annual salary (50th Percentile) £72,500 £70,000 £65,000
Median % change year-on-year +3.57% +7.69% +3.17%
75th Percentile £93,750 £85,000 £82,500
90th Percentile £107,500 £98,750 £95,100
London median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Big Data
Job Vacancy Trend in Central London

Job postings citing Big Data as a proportion of all IT jobs advertised in Central London.

Job vacancy trend for Big Data in Central London

Big Data
Salary Trend in Central London

3-month moving average salary quoted in jobs citing Big Data in Central London.

Salary trend for Big Data in Central London

Big Data
Salary Histogram in Central London

Salary distribution for jobs citing Big Data in Central London over the 6 months to 21 September 2021.

Salary histogram for Big Data in Central London

Big Data
Job Locations in Central London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the Central London region over the 6 months to 21 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London -6 297 £82,500 +17.86% 62
West End of London -15 2 £80,500 -5.29%
City of Westminster -18 1 - -
Southwark - 1 - -
Big Data
London

For the 6 months to 21 September 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Central London region with a requirement for Big Data.

1 179 (52.96%) Java
2 144 (42.60%) Hadoop
3 143 (42.31%) Agile Software Development
4 112 (33.14%) Analytics
5 105 (31.07%) Apache Spark
6 98 (28.99%) SQL
7 95 (28.11%) AWS
8 92 (27.22%) Python
9 88 (26.04%) Kubernetes
10 87 (25.74%) Kafka
11 73 (21.60%) Data Science
12 71 (21.01%) DevOps
13 64 (18.93%) Software Engineering
14 59 (17.46%) Microservices
15 58 (17.16%) Artificial Intelligence
16 57 (16.86%) Azure
17 56 (16.57%) GCP
18 55 (16.27%) Data Warehouse
19 54 (15.98%) Docker
20 52 (15.38%) Finance
20 52 (15.38%) Scala
21 51 (15.09%) Multithreading
21 51 (15.09%) Data Engineering
22 50 (14.79%) NoSQL
23 46 (13.61%) MongoDB
24 41 (12.13%) Amazon Redshift
24 41 (12.13%) Data Quality
25 40 (11.83%) Data Modelling
25 40 (11.83%) Data Pipeline
26 39 (11.54%) React

Big Data
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 105 (31.07%) Apache Spark
2 27 (7.99%) Elasticsearch
3 21 (6.21%) Apache
4 10 (2.96%) Apache Airflow
5 5 (1.48%) SharePoint
6 4 (1.18%) SharePoint 2010
6 4 (1.18%) SharePoint 2013
7 3 (0.89%) Apache Pig
7 3 (0.89%) OpenStack
8 2 (0.59%) Confluence
9 1 (0.30%) Apache Pulsar
9 1 (0.30%) GemFire
Applications
1 12 (3.55%) Microsoft Excel
2 9 (2.66%) Spreadsheet
3 4 (1.18%) InfoPath
4 2 (0.59%) Chatbot
5 1 (0.30%) MS Visio
5 1 (0.30%) OmniGraffle
Business Applications
1 1 (0.30%) Distributed Ledger
Cloud Services
1 95 (28.11%) AWS
2 57 (16.86%) Azure
3 56 (16.57%) GCP
4 29 (8.58%) SaaS
5 23 (6.80%) Power Platform
6 18 (5.33%) Snowflake
7 15 (4.44%) PaaS
8 13 (3.85%) IaaS
9 12 (3.55%) Amazon EC2
10 7 (2.07%) Cloud Computing
10 7 (2.07%) OpenShift
11 6 (1.78%) Slack
12 5 (1.48%) AWS Data Pipeline
12 5 (1.48%) AWS Step Functions
12 5 (1.48%) Microsoft 365
12 5 (1.48%) Serverless
13 4 (1.18%) Amazon S3
13 4 (1.18%) AWS CloudFormation
14 3 (0.89%) Amazon SageMaker
14 3 (0.89%) AWS Lambda
Communications & Networking
1 12 (3.55%) HTTP
2 5 (1.48%) Broadband
3 3 (0.89%) 5G
4 1 (0.30%) DNS
4 1 (0.30%) Internet
4 1 (0.30%) VLAN
Database & Business Intelligence
1 144 (42.60%) Hadoop
2 55 (16.27%) Data Warehouse
3 50 (14.79%) NoSQL
4 46 (13.61%) MongoDB
5 41 (12.13%) Amazon Redshift
6 38 (11.24%) Data Lake
7 34 (10.06%) Apache Cassandra
8 31 (9.17%) Relational Database
9 23 (6.80%) Apache Hive
9 23 (6.80%) Flink
9 23 (6.80%) Power BI
9 23 (6.80%) Tableau
10 22 (6.51%) BigQuery
11 19 (5.62%) SQL Server
12 18 (5.33%) Amazon RDS
12 18 (5.33%) MySQL
13 15 (4.44%) Metadata
14 14 (4.14%) PostgreSQL
15 8 (2.37%) OLTP
16 7 (2.07%) Spark SQL
Development Applications
1 29 (8.58%) Atlassian Bamboo
2 24 (7.10%) Jenkins
3 21 (6.21%) Git (software)
4 19 (5.62%) JIRA
5 11 (3.25%) Gradle
6 9 (2.66%) JMeter
6 9 (2.66%) JUnit
7 8 (2.37%) ER Studio
7 8 (2.37%) ERwin
7 8 (2.37%) PowerDesigner
8 7 (2.07%) Bitbucket
8 7 (2.07%) Hudson
8 7 (2.07%) Subversion
8 7 (2.07%) Vagrant
9 6 (1.78%) Maven
9 6 (1.78%) REST Assured
10 5 (1.48%) Toad
10 5 (1.48%) TortoiseSVN
11 4 (1.18%) GitLab
11 4 (1.18%) Visual Studio
General
1 52 (15.38%) Finance
2 32 (9.47%) Social Skills
3 25 (7.40%) Analytical Skills
4 19 (5.62%) Advertising
5 16 (4.73%) Banking
6 14 (4.14%) Publishing
7 12 (3.55%) Law
8 9 (2.66%) Public Sector
9 6 (1.78%) Influencing Skills
9 6 (1.78%) Private Banking
9 6 (1.78%) Retail
10 5 (1.48%) Front Office
11 4 (1.18%) Investment Banking
11 4 (1.18%) Presentation Skills
12 3 (0.89%) Documentation Skills
13 2 (0.59%) Inclusion and Diversity
13 2 (0.59%) Mandarin Language
13 2 (0.59%) Organisational Skills
14 1 (0.30%) Financial Institution
Job Titles
1 80 (23.67%) Developer
2 71 (21.01%) Data Engineer
3 57 (16.86%) Java Developer
4 53 (15.68%) Big Data Engineer
5 45 (13.31%) Java Engineer
6 30 (8.88%) Architect
7 27 (7.99%) Senior Developer
8 26 (7.69%) Senior Java Developer
9 24 (7.10%) Software Engineer
10 23 (6.80%) AWS Engineer
11 20 (5.92%) Analyst
12 19 (5.62%) Java Software Engineer
13 18 (5.33%) Data Analyst
13 18 (5.33%) Senior Data Engineer
14 17 (5.03%) Consultant
15 16 (4.73%) Cloud Engineer
15 16 (4.73%) Data Analytics Engineer
16 15 (4.44%) Big Data Software Engineer
16 15 (4.44%) Kubernetes Engineer
17 14 (4.14%) Data Architect
Libraries, Frameworks & Software Standards
1 87 (25.74%) Kafka
2 39 (11.54%) React
3 31 (9.17%) Node.js
4 27 (7.99%) GraphQL
4 27 (7.99%) Redux
5 24 (7.10%) Apollo GraphQL
6 20 (5.92%) ActiveMQ
6 20 (5.92%) JMS
7 15 (4.44%) AngularJS
8 14 (4.14%) Apache Thrift
9 12 (3.55%) Web Services
10 11 (3.25%) Akka
10 11 (3.25%) CSS
10 11 (3.25%) HTML
10 11 (3.25%) HTML5
11 10 (2.96%) JSON
11 10 (2.96%) REST
12 8 (2.37%) RESTful
13 7 (2.07%) Middleware
13 7 (2.07%) Spring
Miscellaneous
1 26 (7.69%) User Experience
2 22 (6.51%) Self-Motivation
3 18 (5.33%) Algorithms
4 12 (3.55%) Greenfield Project
4 12 (3.55%) Private Cloud
5 11 (3.25%) Data Centre
6 8 (2.37%) Data Structures
7 6 (1.78%) CMDB
8 5 (1.48%) Cloud Native
9 4 (1.18%) e-Learning
9 4 (1.18%) Taxonomies
10 3 (0.89%) Enterprise Software
10 3 (0.89%) Equities
10 3 (0.89%) Public Cloud
10 3 (0.89%) Social Media
11 2 (0.59%) Derivative
11 2 (0.59%) Enterprise Cloud
11 2 (0.59%) Mobile App
12 1 (0.30%) Life Science
12 1 (0.30%) Media Streaming
Operating Systems
1 12 (3.55%) Linux
2 6 (1.78%) Unix
3 1 (0.30%) Android
3 1 (0.30%) DC/OS
3 1 (0.30%) Windows
Processes & Methodologies
1 143 (42.31%) Agile Software Development
2 112 (33.14%) Analytics
3 73 (21.60%) Data Science
4 71 (21.01%) DevOps
5 64 (18.93%) Software Engineering
6 59 (17.46%) Microservices
7 58 (17.16%) Artificial Intelligence
8 51 (15.09%) Data Engineering
8 51 (15.09%) Multithreading
9 40 (11.83%) Data Modelling
9 40 (11.83%) Data Pipeline
10 37 (10.95%) Business Intelligence
10 37 (10.95%) Computer Science
11 35 (10.36%) Fintech
12 34 (10.06%) Continuous Integration
13 32 (9.47%) Data Analysis
14 30 (8.88%) OO
15 29 (8.58%) Machine Learning
16 27 (7.99%) Data Management
16 27 (7.99%) TDD
Programming Languages
1 179 (52.96%) Java
2 98 (28.99%) SQL
3 92 (27.22%) Python
4 52 (15.38%) Scala
5 38 (11.24%) TypeScript
6 25 (7.40%) Java 8
7 21 (6.21%) JavaScript
8 17 (5.03%) C#
9 13 (3.85%) R
10 12 (3.55%) PHP
11 9 (2.66%) Bash Shell
12 8 (2.37%) Go
12 8 (2.37%) Kotlin
13 7 (2.07%) C++
13 7 (2.07%) ES6
14 6 (1.78%) Ruby
15 5 (1.48%) Clojure
16 4 (1.18%) C
17 2 (0.59%) MATLAB
17 2 (0.59%) Perl
Qualifications
1 32 (9.47%) Degree
2 20 (5.92%) Security Cleared
3 19 (5.62%) SC Cleared
4 12 (3.55%) Computer Science Degree
5 9 (2.66%) DV Cleared
5 9 (2.66%) Master's Degree
6 5 (1.48%) PhD
7 3 (0.89%) BPSS Clearance
8 1 (0.30%) AWS Certification
8 1 (0.30%) IBM Certification
8 1 (0.30%) Microsoft Certification
Quality Assurance & Compliance
1 41 (12.13%) Data Quality
2 23 (6.80%) QA
System Software
1 54 (15.98%) Docker
2 5 (1.48%) Apache ZooKeeper
3 3 (0.89%) HDFS
4 2 (0.59%) Apache Flume
5 1 (0.30%) Virtual Machines
Systems Management
1 88 (26.04%) Kubernetes
2 35 (10.36%) Terraform
3 26 (7.69%) Ansible
4 15 (4.44%) Puppet
5 8 (2.37%) Docker Swarm
5 8 (2.37%) Opscode Chef
5 8 (2.37%) Salt
6 7 (2.07%) Consul
6 7 (2.07%) Grafana
6 7 (2.07%) Graphite
6 7 (2.07%) Packer
7 6 (1.78%) ITRS Geneos
7 6 (1.78%) Nagios
7 6 (1.78%) Opsview
7 6 (1.78%) ZABBIX
8 1 (0.30%) Apache Brooklyn
8 1 (0.30%) HAProxy
8 1 (0.30%) Marathon
8 1 (0.30%) Mesos
8 1 (0.30%) Prometheus
Vendors
1 30 (8.88%) Oracle
2 16 (4.73%) Microsoft
3 15 (4.44%) Talend
4 14 (4.14%) Databricks
5 12 (3.55%) Cloudera
6 9 (2.66%) Google
7 7 (2.07%) Informatica
8 6 (1.78%) IBM
8 6 (1.78%) ServiceNow
9 5 (1.48%) Alteryx
9 5 (1.48%) SAP
10 3 (0.89%) Salesforce.com
11 1 (0.30%) Greenplum
11 1 (0.30%) Hortonworks
11 1 (0.30%) MapR
11 1 (0.30%) Nintex
11 1 (0.30%) Splunk