Period
to 19 January 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 19 January 2021 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
19 Jan 2021
Same period 2020 Same period 2019
Rank 78 66 57
Rank change year-on-year -12 -9 +4
Permanent jobs citing Big Data 902 2,191 2,910
As % of all permanent jobs advertised in London 3.75% 4.33% 4.65%
As % of the Database & Business Intelligence category 13.17% 15.22% 15.65%
Number of salaries quoted 735 1,878 2,508
Median annual salary £75,000 £77,500 £75,000
Median salary % change year-on-year -3.23% +3.33% +7.14%
10th Percentile £48,750 £48,750 £47,500
90th Percentile £110,000 £115,000 £105,000
England median annual salary £67,500 £70,000 £70,000
% change year-on-year -3.57% - +7.69%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 6,851 14,395 18,596
As % of all permanent IT jobs advertised in London 28.46% 28.47% 29.70%
Number of salaries quoted 5,797 11,977 15,530
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,500 £38,750 £37,500
90th Percentile £100,000 £105,000 £95,000
England median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 19 January 2021.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 19 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -7 222 £80,000 +6.67% 51
South London +42 29 £80,000 +6.67% 3
West London +53 10 £77,500 +19.23% 22
East London -8 3 £50,000 -28.57% 9
Big Data
England

For the 6 months to 19 January 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 439 (48.67%) Python
2 429 (47.56%) AWS
3 426 (47.23%) Agile Software Development
4 384 (42.57%) Analytics
5 377 (41.80%) Java
6 304 (33.70%) SQL
7 303 (33.59%) Hadoop
8 298 (33.04%) Azure
9 254 (28.16%) Apache Spark
10 228 (25.28%) Data Science
11 223 (24.72%) DevOps
11 223 (24.72%) Finance
12 217 (24.06%) ETL
13 187 (20.73%) GCP
14 186 (20.62%) Machine Learning
15 178 (19.73%) Kafka
16 166 (18.40%) Data Analytics
17 158 (17.52%) Kubernetes
18 156 (17.29%) Software Engineering
19 153 (16.96%) Scala
20 151 (16.74%) Business Intelligence
21 146 (16.19%) Data Warehouse
22 145 (16.08%) NoSQL
23 142 (15.74%) Artificial Intelligence
24 137 (15.19%) Docker
25 126 (13.97%) Microservices
26 125 (13.86%) Degree
27 120 (13.30%) Scrum
28 118 (13.08%) Data Modelling
29 116 (12.86%) Apache Hive

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 254 (28.16%) Apache Spark
2 74 (8.20%) SAS
3 64 (7.10%) Apache
4 55 (6.10%) Elasticsearch
5 49 (5.43%) Apache Airflow
6 14 (1.55%) Apache Pig
7 13 (1.44%) Confluence
7 13 (1.44%) Tornado
8 12 (1.33%) Luigi
9 10 (1.11%) Moodle
10 7 (0.78%) SharePoint
11 6 (0.67%) Jupyter
12 5 (0.55%) ArcGIS
12 5 (0.55%) Oracle Workflow
13 3 (0.33%) Tomcat
14 2 (0.22%) CMS
14 2 (0.22%) JBoss
14 2 (0.22%) OpenStack
14 2 (0.22%) Oracle SOA Suite
14 2 (0.22%) WebLogic
Applications
1 13 (1.44%) SPSS
2 1 (0.11%) Adobe Creative Suite
2 1 (0.11%) Figma
Business Applications
1 8 (0.89%) Sentinel
2 6 (0.67%) Dynamics CRM
3 5 (0.55%) SAP CRM
4 3 (0.33%) Oracle EBS
5 2 (0.22%) SAP R/3
6 1 (0.11%) SAP APO
6 1 (0.11%) SAP ERP
6 1 (0.11%) SAP Hybris
6 1 (0.11%) SAP S/4HANA
Cloud Services
1 429 (47.56%) AWS
2 298 (33.04%) Azure
3 187 (20.73%) GCP
4 86 (9.53%) Power Platform
5 51 (5.65%) SaaS
6 50 (5.54%) Serverless
7 44 (4.88%) AWS Lambda
8 27 (2.99%) Amazon EMR
8 27 (2.99%) GitHub
9 24 (2.66%) Azure Data Factory
10 22 (2.44%) AWS CloudFormation
11 20 (2.22%) PaaS
12 19 (2.11%) Amazon EC2
13 18 (2.00%) Amazon S3
14 17 (1.88%) Cloud Computing
15 16 (1.77%) Amazon Kinesis
16 15 (1.66%) IaaS
17 13 (1.44%) Dynamics 365
18 5 (0.55%) Amazon SQS
18 5 (0.55%) Office 365
Communications & Networking
1 24 (2.66%) Firewall
2 21 (2.33%) Internet
3 19 (2.11%) HTTP
4 9 (1.00%) TCP/IP
5 8 (0.89%) SSH
6 5 (0.55%) Kerberos
6 5 (0.55%) LAN
6 5 (0.55%) WAN
7 4 (0.44%) 802.11
7 4 (0.44%) DNS
7 4 (0.44%) Fibre Channel
7 4 (0.44%) FTP
7 4 (0.44%) SAN
7 4 (0.44%) SNMP
7 4 (0.44%) Wireless
8 3 (0.33%) 5G
8 3 (0.33%) DMZ
8 3 (0.33%) Reverse Proxy
8 3 (0.33%) Software-Defined Networking
8 3 (0.33%) VPN
Database & Business Intelligence
1 303 (33.59%) Hadoop
2 146 (16.19%) Data Warehouse
3 145 (16.08%) NoSQL
4 116 (12.86%) Apache Hive
5 101 (11.20%) Data Lake
6 86 (9.53%) Power BI
7 76 (8.43%) Tableau
8 66 (7.32%) MongoDB
9 61 (6.76%) Amazon Redshift
10 59 (6.54%) Apache Cassandra
11 58 (6.43%) Relational Database
11 58 (6.43%) SQL Server
12 50 (5.54%) Impala
13 46 (5.10%) Pentaho
13 46 (5.10%) Snowflake Schema
14 43 (4.77%) MySQL
15 42 (4.66%) BusinessObjects
16 39 (4.32%) PostgreSQL
17 37 (4.10%) Data Mining
17 37 (4.10%) Oracle Database
Development Applications
1 94 (10.42%) Git (software)
2 55 (6.10%) Jenkins
3 24 (2.66%) JIRA
4 23 (2.55%) Maven
5 18 (2.00%) Atlassian Bamboo
6 17 (1.88%) GitLab
7 13 (1.44%) TeamCity
8 9 (1.00%) Octopus Deploy
9 7 (0.78%) ERwin
9 7 (0.78%) Team Foundation Server
10 6 (0.67%) Gradle
10 6 (0.67%) JUnit
10 6 (0.67%) Visual Studio Team System
11 5 (0.55%) Bitbucket
12 4 (0.44%) Cucumber
12 4 (0.44%) ER Studio
12 4 (0.44%) JMeter
12 4 (0.44%) Selenium
12 4 (0.44%) WebDriver
13 3 (0.33%) Subversion
General
1 223 (24.72%) Finance
2 106 (11.75%) Banking
3 49 (5.43%) Marketing
4 38 (4.21%) Law
5 36 (3.99%) Retail
6 29 (3.22%) Telecoms
7 24 (2.66%) Advertising
7 24 (2.66%) Games
8 16 (1.77%) Front Office
8 16 (1.77%) Public Sector
9 11 (1.22%) Manufacturing
10 10 (1.11%) Local Government
11 9 (1.00%) Investment Banking
12 7 (0.78%) Electronics
13 6 (0.67%) Pharmaceutical
14 5 (0.55%) Financial Institution
14 5 (0.55%) Legal
14 5 (0.55%) Publishing
15 4 (0.44%) Brand Awareness
16 2 (0.22%) Billing
Job Titles
1 218 (24.17%) Data Engineer
2 180 (19.96%) Developer
3 102 (11.31%) Architect
4 80 (8.87%) Java Developer
5 68 (7.54%) Data Scientist
6 67 (7.43%) Consultant
7 61 (6.76%) Big Data Engineer
7 61 (6.76%) Data Architect
8 53 (5.88%) DevOps Engineer
9 52 (5.76%) Java Engineer
10 46 (5.10%) Software Engineer
11 44 (4.88%) AWS Engineer
12 38 (4.21%) Python Engineer
12 38 (4.21%) Senior Developer
13 35 (3.88%) Analyst
14 34 (3.77%) Solutions Architect
15 31 (3.44%) Senior DevOps
15 31 (3.44%) Senior DevOps Engineer
16 30 (3.33%) Senior Data Scientist
17 29 (3.22%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 178 (19.73%) Kafka
2 60 (6.65%) Spring
3 57 (6.32%) HTML
4 47 (5.21%) Web Services
5 46 (5.10%) Node.js
6 44 (4.88%) Natural Language Processing
7 41 (4.55%) AngularJS
7 41 (4.55%) Spring Boot
8 40 (4.43%) .NET
8 40 (4.43%) React
9 36 (3.99%) REST
10 33 (3.66%) TensorFlow
11 32 (3.55%) CSS
12 26 (2.88%) RESTful
13 25 (2.77%) XML
14 22 (2.44%) HTML5
15 20 (2.22%) JMS
15 20 (2.22%) RabbitMQ
16 19 (2.11%) ActiveMQ
16 19 (2.11%) JSON
Miscellaneous
1 98 (10.86%) Analytical Skills
2 63 (6.98%) Algorithms
3 39 (4.32%) User Experience
4 35 (3.88%) Self-Motivation
5 32 (3.55%) Management Information System
6 30 (3.33%) Enterprise Software
7 25 (2.77%) Data Structures
8 24 (2.66%) Cloud Native
8 24 (2.66%) Data Centre
9 19 (2.11%) Linux Command Line
9 19 (2.11%) Public Cloud
10 15 (1.66%) Internet of Things
11 12 (1.33%) Greenfield Project
12 11 (1.22%) Credit Risk
12 11 (1.22%) Equities
12 11 (1.22%) Fixed Income
12 11 (1.22%) Market Risk
13 10 (1.11%) Hedge funds
13 10 (1.11%) Private Cloud
14 9 (1.00%) Hybrid Cloud
Operating Systems
1 109 (12.08%) Linux
2 46 (5.10%) Unix
3 32 (3.55%) Windows
4 16 (1.77%) Red Hat Enterprise Linux
5 14 (1.55%) CentOS
6 9 (1.00%) Windows Server 2008
7 8 (0.89%) Windows Server
8 4 (0.44%) Ubuntu
9 3 (0.33%) Oracle Linux
10 2 (0.22%) Windows Server 2012
10 2 (0.22%) Windows Server 2016
11 1 (0.11%) Android
11 1 (0.11%) Debian
11 1 (0.11%) Mac OS
11 1 (0.11%) Windows Server 2019
Processes & Methodologies
1 426 (47.23%) Agile Software Development
2 384 (42.57%) Analytics
3 228 (25.28%) Data Science
4 223 (24.72%) DevOps
5 217 (24.06%) ETL
6 186 (20.62%) Machine Learning
7 166 (18.40%) Data Analytics
8 156 (17.29%) Software Engineering
9 151 (16.74%) Business Intelligence
10 142 (15.74%) Artificial Intelligence
11 126 (13.97%) Microservices
12 120 (13.30%) Scrum
13 118 (13.08%) Data Modelling
14 111 (12.31%) Visualisation
15 100 (11.09%) Data Engineering
16 98 (10.86%) Computer Science
17 94 (10.42%) Mentoring
18 85 (9.42%) Data Architecture
19 79 (8.76%) Fintech
20 78 (8.65%) Open Source
Programming Languages
1 439 (48.67%) Python
2 377 (41.80%) Java
3 304 (33.70%) SQL
4 153 (16.96%) Scala
5 110 (12.20%) JavaScript
6 78 (8.65%) R
7 65 (7.21%) C#
8 60 (6.65%) Bash Shell
9 43 (4.77%) Shell Script
10 41 (4.55%) C
11 40 (4.43%) C++
12 37 (4.10%) PL/SQL
13 36 (3.99%) HiveQL
14 33 (3.66%) Java 8
15 23 (2.55%) Go
16 22 (2.44%) Ruby
16 22 (2.44%) TypeScript
17 21 (2.33%) PHP
18 14 (1.55%) Perl
18 14 (1.55%) T-SQL
Qualifications
1 125 (13.86%) Degree
2 44 (4.88%) Security Cleared
3 42 (4.66%) Computer Science Degree
4 40 (4.43%) SC Cleared
5 28 (3.10%) BPSS Clearance
6 18 (2.00%) PhD
7 12 (1.33%) CISSP
8 11 (1.22%) DV Cleared
9 10 (1.11%) Master's Degree
10 9 (1.00%) (ISC)2 CCSP
10 9 (1.00%) Cisco Certification
11 8 (0.89%) Numerate Degree
12 5 (0.55%) AWS Certification
13 2 (0.22%) CISA
13 2 (0.22%) PMI Certification
13 2 (0.22%) TOGAF Certification
14 1 (0.11%) CISM
14 1 (0.11%) Microsoft Certification
14 1 (0.11%) PMP
14 1 (0.11%) SAP Certification
Quality Assurance & Compliance
1 47 (5.21%) Data Quality
2 36 (3.99%) QA
3 7 (0.78%) GDPR
4 3 (0.33%) ISO/IEC 27001
4 3 (0.33%) MiFID
4 3 (0.33%) PMO
4 3 (0.33%) WCAG
5 2 (0.22%) Dodd-Frank
5 2 (0.22%) EMIR
6 1 (0.11%) ISO/IEC 15288
6 1 (0.11%) NIST
6 1 (0.11%) PCI DSS
System Software
1 137 (15.19%) Docker
2 48 (5.32%) HDFS
3 14 (1.55%) VMware Infrastructure
4 13 (1.44%) Virtual Machines
5 8 (0.89%) Active Directory
5 8 (0.89%) Apache ZooKeeper
6 5 (0.55%) Apache Flume
7 4 (0.44%) Hyper-V
8 1 (0.11%) NFS
8 1 (0.11%) Oracle RAC
8 1 (0.11%) oVirt
8 1 (0.11%) VirtualBox
8 1 (0.11%) vSphere
Systems Management
1 158 (17.52%) Kubernetes
2 72 (7.98%) Terraform
3 69 (7.65%) Ansible
4 37 (4.10%) Puppet
5 22 (2.44%) Opscode Chef
6 8 (0.89%) Istio
7 6 (0.67%) Grafana
8 4 (0.44%) Nagios
8 4 (0.44%) Oozie
8 4 (0.44%) Prometheus
9 3 (0.33%) Hadoop YARN
9 3 (0.33%) SCOM
9 3 (0.33%) ZABBIX
10 2 (0.22%) HP Fortify
10 2 (0.22%) Kibana
10 2 (0.22%) Mesos
10 2 (0.22%) SCCM
10 2 (0.22%) SELinux
11 1 (0.11%) Cisco CUCM
11 1 (0.11%) Oracle RMAN
Vendors
1 96 (10.64%) Google
2 89 (9.87%) Oracle
3 72 (7.98%) Talend
4 66 (7.32%) Informatica
5 65 (7.21%) Microsoft
6 63 (6.98%) Cloudera
7 61 (6.76%) Databricks
8 30 (3.33%) SAP
9 20 (2.22%) IBM
10 19 (2.11%) Red Hat
11 16 (1.77%) VMware
12 12 (1.33%) Salesforce.com
13 10 (1.11%) Splunk
14 5 (0.55%) Ab Initio
14 5 (0.55%) NVIDIA
15 4 (0.44%) App Annie
15 4 (0.44%) Facebook
15 4 (0.44%) Intel
15 4 (0.44%) LogicMonitor
15 4 (0.44%) Teradata