Period
to 27 September 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 27 September 2020 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
27 Sep 2020
Same period 2019 Same period 2018
Rank 83 61 47
Rank change year-on-year -22 -14 +22
Permanent jobs citing Big Data 771 2,520 3,881
As % of all permanent jobs advertised in London 3.94% 4.53% 5.68%
As % of the Database & Business Intelligence category 13.84% 15.92% 18.30%
Number of salaries quoted 618 2,209 2,457
Median annual salary £75,000 £77,500 £70,000
Median salary % change year-on-year -3.23% +10.71% +3.70%
10th Percentile £45,875 £50,000 £46,250
90th Percentile £115,000 £115,000 £100,000
England median annual salary £67,500 £70,000 £65,000
% change year-on-year -3.57% +7.69% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 5,572 15,827 21,210
As % of all permanent IT jobs advertised in London 28.48% 28.43% 31.04%
Number of salaries quoted 4,638 13,094 16,864
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,500 £38,000 £37,500
90th Percentile £105,000 £97,500 £93,750
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +1.01%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 27 September 2020.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 27 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -2 203 £72,500 -3.33% 46
South London +76 31 £90,000 +12.50% 4
West London +56 15 £75,000 +20.97% 9
East London +11 12 £57,500 -17.86% 10
Big Data
England

For the 6 months to 27 September 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 346 (44.88%) Python
2 334 (43.32%) Agile Software Development
3 324 (42.02%) AWS
4 302 (39.17%) Java
4 302 (39.17%) Analytics
5 281 (36.45%) Hadoop
6 271 (35.15%) SQL
7 236 (30.61%) Apache Spark
8 225 (29.18%) Finance
9 212 (27.50%) Azure
10 191 (24.77%) Data Science
11 183 (23.74%) Kafka
12 182 (23.61%) Machine Learning
13 174 (22.57%) DevOps
14 155 (20.10%) Degree
15 146 (18.94%) Scala
16 143 (18.55%) Artificial Intelligence
17 142 (18.42%) ETL
18 141 (18.29%) Kubernetes
19 132 (17.12%) Data Analytics
20 127 (16.47%) JavaScript
21 126 (16.34%) Business Intelligence
22 121 (15.69%) Apache Hive
22 121 (15.69%) GCP
23 112 (14.53%) NoSQL
24 110 (14.27%) Microservices
25 105 (13.62%) Git (software)
26 104 (13.49%) Scrum
27 100 (12.97%) Software Engineering
27 100 (12.97%) Docker

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 236 (30.61%) Apache Spark
2 52 (6.74%) Apache
3 40 (5.19%) Elasticsearch
3 40 (5.19%) SAS
4 23 (2.98%) Apache Airflow
5 14 (1.82%) Jupyter
6 13 (1.69%) Confluence
7 11 (1.43%) Moodle
8 4 (0.52%) CMS
8 4 (0.52%) IBM Domino
8 4 (0.52%) Tomcat
9 3 (0.39%) Apache Pig
9 3 (0.39%) Apache Solr
9 3 (0.39%) JBoss
9 3 (0.39%) WebLogic
10 2 (0.26%) Apache Synapse
10 2 (0.26%) Tornado
11 1 (0.13%) GemFire
11 1 (0.13%) Oracle SOA Suite
11 1 (0.13%) WordPress
Applications
1 6 (0.78%) Microsoft Excel
1 6 (0.78%) MS Visio
2 5 (0.65%) Microsoft Office
2 5 (0.65%) Microsoft Project
Business Applications
1 7 (0.91%) Sentinel
2 2 (0.26%) SAP R/3
2 2 (0.26%) SAP S/4HANA
3 1 (0.13%) Payment Gateway
3 1 (0.13%) Primavera
3 1 (0.13%) SAP BPC
3 1 (0.13%) SAP CO
3 1 (0.13%) SAP CRM
3 1 (0.13%) SAP ERP
3 1 (0.13%) SAP EWM
3 1 (0.13%) SAP FI
3 1 (0.13%) SAP FI/CO
3 1 (0.13%) SAP IS-U
3 1 (0.13%) SAP WM
3 1 (0.13%) Workday HCM
Cloud Services
1 324 (42.02%) AWS
2 212 (27.50%) Azure
3 121 (15.69%) GCP
4 95 (12.32%) Power Platform
5 46 (5.97%) SaaS
6 36 (4.67%) Amazon S3
7 27 (3.50%) Serverless
8 24 (3.11%) Amazon EC2
8 24 (3.11%) Amazon EMR
9 17 (2.20%) Amazon SQS
9 17 (2.20%) Azure Data Factory
9 17 (2.20%) IaaS
10 15 (1.95%) AWS CloudFormation
11 14 (1.82%) AWS Lambda
11 14 (1.82%) Cloud Computing
12 13 (1.69%) Office 365
13 12 (1.56%) Amazon Kinesis
13 12 (1.56%) PaaS
14 11 (1.43%) Amazon CloudWatch
14 11 (1.43%) GitHub
Communications & Networking
1 19 (2.46%) Firewall
2 17 (2.20%) HTTP
3 10 (1.30%) Internet
4 8 (1.04%) TCP/IP
5 7 (0.91%) 5G
5 7 (0.91%) SSH
6 3 (0.39%) FTP
7 2 (0.26%) DNS
7 2 (0.26%) Kerberos
8 1 (0.13%) LAN
8 1 (0.13%) Network Security
8 1 (0.13%) VLAN
8 1 (0.13%) WAN
Database & Business Intelligence
1 281 (36.45%) Hadoop
2 121 (15.69%) Apache Hive
3 112 (14.53%) NoSQL
4 95 (12.32%) Power BI
5 78 (10.12%) Data Warehouse
6 74 (9.60%) Data Lake
7 72 (9.34%) SQL Server
8 65 (8.43%) Relational Database
9 52 (6.74%) Amazon Redshift
10 47 (6.10%) Impala
11 46 (5.97%) Data Mining
12 43 (5.58%) MongoDB
12 43 (5.58%) MySQL
13 41 (5.32%) Apache Cassandra
14 40 (5.19%) HBase
15 39 (5.06%) Flink
16 38 (4.93%) RDBMS
17 37 (4.80%) BusinessObjects
17 37 (4.80%) Oracle Database
18 36 (4.67%) Pentaho
Development Applications
1 105 (13.62%) Git (software)
2 33 (4.28%) Jenkins
3 17 (2.20%) Atlassian Bamboo
4 16 (2.08%) JIRA
5 11 (1.43%) GitLab
5 11 (1.43%) Maven
6 10 (1.30%) TeamCity
7 9 (1.17%) Octopus Deploy
8 8 (1.04%) Visual Studio Team System
9 7 (0.91%) Artifactory
10 6 (0.78%) GoCD
10 6 (0.78%) Gradle
10 6 (0.78%) JUnit
10 6 (0.78%) Team Foundation Server
11 5 (0.65%) Selenium
11 5 (0.65%) Sonatype Nexus
11 5 (0.65%) Subversion
12 4 (0.52%) Bitbucket
12 4 (0.52%) Cucumber
12 4 (0.52%) JMeter
General
1 225 (29.18%) Finance
2 65 (8.43%) Banking
3 42 (5.45%) Marketing
4 26 (3.37%) Advertising
5 24 (3.11%) Front Office
6 23 (2.98%) Retail
7 19 (2.46%) Pharmaceutical
8 18 (2.33%) Telecoms
9 13 (1.69%) Manufacturing
9 13 (1.69%) Public Sector
10 11 (1.43%) Law
11 8 (1.04%) Investment Banking
12 5 (0.65%) Financial Institution
12 5 (0.65%) Games
12 5 (0.65%) Local Government
13 3 (0.39%) Legal
13 3 (0.39%) Publishing
14 1 (0.13%) Aerospace
14 1 (0.13%) Automotive
14 1 (0.13%) Electronics
Job Titles
1 208 (26.98%) Data Engineer
2 161 (20.88%) Developer
3 80 (10.38%) Architect
4 74 (9.60%) Java Developer
5 67 (8.69%) Data Scientist
6 64 (8.30%) Big Data Engineer
7 48 (6.23%) Data Architect
8 45 (5.84%) Senior Data Engineer
9 42 (5.45%) AWS Engineer
9 42 (5.45%) Senior Data Scientist
10 40 (5.19%) Consultant
10 40 (5.19%) Python Engineer
11 31 (4.02%) DevOps Engineer
12 25 (3.24%) Cloud Engineer
13 23 (2.98%) Analyst
13 23 (2.98%) Solutions Architect
14 21 (2.72%) Big Data Architect
14 21 (2.72%) Full Stack Developer
15 20 (2.59%) Big Data Developer
16 19 (2.46%) Senior Developer
Libraries, Frameworks & Software Standards
1 183 (23.74%) Kafka
2 52 (6.74%) Natural Language Processing
3 46 (5.97%) TensorFlow
4 40 (5.19%) AngularJS
4 40 (5.19%) React
5 39 (5.06%) Spring
6 36 (4.67%) .NET
7 35 (4.54%) HTML
7 35 (4.54%) scikit-learn
8 34 (4.41%) Pandas
9 31 (4.02%) NumPy
10 30 (3.89%) REST
11 26 (3.37%) CSS
11 26 (3.37%) Node.js
11 26 (3.37%) PySpark
12 24 (3.11%) RESTful
13 23 (2.98%) HTML5
13 23 (2.98%) Keras
13 23 (2.98%) Web Services
14 17 (2.20%) Elastic Stack
Miscellaneous
1 94 (12.19%) Analytical Skills
2 72 (9.34%) Algorithms
3 31 (4.02%) Enterprise Software
4 29 (3.76%) User Experience
5 28 (3.63%) Self-Motivation
6 27 (3.50%) Management Information System
7 26 (3.37%) Equities
8 23 (2.98%) Cloud Native
9 22 (2.85%) Hedge funds
10 21 (2.72%) Hybrid Cloud
11 15 (1.95%) FMCG
12 12 (1.56%) Public Cloud
13 11 (1.43%) e-Learning
13 11 (1.43%) Greenfield Project
13 11 (1.43%) SCORM
14 10 (1.30%) Data Structures
14 10 (1.30%) Internet of Things
14 10 (1.30%) Virtual Team
15 9 (1.17%) Digital Media
15 9 (1.17%) Linux Command Line
Operating Systems
1 77 (9.99%) Linux
2 38 (4.93%) Unix
3 23 (2.98%) Windows
4 9 (1.17%) CentOS
5 5 (0.65%) Red Hat Enterprise Linux
6 3 (0.39%) Windows Server 2008
7 2 (0.26%) Ubuntu
7 2 (0.26%) Windows Server
7 2 (0.26%) Windows Server 2012
7 2 (0.26%) Windows Server 2016
8 1 (0.13%) Mac OS
8 1 (0.13%) Windows Server 2019
Processes & Methodologies
1 334 (43.32%) Agile Software Development
2 302 (39.17%) Analytics
3 191 (24.77%) Data Science
4 182 (23.61%) Machine Learning
5 174 (22.57%) DevOps
6 143 (18.55%) Artificial Intelligence
7 142 (18.42%) ETL
8 132 (17.12%) Data Analytics
9 126 (16.34%) Business Intelligence
10 110 (14.27%) Microservices
11 104 (13.49%) Scrum
12 100 (12.97%) Software Engineering
13 99 (12.84%) Data Modelling
14 95 (12.32%) Computer Science
15 88 (11.41%) Mathematics
16 82 (10.64%) Visualisation
17 78 (10.12%) Data Engineering
17 78 (10.12%) Mentoring
18 69 (8.95%) Problem-Solving
19 58 (7.52%) Requirements Gathering
Programming Languages
1 346 (44.88%) Python
2 302 (39.17%) Java
3 271 (35.15%) SQL
4 146 (18.94%) Scala
5 127 (16.47%) JavaScript
6 62 (8.04%) R
7 49 (6.36%) C#
8 41 (5.32%) Go
9 39 (5.06%) PHP
10 37 (4.80%) Shell Script
11 32 (4.15%) HiveQL
11 32 (4.15%) PL/SQL
12 30 (3.89%) Java 8
13 27 (3.50%) Ruby
14 25 (3.24%) Bash Shell
15 22 (2.85%) C++
16 18 (2.33%) C
17 16 (2.08%) T-SQL
18 12 (1.56%) Perl
18 12 (1.56%) PowerShell
Qualifications
1 155 (20.10%) Degree
2 57 (7.39%) Computer Science Degree
3 30 (3.89%) Security Cleared
4 27 (3.50%) BPSS Clearance
4 27 (3.50%) PhD
5 21 (2.72%) SC Cleared
6 18 (2.33%) Master's Degree
7 10 (1.30%) AWS Certification
8 8 (1.04%) DV Cleared
8 8 (1.04%) Numerate Degree
9 7 (0.91%) CISSP
9 7 (0.91%) PMI Certification
10 5 (0.65%) IIBA
10 5 (0.65%) ISEB
11 4 (0.52%) (ISC)2 CCSP
11 4 (0.52%) CBAP
11 4 (0.52%) Cisco Certification
11 4 (0.52%) Microsoft Certification
12 2 (0.26%) CISA
12 2 (0.26%) SAP Certification
Quality Assurance & Compliance
1 31 (4.02%) Data Quality
2 21 (2.72%) QA
3 17 (2.20%) GDPR
4 3 (0.39%) ISO/IEC 27001
5 2 (0.26%) NIST
5 2 (0.26%) PCI DSS
6 1 (0.13%) MiFID
6 1 (0.13%) Sarbanes-Oxley
6 1 (0.13%) SLA
6 1 (0.13%) WCAG
System Software
1 100 (12.97%) Docker
2 53 (6.87%) HDFS
3 12 (1.56%) Active Directory
4 10 (1.30%) VMware Infrastructure
5 9 (1.17%) Apache ZooKeeper
5 9 (1.17%) Hyper-V
6 8 (1.04%) Virtual Machines
7 5 (0.65%) Apache Flume
8 2 (0.26%) vCloud
8 2 (0.26%) vSphere
9 1 (0.13%) Oracle RAC
9 1 (0.13%) Virtual Servers
9 1 (0.13%) VirtualBox
Systems Management
1 141 (18.29%) Kubernetes
2 40 (5.19%) Terraform
3 36 (4.67%) Ansible
4 11 (1.43%) Hadoop YARN
4 11 (1.43%) Netcool
4 11 (1.43%) Opsview
5 7 (0.91%) Istio
5 7 (0.91%) Puppet
6 6 (0.78%) Oozie
7 5 (0.65%) Kibana
8 4 (0.52%) Nagios
8 4 (0.52%) Opscode Chef
9 3 (0.39%) Mesos
9 3 (0.39%) Prometheus
9 3 (0.39%) SCOM
10 2 (0.26%) HP Fortify
10 2 (0.26%) Marathon
10 2 (0.26%) SCCM
10 2 (0.26%) ZABBIX
11 1 (0.13%) Oracle RMAN
Vendors
1 70 (9.08%) Tableau
2 60 (7.78%) Oracle
3 58 (7.52%) Cloudera
4 56 (7.26%) Talend
5 44 (5.71%) Microsoft
6 41 (5.32%) Informatica
7 40 (5.19%) Databricks
8 34 (4.41%) Google
9 14 (1.82%) VMware
10 13 (1.69%) AppDynamics
10 13 (1.69%) SAP
11 11 (1.43%) Dynatrace
11 11 (1.43%) SevOne
11 11 (1.43%) TOWER Software
12 9 (1.17%) Hortonworks
13 8 (1.04%) Splunk
14 7 (0.91%) LogicMonitor
15 6 (0.78%) Ab Initio
15 6 (0.78%) IBM
16 5 (0.65%) Red Hat