Period
to 28 May 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 May 2020 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
28 May 2020
Same period 2019 Same period 2018
Rank 91 61 41
Rank change year-on-year -30 -20 +18
Permanent jobs citing Big Data 1,341 2,667 4,146
As % of all permanent jobs advertised in London 3.56% 4.59% 5.98%
As % of the Database & Business Intelligence category 12.82% 15.93% 19.04%
Number of salaries quoted 1,101 2,369 2,782
Median annual salary £75,000 £77,500 £70,000
Median salary % change year-on-year -3.23% +10.71% +3.70%
10th Percentile £48,750 £50,000 £45,000
90th Percentile £115,000 £111,250 £102,500
England median annual salary £69,250 £70,000 £65,000
% change year-on-year -1.07% +7.69% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 10,458 16,740 21,774
As % of all permanent IT jobs advertised in London 27.78% 28.83% 31.39%
Number of salaries quoted 8,509 13,905 17,283
Median annual salary £67,500 £65,000 £60,000
Median salary % change year-on-year +3.85% +8.33% -
10th Percentile £40,000 £38,750 £37,500
90th Percentile £105,000 £95,000 £92,500
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 28 May 2020.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 28 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -17 313 £75,000 -1.32% 21
South London +26 41 £71,250 +42.50% 3
West London -18 25 £67,500 +12.50% 4
East London +10 20 £57,500 -17.86% 5
North London -5 2 £68,750 +5.77%
Big Data
England

For the 6 months to 28 May 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 653 (48.70%) Python
2 527 (39.30%) AWS
3 514 (38.33%) Agile Software Development
4 512 (38.18%) Analytics
5 493 (36.76%) Apache Spark
6 486 (36.24%) SQL
7 466 (34.75%) Hadoop
8 439 (32.74%) Java
9 413 (30.80%) Data Science
10 361 (26.92%) Machine Learning
11 354 (26.40%) Finance
12 331 (24.68%) Kafka
13 306 (22.82%) Scala
14 305 (22.74%) DevOps
15 289 (21.55%) Azure
16 274 (20.43%) Artificial Intelligence
17 255 (19.02%) NoSQL
18 254 (18.94%) GCP
19 239 (17.82%) ETL
20 232 (17.30%) Degree
21 229 (17.08%) Kubernetes
22 225 (16.78%) Docker
23 224 (16.70%) Business Intelligence
24 200 (14.91%) Data Warehouse
25 180 (13.42%) Computer Science
25 180 (13.42%) Software Engineering
26 176 (13.12%) Microservices
27 174 (12.98%) JavaScript
28 165 (12.30%) Data Modelling
29 163 (12.16%) Analytical Skills

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 493 (36.76%) Apache Spark
2 88 (6.56%) Apache
3 70 (5.22%) Apache Airflow
4 65 (4.85%) Elasticsearch
5 27 (2.01%) Luigi
6 26 (1.94%) Jupyter
7 23 (1.72%) Confluence
8 21 (1.57%) SAS
9 12 (0.89%) Apache Solr
10 10 (0.75%) Apache Pig
11 9 (0.67%) Cloud Foundry
12 8 (0.60%) Tornado
13 6 (0.45%) ArcGIS
14 5 (0.37%) CMS
14 5 (0.37%) Moodle
14 5 (0.37%) Oracle Workflow
15 4 (0.30%) IBM Domino
15 4 (0.30%) Tomcat
16 3 (0.22%) NetWeaver
16 3 (0.22%) nginx
Applications
1 21 (1.57%) Microsoft Excel
2 11 (0.82%) SPSS
3 7 (0.52%) Microsoft Office
4 4 (0.30%) Microsoft Project
4 4 (0.30%) MS Visio
5 3 (0.22%) Microsoft PowerPoint
6 2 (0.15%) Chatbot
7 1 (0.075%) InVision
7 1 (0.075%) Sketch
Business Applications
1 7 (0.52%) SAP S/4HANA
2 5 (0.37%) SAP CRM
2 5 (0.37%) SAP ERP
2 5 (0.37%) SAP IS-U
3 4 (0.30%) SAP BPC
4 2 (0.15%) R3 Corda
4 2 (0.15%) SAP HCM
4 2 (0.15%) Sparx Enterprise Architect
5 1 (0.075%) Adobe Campaign
5 1 (0.075%) Distributed Ledger
5 1 (0.075%) NetSuite
5 1 (0.075%) Payment Gateway
5 1 (0.075%) Primavera
5 1 (0.075%) SAP EWM
5 1 (0.075%) SAP FI
5 1 (0.075%) SAP FI/CO
5 1 (0.075%) SAP MM
5 1 (0.075%) SAP Payroll
5 1 (0.075%) SAP WM
5 1 (0.075%) SimCorp Dimension
Cloud Services
1 527 (39.30%) AWS
2 289 (21.55%) Azure
3 254 (18.94%) GCP
4 115 (8.58%) Power Platform
5 88 (6.56%) Amazon S3
6 86 (6.41%) Amazon EMR
7 64 (4.77%) Amazon EC2
8 50 (3.73%) Serverless
9 48 (3.58%) SaaS
10 46 (3.43%) Cloud Computing
11 39 (2.91%) Amazon Kinesis
12 32 (2.39%) Azure Data Factory
13 27 (2.01%) Amazon CloudWatch
14 25 (1.86%) AWS Lambda
15 23 (1.72%) GitHub
16 17 (1.27%) PaaS
17 15 (1.12%) Amazon SQS
17 15 (1.12%) Virtual Private Cloud
18 13 (0.97%) AWS CloudTrail
19 11 (0.82%) Datadog
Communications & Networking
1 23 (1.72%) Internet
2 21 (1.57%) Firewall
3 7 (0.52%) HTTP
4 5 (0.37%) Intrusion Detection
5 3 (0.22%) FTP
5 3 (0.22%) TCP/IP
6 2 (0.15%) DNS
6 2 (0.15%) HTTPS
6 2 (0.15%) NAS
6 2 (0.15%) Network Security
6 2 (0.15%) SAN
7 1 (0.075%) IPFS
7 1 (0.075%) SNMP
7 1 (0.075%) Software-Defined Networking
7 1 (0.075%) SSH
7 1 (0.075%) TACACS
7 1 (0.075%) tcpdump
7 1 (0.075%) VPN
Database & Business Intelligence
1 466 (34.75%) Hadoop
2 255 (19.02%) NoSQL
3 200 (14.91%) Data Warehouse
4 152 (11.33%) Apache Hive
5 151 (11.26%) SQL Server
6 138 (10.29%) Relational Database
7 124 (9.25%) Data Lake
8 115 (8.58%) Power BI
9 113 (8.43%) Amazon Redshift
9 113 (8.43%) PostgreSQL
10 97 (7.23%) MongoDB
11 96 (7.16%) Apache Cassandra
12 70 (5.22%) HBase
13 66 (4.92%) BigQuery
14 64 (4.77%) Amazon DynamoDB
15 58 (4.33%) Neo4j
16 49 (3.65%) MySQL
16 49 (3.65%) SQL Server Integration Services
17 48 (3.58%) Amazon RDS
17 48 (3.58%) Flink
Development Applications
1 158 (11.78%) Git (software)
2 82 (6.11%) Jenkins
3 48 (3.58%) JIRA
4 29 (2.16%) Atlassian Bamboo
5 23 (1.72%) Maven
6 20 (1.49%) Vagrant
7 15 (1.12%) JUnit
8 13 (0.97%) TeamCity
9 12 (0.89%) Artifactory
9 12 (0.89%) GitLab
9 12 (0.89%) Visual Studio Team System
10 11 (0.82%) Jasmine
10 11 (0.82%) Sonatype Nexus
11 10 (0.75%) CircleCI
12 9 (0.67%) Bitbucket
12 9 (0.67%) GoCD
12 9 (0.67%) Octopus Deploy
12 9 (0.67%) Protractor
13 5 (0.37%) Ant
13 5 (0.37%) IBM UrbanCode
General
1 354 (26.40%) Finance
2 112 (8.35%) Banking
3 85 (6.34%) Marketing
4 71 (5.29%) Retail
5 43 (3.21%) Public Sector
6 39 (2.91%) Front Office
7 30 (2.24%) Advertising
8 27 (2.01%) Legal
9 26 (1.94%) Telecoms
10 18 (1.34%) Automotive
10 18 (1.34%) Games
11 14 (1.04%) Law
12 13 (0.97%) Manufacturing
13 12 (0.89%) Pharmaceutical
14 11 (0.82%) Investment Banking
15 10 (0.75%) Brand Awareness
16 7 (0.52%) Financial Institution
17 5 (0.37%) Billing
17 5 (0.37%) Local Government
17 5 (0.37%) Retail Banking
Job Titles
1 367 (27.37%) Data Engineer
2 287 (21.40%) Developer
3 123 (9.17%) Architect
4 120 (8.95%) Big Data Engineer
5 103 (7.68%) Java Developer
6 92 (6.86%) Data Scientist
7 87 (6.49%) Data Architect
8 74 (5.52%) Senior Developer
9 72 (5.37%) Senior Data Engineer
10 59 (4.40%) AWS Engineer
11 58 (4.33%) Python Engineer
12 57 (4.25%) DevOps Engineer
13 53 (3.95%) Senior Data Scientist
14 51 (3.80%) Cloud Engineer
15 49 (3.65%) Analyst
16 47 (3.50%) Consultant
17 43 (3.21%) Big Data Architect
18 42 (3.13%) SQL Developer
19 36 (2.68%) Java Engineer
20 33 (2.46%) Platform Engineer
Libraries, Frameworks & Software Standards
1 331 (24.68%) Kafka
2 113 (8.43%) React
3 86 (6.41%) AngularJS
4 68 (5.07%) Natural Language Processing
5 67 (5.00%) HTML
6 66 (4.92%) Node.js
7 64 (4.77%) TensorFlow
8 62 (4.62%) Web Services
9 61 (4.55%) .NET
10 59 (4.40%) CSS
11 54 (4.03%) Spring
12 51 (3.80%) Spark Streaming
13 48 (3.58%) Django
14 42 (3.13%) RESTful
15 41 (3.06%) REST
16 39 (2.91%) HTML5
17 38 (2.83%) scikit-learn
18 35 (2.61%) NumPy
18 35 (2.61%) XML
19 33 (2.46%) Pandas
Miscellaneous
1 163 (12.16%) Analytical Skills
2 109 (8.13%) Algorithms
3 86 (6.41%) Data Structures
4 69 (5.15%) User Experience
5 60 (4.47%) Greenfield Project
6 41 (3.06%) Enterprise Software
7 36 (2.68%) Cloud Native
7 36 (2.68%) Management Information System
8 30 (2.24%) Hedge funds
9 26 (1.94%) Public Cloud
10 25 (1.86%) Hybrid Cloud
11 24 (1.79%) Equities
12 21 (1.57%) Virtual Team
13 19 (1.42%) Internet of Things
13 19 (1.42%) Self-Motivation
14 17 (1.27%) Blog
14 17 (1.27%) Mobile App
15 15 (1.12%) Foreign Exchange (FX)
15 15 (1.12%) Social Media
16 14 (1.04%) Digital Media
Operating Systems
1 140 (10.44%) Linux
2 38 (2.83%) Unix
3 27 (2.01%) Windows
4 16 (1.19%) Red Hat Enterprise Linux
5 10 (0.75%) Ubuntu
6 9 (0.67%) CentOS
7 7 (0.52%) Fedora
8 5 (0.37%) Android
8 5 (0.37%) Apple iOS
8 5 (0.37%) Windows Server
9 2 (0.15%) Windows 10
9 2 (0.15%) Windows 7
10 1 (0.075%) Debian
10 1 (0.075%) Solaris
Processes & Methodologies
1 514 (38.33%) Agile Software Development
2 512 (38.18%) Analytics
3 413 (30.80%) Data Science
4 361 (26.92%) Machine Learning
5 305 (22.74%) DevOps
6 274 (20.43%) Artificial Intelligence
7 239 (17.82%) ETL
8 224 (16.70%) Business Intelligence
9 180 (13.42%) Computer Science
9 180 (13.42%) Software Engineering
10 176 (13.12%) Microservices
11 165 (12.30%) Data Modelling
12 161 (12.01%) Data Analytics
13 151 (11.26%) Data Engineering
14 141 (10.51%) Fintech
15 129 (9.62%) Visualisation
16 121 (9.02%) Continuous Integration
17 117 (8.72%) Scrum
18 105 (7.83%) OO
19 104 (7.76%) Problem-Solving
Programming Languages
1 653 (48.70%) Python
2 486 (36.24%) SQL
3 439 (32.74%) Java
4 306 (22.82%) Scala
5 174 (12.98%) JavaScript
6 120 (8.95%) C#
7 110 (8.20%) R
8 77 (5.74%) C++
9 59 (4.40%) Go
10 50 (3.73%) Bash Shell
11 49 (3.65%) C
11 49 (3.65%) PHP
12 43 (3.21%) T-SQL
13 38 (2.83%) Java 8
14 31 (2.31%) TypeScript
15 29 (2.16%) Kotlin
16 27 (2.01%) PowerShell
17 24 (1.79%) ES6
17 24 (1.79%) Perl
18 21 (1.57%) PL/SQL
Qualifications
1 232 (17.30%) Degree
2 109 (8.13%) Computer Science Degree
3 69 (5.15%) Security Cleared
4 44 (3.28%) PhD
5 41 (3.06%) SC Cleared
6 36 (2.68%) DV Cleared
7 23 (1.72%) Master's Degree
8 13 (0.97%) Microsoft Certification
9 12 (0.89%) Numerate Degree
10 11 (0.82%) PMI Certification
11 10 (0.75%) CCNA
11 10 (0.75%) Cisco Certification
12 9 (0.67%) CISSP
12 9 (0.67%) CompTIA Security+
12 9 (0.67%) GIAC
12 9 (0.67%) Linux+ Certification
12 9 (0.67%) MCSE
12 9 (0.67%) Network+ Certification
12 9 (0.67%) SANS
12 9 (0.67%) SSCP
Quality Assurance & Compliance
1 63 (4.70%) QA
2 55 (4.10%) Data Quality
3 20 (1.49%) GDPR
4 2 (0.15%) PCI DSS
4 2 (0.15%) SLA
5 1 (0.075%) Actionable Recommendations
5 1 (0.075%) MiFID
5 1 (0.075%) PMO
5 1 (0.075%) Sarbanes-Oxley
System Software
1 225 (16.78%) Docker
2 32 (2.39%) HDFS
3 26 (1.94%) VirtualBox
4 25 (1.86%) Apache ZooKeeper
5 23 (1.72%) Apache Flume
6 12 (0.89%) VMware Infrastructure
7 7 (0.52%) NFS
7 7 (0.52%) Samba
7 7 (0.52%) VMware ESXi
7 7 (0.52%) Xen
8 3 (0.22%) Virtual Machines
8 3 (0.22%) vSphere
9 2 (0.15%) vCloud
10 1 (0.075%) Alluxio
10 1 (0.075%) Ceph
10 1 (0.075%) etcd
10 1 (0.075%) Gluster
10 1 (0.075%) iptables
10 1 (0.075%) Virtual Servers
Systems Management
1 229 (17.08%) Kubernetes
2 109 (8.13%) Ansible
3 91 (6.79%) Terraform
4 47 (3.50%) Puppet
5 32 (2.39%) Opscode Chef
6 30 (2.24%) Docker Swarm
7 20 (1.49%) Hadoop YARN
8 17 (1.27%) Oozie
9 16 (1.19%) Nagios
10 12 (0.89%) Mesos
10 12 (0.89%) Salt
11 10 (0.75%) ZABBIX
12 8 (0.60%) Netcool
12 8 (0.60%) Opsview
12 8 (0.60%) Prometheus
13 7 (0.52%) OpenNMS
13 7 (0.52%) vCenter Server
14 6 (0.45%) HAProxy
14 6 (0.45%) Kibana
14 6 (0.45%) Marathon
Vendors
1 159 (11.86%) Google
2 111 (8.28%) Microsoft
3 95 (7.08%) Oracle
4 85 (6.34%) Tableau
5 55 (4.10%) Informatica
5 55 (4.10%) Talend
6 44 (3.28%) Cloudera
7 43 (3.21%) Hortonworks
8 39 (2.91%) Databricks
8 39 (2.91%) SAP
9 29 (2.16%) IBM
10 24 (1.79%) Ab Initio
11 23 (1.72%) Facebook
12 19 (1.42%) Splunk
13 16 (1.19%) Red Hat
14 12 (0.89%) Sybase
14 12 (0.89%) Teradata
14 12 (0.89%) VMware
15 9 (0.67%) AppDynamics
15 9 (0.67%) Netezza