Period
to 17 October 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 17 October 2019 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
17 Oct 2019
Same period 2018 Same period 2017
Rank 57 48 67
Rank change year-on-year -9 +19 +4
Permanent jobs citing Big Data 2,497 3,780 3,294
As % of all permanent IT jobs advertised in London 4.57% 5.57% 4.42%
As % of the Database & Business Intelligence category 16.00% 18.08% 14.96%
Number of salaries quoted 2,017 2,367 2,590
London median annual salary £77,500 £70,000 £67,500
Median salary % change year-on-year +10.71% +3.70% -3.57%
10th Percentile £48,750 £45,000 £45,000
90th Percentile £115,000 £101,250 £100,000
England median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,607 20,912 22,026
As % of all permanent IT jobs advertised in London 28.54% 30.81% 29.58%
Number of salaries quoted 12,915 16,662 17,638
London median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £38,000 £37,500 £36,250
90th Percentile £97,500 £94,200 £90,000
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 17 October 2019.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 17 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +12 646 £75,000 - 115
West London +6 42 £62,000 -0.80% 33
East London +31 33 £70,000 -12.50% 25
South London -6 21 £77,500 +3.33% 10
North London -1 3 £75,000 +7.14% 1
Big Data
England

For the 6 months to 17 October 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 1,108 (44.37%) Python
2 1,071 (42.89%) Analytics
3 987 (39.53%) Agile Software Development
4 914 (36.60%) SQL
5 909 (36.40%) Java
6 868 (34.76%) AWS
7 787 (31.52%) Apache Spark
8 767 (30.72%) Hadoop
9 750 (30.04%) Machine Learning
10 705 (28.23%) Data Science
11 630 (25.23%) Azure
12 606 (24.27%) Finance
13 525 (21.03%) DevOps
14 480 (19.22%) Business Intelligence
15 468 (18.74%) NoSQL
16 460 (18.42%) ETL
17 436 (17.46%) Docker
18 430 (17.22%) Microservices
19 426 (17.06%) Data Warehouse
20 424 (16.98%) Scala
21 411 (16.46%) Software Engineering
22 401 (16.06%) Artificial Intelligence
22 401 (16.06%) Kafka
23 398 (15.94%) GCP
24 382 (15.30%) Apache Hive
25 378 (15.14%) Linux
26 369 (14.78%) Data Analytics
27 366 (14.66%) Degree
28 333 (13.34%) Data Modelling
29 321 (12.86%) Google

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 787 (31.52%) Apache Spark
2 136 (5.45%) Elasticsearch
3 125 (5.01%) Apache
4 62 (2.48%) Apache Airflow
5 49 (1.96%) Apache Pig
6 43 (1.72%) SAS
7 30 (1.20%) Apache Solr
8 21 (0.84%) Jupyter
9 18 (0.72%) CMS
9 18 (0.72%) Confluence
10 15 (0.60%) OpenStack
10 15 (0.60%) Tornado
11 11 (0.44%) Luigi
12 10 (0.40%) IIS
12 10 (0.40%) WildFly
13 9 (0.36%) nginx
14 8 (0.32%) SharePoint
15 7 (0.28%) Cloud Foundry
16 4 (0.16%) IPython
16 4 (0.16%) Magnolia
Applications
1 48 (1.92%) Microsoft Excel
2 16 (0.64%) Microsoft Office
3 11 (0.44%) SPSS
4 9 (0.36%) Microsoft PowerPoint
5 8 (0.32%) Microsoft Project
6 4 (0.16%) GNU Octave
7 2 (0.080%) Sketch
7 2 (0.080%) Stata
8 1 (0.040%) Adobe Premiere
8 1 (0.040%) InVision
8 1 (0.040%) Mathematica
8 1 (0.040%) MS Visio
8 1 (0.040%) SPSS Modeler
Business Applications
1 23 (0.92%) SAP S/4HANA
2 15 (0.60%) Sparx Enterprise Architect
3 7 (0.28%) PolarLake
4 4 (0.16%) Eagle PACE
4 4 (0.16%) Markit EDM
4 4 (0.16%) SAP ERP
4 4 (0.16%) SDL Web 8
5 3 (0.12%) Adobe Campaign
5 3 (0.12%) Dynamics CRM
5 3 (0.12%) SAP Business ByDesign
5 3 (0.12%) SAP HCM
5 3 (0.12%) SAP Payroll
6 1 (0.040%) Data Workbench
6 1 (0.040%) Oracle Payables
6 1 (0.040%) Oracle Receivables
6 1 (0.040%) Payment Gateway
6 1 (0.040%) Salesforce.com CRM
6 1 (0.040%) SAP MM
6 1 (0.040%) SAP Oil and Gas
6 1 (0.040%) SAP SCM
Cloud Services
1 868 (34.76%) AWS
2 630 (25.23%) Azure
3 398 (15.94%) GCP
4 142 (5.69%) Power Platform
5 136 (5.45%) Amazon S3
6 94 (3.76%) Amazon EMR
6 94 (3.76%) Cloud Computing
7 90 (3.60%) Serverless
8 84 (3.36%) SaaS
9 78 (3.12%) PaaS
10 68 (2.72%) Amazon EC2
11 66 (2.64%) Amazon ECS
12 60 (2.40%) Amazon SQS
13 50 (2.00%) AWS Lambda
14 48 (1.92%) Azure Data Factory
15 45 (1.80%) AWS Fargate
16 41 (1.64%) Amazon Kinesis
17 39 (1.56%) GitHub
18 33 (1.32%) IaaS
19 31 (1.24%) OpenShift
Communications & Networking
1 83 (3.32%) Internet
2 31 (1.24%) Firewall
3 18 (0.72%) TCP/IP
4 16 (0.64%) DHCP
4 16 (0.64%) DNS
4 16 (0.64%) VPN
5 15 (0.60%) DMZ
6 14 (0.56%) Kerberos
7 11 (0.44%) HTTPS
8 10 (0.40%) HTTP
9 9 (0.36%) Unified Communications
10 6 (0.24%) SSH
11 5 (0.20%) SSL
12 4 (0.16%) Wi-Fi
13 3 (0.12%) Broadband
13 3 (0.12%) Converged Networks
13 3 (0.12%) SMS
13 3 (0.12%) SNMP
14 1 (0.040%) Intranet
14 1 (0.040%) UMTS
Database & Business Intelligence
1 767 (30.72%) Hadoop
2 468 (18.74%) NoSQL
3 426 (17.06%) Data Warehouse
4 382 (15.30%) Apache Hive
5 256 (10.25%) SQL Server
6 185 (7.41%) MongoDB
7 172 (6.89%) Data Lake
8 166 (6.65%) Relational Database
9 142 (5.69%) Power BI
10 135 (5.41%) PostgreSQL
11 126 (5.05%) HBase
12 116 (4.65%) Apache Cassandra
13 114 (4.57%) Amazon Redshift
14 92 (3.68%) MySQL
15 89 (3.56%) BigQuery
15 89 (3.56%) SQL Server Integration Services
16 84 (3.36%) Impala
17 78 (3.12%) Flink
17 78 (3.12%) SQL Server Analysis Services
18 72 (2.88%) Presto
Development Applications
1 281 (11.25%) Git (software)
2 214 (8.57%) Jenkins
3 88 (3.52%) JIRA
4 35 (1.40%) GitLab
5 33 (1.32%) Atlassian Bamboo
6 30 (1.20%) Bitbucket
6 30 (1.20%) Visual Studio
7 27 (1.08%) Selenium
8 24 (0.96%) Vagrant
9 22 (0.88%) Artifactory
9 22 (0.88%) JUnit
10 21 (0.84%) Bower
11 19 (0.76%) Gradle
12 18 (0.72%) TeamCity
13 17 (0.68%) git-flow
14 16 (0.64%) Visual Studio Team System
15 15 (0.60%) ERwin
15 15 (0.60%) Maven
16 14 (0.56%) ProC
16 14 (0.56%) Team Foundation Server
General
1 606 (24.27%) Finance
2 205 (8.21%) Banking
3 170 (6.81%) Retail
4 162 (6.49%) Marketing
5 91 (3.64%) Front Office
6 80 (3.20%) Law
7 78 (3.12%) Telecoms
8 74 (2.96%) Games
9 63 (2.52%) Public Sector
10 45 (1.80%) Advertising
11 41 (1.64%) Pharmaceutical
12 37 (1.48%) Investment Banking
13 33 (1.32%) Automotive
14 31 (1.24%) Financial Institution
15 30 (1.20%) Manufacturing
16 28 (1.12%) Legal
17 22 (0.88%) Billing
17 22 (0.88%) Multimedia
18 20 (0.80%) Publishing
19 9 (0.36%) Retail Banking
Job Titles
1 651 (26.07%) Developer
2 491 (19.66%) Data Engineer
3 318 (12.74%) Java Developer
4 299 (11.97%) Architect
5 167 (6.69%) Python Engineer
6 154 (6.17%) Data Scientist
7 152 (6.09%) Data Architect
8 148 (5.93%) Consultant
9 147 (5.89%) Big Data Engineer
10 140 (5.61%) Software Engineer
11 124 (4.97%) Senior Data Engineer
12 123 (4.93%) Senior Developer
13 112 (4.49%) AWS Engineer
14 109 (4.37%) Python Developer
15 101 (4.04%) Analyst
15 101 (4.04%) DevOps Engineer
16 100 (4.00%) Java Engineer
17 86 (3.44%) Solutions Architect
18 82 (3.28%) Big Data Developer
19 81 (3.24%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 401 (16.06%) Kafka
2 254 (10.17%) Web Services
3 148 (5.93%) REST
4 144 (5.77%) .NET
4 144 (5.77%) Node.js
5 140 (5.61%) React
6 119 (4.77%) HTML
6 119 (4.77%) Spring
7 113 (4.53%) RESTful
8 111 (4.45%) AngularJS
9 104 (4.16%) Pandas
10 87 (3.48%) CSS
11 79 (3.16%) Natural Language Processing
12 75 (3.00%) TensorFlow
13 74 (2.96%) J2EE
14 68 (2.72%) NumPy
15 60 (2.40%) scikit-learn
16 59 (2.36%) Spring Boot
17 50 (2.00%) Flask
18 46 (1.84%) PySpark
Miscellaneous
1 300 (12.01%) Analytical Skills
2 222 (8.89%) Algorithms
3 165 (6.61%) Data Structures
4 116 (4.65%) User Experience
5 105 (4.21%) Greenfield Project
6 83 (3.32%) Management Information System
7 52 (2.08%) Fixed Income
8 50 (2.00%) Data Centre
9 49 (1.96%) Equities
9 49 (1.96%) Life Science
10 47 (1.88%) Virtual Team
11 43 (1.72%) Internet of Things
11 43 (1.72%) Social Media
12 42 (1.68%) Cloud Native
13 40 (1.60%) Enterprise Software
14 38 (1.52%) Public Cloud
15 36 (1.44%) Foreign Exchange (FX)
16 35 (1.40%) Credit Risk
16 35 (1.40%) Reference Data
17 32 (1.28%) Linux Command Line
Operating Systems
1 378 (15.14%) Linux
2 140 (5.61%) Unix
3 55 (2.20%) Windows
4 23 (0.92%) Android
5 21 (0.84%) CentOS
5 21 (0.84%) Ubuntu
6 17 (0.68%) Apple iOS
7 15 (0.60%) Solaris
8 11 (0.44%) Windows Server
9 9 (0.36%) Red Hat Enterprise Linux
10 7 (0.28%) Debian
11 6 (0.24%) Windows 10
11 6 (0.24%) Windows 7
12 4 (0.16%) Windows Server 2012
13 2 (0.080%) Fedora
14 1 (0.040%) Mac OS
14 1 (0.040%) Mac OS X
Processes & Methodologies
1 1,071 (42.89%) Analytics
2 987 (39.53%) Agile Software Development
3 750 (30.04%) Machine Learning
4 705 (28.23%) Data Science
5 525 (21.03%) DevOps
6 480 (19.22%) Business Intelligence
7 460 (18.42%) ETL
8 430 (17.22%) Microservices
9 411 (16.46%) Software Engineering
10 401 (16.06%) Artificial Intelligence
11 369 (14.78%) Data Analytics
12 333 (13.34%) Data Modelling
13 258 (10.33%) Computer Science
14 256 (10.25%) Data Engineering
15 255 (10.21%) Problem-Solving
16 236 (9.45%) TDD
17 201 (8.05%) Visualisation
18 199 (7.97%) Scrum
19 177 (7.09%) Open Source
20 170 (6.81%) Data Architecture
Programming Languages
1 1,108 (44.37%) Python
2 914 (36.60%) SQL
3 909 (36.40%) Java
4 424 (16.98%) Scala
5 293 (11.73%) JavaScript
6 288 (11.53%) R
7 192 (7.69%) C#
8 121 (4.85%) C
9 112 (4.49%) Bash Shell
10 92 (3.68%) C++
11 89 (3.56%) Java 8
12 78 (3.12%) PL/SQL
13 58 (2.32%) TypeScript
14 50 (2.00%) Go
15 47 (1.88%) ES6
16 41 (1.64%) Shell Script
17 38 (1.52%) T-SQL
18 35 (1.40%) PHP
19 27 (1.08%) Ruby
20 23 (0.92%) Kotlin
Qualifications
1 366 (14.66%) Degree
2 122 (4.89%) Computer Science Degree
3 85 (3.40%) PhD
4 56 (2.24%) Master's Degree
5 52 (2.08%) Security Cleared
6 32 (1.28%) Microsoft Certification
7 31 (1.24%) Numerate Degree
8 27 (1.08%) PMI Certification
9 24 (0.96%) DV Cleared
10 18 (0.72%) SAP Certification
11 17 (0.68%) PMP
11 17 (0.68%) SC Cleared
12 16 (0.64%) MCP
13 15 (0.60%) CISSP
13 15 (0.60%) MBA
13 15 (0.60%) RHCE
14 12 (0.48%) Cisco Certification
15 8 (0.32%) CCNA
15 8 (0.32%) CISM
15 8 (0.32%) MCSE
Quality Assurance & Compliance
1 160 (6.41%) QA
2 139 (5.57%) Data Quality
3 38 (1.52%) GDPR
4 16 (0.64%) SLA
5 14 (0.56%) ISO/IEC 27001
6 13 (0.52%) PCI DSS
7 8 (0.32%) PSD2
8 3 (0.12%) GxP
8 3 (0.12%) MiFID
9 1 (0.040%) Basel III
9 1 (0.040%) IFRS
9 1 (0.040%) IFRS 9
9 1 (0.040%) PMO
System Software
1 436 (17.46%) Docker
2 109 (4.37%) HDFS
3 30 (1.20%) Apache Flume
4 26 (1.04%) Active Directory
5 25 (1.00%) Apache ZooKeeper
6 17 (0.68%) NFS
6 17 (0.68%) VirtualBox
7 15 (0.60%) Firmware
7 15 (0.60%) VMware Infrastructure
8 2 (0.080%) Samba
8 2 (0.080%) VMware ESXi
8 2 (0.080%) Xen
9 1 (0.040%) Hyper-V
9 1 (0.040%) KVM
9 1 (0.040%) Varnish
9 1 (0.040%) Virtual Machines
Systems Management
1 294 (11.77%) Kubernetes
2 174 (6.97%) Ansible
3 157 (6.29%) Terraform
4 90 (3.60%) Hadoop YARN
5 76 (3.04%) Oozie
6 66 (2.64%) Puppet
7 57 (2.28%) Opscode Chef
8 28 (1.12%) Docker Swarm
9 24 (0.96%) Ambari
10 16 (0.64%) Consul
11 10 (0.40%) Packer
12 9 (0.36%) Single Sign-On
13 7 (0.28%) Salt
14 6 (0.24%) Kibana
14 6 (0.24%) Mesos
14 6 (0.24%) Rancher
15 5 (0.20%) BMC PATROL
15 5 (0.20%) HP Quality Center
15 5 (0.20%) Nagios
15 5 (0.20%) Tivoli
Vendors
1 321 (12.86%) Google
2 272 (10.89%) Microsoft
3 181 (7.25%) Oracle
4 159 (6.37%) Tableau
5 134 (5.37%) Cloudera
6 112 (4.49%) Hortonworks
7 84 (3.36%) Informatica
8 80 (3.20%) SAP
9 76 (3.04%) Databricks
10 67 (2.68%) IBM
11 64 (2.56%) Splunk
12 54 (2.16%) Talend
13 47 (1.88%) Teradata
14 44 (1.76%) Salesforce.com
15 32 (1.28%) Facebook
16 27 (1.08%) VMware
17 24 (0.96%) Red Hat
18 17 (0.68%) Adobe
18 17 (0.68%) MapR
18 17 (0.68%) Netezza