Period
to 23 September 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 23 September 2018 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
23 Sep 2018
Same period 2017 Same period 2016
Rank 47 68 72
Rank change year-on-year +21 +4 +1
Permanent jobs citing Big Data 3,906 3,255 3,235
As % of all permanent IT jobs advertised in London 5.75% 4.37% 4.10%
As % of the Database & Business Intelligence category 18.47% 14.83% 13.84%
Number of salaries quoted 2,397 2,563 2,695
London median annual salary £70,000 £67,500 £70,000
Median salary % change year-on-year +3.70% -3.57% +7.69%
10th Percentile £46,250 £45,000 £45,000
90th Percentile £100,000 £100,000 £110,000
England median annual salary £65,000 £62,500 £62,500
% change year-on-year +4.00% - +4.17%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,153 21,950 23,368
As % of all permanent IT jobs advertised in London 31.12% 29.46% 29.61%
Number of salaries quoted 16,801 17,643 20,351
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £93,750 £90,000 £87,500
England median annual salary £50,000 £49,000 £47,500
% change year-on-year +2.04% +3.16% +5.56%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 23 September 2018.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 23 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +25 632 £75,000 +11.11% 109
West London +2 67 £62,500 - 51
East London +11 35 £77,500 +3.33% 13
South London -3 16 £82,500 +32.00% 8
North London +4 6 £70,000 -6.67% 4
Big Data
England

For the 6 months to 23 September 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 1,692 (43.32%) Java
2 1,635 (41.86%) Finance
3 1,465 (37.51%) Python
4 1,405 (35.97%) Agile Software Development
5 1,347 (34.49%) SQL
6 1,246 (31.90%) Analytics
7 1,187 (30.39%) Hadoop
8 1,141 (29.21%) Banking
9 1,119 (28.65%) Problem-Solving
10 1,055 (27.01%) Apache Spark
11 903 (23.12%) Investment Banking
12 881 (22.56%) Risk Management
13 848 (21.71%) Financial Institution
14 841 (21.53%) Low Latency
15 839 (21.48%) Amazon AWS
16 831 (21.27%) Analytical Skills
17 829 (21.22%) Strategic Thinking
18 819 (20.97%) Investment Management
19 816 (20.89%) Innovative Thinking
20 807 (20.66%) Degree
21 805 (20.61%) Cyberthreat
22 769 (19.69%) Machine Learning
23 697 (17.84%) Scala
24 662 (16.95%) Data Science
25 657 (16.82%) Kafka
26 626 (16.03%) JavaScript
27 617 (15.80%) ETL
28 607 (15.54%) NoSQL
29 562 (14.39%) Computer Science
30 526 (13.47%) Linux

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,055 (27.01%) Apache Spark
2 222 (5.68%) Apache
3 202 (5.17%) Elasticsearch
4 147 (3.76%) SAS
5 127 (3.25%) Apache Pig
6 64 (1.64%) Apache Solr
7 58 (1.48%) Confluence
8 38 (0.97%) IIS
9 32 (0.82%) Tomcat
10 16 (0.41%) OpenStack
11 13 (0.33%) CMS
11 13 (0.33%) NServiceBus
12 12 (0.31%) Jetty
13 11 (0.28%) WebSphere
13 11 (0.28%) WildFly
14 10 (0.26%) Apache Airflow
14 10 (0.26%) JBoss
14 10 (0.26%) WebLogic
15 9 (0.23%) Jupyter
15 9 (0.23%) SharePoint
Applications
1 93 (2.38%) Microsoft Excel
2 54 (1.38%) Microsoft Office
3 28 (0.72%) SPSS
4 26 (0.67%) MS Visio
5 23 (0.59%) Microsoft PowerPoint
6 10 (0.26%) Chatbot
7 7 (0.18%) GNU Octave
8 4 (0.10%) Microsoft Project
9 2 (0.051%) CPLEX
9 2 (0.051%) EViews
9 2 (0.051%) Mathematica
9 2 (0.051%) PrintSoft PReS
9 2 (0.051%) Stata
10 1 (0.026%) Mingle
10 1 (0.026%) SPSS Modeler
10 1 (0.026%) Weka
Business Applications
1 23 (0.59%) Dynamics CRM
2 17 (0.44%) Dynamics AX
2 17 (0.44%) Dynamics NAV
3 7 (0.18%) Oracle Receivables
4 6 (0.15%) SAP S/4HANA
4 6 (0.15%) Sentinel
5 5 (0.13%) Actimize
6 4 (0.10%) SAP Forecasting and Replenishment
6 4 (0.10%) SAP Retail
7 3 (0.077%) Oracle Payables
7 3 (0.077%) SAP ERP
8 2 (0.051%) Distributed Ledger
8 2 (0.051%) SAP MII
8 2 (0.051%) Temenos T24
9 1 (0.026%) Adobe Campaign
9 1 (0.026%) Eloqua
9 1 (0.026%) Magento
9 1 (0.026%) Markit EDM
9 1 (0.026%) SAP SD
9 1 (0.026%) WebTrends
Cloud Services
1 839 (21.48%) Amazon AWS
2 504 (12.90%) Microsoft Azure
3 162 (4.15%) Google Cloud Platform
4 126 (3.23%) Serverless
5 121 (3.10%) Cloud Computing
6 94 (2.41%) Amazon Kinesis
7 93 (2.38%) PaaS
7 93 (2.38%) SaaS
8 83 (2.12%) Amazon EMR
9 66 (1.69%) AWS Lambda
10 61 (1.56%) IaaS
11 60 (1.54%) Amazon S3
12 54 (1.38%) Azure Data Factory
13 46 (1.18%) Cortana Intelligence Suite
14 37 (0.95%) GitHub
15 36 (0.92%) Amazon EC2
16 30 (0.77%) Adobe Analytics
17 23 (0.59%) AWS CloudFormation
17 23 (0.59%) Google Analytics
18 22 (0.56%) IBM Cloud
Communications & Networking
1 55 (1.41%) Internet
2 53 (1.36%) Firewall
3 37 (0.95%) TCP/IP
4 31 (0.79%) Wireless
5 29 (0.74%) DNS
6 28 (0.72%) Unified Communications
7 27 (0.69%) HTTP
7 27 (0.69%) Sourcefire
7 27 (0.69%) Wireless Security
8 25 (0.64%) WAN
9 24 (0.61%) LAN
10 22 (0.56%) Kerberos
10 22 (0.56%) Network Security
11 20 (0.51%) DHCP
11 20 (0.51%) SAN
11 20 (0.51%) SSL
12 14 (0.36%) Ethernet
12 14 (0.36%) MPLS
12 14 (0.36%) OSPF
12 14 (0.36%) SNMP
Database & Business Intelligence
1 1,187 (30.39%) Hadoop
2 607 (15.54%) NoSQL
3 479 (12.26%) Apache Hive
4 471 (12.06%) Data Warehouse
5 428 (10.96%) SQL Server
6 402 (10.29%) Relational Database
7 292 (7.48%) MongoDB
8 281 (7.19%) Data Lake
9 276 (7.07%) Apache Cassandra
10 225 (5.76%) Power BI
11 200 (5.12%) HBase
12 197 (5.04%) SQL Server Integration Services
13 188 (4.81%) SQL Server Reporting Services
14 174 (4.45%) Amazon Redshift
15 170 (4.35%) RDBMS
16 169 (4.33%) MySQL
17 144 (3.69%) DB2
18 134 (3.43%) Impala
19 119 (3.05%) PostgreSQL
20 109 (2.79%) SQL Server Analysis Services
Development Applications
1 240 (6.14%) Git (software)
2 149 (3.81%) Jenkins
3 111 (2.84%) JIRA
4 92 (2.36%) JUnit
5 84 (2.15%) Maven
6 80 (2.05%) Visual Studio
7 49 (1.25%) Subversion
8 48 (1.23%) Gradle
8 48 (1.23%) Selenium
9 40 (1.02%) Cucumber
10 34 (0.87%) Atlassian Bamboo
11 31 (0.79%) Team Foundation Server
12 29 (0.74%) TeamCity
13 28 (0.72%) Mockito
14 27 (0.69%) Bitbucket
15 24 (0.61%) Vagrant
16 20 (0.51%) Octopus Deploy
17 19 (0.49%) SQL Server Management Studio (SSMS)
18 18 (0.46%) FitNesse
18 18 (0.46%) Visual Studio Team System
General
1 1,635 (41.86%) Finance
2 1,141 (29.21%) Banking
3 903 (23.12%) Investment Banking
4 848 (21.71%) Financial Institution
5 230 (5.89%) Retail
6 207 (5.30%) Marketing
7 175 (4.48%) Front Office
8 117 (3.00%) Games
9 105 (2.69%) Telecoms
10 73 (1.87%) Advertising
11 65 (1.66%) Law
12 61 (1.56%) Automotive
13 57 (1.46%) Legal
14 56 (1.43%) Pharmaceutical
15 49 (1.25%) Manufacturing
16 47 (1.20%) Publishing
17 29 (0.74%) Multimedia
18 28 (0.72%) Electronics
19 15 (0.38%) German Language
20 11 (0.28%) Italian Language
Job Titles
1 1,116 (28.57%) Developer
2 541 (13.85%) Data Engineer
3 421 (10.78%) Architect
4 362 (9.27%) Java Developer
5 343 (8.78%) Big Data Engineer
6 215 (5.50%) Analyst
7 209 (5.35%) Consultant
8 208 (5.33%) Big Data Developer
9 194 (4.97%) Data Scientist
10 190 (4.86%) Data Architect
11 170 (4.35%) Software Engineer
12 157 (4.02%) Senior Developer
13 129 (3.30%) Solutions Architect
14 123 (3.15%) Platform Engineer
15 106 (2.71%) Big Data Architect
16 99 (2.53%) SQL Developer
17 92 (2.36%) Python Engineer
18 91 (2.33%) DevOps Engineer
18 91 (2.33%) Java Engineer
19 86 (2.20%) Python Developer
Libraries, Frameworks & Software Standards
1 657 (16.82%) Kafka
2 360 (9.22%) AngularJS
3 336 (8.60%) .NET
4 315 (8.06%) RESTful
5 294 (7.53%) Web Services
6 291 (7.45%) HTML
7 230 (5.89%) React
8 222 (5.68%) Spring
9 205 (5.25%) REST
10 182 (4.66%) Node.js
11 153 (3.92%) HTML5
12 139 (3.56%) RabbitMQ
13 135 (3.46%) CSS
13 135 (3.46%) XML
14 122 (3.12%) Natural Language Processing
15 106 (2.71%) Akka
16 85 (2.18%) JSON
17 76 (1.95%) Spring Boot
18 74 (1.89%) Hibernate
19 72 (1.84%) JMS
Miscellaneous
1 831 (21.27%) Analytical Skills
2 805 (20.61%) Cyberthreat
3 562 (14.39%) Computer Science
4 334 (8.55%) Algorithms
5 249 (6.37%) Fintech
6 216 (5.53%) Data Structures
7 206 (5.27%) Self-Motivation
8 193 (4.94%) Management Information System
9 180 (4.61%) Greenfield Project
10 161 (4.12%) User Experience
11 153 (3.92%) Fixed Income
12 128 (3.28%) Equities
13 106 (2.71%) Data Centre
14 92 (2.36%) Derivative
15 90 (2.30%) Virtual Team
16 76 (1.95%) Public Cloud
17 71 (1.82%) Hedge funds
18 68 (1.74%) Analytical Mindset
19 65 (1.66%) Credit Risk
20 60 (1.54%) Enterprise Software
Operating Systems
1 526 (13.47%) Linux
2 322 (8.24%) Unix
3 244 (6.25%) Windows
4 44 (1.13%) Windows Server
5 38 (0.97%) Android
6 34 (0.87%) HPUX
6 34 (0.87%) Solaris
7 32 (0.82%) AIX
8 28 (0.72%) Apple iOS
9 15 (0.38%) Red Hat Enterprise Linux
9 15 (0.38%) Windows Server 2008
10 14 (0.36%) CentOS
11 12 (0.31%) Mac OS X
11 12 (0.31%) Ubuntu
12 10 (0.26%) Windows Server 2012
13 9 (0.23%) Windows 7
14 6 (0.15%) Windows 10
15 3 (0.077%) CoreOS
15 3 (0.077%) VMS
15 3 (0.077%) zOS
Processes & Methodologies
1 1,405 (35.97%) Agile Software Development
2 1,246 (31.90%) Analytics
3 1,119 (28.65%) Problem-Solving
4 881 (22.56%) Risk Management
5 841 (21.53%) Low Latency
6 829 (21.22%) Strategic Thinking
7 819 (20.97%) Investment Management
8 816 (20.89%) Innovative Thinking
9 769 (19.69%) Machine Learning
10 662 (16.95%) Data Science
11 617 (15.80%) ETL
12 514 (13.16%) Business Intelligence
13 474 (12.14%) DevOps
14 465 (11.90%) Software Engineering
15 451 (11.55%) TDD
16 427 (10.93%) OO
17 411 (10.52%) Microservices
18 376 (9.63%) SDLC
19 374 (9.58%) Data Modelling
20 364 (9.32%) Data Analytics
Programming Languages
1 1,692 (43.32%) Java
2 1,465 (37.51%) Python
3 1,347 (34.49%) SQL
4 697 (17.84%) Scala
5 626 (16.03%) JavaScript
6 482 (12.34%) C#
7 366 (9.37%) C++
8 336 (8.60%) R
9 223 (5.71%) Java 8
10 191 (4.89%) Perl
11 143 (3.66%) PowerShell
12 141 (3.61%) Bash Shell
12 141 (3.61%) C
13 113 (2.89%) Shell Script
14 109 (2.79%) T-SQL
15 85 (2.18%) PHP
16 75 (1.92%) MATLAB
16 75 (1.92%) Ruby
17 50 (1.28%) Go
18 42 (1.08%) TypeScript
Qualifications
1 807 (20.66%) Degree
2 258 (6.61%) Computer Science Degree
3 137 (3.51%) PhD
4 131 (3.35%) Master's Degree
5 68 (1.74%) Security Cleared
6 53 (1.36%) CISSP
7 50 (1.28%) Numerate Degree
8 44 (1.13%) Cisco Certification
9 40 (1.02%) CCNA
10 36 (0.92%) Microsoft Certification
11 32 (0.82%) DV Cleared
12 31 (0.79%) PMI Certification
13 29 (0.74%) CCIE
13 29 (0.74%) PMP
14 27 (0.69%) AWS Certification
15 26 (0.67%) CEH
16 25 (0.64%) OSCP
17 24 (0.61%) GCIH
18 23 (0.59%) MCSE
19 19 (0.49%) CCNP
Quality Assurance & Compliance
1 174 (4.45%) QA
2 157 (4.02%) Data Quality
3 53 (1.36%) GDPR
4 31 (0.79%) ISO/IEC 27001
5 20 (0.51%) Solvency II
6 19 (0.49%) PMO
7 18 (0.46%) MiFID
8 16 (0.41%) Dodd-Frank
8 16 (0.41%) FATCA
8 16 (0.41%) IFRS
8 16 (0.41%) IFRS 9
9 11 (0.28%) GPG13
10 9 (0.23%) COBIT
11 6 (0.15%) PCI DSS
12 5 (0.13%) Actionable Recommendations
12 5 (0.13%) ISO 14001
12 5 (0.13%) SLA
13 4 (0.10%) Sarbanes-Oxley
14 3 (0.077%) GxP
14 3 (0.077%) PSD2
System Software
1 335 (8.58%) Docker
2 208 (5.33%) HDFS
3 108 (2.76%) Apache Flume
4 53 (1.36%) VMware Infrastructure
5 41 (1.05%) Active Directory
6 38 (0.97%) Virtual Machines
7 29 (0.74%) Apache ZooKeeper
8 27 (0.69%) Snort
9 22 (0.56%) VirtualBox
10 14 (0.36%) iptables
10 14 (0.36%) vSphere
11 13 (0.33%) Virtual Desktop
12 11 (0.28%) Hyper-V
12 11 (0.28%) VMware NSX
13 10 (0.26%) VMware ESXi
14 6 (0.15%) Microsoft App-V
14 6 (0.15%) XenDesktop
15 5 (0.13%) KVM
16 3 (0.077%) Tivoli Workload Scheduler
17 2 (0.051%) Xen
Systems Management
1 184 (4.71%) Kubernetes
2 157 (4.02%) Ansible
3 127 (3.25%) Puppet
4 109 (2.79%) Oozie
5 108 (2.76%) Terraform
6 82 (2.10%) Opscode Chef
7 63 (1.61%) Hadoop YARN
8 57 (1.46%) Mesos
9 53 (1.36%) Kibana
10 42 (1.08%) Salt
11 28 (0.72%) logstash
12 27 (0.69%) Docker Swarm
13 26 (0.67%) Grafana
13 26 (0.67%) Prometheus
14 24 (0.61%) Suricata
15 17 (0.44%) ITRS Geneos
16 14 (0.36%) Consul
17 13 (0.33%) Automic
17 13 (0.33%) WSUS
18 12 (0.31%) CFEngine
Vendors
1 437 (11.19%) Microsoft
2 299 (7.65%) Oracle
3 283 (7.25%) Tableau
4 234 (5.99%) Google
5 199 (5.09%) Cloudera
6 179 (4.58%) Sybase
7 144 (3.69%) Hortonworks
8 108 (2.76%) Informatica
9 96 (2.46%) Talend
10 85 (2.18%) IBM
11 83 (2.12%) Splunk
12 77 (1.97%) VMware
13 68 (1.74%) SAP
14 66 (1.69%) Cisco
14 66 (1.69%) MapR
15 54 (1.38%) Databricks
16 43 (1.10%) ServiceNow
17 41 (1.05%) EMC
18 40 (1.02%) Adobe
18 40 (1.02%) Cognizant