Period
to 14 December 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 14 December 2018 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
14 Dec 2018
Same period 2017 Same period 2016
Rank 56 65 67
Rank change year-on-year +9 +2 -1
Permanent jobs citing Big Data 3,268 3,486 3,263
As % of all permanent IT jobs advertised in London 4.92% 4.71% 4.39%
As % of the Database & Business Intelligence category 16.48% 15.90% 14.78%
Number of salaries quoted 2,462 2,797 2,809
London median annual salary £75,000 £70,000 £70,000
Median salary % change year-on-year +7.14% - +7.69%
10th Percentile £46,250 £45,000 £44,575
90th Percentile £105,000 £100,000 £107,500
England median annual salary £67,500 £62,500 £62,500
% change year-on-year +8.00% - +4.17%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 19,828 21,919 22,076
As % of all permanent IT jobs advertised in London 29.86% 29.59% 29.72%
Number of salaries quoted 16,268 17,625 19,228
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £95,000 £90,000 £87,500
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% +5.56%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 14 December 2018.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 14 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +19 629 £75,000 +7.14% 110
West London +5 47 £61,250 -2.00% 64
South London -18 20 £73,750 +9.26% 7
East London +5 19 £80,000 +9.97% 32
North London +7 7 £75,000 -25.00% 3
Big Data
England

For the 6 months to 14 December 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 1,378 (42.17%) Java
2 1,353 (41.40%) Python
3 1,314 (40.21%) Agile Software Development
4 1,160 (35.50%) Hadoop
5 1,073 (32.83%) SQL
6 1,069 (32.71%) Finance
7 1,023 (31.30%) Analytics
8 1,010 (30.91%) Apache Spark
9 899 (27.51%) Amazon AWS
10 740 (22.64%) Machine Learning
11 629 (19.25%) Scala
11 629 (19.25%) Data Science
12 626 (19.16%) Kafka
13 619 (18.94%) NoSQL
14 602 (18.42%) Degree
15 601 (18.39%) Banking
16 590 (18.05%) Microsoft Azure
17 559 (17.11%) ETL
18 535 (16.37%) DevOps
19 522 (15.97%) Problem-Solving
20 502 (15.36%) Apache Hive
21 495 (15.15%) Software Engineering
22 486 (14.87%) Business Intelligence
23 438 (13.40%) JavaScript
24 435 (13.31%) Linux
25 431 (13.19%) Analytical Skills
26 410 (12.55%) Artificial Intelligence
27 406 (12.42%) TDD
28 402 (12.30%) Computer Science
29 397 (12.15%) Data Warehouse

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,010 (30.91%) Apache Spark
2 240 (7.34%) Elasticsearch
3 210 (6.43%) Apache
4 162 (4.96%) Apache Pig
5 119 (3.64%) SAS
6 74 (2.26%) Apache Solr
7 41 (1.25%) Confluence
8 25 (0.76%) Tomcat
9 22 (0.67%) CMS
10 21 (0.64%) IIS
11 17 (0.52%) Apache Airflow
12 14 (0.43%) MS Exchange
13 12 (0.37%) Jupyter
13 12 (0.37%) OpenStack
13 12 (0.37%) WildFly
14 10 (0.31%) Jetty
15 9 (0.28%) Oracle SOA Suite
15 9 (0.28%) SharePoint
16 8 (0.24%) Luigi
17 7 (0.21%) WebSphere
Applications
1 79 (2.42%) Microsoft Excel
2 32 (0.98%) Microsoft Office
3 28 (0.86%) SPSS
4 19 (0.58%) Microsoft PowerPoint
5 14 (0.43%) Chatbot
6 13 (0.40%) MS Visio
7 12 (0.37%) Snapchat
8 9 (0.28%) GNU Octave
9 6 (0.18%) Stata
10 5 (0.15%) InVision
10 5 (0.15%) Microsoft Project
11 1 (0.031%) CPLEX
11 1 (0.031%) Open Workbench
Business Applications
1 20 (0.61%) Dynamics CRM
2 13 (0.40%) Dynamics AX
2 13 (0.40%) Dynamics NAV
3 9 (0.28%) SAP S/4HANA
4 8 (0.24%) Oracle Payables
4 8 (0.24%) Oracle Receivables
5 4 (0.12%) Distributed Ledger
5 4 (0.12%) MetaTrader
5 4 (0.12%) SAP ERP
6 2 (0.061%) Oracle BRM
6 2 (0.061%) Oracle CRM On Demand
6 2 (0.061%) SAP MII
6 2 (0.061%) Sentinel
6 2 (0.061%) Temenos T24
7 1 (0.031%) Actimize
7 1 (0.031%) Eloqua
7 1 (0.031%) Markit EDM
7 1 (0.031%) Oracle BPM
7 1 (0.031%) SAP SCM
7 1 (0.031%) Unica
Cloud Services
1 899 (27.51%) Amazon AWS
2 590 (18.05%) Microsoft Azure
3 316 (9.67%) Google Cloud Platform
4 114 (3.49%) Cloud Computing
5 110 (3.37%) Serverless
6 86 (2.63%) PaaS
7 77 (2.36%) Amazon EMR
8 74 (2.26%) AWS Lambda
9 71 (2.17%) Amazon Kinesis
9 71 (2.17%) SaaS
10 50 (1.53%) Amazon S3
11 49 (1.50%) GitHub
12 41 (1.25%) Azure Data Factory
13 35 (1.07%) AWS CloudFormation
14 32 (0.98%) IaaS
15 31 (0.95%) Data Lake Analytics
16 29 (0.89%) Amazon SQS
17 27 (0.83%) Amazon EC2
18 23 (0.70%) Cortana Intelligence Suite
19 20 (0.61%) Office 365
Communications & Networking
1 66 (2.02%) Internet
2 46 (1.41%) Firewall
3 26 (0.80%) HTTP
4 25 (0.76%) VPN
5 21 (0.64%) TCP/IP
6 19 (0.58%) Network Security
6 19 (0.58%) WAN
7 18 (0.55%) DNS
8 17 (0.52%) SAN
9 14 (0.43%) Kerberos
9 14 (0.43%) LAN
10 11 (0.34%) Sourcefire
11 9 (0.28%) DHCP
12 8 (0.24%) SSL
13 7 (0.21%) AMQP
13 7 (0.21%) VSAN
14 5 (0.15%) MPLS
14 5 (0.15%) NAS
14 5 (0.15%) SNMP
14 5 (0.15%) Unified Communications
Database & Business Intelligence
1 1,160 (35.50%) Hadoop
2 619 (18.94%) NoSQL
3 502 (15.36%) Apache Hive
4 397 (12.15%) Data Warehouse
5 346 (10.59%) Apache Cassandra
6 344 (10.53%) SQL Server
7 292 (8.94%) Relational Database
8 285 (8.72%) HBase
9 239 (7.31%) MongoDB
10 218 (6.67%) Amazon Redshift
11 194 (5.94%) Impala
12 182 (5.57%) Data Lake
13 167 (5.11%) Power BI
14 162 (4.96%) MySQL
15 159 (4.87%) SQL Server Integration Services
16 140 (4.28%) SQL Server Reporting Services
17 123 (3.76%) Flink
18 120 (3.67%) PostgreSQL
19 104 (3.18%) RDBMS
20 88 (2.69%) SQL Server Analysis Services
Development Applications
1 218 (6.67%) Git (software)
2 146 (4.47%) Jenkins
3 73 (2.23%) JIRA
4 61 (1.87%) Maven
5 59 (1.81%) Visual Studio
6 51 (1.56%) JUnit
7 39 (1.19%) Selenium
8 32 (0.98%) Team Foundation Server
9 29 (0.89%) TeamCity
10 28 (0.86%) Octopus Deploy
11 27 (0.83%) Cucumber
12 26 (0.80%) Atlassian Bamboo
13 23 (0.70%) Visual Studio Team System
14 20 (0.61%) Gradle
15 19 (0.58%) ERwin
15 19 (0.58%) Subversion
16 18 (0.55%) ER Studio
17 15 (0.46%) EasyMock
18 13 (0.40%) SpecFlow
19 12 (0.37%) Bitbucket
General
1 1,069 (32.71%) Finance
2 601 (18.39%) Banking
3 310 (9.49%) Investment Banking
4 250 (7.65%) Financial Institution
5 200 (6.12%) Retail
6 178 (5.45%) Marketing
7 131 (4.01%) Law
8 125 (3.82%) Games
9 115 (3.52%) Telecoms
10 79 (2.42%) Automotive
11 76 (2.33%) Military
12 61 (1.87%) Advertising
13 54 (1.65%) Front Office
13 54 (1.65%) Publishing
14 47 (1.44%) Pharmaceutical
15 33 (1.01%) Electronics
15 33 (1.01%) Manufacturing
16 31 (0.95%) Legal
17 11 (0.34%) Billing
17 11 (0.34%) Retail Banking
Job Titles
1 971 (29.71%) Developer
2 536 (16.40%) Data Engineer
3 381 (11.66%) Architect
4 352 (10.77%) Java Developer
5 338 (10.34%) Big Data Engineer
6 212 (6.49%) Data Architect
7 189 (5.78%) Consultant
8 169 (5.17%) Data Scientist
9 164 (5.02%) Analyst
10 163 (4.99%) Big Data Developer
11 160 (4.90%) Senior Developer
12 143 (4.38%) Software Engineer
13 115 (3.52%) Solutions Architect
14 99 (3.03%) Big Data Architect
15 89 (2.72%) DevOps Engineer
16 87 (2.66%) Python Developer
17 86 (2.63%) Senior Data Engineer
18 85 (2.60%) Hadoop Engineer
18 85 (2.60%) SQL Developer
19 84 (2.57%) Python Engineer
Libraries, Frameworks & Software Standards
1 626 (19.16%) Kafka
2 264 (8.08%) .NET
3 214 (6.55%) AngularJS
4 210 (6.43%) RESTful
5 207 (6.33%) Web Services
6 196 (6.00%) HTML
7 191 (5.84%) React
8 182 (5.57%) REST
9 168 (5.14%) Node.js
10 163 (4.99%) Spring
11 114 (3.49%) Natural Language Processing
12 108 (3.30%) CSS
12 108 (3.30%) HTML5
13 77 (2.36%) XML
14 73 (2.23%) Hibernate
15 68 (2.08%) Spark Streaming
16 64 (1.96%) Django
17 62 (1.90%) Middleware
18 60 (1.84%) Pandas
19 59 (1.81%) RabbitMQ
Miscellaneous
1 431 (13.19%) Analytical Skills
2 256 (7.83%) Algorithms
3 228 (6.98%) Cyberthreat
4 182 (5.57%) Fintech
5 153 (4.68%) Data Structures
6 148 (4.53%) Greenfield Project
7 121 (3.70%) User Experience
8 111 (3.40%) Management Information System
9 89 (2.72%) Self-Motivation
10 75 (2.29%) Hedge funds
11 66 (2.02%) Data Centre
12 60 (1.84%) Virtual Team
13 59 (1.81%) Equities
14 57 (1.74%) Public Cloud
15 54 (1.65%) Mobile App
16 48 (1.47%) Enterprise Software
17 45 (1.38%) Social Media
18 43 (1.32%) Fixed Income
19 42 (1.29%) Derivative
19 42 (1.29%) Tandem
Operating Systems
1 435 (13.31%) Linux
2 233 (7.13%) Unix
3 180 (5.51%) Windows
4 45 (1.38%) Android
5 38 (1.16%) Windows Server
6 32 (0.98%) Apple iOS
7 22 (0.67%) HPUX
7 22 (0.67%) Solaris
8 20 (0.61%) Ubuntu
9 19 (0.58%) AIX
10 15 (0.46%) CentOS
11 13 (0.40%) Red Hat Enterprise Linux
12 10 (0.31%) Windows Server 2008
13 6 (0.18%) Mac OS X
14 4 (0.12%) CoreOS
14 4 (0.12%) zOS
15 3 (0.092%) Windows 7
16 2 (0.061%) Kali Linux
16 2 (0.061%) Windows 10
16 2 (0.061%) Windows Server 2012
Processes & Methodologies
1 1,314 (40.21%) Agile Software Development
2 1,023 (31.30%) Analytics
3 740 (22.64%) Machine Learning
4 629 (19.25%) Data Science
5 559 (17.11%) ETL
6 535 (16.37%) DevOps
7 522 (15.97%) Problem-Solving
8 495 (15.15%) Software Engineering
9 486 (14.87%) Business Intelligence
10 410 (12.55%) Artificial Intelligence
11 406 (12.42%) TDD
12 402 (12.30%) Computer Science
13 382 (11.69%) Data Modelling
14 367 (11.23%) Microservices
15 347 (10.62%) Continuous Integration
16 332 (10.16%) Data Analytics
17 322 (9.85%) Scrum
18 294 (9.00%) Risk Management
19 286 (8.75%) Low Latency
19 286 (8.75%) Open Source
Programming Languages
1 1,378 (42.17%) Java
2 1,353 (41.40%) Python
3 1,073 (32.83%) SQL
4 629 (19.25%) Scala
5 438 (13.40%) JavaScript
6 380 (11.63%) C#
7 305 (9.33%) R
8 241 (7.37%) Java 8
9 240 (7.34%) C++
10 129 (3.95%) Bash Shell
11 121 (3.70%) PowerShell
12 92 (2.82%) C
13 88 (2.69%) Perl
14 86 (2.63%) T-SQL
15 69 (2.11%) PHP
16 68 (2.08%) Ruby
17 67 (2.05%) MATLAB
18 63 (1.93%) Shell Script
19 50 (1.53%) Go
20 39 (1.19%) PL/SQL
Qualifications
1 602 (18.42%) Degree
2 190 (5.81%) Computer Science Degree
3 107 (3.27%) PhD
4 81 (2.48%) Master's Degree
5 73 (2.23%) Security Cleared
6 43 (1.32%) AWS Certification
7 40 (1.22%) DV Cleared
8 39 (1.19%) CISSP
9 34 (1.04%) Numerate Degree
10 29 (0.89%) Cisco Certification
11 27 (0.83%) SC Cleared
12 22 (0.67%) CCIE
13 21 (0.64%) Microsoft Certification
14 16 (0.49%) PMI Certification
15 15 (0.46%) CEH
15 15 (0.46%) CISM
16 14 (0.43%) PMP
17 12 (0.37%) CompTIA Security+
18 11 (0.34%) MBA
19 10 (0.31%) GCIH
Quality Assurance & Compliance
1 184 (5.63%) Data Quality
2 139 (4.25%) QA
3 47 (1.44%) GDPR
4 24 (0.73%) PMO
5 23 (0.70%) MiFID
6 22 (0.67%) Solvency II
7 20 (0.61%) Dodd-Frank
7 20 (0.61%) FATCA
7 20 (0.61%) IFRS
8 19 (0.58%) ISO/IEC 27001
9 14 (0.43%) IFRS 9
10 6 (0.18%) PCI DSS
11 4 (0.12%) COBIT
11 4 (0.12%) GxP
12 3 (0.092%) GPG13
12 3 (0.092%) PSD2
13 2 (0.061%) HMG Security Policy Framework
13 2 (0.061%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
13 2 (0.061%) Sarbanes-Oxley
14 1 (0.031%) ISO 14001
System Software
1 323 (9.88%) Docker
2 164 (5.02%) HDFS
3 121 (3.70%) Apache Flume
4 59 (1.81%) Apache ZooKeeper
5 44 (1.35%) Active Directory
6 37 (1.13%) VMware Infrastructure
7 16 (0.49%) iptables
7 16 (0.49%) Virtual Machines
8 13 (0.40%) Snort
8 13 (0.40%) VirtualBox
9 11 (0.34%) Hyper-V
10 7 (0.21%) Oracle RAC
10 7 (0.21%) VMware NSX
11 6 (0.18%) vSphere
12 4 (0.12%) Virtual Desktop
12 4 (0.12%) VMware ESXi
13 3 (0.092%) Tivoli Workload Scheduler
14 2 (0.061%) Microsoft App-V
14 2 (0.061%) Squid
14 2 (0.061%) XenDesktop
Systems Management
1 198 (6.06%) Kubernetes
2 161 (4.93%) Ansible
3 155 (4.74%) Oozie
4 128 (3.92%) Puppet
5 101 (3.09%) Hadoop YARN
5 101 (3.09%) Terraform
6 84 (2.57%) Opscode Chef
7 51 (1.56%) Kibana
7 51 (1.56%) Mesos
8 33 (1.01%) logstash
8 33 (1.01%) Salt
9 28 (0.86%) Grafana
9 28 (0.86%) Prometheus
10 21 (0.64%) Ambari
11 17 (0.52%) Nagios
12 16 (0.49%) Docker Swarm
13 15 (0.46%) Automic
14 12 (0.37%) Packer
15 10 (0.31%) CFEngine
15 10 (0.31%) Suricata
Vendors
1 377 (11.54%) Microsoft
2 289 (8.84%) Google
3 273 (8.35%) Tableau
4 255 (7.80%) Oracle
5 247 (7.56%) Cloudera
6 199 (6.09%) Hortonworks
7 108 (3.30%) MapR
8 97 (2.97%) SAP
9 96 (2.94%) Databricks
10 87 (2.66%) IBM
11 79 (2.42%) Talend
12 76 (2.33%) Informatica
13 70 (2.14%) Splunk
14 63 (1.93%) Sybase
15 54 (1.65%) VMware
16 36 (1.10%) Cisco
17 34 (1.04%) ServiceNow
18 31 (0.95%) Apple
18 31 (0.95%) WorldPay
19 30 (0.92%) TIBCO