Period
to 21 June 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 June 2018 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
21 Jun 2018
Same period 2017 Same period 2016
Rank 43 61 72
Rank change year-on-year +18 +11 +7
Permanent jobs citing Big Data 4,083 3,216 3,405
As % of all permanent IT jobs advertised in London 5.88% 4.59% 4.14%
As % of the Database & Business Intelligence category 18.73% 15.23% 13.66%
Number of salaries quoted 2,608 2,687 2,833
London median annual salary £70,000 £67,500 £65,000
Median salary % change year-on-year +3.70% +3.85% +4.00%
10th Percentile £45,000 £45,000 £43,750
90th Percentile £100,000 £103,750 £110,000
England median annual salary £65,000 £62,500 £60,000
% change year-on-year +4.00% +4.17% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,800 21,120 24,928
As % of all permanent IT jobs advertised in London 31.39% 30.14% 30.33%
Number of salaries quoted 17,318 17,972 21,733
London median annual salary £60,000 £60,000 £55,000
Median salary % change year-on-year - +9.09% -
10th Percentile £37,500 £36,250 £35,750
90th Percentile £92,500 £90,000 £85,000
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 21 June 2018.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 21 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +18 669 £70,000 +12.00% 107
West London +3 67 £58,750 +2.17% 48
East London -4 29 £75,000 - 34
South London 0 28 £78,750 +23.05% 6
North London -10 3 £53,641 -2.47% 2
Big Data
England

For the 6 months to 21 June 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 1,685 (41.27%) Java
2 1,583 (38.77%) Python
3 1,524 (37.33%) Analytics
4 1,520 (37.23%) Finance
5 1,317 (32.26%) SQL
6 1,291 (31.62%) Hadoop
7 1,276 (31.25%) Agile Software Development
8 1,168 (28.61%) Apache Spark
9 1,032 (25.28%) Problem-Solving
10 999 (24.47%) Banking
11 933 (22.85%) Machine Learning
12 925 (22.65%) Amazon AWS
13 839 (20.55%) Data Science
14 829 (20.30%) Degree
15 806 (19.74%) Scala
16 794 (19.45%) Analytical Skills
17 777 (19.03%) Investment Banking
18 734 (17.98%) Risk Management
19 710 (17.39%) Financial Institution
20 702 (17.19%) Low Latency
21 689 (16.87%) Investment Management
22 679 (16.63%) Innovative Thinking
23 673 (16.48%) Strategic Thinking
24 667 (16.34%) Cyberthreat
25 634 (15.53%) Kafka
26 604 (14.79%) NoSQL
27 580 (14.21%) Computer Science
28 578 (14.16%) Business Intelligence
29 571 (13.98%) ETL
30 550 (13.47%) Linux

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,168 (28.61%) Apache Spark
2 213 (5.22%) Apache
3 191 (4.68%) Elasticsearch
4 170 (4.16%) SAS
5 110 (2.69%) Apache Pig
6 98 (2.40%) Apache Solr
7 50 (1.22%) Tomcat
8 47 (1.15%) Confluence
9 39 (0.96%) IIS
10 22 (0.54%) OpenStack
11 19 (0.47%) NServiceBus
12 16 (0.39%) JBoss
13 15 (0.37%) Jetty
14 14 (0.34%) Apache Airflow
15 13 (0.32%) Luigi
16 12 (0.29%) CMS
17 11 (0.27%) nginx
17 11 (0.27%) SharePoint
18 10 (0.24%) WebSphere
19 9 (0.22%) WebLogic
Applications
1 73 (1.79%) Microsoft Excel
2 53 (1.30%) Microsoft Office
3 29 (0.71%) MS Visio
4 26 (0.64%) SPSS
5 13 (0.32%) Microsoft PowerPoint
6 8 (0.20%) Chatbot
7 6 (0.15%) GNU Octave
7 6 (0.15%) Mathematica
8 5 (0.12%) Stata
9 3 (0.073%) Microsoft Project
9 3 (0.073%) Weka
10 2 (0.049%) EViews
10 2 (0.049%) PrintSoft PReS
11 1 (0.024%) AutoCAD
11 1 (0.024%) CPLEX
11 1 (0.024%) Mingle
11 1 (0.024%) SPSS Modeler
Business Applications
1 8 (0.20%) Dynamics CRM
2 6 (0.15%) Dynamics AX
2 6 (0.15%) Dynamics NAV
2 6 (0.15%) SAP S/4HANA
3 4 (0.098%) Actimize
3 4 (0.098%) Distributed Ledger
3 4 (0.098%) JDE OneWorld
3 4 (0.098%) Oracle Receivables
3 4 (0.098%) SAP Forecasting and Replenishment
3 4 (0.098%) SAP Retail
3 4 (0.098%) Sentinel
4 2 (0.049%) Markit EDM
4 2 (0.049%) Oracle Procure-to-Pay
4 2 (0.049%) SAP MDG
5 1 (0.024%) BASE24
5 1 (0.024%) MetaTrader
5 1 (0.024%) Oracle BPM
5 1 (0.024%) R3 Corda
5 1 (0.024%) SAP CRM
5 1 (0.024%) WebTrends
Cloud Services
1 925 (22.65%) Amazon AWS
2 525 (12.86%) Microsoft Azure
3 143 (3.50%) Serverless
4 140 (3.43%) Google Cloud Platform
5 113 (2.77%) SaaS
6 101 (2.47%) Cloud Computing
7 93 (2.28%) Amazon EMR
8 92 (2.25%) IaaS
9 87 (2.13%) Amazon S3
10 80 (1.96%) PaaS
11 76 (1.86%) Amazon Kinesis
12 75 (1.84%) AWS Lambda
13 74 (1.81%) Azure Data Factory
14 70 (1.71%) Cortana Intelligence Suite
15 65 (1.59%) GitHub
16 53 (1.30%) Amazon EC2
17 38 (0.93%) Adobe Analytics
18 32 (0.78%) Google Analytics
19 31 (0.76%) AWS CloudFormation
20 28 (0.69%) OpenShift
Communications & Networking
1 77 (1.89%) Internet
2 57 (1.40%) Wireless
3 55 (1.35%) Firewall
4 53 (1.30%) Unified Communications
5 51 (1.25%) Wireless Security
6 46 (1.13%) HTTP
7 40 (0.98%) TCP/IP
8 36 (0.88%) DNS
9 29 (0.71%) Kerberos
10 26 (0.64%) SSL
11 24 (0.59%) Network Security
12 20 (0.49%) Sourcefire
13 18 (0.44%) DHCP
13 18 (0.44%) LAN
14 17 (0.42%) SAN
15 16 (0.39%) WAN
16 15 (0.37%) BGP
16 15 (0.37%) Ethernet
16 15 (0.37%) MPLS
16 15 (0.37%) SNMP
Database & Business Intelligence
1 1,291 (31.62%) Hadoop
2 604 (14.79%) NoSQL
3 498 (12.20%) Apache Hive
4 478 (11.71%) Data Warehouse
5 378 (9.26%) Data Lake
6 373 (9.14%) SQL Server
7 338 (8.28%) Relational Database
8 303 (7.42%) Apache Cassandra
9 289 (7.08%) MongoDB
10 256 (6.27%) HBase
11 230 (5.63%) Power BI
12 187 (4.58%) SQL Server Integration Services
13 180 (4.41%) MySQL
14 172 (4.21%) RDBMS
15 145 (3.55%) Impala
15 145 (3.55%) SQL Server Reporting Services
16 140 (3.43%) Amazon Redshift
17 139 (3.40%) PostgreSQL
18 133 (3.26%) DB2
19 124 (3.04%) SQL Server Analysis Services
Development Applications
1 200 (4.90%) Git (software)
2 178 (4.36%) Jenkins
3 113 (2.77%) JIRA
4 82 (2.01%) Maven
5 75 (1.84%) JUnit
6 69 (1.69%) Visual Studio
7 53 (1.30%) Subversion
8 51 (1.25%) Gradle
9 44 (1.08%) Cucumber
10 40 (0.98%) Selenium
11 34 (0.83%) Atlassian Bamboo
12 31 (0.76%) TeamCity
13 26 (0.64%) Mockito
14 22 (0.54%) Bitbucket
15 21 (0.51%) gulp
15 21 (0.51%) RStudio
15 21 (0.51%) Sonatype Nexus
16 19 (0.47%) Vagrant
17 18 (0.44%) Eclipse
17 18 (0.44%) FitNesse
General
1 1,520 (37.23%) Finance
2 999 (24.47%) Banking
3 777 (19.03%) Investment Banking
4 710 (17.39%) Financial Institution
5 290 (7.10%) Retail
6 254 (6.22%) Marketing
7 189 (4.63%) Front Office
8 165 (4.04%) Telecoms
9 112 (2.74%) Games
10 84 (2.06%) Manufacturing
11 80 (1.96%) Advertising
12 72 (1.76%) Pharmaceutical
13 66 (1.62%) Legal
14 61 (1.49%) Publishing
15 57 (1.40%) Law
16 28 (0.69%) Multimedia
17 20 (0.49%) Electronics
18 17 (0.42%) German Language
19 15 (0.37%) Italian Language
20 9 (0.22%) Automotive
Job Titles
1 1,002 (24.54%) Developer
2 535 (13.10%) Data Engineer
3 530 (12.98%) Architect
4 360 (8.82%) Java Developer
5 320 (7.84%) Big Data Engineer
6 283 (6.93%) Data Scientist
7 241 (5.90%) Analyst
7 241 (5.90%) Data Architect
8 233 (5.71%) Big Data Developer
9 219 (5.36%) Consultant
10 155 (3.80%) Solutions Architect
11 150 (3.67%) Big Data Architect
12 147 (3.60%) Software Engineer
13 134 (3.28%) Senior Developer
14 117 (2.87%) DevOps Engineer
15 115 (2.82%) Technical Architect
16 112 (2.74%) Platform Engineer
17 103 (2.52%) Python Engineer
18 99 (2.42%) Scala Developer
19 97 (2.38%) AWS Engineer
Libraries, Frameworks & Software Standards
1 634 (15.53%) Kafka
2 310 (7.59%) .NET
3 307 (7.52%) Web Services
4 286 (7.00%) AngularJS
5 266 (6.51%) HTML
6 248 (6.07%) RESTful
7 221 (5.41%) Spring
8 207 (5.07%) REST
9 173 (4.24%) Natural Language Processing
10 171 (4.19%) React
11 166 (4.07%) Node.js
12 147 (3.60%) XML
13 133 (3.26%) RabbitMQ
14 128 (3.13%) HTML5
15 112 (2.74%) CSS
16 101 (2.47%) Akka
16 101 (2.47%) JSON
17 90 (2.20%) Spark Streaming
18 82 (2.01%) JMS
19 77 (1.89%) Pandas
Miscellaneous
1 794 (19.45%) Analytical Skills
2 667 (16.34%) Cyberthreat
3 580 (14.21%) Computer Science
4 373 (9.14%) Algorithms
5 316 (7.74%) Fintech
6 180 (4.41%) Data Structures
7 176 (4.31%) Management Information System
8 172 (4.21%) Self-Motivation
9 169 (4.14%) User Experience
10 158 (3.87%) Greenfield Project
11 147 (3.60%) Data Centre
12 140 (3.43%) Fixed Income
13 121 (2.96%) Equities
14 78 (1.91%) Derivative
15 77 (1.89%) Public Cloud
16 74 (1.81%) Hedge funds
16 74 (1.81%) Virtual Team
17 63 (1.54%) Enterprise Software
18 60 (1.47%) Analytical Mindset
19 59 (1.45%) Credit Risk
Operating Systems
1 550 (13.47%) Linux
2 316 (7.74%) Unix
3 185 (4.53%) Windows
4 40 (0.98%) Windows Server
5 30 (0.73%) Red Hat Enterprise Linux
5 30 (0.73%) Solaris
6 27 (0.66%) AIX
6 27 (0.66%) HPUX
7 25 (0.61%) Android
7 25 (0.61%) CentOS
8 23 (0.56%) Apple iOS
9 16 (0.39%) Ubuntu
10 10 (0.24%) Windows 7
10 10 (0.24%) Windows Server 2012
11 7 (0.17%) Mac OS X
11 7 (0.17%) Windows Server 2008
12 5 (0.12%) Amazon Linux
12 5 (0.12%) Windows 10
12 5 (0.12%) Windows 8
13 3 (0.073%) SUSE
Processes & Methodologies
1 1,524 (37.33%) Analytics
2 1,276 (31.25%) Agile Software Development
3 1,032 (25.28%) Problem-Solving
4 933 (22.85%) Machine Learning
5 839 (20.55%) Data Science
6 734 (17.98%) Risk Management
7 702 (17.19%) Low Latency
8 689 (16.87%) Investment Management
9 679 (16.63%) Innovative Thinking
10 673 (16.48%) Strategic Thinking
11 578 (14.16%) Business Intelligence
12 571 (13.98%) ETL
13 501 (12.27%) DevOps
14 471 (11.54%) Data Analytics
15 444 (10.87%) Software Engineering
16 428 (10.48%) TDD
17 409 (10.02%) Microservices
18 397 (9.72%) Visualisation
19 380 (9.31%) OO
20 378 (9.26%) Mathematics
Programming Languages
1 1,685 (41.27%) Java
2 1,583 (38.77%) Python
3 1,317 (32.26%) SQL
4 806 (19.74%) Scala
5 506 (12.39%) JavaScript
6 440 (10.78%) R
7 405 (9.92%) C#
8 389 (9.53%) C++
9 191 (4.68%) Perl
10 178 (4.36%) Java 8
11 144 (3.53%) Bash Shell
12 132 (3.23%) C
13 117 (2.87%) MATLAB
14 98 (2.40%) Shell Script
14 98 (2.40%) T-SQL
15 86 (2.11%) Ruby
16 71 (1.74%) PowerShell
17 69 (1.69%) Go
18 59 (1.45%) PHP
19 43 (1.05%) U-SQL
Qualifications
1 829 (20.30%) Degree
2 233 (5.71%) Computer Science Degree
3 175 (4.29%) PhD
4 125 (3.06%) Master's Degree
5 64 (1.57%) Cisco Certification
6 60 (1.47%) Security Cleared
7 58 (1.42%) CCNA
8 53 (1.30%) CCIE
9 48 (1.18%) Numerate Degree
10 47 (1.15%) CISSP
11 40 (0.98%) CCNP
12 30 (0.73%) Microsoft Certification
13 28 (0.69%) CEH
14 27 (0.66%) ISEB
15 25 (0.61%) TOGAF Certification
16 24 (0.59%) PMP
16 24 (0.59%) SANS
17 22 (0.54%) PMI Certification
18 20 (0.49%) MCSE
18 20 (0.49%) SC Cleared
Quality Assurance & Compliance
1 173 (4.24%) QA
2 157 (3.85%) Data Quality
3 60 (1.47%) GDPR
4 32 (0.78%) GCP
5 28 (0.69%) ISO/IEC 27001
6 21 (0.51%) MiFID
7 20 (0.49%) Solvency II
8 14 (0.34%) Dodd-Frank
9 13 (0.32%) FATCA
10 12 (0.29%) IFRS
10 12 (0.29%) IFRS 9
10 12 (0.29%) PCI DSS
11 11 (0.27%) SLA
12 10 (0.24%) Sarbanes-Oxley
13 8 (0.20%) GPG13
14 6 (0.15%) Actionable Recommendations
14 6 (0.15%) COBIT
14 6 (0.15%) EMIR
14 6 (0.15%) HIPAA
15 5 (0.12%) ISO 14001
System Software
1 320 (7.84%) Docker
2 192 (4.70%) HDFS
3 111 (2.72%) Apache Flume
4 75 (1.84%) VMware Infrastructure
5 54 (1.32%) Virtual Machines
6 38 (0.93%) Active Directory
7 28 (0.69%) Apache ZooKeeper
8 20 (0.49%) Snort
9 18 (0.44%) VirtualBox
10 13 (0.32%) vSphere
11 10 (0.24%) VMware ESXi
12 9 (0.22%) Virtual Desktop
13 7 (0.17%) Hyper-V
13 7 (0.17%) VMware NSX
14 6 (0.15%) KVM
15 4 (0.098%) Microsoft App-V
15 4 (0.098%) XenDesktop
16 3 (0.073%) iptables
16 3 (0.073%) Oracle RAC
17 1 (0.024%) GridGain
Systems Management
1 197 (4.82%) Ansible
2 182 (4.46%) Kubernetes
3 141 (3.45%) Puppet
4 119 (2.91%) Terraform
5 99 (2.42%) Opscode Chef
6 90 (2.20%) Hadoop YARN
6 90 (2.20%) Oozie
7 67 (1.64%) Mesos
8 65 (1.59%) Salt
9 36 (0.88%) Kibana
10 26 (0.64%) Consul
11 24 (0.59%) Ambari
12 20 (0.49%) Docker Swarm
13 19 (0.47%) Suricata
14 13 (0.32%) ITRS Geneos
15 11 (0.27%) logstash
15 11 (0.27%) Packer
15 11 (0.27%) Prometheus
16 9 (0.22%) Grafana
16 9 (0.22%) WSUS
Vendors
1 398 (9.75%) Microsoft
2 336 (8.23%) Oracle
3 329 (8.06%) Tableau
4 289 (7.08%) Google
5 227 (5.56%) Cloudera
6 168 (4.11%) Sybase
7 149 (3.65%) Hortonworks
8 116 (2.84%) Talend
9 111 (2.72%) Informatica
10 102 (2.50%) Splunk
11 100 (2.45%) Cisco
12 89 (2.18%) VMware
13 87 (2.13%) IBM
14 69 (1.69%) NetApp
14 69 (1.69%) WorldPay
15 68 (1.67%) EMC
16 59 (1.45%) SAP
17 58 (1.42%) Dell
18 57 (1.40%) Cognizant
19 54 (1.32%) F5