Period
to 20 October 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 20 October 2017 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
20 Oct 2017
Same period 2016 Same period 2015
Rank 66 68 72
Rank change year-on-year +2 +4 +36
Permanent jobs citing Big Data 3293 3189 3610
As % of all permanent IT jobs advertised in London 4.44% 4.14% 4.05%
As % of the Database & Business Intelligence category 14.99% 14.13% 13.13%
Number of salaries quoted 2588 2679 2944
London median annual salary £67,500 £70,000 £65,000
Median salary % change year-on-year -3.57% +7.69% -
10th Percentile £45,000 £45,000 £41,250
90th Percentile £100,000 £110,000 £97,500
England median annual salary £62,500 £62,500 £60,000
% change year-on-year - +4.17% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21967 22571 27492
As % of all permanent IT jobs advertised in London 29.64% 29.34% 30.82%
Number of salaries quoted 17575 19607 23239
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £90,000 £87,500 £85,000
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 20 October 2017.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 20 October 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -13 432 £67,500 +8.00% 72
West London +25 75 £62,500 +13.64% 7
South London +20 29 £64,500 -2.64% 5
East London -9 14 £70,500 +0.71% 12
North London +7 13 £87,500 +45.83% 2
Big Data
England

For the 6 months to 20 October 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Big Data.

1 1369 (41.57%) Agile Software Development
2 1358 (41.24%) Java
3 1296 (39.36%) Analytics
4 1264 (38.38%) Hadoop
5 1077 (32.71%) Python
6 1013 (30.76%) Apache Spark
7 963 (29.24%) Finance
8 959 (29.12%) SQL
9 645 (19.59%) Amazon AWS
10 642 (19.50%) Scala
11 636 (19.31%) Business Intelligence
12 586 (17.80%) NoSQL
13 571 (17.34%) Data Warehouse
14 541 (16.43%) Machine Learning
15 500 (15.18%) Data Analytics
16 496 (15.06%) DevOps
17 486 (14.76%) Degree
18 457 (13.88%) Software Engineering
19 448 (13.60%) Analytical Skills
20 445 (13.51%) Apache Cassandra
21 440 (13.36%) Banking
22 424 (12.88%) ETL
23 420 (12.75%) Linux
24 411 (12.48%) Microsoft Azure
25 403 (12.24%) TDD
26 393 (11.93%) R
27 382 (11.60%) Relational Database
28 376 (11.42%) JavaScript
29 367 (11.14%) Scrum
30 357 (10.84%) SQL Server

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1013 (30.76%) Apache Spark
2 237 (7.20%) Apache
3 175 (5.31%) Elasticsearch
4 172 (5.22%) SAS
5 106 (3.22%) Apache Pig
6 87 (2.64%) Apache Solr
7 76 (2.31%) Tomcat
8 67 (2.03%) Confluence
9 62 (1.88%) WebSphere
10 56 (1.70%) JBoss
11 53 (1.61%) OpenStack
12 50 (1.52%) CMS
13 46 (1.40%) WebLogic
14 33 (1.00%) Moodle
15 30 (0.91%) Oracle SOA Suite
16 26 (0.79%) Jetty
17 24 (0.73%) Apache Airflow
18 22 (0.67%) Apache Geronimo
18 22 (0.67%) WildFly
19 18 (0.55%) nginx
Applications
1 62 (1.88%) SPSS
2 42 (1.28%) Microsoft Excel
3 12 (0.36%) Chatbot
4 11 (0.33%) Microsoft PowerPoint
5 9 (0.27%) Microsoft Office
6 5 (0.15%) OmniGraffle
6 5 (0.15%) Photoshop
7 4 (0.12%) Adobe Illustrator
7 4 (0.12%) MS Visio
8 2 (0.061%) GNU Octave
8 2 (0.061%) Microsoft Project
8 2 (0.061%) Spreadsheet
9 1 (0.030%) InVision
9 1 (0.030%) Mathematica
9 1 (0.030%) Stata
9 1 (0.030%) Weka
Business Applications
1 12 (0.36%) Markit EDM
2 10 (0.30%) HFM
2 10 (0.30%) Oracle Applications
3 9 (0.27%) BusinessWorks
3 9 (0.27%) Hyperion Enterprise
3 9 (0.27%) TIBCO BusinessEvents
4 8 (0.24%) Dynamics CRM
4 8 (0.24%) Eloqua
4 8 (0.24%) SessionCam
4 8 (0.24%) Social Studio
5 7 (0.21%) Oracle EBS
5 7 (0.21%) Oracle ERP
6 5 (0.15%) Oracle TCA
7 4 (0.12%) Hyperion Planning
8 3 (0.091%) SAP Retail
9 2 (0.061%) Oracle Procure-to-Pay
9 2 (0.061%) Payment Gateway
9 2 (0.061%) SAP InfiniteInsight
10 1 (0.030%) Odoo
10 1 (0.030%) OpenText VIM for SAP
Cloud Services
1 645 (19.59%) Amazon AWS
2 411 (12.48%) Microsoft Azure
3 200 (6.07%) Google Cloud Platform
4 150 (4.56%) SaaS
5 88 (2.67%) Cloud Computing
6 66 (2.00%) PaaS
7 65 (1.97%) GitHub
8 57 (1.73%) IaaS
9 49 (1.49%) Azure Machine Learning
10 44 (1.34%) Amazon EC2
11 36 (1.09%) AWS CloudFormation
12 34 (1.03%) Google Analytics
12 34 (1.03%) Serverless
13 29 (0.88%) Adobe Analytics
14 26 (0.79%) Amazon S3
15 21 (0.64%) AWS Lambda
16 19 (0.58%) Amazon Kinesis
17 18 (0.55%) Amazon EMR
18 14 (0.43%) AdWords
18 14 (0.43%) Azure Data Factory
Communications & Networking
1 66 (2.00%) Internet
2 40 (1.21%) HTTP
3 29 (0.88%) Kerberos
4 24 (0.73%) Firewall
5 21 (0.64%) Network Security
6 17 (0.52%) SSL
7 13 (0.39%) DNS
7 13 (0.39%) LDAP
8 10 (0.30%) DSL
9 8 (0.24%) OpenVPN
9 8 (0.24%) TCP/IP
10 7 (0.21%) SAN
11 5 (0.15%) DHCP
11 5 (0.15%) Remote Desktop
11 5 (0.15%) Wireshark
12 4 (0.12%) Broadband
12 4 (0.12%) NAS
12 4 (0.12%) Skype
12 4 (0.12%) SNMP
12 4 (0.12%) Wi-Fi
Database & Business Intelligence
1 1264 (38.38%) Hadoop
2 586 (17.80%) NoSQL
3 571 (17.34%) Data Warehouse
4 445 (13.51%) Apache Cassandra
5 382 (11.60%) Relational Database
6 357 (10.84%) SQL Server
7 337 (10.23%) Apache Hive
8 306 (9.29%) MongoDB
9 250 (7.59%) RDBMS
10 217 (6.59%) HBase
11 185 (5.62%) MySQL
12 156 (4.74%) SQL Server Integration Services
13 153 (4.65%) Power BI
14 124 (3.77%) QlikView
15 123 (3.74%) SQL Server Analysis Services
16 120 (3.64%) SQL Server Reporting Services
17 113 (3.43%) Data Mining
18 105 (3.19%) Redis
19 86 (2.61%) PostgreSQL
20 75 (2.28%) Data Lake
Development Applications
1 231 (7.01%) Git (software)
2 200 (6.07%) Jenkins
3 152 (4.62%) JIRA
4 113 (3.43%) Selenium
5 92 (2.79%) Maven
6 71 (2.16%) Cucumber
7 51 (1.55%) Talend Open Studio
8 47 (1.43%) Bitbucket
9 45 (1.37%) Atlassian Bamboo
10 34 (1.03%) JUnit
11 33 (1.00%) Hudson
12 31 (0.94%) Team Foundation Server
13 30 (0.91%) TeamCity
13 30 (0.91%) WebDriver
14 29 (0.88%) Subversion
15 24 (0.73%) IntelliJ
16 21 (0.64%) Gerrit
17 19 (0.58%) Calabash
17 19 (0.58%) Jasmine
17 19 (0.58%) Mockito
General
1 963 (29.24%) Finance
2 440 (13.36%) Banking
3 306 (9.29%) Marketing
4 274 (8.32%) Retail
5 248 (7.53%) Investment Banking
6 164 (4.98%) Front Office
7 156 (4.74%) Retail Banking
8 109 (3.31%) Telecoms
9 93 (2.82%) Manufacturing
10 92 (2.79%) Legal
11 91 (2.76%) Games
12 78 (2.37%) Electronics
13 68 (2.06%) Advertising
14 48 (1.46%) Publishing
15 39 (1.18%) Law
16 38 (1.15%) Financial Institution
17 31 (0.94%) Pharmaceutical
18 20 (0.61%) Back Office
19 17 (0.52%) Aerospace
20 11 (0.33%) French Language
Job Titles
1 951 (28.88%) Developer
2 454 (13.79%) Architect
3 343 (10.42%) Java Developer
4 277 (8.41%) Data Engineer
5 252 (7.65%) Consultant
6 235 (7.14%) Data Scientist
7 204 (6.19%) Analyst
8 197 (5.98%) Software Engineer
9 186 (5.65%) Big Data Engineer
10 179 (5.44%) Senior Developer
11 175 (5.31%) Big Data Developer
12 169 (5.13%) Data Architect
13 148 (4.49%) Solutions Architect
14 120 (3.64%) Scala Developer
15 111 (3.37%) Python Developer
16 104 (3.16%) Senior Java Developer
17 103 (3.13%) SQL Developer
18 99 (3.01%) Big Data Architect
19 83 (2.52%) Data Consultant
20 81 (2.46%) Data Analyst
Libraries, Frameworks & Software Standards
1 330 (10.02%) Kafka
2 252 (7.65%) Spring
3 247 (7.50%) AngularJS
4 225 (6.83%) .NET
5 199 (6.04%) HTML
6 191 (5.80%) React
7 188 (5.71%) Web Services
8 166 (5.04%) REST
9 161 (4.89%) Node.js
10 147 (4.46%) CSS
11 117 (3.55%) RESTful
12 106 (3.22%) HTML5
13 104 (3.16%) Hibernate
14 92 (2.79%) Akka
15 89 (2.70%) Natural Language Processing
16 85 (2.58%) JSON
17 77 (2.34%) J2EE
18 72 (2.19%) XML
19 62 (1.88%) NumPy
19 62 (1.88%) Pandas
Miscellaneous
1 448 (13.60%) Analytical Skills
2 320 (9.72%) Computer Science
3 236 (7.17%) Algorithms
4 235 (7.14%) Greenfield Project
5 190 (5.77%) Fintech
6 172 (5.22%) User Experience
7 171 (5.19%) Enterprise Software
8 73 (2.22%) Mobile App
9 69 (2.10%) Data Structures
10 53 (1.61%) Social Media
11 47 (1.43%) Management Information System
12 44 (1.34%) Data Centre
13 43 (1.31%) Derivative
13 43 (1.31%) Foreign Exchange (FX)
14 37 (1.12%) Internet of Things
15 35 (1.06%) Hedge funds
16 33 (1.00%) Digital Media
16 33 (1.00%) Equities
17 32 (0.97%) Public Cloud
18 31 (0.94%) Credit Risk
Operating Systems
1 420 (12.75%) Linux
2 146 (4.43%) Unix
3 102 (3.10%) Windows
4 51 (1.55%) Android
5 42 (1.28%) Apple iOS
6 24 (0.73%) Ubuntu
7 20 (0.61%) CentOS
8 18 (0.55%) Windows Server
9 13 (0.39%) AIX
9 13 (0.39%) Red Hat Enterprise Linux
10 10 (0.30%) Debian
10 10 (0.30%) Mac OS X
11 8 (0.24%) Solaris
12 6 (0.18%) Windows Server 2012
13 5 (0.15%) Windows Server 2008
14 4 (0.12%) HPUX
15 2 (0.061%) CoreOS
15 2 (0.061%) Mesosphere
16 1 (0.030%) Mac OS
Processes & Methodologies
1 1369 (41.57%) Agile Software Development
2 1296 (39.36%) Analytics
3 636 (19.31%) Business Intelligence
4 541 (16.43%) Machine Learning
5 500 (15.18%) Data Analytics
6 496 (15.06%) DevOps
7 457 (13.88%) Software Engineering
8 424 (12.88%) ETL
9 403 (12.24%) TDD
10 367 (11.14%) Scrum
11 357 (10.84%) Open Source
12 304 (9.23%) Microservices
13 302 (9.17%) BDD
14 279 (8.47%) Visualisation
15 274 (8.32%) Continuous Integration
16 269 (8.17%) OO
17 242 (7.35%) SDLC
18 237 (7.20%) Big Data Analytics
19 232 (7.05%) Data Modelling
20 231 (7.01%) Data Management
Programming Languages
1 1358 (41.24%) Java
2 1077 (32.71%) Python
3 959 (29.12%) SQL
4 642 (19.50%) Scala
5 393 (11.93%) R
6 376 (11.42%) JavaScript
7 186 (5.65%) C#
8 179 (5.44%) C++
9 123 (3.74%) Perl
10 105 (3.19%) Bash Shell
11 98 (2.98%) T-SQL
12 94 (2.85%) Go
13 89 (2.70%) C
14 84 (2.55%) Ruby
15 74 (2.25%) PHP
16 59 (1.79%) MATLAB
17 56 (1.70%) Shell Script
18 52 (1.58%) PL/SQL
19 39 (1.18%) ES6
19 39 (1.18%) Groovy
Qualifications
1 486 (14.76%) Degree
2 132 (4.01%) Computer Science Degree
3 115 (3.49%) PhD
4 85 (2.58%) Security Cleared
5 58 (1.76%) DV Cleared
5 58 (1.76%) SC Cleared
6 55 (1.67%) Master's Degree
7 47 (1.43%) ISEB
8 33 (1.00%) Numerate Degree
9 18 (0.55%) MBA
10 17 (0.52%) PMI Certification
11 15 (0.46%) PMP
12 14 (0.43%) Microsoft Certification
13 13 (0.39%) ISTQB
14 11 (0.33%) CISSP
15 9 (0.27%) CTC Cleared
16 7 (0.21%) Cisco Certification
17 6 (0.18%) ACCA
18 5 (0.15%) CCIE
18 5 (0.15%) CCNP
Quality Assurance & Compliance
1 162 (4.92%) QA
2 149 (4.52%) Data Quality
3 40 (1.21%) GCP
4 38 (1.15%) GDPR
5 19 (0.58%) MiFID
6 13 (0.39%) Sarbanes-Oxley
6 13 (0.39%) Solvency II
7 12 (0.36%) Dodd-Frank
8 11 (0.33%) EMIR
9 10 (0.30%) ISO/IEC 27001
9 10 (0.30%) PMO
10 9 (0.27%) PCI DSS
11 7 (0.21%) SLA
12 4 (0.12%) Actionable Recommendations
12 4 (0.12%) ISO 14001
13 3 (0.091%) COBIT
14 1 (0.030%) IFRS
14 1 (0.030%) IFRS 9
System Software
1 325 (9.87%) Docker
2 151 (4.59%) HDFS
3 98 (2.98%) Apache Flume
4 30 (0.91%) Active Directory
5 19 (0.58%) Apache ZooKeeper
6 15 (0.46%) VMware Infrastructure
7 10 (0.30%) Varnish
8 9 (0.27%) Virtual Machines
9 6 (0.18%) KVM
10 4 (0.12%) Hyper-V
10 4 (0.12%) Snort
10 4 (0.12%) VMware NSX
10 4 (0.12%) Xen
11 2 (0.061%) OpenAM
12 1 (0.030%) Cygwin
12 1 (0.030%) MapR-FS
12 1 (0.030%) Oracle RAC
12 1 (0.030%) PowerHA
12 1 (0.030%) vCloud
12 1 (0.030%) vSphere
Systems Management
1 147 (4.46%) Kubernetes
2 144 (4.37%) Puppet
3 142 (4.31%) Ansible
4 105 (3.19%) Opscode Chef
5 72 (2.19%) Mesos
6 70 (2.13%) Terraform
7 50 (1.52%) Oozie
8 27 (0.82%) Salt
9 22 (0.67%) Hadoop YARN
10 19 (0.58%) Kibana
11 18 (0.55%) logstash
12 13 (0.39%) Ambari
12 13 (0.39%) Marathon
13 12 (0.36%) Packer
14 9 (0.27%) ITRS Geneos
15 8 (0.24%) Nagios
16 6 (0.18%) Docker Swarm
16 6 (0.18%) Prometheus
17 5 (0.15%) Graphite
17 5 (0.15%) ZABBIX
Vendors
1 315 (9.57%) Oracle
2 267 (8.11%) Microsoft
3 252 (7.65%) Tableau
4 251 (7.62%) Google
5 155 (4.71%) Cloudera
6 119 (3.61%) SAP
7 103 (3.13%) Hortonworks
8 100 (3.04%) Splunk
9 76 (2.31%) Informatica
10 68 (2.06%) Teradata
11 63 (1.91%) IBM
12 62 (1.88%) MapR
13 56 (1.70%) Red Hat
14 51 (1.55%) Talend
15 48 (1.46%) Salesforce.com
16 39 (1.18%) Adobe
17 29 (0.88%) Cognos
18 28 (0.85%) VMware
19 27 (0.82%) Hyperion
19 27 (0.82%) TIBCO