Period
to 18 January 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 18 January 2018 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
18 Jan 2018
Same period 2017 Same period 2016
Rank 58 63 63
Rank change year-on-year +5 0 +44
Permanent jobs citing Big Data 3,421 3,137 3,798
As % of all permanent IT jobs advertised in London 4.87% 4.43% 4.49%
As % of the Database & Business Intelligence category 16.18% 14.89% 14.56%
Number of salaries quoted 2,791 2,735 3,184
London median annual salary £70,000 £70,000 £65,000
Median salary % change year-on-year - +7.69% +4.00%
10th Percentile £45,000 £45,000 £42,500
90th Percentile £100,000 £105,000 £100,000
England median annual salary £65,000 £62,500 £62,000
% change year-on-year +4.00% +0.81% +7.83%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,142 21,070 26,077
As % of all permanent IT jobs advertised in London 30.07% 29.74% 30.81%
Number of salaries quoted 17,244 18,413 22,258
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £46,000
% change year-on-year +5.26% +3.26% +2.22%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 18 January 2018.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 18 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +5 617 £70,000 +7.69% 132
West London +30 65 £60,000 +4.35% 51
South London -6 33 £67,500 +5.47% 8
East London 0 22 £80,000 +14.29% 27
North London +8 14 £100,000 +80.18% 3
Big Data
England

For the 6 months to 18 January 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Big Data.

1 1,397 (40.84%) Java
2 1,300 (38.00%) Hadoop
3 1,289 (37.68%) Python
4 1,276 (37.30%) Analytics
5 1,228 (35.90%) Agile Software Development
6 1,081 (31.60%) Apache Spark
7 1,045 (30.55%) SQL
8 896 (26.19%) Finance
9 793 (23.18%) Amazon AWS
10 732 (21.40%) Machine Learning
11 724 (21.16%) Scala
12 563 (16.46%) Degree
13 548 (16.02%) DevOps
14 535 (15.64%) Business Intelligence
15 530 (15.49%) NoSQL
16 500 (14.62%) Data Analytics
17 475 (13.88%) Software Engineering
18 469 (13.71%) Data Warehouse
19 420 (12.28%) Banking
20 414 (12.10%) Linux
20 414 (12.10%) Analytical Skills
21 406 (11.87%) Microsoft Azure
22 396 (11.58%) Kafka
23 392 (11.46%) Apache Cassandra
24 383 (11.20%) R
25 380 (11.11%) Apache Hive
25 380 (11.11%) Computer Science
26 369 (10.79%) TDD
27 359 (10.49%) JavaScript
28 356 (10.41%) Docker

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,081 (31.60%) Apache Spark
2 221 (6.46%) Elasticsearch
3 220 (6.43%) Apache
4 156 (4.56%) SAS
5 104 (3.04%) Apache Pig
6 80 (2.34%) Apache Solr
7 57 (1.67%) Confluence
8 53 (1.55%) Tomcat
9 50 (1.46%) OpenStack
10 35 (1.02%) Apache Airflow
11 30 (0.88%) JBoss
12 28 (0.82%) WebSphere
13 24 (0.70%) Moodle
13 24 (0.70%) WebLogic
14 22 (0.64%) Oracle SOA Suite
15 18 (0.53%) nginx
16 16 (0.47%) GeoServer
17 15 (0.44%) CMS
17 15 (0.44%) Luigi
18 14 (0.41%) IIS
Applications
1 57 (1.67%) Microsoft Excel
2 48 (1.40%) SPSS
3 16 (0.47%) Microsoft PowerPoint
4 12 (0.35%) Microsoft Office
5 9 (0.26%) Chatbot
6 8 (0.23%) MS Visio
7 7 (0.20%) Weka
8 5 (0.15%) OmniGraffle
8 5 (0.15%) Photoshop
9 4 (0.12%) Adobe Illustrator
9 4 (0.12%) GNU Octave
9 4 (0.12%) Mathematica
10 2 (0.058%) Microsoft Project
10 2 (0.058%) Stata
11 1 (0.029%) HipChat
11 1 (0.029%) InVision
11 1 (0.029%) Spreadsheet
Business Applications
1 12 (0.35%) Markit EDM
2 9 (0.26%) BusinessWorks
2 9 (0.26%) TIBCO BusinessEvents
3 6 (0.18%) Dynamics CRM
4 5 (0.15%) Oracle Applications
4 5 (0.15%) Oracle EBS
4 5 (0.15%) Oracle ERP
4 5 (0.15%) Oracle TCA
5 4 (0.12%) HFM
5 4 (0.12%) Oracle Receivables
6 3 (0.088%) Distributed Ledger
6 3 (0.088%) Hyperion Planning
6 3 (0.088%) Payment Gateway
6 3 (0.088%) SAP Retail
7 2 (0.058%) Bloomberg AIM
7 2 (0.058%) Oracle AML
8 1 (0.029%) Odoo
8 1 (0.029%) SAP Hybris
8 1 (0.029%) SAP MDG
8 1 (0.029%) SAP S/4HANA
Cloud Services
1 793 (23.18%) Amazon AWS
2 406 (11.87%) Microsoft Azure
3 169 (4.94%) Google Cloud Platform
4 137 (4.00%) SaaS
5 90 (2.63%) PaaS
6 86 (2.51%) Cloud Computing
7 81 (2.37%) IaaS
8 73 (2.13%) Serverless
9 56 (1.64%) Amazon S3
10 51 (1.49%) Amazon EC2
10 51 (1.49%) Azure Data Factory
11 46 (1.34%) GitHub
12 44 (1.29%) Amazon Kinesis
13 42 (1.23%) AWS Lambda
14 41 (1.20%) Cortana Intelligence Suite
15 36 (1.05%) AWS CloudFormation
16 35 (1.02%) Azure Machine Learning
16 35 (1.02%) Google Analytics
17 29 (0.85%) Amazon EMR
18 24 (0.70%) Adobe Analytics
Communications & Networking
1 75 (2.19%) Internet
2 58 (1.70%) HTTP
3 29 (0.85%) Kerberos
4 27 (0.79%) SSL
4 27 (0.79%) Unified Communications
5 26 (0.76%) Wireless
5 26 (0.76%) Wireless Security
6 20 (0.58%) Firewall
6 20 (0.58%) Network Security
7 17 (0.50%) TCP/IP
8 11 (0.32%) LDAP
9 8 (0.23%) DNS
10 7 (0.20%) SAN
11 6 (0.18%) Skype
12 4 (0.12%) Broadband
12 4 (0.12%) GoToMeeting
13 3 (0.088%) DAB
13 3 (0.088%) HTTPS
13 3 (0.088%) VPN
14 2 (0.058%) DSL
Database & Business Intelligence
1 1,300 (38.00%) Hadoop
2 530 (15.49%) NoSQL
3 469 (13.71%) Data Warehouse
4 392 (11.46%) Apache Cassandra
5 380 (11.11%) Apache Hive
6 333 (9.73%) MongoDB
7 310 (9.06%) SQL Server
8 288 (8.42%) Relational Database
9 282 (8.24%) HBase
10 200 (5.85%) MySQL
11 181 (5.29%) RDBMS
12 158 (4.62%) Data Lake
12 158 (4.62%) Power BI
13 128 (3.74%) SQL Server Integration Services
14 124 (3.62%) Data Mining
15 103 (3.01%) SQL Server Analysis Services
16 93 (2.72%) PostgreSQL
17 92 (2.69%) SQL Server Reporting Services
18 91 (2.66%) Amazon Redshift
19 90 (2.63%) QlikView
Development Applications
1 209 (6.11%) Git (software)
2 178 (5.20%) Jenkins
3 112 (3.27%) JIRA
4 85 (2.48%) Maven
5 57 (1.67%) Selenium
6 54 (1.58%) Atlassian Bamboo
7 44 (1.29%) Cucumber
8 41 (1.20%) JUnit
9 37 (1.08%) TeamCity
10 36 (1.05%) Team Foundation Server
11 34 (0.99%) Bitbucket
12 26 (0.76%) Jasmine
12 26 (0.76%) Subversion
13 24 (0.70%) Visual Studio
14 23 (0.67%) Travis CI
15 21 (0.61%) GoCD
16 20 (0.58%) Gradle
17 19 (0.56%) gulp
18 18 (0.53%) Hudson
18 18 (0.53%) webpack
General
1 896 (26.19%) Finance
2 420 (12.28%) Banking
3 268 (7.83%) Retail
4 260 (7.60%) Marketing
5 213 (6.23%) Investment Banking
6 155 (4.53%) Telecoms
7 150 (4.38%) Front Office
8 114 (3.33%) Games
9 103 (3.01%) Retail Banking
10 92 (2.69%) Manufacturing
11 71 (2.08%) Advertising
12 62 (1.81%) Financial Institution
13 56 (1.64%) Legal
14 54 (1.58%) Pharmaceutical
15 50 (1.46%) Electronics
16 49 (1.43%) Law
17 46 (1.34%) Publishing
18 15 (0.44%) Back Office
19 14 (0.41%) French Language
20 11 (0.32%) Aerospace
Job Titles
1 912 (26.66%) Developer
2 480 (14.03%) Architect
3 351 (10.26%) Data Engineer
3 351 (10.26%) Java Developer
4 259 (7.57%) Big Data Engineer
5 253 (7.40%) Consultant
6 239 (6.99%) Data Scientist
7 216 (6.31%) Analyst
8 197 (5.76%) Senior Developer
9 189 (5.52%) Software Engineer
10 186 (5.44%) Data Architect
11 163 (4.76%) Big Data Developer
12 152 (4.44%) Solutions Architect
13 115 (3.36%) DevOps Engineer
14 109 (3.19%) Big Data Architect
15 103 (3.01%) Senior Java Developer
16 101 (2.95%) Lead Developer
17 100 (2.92%) Python Developer
18 98 (2.86%) Java Engineer
19 91 (2.66%) Scala Developer
Libraries, Frameworks & Software Standards
1 396 (11.58%) Kafka
2 257 (7.51%) Spring
3 224 (6.55%) REST
4 218 (6.37%) .NET
5 208 (6.08%) HTML
6 197 (5.76%) AngularJS
7 195 (5.70%) Node.js
8 194 (5.67%) Web Services
9 169 (4.94%) CSS
10 166 (4.85%) React
11 120 (3.51%) Natural Language Processing
12 116 (3.39%) HTML5
13 104 (3.04%) RESTful
14 88 (2.57%) Hibernate
15 82 (2.40%) JSON
16 79 (2.31%) NumPy
17 76 (2.22%) RabbitMQ
17 76 (2.22%) SOAP
18 70 (2.05%) Akka
18 70 (2.05%) J2EE
Miscellaneous
1 414 (12.10%) Analytical Skills
2 380 (11.11%) Computer Science
3 310 (9.06%) Algorithms
4 244 (7.13%) Fintech
5 195 (5.70%) Greenfield Project
6 188 (5.50%) User Experience
7 134 (3.92%) Enterprise Software
8 103 (3.01%) Data Centre
9 102 (2.98%) Mobile App
10 68 (1.99%) Data Structures
11 56 (1.64%) Equities
12 53 (1.55%) Hedge funds
12 53 (1.55%) Management Information System
13 37 (1.08%) Fixed Income
13 37 (1.08%) N-Tier
14 32 (0.94%) Credit Risk
14 32 (0.94%) Derivative
15 30 (0.88%) Clustering
15 30 (0.88%) Internet of Things
16 29 (0.85%) Public Cloud
Operating Systems
1 414 (12.10%) Linux
2 212 (6.20%) Unix
3 81 (2.37%) Windows
4 36 (1.05%) Android
5 35 (1.02%) Apple iOS
6 26 (0.76%) Ubuntu
7 23 (0.67%) CentOS
8 16 (0.47%) AIX
8 16 (0.47%) Red Hat Enterprise Linux
9 14 (0.41%) Mac OS X
10 10 (0.29%) Solaris
11 8 (0.23%) Windows Server
12 7 (0.20%) HPUX
13 5 (0.15%) CoreOS
13 5 (0.15%) Windows Server 2012
14 2 (0.058%) DC/OS
14 2 (0.058%) Mesosphere
14 2 (0.058%) Windows 7
14 2 (0.058%) Windows 8
15 1 (0.029%) Debian
Processes & Methodologies
1 1,276 (37.30%) Analytics
2 1,228 (35.90%) Agile Software Development
3 732 (21.40%) Machine Learning
4 548 (16.02%) DevOps
5 535 (15.64%) Business Intelligence
6 500 (14.62%) Data Analytics
7 475 (13.88%) Software Engineering
8 369 (10.79%) TDD
9 355 (10.38%) ETL
10 338 (9.88%) Microservices
11 318 (9.30%) Scrum
12 309 (9.03%) Open Source
13 308 (9.00%) Visualisation
14 292 (8.54%) Mathematics
15 255 (7.45%) Continuous Integration
16 249 (7.28%) Data Modelling
17 238 (6.96%) BDD
18 216 (6.31%) OO
19 205 (5.99%) Big Data Analytics
20 204 (5.96%) SDLC
Programming Languages
1 1,397 (40.84%) Java
2 1,289 (37.68%) Python
3 1,045 (30.55%) SQL
4 724 (21.16%) Scala
5 383 (11.20%) R
6 359 (10.49%) JavaScript
7 232 (6.78%) C#
8 196 (5.73%) C++
9 159 (4.65%) Bash Shell
10 117 (3.42%) Perl
11 115 (3.36%) Ruby
12 112 (3.27%) Go
13 109 (3.19%) PHP
14 92 (2.69%) C
15 89 (2.60%) MATLAB
16 71 (2.08%) T-SQL
17 55 (1.61%) PL/SQL
18 46 (1.34%) Shell Script
19 41 (1.20%) PowerShell
20 33 (0.96%) ES6
Qualifications
1 563 (16.46%) Degree
2 148 (4.33%) Computer Science Degree
3 136 (3.98%) PhD
4 75 (2.19%) Security Cleared
5 67 (1.96%) Master's Degree
6 57 (1.67%) Numerate Degree
7 50 (1.46%) SC Cleared
8 43 (1.26%) ISEB
9 35 (1.02%) Cisco Certification
10 34 (0.99%) DV Cleared
11 33 (0.96%) CISSP
12 31 (0.91%) CCIE
13 29 (0.85%) CCNA
14 25 (0.73%) CCNP
15 18 (0.53%) CCDP
15 18 (0.53%) CEH
15 18 (0.53%) MBA
16 16 (0.47%) Microsoft Certification
17 15 (0.44%) CCDE
17 15 (0.44%) SANS
Quality Assurance & Compliance
1 167 (4.88%) QA
2 148 (4.33%) Data Quality
3 44 (1.29%) GDPR
4 39 (1.14%) GCP
5 25 (0.73%) Solvency II
6 24 (0.70%) ISO/IEC 27001
7 21 (0.61%) Sarbanes-Oxley
8 12 (0.35%) GPG13
9 11 (0.32%) PCI DSS
10 10 (0.29%) Dodd-Frank
11 9 (0.26%) MiFID
11 9 (0.26%) PMO
12 7 (0.20%) FATCA
12 7 (0.20%) IFRS
12 7 (0.20%) IFRS 9
12 7 (0.20%) SLA
13 5 (0.15%) Actionable Recommendations
13 5 (0.15%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
14 4 (0.12%) HMG Security Policy Framework
15 3 (0.088%) EMIR
System Software
1 356 (10.41%) Docker
2 135 (3.95%) HDFS
3 83 (2.43%) Apache Flume
4 39 (1.14%) VMware Infrastructure
5 26 (0.76%) Apache ZooKeeper
6 23 (0.67%) Virtual Machines
7 15 (0.44%) Active Directory
8 12 (0.35%) Snort
9 9 (0.26%) Varnish
10 4 (0.12%) vSphere
11 3 (0.088%) VMware NSX
12 2 (0.058%) Hyper-V
12 2 (0.058%) KVM
12 2 (0.058%) MapR-FS
12 2 (0.058%) Xen
13 1 (0.029%) Cygwin
13 1 (0.029%) Oracle RAC
13 1 (0.029%) PowerHA
Systems Management
1 174 (5.09%) Kubernetes
2 145 (4.24%) Ansible
3 134 (3.92%) Puppet
4 91 (2.66%) Opscode Chef
5 86 (2.51%) Terraform
6 80 (2.34%) Hadoop YARN
7 64 (1.87%) Mesos
8 51 (1.49%) Oozie
9 25 (0.73%) Salt
10 16 (0.47%) Kibana
11 12 (0.35%) Ambari
11 12 (0.35%) Marathon
11 12 (0.35%) Suricata
12 8 (0.23%) ITRS Geneos
12 8 (0.23%) logstash
13 7 (0.20%) Docker Swarm
14 6 (0.18%) HP Quality Center
14 6 (0.18%) Prometheus
14 6 (0.18%) QRadar
15 5 (0.15%) Graphite
Vendors
1 319 (9.32%) Oracle
2 314 (9.18%) Google
3 256 (7.48%) Microsoft
4 250 (7.31%) Tableau
5 194 (5.67%) Cloudera
6 117 (3.42%) Splunk
7 105 (3.07%) Hortonworks
8 85 (2.48%) SAP
9 78 (2.28%) IBM
10 77 (2.25%) Teradata
11 73 (2.13%) Informatica
12 65 (1.90%) Talend
13 59 (1.72%) Red Hat
14 56 (1.64%) VMware
15 47 (1.37%) MapR
16 45 (1.32%) Twitter
17 43 (1.26%) Cisco
18 33 (0.96%) Adobe
18 33 (0.96%) Salesforce.com
19 30 (0.88%) F5