Period
to 18 November 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 18 November 2017 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
18 Nov 2017
Same period 2016 Same period 2015
Rank 65 66 67
Rank change year-on-year +1 +1 +47
Permanent jobs citing Big Data 3373 3183 3761
As % of all permanent IT jobs advertised in London 4.50% 4.19% 4.21%
As % of the Database & Business Intelligence category 15.28% 14.24% 13.75%
Number of salaries quoted 2672 2713 3066
London median annual salary £69,108 £70,000 £65,000
Median salary % change year-on-year -1.27% +7.69% +4.00%
10th Percentile £45,000 £45,000 £41,250
90th Percentile £100,000 £110,000 £98,750
England median annual salary £62,500 £62,500 £60,000
% change year-on-year - +4.17% +4.35%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22080 22349 27350
As % of all permanent IT jobs advertised in London 29.43% 29.42% 30.64%
Number of salaries quoted 17685 19438 23124
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 18 November 2017.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 18 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -12 517 £70,000 +12.00% 51
West London +36 71 £62,500 +8.70% 8
South London +10 25 £67,500 +4.65% 3
North London +14 15 £100,000 +78.57% 6
East London -6 14 £67,500 -3.57% 14
Big Data
England

For the 6 months to 18 November 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Big Data.

1 1390 (41.21%) Java
2 1346 (39.91%) Agile Software Development
3 1317 (39.05%) Analytics
4 1309 (38.81%) Hadoop
5 1175 (34.84%) Python
6 1074 (31.84%) Apache Spark
7 978 (28.99%) SQL
8 952 (28.22%) Finance
9 690 (20.46%) Amazon AWS
10 670 (19.86%) Scala
11 599 (17.76%) Machine Learning
12 596 (17.67%) Business Intelligence
13 585 (17.34%) NoSQL
14 542 (16.07%) Data Warehouse
15 539 (15.98%) Degree
16 519 (15.39%) DevOps
17 513 (15.21%) Data Analytics
18 469 (13.90%) Software Engineering
19 451 (13.37%) Banking
20 444 (13.16%) Apache Cassandra
21 436 (12.93%) Analytical Skills
22 409 (12.13%) Linux
23 397 (11.77%) Microsoft Azure
24 394 (11.68%) ETL
25 391 (11.59%) R
26 385 (11.41%) TDD
27 382 (11.33%) JavaScript
27 382 (11.33%) Open Source
28 375 (11.12%) Relational Database
29 360 (10.67%) Kafka

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1074 (31.84%) Apache Spark
2 233 (6.91%) Apache
3 215 (6.37%) Elasticsearch
4 167 (4.95%) SAS
5 99 (2.94%) Apache Pig
6 89 (2.64%) Apache Solr
7 75 (2.22%) Confluence
8 68 (2.02%) Tomcat
9 58 (1.72%) OpenStack
10 55 (1.63%) WebSphere
11 51 (1.51%) JBoss
12 44 (1.30%) WebLogic
13 41 (1.22%) CMS
14 33 (0.98%) Moodle
15 28 (0.83%) Apache Airflow
16 25 (0.74%) Oracle SOA Suite
17 24 (0.71%) Jetty
18 22 (0.65%) Apache Geronimo
18 22 (0.65%) WildFly
19 17 (0.50%) nginx
Applications
1 61 (1.81%) SPSS
2 55 (1.63%) Microsoft Excel
3 16 (0.47%) Chatbot
4 13 (0.39%) Microsoft PowerPoint
5 9 (0.27%) Microsoft Office
6 7 (0.21%) MS Visio
7 5 (0.15%) OmniGraffle
7 5 (0.15%) Photoshop
8 4 (0.12%) Adobe Illustrator
9 3 (0.089%) Mathematica
9 3 (0.089%) Microsoft Project
10 2 (0.059%) GNU Octave
10 2 (0.059%) Weka
11 1 (0.030%) InVision
11 1 (0.030%) Spreadsheet
11 1 (0.030%) Stata
Business Applications
1 14 (0.42%) Markit EDM
2 11 (0.33%) BusinessWorks
2 11 (0.33%) TIBCO BusinessEvents
3 10 (0.30%) HFM
4 8 (0.24%) Oracle Applications
5 7 (0.21%) Hyperion Enterprise
5 7 (0.21%) Oracle EBS
5 7 (0.21%) Oracle ERP
6 5 (0.15%) Dynamics CRM
6 5 (0.15%) Eloqua
6 5 (0.15%) Oracle TCA
6 5 (0.15%) SessionCam
6 5 (0.15%) Social Studio
7 4 (0.12%) Hyperion Planning
7 4 (0.12%) Oracle Receivables
7 4 (0.12%) Payment Gateway
8 3 (0.089%) SAP Retail
9 2 (0.059%) Bloomberg AIM
9 2 (0.059%) Oracle Procure-to-Pay
10 1 (0.030%) Odoo
Cloud Services
1 690 (20.46%) Amazon AWS
2 397 (11.77%) Microsoft Azure
3 194 (5.75%) Google Cloud Platform
4 146 (4.33%) SaaS
5 88 (2.61%) Cloud Computing
6 79 (2.34%) PaaS
7 70 (2.08%) IaaS
8 63 (1.87%) GitHub
9 49 (1.45%) Amazon EC2
10 43 (1.27%) Serverless
11 41 (1.22%) AWS CloudFormation
12 40 (1.19%) Azure Machine Learning
13 39 (1.16%) Amazon S3
14 33 (0.98%) Google Analytics
15 31 (0.92%) Amazon Kinesis
16 27 (0.80%) Adobe Analytics
16 27 (0.80%) AWS Lambda
17 23 (0.68%) Amazon EMR
18 17 (0.50%) AdWords
19 16 (0.47%) Azure Data Factory
Communications & Networking
1 70 (2.08%) Internet
2 48 (1.42%) HTTP
3 32 (0.95%) Kerberos
4 23 (0.68%) Firewall
5 20 (0.59%) Network Security
5 20 (0.59%) SSL
6 14 (0.42%) DNS
7 13 (0.39%) LDAP
7 13 (0.39%) TCP/IP
8 9 (0.27%) SAN
9 8 (0.24%) DSL
10 6 (0.18%) Skype
11 5 (0.15%) DHCP
11 5 (0.15%) HTTPS
11 5 (0.15%) OpenVPN
11 5 (0.15%) Remote Desktop
11 5 (0.15%) Unified Communications
12 4 (0.12%) Broadband
12 4 (0.12%) VPN
12 4 (0.12%) Wireless Security
Database & Business Intelligence
1 1309 (38.81%) Hadoop
2 585 (17.34%) NoSQL
3 542 (16.07%) Data Warehouse
4 444 (13.16%) Apache Cassandra
5 375 (11.12%) Relational Database
6 351 (10.41%) SQL Server
7 348 (10.32%) Apache Hive
8 312 (9.25%) MongoDB
9 244 (7.23%) RDBMS
10 226 (6.70%) HBase
11 198 (5.87%) MySQL
12 148 (4.39%) Power BI
13 142 (4.21%) SQL Server Integration Services
14 113 (3.35%) Data Mining
15 112 (3.32%) SQL Server Analysis Services
16 101 (2.99%) SQL Server Reporting Services
17 100 (2.96%) Redis
18 96 (2.85%) QlikView
19 92 (2.73%) Amazon Redshift
20 91 (2.70%) Data Lake
Development Applications
1 219 (6.49%) Git (software)
2 197 (5.84%) Jenkins
3 143 (4.24%) JIRA
4 86 (2.55%) Maven
5 83 (2.46%) Selenium
6 64 (1.90%) Cucumber
7 57 (1.69%) Atlassian Bamboo
8 54 (1.60%) Talend Open Studio
9 50 (1.48%) Bitbucket
10 36 (1.07%) Team Foundation Server
11 35 (1.04%) TeamCity
12 34 (1.01%) JUnit
13 32 (0.95%) Subversion
14 27 (0.80%) IntelliJ
15 26 (0.77%) Hudson
16 21 (0.62%) Travis CI
16 21 (0.62%) WebDriver
17 20 (0.59%) Eclipse
17 20 (0.59%) Gradle
18 18 (0.53%) Jasmine
General
1 952 (28.22%) Finance
2 451 (13.37%) Banking
3 318 (9.43%) Marketing
4 263 (7.80%) Retail
5 248 (7.35%) Investment Banking
6 173 (5.13%) Front Office
7 147 (4.36%) Retail Banking
8 141 (4.18%) Telecoms
9 107 (3.17%) Manufacturing
10 98 (2.91%) Games
11 88 (2.61%) Electronics
12 74 (2.19%) Advertising
13 73 (2.16%) Legal
14 46 (1.36%) Financial Institution
15 45 (1.33%) Law
16 43 (1.27%) Publishing
17 37 (1.10%) Pharmaceutical
18 20 (0.59%) Back Office
19 19 (0.56%) Aerospace
20 14 (0.42%) French Language
Job Titles
1 966 (28.64%) Developer
2 444 (13.16%) Architect
3 358 (10.61%) Java Developer
4 298 (8.83%) Data Engineer
5 250 (7.41%) Consultant
6 243 (7.20%) Data Scientist
7 217 (6.43%) Software Engineer
8 211 (6.26%) Analyst
9 208 (6.17%) Big Data Engineer
10 193 (5.72%) Senior Developer
11 168 (4.98%) Big Data Developer
12 164 (4.86%) Data Architect
13 138 (4.09%) Solutions Architect
14 121 (3.59%) Python Developer
15 114 (3.38%) Scala Developer
16 110 (3.26%) Senior Java Developer
17 96 (2.85%) Big Data Architect
18 89 (2.64%) SQL Developer
19 85 (2.52%) Data Analyst
20 84 (2.49%) Lead Developer
Libraries, Frameworks & Software Standards
1 360 (10.67%) Kafka
2 271 (8.03%) Spring
3 243 (7.20%) AngularJS
4 214 (6.34%) HTML
5 204 (6.05%) .NET
6 194 (5.75%) REST
7 191 (5.66%) React
8 186 (5.51%) Web Services
9 182 (5.40%) Node.js
10 171 (5.07%) CSS
11 122 (3.62%) RESTful
12 119 (3.53%) HTML5
13 109 (3.23%) Hibernate
14 107 (3.17%) Natural Language Processing
15 89 (2.64%) Akka
16 82 (2.43%) JSON
17 77 (2.28%) J2EE
18 70 (2.08%) XML
19 69 (2.05%) NumPy
20 66 (1.96%) RabbitMQ
Miscellaneous
1 436 (12.93%) Analytical Skills
2 347 (10.29%) Computer Science
3 269 (7.98%) Algorithms
4 229 (6.79%) Greenfield Project
5 207 (6.14%) Fintech
6 180 (5.34%) User Experience
7 158 (4.68%) Enterprise Software
8 87 (2.58%) Mobile App
9 63 (1.87%) Data Structures
10 59 (1.75%) Data Centre
11 45 (1.33%) Management Information System
11 45 (1.33%) Social Media
12 42 (1.25%) Hedge funds
13 37 (1.10%) Equities
13 37 (1.10%) Internet of Things
14 35 (1.04%) Derivative
15 34 (1.01%) Public Cloud
16 32 (0.95%) Credit Risk
17 31 (0.92%) N-Tier
18 30 (0.89%) Digital Media
Operating Systems
1 409 (12.13%) Linux
2 171 (5.07%) Unix
3 93 (2.76%) Windows
4 54 (1.60%) Android
5 45 (1.33%) Apple iOS
6 31 (0.92%) Ubuntu
7 23 (0.68%) CentOS
8 15 (0.44%) AIX
9 13 (0.39%) Mac OS X
9 13 (0.39%) Red Hat Enterprise Linux
10 12 (0.36%) Windows Server
11 8 (0.24%) Debian
11 8 (0.24%) Solaris
12 6 (0.18%) HPUX
13 5 (0.15%) Windows Server 2012
14 4 (0.12%) Windows Server 2008
15 3 (0.089%) CoreOS
16 1 (0.030%) DC/OS
16 1 (0.030%) Mac OS
16 1 (0.030%) Mesosphere
Processes & Methodologies
1 1346 (39.91%) Agile Software Development
2 1317 (39.05%) Analytics
3 599 (17.76%) Machine Learning
4 596 (17.67%) Business Intelligence
5 519 (15.39%) DevOps
6 513 (15.21%) Data Analytics
7 469 (13.90%) Software Engineering
8 394 (11.68%) ETL
9 385 (11.41%) TDD
10 382 (11.33%) Open Source
11 359 (10.64%) Scrum
12 317 (9.40%) Microservices
13 304 (9.01%) BDD
14 276 (8.18%) Visualisation
15 275 (8.15%) Continuous Integration
16 264 (7.83%) OO
17 249 (7.38%) SDLC
18 240 (7.12%) Mathematics
19 235 (6.97%) Data Modelling
20 234 (6.94%) Big Data Analytics
Programming Languages
1 1390 (41.21%) Java
2 1175 (34.84%) Python
3 978 (28.99%) SQL
4 670 (19.86%) Scala
5 391 (11.59%) R
6 382 (11.33%) JavaScript
7 195 (5.78%) C#
8 184 (5.46%) C++
9 127 (3.77%) Bash Shell
10 116 (3.44%) Perl
11 112 (3.32%) Go
12 110 (3.26%) Ruby
13 107 (3.17%) C
14 92 (2.73%) PHP
15 84 (2.49%) T-SQL
16 72 (2.13%) MATLAB
17 57 (1.69%) Shell Script
18 56 (1.66%) PL/SQL
19 38 (1.13%) PowerShell
20 36 (1.07%) ES6
Qualifications
1 539 (15.98%) Degree
2 154 (4.57%) Computer Science Degree
3 125 (3.71%) PhD
4 91 (2.70%) Security Cleared
5 61 (1.81%) SC Cleared
6 58 (1.72%) DV Cleared
7 56 (1.66%) Master's Degree
8 49 (1.45%) ISEB
9 41 (1.22%) Numerate Degree
10 20 (0.59%) CISSP
11 19 (0.56%) MBA
12 15 (0.44%) ISTQB
12 15 (0.44%) PMI Certification
12 15 (0.44%) PMP
13 13 (0.39%) Cisco Certification
14 12 (0.36%) Microsoft Certification
15 11 (0.33%) CCNA
16 9 (0.27%) CCIE
16 9 (0.27%) CCNP
16 9 (0.27%) CTC Cleared
Quality Assurance & Compliance
1 159 (4.71%) QA
2 149 (4.42%) Data Quality
3 45 (1.33%) GCP
4 41 (1.22%) GDPR
5 20 (0.59%) Solvency II
6 17 (0.50%) ISO/IEC 27001
6 17 (0.50%) Sarbanes-Oxley
7 16 (0.47%) MiFID
8 12 (0.36%) Dodd-Frank
9 9 (0.27%) PCI DSS
10 8 (0.24%) EMIR
10 8 (0.24%) PMO
11 7 (0.21%) GPG13
11 7 (0.21%) SLA
12 4 (0.12%) Actionable Recommendations
12 4 (0.12%) IFRS
12 4 (0.12%) IFRS 9
12 4 (0.12%) ISO 14001
13 3 (0.089%) COBIT
13 3 (0.089%) FATCA
System Software
1 358 (10.61%) Docker
2 152 (4.51%) HDFS
3 93 (2.76%) Apache Flume
4 23 (0.68%) Active Directory
4 23 (0.68%) Apache ZooKeeper
5 20 (0.59%) VMware Infrastructure
6 12 (0.36%) Virtual Machines
7 10 (0.30%) Snort
8 9 (0.27%) Varnish
9 5 (0.15%) KVM
10 4 (0.12%) Hyper-V
10 4 (0.12%) VMware NSX
10 4 (0.12%) Xen
11 3 (0.089%) vSphere
12 2 (0.059%) OpenAM
13 1 (0.030%) Cygwin
13 1 (0.030%) MapR-FS
13 1 (0.030%) Oracle RAC
13 1 (0.030%) PowerHA
13 1 (0.030%) vCloud
Systems Management
1 158 (4.68%) Kubernetes
2 142 (4.21%) Ansible
3 128 (3.79%) Puppet
4 102 (3.02%) Opscode Chef
5 77 (2.28%) Terraform
6 72 (2.13%) Mesos
7 54 (1.60%) Oozie
8 40 (1.19%) Hadoop YARN
9 27 (0.80%) Salt
10 24 (0.71%) Kibana
11 18 (0.53%) logstash
12 16 (0.47%) Marathon
13 10 (0.30%) Ambari
14 9 (0.27%) ITRS Geneos
15 8 (0.24%) Packer
16 7 (0.21%) Nagios
16 7 (0.21%) Suricata
17 5 (0.15%) Docker Swarm
17 5 (0.15%) Prometheus
17 5 (0.15%) QRadar
Vendors
1 318 (9.43%) Oracle
2 264 (7.83%) Google
3 250 (7.41%) Microsoft
4 236 (7.00%) Tableau
5 160 (4.74%) Cloudera
6 119 (3.53%) SAP
7 112 (3.32%) Splunk
8 95 (2.82%) Hortonworks
9 79 (2.34%) Informatica
10 69 (2.05%) Teradata
11 63 (1.87%) IBM
12 58 (1.72%) Red Hat
13 54 (1.60%) MapR
13 54 (1.60%) Talend
14 44 (1.30%) Salesforce.com
15 37 (1.10%) Adobe
16 35 (1.04%) VMware
17 26 (0.77%) Cognos
18 25 (0.74%) Hyperion
18 25 (0.74%) Twitter