Period
to 22 November 2017

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 22 November 2017 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
22 Nov 2017
Same period 2016 Same period 2015
Rank 73 71 63
Rank change year-on-year -2 -8 +73
Permanent jobs citing Big Data 414 488 720
As % of all permanent IT jobs advertised in the City of London 4.04% 4.18% 4.27%
As % of the Database & Business Intelligence category 12.91% 13.83% 14.42%
Number of salaries quoted 372 426 574
City of London median annual salary £70,000 £62,500 £65,000
Median salary % change year-on-year +12.00% -3.85% -
10th Percentile £47,500 £41,750 £42,500
90th Percentile £110,000 £105,000 £101,100
Central London median annual salary £70,000 £62,500 £65,000
% change year-on-year +12.00% -3.85% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3206 3528 4992
As % of all permanent IT jobs advertised in the City of London 31.31% 30.18% 29.60%
Number of salaries quoted 2927 3240 4339
City of London median annual salary £60,000 £57,500 £57,500
Median salary % change year-on-year +4.35% - +4.55%
10th Percentile £41,250 £36,250 £36,250
90th Percentile £87,500 £86,250 £85,000
Central London median annual salary £59,500 £55,000 £57,000
% change year-on-year +8.18% -3.51% +3.64%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 22 November 2017.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 22 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +15 5 - -
Moorgate - 3 £90,000 -
Big Data
Central London

For the 6 months to 22 November 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the City of London region with a requirement for Big Data.

1 194 (46.86%) Java
2 167 (40.34%) Hadoop
3 161 (38.89%) Agile Software Development
4 134 (32.37%) Finance
5 130 (31.40%) Python
6 129 (31.16%) Apache Spark
7 121 (29.23%) SQL
8 107 (25.85%) Amazon AWS
9 101 (24.40%) Analytics
10 92 (22.22%) NoSQL
11 81 (19.57%) Scala
12 80 (19.32%) Machine Learning
13 68 (16.43%) Business Intelligence
14 65 (15.70%) DevOps
15 63 (15.22%) Data Warehouse
16 61 (14.73%) SQL Server
17 58 (14.01%) Microsoft Azure
18 55 (13.29%) Degree
19 54 (13.04%) TDD
20 53 (12.80%) Banking
21 52 (12.56%) Software Engineering
21 52 (12.56%) Microservices
22 50 (12.08%) Elasticsearch
23 49 (11.84%) MongoDB
24 48 (11.59%) Apache Hive
24 48 (11.59%) ETL
25 47 (11.35%) Continuous Integration
25 47 (11.35%) Docker
26 44 (10.63%) R
26 44 (10.63%) Linux

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 129 (31.16%) Apache Spark
2 50 (12.08%) Elasticsearch
3 42 (10.14%) Apache
4 19 (4.59%) Apache Solr
5 16 (3.86%) Tomcat
6 14 (3.38%) Apache Pig
6 14 (3.38%) SAS
7 13 (3.14%) WebLogic
8 12 (2.90%) Jetty
8 12 (2.90%) OpenStack
9 11 (2.66%) JBoss
9 11 (2.66%) WebSphere
10 9 (2.17%) WebSphere Application Server
11 4 (0.97%) CMS
11 4 (0.97%) nginx
12 3 (0.72%) Confluence
13 2 (0.48%) Apache Geronimo
13 2 (0.48%) Sitefinity
13 2 (0.48%) Umbraco
13 2 (0.48%) WildFly
Applications
1 8 (1.93%) Microsoft Excel
2 6 (1.45%) SPSS
3 1 (0.24%) Microsoft Office
3 1 (0.24%) Microsoft PowerPoint
3 1 (0.24%) Spreadsheet
Business Applications
1 3 (0.72%) HFM
1 3 (0.72%) Hyperion Enterprise
2 2 (0.48%) Bloomberg AIM
2 2 (0.48%) Markit EDM
3 1 (0.24%) Dynamics CRM
3 1 (0.24%) Oracle Applications
3 1 (0.24%) Oracle EBS
3 1 (0.24%) Oracle ERP
Cloud Services
1 107 (25.85%) Amazon AWS
2 58 (14.01%) Microsoft Azure
3 24 (5.80%) Google Cloud Platform
4 14 (3.38%) Amazon EC2
5 13 (3.14%) AWS CloudFormation
5 13 (3.14%) SaaS
6 12 (2.90%) Amazon Kinesis
6 12 (2.90%) Amazon S3
7 11 (2.66%) AWS Lambda
7 11 (2.66%) Serverless
8 10 (2.42%) GitHub
9 6 (1.45%) Cloud Computing
10 5 (1.21%) Amazon EMR
10 5 (1.21%) Virtual Private Cloud
11 4 (0.97%) Amazon CloudWatch
11 4 (0.97%) Amazon ElastiCache
12 2 (0.48%) AWS CloudTrail
12 2 (0.48%) CloudFront
12 2 (0.48%) IaaS
12 2 (0.48%) Route 53
Communications & Networking
1 10 (2.42%) HTTP
2 7 (1.69%) Internet
3 3 (0.72%) Firewall
3 3 (0.72%) Network Security
4 2 (0.48%) Broadband
4 2 (0.48%) Kerberos
4 2 (0.48%) LDAP
4 2 (0.48%) TCP/IP
5 1 (0.24%) DNS
5 1 (0.24%) GoToMeeting
5 1 (0.24%) Skype
5 1 (0.24%) SMS
5 1 (0.24%) SSL
5 1 (0.24%) VPN
5 1 (0.24%) Wireshark
5 1 (0.24%) X.509
Database & Business Intelligence
1 167 (40.34%) Hadoop
2 92 (22.22%) NoSQL
3 63 (15.22%) Data Warehouse
4 61 (14.73%) SQL Server
5 49 (11.84%) MongoDB
6 48 (11.59%) Apache Hive
7 39 (9.42%) Apache Cassandra
8 33 (7.97%) HBase
9 25 (6.04%) MySQL
9 25 (6.04%) SQL Server Integration Services
10 24 (5.80%) Amazon Redshift
11 22 (5.31%) Power BI
11 22 (5.31%) SQL Server Analysis Services
12 19 (4.59%) PostgreSQL
13 18 (4.35%) Data Mining
13 18 (4.35%) Redis
14 17 (4.11%) Relational Database
14 17 (4.11%) SQL Server Reporting Services
15 16 (3.86%) BigQuery
15 16 (3.86%) Data Lake
Development Applications
1 32 (7.73%) Git (software)
2 18 (4.35%) Jenkins
3 12 (2.90%) Maven
4 11 (2.66%) Talend Open Studio
5 10 (2.42%) Subversion
6 9 (2.17%) JIRA
7 6 (1.45%) Eclipse
7 6 (1.45%) JUnit
8 5 (1.21%) GoCD
8 5 (1.21%) RStudio
8 5 (1.21%) Selenium
8 5 (1.21%) SQL Server Management Studio (SSMS)
8 5 (1.21%) Travis CI
8 5 (1.21%) Visual Studio
9 3 (0.72%) CMake
9 3 (0.72%) Cucumber
9 3 (0.72%) Sonatype Nexus
10 2 (0.48%) Codeship
10 2 (0.48%) Gradle
11 1 (0.24%) Protractor
General
1 134 (32.37%) Finance
2 53 (12.80%) Banking
3 32 (7.73%) Marketing
4 25 (6.04%) Games
5 21 (5.07%) Retail
6 20 (4.83%) Investment Banking
7 12 (2.90%) Front Office
8 11 (2.66%) Publishing
9 9 (2.17%) Financial Institution
10 8 (1.93%) Law
11 7 (1.69%) Advertising
12 5 (1.21%) Telecoms
13 3 (0.72%) Back Office
14 2 (0.48%) Legal
14 2 (0.48%) Pharmaceutical
14 2 (0.48%) Retail Banking
15 1 (0.24%) Automotive
Job Titles
1 176 (42.51%) Developer
2 91 (21.98%) Java Developer
3 43 (10.39%) Data Engineer
4 36 (8.70%) Lead Developer
5 33 (7.97%) Architect
5 33 (7.97%) Scala Developer
6 30 (7.25%) Data Scientist
7 28 (6.76%) SQL Developer
8 27 (6.52%) Big Data Developer
9 25 (6.04%) Analyst
10 24 (5.80%) Java Scala Developer
11 22 (5.31%) Big Data Engineer
12 19 (4.59%) Apache Spark Developer
12 19 (4.59%) Hadoop Developer
13 18 (4.35%) Lead Java Developer
13 18 (4.35%) Software Engineer
13 18 (4.35%) Solutions Architect
14 17 (4.11%) Business Intelligence Developer
14 17 (4.11%) Java Hadoop Developer
14 17 (4.11%) Senior Developer
Libraries, Frameworks & Software Standards
1 40 (9.66%) AngularJS
2 38 (9.18%) REST
3 33 (7.97%) Spring
4 30 (7.25%) React
5 28 (6.76%) Kafka
5 28 (6.76%) Node.js
5 28 (6.76%) Web Services
6 25 (6.04%) Akka
7 24 (5.80%) RESTful
8 23 (5.56%) .NET
8 23 (5.56%) HTML
9 19 (4.59%) JMS
10 18 (4.35%) CSS
10 18 (4.35%) Lucene
11 16 (3.86%) Apache Camel
11 16 (3.86%) JSON
12 14 (3.38%) XML
13 12 (2.90%) Elastic Stack
13 12 (2.90%) HTML5
14 10 (2.42%) Dropwizard
Miscellaneous
1 41 (9.90%) Fintech
1 41 (9.90%) Greenfield Project
2 32 (7.73%) Algorithms
2 32 (7.73%) Computer Science
3 23 (5.56%) Analytical Skills
4 20 (4.83%) Enterprise Software
5 14 (3.38%) Equities
6 12 (2.90%) Fixed Income
7 11 (2.66%) Foreign Exchange (FX)
7 11 (2.66%) Mobile App
8 10 (2.42%) Data Structures
9 9 (2.17%) Semantic Web
9 9 (2.17%) Virtual Team
10 8 (1.93%) User Experience
11 7 (1.69%) Social Network
12 6 (1.45%) Data Centre
13 5 (1.21%) Robotics
14 4 (0.97%) Clustering
14 4 (0.97%) Digital TV
14 4 (0.97%) STB
Operating Systems
1 44 (10.63%) Linux
2 16 (3.86%) Unix
3 10 (2.42%) CentOS
4 7 (1.69%) Windows
5 5 (1.21%) Ubuntu
6 4 (0.97%) Mac OS X
6 4 (0.97%) Red Hat Enterprise Linux
7 2 (0.48%) AIX
8 1 (0.24%) Android
8 1 (0.24%) Apple iOS
Processes & Methodologies
1 161 (38.89%) Agile Software Development
2 101 (24.40%) Analytics
3 80 (19.32%) Machine Learning
4 68 (16.43%) Business Intelligence
5 65 (15.70%) DevOps
6 54 (13.04%) TDD
7 52 (12.56%) Microservices
7 52 (12.56%) Software Engineering
8 48 (11.59%) ETL
9 47 (11.35%) Continuous Integration
10 42 (10.14%) Multithreading
10 42 (10.14%) Scrum
11 33 (7.97%) Data Modelling
12 30 (7.25%) Open Source
13 28 (6.76%) Visualisation
14 26 (6.28%) Mentoring
14 26 (6.28%) Stakeholder Management
15 25 (6.04%) Statistics
16 23 (5.56%) Data Analytics
16 23 (5.56%) Predictive Analytics
Programming Languages
1 194 (46.86%) Java
2 130 (31.40%) Python
3 121 (29.23%) SQL
4 81 (19.57%) Scala
5 44 (10.63%) R
6 37 (8.94%) JavaScript
7 31 (7.49%) C#
8 28 (6.76%) C++
9 26 (6.28%) T-SQL
10 25 (6.04%) Go
11 22 (5.31%) Bash Shell
11 22 (5.31%) PHP
12 17 (4.11%) C
12 17 (4.11%) Perl
13 16 (3.86%) Ruby
14 11 (2.66%) MATLAB
15 4 (0.97%) Clojure
15 4 (0.97%) F#
16 3 (0.72%) CoffeeScript
16 3 (0.72%) Julia
Qualifications
1 55 (13.29%) Degree
2 17 (4.11%) Computer Science Degree
3 16 (3.86%) PhD
4 13 (3.14%) ISEB
5 6 (1.45%) Security Cleared
6 5 (1.21%) CISSP
6 5 (1.21%) DV Cleared
7 4 (0.97%) Microsoft Certification
8 3 (0.72%) ACCA
8 3 (0.72%) Master's Degree
8 3 (0.72%) Numerate Degree
9 2 (0.48%) CISM
9 2 (0.48%) SC Cleared
10 1 (0.24%) CCNP
10 1 (0.24%) Cisco Certification
10 1 (0.24%) Postgraduate
Quality Assurance & Compliance
1 12 (2.90%) Data Quality
2 10 (2.42%) QA
3 9 (2.17%) Sarbanes-Oxley
3 9 (2.17%) Solvency II
4 5 (1.21%) GCP
4 5 (1.21%) SLA
5 4 (0.97%) GDPR
6 3 (0.72%) PMO
7 1 (0.24%) Actionable Recommendations
7 1 (0.24%) IFRS
7 1 (0.24%) IFRS 9
7 1 (0.24%) ISO/IEC 27001
System Software
1 47 (11.35%) Docker
2 25 (6.04%) HDFS
3 10 (2.42%) Apache Flume
4 3 (0.72%) Apache ZooKeeper
5 2 (0.48%) Active Directory
5 2 (0.48%) Virtual Machines
6 1 (0.24%) Cygwin
6 1 (0.24%) KVM
6 1 (0.24%) OpenAM
6 1 (0.24%) vCloud
6 1 (0.24%) VMware Infrastructure
Systems Management
1 27 (6.52%) Ansible
2 24 (5.80%) Puppet
3 18 (4.35%) Kubernetes
3 18 (4.35%) Opscode Chef
4 16 (3.86%) Terraform
5 12 (2.90%) Kibana
5 12 (2.90%) logstash
6 10 (2.42%) Salt
7 5 (1.21%) Mesos
8 3 (0.72%) Graphite
8 3 (0.72%) Oozie
9 2 (0.48%) Hadoop YARN
9 2 (0.48%) ZABBIX
10 1 (0.24%) Consul
10 1 (0.24%) Rundeck
Vendors
1 41 (9.90%) Microsoft
2 40 (9.66%) Oracle
3 27 (6.52%) Tableau
4 21 (5.07%) Google
5 14 (3.38%) Cloudera
6 11 (2.66%) Salesforce.com
6 11 (2.66%) Talend
7 9 (2.17%) Cognos
7 9 (2.17%) Informatica
7 9 (2.17%) SAP
8 6 (1.45%) Autodesk
8 6 (1.45%) Red Hat
8 6 (1.45%) Teradata
9 5 (1.21%) Adthena
9 5 (1.21%) Splunk
10 4 (0.97%) Arqiva
10 4 (0.97%) BT
10 4 (0.97%) Hyperion
10 4 (0.97%) MicroStrategy
11 3 (0.72%) Adobe