Period
to 21 May 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 May 2018 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
21 May 2018
Same period 2017 Same period 2016
Rank 57 72 75
Rank change year-on-year +15 +3 +31
Permanent jobs citing Big Data 505 410 562
As % of all permanent IT jobs advertised in the City of London 4.77% 4.03% 4.14%
As % of the Database & Business Intelligence category 15.18% 12.72% 14.51%
Number of salaries quoted 465 373 474
City of London median annual salary £72,500 £65,000 £62,500
Median salary % change year-on-year +11.54% +4.00% -3.85%
10th Percentile £47,500 £45,000 £42,500
90th Percentile £99,500 £105,000 £104,625
Central London median annual salary £70,000 £65,000 £65,000
% change year-on-year +7.69% - +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,326 3,224 3,872
As % of all permanent IT jobs advertised in the City of London 31.42% 31.68% 28.51%
Number of salaries quoted 2,969 2,906 3,472
City of London median annual salary £62,500 £60,000 £55,000
Median salary % change year-on-year +4.17% +9.09% -
10th Percentile £41,250 £37,500 £36,500
90th Percentile £90,000 £87,500 £83,625
Central London median annual salary £62,500 £60,000 £55,000
% change year-on-year +4.17% +9.09% -

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 21 May 2018.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 21 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +3 3 £80,000 +68.42%
Big Data
Central London

For the 6 months to 21 May 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 206 (40.79%) Java
2 185 (36.63%) Python
3 184 (36.44%) Finance
4 179 (35.45%) SQL
5 177 (35.05%) Hadoop
6 167 (33.07%) Analytics
7 163 (32.28%) Apache Spark
8 156 (30.89%) Agile Software Development
9 143 (28.32%) Amazon AWS
10 137 (27.13%) Machine Learning
11 128 (25.35%) Scala
12 115 (22.77%) Data Science
13 99 (19.60%) Data Lake
14 96 (19.01%) NoSQL
15 85 (16.83%) Microsoft Azure
16 83 (16.44%) Business Intelligence
17 79 (15.64%) Data Warehouse
18 74 (14.65%) Kafka
19 71 (14.06%) C#
19 71 (14.06%) SQL Server
20 70 (13.86%) Microsoft
21 68 (13.47%) Fintech
22 67 (13.27%) ETL
23 65 (12.87%) Degree
23 65 (12.87%) Power BI
24 59 (11.68%) Apache Hive
24 59 (11.68%) Banking
25 56 (11.09%) SQL Server Reporting Services
25 56 (11.09%) DevOps
26 55 (10.89%) TDD

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 163 (32.28%) Apache Spark
2 34 (6.73%) Elasticsearch
3 16 (3.17%) Apache
4 12 (2.38%) Apache Pig
4 12 (2.38%) SAS
5 9 (1.78%) SharePoint
6 7 (1.39%) Apache Solr
7 6 (1.19%) NServiceBus
8 5 (0.99%) Tomcat
9 3 (0.59%) WordPress
10 2 (0.40%) Apache Airflow
10 2 (0.40%) IIS
10 2 (0.40%) JBoss
10 2 (0.40%) Luigi
11 1 (0.20%) Cloud Foundry
11 1 (0.20%) Confluence
11 1 (0.20%) GemFire
11 1 (0.20%) Jetty
11 1 (0.20%) nginx
11 1 (0.20%) Oracle Workflow
Applications
1 6 (1.19%) Microsoft Excel
2 4 (0.79%) SPSS
Business Applications
1 1 (0.20%) SAP CRM
1 1 (0.20%) SAP S/4HANA
Cloud Services
1 143 (28.32%) Amazon AWS
2 85 (16.83%) Microsoft Azure
3 18 (3.56%) Azure Data Factory
4 16 (3.17%) Serverless
5 15 (2.97%) AWS Lambda
5 15 (2.97%) Cloud Computing
5 15 (2.97%) Cortana Intelligence Suite
6 13 (2.57%) SaaS
7 11 (2.18%) Amazon Kinesis
7 11 (2.18%) IaaS
8 10 (1.98%) Amazon EMR
9 7 (1.39%) GitHub
10 5 (0.99%) Amazon S3
10 5 (0.99%) OpenShift
11 4 (0.79%) Datadog
12 3 (0.59%) Amazon EC2
12 3 (0.59%) Google Cloud Platform
13 2 (0.40%) AWS CloudFormation
13 2 (0.40%) Office 365
14 1 (0.20%) Virtual Private Cloud
Communications & Networking
1 10 (1.98%) Firewall
1 10 (1.98%) Internet
2 7 (1.39%) DNS
3 6 (1.19%) HTTP
4 4 (0.79%) SMTP
4 4 (0.79%) TCP/IP
4 4 (0.79%) VPN
5 3 (0.59%) Intranet
5 3 (0.59%) LAN
5 3 (0.59%) SAN
6 2 (0.40%) Kerberos
6 2 (0.40%) Wi-Fi
6 2 (0.40%) WLAN
7 1 (0.20%) Broadband
7 1 (0.20%) WAN
Database & Business Intelligence
1 177 (35.05%) Hadoop
2 99 (19.60%) Data Lake
3 96 (19.01%) NoSQL
4 79 (15.64%) Data Warehouse
5 71 (14.06%) SQL Server
6 65 (12.87%) Power BI
7 59 (11.68%) Apache Hive
8 56 (11.09%) SQL Server Reporting Services
9 48 (9.50%) SQL Server Integration Services
10 40 (7.92%) MongoDB
11 39 (7.72%) Apache Cassandra
12 36 (7.13%) HBase
13 31 (6.14%) SQL Server Analysis Services
14 25 (4.95%) Relational Database
15 22 (4.36%) PostgreSQL
15 22 (4.36%) SQL Server 2008
16 17 (3.37%) Data Mining
17 16 (3.17%) Azure SQL Database
17 16 (3.17%) QlikView
18 15 (2.97%) OLAP
Development Applications
1 25 (4.95%) Git (software)
2 17 (3.37%) Jenkins
3 13 (2.57%) Maven
3 13 (2.57%) Visual Studio
4 9 (1.78%) Subversion
5 8 (1.58%) TeamCity
6 7 (1.39%) Eclipse
6 7 (1.39%) JUnit
7 6 (1.19%) GoCD
7 6 (1.19%) Sonatype Nexus
7 6 (1.19%) SQL Server Management Studio (SSMS)
8 5 (0.99%) AppVeyor
8 5 (0.99%) Octopus Deploy
9 4 (0.79%) Artifactory
10 3 (0.59%) JIRA
10 3 (0.59%) Selenium
11 2 (0.40%) NUnit
11 2 (0.40%) Oracle APEX
11 2 (0.40%) SpecFlow
11 2 (0.40%) Visual Studio Team System
General
1 184 (36.44%) Finance
2 59 (11.68%) Banking
3 22 (4.36%) Publishing
4 20 (3.96%) Front Office
5 15 (2.97%) Advertising
6 11 (2.18%) Games
6 11 (2.18%) Marketing
6 11 (2.18%) Retail
7 10 (1.98%) Investment Banking
8 6 (1.19%) Law
9 5 (0.99%) Financial Institution
10 3 (0.59%) Automotive
10 3 (0.59%) Pharmaceutical
11 2 (0.40%) Mandarin Language
11 2 (0.40%) Telecoms
12 1 (0.20%) Aerospace
12 1 (0.20%) Retail Banking
Job Titles
1 198 (39.21%) Developer
2 74 (14.65%) Data Engineer
2 74 (14.65%) Java Developer
3 53 (10.50%) Big Data Developer
4 47 (9.31%) Big Data Engineer
5 44 (8.71%) Architect
6 40 (7.92%) Data Scientist
7 35 (6.93%) Scala Developer
8 31 (6.14%) Business Intelligence Developer
9 30 (5.94%) SQL Developer
10 22 (4.36%) Analyst
10 22 (4.36%) Python Developer
11 19 (3.76%) Consultant
12 18 (3.56%) Senior Developer
12 18 (3.56%) SQL BI Developer
13 17 (3.37%) Data Manager
14 16 (3.17%) Data Architect
14 16 (3.17%) Software Engineer
15 15 (2.97%) Hadoop Developer
15 15 (2.97%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 74 (14.65%) Kafka
2 46 (9.11%) .NET
3 27 (5.35%) REST
4 25 (4.95%) Natural Language Processing
5 23 (4.55%) Spring
6 21 (4.16%) RabbitMQ
7 17 (3.37%) AngularJS
7 17 (3.37%) XML
8 16 (3.17%) Akka
8 16 (3.17%) Node.js
9 15 (2.97%) Web Services
10 14 (2.77%) ASP.NET
10 14 (2.77%) ASP.NET MVC
10 14 (2.77%) WPF
11 12 (2.38%) Django
12 11 (2.18%) Elastic Stack
12 11 (2.18%) HTML
13 10 (1.98%) JSON
13 10 (1.98%) WCF
14 9 (1.78%) RESTful
Miscellaneous
1 68 (13.47%) Fintech
2 55 (10.89%) Computer Science
3 35 (6.93%) Algorithms
4 33 (6.53%) Analytical Skills
5 30 (5.94%) Greenfield Project
6 19 (3.76%) Equities
7 15 (2.97%) Foreign Exchange (FX)
8 14 (2.77%) Linux Command Line
9 13 (2.57%) User Experience
10 12 (2.38%) Fixed Income
11 11 (2.18%) Data Structures
12 10 (1.98%) Self-Motivation
13 9 (1.78%) Market Risk
14 8 (1.58%) Enterprise Software
14 8 (1.58%) Hedge funds
14 8 (1.58%) Internet of Things
14 8 (1.58%) Public Cloud
14 8 (1.58%) Tandem
14 8 (1.58%) Virtual Team
15 7 (1.39%) Clustering
Operating Systems
1 53 (10.50%) Linux
2 24 (4.75%) Unix
3 21 (4.16%) Windows
4 7 (1.39%) Windows Server
5 6 (1.19%) Red Hat Enterprise Linux
6 5 (0.99%) CentOS
7 4 (0.79%) AIX
7 4 (0.79%) HPUX
7 4 (0.79%) Solaris
8 3 (0.59%) Windows 10
9 2 (0.40%) Android
10 1 (0.20%) DC/OS
10 1 (0.20%) Ubuntu
10 1 (0.20%) Windows Server 2012
Processes & Methodologies
1 167 (33.07%) Analytics
2 156 (30.89%) Agile Software Development
3 137 (27.13%) Machine Learning
4 115 (22.77%) Data Science
5 83 (16.44%) Business Intelligence
6 67 (13.27%) ETL
7 56 (11.09%) DevOps
8 55 (10.89%) TDD
9 49 (9.70%) Mathematics
10 47 (9.31%) Data Analytics
11 46 (9.11%) Artificial Intelligence
11 46 (9.11%) Data Engineering
12 44 (8.71%) Scrum
13 42 (8.32%) Microservices
13 42 (8.32%) Open Source
14 41 (8.12%) Software Engineering
15 34 (6.73%) Problem-Solving
16 33 (6.53%) Mentoring
17 31 (6.14%) Visualisation
18 29 (5.74%) Statistics
Programming Languages
1 206 (40.79%) Java
2 185 (36.63%) Python
3 179 (35.45%) SQL
4 128 (25.35%) Scala
5 71 (14.06%) C#
6 48 (9.50%) R
7 46 (9.11%) JavaScript
8 42 (8.32%) T-SQL
9 38 (7.52%) Java 8
10 14 (2.77%) C++
11 12 (2.38%) Bash Shell
12 10 (1.98%) Go
12 10 (1.98%) Ruby
13 9 (1.78%) PHP
14 7 (1.39%) U-SQL
15 6 (1.19%) F#
15 6 (1.19%) MATLAB
15 6 (1.19%) Perl
16 4 (0.79%) Kotlin
16 4 (0.79%) VB
Qualifications
1 65 (12.87%) Degree
2 19 (3.76%) Computer Science Degree
3 15 (2.97%) PhD
4 4 (0.79%) Master's Degree
4 4 (0.79%) MBA
4 4 (0.79%) Microsoft Certification
4 4 (0.79%) Security Cleared
5 3 (0.59%) PMP
5 3 (0.59%) TOGAF Certification
6 2 (0.40%) CCDA
6 2 (0.40%) CCNA
6 2 (0.40%) CCNP
6 2 (0.40%) Cisco Certification
6 2 (0.40%) CISM
6 2 (0.40%) CISSP
6 2 (0.40%) HP ASE
6 2 (0.40%) OCA
6 2 (0.40%) Oracle Certification
6 2 (0.40%) PMI Certification
6 2 (0.40%) VMware Certified Professional (VCP)
Quality Assurance & Compliance
1 17 (3.37%) Data Quality
2 16 (3.17%) QA
3 9 (1.78%) GDPR
4 6 (1.19%) MiFID
5 4 (0.79%) Solvency II
6 3 (0.59%) Actionable Recommendations
6 3 (0.59%) EMIR
7 2 (0.40%) ISO/IEC 27001
7 2 (0.40%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
8 1 (0.20%) Dodd-Frank
8 1 (0.20%) FATCA
8 1 (0.20%) SLA
System Software
1 45 (8.91%) Docker
2 21 (4.16%) HDFS
3 14 (2.77%) Apache Flume
4 11 (2.18%) Virtual Machines
5 7 (1.39%) VMware Infrastructure
6 4 (0.79%) Active Directory
7 3 (0.59%) Apache ZooKeeper
7 3 (0.59%) Hyper-V
8 1 (0.20%) VirtualBox
8 1 (0.20%) vSphere
Systems Management
1 40 (7.92%) Kubernetes
2 26 (5.15%) Ansible
3 17 (3.37%) Mesos
3 17 (3.37%) Oozie
4 16 (3.17%) Terraform
5 14 (2.77%) Puppet
6 11 (2.18%) Hadoop YARN
7 10 (1.98%) Consul
8 6 (1.19%) Salt
9 5 (0.99%) Opscode Chef
10 3 (0.59%) Docker Swarm
10 3 (0.59%) Kibana
11 2 (0.40%) Control-M
11 2 (0.40%) Graphite
11 2 (0.40%) logstash
11 2 (0.40%) Red Hat Satellite
11 2 (0.40%) Simian Army
12 1 (0.20%) Check_MK
12 1 (0.20%) Nagios
12 1 (0.20%) Rsyslog
Vendors
1 70 (13.86%) Microsoft
2 41 (8.12%) Oracle
3 37 (7.33%) Tableau
4 32 (6.34%) Google
5 28 (5.54%) Cloudera
6 21 (4.16%) Hortonworks
7 17 (3.37%) IBM
8 16 (3.17%) MapR
9 11 (2.18%) VMware
10 9 (1.78%) Apigee
11 8 (1.58%) Cognos
12 7 (1.39%) Facebook
12 7 (1.39%) SAP
13 6 (1.19%) Capita
13 6 (1.19%) Informatica
14 4 (0.79%) New Relic
15 3 (0.59%) Alteryx
15 3 (0.59%) Datameer
15 3 (0.59%) Sybase
15 3 (0.59%) Teradata