Period
to 14 August 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 14 August 2018 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
14 Aug 2018
Same period 2017 Same period 2016
Rank 55 80 74
Rank change year-on-year +25 -6 +10
Permanent jobs citing Big Data 545 375 503
As % of all permanent IT jobs advertised in the City of London 4.98% 3.68% 3.85%
As % of the Database & Business Intelligence category 15.71% 11.59% 13.61%
Number of salaries quoted 505 341 433
City of London median annual salary £75,000 £65,000 £60,000
Median salary % change year-on-year +15.38% +8.33% -9.43%
10th Percentile £48,000 £46,250 £42,500
90th Percentile £106,250 £102,500 £105,000
Central London median annual salary £74,500 £65,000 £62,500
% change year-on-year +14.62% +4.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,470 3,235 3,697
As % of all permanent IT jobs advertised in the City of London 31.72% 31.74% 28.27%
Number of salaries quoted 3,140 2,905 3,355
City of London median annual salary £65,000 £60,000 £55,000
Median salary % change year-on-year +8.33% +9.09% -
10th Percentile £40,000 £37,500 £37,500
90th Percentile £92,500 £87,500 £83,750
Central London median annual salary £65,000 £60,000 £55,000
% change year-on-year +8.33% +9.09% -

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 14 August 2018.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 14 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -2 4 £80,000 +68.42%
Big Data
Central London

For the 6 months to 14 August 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 233 (42.75%) Java
2 212 (38.90%) SQL
3 207 (37.98%) Finance
4 194 (35.60%) Agile Software Development
5 186 (34.13%) Python
6 160 (29.36%) Hadoop
7 154 (28.26%) Apache Spark
8 153 (28.07%) Analytics
9 130 (23.85%) Amazon AWS
10 125 (22.94%) Machine Learning
11 120 (22.02%) Scala
12 116 (21.28%) Data Warehouse
13 106 (19.45%) Data Science
14 93 (17.06%) Kafka
15 89 (16.33%) SQL Server
16 88 (16.15%) NoSQL
17 87 (15.96%) Data Lake
18 85 (15.60%) ETL
19 84 (15.41%) Banking
20 80 (14.68%) Business Intelligence
21 74 (13.58%) Microsoft Azure
22 73 (13.39%) Degree
23 70 (12.84%) Microsoft
24 69 (12.66%) C#
24 69 (12.66%) Apache Hive
24 69 (12.66%) DevOps
24 69 (12.66%) Power BI
25 67 (12.29%) Continuous Integration
26 66 (12.11%) SQL Server Integration Services
27 65 (11.93%) Mathematics

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (28.26%) Apache Spark
2 19 (3.49%) Elasticsearch
3 17 (3.12%) Apache Pig
4 12 (2.20%) SAS
5 9 (1.65%) Apache
5 9 (1.65%) SharePoint
6 7 (1.28%) Apache Solr
7 6 (1.10%) Confluence
8 4 (0.73%) IIS
8 4 (0.73%) WordPress
9 3 (0.55%) NServiceBus
10 2 (0.37%) GemFire
10 2 (0.37%) Jetty
10 2 (0.37%) Oracle Workflow
10 2 (0.37%) Tomcat
10 2 (0.37%) WebSphere
10 2 (0.37%) WebSphere Application Server
11 1 (0.18%) CMS
11 1 (0.18%) nginx
11 1 (0.18%) OpenStack
Applications
1 13 (2.39%) Microsoft Excel
2 4 (0.73%) Microsoft Office
3 2 (0.37%) Microsoft PowerPoint
4 1 (0.18%) MS Visio
Cloud Services
1 130 (23.85%) Amazon AWS
2 74 (13.58%) Microsoft Azure
3 16 (2.94%) Amazon EMR
4 15 (2.75%) Amazon Kinesis
4 15 (2.75%) Google Cloud Platform
5 11 (2.02%) Cloud Computing
6 7 (1.28%) Serverless
7 6 (1.10%) AWS Lambda
8 5 (0.92%) GitHub
9 4 (0.73%) Amazon EC2
9 4 (0.73%) Amazon SQS
9 4 (0.73%) SaaS
10 3 (0.55%) Amazon CloudWatch
10 3 (0.55%) AWS CloudFormation
10 3 (0.55%) OpenShift
11 2 (0.37%) Amazon ElastiCache
11 2 (0.37%) Azure Data Factory
11 2 (0.37%) Datadog
11 2 (0.37%) IaaS
11 2 (0.37%) Virtual Private Cloud
Communications & Networking
1 10 (1.83%) Internet
2 7 (1.28%) Firewall
3 6 (1.10%) DNS
4 4 (0.73%) Intranet
4 4 (0.73%) TCP/IP
5 3 (0.55%) LAN
5 3 (0.55%) VPN
5 3 (0.55%) Wireless
6 2 (0.37%) GSM
6 2 (0.37%) HTTP
6 2 (0.37%) LTE
6 2 (0.37%) SMTP
6 2 (0.37%) Wi-Fi
6 2 (0.37%) WLAN
7 1 (0.18%) Broadband
7 1 (0.18%) Kerberos
7 1 (0.18%) SAN
7 1 (0.18%) SSL
7 1 (0.18%) WAN
Database & Business Intelligence
1 160 (29.36%) Hadoop
2 116 (21.28%) Data Warehouse
3 89 (16.33%) SQL Server
4 88 (16.15%) NoSQL
5 87 (15.96%) Data Lake
6 69 (12.66%) Apache Hive
6 69 (12.66%) Power BI
7 66 (12.11%) SQL Server Integration Services
8 65 (11.93%) SQL Server Reporting Services
9 37 (6.79%) Relational Database
10 32 (5.87%) Apache Cassandra
11 30 (5.50%) SQL Server Analysis Services
12 27 (4.95%) MySQL
13 25 (4.59%) PostgreSQL
13 25 (4.59%) SQL Server 2008
14 23 (4.22%) HBase
15 18 (3.30%) MongoDB
16 16 (2.94%) BusinessObjects
17 15 (2.75%) Cosmos DB
18 14 (2.57%) Sqoop
Development Applications
1 30 (5.50%) Jenkins
2 17 (3.12%) Git (software)
3 16 (2.94%) Maven
4 11 (2.02%) SQL Server Management Studio (SSMS)
5 10 (1.83%) Subversion
6 8 (1.47%) JIRA
7 7 (1.28%) Visual Studio
8 6 (1.10%) Gradle
8 6 (1.10%) JUnit
8 6 (1.10%) Selenium
9 5 (0.92%) TeamCity
10 4 (0.73%) Sonatype Nexus
11 3 (0.55%) GoCD
11 3 (0.55%) RStudio
12 2 (0.37%) Artifactory
12 2 (0.37%) Bitbucket
12 2 (0.37%) GitLab
12 2 (0.37%) Jasmine
12 2 (0.37%) SonarQube
12 2 (0.37%) SpecFlow
General
1 207 (37.98%) Finance
2 84 (15.41%) Banking
3 19 (3.49%) Law
4 18 (3.30%) Advertising
4 18 (3.30%) Games
4 18 (3.30%) Investment Banking
5 17 (3.12%) Marketing
6 15 (2.75%) Front Office
7 12 (2.20%) Publishing
8 9 (1.65%) Retail
9 6 (1.10%) Telecoms
10 5 (0.92%) Financial Institution
10 5 (0.92%) Pharmaceutical
11 3 (0.55%) Aerospace
12 2 (0.37%) Automotive
13 1 (0.18%) French Language
13 1 (0.18%) Mandarin Language
13 1 (0.18%) Multimedia
Job Titles
1 242 (44.40%) Developer
2 109 (20.00%) Java Developer
3 88 (16.15%) Data Engineer
4 57 (10.46%) Big Data Developer
5 53 (9.72%) Architect
6 52 (9.54%) SQL Developer
7 46 (8.44%) Data Scientist
8 45 (8.26%) Big Data Engineer
9 40 (7.34%) Business Intelligence Developer
10 29 (5.32%) Scala Developer
11 27 (4.95%) Python Developer
11 27 (4.95%) Senior Developer
12 25 (4.59%) SQL BI Developer
13 24 (4.40%) Data Architect
14 21 (3.85%) Consultant
14 21 (3.85%) Data Warehouse Developer
15 20 (3.67%) Big Data Architect
15 20 (3.67%) Lead Developer
16 19 (3.49%) SSRS Developer
16 19 (3.49%) T-SQL Developer
Libraries, Frameworks & Software Standards
1 93 (17.06%) Kafka
2 45 (8.26%) .NET
3 36 (6.61%) REST
4 31 (5.69%) Web Services
4 31 (5.69%) XML
5 27 (4.95%) Spring
6 24 (4.40%) Natural Language Processing
6 24 (4.40%) Node.js
7 21 (3.85%) Akka
8 20 (3.67%) HTML
9 18 (3.30%) Hibernate
9 18 (3.30%) SOAP
10 17 (3.12%) RESTful
11 15 (2.75%) JSON
11 15 (2.75%) RabbitMQ
12 11 (2.02%) React
13 10 (1.83%) AngularJS
14 9 (1.65%) ASP.NET
14 9 (1.65%) ASP.NET MVC
14 9 (1.65%) HTML5
Miscellaneous
1 60 (11.01%) Computer Science
2 53 (9.72%) Greenfield Project
3 48 (8.81%) Fintech
4 47 (8.62%) Analytical Skills
5 31 (5.69%) Algorithms
6 23 (4.22%) Data Structures
7 14 (2.57%) Equities
7 14 (2.57%) Self-Motivation
8 13 (2.39%) Market Risk
8 13 (2.39%) Public Cloud
9 12 (2.20%) Tandem
9 12 (2.20%) Virtual Team
10 11 (2.02%) Management Information System
11 10 (1.83%) Internet of Things
12 8 (1.47%) Credit Risk
12 8 (1.47%) Derivative
12 8 (1.47%) Foreign Exchange (FX)
12 8 (1.47%) Linux Command Line
13 7 (1.28%) Reference Data
13 7 (1.28%) User Experience
Operating Systems
1 49 (8.99%) Linux
2 28 (5.14%) Unix
3 21 (3.85%) Windows
4 8 (1.47%) AIX
4 8 (1.47%) HPUX
4 8 (1.47%) Solaris
5 6 (1.10%) Red Hat Enterprise Linux
6 5 (0.92%) Windows Server
7 4 (0.73%) Android
7 4 (0.73%) Windows 10
8 3 (0.55%) CentOS
9 2 (0.37%) Apple iOS
10 1 (0.18%) Windows Server 2012
Processes & Methodologies
1 194 (35.60%) Agile Software Development
2 153 (28.07%) Analytics
3 125 (22.94%) Machine Learning
4 106 (19.45%) Data Science
5 85 (15.60%) ETL
6 80 (14.68%) Business Intelligence
7 69 (12.66%) DevOps
8 67 (12.29%) Continuous Integration
9 65 (11.93%) Mathematics
10 58 (10.64%) Artificial Intelligence
11 56 (10.28%) Microservices
12 54 (9.91%) Mentoring
12 54 (9.91%) TDD
13 53 (9.72%) Data Analytics
14 47 (8.62%) Data Management
15 45 (8.26%) Data Engineering
15 45 (8.26%) Open Source
16 42 (7.71%) Software Engineering
17 39 (7.16%) Data Modelling
18 36 (6.61%) Statistics
Programming Languages
1 233 (42.75%) Java
2 212 (38.90%) SQL
3 186 (34.13%) Python
4 120 (22.02%) Scala
5 69 (12.66%) C#
6 59 (10.83%) R
6 59 (10.83%) T-SQL
7 53 (9.72%) JavaScript
8 52 (9.54%) Java 8
9 19 (3.49%) Bash Shell
9 19 (3.49%) C++
10 12 (2.20%) VB
11 11 (2.02%) Go
12 9 (1.65%) Kotlin
13 7 (1.28%) Perl
13 7 (1.28%) Ruby
14 6 (1.10%) PHP
15 5 (0.92%) PowerShell
16 3 (0.55%) F#
16 3 (0.55%) Groovy
Qualifications
1 73 (13.39%) Degree
2 20 (3.67%) PhD
3 8 (1.47%) Computer Science Degree
4 7 (1.28%) Numerate Degree
5 5 (0.92%) Postgraduate
6 4 (0.73%) AWS Certification
6 4 (0.73%) Master's Degree
7 3 (0.55%) Security Cleared
8 2 (0.37%) CCDA
8 2 (0.37%) CCNA
8 2 (0.37%) CCNP
8 2 (0.37%) Cisco Certification
8 2 (0.37%) HP ASE
8 2 (0.37%) HPE ATP
8 2 (0.37%) MBA
8 2 (0.37%) OCA
8 2 (0.37%) Oracle Certification
8 2 (0.37%) VMware Certified Professional (VCP)
8 2 (0.37%) VTSP
9 1 (0.18%) TOGAF Certification
Quality Assurance & Compliance
1 22 (4.04%) Data Quality
2 20 (3.67%) QA
3 9 (1.65%) GDPR
4 6 (1.10%) GCP
5 5 (0.92%) MiFID
6 1 (0.18%) Dodd-Frank
6 1 (0.18%) EMIR
6 1 (0.18%) FATCA
6 1 (0.18%) IFRS
6 1 (0.18%) IFRS 9
6 1 (0.18%) ISO/IEC 27001
6 1 (0.18%) PMO
6 1 (0.18%) SLA
6 1 (0.18%) Solvency II
System Software
1 56 (10.28%) Docker
2 25 (4.59%) HDFS
3 21 (3.85%) Apache Flume
4 6 (1.10%) Active Directory
5 4 (0.73%) Apache ZooKeeper
5 4 (0.73%) Virtual Machines
5 4 (0.73%) VirtualBox
6 3 (0.55%) VMware Infrastructure
7 1 (0.18%) Hyper-V
7 1 (0.18%) Tivoli Workload Scheduler
7 1 (0.18%) vSphere
Systems Management
1 31 (5.69%) Kubernetes
2 23 (4.22%) Ansible
3 21 (3.85%) Oozie
4 18 (3.30%) Puppet
5 10 (1.83%) Mesos
5 10 (1.83%) Terraform
6 8 (1.47%) Hadoop YARN
7 6 (1.10%) Opscode Chef
8 5 (0.92%) Consul
9 4 (0.73%) Prometheus
10 3 (0.55%) Kibana
10 3 (0.55%) Salt
11 2 (0.37%) Grafana
11 2 (0.37%) logstash
11 2 (0.37%) Nagios
11 2 (0.37%) Packer
12 1 (0.18%) Capistrano
12 1 (0.18%) Check_MK
12 1 (0.18%) Rsyslog
12 1 (0.18%) Tivoli
Vendors
1 70 (12.84%) Microsoft
2 48 (8.81%) Oracle
3 32 (5.87%) Tableau
4 22 (4.04%) Google
5 17 (3.12%) Hortonworks
6 15 (2.75%) Cloudera
7 13 (2.39%) Apigee
7 13 (2.39%) Cognos
7 13 (2.39%) MapR
8 11 (2.02%) Informatica
9 8 (1.47%) VMware
10 7 (1.28%) IBM
10 7 (1.28%) Solace
11 5 (0.92%) Capita
12 4 (0.73%) Alteryx
12 4 (0.73%) Facebook
12 4 (0.73%) Talend
13 3 (0.55%) Datameer
13 3 (0.55%) Dell
13 3 (0.55%) New Relic