Period
to 12 December 2019

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 12 December 2019 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
12 Dec 2019
Same period 2018 Same period 2017
Rank 56 53 67
Rank change year-on-year -3 +14 +11
Permanent jobs citing Big Data 440 529 436
As % of all permanent IT jobs advertised in the City of London 4.47% 4.96% 4.21%
As % of the Database & Business Intelligence category 15.79% 16.26% 13.63%
Number of salaries quoted 390 506 396
City of London median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% +7.69%
10th Percentile £51,250 £49,750 £47,500
90th Percentile £112,500 £102,500 £108,750
Central London median annual salary £75,000 £75,000 £70,000
% change year-on-year - +7.14% +7.69%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 2,787 3,253 3,200
As % of all permanent IT jobs advertised in the City of London 28.32% 30.49% 30.89%
Number of salaries quoted 2,458 2,950 2,922
City of London median annual salary £69,900 £65,000 £60,000
Median salary % change year-on-year +7.54% +8.33% +4.35%
10th Percentile £42,500 £41,250 £41,250
90th Percentile £102,500 £95,000 £89,875
Central London median annual salary £67,500 £65,000 £60,000
% change year-on-year +3.85% +8.33% +4.35%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 12 December 2019.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 12 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -9 2 £65,000 -25.71%
Moorgate - 1 £60,000 - 1
Big Data
Central London

For the 6 months to 12 December 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 176 (40.00%) Python
2 172 (39.09%) SQL
3 169 (38.41%) Java
4 157 (35.68%) Apache Spark
5 143 (32.50%) Hadoop
6 140 (31.82%) Analytics
7 138 (31.36%) Finance
8 122 (27.73%) AWS
9 120 (27.27%) Agile Software Development
10 108 (24.55%) Azure
11 107 (24.32%) Machine Learning
11 107 (24.32%) Docker
12 104 (23.64%) Data Science
13 89 (20.23%) Microservices
14 88 (20.00%) Kubernetes
15 86 (19.55%) DevOps
15 86 (19.55%) Data Warehouse
16 81 (18.41%) Scala
17 78 (17.73%) NoSQL
18 74 (16.82%) Apache Hive
19 69 (15.68%) Data Structures
19 69 (15.68%) ETL
19 69 (15.68%) Google
20 68 (15.45%) Software Engineering
20 68 (15.45%) Analytical Skills
21 66 (15.00%) GCP
22 65 (14.77%) JavaScript
23 64 (14.55%) Algorithms
24 62 (14.09%) Kafka
25 61 (13.86%) Degree

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 157 (35.68%) Apache Spark
2 42 (9.55%) Elasticsearch
3 13 (2.95%) Apache
4 12 (2.73%) Apache Airflow
5 7 (1.59%) Luigi
6 6 (1.36%) SAS
7 4 (0.91%) Apache Solr
7 4 (0.91%) CMS
7 4 (0.91%) Confluence
8 2 (0.45%) Apache Pig
9 1 (0.23%) WildFly
Applications
1 9 (2.05%) Microsoft Excel
2 3 (0.68%) Microsoft Office
Business Applications
1 3 (0.68%) SAP MDG
2 1 (0.23%) FINCAD Analytics
2 1 (0.23%) Sparx Enterprise Architect
Cloud Services
1 122 (27.73%) AWS
2 108 (24.55%) Azure
3 66 (15.00%) GCP
4 16 (3.64%) Power Platform
5 15 (3.41%) SaaS
6 13 (2.95%) Amazon EMR
6 13 (2.95%) Amazon S3
7 9 (2.05%) Azure Data Factory
7 9 (2.05%) Serverless
8 8 (1.82%) GitHub
9 6 (1.36%) AWS CloudFormation
10 5 (1.14%) AWS Lambda
10 5 (1.14%) Cloud Computing
11 4 (0.91%) Amazon EC2
11 4 (0.91%) Amazon Kinesis
12 3 (0.68%) Amazon SQS
12 3 (0.68%) PaaS
13 2 (0.45%) Amazon CloudWatch
13 2 (0.45%) CloudFront
13 2 (0.45%) Route 53
Communications & Networking
1 4 (0.91%) DHCP
1 4 (0.91%) DMZ
1 4 (0.91%) DNS
2 2 (0.45%) Broadband
2 2 (0.45%) HTTP
2 2 (0.45%) Internet
3 1 (0.23%) VPN
Database & Business Intelligence
1 143 (32.50%) Hadoop
2 86 (19.55%) Data Warehouse
3 78 (17.73%) NoSQL
4 74 (16.82%) Apache Hive
5 47 (10.68%) MongoDB
6 34 (7.73%) Relational Database
6 34 (7.73%) SQL Server
7 30 (6.82%) Apache Cassandra
7 30 (6.82%) PostgreSQL
8 19 (4.32%) Data Lake
9 16 (3.64%) Power BI
10 15 (3.41%) MySQL
10 15 (3.41%) SQL Server Integration Services
11 14 (3.18%) HBase
12 13 (2.95%) Amazon Redshift
12 13 (2.95%) Flink
13 12 (2.73%) Amazon Athena
14 11 (2.50%) SQL Server Reporting Services
15 10 (2.27%) HDInsight
16 9 (2.05%) Presto
Development Applications
1 35 (7.95%) Git (software)
2 24 (5.45%) Jenkins
3 13 (2.95%) JIRA
4 8 (1.82%) ER Studio
5 7 (1.59%) ERwin
5 7 (1.59%) PowerDesigner
6 4 (0.91%) Visual Studio
7 3 (0.68%) Atlassian Bamboo
7 3 (0.68%) Octopus Deploy
7 3 (0.68%) TeamCity
7 3 (0.68%) Vagrant
8 2 (0.45%) JUnit
9 1 (0.23%) Flyway
9 1 (0.23%) git-flow
9 1 (0.23%) HP UFT
9 1 (0.23%) NUnit
9 1 (0.23%) Rational Robot
9 1 (0.23%) SilkTest
9 1 (0.23%) SonarQube
9 1 (0.23%) WinRunner
General
1 138 (31.36%) Finance
2 36 (8.18%) Marketing
3 34 (7.73%) Banking
4 24 (5.45%) Advertising
5 17 (3.86%) Front Office
6 16 (3.64%) Legal
7 15 (3.41%) Law
7 15 (3.41%) Retail
8 13 (2.95%) Investment Banking
9 10 (2.27%) Financial Institution
10 3 (0.68%) Publishing
10 3 (0.68%) Telecoms
11 2 (0.45%) Billing
11 2 (0.45%) Manufacturing
11 2 (0.45%) Public Sector
12 1 (0.23%) Automotive
12 1 (0.23%) Games
Job Titles
1 174 (39.55%) Developer
2 95 (21.59%) Data Engineer
2 95 (21.59%) Java Developer
3 59 (13.41%) Senior Developer
4 40 (9.09%) Senior Java Developer
5 37 (8.41%) Architect
6 35 (7.95%) Python Engineer
7 31 (7.05%) Senior Data Engineer
8 29 (6.59%) Python Developer
9 22 (5.00%) DevOps Engineer
10 17 (3.86%) Big Data Engineer
10 17 (3.86%) Data Scientist
11 16 (3.64%) AWS Developer
11 16 (3.64%) Data Architect
11 16 (3.64%) React Developer
12 15 (3.41%) Analyst
13 14 (3.18%) Head of Technology
13 14 (3.18%) NoSQL Developer
14 13 (2.95%) AWS Engineer
14 13 (2.95%) Scala Developer
Libraries, Frameworks & Software Standards
1 62 (14.09%) Kafka
2 42 (9.55%) RESTful
3 35 (7.95%) AngularJS
4 33 (7.50%) React
5 28 (6.36%) HTML
6 27 (6.14%) GraphQL
6 27 (6.14%) TensorFlow
7 26 (5.91%) Pandas
7 26 (5.91%) scikit-learn
8 25 (5.68%) HTML5
9 22 (5.00%) Node.js
9 22 (5.00%) REST
10 21 (4.77%) Keras
11 19 (4.32%) CSS
12 18 (4.09%) .NET
13 13 (2.95%) .NET Core
13 13 (2.95%) .NET Framework
13 13 (2.95%) Django
13 13 (2.95%) XML
14 12 (2.73%) SciPy
Miscellaneous
1 69 (15.68%) Data Structures
2 68 (15.45%) Analytical Skills
3 64 (14.55%) Algorithms
4 24 (5.45%) Greenfield Project
5 22 (5.00%) Linux Command Line
5 22 (5.00%) Management Information System
6 15 (3.41%) Credit Risk
7 10 (2.27%) Market Risk
7 10 (2.27%) User Experience
8 8 (1.82%) Data Centre
9 7 (1.59%) Equities
9 7 (1.59%) Spread Betting
10 6 (1.36%) Robotics
10 6 (1.36%) Social Media
11 5 (1.14%) Cyberthreat
11 5 (1.14%) Digital Media
11 5 (1.14%) Hedge funds
12 4 (0.91%) Client/Server
13 3 (0.68%) Fixed Income
13 3 (0.68%) N-Tier
Operating Systems
1 50 (11.36%) Linux
2 38 (8.64%) Unix
3 11 (2.50%) Windows
4 4 (0.91%) Solaris
5 2 (0.45%) CentOS
5 2 (0.45%) Ubuntu
6 1 (0.23%) Red Hat Enterprise Linux
Processes & Methodologies
1 140 (31.82%) Analytics
2 120 (27.27%) Agile Software Development
3 107 (24.32%) Machine Learning
4 104 (23.64%) Data Science
5 89 (20.23%) Microservices
6 86 (19.55%) DevOps
7 69 (15.68%) ETL
8 68 (15.45%) Software Engineering
9 58 (13.18%) Computer Science
10 56 (12.73%) Data Analytics
11 55 (12.50%) Artificial Intelligence
12 51 (11.59%) Problem-Solving
13 48 (10.91%) Fintech
14 47 (10.68%) Business Intelligence
15 40 (9.09%) Decision-Making
16 39 (8.86%) Data Modelling
17 38 (8.64%) Visualisation
18 35 (7.95%) Data Integration
19 34 (7.73%) TDD
20 32 (7.27%) Data Management
Programming Languages
1 176 (40.00%) Python
2 172 (39.09%) SQL
3 169 (38.41%) Java
4 81 (18.41%) Scala
5 65 (14.77%) JavaScript
6 44 (10.00%) C#
7 33 (7.50%) TypeScript
8 26 (5.91%) C++
9 21 (4.77%) R
10 18 (4.09%) PHP
11 17 (3.86%) PL/SQL
12 16 (3.64%) Kotlin
13 12 (2.73%) ES6
14 11 (2.50%) C
14 11 (2.50%) Java 8
15 10 (2.27%) Bash Shell
15 10 (2.27%) Go
16 4 (0.91%) Clojure
16 4 (0.91%) Haskell
16 4 (0.91%) T-SQL
Qualifications
1 61 (13.86%) Degree
2 26 (5.91%) Master's Degree
3 25 (5.68%) Computer Science Degree
4 23 (5.23%) PhD
5 4 (0.91%) MCP
5 4 (0.91%) Microsoft Certification
5 4 (0.91%) RHCE
6 3 (0.68%) Security Cleared
7 2 (0.45%) Numerate Degree
7 2 (0.45%) SC Cleared
8 1 (0.23%) APMP
8 1 (0.23%) ITIL Certification
8 1 (0.23%) Six Sigma Black Belt
Quality Assurance & Compliance
1 30 (6.82%) Data Quality
2 18 (4.09%) QA
3 5 (1.14%) PCI DSS
4 4 (0.91%) SLA
5 3 (0.68%) GDPR
5 3 (0.68%) ISO/IEC 27001
6 1 (0.23%) Basel III
6 1 (0.23%) IFRS
6 1 (0.23%) IFRS 9
System Software
1 107 (24.32%) Docker
2 11 (2.50%) HDFS
3 6 (1.36%) Active Directory
4 4 (0.91%) Apache ZooKeeper
4 4 (0.91%) Firmware
4 4 (0.91%) NFS
5 2 (0.45%) Apache Flume
Systems Management
1 88 (20.00%) Kubernetes
2 51 (11.59%) Terraform
3 19 (4.32%) Consul
4 17 (3.86%) Ansible
5 10 (2.27%) Oozie
6 9 (2.05%) Docker Swarm
6 9 (2.05%) Packer
7 6 (1.36%) Puppet
8 4 (0.91%) Opscode Chef
9 2 (0.45%) Hadoop YARN
10 1 (0.23%) Control-M
Vendors
1 69 (15.68%) Google
2 33 (7.50%) Microsoft
3 29 (6.59%) Oracle
4 19 (4.32%) Tableau
5 16 (3.64%) Teradata
6 15 (3.41%) Informatica
7 11 (2.50%) IBM
7 11 (2.50%) SAP
8 8 (1.82%) Talend
9 7 (1.59%) Databricks
10 4 (0.91%) MuleSoft
10 4 (0.91%) Samsung
10 4 (0.91%) ServiceNow
10 4 (0.91%) Splunk
11 3 (0.68%) Ab Initio
11 3 (0.68%) Cloudera
11 3 (0.68%) MapR
11 3 (0.68%) Salesforce.com
11 3 (0.68%) UiPath
12 2 (0.45%) Netezza