Period
to 16 September 2019

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 16 September 2019 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
16 Sep 2019
Same period 2018 Same period 2017
Rank 56 58 86
Rank change year-on-year +2 +28 -15
Permanent jobs citing Big Data 495 521 362
As % of all permanent IT jobs advertised in the City of London 4.92% 4.78% 3.57%
As % of the Database & Business Intelligence category 15.78% 15.31% 11.29%
Number of salaries quoted 443 490 324
City of London median annual salary £77,500 £75,000 £67,500
Median salary % change year-on-year +3.33% +11.11% +8.00%
10th Percentile £51,250 £50,000 £47,500
90th Percentile £112,500 £106,250 £102,500
Central London median annual salary £77,500 £75,000 £67,500
% change year-on-year +3.33% +11.11% +8.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,136 3,403 3,205
As % of all permanent IT jobs advertised in the City of London 31.17% 31.25% 31.57%
Number of salaries quoted 2,824 3,085 2,913
City of London median annual salary £67,500 £65,000 £60,000
Median salary % change year-on-year +3.85% +8.33% +4.35%
10th Percentile £42,500 £40,000 £40,000
90th Percentile £97,500 £93,750 £87,500
Central London median annual salary £65,000 £65,000 £60,000
% change year-on-year - +8.33% +9.09%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 16 September 2019.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 16 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -9 3 £65,000 -18.75%
Moorgate - 1 £60,000 -
Big Data
Central London

For the 6 months to 16 September 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 241 (48.69%) Python
2 198 (40.00%) Analytics
3 176 (35.56%) Java
4 174 (35.15%) SQL
5 164 (33.13%) Finance
6 149 (30.10%) Apache Spark
7 148 (29.90%) Hadoop
8 143 (28.89%) Machine Learning
9 138 (27.88%) Agile Software Development
10 137 (27.68%) Data Science
11 135 (27.27%) AWS
12 124 (25.05%) Azure
13 106 (21.41%) NoSQL
14 101 (20.40%) Docker
15 99 (20.00%) DevOps
16 93 (18.79%) Business Intelligence
17 91 (18.38%) Microservices
17 91 (18.38%) Data Warehouse
18 89 (17.98%) Scala
19 83 (16.77%) Kubernetes
20 81 (16.36%) Data Analytics
21 79 (15.96%) Kafka
21 79 (15.96%) Analytical Skills
22 74 (14.95%) Artificial Intelligence
23 73 (14.75%) GCP
24 71 (14.34%) ETL
25 70 (14.14%) Algorithms
26 69 (13.94%) Linux
27 64 (12.93%) Software Engineering
28 59 (11.92%) MongoDB

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 149 (30.10%) Apache Spark
2 43 (8.69%) Elasticsearch
3 29 (5.86%) Apache
4 10 (2.02%) SAS
5 7 (1.41%) Apache Solr
6 6 (1.21%) Apache Airflow
6 6 (1.21%) SharePoint
7 5 (1.01%) Apache Pig
7 5 (1.01%) CMS
8 4 (0.81%) Luigi
9 3 (0.61%) Confluence
10 1 (0.20%) BizTalk Server
10 1 (0.20%) OpenStack
10 1 (0.20%) WebSphere
10 1 (0.20%) WildFly
Applications
1 3 (0.61%) Microsoft Excel
2 2 (0.40%) Microsoft Office
3 1 (0.20%) Spreadsheet
Cloud Services
1 135 (27.27%) AWS
2 124 (25.05%) Azure
3 73 (14.75%) GCP
4 58 (11.72%) Power Platform
5 16 (3.23%) Amazon EMR
6 14 (2.83%) Serverless
7 12 (2.42%) AWS Lambda
8 10 (2.02%) GitHub
9 9 (1.82%) Amazon S3
10 8 (1.62%) Cloud Computing
11 7 (1.41%) SaaS
12 6 (1.21%) Amazon Kinesis
12 6 (1.21%) AWS CloudFormation
12 6 (1.21%) PaaS
13 5 (1.01%) Amazon EC2
14 4 (0.81%) Amazon CloudWatch
14 4 (0.81%) Amazon SQS
14 4 (0.81%) Azure Data Factory
14 4 (0.81%) Route 53
15 3 (0.61%) CloudFront
Communications & Networking
1 7 (1.41%) Internet
2 2 (0.40%) Broadband
2 2 (0.40%) VPN
3 1 (0.20%) HTTP
3 1 (0.20%) Skype
Database & Business Intelligence
1 148 (29.90%) Hadoop
2 106 (21.41%) NoSQL
3 91 (18.38%) Data Warehouse
4 59 (11.92%) MongoDB
5 58 (11.72%) Power BI
6 53 (10.71%) Apache Hive
7 52 (10.51%) SQL Server
8 37 (7.47%) Apache Cassandra
9 34 (6.87%) SQL Server Reporting Services
10 33 (6.67%) Data Lake
11 30 (6.06%) PostgreSQL
11 30 (6.06%) QlikView
12 29 (5.86%) SQL Server Integration Services
13 23 (4.65%) Relational Database
14 15 (3.03%) SQL Server Analysis Services
15 14 (2.83%) HBase
16 12 (2.42%) MySQL
17 11 (2.22%) OLTP
18 10 (2.02%) Flink
19 9 (1.82%) Azure SQL Data Warehouse
Development Applications
1 26 (5.25%) Jenkins
2 13 (2.63%) Git (software)
3 11 (2.22%) ER Studio
3 11 (2.22%) ERwin
3 11 (2.22%) PowerDesigner
4 9 (1.82%) JIRA
5 7 (1.41%) Selenium
6 4 (0.81%) Atlassian Bamboo
6 4 (0.81%) Octopus Deploy
6 4 (0.81%) TeamCity
6 4 (0.81%) Visual Studio Team System
7 3 (0.61%) Vagrant
8 2 (0.40%) Gradle
8 2 (0.40%) Team Foundation Server
8 2 (0.40%) Visual Studio
9 1 (0.20%) Artifactory
9 1 (0.20%) HP UFT
9 1 (0.20%) RIATest
9 1 (0.20%) WebDriver
9 1 (0.20%) WinRunner
General
1 164 (33.13%) Finance
2 37 (7.47%) Banking
3 34 (6.87%) Marketing
4 29 (5.86%) Retail
5 23 (4.65%) Advertising
6 17 (3.43%) Front Office
7 14 (2.83%) Financial Institution
8 9 (1.82%) Law
9 8 (1.62%) Investment Banking
9 8 (1.62%) Telecoms
10 7 (1.41%) Legal
11 4 (0.81%) Publishing
12 3 (0.61%) Manufacturing
12 3 (0.61%) Public Sector
13 2 (0.40%) Games
13 2 (0.40%) Retail Banking
14 1 (0.20%) Electronics
14 1 (0.20%) Pharmaceutical
Job Titles
1 176 (35.56%) Developer
2 92 (18.59%) Data Engineer
3 84 (16.97%) Java Developer
4 54 (10.91%) Senior Developer
5 50 (10.10%) Architect
6 41 (8.28%) Senior Java Developer
7 38 (7.68%) DevOps Engineer
8 37 (7.47%) Python Engineer
9 34 (6.87%) Data Scientist
10 30 (6.06%) Senior Data Engineer
11 29 (5.86%) Python Developer
12 28 (5.66%) Big Data Engineer
13 23 (4.65%) AWS Engineer
14 22 (4.44%) Data Architect
15 19 (3.84%) Lead Developer
16 18 (3.64%) Cloud Engineer
17 17 (3.43%) Senior Data Scientist
17 17 (3.43%) SQL Developer
18 16 (3.23%) Kubernetes Engineer
19 15 (3.03%) AWS DevOps Engineer
Libraries, Frameworks & Software Standards
1 79 (15.96%) Kafka
2 38 (7.68%) REST
3 30 (6.06%) RESTful
4 29 (5.86%) TensorFlow
5 28 (5.66%) AngularJS
5 28 (5.66%) scikit-learn
5 28 (5.66%) Web Services
6 27 (5.45%) Pandas
7 26 (5.25%) React
8 20 (4.04%) GraphQL
8 20 (4.04%) Keras
9 19 (3.84%) Spring
10 18 (3.64%) Natural Language Processing
11 17 (3.43%) .NET
12 16 (3.23%) HTML
12 16 (3.23%) SciPy
13 15 (3.03%) Elastic Stack
13 15 (3.03%) Flask
14 13 (2.63%) Django
14 13 (2.63%) HTML5
Miscellaneous
1 79 (15.96%) Analytical Skills
2 70 (14.14%) Algorithms
3 52 (10.51%) Data Structures
4 22 (4.44%) Greenfield Project
5 19 (3.84%) Credit Risk
6 18 (3.64%) Linux Command Line
6 18 (3.64%) Management Information System
7 13 (2.63%) Spread Betting
8 10 (2.02%) Market Risk
9 9 (1.82%) Robotics
10 7 (1.41%) Data Centre
10 7 (1.41%) Social Media
11 6 (1.21%) Mobile App
11 6 (1.21%) User Experience
12 5 (1.01%) Cyberthreat
12 5 (1.01%) Equities
12 5 (1.01%) Hedge funds
13 4 (0.81%) Internet of Things
13 4 (0.81%) Self-Motivation
13 4 (0.81%) Virtual Team
Operating Systems
1 69 (13.94%) Linux
2 31 (6.26%) Unix
3 22 (4.44%) Windows
4 4 (0.81%) Red Hat Enterprise Linux
5 3 (0.61%) CentOS
5 3 (0.61%) Ubuntu
6 1 (0.20%) Apple iOS
6 1 (0.20%) Mac OS
6 1 (0.20%) Windows Server
Processes & Methodologies
1 198 (40.00%) Analytics
2 143 (28.89%) Machine Learning
3 138 (27.88%) Agile Software Development
4 137 (27.68%) Data Science
5 99 (20.00%) DevOps
6 93 (18.79%) Business Intelligence
7 91 (18.38%) Microservices
8 81 (16.36%) Data Analytics
9 74 (14.95%) Artificial Intelligence
10 71 (14.34%) ETL
11 64 (12.93%) Software Engineering
12 56 (11.31%) Data Modelling
13 52 (10.51%) Visualisation
14 48 (9.70%) Problem-Solving
14 48 (9.70%) TDD
15 46 (9.29%) Data Engineering
16 44 (8.89%) Data Integration
17 42 (8.48%) Computer Science
18 40 (8.08%) Data Management
19 37 (7.47%) Fintech
Programming Languages
1 241 (48.69%) Python
2 176 (35.56%) Java
3 174 (35.15%) SQL
4 89 (17.98%) Scala
5 53 (10.71%) JavaScript
5 53 (10.71%) R
6 33 (6.67%) C#
7 28 (5.66%) Bash Shell
8 20 (4.04%) C++
9 15 (3.03%) TypeScript
10 12 (2.42%) Java 8
11 10 (2.02%) Clojure
12 8 (1.62%) C
12 8 (1.62%) PHP
12 8 (1.62%) PL/SQL
12 8 (1.62%) PowerShell
12 8 (1.62%) T-SQL
13 7 (1.41%) Go
14 5 (1.01%) ES6
14 5 (1.01%) Haskell
Qualifications
1 52 (10.51%) Degree
2 28 (5.66%) PhD
3 26 (5.25%) Master's Degree
4 13 (2.63%) Computer Science Degree
5 7 (1.41%) Numerate Degree
6 3 (0.61%) Security Cleared
7 2 (0.40%) DV Cleared
8 1 (0.20%) A+ Certification
8 1 (0.20%) APMP
8 1 (0.20%) AWS Certification
8 1 (0.20%) CCNA
8 1 (0.20%) Cisco Certification
8 1 (0.20%) CISM
8 1 (0.20%) CISSP
8 1 (0.20%) ITIL Certification
8 1 (0.20%) ITIL Foundation Certificate
8 1 (0.20%) Microsoft Certification
8 1 (0.20%) PRINCE2 Practitioner
8 1 (0.20%) SC Cleared
8 1 (0.20%) Six Sigma Black Belt
Quality Assurance & Compliance
1 29 (5.86%) QA
2 21 (4.24%) Data Quality
3 10 (2.02%) PCI DSS
4 2 (0.40%) GDPR
4 2 (0.40%) ISO/IEC 27001
System Software
1 101 (20.40%) Docker
2 12 (2.42%) HDFS
3 3 (0.61%) Active Directory
3 3 (0.61%) Apache Flume
3 3 (0.61%) Apache ZooKeeper
3 3 (0.61%) Oracle RAC
4 1 (0.20%) VMware Infrastructure
Systems Management
1 83 (16.77%) Kubernetes
2 59 (11.92%) Terraform
3 34 (6.87%) Ansible
4 30 (6.06%) Puppet
5 15 (3.03%) Consul
6 14 (2.83%) Opscode Chef
7 11 (2.22%) Docker Swarm
8 8 (1.62%) Oozie
8 8 (1.62%) Packer
9 2 (0.40%) Enterprise Manager Cloud Control
9 2 (0.40%) Hadoop YARN
10 1 (0.20%) Control-M
10 1 (0.20%) Jamf Pro
10 1 (0.20%) Mesos
10 1 (0.20%) Microsoft Intune
Vendors
1 57 (11.52%) Google
2 54 (10.91%) Tableau
3 53 (10.71%) Microsoft
4 25 (5.05%) Oracle
5 18 (3.64%) Informatica
6 14 (2.83%) IBM
7 12 (2.42%) SAP
7 12 (2.42%) Teradata
8 10 (2.02%) Talend
9 9 (1.82%) Hortonworks
10 6 (1.21%) Cloudera
11 5 (1.01%) Cognos
11 5 (1.01%) Databricks
11 5 (1.01%) MuleSoft
12 4 (0.81%) UiPath
12 4 (0.81%) Xamarin
13 3 (0.61%) Alteryx
13 3 (0.61%) MapR
13 3 (0.61%) Netezza
13 3 (0.61%) Samsung