Period
to 17 June 2019

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 17 June 2019 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
17 Jun 2019
Same period 2018 Same period 2017
Rank 58 60 73
Rank change year-on-year +2 +13 +3
Permanent jobs citing Big Data 452 529 398
As % of all permanent IT jobs advertised in the City of London 4.51% 4.80% 3.93%
As % of the Database & Business Intelligence category 14.52% 15.25% 12.28%
Number of salaries quoted 408 481 365
City of London median annual salary £75,000 £72,500 £65,000
Median salary % change year-on-year +3.45% +11.54% +4.00%
10th Percentile £51,250 £47,500 £46,250
90th Percentile £110,000 £100,000 £105,000
Central London median annual salary £75,000 £72,500 £62,500
% change year-on-year +3.45% +16.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,112 3,468 3,240
As % of all permanent IT jobs advertised in the City of London 31.03% 31.44% 31.96%
Number of salaries quoted 2,811 3,105 2,912
City of London median annual salary £67,500 £65,000 £60,000
Median salary % change year-on-year +3.85% +8.33% +9.09%
10th Percentile £42,500 £40,000 £37,500
90th Percentile £97,500 £90,000 £86,250
Central London median annual salary £65,000 £62,500 £60,000
% change year-on-year +4.00% +4.17% +9.09%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 17 June 2019.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 17 June 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -6 1 £22,000 -72.50%
Big Data
Central London

For the 6 months to 17 June 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 211 (46.68%) Python
2 185 (40.93%) Analytics
3 182 (40.27%) Java
4 167 (36.95%) Agile Software Development
5 151 (33.41%) Finance
6 148 (32.74%) SQL
7 133 (29.42%) Amazon AWS
8 132 (29.20%) Apache Spark
9 124 (27.43%) Hadoop
10 116 (25.66%) Machine Learning
11 108 (23.89%) Data Science
12 106 (23.45%) DevOps
13 105 (23.23%) NoSQL
14 103 (22.79%) Kafka
15 97 (21.46%) Artificial Intelligence
16 95 (21.02%) Microsoft Azure
17 88 (19.47%) Data Analytics
18 87 (19.25%) Scala
19 84 (18.58%) Docker
20 83 (18.36%) Business Intelligence
20 83 (18.36%) Microservices
21 71 (15.71%) TDD
22 65 (14.38%) Linux
23 64 (14.16%) MongoDB
24 62 (13.72%) Kubernetes
25 61 (13.50%) Analytical Skills
25 61 (13.50%) ETL
26 59 (13.05%) Software Engineering
26 59 (13.05%) Google Cloud Platform
27 55 (12.17%) SQL Server

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 132 (29.20%) Apache Spark
2 43 (9.51%) Elasticsearch
3 32 (7.08%) Apache
4 9 (1.99%) Apache Solr
4 9 (1.99%) SharePoint
5 8 (1.77%) Apache Pig
6 5 (1.11%) SAS
7 3 (0.66%) Apache Airflow
8 2 (0.44%) CMS
8 2 (0.44%) Confluence
9 1 (0.22%) BizTalk Server
9 1 (0.22%) DNN
9 1 (0.22%) Jupyter
9 1 (0.22%) Luigi
9 1 (0.22%) OpenStack
9 1 (0.22%) WebSphere
Applications
1 2 (0.44%) Microsoft Office
2 1 (0.22%) Microsoft Excel
2 1 (0.22%) Spreadsheet
Business Applications
1 4 (0.88%) Dynamics CRM
2 1 (0.22%) MetaTrader
Cloud Services
1 133 (29.42%) Amazon AWS
2 95 (21.02%) Microsoft Azure
3 59 (13.05%) Google Cloud Platform
4 48 (10.62%) Power Platform
5 17 (3.76%) AWS Lambda
6 13 (2.88%) Serverless
7 12 (2.65%) Amazon EMR
7 12 (2.65%) Amazon S3
8 10 (2.21%) Cloud Computing
9 8 (1.77%) Amazon EC2
9 8 (1.77%) GitHub
10 7 (1.55%) PaaS
11 6 (1.33%) Amazon Kinesis
12 4 (0.88%) Amazon CloudWatch
12 4 (0.88%) Amazon ElastiCache
12 4 (0.88%) Amazon SQS
12 4 (0.88%) Route 53
13 3 (0.66%) SaaS
14 2 (0.44%) AWS CloudFormation
14 2 (0.44%) CloudFront
Communications & Networking
1 6 (1.33%) Internet
2 4 (0.88%) AMQP
3 3 (0.66%) FTP
3 3 (0.66%) HTTP
3 3 (0.66%) TCP/IP
4 2 (0.44%) VPN
5 1 (0.22%) 5G
5 1 (0.22%) Firewall
5 1 (0.22%) Skype
Database & Business Intelligence
1 124 (27.43%) Hadoop
2 105 (23.23%) NoSQL
3 64 (14.16%) MongoDB
4 55 (12.17%) SQL Server
5 53 (11.73%) Data Warehouse
6 48 (10.62%) Power BI
7 44 (9.73%) Apache Cassandra
8 33 (7.30%) Apache Hive
9 31 (6.86%) PostgreSQL
10 30 (6.64%) Data Lake
11 26 (5.75%) HBase
11 26 (5.75%) SQL Server Reporting Services
12 23 (5.09%) QlikView
13 21 (4.65%) SQL Server Integration Services
14 18 (3.98%) MySQL
15 14 (3.10%) Relational Database
16 12 (2.65%) Amazon DynamoDB
16 12 (2.65%) Amazon Redshift
16 12 (2.65%) SQL Server Analysis Services
17 11 (2.43%) Redis
Development Applications
1 29 (6.42%) Jenkins
2 21 (4.65%) Git (software)
3 10 (2.21%) Selenium
4 7 (1.55%) Visual Studio Team System
5 6 (1.33%) ERwin
6 5 (1.11%) ER Studio
6 5 (1.11%) PowerDesigner
7 4 (0.88%) Maven
8 3 (0.66%) Jasmine
8 3 (0.66%) Karma Test Runner
9 2 (0.44%) Atlassian Bamboo
9 2 (0.44%) JIRA
9 2 (0.44%) Octopus Deploy
9 2 (0.44%) Subversion
9 2 (0.44%) Team Foundation Server
9 2 (0.44%) TeamCity
9 2 (0.44%) Visual Studio
9 2 (0.44%) WebDriver
10 1 (0.22%) GitLab
10 1 (0.22%) gulp
General
1 151 (33.41%) Finance
2 28 (6.19%) Retail
3 23 (5.09%) Banking
4 19 (4.20%) Marketing
5 17 (3.76%) Advertising
6 16 (3.54%) Law
7 11 (2.43%) Financial Institution
7 11 (2.43%) Front Office
8 8 (1.77%) Telecoms
9 3 (0.66%) Pharmaceutical
10 2 (0.44%) Retail Banking
11 1 (0.22%) Billing
11 1 (0.22%) Electronics
11 1 (0.22%) Games
11 1 (0.22%) Investment Banking
11 1 (0.22%) Legal
11 1 (0.22%) Manufacturing
11 1 (0.22%) Publishing
Job Titles
1 191 (42.26%) Developer
2 88 (19.47%) Java Developer
3 61 (13.50%) Data Engineer
4 50 (11.06%) Architect
5 43 (9.51%) Big Data Engineer
6 35 (7.74%) DevOps Engineer
6 35 (7.74%) Senior Developer
7 31 (6.86%) Python Engineer
8 29 (6.42%) Big Data Developer
9 28 (6.19%) Python Developer
10 27 (5.97%) Data Scientist
11 26 (5.75%) Data Architect
12 20 (4.42%) Lead Developer
13 19 (4.20%) .NET Developer
13 19 (4.20%) Senior Java Developer
14 17 (3.76%) AWS Engineer
15 16 (3.54%) Cloud Engineer
16 14 (3.10%) Analytics Developer
16 14 (3.10%) Scala Developer
16 14 (3.10%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 103 (22.79%) Kafka
2 41 (9.07%) React
3 37 (8.19%) REST
4 34 (7.52%) AngularJS
5 29 (6.42%) .NET
5 29 (6.42%) Web Services
6 23 (5.09%) Spring
7 18 (3.98%) Natural Language Processing
8 17 (3.76%) HTML
8 17 (3.76%) TensorFlow
9 16 (3.54%) RESTful
10 15 (3.32%) CSS
10 15 (3.32%) scikit-learn
11 14 (3.10%) Pandas
11 14 (3.10%) SciPy
12 13 (2.88%) Elastic Stack
13 12 (2.65%) NumPy
14 11 (2.43%) ASP.NET Web API
14 11 (2.43%) Redux
14 11 (2.43%) Spring Boot
Miscellaneous
1 61 (13.50%) Analytical Skills
2 54 (11.95%) Algorithms
3 21 (4.65%) Data Structures
4 20 (4.42%) Greenfield Project
5 14 (3.10%) Credit Risk
6 12 (2.65%) Hedge funds
7 11 (2.43%) Spread Betting
7 11 (2.43%) Virtual Team
8 10 (2.21%) Self-Motivation
9 9 (1.99%) Mobile App
10 8 (1.77%) Clustering
10 8 (1.77%) Robotics
11 7 (1.55%) Replication
12 6 (1.33%) Enterprise Software
12 6 (1.33%) Market Risk
13 5 (1.11%) Management Information System
14 4 (0.88%) Foreign Exchange (FX)
14 4 (0.88%) Internet of Things
15 3 (0.66%) Public Cloud
15 3 (0.66%) User Experience
Operating Systems
1 65 (14.38%) Linux
2 20 (4.42%) Unix
3 14 (3.10%) Windows
4 8 (1.77%) Red Hat Enterprise Linux
5 5 (1.11%) CentOS
5 5 (1.11%) Ubuntu
6 1 (0.22%) Android
6 1 (0.22%) Apple iOS
6 1 (0.22%) Mac OS
6 1 (0.22%) Windows Server
Processes & Methodologies
1 185 (40.93%) Analytics
2 167 (36.95%) Agile Software Development
3 116 (25.66%) Machine Learning
4 108 (23.89%) Data Science
5 106 (23.45%) DevOps
6 97 (21.46%) Artificial Intelligence
7 88 (19.47%) Data Analytics
8 83 (18.36%) Business Intelligence
8 83 (18.36%) Microservices
9 71 (15.71%) TDD
10 61 (13.50%) ETL
11 59 (13.05%) Software Engineering
12 50 (11.06%) Data Engineering
13 49 (10.84%) Data Modelling
14 45 (9.96%) Continuous Integration
15 41 (9.07%) Fintech
16 39 (8.63%) Data Analysis
17 35 (7.74%) Problem-Solving
17 35 (7.74%) Test Automation
18 31 (6.86%) Visualisation
Programming Languages
1 211 (46.68%) Python
2 182 (40.27%) Java
3 148 (32.74%) SQL
4 87 (19.25%) Scala
5 51 (11.28%) JavaScript
6 50 (11.06%) R
7 42 (9.29%) C#
8 29 (6.42%) Java 8
9 27 (5.97%) Bash Shell
10 15 (3.32%) ES6
11 13 (2.88%) C++
11 13 (2.88%) T-SQL
12 12 (2.65%) PowerShell
13 11 (2.43%) Clojure
13 11 (2.43%) PHP
14 9 (1.99%) C
15 8 (1.77%) Shell Script
16 7 (1.55%) Go
17 6 (1.33%) ES7
18 4 (0.88%) TypeScript
Qualifications
1 38 (8.41%) Degree
2 15 (3.32%) PhD
3 9 (1.99%) Computer Science Degree
4 8 (1.77%) Security Cleared
5 7 (1.55%) DV Cleared
6 5 (1.11%) Numerate Degree
7 4 (0.88%) Master's Degree
8 2 (0.44%) A+ Certification
8 2 (0.44%) AWS Certification
8 2 (0.44%) CISM
8 2 (0.44%) CISSP
9 1 (0.22%) CCNA
9 1 (0.22%) CEH
9 1 (0.22%) CFA
9 1 (0.22%) Cisco Certification
9 1 (0.22%) ISSMP
9 1 (0.22%) MCP
9 1 (0.22%) MCSE
9 1 (0.22%) Microsoft Certification
9 1 (0.22%) PRINCE2 Certification
Quality Assurance & Compliance
1 19 (4.20%) QA
2 9 (1.99%) Data Quality
3 5 (1.11%) PCI DSS
System Software
1 84 (18.58%) Docker
2 18 (3.98%) HDFS
3 11 (2.43%) Apache Flume
4 9 (1.99%) Oracle RAC
5 3 (0.66%) Apache ZooKeeper
6 1 (0.22%) Active Directory
6 1 (0.22%) VMware Infrastructure
Systems Management
1 62 (13.72%) Kubernetes
2 44 (9.73%) Ansible
3 34 (7.52%) Puppet
4 23 (5.09%) Terraform
5 19 (4.20%) Opscode Chef
6 11 (2.43%) Oozie
7 7 (1.55%) Docker Swarm
7 7 (1.55%) Enterprise Manager Cloud Control
8 4 (0.88%) Kibana
9 2 (0.44%) Hadoop YARN
10 1 (0.22%) Jamf Pro
10 1 (0.22%) Mesos
10 1 (0.22%) Microsoft Intune
10 1 (0.22%) Packer
10 1 (0.22%) Prometheus
Vendors
1 46 (10.18%) Tableau
2 42 (9.29%) Microsoft
3 34 (7.52%) Oracle
4 32 (7.08%) Google
5 16 (3.54%) Hortonworks
5 16 (3.54%) Informatica
6 12 (2.65%) SAP
7 10 (2.21%) Cloudera
8 9 (1.99%) IBM
9 8 (1.77%) HP
10 7 (1.55%) Sybase
10 7 (1.55%) Talend
10 7 (1.55%) Teradata
10 7 (1.55%) Xamarin
11 6 (1.33%) Cognos
11 6 (1.33%) Salesforce.com
12 3 (0.66%) Alteryx
12 3 (0.66%) MicroStrategy
12 3 (0.66%) SaltStack
13 2 (0.44%) MuleSoft