Period
to 28 January 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 January 2020 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
28 Jan 2020
Same period 2019 Same period 2018
Rank 69 59 61
Rank change year-on-year -10 +2 +2
Permanent jobs citing Big Data 2,183 2,909 3,375
As % of all permanent IT jobs advertised in London 4.26% 4.63% 4.89%
As % of the Database & Business Intelligence category 15.24% 15.71% 16.19%
Number of salaries quoted 1,754 2,377 2,768
London median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% -
10th Percentile £48,750 £47,100 £45,000
90th Percentile £115,000 £105,000 £100,000
England median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 14,321 18,519 20,850
As % of all permanent IT jobs advertised in London 27.93% 29.46% 30.23%
Number of salaries quoted 11,833 15,323 17,130
London median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £38,750 £37,500 £36,469
90th Percentile £105,000 £95,000 £89,000
England median annual salary £53,000 £52,500 £50,000
% change year-on-year +0.95% +5.00% +5.26%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 28 January 2020.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 28 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +1 502 £75,000 -3.23% 137
East London +38 43 £70,000 -12.50% 19
West London +6 33 £65,000 +8.33% 30
South London +12 32 £75,000 +9.09% 7
North London -9 3 £55,000 -26.67% 3
Big Data
England

For the 6 months to 28 January 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 971 (44.48%) Python
2 895 (41.00%) Agile Software Development
3 865 (39.62%) Analytics
4 804 (36.83%) AWS
5 798 (36.56%) SQL
6 774 (35.46%) Java
7 670 (30.69%) Apache Spark
8 665 (30.46%) Hadoop
9 638 (29.23%) Data Science
10 633 (29.00%) Machine Learning
11 574 (26.29%) Finance
12 540 (24.74%) Azure
13 485 (22.22%) DevOps
14 460 (21.07%) ETL
15 430 (19.70%) NoSQL
16 424 (19.42%) Microservices
17 411 (18.83%) Artificial Intelligence
18 404 (18.51%) Scala
19 381 (17.45%) Data Warehouse
19 381 (17.45%) Docker
20 363 (16.63%) Business Intelligence
21 360 (16.49%) Software Engineering
22 349 (15.99%) Degree
23 347 (15.90%) Kafka
24 346 (15.85%) GCP
25 322 (14.75%) Analytical Skills
26 321 (14.70%) Data Analytics
27 320 (14.66%) JavaScript
28 307 (14.06%) Data Modelling
29 299 (13.70%) Kubernetes

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 670 (30.69%) Apache Spark
2 109 (4.99%) Apache
3 100 (4.58%) Elasticsearch
4 81 (3.71%) Apache Airflow
5 26 (1.19%) SAS
6 23 (1.05%) Luigi
7 22 (1.01%) Confluence
8 17 (0.78%) Apache Pig
8 17 (0.78%) Jupyter
8 17 (0.78%) OpenStack
9 16 (0.73%) Cloud Foundry
9 16 (0.73%) IIS
10 13 (0.60%) Apache Solr
11 11 (0.50%) Tornado
12 8 (0.37%) CMS
13 6 (0.27%) ArcGIS
13 6 (0.27%) IPython
14 5 (0.23%) nginx
14 5 (0.23%) Oracle Workflow
14 5 (0.23%) SharePoint
Applications
1 46 (2.11%) Microsoft Excel
2 13 (0.60%) Microsoft Office
3 11 (0.50%) SPSS
4 4 (0.18%) Microsoft PowerPoint
5 2 (0.092%) Chatbot
5 2 (0.092%) InVision
5 2 (0.092%) Sketch
6 1 (0.046%) Microsoft Project
6 1 (0.046%) Simulink
6 1 (0.046%) SPSS Modeler
Business Applications
1 16 (0.73%) SAP S/4HANA
2 15 (0.69%) Sparx Enterprise Architect
3 7 (0.32%) PolarLake
4 6 (0.27%) Dynamics CRM
5 5 (0.23%) SAP HCM
5 5 (0.23%) SAP MDG
6 4 (0.18%) Eagle PACE
6 4 (0.18%) Markit EDM
6 4 (0.18%) SAP Payroll
7 3 (0.14%) Adobe Campaign
8 2 (0.092%) Eikon
8 2 (0.092%) NetSuite
8 2 (0.092%) R3 Corda
8 2 (0.092%) SAP BPC
8 2 (0.092%) SAP MM
9 1 (0.046%) Dynamics AX
9 1 (0.046%) FINCAD Analytics
9 1 (0.046%) SAP ERP
9 1 (0.046%) SAP HR
9 1 (0.046%) WebTrends
Cloud Services
1 804 (36.83%) AWS
2 540 (24.74%) Azure
3 346 (15.85%) GCP
4 145 (6.64%) Amazon S3
5 105 (4.81%) Amazon EMR
6 87 (3.99%) Power Platform
7 83 (3.80%) Cloud Computing
8 78 (3.57%) Serverless
9 77 (3.53%) SaaS
10 69 (3.16%) Amazon EC2
11 64 (2.93%) Amazon Kinesis
12 55 (2.52%) PaaS
13 47 (2.15%) AWS Lambda
14 44 (2.02%) Azure Data Factory
15 41 (1.88%) Amazon ECS
16 31 (1.42%) Amazon SQS
17 30 (1.37%) AWS Fargate
17 30 (1.37%) GitHub
18 27 (1.24%) IaaS
19 26 (1.19%) Basecamp
Communications & Networking
1 64 (2.93%) Internet
2 31 (1.42%) Firewall
3 18 (0.82%) DNS
4 17 (0.78%) DHCP
5 15 (0.69%) DMZ
6 14 (0.64%) HTTP
6 14 (0.64%) Kerberos
7 12 (0.55%) VPN
8 9 (0.41%) HTTPS
8 9 (0.41%) TCP/IP
9 6 (0.27%) SSH
10 5 (0.23%) SSL
10 5 (0.23%) Unified Communications
11 3 (0.14%) NAS
11 3 (0.14%) SAN
12 2 (0.092%) SMS
13 1 (0.046%) Broadband
13 1 (0.046%) Intranet
13 1 (0.046%) SNMP
13 1 (0.046%) UMTS
Database & Business Intelligence
1 665 (30.46%) Hadoop
2 430 (19.70%) NoSQL
3 381 (17.45%) Data Warehouse
4 276 (12.64%) Apache Hive
5 252 (11.54%) SQL Server
6 180 (8.25%) Relational Database
7 155 (7.10%) Data Lake
8 152 (6.96%) Amazon Redshift
9 151 (6.92%) PostgreSQL
10 142 (6.50%) MongoDB
11 91 (4.17%) Apache Cassandra
12 90 (4.12%) BigQuery
13 87 (3.99%) Power BI
14 82 (3.76%) Amazon DynamoDB
15 78 (3.57%) Flink
16 77 (3.53%) Amazon Athena
17 72 (3.30%) HBase
18 68 (3.11%) SQL Server Integration Services
19 67 (3.07%) Neo4j
20 65 (2.98%) Presto
Development Applications
1 288 (13.19%) Git (software)
2 177 (8.11%) Jenkins
3 108 (4.95%) JIRA
4 45 (2.06%) Atlassian Bamboo
5 35 (1.60%) Vagrant
6 31 (1.42%) GitLab
7 28 (1.28%) Bitbucket
8 27 (1.24%) Visual Studio
9 26 (1.19%) JUnit
10 17 (0.78%) Visual Studio Team System
11 15 (0.69%) Bower
11 15 (0.69%) ProC
12 14 (0.64%) ERwin
12 14 (0.64%) TeamCity
13 13 (0.60%) Maven
14 11 (0.50%) Artifactory
14 11 (0.50%) Mockito
15 10 (0.46%) git-flow
15 10 (0.46%) Octopus Deploy
16 8 (0.37%) CircleCI
General
1 574 (26.29%) Finance
2 159 (7.28%) Banking
3 140 (6.41%) Marketing
4 106 (4.86%) Retail
5 86 (3.94%) Front Office
6 60 (2.75%) Public Sector
7 55 (2.52%) Games
8 50 (2.29%) Advertising
9 44 (2.02%) Telecoms
10 38 (1.74%) Legal
11 33 (1.51%) Law
12 29 (1.33%) Automotive
13 20 (0.92%) Pharmaceutical
14 19 (0.87%) Billing
15 18 (0.82%) Manufacturing
16 17 (0.78%) Financial Institution
16 17 (0.78%) Investment Banking
17 16 (0.73%) Multimedia
18 14 (0.64%) Brand Awareness
19 8 (0.37%) iGaming
Job Titles
1 582 (26.66%) Developer
2 435 (19.93%) Data Engineer
3 297 (13.61%) Java Developer
4 250 (11.45%) Architect
5 145 (6.64%) Senior Developer
6 136 (6.23%) Data Scientist
7 135 (6.18%) Data Architect
8 133 (6.09%) Software Engineer
9 125 (5.73%) Python Engineer
10 119 (5.45%) Analyst
11 112 (5.13%) Senior Data Engineer
12 111 (5.08%) Consultant
13 106 (4.86%) Java Engineer
14 96 (4.40%) Python Developer
15 83 (3.80%) Big Data Engineer
15 83 (3.80%) Java Software Engineer
16 74 (3.39%) Java Software Developer
17 73 (3.34%) AWS Engineer
17 73 (3.34%) Senior Data Scientist
18 72 (3.30%) Developer/Software Engineer
Libraries, Frameworks & Software Standards
1 347 (15.90%) Kafka
2 199 (9.12%) React
3 193 (8.84%) Web Services
4 171 (7.83%) Node.js
5 136 (6.23%) AngularJS
6 117 (5.36%) HTML
7 116 (5.31%) REST
8 115 (5.27%) RESTful
9 114 (5.22%) .NET
10 100 (4.58%) J2EE
11 96 (4.40%) TensorFlow
12 85 (3.89%) Spring
13 83 (3.80%) CSS
14 82 (3.76%) Natural Language Processing
15 58 (2.66%) scikit-learn
16 57 (2.61%) Pandas
17 56 (2.57%) Lambda Expressions
18 53 (2.43%) Django
19 52 (2.38%) HTML5
19 52 (2.38%) XML
Miscellaneous
1 322 (14.75%) Analytical Skills
2 186 (8.52%) Algorithms
3 155 (7.10%) Data Structures
4 112 (5.13%) User Experience
5 102 (4.67%) Greenfield Project
6 78 (3.57%) Management Information System
7 54 (2.47%) Enterprise Software
8 50 (2.29%) Cloud Native
9 45 (2.06%) Fixed Income
10 41 (1.88%) Internet of Things
11 40 (1.83%) Equities
11 40 (1.83%) Foreign Exchange (FX)
12 38 (1.74%) Data Centre
12 38 (1.74%) Social Media
13 37 (1.69%) Virtual Team
14 36 (1.65%) Reference Data
15 28 (1.28%) Credit Risk
15 28 (1.28%) Life Science
16 27 (1.24%) Linux Command Line
16 27 (1.24%) Public Cloud
Operating Systems
1 280 (12.83%) Linux
2 80 (3.66%) Unix
3 39 (1.79%) Windows
4 16 (0.73%) Solaris
5 15 (0.69%) CentOS
6 14 (0.64%) Ubuntu
6 14 (0.64%) Windows Server
7 8 (0.37%) Red Hat Enterprise Linux
8 7 (0.32%) Windows 10
8 7 (0.32%) Windows 7
9 6 (0.27%) Android
10 5 (0.23%) Debian
11 4 (0.18%) Apple iOS
11 4 (0.18%) Fedora
11 4 (0.18%) Windows Server 2012
12 1 (0.046%) Mac OS X
Processes & Methodologies
1 895 (41.00%) Agile Software Development
2 865 (39.62%) Analytics
3 638 (29.23%) Data Science
4 633 (29.00%) Machine Learning
5 485 (22.22%) DevOps
6 460 (21.07%) ETL
7 424 (19.42%) Microservices
8 411 (18.83%) Artificial Intelligence
9 363 (16.63%) Business Intelligence
10 360 (16.49%) Software Engineering
11 321 (14.70%) Data Analytics
12 307 (14.06%) Data Modelling
13 285 (13.06%) Computer Science
14 234 (10.72%) Data Engineering
15 225 (10.31%) Problem-Solving
16 218 (9.99%) Visualisation
17 193 (8.84%) Open Source
18 185 (8.47%) Fintech
19 183 (8.38%) Project Management
20 180 (8.25%) TDD
Programming Languages
1 971 (44.48%) Python
2 798 (36.56%) SQL
3 774 (35.46%) Java
4 404 (18.51%) Scala
5 320 (14.66%) JavaScript
6 227 (10.40%) R
7 197 (9.02%) C#
8 126 (5.77%) C
9 89 (4.08%) C++
10 85 (3.89%) Java 8
11 78 (3.57%) TypeScript
12 75 (3.44%) Bash Shell
13 63 (2.89%) PL/SQL
14 58 (2.66%) Go
15 54 (2.47%) Kotlin
16 53 (2.43%) ES6
17 51 (2.34%) T-SQL
18 38 (1.74%) PHP
18 38 (1.74%) Shell Script
19 33 (1.51%) Ruby
Qualifications
1 349 (15.99%) Degree
2 145 (6.64%) Computer Science Degree
3 86 (3.94%) PhD
4 72 (3.30%) Security Cleared
5 44 (2.02%) Master's Degree
6 32 (1.47%) DV Cleared
7 29 (1.33%) Microsoft Certification
7 29 (1.33%) SC Cleared
8 21 (0.96%) MBA
9 18 (0.82%) PMI Certification
10 15 (0.69%) MCP
10 15 (0.69%) RHCE
11 14 (0.64%) Numerate Degree
11 14 (0.64%) SAP Certification
12 13 (0.60%) PMP
13 11 (0.50%) CISSP
14 8 (0.37%) CCNA
14 8 (0.37%) Cisco Certification
14 8 (0.37%) MCSE
14 8 (0.37%) SSCP
Quality Assurance & Compliance
1 172 (7.88%) Data Quality
2 160 (7.33%) QA
3 33 (1.51%) GDPR
4 17 (0.78%) SLA
5 14 (0.64%) ISO/IEC 27001
6 3 (0.14%) PCI DSS
7 2 (0.092%) MiFID
8 1 (0.046%) Basel III
8 1 (0.046%) EMIR
8 1 (0.046%) GxP
8 1 (0.046%) IFRS
8 1 (0.046%) IFRS 9
8 1 (0.046%) PMO
8 1 (0.046%) Sarbanes-Oxley
System Software
1 381 (17.45%) Docker
2 93 (4.26%) HDFS
3 32 (1.47%) VirtualBox
4 25 (1.15%) Active Directory
5 24 (1.10%) Apache Flume
6 21 (0.96%) VMware Infrastructure
7 19 (0.87%) NFS
8 15 (0.69%) Firmware
9 10 (0.46%) Apache ZooKeeper
10 5 (0.23%) VMware ESXi
11 4 (0.18%) Hyper-V
11 4 (0.18%) Samba
11 4 (0.18%) Xen
12 3 (0.14%) Varnish
13 1 (0.046%) Ceph
13 1 (0.046%) etcd
13 1 (0.046%) Gluster
13 1 (0.046%) KVM
13 1 (0.046%) Virtual Machines
13 1 (0.046%) VMware Workstation
Systems Management
1 299 (13.70%) Kubernetes
2 138 (6.32%) Terraform
3 137 (6.28%) Ansible
4 58 (2.66%) Hadoop YARN
5 54 (2.47%) Puppet
6 50 (2.29%) Oozie
7 41 (1.88%) Docker Swarm
7 41 (1.88%) Opscode Chef
8 12 (0.55%) Ambari
8 12 (0.55%) Consul
9 10 (0.46%) Single Sign-On
10 9 (0.41%) Mesos
10 9 (0.41%) Nagios
11 8 (0.37%) Packer
12 6 (0.27%) Grafana
13 5 (0.23%) BMC PATROL
13 5 (0.23%) HAProxy
13 5 (0.23%) Prometheus
13 5 (0.23%) Tivoli
13 5 (0.23%) ZABBIX
Vendors
1 292 (13.38%) Google
2 204 (9.34%) Microsoft
3 145 (6.64%) Oracle
4 98 (4.49%) Cloudera
4 98 (4.49%) Tableau
5 97 (4.44%) Hortonworks
6 85 (3.89%) Informatica
7 74 (3.39%) Databricks
8 70 (3.21%) IBM
9 62 (2.84%) SAP
10 54 (2.47%) Teradata
11 50 (2.29%) Talend
12 44 (2.02%) Facebook
13 40 (1.83%) Splunk
14 25 (1.15%) VMware
15 23 (1.05%) Salesforce.com
16 20 (0.92%) Ab Initio
17 19 (0.87%) Adobe
18 15 (0.69%) Red Hat
18 15 (0.69%) Sybase