Period
to 21 May 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 May 2019 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
21 May 2019
Same period 2018 Same period 2017
Rank 59 42 58
Rank change year-on-year -17 +16 +13
Permanent jobs citing Big Data 2,725 4,032 3,274
As % of all permanent IT jobs advertised in London 4.67% 5.85% 4.81%
As % of the Database & Business Intelligence category 16.18% 18.69% 15.80%
Number of salaries quoted 2,244 2,716 2,782
London median annual salary £77,500 £70,000 £67,500
Median salary % change year-on-year +10.71% +3.70% +3.85%
10th Percentile £49,063 £45,000 £45,000
90th Percentile £110,000 £102,500 £103,750
England median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% +4.17%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 16,845 21,569 20,726
As % of all permanent IT jobs advertised in London 28.88% 31.32% 30.43%
Number of salaries quoted 13,996 17,245 17,826
London median annual salary £65,000 £60,000 £60,000
Median salary % change year-on-year +8.33% - +9.09%
10th Percentile £38,750 £37,500 £36,250
90th Percentile £95,000 £92,500 £90,000
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

The salary distribution of IT jobs citing Big Data in London over the 6 months to 21 May 2019.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 21 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +4 575 £75,000 +7.14% 84
West London +43 83 £60,000 +6.67% 17
South London +7 28 £50,000 -33.33% 2
East London +17 17 £70,000 -22.22% 11
North London +12 2 £72,500 +71.47% 1
Big Data
England

For the 6 months to 21 May 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 1,371 (50.31%) Python
2 1,156 (42.42%) Agile Software Development
3 1,149 (42.17%) Java
4 1,105 (40.55%) Hadoop
5 1,088 (39.93%) Apache Spark
6 1,060 (38.90%) Analytics
7 971 (35.63%) Amazon AWS
8 921 (33.80%) SQL
9 815 (29.91%) Machine Learning
10 759 (27.85%) Kafka
11 735 (26.97%) Scala
12 669 (24.55%) Data Science
13 655 (24.04%) DevOps
14 644 (23.63%) Finance
15 643 (23.60%) NoSQL
16 620 (22.75%) Microsoft Azure
17 539 (19.78%) Apache Hive
18 515 (18.90%) Business Intelligence
19 495 (18.17%) ETL
20 468 (17.17%) Google Cloud Platform
21 465 (17.06%) Software Engineering
22 439 (16.11%) Artificial Intelligence
23 428 (15.71%) Docker
24 420 (15.41%) Data Warehouse
25 413 (15.16%) Data Modelling
26 391 (14.35%) Linux
27 364 (13.36%) Data Analytics
28 348 (12.77%) Microservices
28 348 (12.77%) Degree
29 339 (12.44%) HBase

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,088 (39.93%) Apache Spark
2 278 (10.20%) Elasticsearch
3 229 (8.40%) Apache Pig
4 193 (7.08%) Apache
5 82 (3.01%) Apache Solr
6 59 (2.17%) SAS
7 24 (0.88%) Apache Airflow
7 24 (0.88%) Confluence
8 20 (0.73%) Jupyter
9 12 (0.44%) SharePoint
10 10 (0.37%) Tornado
10 10 (0.37%) WildFly
11 9 (0.33%) CMS
11 9 (0.33%) IPython
12 7 (0.26%) OpenStack
12 7 (0.26%) Oracle SOA Suite
13 6 (0.22%) Luigi
14 5 (0.18%) IIS
15 4 (0.15%) DNN
15 4 (0.15%) Ethereum
Applications
1 64 (2.35%) Microsoft Excel
2 22 (0.81%) Microsoft PowerPoint
3 16 (0.59%) SPSS
4 9 (0.33%) Chatbot
4 9 (0.33%) Microsoft Project
5 8 (0.29%) Microsoft Office
6 4 (0.15%) MS Visio
6 4 (0.15%) Sketch
7 3 (0.11%) Spreadsheet
8 2 (0.073%) GNU Octave
8 2 (0.073%) Open Workbench
9 1 (0.037%) Adobe Creative Suite
9 1 (0.037%) Mathematica
9 1 (0.037%) OmniGraffle
9 1 (0.037%) Simulink
Business Applications
1 14 (0.51%) SAP S/4HANA
2 9 (0.33%) Distributed Ledger
3 7 (0.26%) Dynamics CRM
4 5 (0.18%) SAP ERP
5 4 (0.15%) SDL Web 8
6 3 (0.11%) SAP Business ByDesign
7 2 (0.073%) MetaTrader
7 2 (0.073%) Oracle BPM
7 2 (0.073%) Oracle BRM
7 2 (0.073%) Oracle CRM On Demand
7 2 (0.073%) SAP BPC
7 2 (0.073%) SAP Oil and Gas
8 1 (0.037%) Hyperion Planning
8 1 (0.037%) Oracle EBS
8 1 (0.037%) SAP CO
8 1 (0.037%) SAP FI
8 1 (0.037%) SAP FI/CO
8 1 (0.037%) SAP SCM
8 1 (0.037%) SAP SD
8 1 (0.037%) Unica
Cloud Services
1 971 (35.63%) Amazon AWS
2 620 (22.75%) Microsoft Azure
3 468 (17.17%) Google Cloud Platform
4 199 (7.30%) Power Platform
5 102 (3.74%) Serverless
6 94 (3.45%) PaaS
7 80 (2.94%) Cloud Computing
8 70 (2.57%) AWS Lambda
9 60 (2.20%) Amazon EMR
10 59 (2.17%) SaaS
11 57 (2.09%) Amazon S3
12 54 (1.98%) Amazon Kinesis
12 54 (1.98%) Amazon SQS
13 47 (1.72%) Amazon EC2
14 39 (1.43%) Amazon CloudWatch
15 33 (1.21%) AWS CloudFormation
16 32 (1.17%) Azure Data Factory
17 30 (1.10%) Azure Machine Learning
17 30 (1.10%) GitHub
18 28 (1.03%) IaaS
Communications & Networking
1 49 (1.80%) Internet
2 24 (0.88%) VPN
3 21 (0.77%) Firewall
4 19 (0.70%) HTTP
5 13 (0.48%) Wi-Fi
6 12 (0.44%) SSH
7 9 (0.33%) Network Security
7 9 (0.33%) TCP/IP
8 8 (0.29%) Unified Communications
9 7 (0.26%) AMQP
10 5 (0.18%) MQTT
10 5 (0.18%) SNMP
11 4 (0.15%) 5G
11 4 (0.15%) DHCP
11 4 (0.15%) DNS
11 4 (0.15%) FTP
11 4 (0.15%) Kerberos
11 4 (0.15%) Wireless
12 3 (0.11%) MPLS
12 3 (0.11%) WAN
Database & Business Intelligence
1 1,105 (40.55%) Hadoop
2 643 (23.60%) NoSQL
3 539 (19.78%) Apache Hive
4 420 (15.41%) Data Warehouse
5 339 (12.44%) HBase
6 312 (11.45%) Apache Cassandra
7 252 (9.25%) SQL Server
8 240 (8.81%) Amazon Redshift
9 231 (8.48%) MongoDB
10 225 (8.26%) Impala
11 199 (7.30%) Power BI
12 175 (6.42%) Relational Database
13 165 (6.06%) Data Lake
14 142 (5.21%) MySQL
15 136 (4.99%) Flink
16 127 (4.66%) Sqoop
17 123 (4.51%) SQL Server Integration Services
18 114 (4.18%) PostgreSQL
19 107 (3.93%) QlikView
20 95 (3.49%) BigQuery
Development Applications
1 181 (6.64%) Git (software)
2 173 (6.35%) Jenkins
3 61 (2.24%) Maven
4 57 (2.09%) JIRA
5 43 (1.58%) Gradle
6 40 (1.47%) Selenium
7 33 (1.21%) Ant
8 25 (0.92%) Atlassian Bamboo
8 25 (0.92%) Visual Studio
9 23 (0.84%) Visual Studio Team System
10 22 (0.81%) Artifactory
11 21 (0.77%) JUnit
12 20 (0.73%) Travis CI
13 19 (0.70%) Cucumber
14 18 (0.66%) GitLab
14 18 (0.66%) TeamCity
15 13 (0.48%) Subversion
16 11 (0.40%) Bitbucket
17 10 (0.37%) ERwin
17 10 (0.37%) Team Foundation Server
General
1 644 (23.63%) Finance
2 275 (10.09%) Banking
3 264 (9.69%) Law
4 137 (5.03%) Retail
5 114 (4.18%) Marketing
6 97 (3.56%) Telecoms
7 65 (2.39%) Investment Banking
8 62 (2.28%) Games
9 47 (1.72%) Publishing
10 44 (1.61%) Advertising
11 31 (1.14%) Financial Institution
12 25 (0.92%) Front Office
12 25 (0.92%) Manufacturing
13 22 (0.81%) Billing
14 19 (0.70%) Automotive
15 18 (0.66%) Pharmaceutical
16 13 (0.48%) Electronics
17 11 (0.40%) Legal
18 7 (0.26%) Back Office
18 7 (0.26%) Retail Banking
Job Titles
1 633 (23.23%) Developer
2 573 (21.03%) Data Engineer
3 396 (14.53%) Architect
4 376 (13.80%) Big Data Engineer
5 266 (9.76%) Java Developer
6 253 (9.28%) Data Architect
7 146 (5.36%) Hadoop Engineer
8 138 (5.06%) Data Scientist
9 137 (5.03%) Consultant
10 136 (4.99%) Analyst
11 133 (4.88%) Python Engineer
12 129 (4.73%) DevOps Engineer
13 121 (4.44%) Solutions Architect
14 118 (4.33%) Big Data Developer
15 115 (4.22%) Big Data Architect
16 102 (3.74%) Senior Developer
17 101 (3.71%) Python Developer
18 98 (3.60%) Senior Data Engineer
18 98 (3.60%) Software Engineer
19 87 (3.19%) Java Engineer
Libraries, Frameworks & Software Standards
1 759 (27.85%) Kafka
2 192 (7.05%) Web Services
3 177 (6.50%) Spring
4 165 (6.06%) REST
5 151 (5.54%) .NET
6 146 (5.36%) React
7 122 (4.48%) Natural Language Processing
8 121 (4.44%) RESTful
9 110 (4.04%) Apache NiFi
10 101 (3.71%) AngularJS
11 96 (3.52%) Node.js
12 92 (3.38%) HTML
13 86 (3.16%) Pandas
13 86 (3.16%) Spark Streaming
14 78 (2.86%) NumPy
15 73 (2.68%) scikit-learn
16 68 (2.50%) Elastic Stack
17 67 (2.46%) JSON
18 63 (2.31%) CSS
19 62 (2.28%) TensorFlow
Miscellaneous
1 338 (12.40%) Analytical Skills
2 216 (7.93%) Algorithms
3 158 (5.80%) Fintech
4 142 (5.21%) Data Structures
5 104 (3.82%) User Experience
6 94 (3.45%) Greenfield Project
7 58 (2.13%) Virtual Team
8 48 (1.76%) Mobile App
9 47 (1.72%) Hedge funds
10 42 (1.54%) Self-Motivation
11 41 (1.50%) Enterprise Software
12 39 (1.43%) Data Centre
13 34 (1.25%) Social Media
14 33 (1.21%) Credit Risk
14 33 (1.21%) Public Cloud
15 27 (0.99%) Cloud Native
16 23 (0.84%) Life Science
16 23 (0.84%) Management Information System
17 22 (0.81%) Internet of Things
18 19 (0.70%) Clustering
Operating Systems
1 391 (14.35%) Linux
2 178 (6.53%) Unix
3 61 (2.24%) Windows
4 51 (1.87%) Ubuntu
5 42 (1.54%) CentOS
6 26 (0.95%) Red Hat Enterprise Linux
7 22 (0.81%) Android
8 18 (0.66%) Apple iOS
9 11 (0.40%) Windows Server
10 4 (0.15%) Oracle Linux
11 3 (0.11%) Debian
11 3 (0.11%) Windows 7
12 2 (0.073%) AIX
12 2 (0.073%) Fedora
12 2 (0.073%) Windows 10
13 1 (0.037%) FreeBSD
13 1 (0.037%) Mac OS
13 1 (0.037%) Windows Server 2008
Processes & Methodologies
1 1,156 (42.42%) Agile Software Development
2 1,060 (38.90%) Analytics
3 815 (29.91%) Machine Learning
4 669 (24.55%) Data Science
5 655 (24.04%) DevOps
6 515 (18.90%) Business Intelligence
7 495 (18.17%) ETL
8 465 (17.06%) Software Engineering
9 439 (16.11%) Artificial Intelligence
10 413 (15.16%) Data Modelling
11 364 (13.36%) Data Analytics
12 348 (12.77%) Microservices
13 313 (11.49%) Data Engineering
14 304 (11.16%) Scrum
15 275 (10.09%) Visualisation
16 253 (9.28%) Continuous Integration
17 248 (9.10%) TDD
18 240 (8.81%) Computer Science
19 209 (7.67%) Problem-Solving
20 205 (7.52%) Open Source
Programming Languages
1 1,371 (50.31%) Python
2 1,149 (42.17%) Java
3 921 (33.80%) SQL
4 735 (26.97%) Scala
5 234 (8.59%) R
6 204 (7.49%) JavaScript
7 161 (5.91%) C#
8 114 (4.18%) Java 8
9 112 (4.11%) C++
10 94 (3.45%) Bash Shell
11 64 (2.35%) Groovy
11 64 (2.35%) PL/SQL
12 54 (1.98%) T-SQL
13 50 (1.83%) Go
14 48 (1.76%) Clojure
15 43 (1.58%) Shell Script
16 41 (1.50%) Perl
17 36 (1.32%) C
17 36 (1.32%) PHP
18 34 (1.25%) Ruby
Qualifications
1 348 (12.77%) Degree
2 116 (4.26%) Computer Science Degree
3 83 (3.05%) PhD
4 54 (1.98%) Security Cleared
5 51 (1.87%) Numerate Degree
6 28 (1.03%) SC Cleared
7 25 (0.92%) CISSP
8 21 (0.77%) DV Cleared
9 20 (0.73%) Master's Degree
10 19 (0.70%) CISM
11 18 (0.66%) Cisco Certification
12 17 (0.62%) TOGAF Certification
13 13 (0.48%) MBA
14 12 (0.44%) SAP Certification
15 11 (0.40%) ISEB
15 11 (0.40%) PMI Certification
15 11 (0.40%) PMP
16 10 (0.37%) Chartered Engineer
17 8 (0.29%) CCIE
17 8 (0.29%) ISTQB
Quality Assurance & Compliance
1 132 (4.84%) Data Quality
2 124 (4.55%) QA
3 56 (2.06%) GDPR
4 15 (0.55%) ISO/IEC 27001
5 11 (0.40%) IFRS
6 10 (0.37%) MiFID
6 10 (0.37%) PCI DSS
7 9 (0.33%) Solvency II
8 8 (0.29%) Dodd-Frank
9 7 (0.26%) FATCA
10 4 (0.15%) GxP
11 3 (0.11%) NIST 800
12 2 (0.073%) ISO 20022
12 2 (0.073%) PMO
12 2 (0.073%) SLA
13 1 (0.037%) COBIT
13 1 (0.037%) FedRAMP
13 1 (0.037%) HIPAA
13 1 (0.037%) ISO/IEC 27005
13 1 (0.037%) SNOMED CT
System Software
1 428 (15.71%) Docker
2 136 (4.99%) HDFS
3 131 (4.81%) Apache Flume
4 107 (3.93%) Apache ZooKeeper
5 10 (0.37%) VMware Infrastructure
6 9 (0.33%) Active Directory
6 9 (0.33%) Oracle RAC
7 6 (0.22%) VirtualBox
8 5 (0.18%) Virtual Machines
9 3 (0.11%) Firmware
9 3 (0.11%) Hyper-V
9 3 (0.11%) VMware ESXi
9 3 (0.11%) XenApp
10 2 (0.073%) GridGain
10 2 (0.073%) NFS
10 2 (0.073%) Tivoli Workload Scheduler
10 2 (0.073%) Xen
11 1 (0.037%) KVM
11 1 (0.037%) Virtual Servers
11 1 (0.037%) VMware Workstation
Systems Management
1 253 (9.28%) Kubernetes
2 210 (7.71%) Oozie
3 163 (5.98%) Ansible
4 147 (5.39%) Hadoop YARN
5 146 (5.36%) Terraform
6 80 (2.94%) Puppet
7 76 (2.79%) Opscode Chef
8 70 (2.57%) Ambari
9 35 (1.28%) Mesos
10 31 (1.14%) Nagios
11 29 (1.06%) Kibana
12 22 (0.81%) Marathon
13 12 (0.44%) Docker Swarm
14 10 (0.37%) systemd
15 9 (0.33%) Enterprise Manager Cloud Control
15 9 (0.33%) logstash
16 6 (0.22%) Packer
16 6 (0.22%) Salt
17 4 (0.15%) Grafana
17 4 (0.15%) Rundeck
Vendors
1 315 (11.56%) Cloudera
2 274 (10.06%) Google
2 274 (10.06%) Microsoft
3 248 (9.10%) Tableau
4 221 (8.11%) Oracle
5 186 (6.83%) Hortonworks
6 129 (4.73%) Databricks
7 109 (4.00%) SAP
8 106 (3.89%) Informatica
9 90 (3.30%) MapR
9 90 (3.30%) Talend
10 80 (2.94%) IBM
11 54 (1.98%) Red Hat
12 33 (1.21%) HP
13 32 (1.17%) Splunk
14 29 (1.06%) TIBCO
15 28 (1.03%) VMware
16 25 (0.92%) Greenplum
16 25 (0.92%) Sybase
17 24 (0.88%) Salesforce.com