Period
to 28 September 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 September 2021 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
28 Sep 2021
Same period 2020 Same period 2019
Rank 84 85 63
Rank change year-on-year +1 -22 -15
Permanent jobs citing Big Data 1,913 779 2,506
As % of all permanent jobs advertised in London 3.88% 3.95% 4.53%
As % of the Database & Business Intelligence category 12.15% 13.65% 15.64%
Number of salaries quoted 1,231 581 2,050
10th Percentile £47,500 £45,000 £50,000
25th Percentile £58,188 £56,500 £61,250
Median annual salary (50th Percentile) £80,000 £75,000 £77,500
Median % change year-on-year +6.67% -3.23% +10.71%
75th Percentile £95,000 £95,000 £95,000
90th Percentile £115,000 £117,500 £115,000
England median annual salary £72,500 £67,500 £70,000
% change year-on-year +7.41% -3.57% +7.69%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,747 5,706 16,027
As % of all permanent IT jobs advertised in London 31.92% 28.92% 28.98%
Number of salaries quoted 9,410 4,795 13,372
10th Percentile £45,000 £42,500 £37,500
25th Percentile £53,750 £52,500 £48,750
Median annual salary (50th Percentile) £70,000 £70,000 £65,000
Median % change year-on-year - +7.69% +4.00%
75th Percentile £90,000 £87,500 £82,500
90th Percentile £107,500 £105,750 £97,500
England median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 28 September 2021.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 28 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -4 337 £80,000 +12.28% 67
West London -38 51 £80,000 +6.67% 20
South London -27 21 £53,500 -40.56%
East London -21 6 £70,000 +21.74% 10
Big Data
England

For the 6 months to 28 September 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 876 (45.79%) Python
2 802 (41.92%) AWS
3 799 (41.77%) Analytics
4 741 (38.73%) Agile Software Development
5 731 (38.21%) SQL
6 619 (32.36%) Java
7 593 (31.00%) GCP
8 564 (29.48%) Hadoop
9 553 (28.91%) Apache Spark
10 532 (27.81%) Azure
11 531 (27.76%) Artificial Intelligence
12 520 (27.18%) Kubernetes
13 516 (26.97%) Data Science
14 440 (23.00%) Docker
15 427 (22.32%) Machine Learning
16 404 (21.12%) DevOps
17 390 (20.39%) Finance
18 386 (20.18%) ETL
19 379 (19.81%) Kafka
20 361 (18.87%) Software Engineering
21 328 (17.15%) Data Warehouse
22 325 (16.99%) NoSQL
23 323 (16.88%) Social Skills
24 320 (16.73%) Business Intelligence
25 313 (16.36%) Microservices
26 302 (15.79%) Google
26 302 (15.79%) Data Pipeline
27 286 (14.95%) Computer Science
28 271 (14.17%) Data Modelling
29 270 (14.11%) Continuous Integration

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 553 (28.91%) Apache Spark
2 171 (8.94%) Apache Airflow
3 160 (8.36%) Elasticsearch
4 152 (7.95%) Apache
5 53 (2.77%) Confluence
6 36 (1.88%) IIS
7 33 (1.73%) Luigi
8 31 (1.62%) Apache Pig
9 24 (1.25%) Jupyter
10 18 (0.94%) SharePoint
11 10 (0.52%) SAS
12 8 (0.42%) Oracle Workflow
13 7 (0.37%) OpenStack
14 6 (0.31%) CMS
14 6 (0.31%) Oracle SOA Suite
15 4 (0.21%) SharePoint 2010
15 4 (0.21%) SharePoint 2013
16 3 (0.16%) EPiServer
16 3 (0.16%) JBoss
16 3 (0.16%) Tomcat
Applications
1 28 (1.46%) Microsoft Excel
2 22 (1.15%) Figma
3 15 (0.78%) Microsoft Office
4 14 (0.73%) Adobe Creative Suite
5 8 (0.42%) Sketch
5 8 (0.42%) Spreadsheet
6 6 (0.31%) Chatbot
7 4 (0.21%) InfoPath
8 3 (0.16%) SPSS
9 1 (0.052%) Microsoft PowerPoint
9 1 (0.052%) Microsoft Project
9 1 (0.052%) MS Visio
9 1 (0.052%) OmniGraffle
9 1 (0.052%) Stata
Business Applications
1 13 (0.68%) IBM Planning Analytics
1 13 (0.68%) Oracle ERP
2 10 (0.52%) Primavera
3 6 (0.31%) Distributed Ledger
4 5 (0.26%) R3 Corda
5 4 (0.21%) Oracle BPM
6 3 (0.16%) Oracle EBS R12
7 2 (0.10%) Oracle Procure-to-Pay
7 2 (0.10%) SAP R/3
8 1 (0.052%) Dynamics CRM
8 1 (0.052%) Oracle EBS
8 1 (0.052%) Sentinel
Cloud Services
1 802 (41.92%) AWS
2 593 (31.00%) GCP
3 532 (27.81%) Azure
4 191 (9.98%) Serverless
5 162 (8.47%) Power Platform
6 149 (7.79%) SaaS
6 149 (7.79%) Snowflake
7 119 (6.22%) IaaS
8 113 (5.91%) PaaS
9 88 (4.60%) Cloud Computing
10 84 (4.39%) Amazon EMR
11 83 (4.34%) Amazon S3
11 83 (4.34%) GitHub
12 68 (3.55%) AWS Lambda
13 55 (2.88%) Amazon Kinesis
14 52 (2.72%) Cloud Functions
15 45 (2.35%) Amazon EC2
16 43 (2.25%) Amazon SQS
16 43 (2.25%) IBM Cloud
17 31 (1.62%) Azure Data Factory
Communications & Networking
1 56 (2.93%) HTTP
2 27 (1.41%) Internet
3 24 (1.25%) Wireless
4 15 (0.78%) 5G
4 15 (0.78%) Firewall
5 13 (0.68%) Broadband
6 12 (0.63%) 4G
7 10 (0.52%) Network Security
8 8 (0.42%) Sourcefire
9 6 (0.31%) SMS
10 4 (0.21%) TCP/IP
10 4 (0.21%) WPA
11 3 (0.16%) Cisco IPT
11 3 (0.16%) DNS
12 2 (0.10%) FTP
12 2 (0.10%) VLAN
13 1 (0.052%) ATM
13 1 (0.052%) Kerberos
13 1 (0.052%) VPN
Database & Business Intelligence
1 564 (29.48%) Hadoop
2 328 (17.15%) Data Warehouse
3 325 (16.99%) NoSQL
4 192 (10.04%) MongoDB
5 188 (9.83%) Amazon Redshift
6 180 (9.41%) Data Lake
7 163 (8.52%) Tableau
8 159 (8.31%) PostgreSQL
9 156 (8.15%) Power BI
10 155 (8.10%) BigQuery
11 152 (7.95%) Apache Hive
11 152 (7.95%) Relational Database
12 118 (6.17%) SQL Server
13 89 (4.65%) MySQL
14 88 (4.60%) Apache Cassandra
15 81 (4.23%) Metadata
16 65 (3.40%) Flink
16 65 (3.40%) Redis
17 63 (3.29%) HBase
17 63 (3.29%) Neo4j
Development Applications
1 232 (12.13%) Jenkins
2 156 (8.15%) Git (software)
3 104 (5.44%) Atlassian Bamboo
4 99 (5.18%) JIRA
5 51 (2.67%) Vagrant
6 38 (1.99%) TeamCity
7 37 (1.93%) Selenium
8 36 (1.88%) JUnit
9 35 (1.83%) JMeter
10 34 (1.78%) Octopus Deploy
11 33 (1.73%) Bitbucket
12 31 (1.62%) Gradle
12 31 (1.62%) WebDriver
13 29 (1.52%) CircleCI
14 22 (1.15%) Jasmine
14 22 (1.15%) Maven
15 19 (0.99%) Cypress.io
16 15 (0.78%) Visual Studio
16 15 (0.78%) webpack
17 11 (0.58%) ERwin
General
1 390 (20.39%) Finance
2 323 (16.88%) Social Skills
3 179 (9.36%) Analytical Skills
4 119 (6.22%) Retail
5 114 (5.96%) Banking
6 68 (3.55%) Telecoms
7 67 (3.50%) Marketing
8 51 (2.67%) Advertising
8 51 (2.67%) Presentation Skills
9 48 (2.51%) Public Sector
10 42 (2.20%) Games
11 30 (1.57%) Investment Banking
12 29 (1.52%) Publishing
13 26 (1.36%) Legal
14 25 (1.31%) Inclusion and Diversity
14 25 (1.31%) Law
15 23 (1.20%) Manufacturing
16 21 (1.10%) Influencing Skills
17 18 (0.94%) Financial Institution
18 16 (0.84%) Automotive
Job Titles
1 405 (21.17%) Developer
2 361 (18.87%) Data Engineer
3 311 (16.26%) Architect
4 156 (8.15%) Java Developer
5 154 (8.05%) Software Engineer
6 149 (7.79%) Data Architect
7 124 (6.48%) Big Data Engineer
8 121 (6.33%) Senior Developer
9 104 (5.44%) Analyst
10 89 (4.65%) Solutions Architect
11 73 (3.82%) Consultant
12 72 (3.76%) Java Engineer
13 70 (3.66%) Data Analyst
14 68 (3.55%) Data Scientist
15 66 (3.45%) Cloud Architect
15 66 (3.45%) Senior Data Engineer
16 64 (3.35%) Scala Engineer
17 62 (3.24%) Senior Java Developer
18 56 (2.93%) Python Engineer
19 52 (2.72%) AWS Engineer
Libraries, Frameworks & Software Standards
1 379 (19.81%) Kafka
2 212 (11.08%) React
3 167 (8.73%) REST
4 157 (8.21%) Node.js
5 129 (6.74%) Spring
6 120 (6.27%) GraphQL
6 120 (6.27%) Web Services
7 110 (5.75%) AngularJS
8 90 (4.70%) HTML
9 87 (4.55%) CSS
10 82 (4.29%) Spring Boot
11 78 (4.08%) Apache Beam
12 77 (4.03%) .NET
13 66 (3.45%) Spark Streaming
14 65 (3.40%) JSON
15 56 (2.93%) Django
16 55 (2.88%) Akka
17 49 (2.56%) Apache Thrift
18 48 (2.51%) Redux
19 45 (2.35%) RESTful
Miscellaneous
1 125 (6.53%) Cloud Native
2 124 (6.48%) Algorithms
3 105 (5.49%) User Experience
4 94 (4.91%) Hybrid Cloud
5 85 (4.44%) Public Cloud
6 74 (3.87%) Self-Motivation
7 64 (3.35%) Data Structures
8 34 (1.78%) Hedge funds
9 29 (1.52%) Private Cloud
10 25 (1.31%) Linux Command Line
11 24 (1.25%) Enterprise Software
11 24 (1.25%) Greenfield Project
11 24 (1.25%) Management Information System
11 24 (1.25%) Virtual Team
12 23 (1.20%) Data Centre
13 21 (1.10%) Social Media
14 18 (0.94%) NHS
15 16 (0.84%) Cyberattack
15 16 (0.84%) Internet of Things
16 14 (0.73%) Equities
Operating Systems
1 107 (5.59%) Linux
2 46 (2.40%) Unix
3 18 (0.94%) Windows
4 9 (0.47%) Apple iOS
5 5 (0.26%) Mac OS
5 5 (0.26%) VMS
6 4 (0.21%) Red Hat Enterprise Linux
7 3 (0.16%) DC/OS
7 3 (0.16%) Mesosphere
8 1 (0.052%) Android
8 1 (0.052%) CentOS
Processes & Methodologies
1 799 (41.77%) Analytics
2 741 (38.73%) Agile Software Development
3 531 (27.76%) Artificial Intelligence
4 516 (26.97%) Data Science
5 427 (22.32%) Machine Learning
6 404 (21.12%) DevOps
7 386 (20.18%) ETL
8 361 (18.87%) Software Engineering
9 320 (16.73%) Business Intelligence
10 313 (16.36%) Microservices
11 302 (15.79%) Data Pipeline
12 286 (14.95%) Computer Science
13 271 (14.17%) Data Modelling
14 270 (14.11%) Continuous Integration
15 267 (13.96%) Data Engineering
16 234 (12.23%) Open Source
17 220 (11.50%) Visualisation
18 214 (11.19%) Data Analytics
19 213 (11.13%) Problem-Solving
20 200 (10.45%) Data Architecture
Programming Languages
1 876 (45.79%) Python
2 731 (38.21%) SQL
3 619 (32.36%) Java
4 253 (13.23%) Scala
5 226 (11.81%) JavaScript
6 145 (7.58%) TypeScript
7 132 (6.90%) Go
8 117 (6.12%) C#
9 78 (4.08%) PowerShell
10 73 (3.82%) R
11 68 (3.55%) C++
12 64 (3.35%) Java 8
13 61 (3.19%) Bash Shell
14 40 (2.09%) C
15 34 (1.78%) Ruby
16 27 (1.41%) PHP
17 26 (1.36%) Shell Script
18 25 (1.31%) ES6
19 22 (1.15%) Rust
20 19 (0.99%) Kotlin
Qualifications
1 260 (13.59%) Degree
2 78 (4.08%) Security Cleared
3 71 (3.71%) Computer Science Degree
4 68 (3.55%) SC Cleared
5 31 (1.62%) Master's Degree
6 29 (1.52%) PhD
7 14 (0.73%) AWS Certification
7 14 (0.73%) Numerate Degree
8 10 (0.52%) Oracle Certification
9 7 (0.37%) DV Cleared
10 6 (0.31%) Microsoft Certification
11 5 (0.26%) BPSS Clearance
11 5 (0.26%) CISSP
12 4 (0.21%) A+ Certification
12 4 (0.21%) MCSA
12 4 (0.21%) TOGAF Certification
13 3 (0.16%) (ISC)2 CCSP
13 3 (0.16%) Cisco Certification
14 2 (0.10%) CCA
14 2 (0.10%) ISEB
Quality Assurance & Compliance
1 134 (7.00%) Data Quality
2 104 (5.44%) QA
3 72 (3.76%) GDPR
4 27 (1.41%) Accessibility
5 4 (0.21%) Sarbanes-Oxley
6 3 (0.16%) Actionable Recommendations
7 2 (0.10%) MiFID
7 2 (0.10%) NIST
7 2 (0.10%) Solvency II
8 1 (0.052%) Cyber Essentials
8 1 (0.052%) ISO/IEC 27001
8 1 (0.052%) NCSC
8 1 (0.052%) PCI DSS
System Software
1 440 (23.00%) Docker
2 44 (2.30%) VirtualBox
3 29 (1.52%) Active Directory
4 19 (0.99%) Apache ZooKeeper
4 19 (0.99%) HDFS
5 8 (0.42%) Virtual Machines
6 7 (0.37%) Ceph
7 6 (0.31%) Apache Flume
8 4 (0.21%) Hyper-V
8 4 (0.21%) VMware Infrastructure
Systems Management
1 520 (27.18%) Kubernetes
2 254 (13.28%) Terraform
3 163 (8.52%) Ansible
4 73 (3.82%) Prometheus
5 68 (3.55%) Puppet
6 66 (3.45%) Docker Swarm
7 60 (3.14%) Opscode Chef
8 55 (2.88%) Grafana
9 32 (1.67%) SCCM
10 18 (0.94%) Oozie
11 10 (0.52%) Salt
12 9 (0.47%) ITRS Geneos
13 8 (0.42%) Consul
13 8 (0.42%) Graphite
14 7 (0.37%) Control-M
14 7 (0.37%) Galera Cluster
14 7 (0.37%) Packer
15 6 (0.31%) Hadoop YARN
15 6 (0.31%) Nagios
15 6 (0.31%) Opsview
Vendors
1 302 (15.79%) Google
2 128 (6.69%) Oracle
3 125 (6.53%) Microsoft
4 93 (4.86%) Informatica
5 91 (4.76%) Databricks
6 90 (4.70%) Cloudera
7 78 (4.08%) IBM
8 74 (3.87%) Talend
9 73 (3.82%) Hortonworks
10 29 (1.52%) SAP
11 23 (1.20%) Adobe
12 22 (1.15%) Teradata
13 21 (1.10%) Splunk
14 20 (1.05%) Instagram
15 19 (0.99%) Yahoo!
16 18 (0.94%) YouTube
17 17 (0.89%) Salesforce.com
18 16 (0.84%) Cisco
19 15 (0.78%) GoldenSource
19 15 (0.78%) Hyperion