Period
to 25 June 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 25 June 2021 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
25 Jun 2021
Same period 2020 Same period 2019
Rank 79 94 65
Rank change year-on-year +15 -29 -23
Permanent jobs citing Big Data 1,647 1,170 2,595
As % of all permanent jobs advertised in London 4.07% 3.50% 4.49%
As % of the Database & Business Intelligence category 13.15% 12.46% 15.60%
Number of salaries quoted 1,105 895 2,180
10th Percentile £46,250 £47,500 £50,000
25th Percentile £55,000 £57,500 £60,000
Median annual salary (50th Percentile) £77,500 £75,000 £77,500
Median % change year-on-year +3.33% -3.23% +10.71%
75th Percentile £95,000 £92,750 £95,000
90th Percentile £115,000 £115,000 £111,250
England median annual salary £67,500 £67,500 £70,000
% change year-on-year - -3.57% +7.69%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 12,523 9,389 16,639
As % of all permanent IT jobs advertised in London 30.96% 28.10% 28.81%
Number of salaries quoted 8,040 7,669 13,984
10th Percentile £43,750 £41,250 £37,730
25th Percentile £52,500 £50,000 £47,500
Median annual salary (50th Percentile) £70,000 £67,500 £65,000
Median % change year-on-year +3.70% +3.85% +8.33%
75th Percentile £87,500 £85,000 £82,500
90th Percentile £105,000 £103,750 £95,000
England median annual salary £55,000 £55,000 £52,500
% change year-on-year - +4.76% +5.00%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 25 June 2021.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 25 June 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +20 313 £80,000 +10.34% 87
West London +6 22 £65,000 -10.34% 19
South London -20 22 £55,000 -31.25% 7
Big Data
England

For the 6 months to 25 June 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 789 (47.91%) Python
2 756 (45.90%) AWS
3 655 (39.77%) Agile Software Development
4 638 (38.74%) Analytics
5 603 (36.61%) SQL
6 554 (33.64%) Hadoop
7 542 (32.91%) Java
8 522 (31.69%) Apache Spark
9 519 (31.51%) GCP
10 518 (31.45%) Kubernetes
11 506 (30.72%) Artificial Intelligence
12 467 (28.35%) Docker
13 462 (28.05%) Azure
14 439 (26.65%) Data Science
15 402 (24.41%) Software Engineering
16 385 (23.38%) Machine Learning
17 383 (23.25%) DevOps
18 365 (22.16%) ETL
19 330 (20.04%) Finance
20 316 (19.19%) Data Pipeline
21 307 (18.64%) Kafka
22 300 (18.21%) Microservices
23 287 (17.43%) NoSQL
24 279 (16.94%) Data Engineering
25 278 (16.88%) Terraform
26 277 (16.82%) Google
27 262 (15.91%) Business Intelligence
28 257 (15.60%) Data Warehouse
29 243 (14.75%) Continuous Integration
29 243 (14.75%) Social Skills

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 522 (31.69%) Apache Spark
2 187 (11.35%) Apache Airflow
3 131 (7.95%) Elasticsearch
4 128 (7.77%) Apache
5 48 (2.91%) Luigi
6 47 (2.85%) Confluence
7 31 (1.88%) Apache Pig
8 29 (1.76%) SAS
9 24 (1.46%) IIS
10 11 (0.67%) Oracle Workflow
11 7 (0.43%) Jupyter
11 7 (0.43%) Oracle SOA Suite
11 7 (0.43%) WebLogic
12 6 (0.36%) OpenStack
13 5 (0.30%) SharePoint
14 4 (0.24%) CMS
14 4 (0.24%) Moodle
14 4 (0.24%) Tomcat
15 3 (0.18%) GemFire
15 3 (0.18%) Mule
Applications
1 22 (1.34%) Microsoft Excel
2 18 (1.09%) SPSS
3 14 (0.85%) Microsoft Office
4 12 (0.73%) Spreadsheet
5 6 (0.36%) Figma
6 4 (0.24%) Adobe Creative Suite
7 2 (0.12%) Gephi
7 2 (0.12%) Sketch
8 1 (0.061%) Microsoft PowerPoint
8 1 (0.061%) Microsoft Project
8 1 (0.061%) Stata
Business Applications
1 10 (0.61%) Primavera
2 8 (0.49%) Oracle ERP
3 3 (0.18%) Distributed Ledger
3 3 (0.18%) Oracle EBS
4 2 (0.12%) Oracle BPM
4 2 (0.12%) R3 Corda
4 2 (0.12%) SAP S/4HANA
4 2 (0.12%) Sentinel
4 2 (0.12%) Sparx Enterprise Architect
5 1 (0.061%) Oracle Procure-to-Pay
5 1 (0.061%) SAP CRM
5 1 (0.061%) SAP ERP
5 1 (0.061%) SAP Hybris
5 1 (0.061%) SAP R/3
Cloud Services
1 756 (45.90%) AWS
2 519 (31.51%) GCP
3 462 (28.05%) Azure
4 154 (9.35%) Serverless
5 131 (7.95%) Snowflake
6 124 (7.53%) Power Platform
7 98 (5.95%) Amazon EMR
8 96 (5.83%) SaaS
9 81 (4.92%) Amazon S3
10 70 (4.25%) Cloud Computing
11 67 (4.07%) IBM Cloud
12 63 (3.83%) AWS Lambda
13 62 (3.76%) Cloud Functions
14 61 (3.70%) PaaS
15 59 (3.58%) GitHub
16 58 (3.52%) IaaS
17 49 (2.98%) Amazon EC2
18 36 (2.19%) Amazon Kinesis
19 35 (2.13%) AWS CloudFormation
20 33 (2.00%) AWS Fargate
Communications & Networking
1 43 (2.61%) HTTP
2 40 (2.43%) Firewall
2 40 (2.43%) Internet
3 16 (0.97%) Wireless
4 15 (0.91%) 5G
5 12 (0.73%) 4G
6 6 (0.36%) IMAP
6 6 (0.36%) Network Security
6 6 (0.36%) SMTP
7 5 (0.30%) Broadband
7 5 (0.30%) SMS
8 3 (0.18%) DNS
8 3 (0.18%) SSL
8 3 (0.18%) Unified Communications
8 3 (0.18%) VPN
9 2 (0.12%) Cisco IPT
9 2 (0.12%) Ethernet
9 2 (0.12%) Intrusion Detection
9 2 (0.12%) MPLS
9 2 (0.12%) Sourcefire
Database & Business Intelligence
1 554 (33.64%) Hadoop
2 287 (17.43%) NoSQL
3 257 (15.60%) Data Warehouse
4 213 (12.93%) Amazon Redshift
5 138 (8.38%) PostgreSQL
6 133 (8.08%) BigQuery
7 130 (7.89%) Data Lake
8 123 (7.47%) Relational Database
9 120 (7.29%) MongoDB
10 118 (7.16%) Power BI
11 110 (6.68%) Tableau
12 104 (6.31%) Apache Hive
13 87 (5.28%) SQL Server
14 82 (4.98%) Amazon Athena
15 76 (4.61%) Neo4j
16 71 (4.31%) Redis
17 70 (4.25%) Electronic Patient Records
18 69 (4.19%) Apache Cassandra
19 67 (4.07%) MySQL
20 51 (3.10%) Amazon RDS
Development Applications
1 219 (13.30%) Jenkins
2 116 (7.04%) Atlassian Bamboo
3 115 (6.98%) Git (software)
4 87 (5.28%) JIRA
5 77 (4.68%) Vagrant
6 32 (1.94%) Selenium
7 29 (1.76%) JMeter
7 29 (1.76%) JUnit
8 27 (1.64%) TeamCity
9 26 (1.58%) Bitbucket
10 25 (1.52%) Octopus Deploy
10 25 (1.52%) WebDriver
11 19 (1.15%) Cypress.io
12 18 (1.09%) Gradle
13 14 (0.85%) CircleCI
13 14 (0.85%) Jasmine
14 13 (0.79%) GitLab
14 13 (0.79%) Team Foundation Server
15 12 (0.73%) webpack
16 10 (0.61%) Visual Studio
General
1 330 (20.04%) Finance
2 243 (14.75%) Social Skills
3 120 (7.29%) Analytical Skills
4 98 (5.95%) Banking
5 82 (4.98%) Telecoms
6 81 (4.92%) Retail
7 74 (4.49%) Marketing
8 39 (2.37%) Advertising
9 34 (2.06%) Presentation Skills
10 31 (1.88%) Games
11 30 (1.82%) Law
12 29 (1.76%) Investment Banking
13 28 (1.70%) Legal
14 25 (1.52%) Manufacturing
15 21 (1.28%) Front Office
16 17 (1.03%) Public Sector
17 16 (0.97%) Influencing Skills
18 15 (0.91%) Financial Institution
19 11 (0.67%) Documentation Skills
20 10 (0.61%) Czech Language
Job Titles
1 362 (21.98%) Data Engineer
2 348 (21.13%) Developer
3 243 (14.75%) Architect
4 146 (8.86%) Big Data Engineer
5 130 (7.89%) Software Engineer
6 127 (7.71%) Java Developer
7 123 (7.47%) Data Architect
8 96 (5.83%) Senior Developer
9 85 (5.16%) Java Engineer
10 75 (4.55%) AWS Engineer
10 75 (4.55%) Platform Engineer
11 72 (4.37%) Analyst
12 68 (4.13%) Consultant
13 66 (4.01%) Solutions Architect
14 64 (3.89%) Senior Data Engineer
15 62 (3.76%) Python Engineer
16 54 (3.28%) Data Scientist
17 52 (3.16%) Data Analyst
18 49 (2.98%) Scala Engineer
19 46 (2.79%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 307 (18.64%) Kafka
2 174 (10.56%) React
3 157 (9.53%) REST
4 128 (7.77%) Node.js
5 120 (7.29%) AngularJS
6 102 (6.19%) GraphQL
7 100 (6.07%) Web Services
8 93 (5.65%) Spark Streaming
9 91 (5.53%) CSS
10 85 (5.16%) Spring
11 82 (4.98%) .NET
12 76 (4.61%) HTML
13 66 (4.01%) Apache Beam
14 57 (3.46%) Spring Boot
14 57 (3.46%) Vue.js
15 56 (3.40%) NumPy
16 52 (3.16%) Django
17 51 (3.10%) JSON
18 50 (3.04%) Redux
19 47 (2.85%) Akka
Miscellaneous
1 100 (6.07%) User Experience
2 91 (5.53%) Hybrid Cloud
3 87 (5.28%) Algorithms
4 77 (4.68%) Hedge funds
5 65 (3.95%) Cloud Native
6 59 (3.58%) Data Structures
7 52 (3.16%) Self-Motivation
8 45 (2.73%) Public Cloud
9 42 (2.55%) Linux Command Line
10 29 (1.76%) Data Centre
10 29 (1.76%) Greenfield Project
11 28 (1.70%) Enterprise Software
12 22 (1.34%) Virtual Team
13 19 (1.15%) Equities
13 19 (1.15%) Internet of Things
14 18 (1.09%) Management Information System
15 14 (0.85%) e-Learning
16 13 (0.79%) Cyberattack
16 13 (0.79%) Reference Data
16 13 (0.79%) Robotics
Operating Systems
1 129 (7.83%) Linux
2 32 (1.94%) Unix
3 21 (1.28%) Red Hat Enterprise Linux
4 11 (0.67%) Windows
5 10 (0.61%) CentOS
6 3 (0.18%) Android
7 2 (0.12%) Debian
8 1 (0.061%) Fedora
8 1 (0.061%) Ubuntu
8 1 (0.061%) VMS
8 1 (0.061%) Windows Server
Processes & Methodologies
1 655 (39.77%) Agile Software Development
2 638 (38.74%) Analytics
3 506 (30.72%) Artificial Intelligence
4 439 (26.65%) Data Science
5 402 (24.41%) Software Engineering
6 385 (23.38%) Machine Learning
7 383 (23.25%) DevOps
8 365 (22.16%) ETL
9 316 (19.19%) Data Pipeline
10 300 (18.21%) Microservices
11 279 (16.94%) Data Engineering
12 262 (15.91%) Business Intelligence
13 243 (14.75%) Continuous Integration
14 239 (14.51%) Open Source
15 204 (12.39%) Computer Science
16 201 (12.20%) Data Modelling
17 196 (11.90%) Visualisation
18 191 (11.60%) Data Analytics
19 159 (9.65%) Data Architecture
20 152 (9.23%) Scrum
Programming Languages
1 789 (47.91%) Python
2 603 (36.61%) SQL
3 542 (32.91%) Java
4 208 (12.63%) Scala
5 204 (12.39%) JavaScript
6 155 (9.41%) TypeScript
7 116 (7.04%) C#
8 109 (6.62%) Go
9 76 (4.61%) C++
10 62 (3.76%) C
11 61 (3.70%) Java 8
12 60 (3.64%) R
13 45 (2.73%) Bash Shell
13 45 (2.73%) PHP
14 38 (2.31%) PowerShell
15 37 (2.25%) Ruby
16 30 (1.82%) Cython
17 24 (1.46%) Perl
18 21 (1.28%) ES6
19 20 (1.21%) Kotlin
Qualifications
1 209 (12.69%) Degree
2 77 (4.68%) Computer Science Degree
3 71 (4.31%) Security Cleared
4 49 (2.98%) SC Cleared
5 40 (2.43%) PhD
6 23 (1.40%) DV Cleared
7 9 (0.55%) AWS Certification
8 8 (0.49%) Master's Degree
8 8 (0.49%) Oracle Certification
9 7 (0.43%) Numerate Degree
10 5 (0.30%) Cisco Certification
10 5 (0.30%) CISSP
11 3 (0.18%) BPSS Clearance
11 3 (0.18%) CCNA
11 3 (0.18%) GIAC
11 3 (0.18%) Linux+ Certification
11 3 (0.18%) MCSE
11 3 (0.18%) Microsoft Certification
11 3 (0.18%) Network+ Certification
11 3 (0.18%) SSCP
Quality Assurance & Compliance
1 90 (5.46%) QA
2 83 (5.04%) Data Quality
3 56 (3.40%) GDPR
4 11 (0.67%) Accessibility
5 4 (0.24%) Sarbanes-Oxley
6 3 (0.18%) PMO
7 2 (0.12%) MiFID
7 2 (0.12%) Solvency II
8 1 (0.061%) GRC
8 1 (0.061%) ISO/IEC 15288
8 1 (0.061%) ISO/IEC 27001
8 1 (0.061%) NIST
8 1 (0.061%) SLA
System Software
1 467 (28.35%) Docker
2 71 (4.31%) VirtualBox
3 21 (1.28%) HDFS
4 19 (1.15%) Active Directory
5 14 (0.85%) Apache ZooKeeper
6 7 (0.43%) VMware Infrastructure
7 6 (0.36%) Ceph
7 6 (0.36%) Oracle RAC
8 5 (0.30%) Virtual Machines
9 4 (0.24%) Apache Flume
10 1 (0.061%) NFS
10 1 (0.061%) Samba
10 1 (0.061%) VMware ESXi
10 1 (0.061%) Xen
Systems Management
1 518 (31.45%) Kubernetes
2 278 (16.88%) Terraform
3 192 (11.66%) Ansible
4 87 (5.28%) Docker Swarm
5 68 (4.13%) Puppet
6 58 (3.52%) Prometheus
7 54 (3.28%) Opscode Chef
8 49 (2.98%) Grafana
9 18 (1.09%) SCCM
10 8 (0.49%) Hadoop YARN
10 8 (0.49%) ZABBIX
11 7 (0.43%) ITRS Geneos
11 7 (0.43%) Nagios
12 6 (0.36%) Graphite
12 6 (0.36%) Kibana
12 6 (0.36%) Oozie
12 6 (0.36%) Opsview
12 6 (0.36%) Oracle RMAN
12 6 (0.36%) Packer
12 6 (0.36%) Salt
Vendors
1 277 (16.82%) Google
2 111 (6.74%) Oracle
3 109 (6.62%) Cloudera
4 103 (6.25%) Informatica
5 95 (5.77%) Talend
6 87 (5.28%) Microsoft
7 85 (5.16%) IBM
8 82 (4.98%) Hortonworks
9 61 (3.70%) Databricks
10 38 (2.31%) Yahoo!
11 29 (1.76%) SAP
12 22 (1.34%) Salesforce.com
13 15 (0.91%) Red Hat
13 15 (0.91%) Splunk
14 14 (0.85%) Instagram
14 14 (0.85%) YouTube
15 13 (0.79%) Hyperion
16 12 (0.73%) Alteryx
16 12 (0.73%) Qubit
17 11 (0.67%) VMware