Period
to

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 12 August 2022 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
12 Aug 2022
Same period 2021 Same period 2020
Rank 94 79 93
Rank change year-on-year -15 +14 -30
Permanent jobs citing Big Data 2,755 1,858 916
As % of all permanent jobs advertised in London 3.83% 4.07% 3.50%
As % of the Database & Business Intelligence category 12.41% 12.81% 12.47%
Number of salaries quoted 1,091 1,206 675
10th Percentile £51,500 £47,500 £46,250
25th Percentile £65,500 £57,500 £56,500
Median annual salary (50th Percentile) £80,000 £80,000 £75,000
Median % change year-on-year - +6.67% -3.85%
75th Percentile £100,000 £95,000 £95,000
90th Percentile £115,000 £114,375 £120,000
England median annual salary £80,000 £70,000 £67,500
% change year-on-year +14.29% +3.70% -3.57%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22,200 14,507 7,348
As % of all permanent IT jobs advertised in London 30.86% 31.77% 28.09%
Number of salaries quoted 9,105 8,672 5,948
10th Percentile £45,000 £43,750 £42,077
25th Percentile £55,000 £53,500 £51,250
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £90,000 £88,750 £85,000
90th Percentile £110,000 £105,000 £101,250
England median annual salary £60,000 £57,500 £55,000
% change year-on-year +4.35% +4.55% +4.76%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 12 August 2022.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 12 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London -74 197 £85,000 +6.25% 45
West London +1 54 £75,000 -11.24% 16
South London -11 46 £48,500 -9.35%
East London -3 45 £82,500 +17.86% 7
North London - 13 - -
Big Data
England

For the 6 months to 12 August 2022, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 1,608 (58.37%) Python
2 1,254 (45.52%) Agile
3 1,214 (44.07%) AWS
4 1,135 (41.20%) SQL
5 1,128 (40.94%) Analytics
6 1,049 (38.08%) Data Science
7 987 (35.83%) Java
8 901 (32.70%) Azure
9 856 (31.07%) Machine Learning
10 800 (29.04%) Apache Spark
11 771 (27.99%) GCP
12 712 (25.84%) Finance
13 680 (24.68%) Social Skills
14 672 (24.39%) DevOps
15 662 (24.03%) Data Engineering
16 655 (23.77%) Kubernetes
17 654 (23.74%) CI/CD
18 648 (23.52%) Artificial Intelligence
19 630 (22.87%) Hadoop
20 585 (21.23%) Data Modelling
21 583 (21.16%) Software Engineering
21 583 (21.16%) Kafka
22 534 (19.38%) Degree
23 529 (19.20%) Data Warehouse
24 504 (18.29%) ETL
25 488 (17.71%) NoSQL
26 461 (16.73%) Mentoring
27 454 (16.48%) Data Pipeline
28 452 (16.41%) Scala
29 447 (16.23%) Docker

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 800 (29.04%) Apache Spark
2 244 (8.86%) Apache Airflow
3 174 (6.32%) Apache
4 86 (3.12%) Apache Pulsar
5 64 (2.32%) OpenStack
6 56 (2.03%) Confluence
7 36 (1.31%) Apache Solr
7 36 (1.31%) nginx
8 35 (1.27%) SAS
9 34 (1.23%) Oracle Workflow
10 33 (1.20%) Jupyter
11 32 (1.16%) Apache Pig
12 22 (0.80%) Luigi
12 22 (0.80%) SharePoint
13 17 (0.62%) Tomcat
14 15 (0.54%) IIS
15 12 (0.44%) Apache Synapse
15 12 (0.44%) CMS
16 10 (0.36%) Jetty
17 9 (0.33%) ColdFusion
Applications
1 49 (1.78%) Microsoft Excel
2 12 (0.44%) Microsoft Office
3 8 (0.29%) Spreadsheet
4 3 (0.11%) Microsoft PowerPoint
4 3 (0.11%) MS Visio
5 2 (0.073%) Microsoft Project
6 1 (0.036%) Adobe Premiere
6 1 (0.036%) SPSS
6 1 (0.036%) Zeplin
Business Applications
1 19 (0.69%) Oracle Payables
2 8 (0.29%) Avolution ABACUS
3 6 (0.22%) SAP Oil and Gas
4 3 (0.11%) Infor M3
4 3 (0.11%) SAP S/4HANA
5 2 (0.073%) Dynamics CRM
5 2 (0.073%) Primavera
6 1 (0.036%) ION MarketView
6 1 (0.036%) Maximo
6 1 (0.036%) Sparx Enterprise Architect
Cloud Services
1 1,214 (44.07%) AWS
2 901 (32.70%) Azure
3 771 (27.99%) GCP
4 217 (7.88%) Power Platform
4 217 (7.88%) Serverless
5 209 (7.59%) Snowflake
6 175 (6.35%) Cloud Computing
7 151 (5.48%) SaaS
8 146 (5.30%) Amazon S3
9 125 (4.54%) Azure Synapse Analytics
10 123 (4.46%) AWS Lambda
11 122 (4.43%) Azure Data Factory
12 115 (4.17%) GitHub
13 104 (3.77%) dbt
14 97 (3.52%) Amazon Kinesis
15 95 (3.45%) Azure DevOps
16 87 (3.16%) AWS CloudFormation
17 86 (3.12%) Amazon EMR
18 80 (2.90%) PaaS
19 74 (2.69%) Azure Cosmos DB
Communications & Networking
1 106 (3.85%) HTTP
2 70 (2.54%) Internet
2 70 (2.54%) PPP
3 50 (1.81%) TCP/IP
4 26 (0.94%) Firewall
5 17 (0.62%) VoIP
6 15 (0.54%) DNS
6 15 (0.54%) VPN
7 11 (0.40%) Broadband
8 10 (0.36%) VLAN
9 7 (0.25%) DSL
9 7 (0.25%) SMS
10 5 (0.18%) Kerberos
10 5 (0.18%) Unified Communications
10 5 (0.18%) Wireless
11 4 (0.15%) Cisco IPT
11 4 (0.15%) IPsec
12 3 (0.11%) Network Security
12 3 (0.11%) SSL
12 3 (0.11%) WebEx
Database & Business Intelligence
1 630 (22.87%) Hadoop
2 529 (19.20%) Data Warehouse
3 488 (17.71%) NoSQL
4 370 (13.43%) Data Lake
5 307 (11.14%) MongoDB
6 287 (10.42%) Relational Database
7 246 (8.93%) SQL Server
8 226 (8.20%) PostgreSQL
9 220 (7.99%) Apache Hive
10 217 (7.88%) Power BI
11 200 (7.26%) Amazon Redshift
12 198 (7.19%) Elasticsearch
13 192 (6.97%) Apache Cassandra
14 191 (6.93%) Tableau
15 169 (6.13%) HBase
16 166 (6.03%) Flink
17 163 (5.92%) BigQuery
18 148 (5.37%) MySQL
19 101 (3.67%) DynamoDB
19 101 (3.67%) Redis
Development Applications
1 342 (12.41%) Git (software)
2 218 (7.91%) Jenkins
3 111 (4.03%) JIRA
4 106 (3.85%) JUnit
5 97 (3.52%) Selenium
6 89 (3.23%) Maven
7 82 (2.98%) Atlassian Bamboo
8 50 (1.81%) Octopus Deploy
8 50 (1.81%) TeamCity
9 48 (1.74%) GitLab
10 45 (1.63%) Bitbucket
11 41 (1.49%) JMeter
12 38 (1.38%) WebDriver
13 37 (1.34%) MLflow
14 36 (1.31%) Visual Studio
15 34 (1.23%) ERwin
16 31 (1.13%) Travis CI
17 28 (1.02%) Gradle
18 27 (0.98%) CircleCI
19 26 (0.94%) IBM UrbanCode
General
1 712 (25.84%) Finance
2 680 (24.68%) Social Skills
3 429 (15.57%) Analytical Skills
4 310 (11.25%) Games
5 262 (9.51%) Marketing
6 220 (7.99%) Retail
7 186 (6.75%) Banking
8 133 (4.83%) Inclusion and Diversity
9 103 (3.74%) Presentation Skills
10 89 (3.23%) Advertising
11 82 (2.98%) Public Sector
12 73 (2.65%) Telecoms
13 69 (2.50%) Influencing Skills
14 62 (2.25%) Law
15 61 (2.21%) Legal
16 54 (1.96%) Pharmaceutical
17 36 (1.31%) Financial Institution
18 35 (1.27%) Retail Banking
19 24 (0.87%) Front Office
20 20 (0.73%) Manufacturing
Job Titles
1 636 (23.09%) Data Engineer
2 416 (15.10%) Architect
3 385 (13.97%) Developer
4 298 (10.82%) Software Engineer
5 168 (6.10%) Data Architect
6 163 (5.92%) Senior Data Engineer
7 155 (5.63%) Java Developer
8 153 (5.55%) Senior Developer
9 146 (5.30%) Data Scientist
10 143 (5.19%) Solutions Architect
11 128 (4.65%) Big Data Engineer
12 124 (4.50%) Analyst
13 116 (4.21%) Senior Software Engineer
14 94 (3.41%) Consultant
15 76 (2.76%) Data Manager
16 74 (2.69%) Senior Java Developer
16 74 (2.69%) Senior Manager
17 70 (2.54%) DevOps Engineer
17 70 (2.54%) Senior Data Scientist
18 62 (2.25%) Cloud Architect
Libraries, Frameworks & Software Standards
1 583 (21.16%) Kafka
2 248 (9.00%) Spring
3 224 (8.13%) REST
4 185 (6.72%) PySpark
5 179 (6.50%) React
6 149 (5.41%) Web Services
7 145 (5.26%) Node.js
8 141 (5.12%) .NET
9 112 (4.07%) CSS
10 110 (3.99%) HTML
11 106 (3.85%) Spring Boot
12 95 (3.45%) Apache NiFi
13 87 (3.16%) Apache Beam
13 87 (3.16%) JSON
14 85 (3.09%) Pandas
15 83 (3.01%) RESTful
16 75 (2.72%) AngularJS
17 73 (2.65%) RabbitMQ
18 72 (2.61%) Django
19 70 (2.54%) scikit-learn
Miscellaneous
1 394 (14.30%) Algorithms
2 195 (7.08%) Data Structures
3 178 (6.46%) Public Cloud
4 155 (5.63%) Social Media
5 140 (5.08%) Cloud Native
6 104 (3.77%) Blog
7 102 (3.70%) Social Network
8 98 (3.56%) Hackathon
9 95 (3.45%) Blockchain
9 95 (3.45%) User Experience
10 90 (3.27%) IoT
11 86 (3.12%) Self-Motivation
12 82 (2.98%) Renewable Energy
13 63 (2.29%) Greenfield Project
13 63 (2.29%) Management Information System
14 53 (1.92%) Life Science
15 52 (1.89%) Hybrid Cloud
16 42 (1.52%) Enterprise Software
16 42 (1.52%) Online Games
16 42 (1.52%) Sports Betting
Operating Systems
1 235 (8.53%) Linux
2 70 (2.54%) Unix
3 53 (1.92%) Windows
4 27 (0.98%) CentOS
5 18 (0.65%) Red Hat Enterprise Linux
6 17 (0.62%) Android
7 16 (0.58%) VMS
8 10 (0.36%) Mesosphere
9 4 (0.15%) Windows Server
10 3 (0.11%) Alpine Linux
10 3 (0.11%) Ubuntu
11 1 (0.036%) Apple iOS
11 1 (0.036%) SUSE
Processes & Methodologies
1 1,254 (45.52%) Agile
2 1,128 (40.94%) Analytics
3 1,049 (38.08%) Data Science
4 856 (31.07%) Machine Learning
5 672 (24.39%) DevOps
6 662 (24.03%) Data Engineering
7 654 (23.74%) CI/CD
8 648 (23.52%) Artificial Intelligence
9 585 (21.23%) Data Modelling
10 583 (21.16%) Software Engineering
11 504 (18.29%) ETL
12 461 (16.73%) Mentoring
13 454 (16.48%) Data Pipeline
14 442 (16.04%) Business Intelligence
15 410 (14.88%) Computer Science
16 409 (14.85%) Microservices
17 359 (13.03%) Data Architecture
18 350 (12.70%) Data Analytics
19 347 (12.60%) TDD
20 336 (12.20%) Visualisation
Programming Languages
1 1,608 (58.37%) Python
2 1,135 (41.20%) SQL
3 987 (35.83%) Java
4 452 (16.41%) Scala
5 386 (14.01%) JavaScript
6 191 (6.93%) C#
7 146 (5.30%) Bash
8 138 (5.01%) R
9 123 (4.46%) PowerShell
10 118 (4.28%) TypeScript
11 76 (2.76%) C++
12 74 (2.69%) Go
13 43 (1.56%) C
14 40 (1.45%) Kotlin
14 40 (1.45%) T-SQL
15 37 (1.34%) ES6
15 37 (1.34%) PHP
16 31 (1.13%) Shell Script
17 24 (0.87%) PL/SQL
18 21 (0.76%) Groovy
Qualifications
1 534 (19.38%) Degree
2 128 (4.65%) Computer Science Degree
3 95 (3.45%) Master's Degree
4 69 (2.50%) AWS Certification
5 50 (1.81%) Security Cleared
6 40 (1.45%) PhD
6 40 (1.45%) TOGAF Certification
7 27 (0.98%) SC Cleared
8 12 (0.44%) BPSS Clearance
8 12 (0.44%) Sun Certification
9 11 (0.40%) Numerate Degree
10 10 (0.36%) CISSP
10 10 (0.36%) Microsoft Certification
11 9 (0.33%) MBA
12 5 (0.18%) PMI Certification
13 4 (0.15%) (ISC)2 CCSP
13 4 (0.15%) CISA
13 4 (0.15%) Cisco Certification
13 4 (0.15%) CISM
14 3 (0.11%) ITIL Certification
Quality Assurance & Compliance
1 246 (8.93%) Data Quality
2 188 (6.82%) QA
3 37 (1.34%) GDPR
4 9 (0.33%) PCI DSS
5 8 (0.29%) MiFID
6 7 (0.25%) EMIR
6 7 (0.25%) ISO/IEC 27001
6 7 (0.25%) NIST
6 7 (0.25%) SLA
7 6 (0.22%) Accessibility
7 6 (0.22%) SEPA
8 4 (0.15%) HIPAA
8 4 (0.15%) ISO 20022
8 4 (0.15%) SOC 2
9 3 (0.11%) IFRS
9 3 (0.11%) ISO 15022
9 3 (0.11%) Sarbanes-Oxley
10 1 (0.036%) COBIT
10 1 (0.036%) Dodd-Frank
10 1 (0.036%) GMP
System Software
1 447 (16.23%) Docker
2 83 (3.01%) Apache Flume
3 74 (2.69%) Apache ZooKeeper
4 22 (0.80%) VMware Infrastructure
5 17 (0.62%) Active Directory
6 16 (0.58%) Virtual Machines
7 13 (0.47%) Firmware
8 12 (0.44%) HDFS
9 4 (0.15%) zsh
10 3 (0.11%) KVM
11 1 (0.036%) Virtual Desktop
Systems Management
1 655 (23.77%) Kubernetes
2 280 (10.16%) Terraform
3 125 (4.54%) Ansible
4 85 (3.09%) Puppet
5 61 (2.21%) Opscode Chef
6 60 (2.18%) Oozie
7 54 (1.96%) Prometheus
8 35 (1.27%) Grafana
9 28 (1.02%) HAProxy
9 28 (1.02%) SCCM
10 14 (0.51%) Docker Swarm
10 14 (0.51%) Kibana
10 14 (0.51%) logstash
11 13 (0.47%) Failover Clustering
12 10 (0.36%) Automic
12 10 (0.36%) Consul
12 10 (0.36%) Graphite
12 10 (0.36%) Kubeflow
12 10 (0.36%) Salt
12 10 (0.36%) Single Sign-On
Vendors
1 385 (13.97%) Google
2 317 (11.51%) Databricks
3 228 (8.28%) Microsoft
4 209 (7.59%) Oracle
5 106 (3.85%) Teradata
6 105 (3.81%) Twitter
7 87 (3.16%) Splunk
8 84 (3.05%) Cloudera
9 76 (2.76%) Sun
10 70 (2.54%) Informatica
11 52 (1.89%) IBM
12 36 (1.31%) Talend
13 33 (1.20%) Cisco
13 33 (1.20%) SAP
14 31 (1.13%) New Relic
14 31 (1.13%) TOWER Software
15 30 (1.09%) CA
16 28 (1.02%) Alteryx
16 28 (1.02%) Salesforce.com
17 24 (0.87%) Instagram