Period
to 12 April 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 12 April 2021 with a comparison to the same period in the previous 2 years.

Big Data
England > London
6 months to
12 Apr 2021
Same period 2020 Same period 2019
Rank 78 85 59
Rank change year-on-year +7 -26 -8
Permanent jobs citing Big Data 1,187 1,679 2,900
As % of all permanent jobs advertised in London 3.87% 3.59% 4.75%
As % of the Database & Business Intelligence category 13.55% 12.95% 16.16%
Number of salaries quoted 849 1,325 2,427
10th Percentile £46,700 £48,750 £48,750
25th Percentile £57,500 £57,500 £60,000
Median annual salary (50th Percentile) £75,000 £75,000 £77,000
Median % change year-on-year - -2.60% +6.21%
75th Percentile £92,750 £95,000 £95,000
90th Percentile £110,000 £115,000 £110,000
England median annual salary £65,000 £70,000 £70,000
% change year-on-year -7.14% - +7.69%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 8,761 12,963 17,948
As % of all permanent IT jobs advertised in London 28.57% 27.68% 29.39%
Number of salaries quoted 6,909 10,687 15,097
10th Percentile £43,750 £39,000 £38,750
25th Percentile £52,500 £50,000 £47,500
Median annual salary (50th Percentile) £70,000 £65,000 £65,000
Median % change year-on-year +7.69% - +8.33%
75th Percentile £86,250 £85,000 £81,250
90th Percentile £100,000 £102,500 £95,000
England median annual salary £55,000 £53,931 £52,500
% change year-on-year +1.98% +2.73% +5.00%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Salary Trend in London

3-month moving average salary quoted in jobs citing Big Data in London.

Salary trend for Big Data in London

Big Data
Salary Histogram in London

Salary distribution for jobs citing Big Data in London over the 6 months to 12 April 2021.

Salary histogram for Big Data in London

Big Data
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the London region over the 6 months to 12 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +21 266 £80,000 +6.67% 70
South London +6 29 £80,000 +6.67% 1
West London +45 13 £70,000 +3.70% 36
East London -3 2 £50,000 -13.04% 17
Big Data
England

For the 6 months to 12 April 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Big Data.

1 586 (49.37%) Python
2 568 (47.85%) AWS
3 514 (43.30%) Agile Software Development
4 464 (39.09%) Analytics
5 402 (33.87%) Java
6 395 (33.28%) Hadoop
7 386 (32.52%) SQL
8 361 (30.41%) Apache Spark
9 358 (30.16%) Azure
10 334 (28.14%) GCP
11 321 (27.04%) Kubernetes
12 311 (26.20%) Data Science
13 309 (26.03%) DevOps
14 288 (24.26%) Docker
15 276 (23.25%) ETL
16 274 (23.08%) Machine Learning
17 273 (23.00%) Artificial Intelligence
18 261 (21.99%) Software Engineering
19 246 (20.72%) Finance
20 243 (20.47%) Kafka
21 210 (17.69%) Microservices
22 209 (17.61%) Google
23 205 (17.27%) Data Engineering
24 201 (16.93%) Business Intelligence
25 192 (16.18%) NoSQL
26 188 (15.84%) Data Warehouse
27 168 (14.15%) Data Analytics
28 167 (14.07%) Terraform
29 158 (13.31%) Scala
30 149 (12.55%) Open Source

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 361 (30.41%) Apache Spark
2 115 (9.69%) Apache Airflow
3 84 (7.08%) Elasticsearch
4 75 (6.32%) Apache
5 52 (4.38%) SAS
6 41 (3.45%) Luigi
7 32 (2.70%) Confluence
8 30 (2.53%) Apache Pig
9 8 (0.67%) IIS
9 8 (0.67%) Moodle
9 8 (0.67%) Oracle Workflow
10 7 (0.59%) Tornado
11 6 (0.51%) Jupyter
11 6 (0.51%) Oracle SOA Suite
11 6 (0.51%) SharePoint
11 6 (0.51%) WebLogic
12 4 (0.34%) ArcGIS
12 4 (0.34%) OpenStack
13 3 (0.25%) GemFire
14 2 (0.17%) CMS
Applications
1 21 (1.77%) SPSS
2 12 (1.01%) Microsoft Excel
3 7 (0.59%) Microsoft Office
3 7 (0.59%) Spreadsheet
4 2 (0.17%) Gephi
5 1 (0.084%) Adobe Creative Suite
5 1 (0.084%) Figma
5 1 (0.084%) Microsoft PowerPoint
Business Applications
1 6 (0.51%) Dynamics CRM
2 5 (0.42%) SAP CRM
3 4 (0.34%) Oracle EBS
4 2 (0.17%) SAP S/4HANA
4 2 (0.17%) Sentinel
4 2 (0.17%) Sparx Enterprise Architect
5 1 (0.084%) Oracle ERP
5 1 (0.084%) SAP APO
5 1 (0.084%) SAP ERP
5 1 (0.084%) SAP Hybris
Cloud Services
1 568 (47.85%) AWS
2 358 (30.16%) Azure
3 334 (28.14%) GCP
4 81 (6.82%) Serverless
5 74 (6.23%) Power Platform
6 66 (5.56%) Amazon EMR
7 60 (5.05%) SaaS
8 49 (4.13%) AWS Lambda
9 45 (3.79%) Amazon S3
10 42 (3.54%) Cloud Computing
11 38 (3.20%) Amazon Kinesis
12 37 (3.12%) IBM Cloud
13 33 (2.78%) PaaS
14 29 (2.44%) AWS CloudFormation
14 29 (2.44%) IaaS
15 28 (2.36%) Amazon EC2
16 27 (2.27%) Cloud Functions
17 22 (1.85%) GitHub
18 21 (1.77%) Azure Data Factory
19 16 (1.35%) Matillion
Communications & Networking
1 48 (4.04%) Internet
2 44 (3.71%) Firewall
3 18 (1.52%) HTTP
4 8 (0.67%) Wireless
5 6 (0.51%) DNS
5 6 (0.51%) IMAP
5 6 (0.51%) SMTP
6 5 (0.42%) FTP
6 5 (0.42%) VPN
7 4 (0.34%) 802.11
7 4 (0.34%) Fibre Channel
7 4 (0.34%) Kerberos
7 4 (0.34%) LAN
7 4 (0.34%) SAN
7 4 (0.34%) SNMP
7 4 (0.34%) SSH
7 4 (0.34%) TCP/IP
7 4 (0.34%) Unified Communications
7 4 (0.34%) WAN
8 3 (0.25%) Software-Defined Networking
Database & Business Intelligence
1 395 (33.28%) Hadoop
2 192 (16.18%) NoSQL
3 188 (15.84%) Data Warehouse
4 119 (10.03%) Amazon Redshift
5 93 (7.83%) Tableau
6 91 (7.67%) Data Lake
7 87 (7.33%) Apache Hive
8 81 (6.82%) Relational Database
9 75 (6.32%) MongoDB
10 74 (6.23%) Power BI
11 73 (6.15%) BigQuery
12 68 (5.73%) Apache Cassandra
13 66 (5.56%) SQL Server
14 57 (4.80%) PostgreSQL
15 56 (4.72%) MySQL
16 51 (4.30%) Electronic Patient Records
17 47 (3.96%) Amazon Athena
18 46 (3.88%) Snowflake Schema
19 41 (3.45%) Neo4j
20 40 (3.37%) Data Mining
Development Applications
1 115 (9.69%) Jenkins
2 82 (6.91%) Git (software)
3 57 (4.80%) Atlassian Bamboo
4 55 (4.63%) JIRA
5 41 (3.45%) Vagrant
6 23 (1.94%) GitLab
6 23 (1.94%) TeamCity
7 21 (1.77%) Octopus Deploy
8 18 (1.52%) Bitbucket
9 13 (1.10%) Team Foundation Server
10 12 (1.01%) Maven
11 8 (0.67%) SonarQube
12 7 (0.59%) Sonatype Nexus
13 6 (0.51%) CircleCI
13 6 (0.51%) Gradle
13 6 (0.51%) Selenium
14 5 (0.42%) Cypress.io
14 5 (0.42%) ERwin
14 5 (0.42%) JMeter
14 5 (0.42%) JUnit
General
1 246 (20.72%) Finance
2 99 (8.34%) Banking
3 52 (4.38%) Marketing
4 45 (3.79%) Retail
4 45 (3.79%) Telecoms
5 44 (3.71%) Law
6 26 (2.19%) Games
7 24 (2.02%) Advertising
8 19 (1.60%) Legal
9 18 (1.52%) Public Sector
10 15 (1.26%) Front Office
10 15 (1.26%) Investment Banking
11 11 (0.93%) Local Government
12 9 (0.76%) Brand Awareness
13 8 (0.67%) Manufacturing
14 6 (0.51%) Financial Institution
15 5 (0.42%) Electronics
15 5 (0.42%) Pharmaceutical
16 4 (0.34%) Czech Language
17 2 (0.17%) Billing
Job Titles
1 281 (23.67%) Data Engineer
2 222 (18.70%) Developer
3 140 (11.79%) Architect
4 93 (7.83%) Big Data Engineer
5 89 (7.50%) Java Developer
6 82 (6.91%) Data Architect
7 81 (6.82%) Consultant
8 71 (5.98%) Software Engineer
9 68 (5.73%) Java Engineer
10 63 (5.31%) Senior Developer
11 59 (4.97%) Data Scientist
12 56 (4.72%) AWS Engineer
13 51 (4.30%) DevOps Engineer
14 48 (4.04%) Platform Engineer
15 45 (3.79%) Python Engineer
15 45 (3.79%) Senior Data Engineer
16 42 (3.54%) Analyst
17 40 (3.37%) Solutions Architect
18 36 (3.03%) Java Software Engineer
19 33 (2.78%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 243 (20.47%) Kafka
2 89 (7.50%) React
3 78 (6.57%) REST
4 73 (6.15%) Node.js
5 65 (5.48%) HTML
6 62 (5.22%) .NET
6 62 (5.22%) AngularJS
7 59 (4.97%) Web Services
8 55 (4.63%) CSS
9 52 (4.38%) Spark Streaming
10 45 (3.79%) Spring
11 43 (3.62%) Spring Boot
12 38 (3.20%) Natural Language Processing
12 38 (3.20%) NumPy
13 34 (2.86%) Redux
13 34 (2.86%) Velocity
14 32 (2.70%) GraphQL
15 31 (2.61%) XML
16 29 (2.44%) HTML5
17 26 (2.19%) RESTful
Miscellaneous
1 85 (7.16%) Analytical Skills
2 60 (5.05%) User Experience
3 59 (4.97%) Algorithms
4 49 (4.13%) Hedge funds
5 43 (3.62%) Data Structures
6 39 (3.29%) Hybrid Cloud
7 35 (2.95%) Linux Command Line
8 30 (2.53%) Self-Motivation
9 27 (2.27%) Cloud Native
9 27 (2.27%) Enterprise Software
10 26 (2.19%) Internet of Things
11 25 (2.11%) Data Centre
11 25 (2.11%) Greenfield Project
12 23 (1.94%) Public Cloud
13 22 (1.85%) Management Information System
14 16 (1.35%) Virtual Team
15 15 (1.26%) Equities
16 14 (1.18%) e-Learning
17 12 (1.01%) Market Risk
18 11 (0.93%) Private Cloud
Operating Systems
1 135 (11.37%) Linux
2 29 (2.44%) Unix
3 28 (2.36%) Red Hat Enterprise Linux
4 20 (1.68%) Windows
5 17 (1.43%) CentOS
6 7 (0.59%) Windows Server
7 6 (0.51%) Windows Server 2008
8 5 (0.42%) Ubuntu
9 3 (0.25%) Android
9 3 (0.25%) Oracle Linux
10 2 (0.17%) Debian
11 1 (0.084%) Fedora
Processes & Methodologies
1 514 (43.30%) Agile Software Development
2 464 (39.09%) Analytics
3 311 (26.20%) Data Science
4 309 (26.03%) DevOps
5 276 (23.25%) ETL
6 274 (23.08%) Machine Learning
7 273 (23.00%) Artificial Intelligence
8 261 (21.99%) Software Engineering
9 210 (17.69%) Microservices
10 205 (17.27%) Data Engineering
11 201 (16.93%) Business Intelligence
12 168 (14.15%) Data Analytics
13 149 (12.55%) Open Source
14 134 (11.29%) Visualisation
15 132 (11.12%) Continuous Integration
16 124 (10.45%) Data Modelling
17 120 (10.11%) Data Architecture
18 115 (9.69%) Computer Science
19 114 (9.60%) Scrum
20 113 (9.52%) Fintech
Programming Languages
1 586 (49.37%) Python
2 402 (33.87%) Java
3 386 (32.52%) SQL
4 158 (13.31%) Scala
5 115 (9.69%) JavaScript
6 89 (7.50%) C#
7 82 (6.91%) TypeScript
8 60 (5.05%) R
9 59 (4.97%) C
10 57 (4.80%) C++
11 49 (4.13%) Bash Shell
12 45 (3.79%) Go
12 45 (3.79%) PHP
13 38 (3.20%) Java 8
14 30 (2.53%) Perl
15 19 (1.60%) Kotlin
16 18 (1.52%) Cython
16 18 (1.52%) ES6
17 17 (1.43%) Shell Script
18 16 (1.35%) T-SQL
Qualifications
1 142 (11.96%) Degree
2 63 (5.31%) Security Cleared
3 53 (4.47%) Computer Science Degree
4 44 (3.71%) SC Cleared
5 28 (2.36%) PhD
6 27 (2.27%) DV Cleared
7 9 (0.76%) BPSS Clearance
8 7 (0.59%) Cisco Certification
8 7 (0.59%) CISSP
9 5 (0.42%) AWS Certification
9 5 (0.42%) Numerate Degree
10 4 (0.34%) (ISC)2 CCSP
11 3 (0.25%) CCNA
11 3 (0.25%) CompTIA Security+
11 3 (0.25%) Linux+ Certification
11 3 (0.25%) MCSE
11 3 (0.25%) Microsoft Certification
11 3 (0.25%) Network+ Certification
11 3 (0.25%) SANS
11 3 (0.25%) SSCP
Quality Assurance & Compliance
1 60 (5.05%) QA
2 52 (4.38%) Data Quality
3 17 (1.43%) GDPR
4 5 (0.42%) GRC
5 4 (0.34%) PMO
6 2 (0.17%) Dodd-Frank
6 2 (0.17%) EMIR
6 2 (0.17%) MiFID
6 2 (0.17%) Sarbanes-Oxley
7 1 (0.084%) ISO/IEC 15288
7 1 (0.084%) ISO/IEC 27001
7 1 (0.084%) SLA
System Software
1 288 (24.26%) Docker
2 39 (3.29%) VirtualBox
3 22 (1.85%) HDFS
4 13 (1.10%) VMware Infrastructure
5 11 (0.93%) Virtual Machines
6 10 (0.84%) Apache ZooKeeper
7 8 (0.67%) Active Directory
8 6 (0.51%) Oracle RAC
9 3 (0.25%) Apache Flume
10 2 (0.17%) NFS
11 1 (0.084%) Ceph
11 1 (0.084%) oVirt
11 1 (0.084%) Samba
11 1 (0.084%) VMware ESXi
11 1 (0.084%) Xen
Systems Management
1 321 (27.04%) Kubernetes
2 167 (14.07%) Terraform
3 145 (12.22%) Ansible
4 65 (5.48%) Puppet
5 47 (3.96%) Opscode Chef
6 41 (3.45%) Docker Swarm
7 28 (2.36%) Prometheus
8 26 (2.19%) Grafana
9 8 (0.67%) SCCM
10 7 (0.59%) ITRS Geneos
10 7 (0.59%) Nagios
11 6 (0.51%) Data Guard
11 6 (0.51%) Oracle RMAN
11 6 (0.51%) ZABBIX
12 5 (0.42%) Oozie
13 3 (0.25%) Kibana
14 2 (0.17%) Graphite
14 2 (0.17%) Hadoop YARN
14 2 (0.17%) Opsview
14 2 (0.17%) Salt
Vendors
1 209 (17.61%) Google
2 95 (8.00%) Oracle
3 89 (7.50%) Informatica
4 80 (6.74%) Cloudera
5 77 (6.49%) Talend
6 69 (5.81%) Microsoft
7 60 (5.05%) IBM
8 51 (4.30%) Databricks
9 44 (3.71%) Hortonworks
10 37 (3.12%) SAP
11 25 (2.11%) Red Hat
12 24 (2.02%) Salesforce.com
13 20 (1.68%) Splunk
14 19 (1.60%) Yahoo!
15 17 (1.43%) VMware
16 14 (1.18%) Twitter
17 10 (0.84%) Ab Initio
17 10 (0.84%) Alteryx
18 9 (0.76%) App Annie
19 8 (0.67%) Teradata