Period
to 24 October 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 24 October 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
24 Oct 2021
Same period 2020 Same period 2019
Rank 122 107 93
Rank change year-on-year -15 -14 -10
Permanent jobs citing Big Data 3,571 1,492 4,469
As % of all permanent jobs advertised in the UK 2.84% 3.05% 3.27%
As % of the Database & Business Intelligence category 10.19% 10.64% 11.99%
Number of salaries quoted 2,048 1,193 3,610
10th Percentile £45,000 £41,250 £37,500
25th Percentile £53,750 £47,500 £47,500
Median annual salary (50th Percentile) £72,500 £65,000 £67,500
Median % change year-on-year +11.54% -3.70% +3.85%
75th Percentile £92,500 £82,500 £86,250
90th Percentile £107,500 £100,000 £105,000
UK excluding London median annual salary £60,750 £55,000 £52,500
% change year-on-year +10.45% +4.76% -4.55%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 35,029 14,022 37,259
As % of all permanent IT jobs advertised in the UK 27.86% 28.69% 27.28%
Number of salaries quoted 22,394 11,925 30,904
10th Percentile £35,000 £33,750 £31,250
25th Percentile £42,500 £42,000 £38,250
Median annual salary (50th Percentile) £57,500 £55,000 £52,500
Median % change year-on-year +4.55% +4.76% +5.00%
75th Percentile £77,500 £72,500 £70,000
90th Percentile £95,000 £88,750 £86,250
UK excluding London median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 24 October 2021.

Salary histogram for Big Data in the UK

Big Data
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 24 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -21 3,158 £75,000 +15.38% 390
London -4 1,913 £80,000 +10.34% 240
UK excluding London -40 1,391 £60,750 +10.45% 172
Work from Home +6 629 £72,500 +20.83% 82
South East -14 518 £67,500 +12.50% 44
North of England -59 240 £55,000 - 51
Midlands -68 159 £57,500 +4.55% 26
South West -63 135 £62,500 +8.70% 14
Yorkshire -30 126 £55,000 - 12
East of England -49 114 £72,500 +20.83% 13
West Midlands -45 112 £57,500 +4.55% 15
North West -66 108 £59,500 -15.00% 31
Scotland -39 106 £55,000 +4.76% 16
Northern Ireland +8 58 £75,000 - 2
Wales -34 52 £42,500 -15.00% 7
East Midlands -75 47 £65,000 -5.45% 11
Isle of Man +1 10 - -
North East -41 6 £56,914 +35.51% 8

For the 6 months to 24 October 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 1,619 (45.34%) Python
2 1,575 (44.11%) Analytics
3 1,555 (43.55%) AWS
4 1,503 (42.09%) Agile Software Development
5 1,366 (38.25%) Java
6 1,299 (36.38%) SQL
7 1,098 (30.75%) Azure
8 938 (26.27%) DevOps
9 936 (26.21%) Apache Spark
10 859 (24.05%) Microservices
11 844 (23.63%) GCP
12 839 (23.49%) Docker
13 834 (23.35%) Software Engineering
14 804 (22.51%) Data Science
15 803 (22.49%) Artificial Intelligence
16 784 (21.95%) Machine Learning
17 781 (21.87%) Hadoop
18 765 (21.42%) Social Skills
19 752 (21.06%) Kafka
20 719 (20.13%) Finance
21 707 (19.80%) ETL
22 685 (19.18%) Jenkins
23 671 (18.79%) Kubernetes
24 651 (18.23%) Degree
25 639 (17.89%) Business Intelligence
26 625 (17.50%) Scrum
27 613 (17.17%) NoSQL
28 612 (17.14%) Computer Science
29 592 (16.58%) Data Warehouse
30 582 (16.30%) Open Source

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 936 (26.21%) Apache Spark
2 343 (9.61%) Apache
3 225 (6.30%) Elasticsearch
4 221 (6.19%) Apache Airflow
5 117 (3.28%) GemFire
6 105 (2.94%) Confluence
7 70 (1.96%) Cloud Foundry
8 46 (1.29%) SAS
9 36 (1.01%) Jupyter
9 36 (1.01%) Luigi
10 32 (0.90%) IIS
11 30 (0.84%) Apache Pig
12 21 (0.59%) SharePoint
13 11 (0.31%) Apache Solr
14 10 (0.28%) Oracle SOA Suite
15 9 (0.25%) Oracle Workflow
16 8 (0.22%) Apache Synapse
16 8 (0.22%) OpenStack
17 7 (0.20%) CMS
17 7 (0.20%) Tomcat
Applications
1 50 (1.40%) Microsoft Excel
2 29 (0.81%) Figma
3 23 (0.64%) Microsoft Office
4 17 (0.48%) SPSS
5 14 (0.39%) Adobe Creative Suite
6 13 (0.36%) Sketch
7 9 (0.25%) Chatbot
8 5 (0.14%) InVision
9 4 (0.11%) InfoPath
9 4 (0.11%) Microsoft PowerPoint
9 4 (0.11%) Spreadsheet
10 3 (0.084%) GNU Octave
10 3 (0.084%) Weka
11 2 (0.056%) Microsoft Project
11 2 (0.056%) Simulink
11 2 (0.056%) Stata
12 1 (0.028%) MS Visio
12 1 (0.028%) OmniGraffle
Business Applications
1 18 (0.50%) Dynamics CRM
2 13 (0.36%) IBM Planning Analytics
2 13 (0.36%) Oracle ERP
3 10 (0.28%) Sentinel
4 8 (0.22%) Primavera
4 8 (0.22%) Unica
5 6 (0.17%) Distributed Ledger
6 5 (0.14%) R3 Corda
7 4 (0.11%) Maximo
7 4 (0.11%) NetSuite
7 4 (0.11%) Oracle BPM
8 3 (0.084%) Oracle EBS R12
8 3 (0.084%) SAP Oil and Gas
9 2 (0.056%) Adobe Campaign
9 2 (0.056%) Oracle EBS
9 2 (0.056%) Oracle Procure-to-Pay
9 2 (0.056%) SAP R/3
9 2 (0.056%) SAP S/4HANA
9 2 (0.056%) WebTrends
10 1 (0.028%) Eikon
Cloud Services
1 1,555 (43.55%) AWS
2 1,098 (30.75%) Azure
3 844 (23.63%) GCP
4 465 (13.02%) Serverless
5 408 (11.43%) GitHub
6 332 (9.30%) Power Platform
7 264 (7.39%) SaaS
8 221 (6.19%) Amazon Kinesis
9 192 (5.38%) PaaS
10 191 (5.35%) AWS Lambda
11 190 (5.32%) Cloud Computing
12 177 (4.96%) Azure Data Factory
13 171 (4.79%) Snowflake
14 167 (4.68%) Amazon S3
15 165 (4.62%) IaaS
16 149 (4.17%) Amazon EC2
17 119 (3.33%) Amazon EMR
18 102 (2.86%) AWS CloudFormation
19 96 (2.69%) Azure Synapse Analytics
20 80 (2.24%) Amazon SQS
Communications & Networking
1 64 (1.79%) Internet
2 60 (1.68%) HTTP
3 57 (1.60%) Firewall
4 35 (0.98%) Cisco IPT
5 34 (0.95%) SSL
6 27 (0.76%) DNS
7 26 (0.73%) VPN
8 25 (0.70%) Wireless
9 22 (0.62%) Broadband
10 16 (0.45%) BGP
11 15 (0.42%) 4G
12 14 (0.39%) IPsec
13 13 (0.36%) 5G
14 11 (0.31%) Network Security
15 9 (0.25%) LAN
15 9 (0.25%) WAN
16 8 (0.22%) Sourcefire
17 7 (0.20%) TCP/IP
18 6 (0.17%) SMS
19 5 (0.14%) FTP
Database & Business Intelligence
1 781 (21.87%) Hadoop
2 613 (17.17%) NoSQL
3 592 (16.58%) Data Warehouse
4 434 (12.15%) Data Lake
5 395 (11.06%) Relational Database
6 346 (9.69%) PostgreSQL
7 325 (9.10%) Power BI
8 320 (8.96%) MongoDB
9 268 (7.50%) Amazon Redshift
10 259 (7.25%) Apache Hive
11 251 (7.03%) Tableau
12 241 (6.75%) HBase
13 229 (6.41%) MySQL
14 221 (6.19%) Redis
15 215 (6.02%) BigQuery
16 210 (5.88%) SQL Server
17 180 (5.04%) Apache Cassandra
18 170 (4.76%) Amazon DynamoDB
19 167 (4.68%) Amazon RDS
20 166 (4.65%) MariaDB
Development Applications
1 685 (19.18%) Jenkins
2 417 (11.68%) Git (software)
3 209 (5.85%) JIRA
4 165 (4.62%) JUnit
5 150 (4.20%) Gradle
6 132 (3.70%) Cypress.io
7 128 (3.58%) Cucumber
8 120 (3.36%) Sonatype Nexus
9 116 (3.25%) Protractor
9 116 (3.25%) Storybook
10 115 (3.22%) IntelliJ
11 114 (3.19%) Eclipse
12 108 (3.02%) Mockito
13 90 (2.52%) Atlassian Bamboo
14 89 (2.49%) SonarQube
15 74 (2.07%) Artifactory
16 61 (1.71%) Bitbucket
17 51 (1.43%) Selenium
18 45 (1.26%) Maven
19 43 (1.20%) TeamCity
General
1 765 (21.42%) Social Skills
2 719 (20.13%) Finance
3 432 (12.10%) Analytical Skills
4 325 (9.10%) Banking
5 234 (6.55%) Inclusion and Diversity
6 232 (6.50%) Law
7 211 (5.91%) Retail
8 160 (4.48%) Presentation Skills
9 92 (2.58%) Marketing
10 81 (2.27%) Legal
11 79 (2.21%) Public Sector
12 70 (1.96%) Advertising
13 65 (1.82%) Telecoms
14 54 (1.51%) Games
15 45 (1.26%) Publishing
16 42 (1.18%) Automotive
17 39 (1.09%) Organisational Skills
18 38 (1.06%) Investment Banking
18 38 (1.06%) Pharmaceutical
19 33 (0.92%) Financial Institution
Job Titles
1 857 (24.00%) Developer
2 650 (18.20%) Data Engineer
3 457 (12.80%) Architect
4 426 (11.93%) Software Engineer
5 330 (9.24%) Java Developer
6 225 (6.30%) Data Architect
7 211 (5.91%) Senior Developer
8 199 (5.57%) Big Data Engineer
9 185 (5.18%) Analyst
10 136 (3.81%) Solutions Architect
11 128 (3.58%) Senior Software Engineer
12 121 (3.39%) Senior Data Engineer
13 115 (3.22%) Lead Developer
14 107 (3.00%) Python Engineer
15 106 (2.97%) Consultant
15 106 (2.97%) Data Scientist
16 95 (2.66%) Principal Engineer
17 92 (2.58%) Cloud Architect
17 92 (2.58%) Data Analyst
17 92 (2.58%) Java Engineer
Libraries, Frameworks & Software Standards
1 752 (21.06%) Kafka
2 498 (13.95%) Spring
3 407 (11.40%) React
4 400 (11.20%) Node.js
5 366 (10.25%) REST
6 292 (8.18%) Web Services
7 268 (7.50%) AngularJS
7 268 (7.50%) GraphQL
8 233 (6.52%) CSS
9 227 (6.36%) Middleware
10 208 (5.82%) RESTful
11 200 (5.60%) JSON
12 188 (5.26%) .NET
13 184 (5.15%) Hibernate
14 176 (4.93%) RabbitMQ
15 173 (4.84%) Redux
16 168 (4.70%) Spark Streaming
17 165 (4.62%) JavaBeans
18 161 (4.51%) Spring Boot
19 152 (4.26%) Express
Miscellaneous
1 278 (7.78%) User Experience
2 211 (5.91%) Algorithms
3 177 (4.96%) Self-Motivation
4 176 (4.93%) Cloud Native
5 143 (4.00%) Linux Command Line
6 137 (3.84%) Data Structures
7 123 (3.44%) Hybrid Cloud
8 118 (3.30%) Public Cloud
9 66 (1.85%) Management Information System
10 60 (1.68%) Cyberattack
11 58 (1.62%) Greenfield Project
11 58 (1.62%) Virtual Team
12 56 (1.57%) Data Centre
13 55 (1.54%) Tandem
14 45 (1.26%) Life Science
15 37 (1.04%) Enterprise Software
15 37 (1.04%) Social Media
16 29 (0.81%) Reference Data
16 29 (0.81%) Robotics
17 26 (0.73%) Hedge funds
Operating Systems
1 439 (12.29%) Linux
2 227 (6.36%) Unix
3 52 (1.46%) Windows
4 48 (1.34%) Red Hat Enterprise Linux
5 43 (1.20%) CentOS
6 39 (1.09%) VMS
7 15 (0.42%) Apple iOS
8 13 (0.36%) Fedora
9 12 (0.34%) Windows Server
10 5 (0.14%) Mac OS
11 4 (0.11%) Android
11 4 (0.11%) DC/OS
12 3 (0.084%) Mesosphere
13 2 (0.056%) Windows 10
14 1 (0.028%) Debian
14 1 (0.028%) Mac OS X
14 1 (0.028%) Ubuntu
Processes & Methodologies
1 1,575 (44.11%) Analytics
2 1,503 (42.09%) Agile Software Development
3 938 (26.27%) DevOps
4 859 (24.05%) Microservices
5 834 (23.35%) Software Engineering
6 804 (22.51%) Data Science
7 803 (22.49%) Artificial Intelligence
8 784 (21.95%) Machine Learning
9 707 (19.80%) ETL
10 639 (17.89%) Business Intelligence
11 625 (17.50%) Scrum
12 612 (17.14%) Computer Science
13 582 (16.30%) Open Source
14 558 (15.63%) Problem-Solving
15 555 (15.54%) Data Analytics
15 555 (15.54%) Data Pipeline
16 551 (15.43%) Continuous Integration
17 545 (15.26%) TDD
18 487 (13.64%) Data Modelling
19 403 (11.29%) Data Engineering
Programming Languages
1 1,619 (45.34%) Python
2 1,366 (38.25%) Java
3 1,299 (36.38%) SQL
4 413 (11.57%) JavaScript
5 369 (10.33%) Scala
6 343 (9.61%) C#
7 233 (6.52%) Java 8
8 203 (5.68%) PowerShell
9 186 (5.21%) TypeScript
10 158 (4.42%) Go
11 153 (4.28%) R
12 152 (4.26%) Shell Script
13 123 (3.44%) C++
14 119 (3.33%) Groovy
15 114 (3.19%) C
16 108 (3.02%) Bash Shell
17 63 (1.76%) PHP
18 60 (1.68%) Ruby
19 42 (1.18%) Perl
20 37 (1.04%) T-SQL
Qualifications
1 651 (18.23%) Degree
2 276 (7.73%) Security Cleared
3 234 (6.55%) SC Cleared
4 152 (4.26%) Computer Science Degree
5 118 (3.30%) Oracle Certification
6 108 (3.02%) OCP
7 63 (1.76%) Numerate Degree
8 48 (1.34%) AWS Certification
9 42 (1.18%) Master's Degree
10 39 (1.09%) Cisco Certification
11 37 (1.04%) CISSP
12 36 (1.01%) PhD
13 35 (0.98%) (ISC)2 CCSP
14 19 (0.53%) DV Cleared
15 15 (0.42%) CCSP
16 14 (0.39%) Microsoft Certification
17 9 (0.25%) BPSS Clearance
18 8 (0.22%) MCSA
18 8 (0.22%) TOGAF Certification
19 6 (0.17%) ISEB
Quality Assurance & Compliance
1 230 (6.44%) Data Quality
2 185 (5.18%) QA
3 87 (2.44%) GDPR
4 35 (0.98%) Accessibility
5 12 (0.34%) SLA
6 9 (0.25%) Actionable Recommendations
6 9 (0.25%) GxP
7 8 (0.22%) PMO
8 4 (0.11%) NIST
8 4 (0.11%) PCI DSS
9 3 (0.084%) Sarbanes-Oxley
10 2 (0.056%) ISO/IEC 27001
10 2 (0.056%) MiFID
10 2 (0.056%) Solvency II
11 1 (0.028%) COBIT
11 1 (0.028%) Cyber Essentials
11 1 (0.028%) IFRS
11 1 (0.028%) IFRS 9
11 1 (0.028%) ISO 20022
11 1 (0.028%) NCSC
System Software
1 839 (23.49%) Docker
2 143 (4.00%) HDFS
3 99 (2.77%) VMware Infrastructure
4 59 (1.65%) Active Directory
5 34 (0.95%) Apache ZooKeeper
6 26 (0.73%) VirtualBox
7 14 (0.39%) Virtual Machines
8 10 (0.28%) Apache Flume
9 5 (0.14%) Ceph
10 4 (0.11%) Hyper-V
11 3 (0.084%) Firmware
11 3 (0.084%) KVM
11 3 (0.084%) VMware ESXi
12 2 (0.056%) Virtual Desktop
Systems Management
1 671 (18.79%) Kubernetes
2 525 (14.70%) Terraform
3 402 (11.26%) Ansible
4 114 (3.19%) Opscode Chef
5 98 (2.74%) Puppet
6 75 (2.10%) Prometheus
7 57 (1.60%) Grafana
8 46 (1.29%) Docker Swarm
9 31 (0.87%) SCCM
10 23 (0.64%) Oozie
11 21 (0.59%) Hadoop YARN
12 16 (0.45%) Consul
13 11 (0.31%) Salt
14 10 (0.28%) Kibana
15 9 (0.25%) ITRS Geneos
16 8 (0.22%) Control-M
16 8 (0.22%) Graphite
16 8 (0.22%) Kubeflow
17 7 (0.20%) Packer
18 6 (0.17%) Opsview
Vendors
1 419 (11.73%) Google
2 271 (7.59%) Databricks
3 267 (7.48%) Microsoft
4 211 (5.91%) Oracle
5 132 (3.70%) VMware
6 128 (3.58%) Informatica
7 116 (3.25%) Okta
8 84 (2.35%) Cloudera
9 82 (2.30%) Talend
10 71 (1.99%) SAP
11 68 (1.90%) IBM
12 56 (1.57%) Hortonworks
13 43 (1.20%) Adobe
14 42 (1.18%) Red Hat
15 41 (1.15%) Palantir
16 38 (1.06%) Salesforce.com
17 34 (0.95%) Splunk
18 32 (0.90%) ServiceNow
18 32 (0.90%) StreamSets
19 29 (0.81%) Teradata