Period
to

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 23 May 2022 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
23 May 2022
Same period 2021 Same period 2020
Rank 106 125 115
Rank change year-on-year +19 -10 -26
Permanent jobs citing Big Data 5,301 2,493 2,583
As % of all permanent jobs advertised in the UK 3.25% 2.71% 2.78%
As % of the Database & Business Intelligence category 11.67% 10.26% 10.35%
Number of salaries quoted 1,868 1,771 1,992
10th Percentile £46,250 £42,500 £39,000
25th Percentile £60,000 £47,500 £50,000
Median annual salary (50th Percentile) £80,000 £65,000 £67,500
Median % change year-on-year +23.08% -3.70% -
75th Percentile £95,000 £86,250 £85,000
90th Percentile £110,000 £100,000 £110,000
UK excluding London median annual salary £69,925 £55,000 £55,000
% change year-on-year +27.14% - +4.76%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 45,412 24,304 24,961
As % of all permanent IT jobs advertised in the UK 27.86% 26.46% 26.86%
Number of salaries quoted 20,703 18,577 20,495
10th Percentile £36,250 £33,750 £32,500
25th Percentile £45,000 £41,250 £40,000
Median annual salary (50th Percentile) £60,000 £55,000 £52,500
Median % change year-on-year +9.09% +4.76% +5.00%
75th Percentile £80,000 £73,750 £72,500
90th Percentile £95,000 £88,750 £88,750
UK excluding London median annual salary £52,500 £47,500 £47,000
% change year-on-year +10.53% +1.06% +4.44%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 23 May 2022.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 23 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +20 4,504 £80,000 +20.75% 231
London -5 3,053 £82,500 +10.00% 133
Work from Home +8 2,102 £80,000 +14.29% 124
UK excluding London -18 1,465 £69,925 +27.14% 108
South East +23 505 £66,250 +13.25% 29
North of England -28 312 £70,000 +27.27% 30
South West -27 198 £70,000 +27.27% 20
East of England +11 179 £54,500 -27.33% 9
North West +1 172 £70,000 +21.74% 20
Midlands -29 127 £65,000 +13.04% 12
Scotland -12 123 £57,500 +21.05% 10
Yorkshire -55 122 £70,000 +27.27% 5
West Midlands -29 85 £70,000 +21.74% 5
East Midlands -4 41 £65,000 +19.27% 7
Wales -31 22 £66,250 +32.50% 2
North East -6 18 £48,872 -14.13% 5
Northern Ireland -22 6 £67,250 +5.49% 1

For the 6 months to 23 May 2022, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,742 (51.73%) Python
2 2,260 (42.63%) Agile
3 2,158 (40.71%) AWS
4 2,136 (40.29%) Analytics
5 1,865 (35.18%) Java
6 1,858 (35.05%) SQL
7 1,751 (33.03%) Data Science
8 1,505 (28.39%) Azure
9 1,388 (26.18%) Machine Learning
10 1,335 (25.18%) Social Skills
11 1,300 (24.52%) Apache Spark
12 1,281 (24.17%) Kubernetes
13 1,268 (23.92%) Finance
14 1,262 (23.81%) DevOps
15 1,196 (22.56%) CI/CD
16 1,164 (21.96%) Software Engineering
17 1,074 (20.26%) Kafka
18 1,073 (20.24%) GCP
19 1,059 (19.98%) Artificial Intelligence
20 1,031 (19.45%) ETL
21 1,004 (18.94%) Data Engineering
22 962 (18.15%) Microservices
23 960 (18.11%) Docker
24 957 (18.05%) Data Modelling
25 954 (18.00%) Hadoop
26 900 (16.98%) Degree
27 894 (16.86%) Data Pipeline
28 803 (15.15%) Computer Science
29 801 (15.11%) Business Intelligence
30 792 (14.94%) Data Warehouse

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,300 (24.52%) Apache Spark
2 417 (7.87%) Apache
3 400 (7.55%) Elasticsearch
4 388 (7.32%) Apache Airflow
5 160 (3.02%) Apache Solr
6 109 (2.06%) Confluence
7 75 (1.41%) SAS
8 61 (1.15%) Apache Pulsar
9 60 (1.13%) Luigi
10 48 (0.91%) OpenStack
11 47 (0.89%) Oracle Workflow
12 43 (0.81%) SharePoint
13 41 (0.77%) Jupyter
14 40 (0.75%) nginx
15 34 (0.64%) Apache Pig
16 33 (0.62%) IIS
17 15 (0.28%) Cloud Foundry
18 14 (0.26%) CMS
19 13 (0.25%) ColdFusion
19 13 (0.25%) Sitecore CMS
Applications
1 126 (2.38%) Microsoft Excel
2 28 (0.53%) Microsoft PowerPoint
3 25 (0.47%) Microsoft Office
4 22 (0.42%) SPSS
5 18 (0.34%) MS Visio
6 15 (0.28%) Spreadsheet
7 9 (0.17%) Adobe XD
7 9 (0.17%) Sketch
8 5 (0.094%) Microsoft Project
9 4 (0.075%) Chatbot
10 2 (0.038%) Adobe Illustrator
10 2 (0.038%) FileZilla
10 2 (0.038%) Photoshop
11 1 (0.019%) Adobe Premiere
11 1 (0.019%) Gephi
11 1 (0.019%) Stata
11 1 (0.019%) Zeplin
Business Applications
1 17 (0.32%) Oracle Payables
2 16 (0.30%) Avolution ABACUS
3 10 (0.19%) SAP S/4HANA
4 8 (0.15%) Dynamics CRM
5 3 (0.057%) Adobe Campaign
6 2 (0.038%) Oracle Financials
6 2 (0.038%) SAP CO
6 2 (0.038%) SAP FI
6 2 (0.038%) SAP FI/CO
7 1 (0.019%) assyst
7 1 (0.019%) Cognos Business Intelligence
7 1 (0.019%) Distributed Ledger
7 1 (0.019%) Dynamics NAV
7 1 (0.019%) ION MarketView
7 1 (0.019%) Maximo
7 1 (0.019%) SAP Oil and Gas
Cloud Services
1 2,158 (40.71%) AWS
2 1,505 (28.39%) Azure
3 1,073 (20.24%) GCP
4 506 (9.55%) Serverless
5 381 (7.19%) SaaS
6 380 (7.17%) Power Platform
7 291 (5.49%) Azure Data Factory
8 284 (5.36%) GitHub
9 266 (5.02%) AWS Lambda
10 257 (4.85%) Snowflake
11 231 (4.36%) Cloud Computing
12 212 (4.00%) Amazon S3
12 212 (4.00%) Azure Synapse Analytics
13 197 (3.72%) AWS CloudFormation
14 172 (3.24%) PaaS
15 171 (3.23%) Amazon EMR
16 161 (3.04%) Amazon Kinesis
17 158 (2.98%) Azure Cosmos DB
18 139 (2.62%) GitHub Actions
19 129 (2.43%) OpenShift
Communications & Networking
1 143 (2.70%) HTTP
2 132 (2.49%) Internet
3 89 (1.68%) TCP/IP
4 73 (1.38%) PPP
5 55 (1.04%) Cisco IPT
6 54 (1.02%) Firewall
7 48 (0.91%) VPN
8 46 (0.87%) SSL
9 45 (0.85%) Network Security
10 40 (0.75%) DHCP
11 36 (0.68%) IMAP
11 36 (0.68%) tcpdump
11 36 (0.68%) Wireshark
12 27 (0.51%) DNS
12 27 (0.51%) VoIP
13 26 (0.49%) Broadband
14 23 (0.43%) Wireless
15 16 (0.30%) IPsec
16 12 (0.23%) 5G
17 11 (0.21%) Unified Communications
Database & Business Intelligence
1 954 (18.00%) Hadoop
2 792 (14.94%) Data Warehouse
3 779 (14.70%) NoSQL
4 691 (13.04%) Data Lake
5 557 (10.51%) PostgreSQL
6 505 (9.53%) Relational Database
7 447 (8.43%) MongoDB
8 422 (7.96%) SQL Server
9 380 (7.17%) Power BI
10 341 (6.43%) Apache Hive
11 324 (6.11%) Redis
12 309 (5.83%) Apache Cassandra
13 305 (5.75%) Amazon Redshift
14 299 (5.64%) Tableau
15 291 (5.49%) MySQL
16 264 (4.98%) BigQuery
17 243 (4.58%) Metadata
18 226 (4.26%) HBase
19 192 (3.62%) Flink
20 188 (3.55%) RDBMS
Development Applications
1 664 (12.53%) Git (software)
2 369 (6.96%) Jenkins
3 239 (4.51%) JIRA
4 131 (2.47%) Selenium
5 120 (2.26%) JUnit
6 107 (2.02%) Maven
7 87 (1.64%) Octopus Deploy
7 87 (1.64%) TeamCity
8 84 (1.58%) Atlassian Bamboo
9 77 (1.45%) GitLab
10 75 (1.41%) CircleCI
11 56 (1.06%) Bitbucket
11 56 (1.06%) ERwin
12 49 (0.92%) Visual Studio
13 48 (0.91%) Zephyr
14 44 (0.83%) Subversion
15 41 (0.77%) JMeter
16 36 (0.68%) WebDriver
17 35 (0.66%) SQL Server Management Studio (SSMS)
18 33 (0.62%) RSpec
General
1 1,335 (25.18%) Social Skills
2 1,268 (23.92%) Finance
3 700 (13.21%) Analytical Skills
4 498 (9.39%) Retail
5 380 (7.17%) Marketing
6 339 (6.40%) Games
7 314 (5.92%) Inclusion and Diversity
8 255 (4.81%) Law
9 228 (4.30%) Banking
10 199 (3.75%) Public Sector
11 184 (3.47%) Presentation Skills
12 166 (3.13%) Advertising
13 134 (2.53%) Telecoms
14 128 (2.41%) Legal
15 117 (2.21%) Pharmaceutical
16 93 (1.75%) Influencing Skills
17 77 (1.45%) Financial Institution
18 56 (1.06%) Manufacturing
19 49 (0.92%) Publishing
20 38 (0.72%) Automotive
Job Titles
1 1,182 (22.30%) Data Engineer
2 804 (15.17%) Developer
3 799 (15.07%) Architect
4 608 (11.47%) Software Engineer
5 364 (6.87%) Java Developer
6 360 (6.79%) Senior Data Engineer
7 327 (6.17%) Senior Developer
8 320 (6.04%) Senior Software Engineer
9 306 (5.77%) Data Architect
10 274 (5.17%) Solutions Architect
11 254 (4.79%) Analyst
12 237 (4.47%) Big Data Engineer
13 209 (3.94%) Senior Java Developer
14 205 (3.87%) Data Scientist
15 199 (3.75%) Consultant
16 170 (3.21%) Data Manager
17 165 (3.11%) DevOps Engineer
18 154 (2.91%) Security Engineer
19 153 (2.89%) Cloud Engineer
20 129 (2.43%) Azure Engineer
Libraries, Frameworks & Software Standards
1 1,074 (20.26%) Kafka
2 450 (8.49%) React
3 442 (8.34%) Spring
4 362 (6.83%) .NET
5 300 (5.66%) REST
6 290 (5.47%) Node.js
7 263 (4.96%) HTML
8 259 (4.89%) Web Services
9 236 (4.45%) CSS
10 218 (4.11%) AngularJS
11 198 (3.74%) PySpark
12 189 (3.57%) RESTful
13 170 (3.21%) Spring Boot
14 157 (2.96%) JSON
15 141 (2.66%) RabbitMQ
16 139 (2.62%) Apache NiFi
17 133 (2.51%) Apache Beam
18 102 (1.92%) TensorFlow
19 100 (1.89%) GraphQL
20 97 (1.83%) Elastic Stack
Miscellaneous
1 597 (11.26%) Algorithms
2 396 (7.47%) Data Structures
3 311 (5.87%) Public Cloud
4 293 (5.53%) Social Media
5 276 (5.21%) IoT
6 252 (4.75%) Cloud Native
7 225 (4.24%) Hybrid Cloud
8 213 (4.02%) Blockchain
9 199 (3.75%) User Experience
10 177 (3.34%) Self-Motivation
11 162 (3.06%) Management Information System
12 154 (2.91%) Blog
13 135 (2.55%) Cyberattack
14 123 (2.32%) Cyber Defence
15 107 (2.02%) Social Network
16 100 (1.89%) Renewable Energy
17 90 (1.70%) Enterprise Software
17 90 (1.70%) Greenfield Project
18 84 (1.58%) Life Science
19 57 (1.08%) iPhone
Operating Systems
1 563 (10.62%) Linux
2 128 (2.41%) Unix
3 126 (2.38%) Windows
4 46 (0.87%) VMS
5 38 (0.72%) CentOS
6 19 (0.36%) Apple iOS
7 15 (0.28%) Android
8 14 (0.26%) Ubuntu
9 12 (0.23%) Red Hat Enterprise Linux
10 10 (0.19%) Mesosphere
11 9 (0.17%) Alpine Linux
11 9 (0.17%) Windows Server
12 8 (0.15%) Windows 10
13 1 (0.019%) Embedded Linux
13 1 (0.019%) Mac OS X
13 1 (0.019%) SUSE
Processes & Methodologies
1 2,260 (42.63%) Agile
2 2,136 (40.29%) Analytics
3 1,751 (33.03%) Data Science
4 1,388 (26.18%) Machine Learning
5 1,262 (23.81%) DevOps
6 1,196 (22.56%) CI/CD
7 1,164 (21.96%) Software Engineering
8 1,059 (19.98%) Artificial Intelligence
9 1,031 (19.45%) ETL
10 1,004 (18.94%) Data Engineering
11 962 (18.15%) Microservices
12 957 (18.05%) Data Modelling
13 894 (16.86%) Data Pipeline
14 803 (15.15%) Computer Science
15 801 (15.11%) Business Intelligence
16 752 (14.19%) Problem-Solving
17 712 (13.43%) Data Analytics
18 633 (11.94%) Mentoring
19 621 (11.71%) Data Management
20 617 (11.64%) TDD
Programming Languages
1 2,742 (51.73%) Python
2 1,865 (35.18%) Java
3 1,858 (35.05%) SQL
4 774 (14.60%) JavaScript
5 691 (13.04%) Scala
6 408 (7.70%) C#
7 298 (5.62%) R
8 297 (5.60%) PowerShell
9 294 (5.55%) Bash
10 217 (4.09%) TypeScript
11 199 (3.75%) Go
12 106 (2.00%) Ruby
13 102 (1.92%) C++
14 96 (1.81%) PHP
15 94 (1.77%) C
16 89 (1.68%) Shell Script
17 87 (1.64%) T-SQL
18 74 (1.40%) Kotlin
19 51 (0.96%) Apex Code
20 48 (0.91%) VBA
Qualifications
1 900 (16.98%) Degree
2 295 (5.56%) Computer Science Degree
3 186 (3.51%) Security Cleared
4 139 (2.62%) SC Cleared
5 136 (2.57%) AWS Certification
6 119 (2.24%) Master's Degree
7 67 (1.26%) PhD
8 62 (1.17%) CISSP
9 57 (1.08%) Cisco Certification
10 56 (1.06%) (ISC)2 CCSP
11 53 (1.00%) TOGAF Certification
12 47 (0.89%) Microsoft Certification
13 41 (0.77%) ISTQB
14 40 (0.75%) ISTQB Advanced Certification
14 40 (0.75%) ISTQB Foundation Certification
15 18 (0.34%) DV Cleared
15 18 (0.34%) Numerate Degree
15 18 (0.34%) PMI Certification
16 14 (0.26%) MBA
17 12 (0.23%) Sun Certification
Quality Assurance & Compliance
1 318 (6.00%) QA
2 311 (5.87%) Data Quality
3 95 (1.79%) GDPR
4 28 (0.53%) SLA
5 25 (0.47%) HIPAA
5 25 (0.47%) ISO/IEC 27001
6 20 (0.38%) Accessibility
7 15 (0.28%) PCI DSS
8 14 (0.26%) GRC
9 11 (0.21%) MiFID
10 10 (0.19%) COBIT
10 10 (0.19%) SEPA
11 9 (0.17%) EMIR
11 9 (0.17%) ISO 20022
11 9 (0.17%) NIST
12 8 (0.15%) GxP
13 7 (0.13%) PMO
14 6 (0.11%) GMP
15 5 (0.094%) SOC 2
16 4 (0.075%) Cyber Essentials
System Software
1 960 (18.11%) Docker
2 138 (2.60%) Apache ZooKeeper
3 63 (1.19%) Apache Flume
4 53 (1.00%) VMware Infrastructure
5 48 (0.91%) Active Directory
6 37 (0.70%) HDFS
7 29 (0.55%) Virtual Machines
8 17 (0.32%) Firmware
9 5 (0.094%) Virtual Desktop
10 4 (0.075%) KVM
11 3 (0.057%) zsh
12 1 (0.019%) vSphere
Systems Management
1 1,281 (24.17%) Kubernetes
2 543 (10.24%) Terraform
3 338 (6.38%) Ansible
4 151 (2.85%) Puppet
5 132 (2.49%) Opscode Chef
6 121 (2.28%) Prometheus
7 75 (1.41%) Oozie
8 68 (1.28%) SCCM
9 65 (1.23%) Grafana
10 39 (0.74%) Hadoop YARN
11 36 (0.68%) HP ALM
12 27 (0.51%) Kibana
13 24 (0.45%) Consul
13 24 (0.45%) HAProxy
14 13 (0.25%) Failover Clustering
14 13 (0.25%) logstash
15 12 (0.23%) Graylog
16 11 (0.21%) Salt
17 10 (0.19%) Automic
18 9 (0.17%) Istio
Vendors
1 643 (12.13%) Google
2 555 (10.47%) Databricks
3 469 (8.85%) Microsoft
4 345 (6.51%) Oracle
5 321 (6.06%) Twitter
6 143 (2.70%) Salesforce.com
7 124 (2.34%) Informatica
8 112 (2.11%) Talend
9 103 (1.94%) Splunk
10 99 (1.87%) Teradata
11 93 (1.75%) Cloudera
12 77 (1.45%) SAP
13 76 (1.43%) Sun
14 70 (1.32%) Cisco
15 60 (1.13%) Palantir
16 56 (1.06%) Atlassian
17 53 (1.00%) VMware
18 42 (0.79%) Brandwatch
19 37 (0.70%) HP
20 28 (0.53%) CA