Period
to 29 July 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 29 July 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
29 Jul 2021
Same period 2020 Same period 2019
Rank 113 112 92
Rank change year-on-year -1 -20 -12
Permanent jobs citing Big Data 3,368 1,943 4,821
As % of all permanent jobs advertised in the UK 2.98% 2.82% 3.35%
As % of the Database & Business Intelligence category 10.63% 10.19% 12.04%
Number of salaries quoted 2,073 1,492 3,872
10th Percentile £45,000 £40,000 £35,250
25th Percentile £50,000 £48,750 £47,500
Median annual salary (50th Percentile) £70,000 £65,000 £67,500
Median % change year-on-year +7.69% -3.70% +8.00%
75th Percentile £88,750 £83,750 £87,500
90th Percentile £105,000 £103,750 £105,000
UK excluding London median annual salary £57,500 £57,500 £52,175
% change year-on-year - +10.21% -5.14%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 31,672 19,060 40,041
As % of all permanent IT jobs advertised in the UK 28.05% 27.62% 27.81%
Number of salaries quoted 21,204 15,650 33,146
10th Percentile £34,750 £32,500 £31,250
25th Percentile £42,500 £41,250 £37,500
Median annual salary (50th Percentile) £55,000 £55,000 £52,000
Median % change year-on-year - +5.77% +4.00%
75th Percentile £75,000 £72,500 £70,000
90th Percentile £92,500 £88,750 £85,000
UK excluding London median annual salary £48,500 £47,500 £45,000
% change year-on-year +2.11% +5.56% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 29 July 2021.

Salary histogram for Big Data in the UK

Big Data
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 29 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +1 3,016 £70,000 +3.70% 435
London +9 1,824 £80,000 +6.67% 270
UK excluding London -13 1,336 £57,500 - 189
Work from Home +23 611 £70,000 +7.69% 82
South East -29 435 £61,250 +2.08% 43
North of England +13 260 £55,000 -12.35% 41
South West -27 207 £55,500 -3.48% 26
Yorkshire +30 146 £55,000 - 16
Midlands -67 138 £57,500 +4.55% 30
West Midlands -30 108 £57,500 +4.55% 20
North West -44 107 £57,500 -12.21% 21
East of England -25 93 £80,000 +28.00% 20
Scotland -47 91 £50,000 -4.76% 15
Northern Ireland +12 54 £75,000 - 7
Wales -4 45 £45,000 -9.09% 7
East Midlands -67 30 £55,500 -26.00% 10
Isle of Man - 14 £37,500 -
North East -25 7 £90,000 +28.57% 4

For the 6 months to 29 July 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 1,492 (44.30%) Agile Software Development
2 1,491 (44.27%) AWS
3 1,470 (43.65%) Python
4 1,287 (38.21%) Analytics
5 1,269 (37.68%) Java
6 1,146 (34.03%) SQL
7 1,006 (29.87%) Azure
8 948 (28.15%) Docker
9 947 (28.12%) Artificial Intelligence
10 925 (27.46%) Software Engineering
11 878 (26.07%) Apache Spark
12 874 (25.95%) DevOps
13 862 (25.59%) GCP
14 826 (24.52%) Microservices
15 819 (24.32%) Machine Learning
16 789 (23.43%) Hadoop
17 780 (23.16%) Kubernetes
18 774 (22.98%) Data Science
19 709 (21.05%) Jenkins
20 686 (20.37%) Kafka
21 679 (20.16%) Finance
22 649 (19.27%) Social Skills
23 647 (19.21%) ETL
24 626 (18.59%) Open Source
25 601 (17.84%) Scrum
26 592 (17.58%) Degree
27 558 (16.57%) Data Pipeline
28 551 (16.36%) NoSQL
29 540 (16.03%) Business Intelligence
30 531 (15.77%) Terraform

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 878 (26.07%) Apache Spark
2 314 (9.32%) Apache
3 253 (7.51%) Apache Airflow
4 239 (7.10%) Elasticsearch
5 115 (3.41%) Confluence
6 108 (3.21%) GemFire
7 64 (1.90%) Cloud Foundry
8 53 (1.57%) Luigi
9 52 (1.54%) SAS
10 31 (0.92%) Apache Pig
10 31 (0.92%) IIS
11 23 (0.68%) Oracle SOA Suite
12 19 (0.56%) Oracle Workflow
13 15 (0.45%) SharePoint
14 12 (0.36%) Jupyter
15 10 (0.30%) Apache Synapse
16 9 (0.27%) Tomcat
17 8 (0.24%) OpenStack
18 7 (0.21%) WebLogic
19 6 (0.18%) CMS
Applications
1 49 (1.45%) Microsoft Excel
2 27 (0.80%) Microsoft Office
3 23 (0.68%) Figma
4 18 (0.53%) SPSS
5 12 (0.36%) Spreadsheet
6 10 (0.30%) Adobe Creative Suite
7 7 (0.21%) Microsoft PowerPoint
7 7 (0.21%) Sketch
8 6 (0.18%) Gephi
9 4 (0.12%) Adobe Illustrator
9 4 (0.12%) Chatbot
9 4 (0.12%) GIMP
9 4 (0.12%) Inkscape
9 4 (0.12%) Photoshop
10 3 (0.089%) GNU Octave
10 3 (0.089%) Weka
11 2 (0.059%) InfoPath
11 2 (0.059%) Microsoft Project
11 2 (0.059%) Stata
Business Applications
1 22 (0.65%) Dynamics CRM
2 16 (0.48%) Oracle ERP
3 12 (0.36%) IBM Planning Analytics
4 11 (0.33%) Sentinel
5 10 (0.30%) Primavera
6 9 (0.27%) HFM
6 9 (0.27%) Hyperion Planning
7 6 (0.18%) Distributed Ledger
7 6 (0.18%) Sparx Enterprise Architect
8 5 (0.15%) R3 Corda
9 4 (0.12%) Maximo
9 4 (0.12%) Oracle BPM
10 3 (0.089%) Oracle EBS
10 3 (0.089%) SAP Oil and Gas
10 3 (0.089%) Unica
11 2 (0.059%) Adobe Campaign
11 2 (0.059%) Oracle Procure-to-Pay
11 2 (0.059%) SAP R/3
11 2 (0.059%) SAP S/4HANA
11 2 (0.059%) WebTrends
Cloud Services
1 1,491 (44.27%) AWS
2 1,006 (29.87%) Azure
3 862 (25.59%) GCP
4 399 (11.85%) Serverless
5 334 (9.92%) GitHub
6 270 (8.02%) Power Platform
7 251 (7.45%) SaaS
8 203 (6.03%) Snowflake
9 192 (5.70%) Cloud Computing
10 164 (4.87%) PaaS
11 158 (4.69%) Amazon Kinesis
12 134 (3.98%) IaaS
13 127 (3.77%) Amazon S3
14 125 (3.71%) AWS Lambda
15 121 (3.59%) Amazon EMR
16 93 (2.76%) Amazon EC2
17 85 (2.52%) Azure Data Factory
18 71 (2.11%) AWS CloudFormation
19 69 (2.05%) Cloud Functions
20 66 (1.96%) IBM Cloud
Communications & Networking
1 97 (2.88%) Internet
2 87 (2.58%) Firewall
3 59 (1.75%) HTTP
4 35 (1.04%) DNS
4 35 (1.04%) SSL
5 31 (0.92%) VPN
6 19 (0.56%) Wireless
7 16 (0.48%) BGP
8 15 (0.45%) 5G
9 14 (0.42%) 4G
9 14 (0.42%) IPsec
10 12 (0.36%) Broadband
11 11 (0.33%) Network Security
12 9 (0.27%) LAN
12 9 (0.27%) SMTP
12 9 (0.27%) Sourcefire
12 9 (0.27%) Unified Communications
12 9 (0.27%) WAN
13 8 (0.24%) FTP
14 7 (0.21%) Intrusion Detection
Database & Business Intelligence
1 789 (23.43%) Hadoop
2 551 (16.36%) NoSQL
3 511 (15.17%) Data Warehouse
4 341 (10.12%) Relational Database
5 307 (9.12%) PostgreSQL
6 298 (8.85%) Data Lake
7 292 (8.67%) Amazon Redshift
8 263 (7.81%) Power BI
9 225 (6.68%) Tableau
10 222 (6.59%) MongoDB
11 215 (6.38%) BigQuery
12 210 (6.24%) HBase
13 206 (6.12%) Apache Hive
14 189 (5.61%) Redis
15 184 (5.46%) SQL Server
16 164 (4.87%) MySQL
17 150 (4.45%) MariaDB
18 139 (4.13%) Metadata
19 133 (3.95%) Apache Cassandra
20 107 (3.18%) Amazon Athena
Development Applications
1 709 (21.05%) Jenkins
2 358 (10.63%) Git (software)
3 208 (6.18%) JIRA
4 151 (4.48%) JUnit
5 139 (4.13%) Atlassian Bamboo
6 130 (3.86%) Gradle
7 126 (3.74%) Cypress.io
8 122 (3.62%) Cucumber
9 113 (3.36%) Sonatype Nexus
10 106 (3.15%) Protractor
11 105 (3.12%) Storybook
12 103 (3.06%) IntelliJ
13 101 (3.00%) Eclipse
14 93 (2.76%) Mockito
15 88 (2.61%) Vagrant
16 85 (2.52%) SonarQube
17 65 (1.93%) Artifactory
18 63 (1.87%) Bitbucket
19 52 (1.54%) Selenium
20 42 (1.25%) Team Foundation Server
General
1 679 (20.16%) Finance
2 649 (19.27%) Social Skills
3 364 (10.81%) Analytical Skills
4 302 (8.97%) Banking
5 215 (6.38%) Law
6 194 (5.76%) Retail
7 179 (5.31%) Inclusion and Diversity
8 141 (4.19%) Presentation Skills
9 120 (3.56%) Marketing
10 116 (3.44%) Legal
11 94 (2.79%) Telecoms
12 61 (1.81%) Games
13 59 (1.75%) Public Sector
14 56 (1.66%) Advertising
15 40 (1.19%) Influencing Skills
15 40 (1.19%) Manufacturing
15 40 (1.19%) Organisational Skills
16 33 (0.98%) Investment Banking
17 26 (0.77%) Financial Institution
18 25 (0.74%) Automotive
Job Titles
1 803 (23.84%) Developer
2 607 (18.02%) Data Engineer
3 452 (13.42%) Architect
4 425 (12.62%) Software Engineer
5 312 (9.26%) Java Developer
6 223 (6.62%) Data Architect
7 198 (5.88%) Big Data Engineer
8 173 (5.14%) Senior Developer
9 162 (4.81%) Analyst
10 153 (4.54%) Consultant
11 135 (4.01%) Senior Software Engineer
12 122 (3.62%) Java Engineer
13 121 (3.59%) Senior Data Engineer
13 121 (3.59%) Solutions Architect
14 117 (3.47%) Python Engineer
15 115 (3.41%) Lead Developer
16 95 (2.82%) AWS Engineer
17 91 (2.70%) Platform Engineer
18 89 (2.64%) DevOps Engineer
19 86 (2.55%) Data Analyst
Libraries, Frameworks & Software Standards
1 686 (20.37%) Kafka
2 435 (12.92%) Spring
3 408 (12.11%) React
4 382 (11.34%) Node.js
5 355 (10.54%) REST
6 280 (8.31%) AngularJS
7 265 (7.87%) Web Services
8 251 (7.45%) GraphQL
9 238 (7.07%) CSS
10 210 (6.24%) Spark Streaming
11 199 (5.91%) .NET
11 199 (5.91%) Middleware
11 199 (5.91%) RESTful
12 178 (5.29%) JSON
13 164 (4.87%) Redux
14 158 (4.69%) Hibernate
15 155 (4.60%) RabbitMQ
16 149 (4.42%) Spring Boot
17 141 (4.19%) HTML
18 138 (4.10%) JavaBeans
Miscellaneous
1 283 (8.40%) User Experience
2 195 (5.79%) Algorithms
3 149 (4.42%) Hybrid Cloud
3 149 (4.42%) Linux Command Line
3 149 (4.42%) Self-Motivation
4 138 (4.10%) Cloud Native
5 117 (3.47%) Data Structures
6 86 (2.55%) Cyberattack
7 85 (2.52%) Public Cloud
8 71 (2.11%) Hedge funds
9 62 (1.84%) Data Centre
10 51 (1.51%) Management Information System
11 46 (1.37%) Greenfield Project
11 46 (1.37%) Tandem
12 45 (1.34%) Legacy Systems
13 44 (1.31%) Virtual Team
14 43 (1.28%) Internet of Things
15 41 (1.22%) Enterprise Software
15 41 (1.22%) Robotics
16 29 (0.86%) Life Science
Operating Systems
1 433 (12.86%) Linux
2 189 (5.61%) Unix
3 69 (2.05%) Red Hat Enterprise Linux
4 52 (1.54%) Windows
5 50 (1.48%) CentOS
6 21 (0.62%) VMS
7 16 (0.48%) Fedora
8 12 (0.36%) Windows Server
9 8 (0.24%) Android
10 6 (0.18%) Apple iOS
11 5 (0.15%) Ubuntu
12 3 (0.089%) Windows 10
13 2 (0.059%) Mac OS
14 1 (0.030%) Debian
14 1 (0.030%) Mac OS X
14 1 (0.030%) Mesosphere
14 1 (0.030%) Solaris
14 1 (0.030%) Windows Server 2008
Processes & Methodologies
1 1,492 (44.30%) Agile Software Development
2 1,287 (38.21%) Analytics
3 947 (28.12%) Artificial Intelligence
4 925 (27.46%) Software Engineering
5 874 (25.95%) DevOps
6 826 (24.52%) Microservices
7 819 (24.32%) Machine Learning
8 774 (22.98%) Data Science
9 647 (19.21%) ETL
10 626 (18.59%) Open Source
11 601 (17.84%) Scrum
12 558 (16.57%) Data Pipeline
13 540 (16.03%) Business Intelligence
14 509 (15.11%) Continuous Integration
15 505 (14.99%) Computer Science
16 468 (13.90%) TDD
17 445 (13.21%) Problem-Solving
18 444 (13.18%) Data Analytics
19 435 (12.92%) Data Engineering
20 425 (12.62%) Data Modelling
Programming Languages
1 1,470 (43.65%) Python
2 1,269 (37.68%) Java
3 1,146 (34.03%) SQL
4 450 (13.36%) JavaScript
5 311 (9.23%) Scala
6 298 (8.85%) C#
7 222 (6.59%) Java 8
8 193 (5.73%) TypeScript
9 148 (4.39%) Go
10 137 (4.07%) C
11 136 (4.04%) Shell Script
12 130 (3.86%) C++
13 106 (3.15%) R
14 103 (3.06%) Groovy
15 84 (2.49%) PowerShell
16 81 (2.40%) Bash Shell
17 69 (2.05%) PHP
18 64 (1.90%) Ruby
19 42 (1.25%) Perl
19 42 (1.25%) T-SQL
Qualifications
1 592 (17.58%) Degree
2 290 (8.61%) Security Cleared
3 215 (6.38%) SC Cleared
4 149 (4.42%) Computer Science Degree
5 110 (3.27%) Oracle Certification
6 95 (2.82%) OCP
7 84 (2.49%) Numerate Degree
8 66 (1.96%) DV Cleared
9 53 (1.57%) PhD
10 32 (0.95%) Master's Degree
11 17 (0.50%) Microsoft Certification
12 15 (0.45%) AWS Certification
13 14 (0.42%) Cisco Certification
14 13 (0.39%) MCSE
15 11 (0.33%) CISSP
16 10 (0.30%) CCNA
17 9 (0.27%) ACCA
17 9 (0.27%) CIMA
17 9 (0.27%) GIAC
17 9 (0.27%) SANS
Quality Assurance & Compliance
1 168 (4.99%) Data Quality
2 143 (4.25%) QA
3 95 (2.82%) GDPR
4 36 (1.07%) Accessibility
5 10 (0.30%) SLA
6 7 (0.21%) GxP
7 5 (0.15%) PMO
8 4 (0.12%) NIST
8 4 (0.12%) Sarbanes-Oxley
8 4 (0.12%) WCAG
9 3 (0.089%) GRC
9 3 (0.089%) ISO/IEC 27001
9 3 (0.089%) PCI DSS
10 2 (0.059%) COBIT
10 2 (0.059%) MiFID
10 2 (0.059%) Solvency II
11 1 (0.030%) Actionable Recommendations
System Software
1 948 (28.15%) Docker
2 135 (4.01%) HDFS
3 92 (2.73%) VMware Infrastructure
4 71 (2.11%) VirtualBox
5 56 (1.66%) Active Directory
6 30 (0.89%) Apache ZooKeeper
7 21 (0.62%) Apache Flume
8 11 (0.33%) Virtual Machines
9 7 (0.21%) Ceph
10 6 (0.18%) Oracle RAC
10 6 (0.18%) VMware ESXi
11 3 (0.089%) KVM
12 2 (0.059%) Firmware
12 2 (0.059%) Hyper-V
12 2 (0.059%) NFS
12 2 (0.059%) Samba
12 2 (0.059%) vSphere
12 2 (0.059%) Xen
13 1 (0.030%) VMware NSX
Systems Management
1 780 (23.16%) Kubernetes
2 531 (15.77%) Terraform
3 475 (14.10%) Ansible
4 117 (3.47%) Puppet
5 114 (3.38%) Opscode Chef
6 102 (3.03%) Docker Swarm
7 85 (2.52%) Prometheus
8 78 (2.32%) Grafana
9 25 (0.74%) Hadoop YARN
10 23 (0.68%) SCCM
11 21 (0.62%) Salt
11 21 (0.62%) ZABBIX
12 20 (0.59%) Nagios
13 19 (0.56%) Consul
13 19 (0.56%) Graphite
13 19 (0.56%) Packer
14 18 (0.53%) Opsview
15 16 (0.48%) Oozie
16 12 (0.36%) ITRS Geneos
17 11 (0.33%) Kibana
Vendors
1 423 (12.56%) Google
2 226 (6.71%) Oracle
3 205 (6.09%) Microsoft
4 156 (4.63%) Databricks
5 132 (3.92%) VMware
6 126 (3.74%) Cloudera
7 120 (3.56%) Informatica
8 112 (3.33%) Talend
9 105 (3.12%) Okta
10 92 (2.73%) IBM
11 89 (2.64%) Hortonworks
12 69 (2.05%) SAP
13 53 (1.57%) Red Hat
14 45 (1.34%) Splunk
15 38 (1.13%) Yahoo!
16 31 (0.92%) Hyperion
17 28 (0.83%) Salesforce.com
18 25 (0.74%) Adobe
19 24 (0.71%) Cisco
20 20 (0.59%) Instagram