Period
to 13 April 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 13 April 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
13 Apr 2021
Same period 2020 Same period 2019
Rank 122 116 82
Rank change year-on-year -6 -34 +2
Permanent jobs citing Big Data 2,180 3,066 5,293
As % of all permanent jobs advertised in the UK 2.62% 2.69% 3.56%
As % of the Database & Business Intelligence category 9.95% 9.99% 12.50%
Number of salaries quoted 1,583 2,401 4,239
10th Percentile £42,500 £40,000 £35,000
25th Percentile £47,500 £50,000 £47,500
Median annual salary (50th Percentile) £65,000 £70,000 £67,500
Median % change year-on-year -7.14% +3.70% +3.85%
75th Percentile £85,000 £86,250 £87,500
90th Percentile £100,000 £110,000 £102,500
UK excluding London median annual salary £55,000 £55,000 £54,875
% change year-on-year - +0.23% -0.23%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 21,917 30,681 42,357
As % of all permanent IT jobs advertised in the UK 26.39% 26.95% 28.45%
Number of salaries quoted 17,685 25,311 35,070
10th Percentile £33,750 £32,500 £31,250
25th Percentile £41,250 £40,000 £37,500
Median annual salary (50th Percentile) £55,000 £52,500 £52,500
Median % change year-on-year +4.76% - +5.00%
75th Percentile £73,750 £72,500 £70,000
90th Percentile £88,750 £88,750 £85,000
UK excluding London median annual salary £48,500 £45,000 £45,000
% change year-on-year +7.78% - +5.88%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 13 April 2021.

Salary histogram for Big Data in the UK

Big Data
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 13 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -10 2,012 £65,000 -7.14% 401
London +8 1,189 £75,000 - 237
UK excluding London -11 869 £55,000 - 183
Work from Home -6 386 £65,000 -13.33% 71
South East -36 234 £59,249 -1.25% 37
North of England +32 215 £55,000 - 46
South West +35 209 £52,500 +5.00% 18
Yorkshire +59 141 £55,000 - 9
Midlands -52 83 £55,500 -7.50% 22
North West -16 66 £57,500 +9.52% 33
West Midlands +4 59 £57,500 +4.55% 15
Scotland -42 54 £49,000 -2.00% 19
East of England -4 50 £70,000 -6.67% 36
East Midlands -60 24 £55,500 -26.00% 7
Wales +30 18 £50,000 +17.65% 4
North East -5 8 £43,000 -21.35% 4
Northern Ireland +3 4 £63,750 +70.00% 2
Isle of Man - 3 £37,500 - 1

For the 6 months to 13 April 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 995 (45.64%) Python
2 977 (44.82%) AWS
3 923 (42.34%) Agile Software Development
4 832 (38.17%) Analytics
5 759 (34.82%) SQL
6 717 (32.89%) Java
7 686 (31.47%) Azure
8 576 (26.42%) Software Engineering
9 568 (26.06%) Hadoop
10 565 (25.92%) Machine Learning
11 564 (25.87%) Data Science
12 557 (25.55%) DevOps
13 551 (25.28%) Apache Spark
14 516 (23.67%) Artificial Intelligence
15 477 (21.88%) GCP
16 475 (21.79%) ETL
17 465 (21.33%) Docker
18 430 (19.72%) Kubernetes
19 405 (18.58%) Kafka
20 387 (17.75%) Business Intelligence
21 374 (17.16%) Data Engineering
22 362 (16.61%) Finance
23 358 (16.42%) Microservices
24 343 (15.73%) Data Warehouse
24 343 (15.73%) NoSQL
25 329 (15.09%) Degree
26 292 (13.39%) Scrum
27 286 (13.12%) JavaScript
27 286 (13.12%) Data Analytics
28 279 (12.80%) Google

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 551 (25.28%) Apache Spark
2 153 (7.02%) Apache Airflow
3 147 (6.74%) Apache
4 134 (6.15%) Elasticsearch
5 81 (3.72%) Confluence
6 66 (3.03%) SAS
7 55 (2.52%) Luigi
8 32 (1.47%) Apache Pig
9 25 (1.15%) Oracle SOA Suite
10 14 (0.64%) IIS
11 12 (0.55%) GemFire
11 12 (0.55%) Oracle Workflow
12 9 (0.41%) Moodle
13 8 (0.37%) Jupyter
13 8 (0.37%) OpenStack
14 7 (0.32%) SharePoint
14 7 (0.32%) Tornado
14 7 (0.32%) WebLogic
15 6 (0.28%) ArcGIS
15 6 (0.28%) GlassFish
Applications
1 21 (0.96%) Microsoft Excel
1 21 (0.96%) SPSS
2 9 (0.41%) Microsoft Office
3 8 (0.37%) Spreadsheet
4 6 (0.28%) Gephi
5 4 (0.18%) Figma
5 4 (0.18%) Microsoft PowerPoint
6 3 (0.14%) Adobe Illustrator
6 3 (0.14%) GIMP
6 3 (0.14%) Inkscape
6 3 (0.14%) Photoshop
7 1 (0.046%) Adobe Creative Suite
Business Applications
1 9 (0.41%) Dynamics CRM
1 9 (0.41%) HFM
1 9 (0.41%) Hyperion Planning
1 9 (0.41%) SAP CRM
1 9 (0.41%) Sparx Enterprise Architect
2 4 (0.18%) Oracle EBS
3 3 (0.14%) Oracle ERP
3 3 (0.14%) SAP S/4HANA
4 2 (0.092%) SAP ERP
4 2 (0.092%) SAP Hybris
4 2 (0.092%) Sentinel
5 1 (0.046%) SAP APO
5 1 (0.046%) SAP IS-U
Cloud Services
1 977 (44.82%) AWS
2 686 (31.47%) Azure
3 477 (21.88%) GCP
4 159 (7.29%) Power Platform
5 126 (5.78%) SaaS
6 119 (5.46%) Serverless
7 86 (3.94%) Cloud Computing
8 85 (3.90%) Amazon EMR
9 68 (3.12%) PaaS
10 61 (2.80%) AWS Lambda
11 53 (2.43%) Amazon S3
12 50 (2.29%) IaaS
13 46 (2.11%) Azure Data Factory
14 45 (2.06%) GitHub
15 43 (1.97%) Amazon Kinesis
16 42 (1.93%) IBM Cloud
17 37 (1.70%) Amazon EC2
17 37 (1.70%) AWS CloudFormation
18 29 (1.33%) Cloud Functions
19 19 (0.87%) Matillion
Communications & Networking
1 107 (4.91%) Internet
2 65 (2.98%) Firewall
3 22 (1.01%) HTTP
4 19 (0.87%) DNS
5 15 (0.69%) VPN
6 11 (0.50%) Unified Communications
7 10 (0.46%) SSL
8 9 (0.41%) Wireless
9 7 (0.32%) FTP
9 7 (0.32%) Intrusion Detection
9 7 (0.32%) SAN
10 6 (0.28%) Ethernet
10 6 (0.28%) Fibre Channel
10 6 (0.28%) IMAP
10 6 (0.28%) Kerberos
10 6 (0.28%) LAN
10 6 (0.28%) MPLS
10 6 (0.28%) Skype
10 6 (0.28%) SMTP
10 6 (0.28%) WAN
Database & Business Intelligence
1 568 (26.06%) Hadoop
2 343 (15.73%) Data Warehouse
2 343 (15.73%) NoSQL
3 200 (9.17%) Data Lake
4 170 (7.80%) Amazon Redshift
5 164 (7.52%) Tableau
6 159 (7.29%) Power BI
7 148 (6.79%) Apache Hive
8 147 (6.74%) Relational Database
9 136 (6.24%) SQL Server
10 117 (5.37%) MongoDB
11 115 (5.28%) PostgreSQL
12 109 (5.00%) BigQuery
13 99 (4.54%) MySQL
14 96 (4.40%) Apache Cassandra
15 76 (3.49%) Snowflake Schema
15 76 (3.49%) SQL Server Integration Services
16 75 (3.44%) Data Mining
17 72 (3.30%) HBase
18 71 (3.26%) Amazon Athena
Development Applications
1 214 (9.82%) Jenkins
2 158 (7.25%) Git (software)
3 132 (6.06%) JIRA
4 65 (2.98%) Atlassian Bamboo
5 50 (2.29%) Vagrant
6 31 (1.42%) Bitbucket
6 31 (1.42%) TeamCity
7 30 (1.38%) Maven
8 26 (1.19%) Cucumber
9 25 (1.15%) GitLab
10 23 (1.06%) Selenium
11 21 (0.96%) Octopus Deploy
12 20 (0.92%) Team Foundation Server
13 19 (0.87%) Eclipse
13 19 (0.87%) JUnit
13 19 (0.87%) SonarQube
14 18 (0.83%) Gradle
15 16 (0.73%) Cypress.io
15 16 (0.73%) Sonatype Nexus
16 11 (0.50%) IntelliJ
General
1 362 (16.61%) Finance
2 140 (6.42%) Banking
3 91 (4.17%) Legal
4 79 (3.62%) Marketing
5 75 (3.44%) Retail
6 66 (3.03%) Law
7 55 (2.52%) Public Sector
8 49 (2.25%) Telecoms
9 44 (2.02%) Games
10 32 (1.47%) Advertising
11 26 (1.19%) Local Government
12 23 (1.06%) Manufacturing
13 17 (0.78%) Investment Banking
14 15 (0.69%) Front Office
15 13 (0.60%) Aerospace
15 13 (0.60%) Electronics
15 13 (0.60%) Financial Institution
16 11 (0.50%) Pharmaceutical
17 10 (0.46%) French Language
17 10 (0.46%) Military
Job Titles
1 464 (21.28%) Data Engineer
2 399 (18.30%) Developer
3 254 (11.65%) Architect
4 242 (11.10%) Software Engineer
5 150 (6.88%) Consultant
6 146 (6.70%) Data Architect
7 139 (6.38%) Big Data Engineer
8 122 (5.60%) Java Developer
9 107 (4.91%) Analyst
10 102 (4.68%) Data Scientist
11 101 (4.63%) Senior Developer
12 92 (4.22%) Java Engineer
13 91 (4.17%) Senior Data Engineer
14 80 (3.67%) AWS Engineer
15 77 (3.53%) Solutions Architect
16 68 (3.12%) DevOps Engineer
17 63 (2.89%) Python Engineer
18 59 (2.71%) Platform Engineer
19 55 (2.52%) Java Software Engineer
20 54 (2.48%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 405 (18.58%) Kafka
2 184 (8.44%) Node.js
3 144 (6.61%) .NET
4 131 (6.01%) React
5 124 (5.69%) Web Services
6 114 (5.23%) HTML
7 108 (4.95%) REST
8 107 (4.91%) CSS
9 90 (4.13%) Spring
10 87 (3.99%) AngularJS
11 75 (3.44%) Spark Streaming
12 74 (3.39%) Apache NiFi
13 61 (2.80%) Spring Boot
14 57 (2.61%) HTML5
15 56 (2.57%) Natural Language Processing
16 55 (2.52%) Redux
17 52 (2.39%) RESTful
18 45 (2.06%) Velocity
19 44 (2.02%) RabbitMQ
20 43 (1.97%) XML
Miscellaneous
1 180 (8.26%) Analytical Skills
2 125 (5.73%) Algorithms
3 112 (5.14%) User Experience
4 69 (3.17%) Cyberattack
5 67 (3.07%) Data Structures
6 63 (2.89%) Cloud Native
6 63 (2.89%) Internet of Things
7 59 (2.71%) Linux Command Line
8 54 (2.48%) Self-Motivation
9 50 (2.29%) Hedge funds
10 48 (2.20%) Management Information System
11 45 (2.06%) Greenfield Project
12 42 (1.93%) Hybrid Cloud
13 40 (1.83%) Data Centre
14 36 (1.65%) Public Cloud
15 34 (1.56%) Enterprise Software
16 30 (1.38%) Life Science
17 23 (1.06%) Virtual Team
18 21 (0.96%) Mobile App
19 16 (0.73%) Robotics
Operating Systems
1 258 (11.83%) Linux
2 65 (2.98%) Red Hat Enterprise Linux
3 61 (2.80%) Unix
4 57 (2.61%) Windows
5 56 (2.57%) CentOS
6 16 (0.73%) Ubuntu
7 9 (0.41%) Windows Server
8 8 (0.37%) Android
9 7 (0.32%) Windows Server 2008
10 5 (0.23%) Apple iOS
10 5 (0.23%) Oracle Linux
11 3 (0.14%) Fedora
11 3 (0.14%) VMS
12 2 (0.092%) Debian
12 2 (0.092%) Solaris
13 1 (0.046%) Mesosphere
13 1 (0.046%) Windows 10
Processes & Methodologies
1 923 (42.34%) Agile Software Development
2 832 (38.17%) Analytics
3 576 (26.42%) Software Engineering
4 565 (25.92%) Machine Learning
5 564 (25.87%) Data Science
6 557 (25.55%) DevOps
7 516 (23.67%) Artificial Intelligence
8 475 (21.79%) ETL
9 387 (17.75%) Business Intelligence
10 374 (17.16%) Data Engineering
11 358 (16.42%) Microservices
12 292 (13.39%) Scrum
13 286 (13.12%) Data Analytics
14 264 (12.11%) Data Modelling
14 264 (12.11%) Open Source
15 241 (11.06%) Visualisation
16 212 (9.72%) Mathematics
17 197 (9.04%) Data Architecture
18 192 (8.81%) Computer Science
19 188 (8.62%) Mentoring
Programming Languages
1 995 (45.64%) Python
2 759 (34.82%) SQL
3 717 (32.89%) Java
4 286 (13.12%) JavaScript
5 232 (10.64%) C#
6 227 (10.41%) Scala
7 125 (5.73%) C
8 120 (5.50%) C++
9 117 (5.37%) R
10 95 (4.36%) TypeScript
11 83 (3.81%) Bash Shell
12 66 (3.03%) PHP
13 63 (2.89%) Go
14 54 (2.48%) Java 8
15 45 (2.06%) Perl
16 36 (1.65%) T-SQL
17 29 (1.33%) PowerShell
18 27 (1.24%) Shell Script
19 25 (1.15%) Ruby
20 21 (0.96%) PL/SQL
Qualifications
1 329 (15.09%) Degree
2 163 (7.48%) Security Cleared
3 103 (4.72%) SC Cleared
4 82 (3.76%) Computer Science Degree
5 81 (3.72%) DV Cleared
6 79 (3.62%) Numerate Degree
7 51 (2.34%) PhD
8 25 (1.15%) CISSP
9 17 (0.78%) Cisco Certification
9 17 (0.78%) Master's Degree
9 17 (0.78%) SSCP
10 10 (0.46%) Oracle Certification
11 9 (0.41%) ACCA
11 9 (0.41%) BPSS Clearance
11 9 (0.41%) CCNA
11 9 (0.41%) CIMA
11 9 (0.41%) CISM
11 9 (0.41%) MCSE
11 9 (0.41%) Microsoft Certification
12 8 (0.37%) (ISC)2 CCSP
Quality Assurance & Compliance
1 85 (3.90%) Data Quality
2 81 (3.72%) QA
3 37 (1.70%) GDPR
4 16 (0.73%) ISO/IEC 27001
5 15 (0.69%) NIST
6 14 (0.64%) NCSC
7 12 (0.55%) GRC
8 9 (0.41%) Cyber Essentials
8 9 (0.41%) PCI DSS
9 5 (0.23%) NIST 800
9 5 (0.23%) SLA
10 4 (0.18%) PMO
11 3 (0.14%) GPG13
11 3 (0.14%) WCAG
12 2 (0.092%) Dodd-Frank
12 2 (0.092%) EMIR
12 2 (0.092%) ISO/IEC 15288
12 2 (0.092%) MiFID
12 2 (0.092%) Sarbanes-Oxley
13 1 (0.046%) Actionable Recommendations
System Software
1 465 (21.33%) Docker
2 57 (2.61%) HDFS
3 45 (2.06%) VirtualBox
4 35 (1.61%) VMware Infrastructure
5 25 (1.15%) Apache ZooKeeper
6 19 (0.87%) Active Directory
7 14 (0.64%) Apache Flume
8 11 (0.50%) Virtual Machines
9 6 (0.28%) Oracle RAC
10 4 (0.18%) Firmware
10 4 (0.18%) VMware ESXi
11 3 (0.14%) NFS
12 2 (0.092%) Samba
12 2 (0.092%) vSphere
12 2 (0.092%) Xen
13 1 (0.046%) Ceph
13 1 (0.046%) oVirt
13 1 (0.046%) VMware NSX
Systems Management
1 430 (19.72%) Kubernetes
2 239 (10.96%) Ansible
3 219 (10.05%) Terraform
4 81 (3.72%) Puppet
5 65 (2.98%) Opscode Chef
6 51 (2.34%) Docker Swarm
7 32 (1.47%) Grafana
8 30 (1.38%) Prometheus
9 20 (0.92%) Hadoop YARN
10 19 (0.87%) Nagios
11 16 (0.73%) Oozie
12 13 (0.60%) Graphite
12 13 (0.60%) Opsview
12 13 (0.60%) ZABBIX
13 8 (0.37%) SCCM
14 7 (0.32%) ITRS Geneos
14 7 (0.32%) Kibana
14 7 (0.32%) Packer
15 6 (0.28%) Consul
15 6 (0.28%) Salt
Vendors
1 279 (12.80%) Google
2 211 (9.68%) Oracle
3 175 (8.03%) Microsoft
4 119 (5.46%) Databricks
5 110 (5.05%) Cloudera
6 107 (4.91%) Informatica
7 96 (4.40%) Talend
8 76 (3.49%) IBM
9 65 (2.98%) SAP
10 61 (2.80%) Red Hat
11 52 (2.39%) Hortonworks
12 51 (2.34%) VMware
13 30 (1.38%) Splunk
14 26 (1.19%) Salesforce.com
15 25 (1.15%) Yahoo!
16 19 (0.87%) Sparx
17 17 (0.78%) Teradata
18 16 (0.73%) Hyperion
19 14 (0.64%) Ab Initio
19 14 (0.64%) Twitter