Period
to 26 January 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 26 January 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
26 Jan 2021
Same period 2020 Same period 2019
Rank 120 100 87
Rank change year-on-year -20 -13 +6
Permanent jobs citing Big Data 1,741 3,788 5,333
As % of all permanent jobs advertised in the UK 2.68% 3.06% 3.54%
As % of the Database & Business Intelligence category 9.78% 11.29% 12.28%
Number of salaries quoted 1,554 3,203 4,487
Median annual salary £65,000 £70,000 £67,500
Median salary % change year-on-year -7.14% +3.70% +8.00%
10th Percentile £41,250 £37,815 £38,000
90th Percentile £98,375 £110,000 £100,000
UK excluding London median annual salary £55,000 £55,000 £55,000

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 17,797 33,560 43,434
As % of all permanent IT jobs advertised in the UK 27.38% 27.09% 28.80%
Number of salaries quoted 14,924 27,761 36,084
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +9.38%
10th Percentile £33,750 £32,000 £31,250
90th Percentile £87,500 £88,750 £85,000
UK excluding London median annual salary £49,000 £45,000 £45,000
% change year-on-year +8.89% - +5.88%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 26 January 2021.

Salary histogram for Big Data in the UK

Big Data
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 26 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -22 1,590 £67,500 -3.57% 320
London -13 918 £75,000 -3.23% 180
UK excluding London -15 757 £55,000 - 158
Work from Home -25 272 £65,000 -10.34% 54
South East -1 213 £60,000 +9.09% 36
North of England +27 209 £55,000 +0.60% 51
South West -4 130 £52,500 +5.00% 14
Yorkshire +53 116 £55,000 - 15
Scotland -24 77 £52,500 +5.00% 13
North West +3 76 £70,000 +40.00% 33
Midlands -51 62 £55,500 -7.50% 25
East of England 0 37 £70,000 -6.67% 14
West Midlands +12 36 £60,000 +9.09% 15
Wales +42 26 £49,000 +18.79% 5
East Midlands -40 26 £55,000 -21.43% 10
North East -7 17 £43,000 -5.31% 3
Northern Ireland +9 2 £63,750 +82.14%
Isle of Man - 1 - -

For the 6 months to 26 January 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 806 (46.30%) Python
2 725 (41.64%) AWS
3 703 (40.38%) Agile Software Development
4 700 (40.21%) Analytics
5 663 (38.08%) Java
6 613 (35.21%) SQL
7 562 (32.28%) Azure
8 460 (26.42%) Hadoop
9 450 (25.85%) DevOps
10 424 (24.35%) Machine Learning
11 412 (23.66%) Apache Spark
12 390 (22.40%) Data Science
13 373 (21.42%) Software Engineering
14 349 (20.05%) ETL
15 332 (19.07%) Finance
16 301 (17.29%) GCP
17 289 (16.60%) NoSQL
17 289 (16.60%) Business Intelligence
18 285 (16.37%) Kafka
19 284 (16.31%) Artificial Intelligence
20 276 (15.85%) Data Analytics
21 275 (15.80%) Degree
22 270 (15.51%) JavaScript
23 269 (15.45%) Kubernetes
24 265 (15.22%) Data Warehouse
25 253 (14.53%) Microservices
26 249 (14.30%) Docker
27 227 (13.04%) Scrum
28 219 (12.58%) Scala
29 214 (12.29%) Data Lake

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 412 (23.66%) Apache Spark
2 141 (8.10%) Apache
3 108 (6.20%) Elasticsearch
4 76 (4.37%) SAS
5 74 (4.25%) Apache Airflow
6 39 (2.24%) Confluence
7 24 (1.38%) Luigi
8 17 (0.98%) Apache Pig
9 13 (0.75%) Tornado
10 11 (0.63%) Moodle
11 10 (0.57%) Jupyter
12 9 (0.52%) ArcGIS
12 9 (0.52%) nginx
13 7 (0.40%) Oracle SOA Suite
13 7 (0.40%) SharePoint
13 7 (0.40%) Tomcat
14 5 (0.29%) IIS
14 5 (0.29%) Oracle Workflow
15 4 (0.23%) GlassFish
15 4 (0.23%) OpenStack
Applications
1 18 (1.03%) SPSS
2 7 (0.40%) Microsoft Excel
3 1 (0.057%) Adobe Creative Suite
3 1 (0.057%) Figma
3 1 (0.057%) Microsoft Office
3 1 (0.057%) Microsoft PowerPoint
3 1 (0.057%) Microsoft Project
3 1 (0.057%) MS Visio
Business Applications
1 9 (0.52%) SAP CRM
2 8 (0.46%) Sentinel
3 6 (0.34%) Dynamics CRM
4 4 (0.23%) Sparx Enterprise Architect
5 3 (0.17%) Oracle EBS
5 3 (0.17%) SAP IS-U
5 3 (0.17%) SAP S/4HANA
6 2 (0.11%) SAP R/3
7 1 (0.057%) SAP APO
7 1 (0.057%) SAP ERP
7 1 (0.057%) SAP Hybris
Cloud Services
1 725 (41.64%) AWS
2 562 (32.28%) Azure
3 301 (17.29%) GCP
4 127 (7.29%) SaaS
5 124 (7.12%) Power Platform
6 78 (4.48%) PaaS
7 67 (3.85%) Serverless
8 56 (3.22%) GitHub
9 55 (3.16%) AWS Lambda
10 48 (2.76%) IaaS
11 42 (2.41%) Cloud Computing
12 39 (2.24%) Amazon EMR
13 32 (1.84%) Amazon EC2
14 31 (1.78%) AWS CloudFormation
14 31 (1.78%) Azure Data Factory
15 30 (1.72%) Amazon S3
16 24 (1.38%) Stackdriver
17 17 (0.98%) Amazon Kinesis
18 15 (0.86%) Dynamics 365
19 13 (0.75%) Amazon EKS
Communications & Networking
1 66 (3.79%) Internet
2 40 (2.30%) Firewall
3 18 (1.03%) HTTP
4 12 (0.69%) Skype
5 10 (0.57%) DNS
5 10 (0.57%) WAN
6 9 (0.52%) TCP/IP
6 9 (0.52%) VPN
7 8 (0.46%) SSL
8 7 (0.40%) Kerberos
8 7 (0.40%) LAN
8 7 (0.40%) SSH
9 6 (0.34%) Fibre Channel
9 6 (0.34%) SAN
9 6 (0.34%) Unified Communications
9 6 (0.34%) Wireless
10 5 (0.29%) DMZ
11 4 (0.23%) 5G
11 4 (0.23%) FTP
11 4 (0.23%) SNMP
Database & Business Intelligence
1 460 (26.42%) Hadoop
2 289 (16.60%) NoSQL
3 265 (15.22%) Data Warehouse
4 214 (12.29%) Data Lake
5 165 (9.48%) Apache Hive
6 131 (7.52%) MongoDB
7 124 (7.12%) Power BI
8 120 (6.89%) SQL Server
9 117 (6.72%) Tableau
10 114 (6.55%) PostgreSQL
11 112 (6.43%) Relational Database
12 106 (6.09%) Amazon Redshift
13 82 (4.71%) Apache Cassandra
14 77 (4.42%) MySQL
15 70 (4.02%) Snowflake Schema
16 66 (3.79%) BigQuery
17 61 (3.50%) Impala
18 58 (3.33%) HBase
19 57 (3.27%) Data Mining
20 54 (3.10%) BusinessObjects
Development Applications
1 154 (8.85%) Git (software)
2 96 (5.51%) Jenkins
3 77 (4.42%) JIRA
4 34 (1.95%) Gradle
5 32 (1.84%) Maven
6 21 (1.21%) TeamCity
7 20 (1.15%) Atlassian Bamboo
8 18 (1.03%) Selenium
9 17 (0.98%) GitLab
10 16 (0.92%) Cucumber
11 14 (0.80%) Bitbucket
12 12 (0.69%) SpecFlow
13 10 (0.57%) Eclipse
13 10 (0.57%) ERwin
13 10 (0.57%) Octopus Deploy
13 10 (0.57%) Team Foundation Server
13 10 (0.57%) webpack
14 9 (0.52%) JUnit
15 8 (0.46%) Oracle APEX
15 8 (0.46%) Visual Studio
General
1 332 (19.07%) Finance
2 137 (7.87%) Banking
3 67 (3.85%) Public Sector
4 56 (3.22%) Marketing
5 48 (2.76%) Law
5 48 (2.76%) Retail
6 42 (2.41%) Games
7 36 (2.07%) Legal
8 30 (1.72%) Telecoms
9 29 (1.67%) Advertising
10 24 (1.38%) Pharmaceutical
11 19 (1.09%) Local Government
12 16 (0.92%) Financial Institution
13 15 (0.86%) Front Office
14 11 (0.63%) Electronics
14 11 (0.63%) Investment Banking
14 11 (0.63%) Manufacturing
15 10 (0.57%) Military
16 9 (0.52%) Aerospace
17 7 (0.40%) Publishing
Job Titles
1 403 (23.15%) Developer
2 333 (19.13%) Data Engineer
3 209 (12.00%) Architect
4 180 (10.34%) Software Engineer
5 133 (7.64%) Java Developer
6 114 (6.55%) Senior Developer
7 109 (6.26%) Data Architect
8 104 (5.97%) Big Data Engineer
9 101 (5.80%) Data Scientist
10 98 (5.63%) Solutions Architect
11 96 (5.51%) Consultant
12 83 (4.77%) DevOps Engineer
13 82 (4.71%) Analyst
14 67 (3.85%) Java Engineer
15 55 (3.16%) AWS Engineer
16 49 (2.81%) Python Engineer
16 49 (2.81%) Senior Data Engineer
17 42 (2.41%) Software Developer
18 41 (2.35%) Business Analyst
19 38 (2.18%) Senior DevOps
Libraries, Frameworks & Software Standards
1 285 (16.37%) Kafka
2 147 (8.44%) Node.js
3 117 (6.72%) Spring
4 111 (6.38%) HTML
5 109 (6.26%) .NET
6 90 (5.17%) Web Services
7 81 (4.65%) CSS
8 68 (3.91%) React
9 67 (3.85%) REST
10 66 (3.79%) Spring Boot
11 62 (3.56%) Natural Language Processing
12 61 (3.50%) AngularJS
13 60 (3.45%) RabbitMQ
14 47 (2.70%) Apache NiFi
14 47 (2.70%) HTML5
14 47 (2.70%) RESTful
15 40 (2.30%) TensorFlow
16 35 (2.01%) Middleware
17 34 (1.95%) JSON
18 29 (1.67%) ActiveMQ
Miscellaneous
1 170 (9.76%) Analytical Skills
2 100 (5.74%) Algorithms
3 61 (3.50%) User Experience
4 55 (3.16%) Management Information System
5 54 (3.10%) Internet of Things
6 53 (3.04%) Cloud Native
7 51 (2.93%) Self-Motivation
8 42 (2.41%) Enterprise Software
8 42 (2.41%) Linux Command Line
9 41 (2.35%) Data Centre
10 39 (2.24%) Data Structures
11 38 (2.18%) Greenfield Project
12 33 (1.90%) Public Cloud
13 28 (1.61%) Mobile App
14 27 (1.55%) Cyberattack
15 21 (1.21%) Life Science
16 18 (1.03%) PKI
17 15 (0.86%) Social Media
18 13 (0.75%) Hybrid Cloud
18 13 (0.75%) Virtual Team
Operating Systems
1 202 (11.60%) Linux
2 88 (5.05%) Unix
3 64 (3.68%) Windows
4 41 (2.35%) Red Hat Enterprise Linux
5 36 (2.07%) CentOS
6 10 (0.57%) Ubuntu
6 10 (0.57%) Windows Server
7 9 (0.52%) Windows Server 2008
8 8 (0.46%) Windows Server 2016
9 6 (0.34%) Android
10 5 (0.29%) Apple iOS
10 5 (0.29%) Oracle Linux
11 4 (0.23%) Solaris
12 2 (0.11%) VMS
12 2 (0.11%) Windows Server 2012
13 1 (0.057%) Debian
13 1 (0.057%) Mac OS
13 1 (0.057%) Mesosphere
13 1 (0.057%) Windows Server 2019
Processes & Methodologies
1 703 (40.38%) Agile Software Development
2 700 (40.21%) Analytics
3 450 (25.85%) DevOps
4 424 (24.35%) Machine Learning
5 390 (22.40%) Data Science
6 373 (21.42%) Software Engineering
7 349 (20.05%) ETL
8 289 (16.60%) Business Intelligence
9 284 (16.31%) Artificial Intelligence
10 276 (15.85%) Data Analytics
11 253 (14.53%) Microservices
12 227 (13.04%) Scrum
13 200 (11.49%) Data Modelling
14 196 (11.26%) Data Engineering
15 179 (10.28%) Mathematics
16 173 (9.94%) Visualisation
17 150 (8.62%) Computer Science
18 141 (8.10%) Mentoring
19 135 (7.75%) Open Source
20 126 (7.24%) Data Architecture
Programming Languages
1 806 (46.30%) Python
2 663 (38.08%) Java
3 613 (35.21%) SQL
4 270 (15.51%) JavaScript
5 219 (12.58%) Scala
6 205 (11.77%) C#
7 145 (8.33%) R
8 94 (5.40%) Bash Shell
9 86 (4.94%) C++
10 82 (4.71%) C
11 48 (2.76%) Shell Script
12 46 (2.64%) Go
12 46 (2.64%) PL/SQL
12 46 (2.64%) TypeScript
13 45 (2.58%) PHP
14 39 (2.24%) Java 8
14 39 (2.24%) PowerShell
15 34 (1.95%) HiveQL
16 31 (1.78%) Perl
17 28 (1.61%) Ruby
Qualifications
1 275 (15.80%) Degree
2 144 (8.27%) Security Cleared
3 103 (5.92%) SC Cleared
4 78 (4.48%) Numerate Degree
5 56 (3.22%) Computer Science Degree
6 52 (2.99%) DV Cleared
7 33 (1.90%) PhD
8 26 (1.49%) BPSS Clearance
9 25 (1.44%) CISSP
10 17 (0.98%) Cisco Certification
11 14 (0.80%) (ISC)2 CCSP
12 12 (0.69%) Master's Degree
13 9 (0.52%) CISM
14 8 (0.46%) SSCP
15 7 (0.40%) AWS Certification
16 6 (0.34%) DBS Check
17 5 (0.29%) TOGAF Certification
18 4 (0.23%) Microsoft Certification
19 3 (0.17%) MCDBA
19 3 (0.17%) SAP Certification
Quality Assurance & Compliance
1 77 (4.42%) Data Quality
2 64 (3.68%) QA
3 26 (1.49%) GDPR
4 18 (1.03%) ISO/IEC 27001
5 15 (0.86%) NIST
6 14 (0.80%) NCSC
7 10 (0.57%) PCI DSS
8 9 (0.52%) SLA
9 8 (0.46%) Cyber Essentials
10 7 (0.40%) GPG13
11 6 (0.34%) NIST 800
12 4 (0.23%) PMO
13 3 (0.17%) MiFID
13 3 (0.17%) WCAG
14 2 (0.11%) Dodd-Frank
14 2 (0.11%) EMIR
14 2 (0.11%) ISO/IEC 15288
15 1 (0.057%) ISO 26262
System Software
1 249 (14.30%) Docker
2 76 (4.37%) HDFS
3 27 (1.55%) Apache ZooKeeper
4 25 (1.44%) VMware Infrastructure
5 18 (1.03%) Active Directory
6 16 (0.92%) Virtual Machines
7 5 (0.29%) Apache Flume
7 5 (0.29%) Firmware
8 4 (0.23%) VMware ESXi
9 3 (0.17%) Hyper-V
9 3 (0.17%) Varnish
10 1 (0.057%) NFS
10 1 (0.057%) Oracle RAC
10 1 (0.057%) oVirt
10 1 (0.057%) VirtualBox
10 1 (0.057%) vSphere
Systems Management
1 269 (15.45%) Kubernetes
2 147 (8.44%) Terraform
3 127 (7.29%) Ansible
4 55 (3.16%) Puppet
5 36 (2.07%) Opscode Chef
6 31 (1.78%) Grafana
7 19 (1.09%) Hadoop YARN
8 11 (0.63%) Nagios
8 11 (0.63%) Oozie
9 8 (0.46%) Istio
10 7 (0.40%) Graphite
10 7 (0.40%) Opsview
10 7 (0.40%) Prometheus
11 6 (0.34%) ZABBIX
12 4 (0.23%) Mesos
13 3 (0.17%) HAProxy
13 3 (0.17%) Kibana
13 3 (0.17%) Oracle ZFS
13 3 (0.17%) SCOM
14 2 (0.11%) Single Sign-On
Vendors
1 173 (9.94%) Microsoft
2 167 (9.59%) Google
3 154 (8.85%) Oracle
4 117 (6.72%) Databricks
5 82 (4.71%) Cloudera
5 82 (4.71%) Talend
6 81 (4.65%) Informatica
7 47 (2.70%) SAP
8 44 (2.53%) Red Hat
9 40 (2.30%) Splunk
10 36 (2.07%) IBM
11 34 (1.95%) VMware
12 32 (1.84%) Sparx
13 25 (1.44%) ServiceNow
14 18 (1.03%) Teradata
15 15 (0.86%) Xamarin
16 13 (0.75%) Salesforce.com
17 12 (0.69%) Solace
18 10 (0.57%) Ab Initio
19 7 (0.40%) Yahoo!