Period
to 26 September 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 26 September 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
26 Sep 2020
Same period 2019 Same period 2018
Rank 99 93 78
Rank change year-on-year -6 -15 +22
Permanent jobs citing Big Data 1,521 4,629 6,444
As % of all permanent jobs advertised in the UK 3.16% 3.30% 3.85%
As % of the Database & Business Intelligence category 11.11% 12.18% 12.95%
Number of salaries quoted 1,303 3,988 4,596
Median annual salary £65,000 £67,500 £65,000
Median salary % change year-on-year -3.70% +3.85% +4.00%
10th Percentile £41,591 £37,500 £37,500
90th Percentile £101,250 £105,000 £95,000
UK excluding London median annual salary £57,500 £52,500 £55,000
% change year-on-year +9.52% -4.55% +4.76%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 13,688 37,997 49,743
As % of all permanent IT jobs advertised in the UK 28.41% 27.06% 29.71%
Number of salaries quoted 11,427 31,016 40,583
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +5.26%
10th Percentile £33,750 £31,250 £31,250
90th Percentile £90,000 £85,000 £82,500
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 26 September 2020.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 26 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -8 1,421 £67,500 -3.57% 244
London -22 779 £75,000 -3.23% 129
UK excluding London +22 729 £57,500 +9.52% 136
South East +61 239 £62,500 +13.64% 26
North of England +67 145 £55,000 +0.92% 37
Work from Home -54 117 £71,250 +1.79% 36
Midlands +48 104 £55,000 - 20
South West -26 96 £57,500 +15.00% 18
North West +51 92 £70,000 +27.27% 23
West Midlands +80 60 £55,000 - 7
East of England +40 57 £60,000 -7.69% 13
Scotland -7 56 £52,500 +16.67% 16
East Midlands +5 42 £68,750 +25.00% 13
Yorkshire +96 41 £55,000 +0.92% 10
Wales +41 31 £50,000 +25.00% 5
North East -7 12 £42,250 -14.69% 4
Northern Ireland +11 1 - - 1

For the 6 months to 26 September 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 669 (43.98%) Python
2 600 (39.45%) Agile Software Development
3 565 (37.15%) Java
4 539 (35.44%) Analytics
5 536 (35.24%) AWS
6 527 (34.65%) SQL
7 453 (29.78%) Hadoop
8 421 (27.68%) Azure
9 389 (25.58%) Apache Spark
10 380 (24.98%) DevOps
11 373 (24.52%) Finance
12 343 (22.55%) Machine Learning
13 324 (21.30%) Degree
14 311 (20.45%) Data Science
15 276 (18.15%) Business Intelligence
16 266 (17.49%) ETL
17 260 (17.09%) Kafka
18 242 (15.91%) JavaScript
19 240 (15.78%) Software Engineering
20 237 (15.58%) Artificial Intelligence
21 233 (15.32%) Scala
22 231 (15.19%) Data Lake
23 229 (15.06%) Kubernetes
24 222 (14.60%) Microservices
25 217 (14.27%) NoSQL
26 215 (14.14%) Data Warehouse
27 210 (13.81%) GCP
28 207 (13.61%) Data Modelling
29 198 (13.02%) Analytical Skills
30 197 (12.95%) Git (software)

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 389 (25.58%) Apache Spark
2 117 (7.69%) Apache
3 99 (6.51%) Elasticsearch
4 47 (3.09%) SAS
5 38 (2.50%) Apache Airflow
6 22 (1.45%) Confluence
7 17 (1.12%) Jupyter
8 12 (0.79%) Tomcat
9 11 (0.72%) CMS
9 11 (0.72%) Moodle
10 10 (0.66%) Luigi
11 9 (0.59%) Apache Pig
12 7 (0.46%) Cloud Foundry
12 7 (0.46%) nginx
13 5 (0.33%) JBoss
13 5 (0.33%) Mule
13 5 (0.33%) WebLogic
14 4 (0.26%) Apache Solr
14 4 (0.26%) IBM Domino
15 3 (0.20%) Apache Synapse
Applications
1 9 (0.59%) Microsoft Excel
1 9 (0.59%) MS Visio
2 6 (0.39%) Microsoft Office
2 6 (0.39%) Microsoft Project
3 3 (0.20%) Microsoft PowerPoint
Business Applications
1 12 (0.79%) Sparx Enterprise Architect
2 7 (0.46%) Sentinel
3 5 (0.33%) SAP IS-U
4 4 (0.26%) Eikon
4 4 (0.26%) SAP S/4HANA
5 2 (0.13%) NetSuite
5 2 (0.13%) Oracle Subledger Accounting
5 2 (0.13%) SAP R/3
6 1 (0.066%) Payment Gateway
6 1 (0.066%) Primavera
6 1 (0.066%) SAP BPC
6 1 (0.066%) SAP CO
6 1 (0.066%) SAP CRM
6 1 (0.066%) SAP ERP
6 1 (0.066%) SAP EWM
6 1 (0.066%) SAP FI
6 1 (0.066%) SAP FI/CO
6 1 (0.066%) SAP WM
6 1 (0.066%) Workday HCM
Cloud Services
1 536 (35.24%) AWS
2 421 (27.68%) Azure
3 210 (13.81%) GCP
4 172 (11.31%) Power Platform
5 127 (8.35%) SaaS
6 70 (4.60%) PaaS
7 64 (4.21%) IaaS
8 55 (3.62%) Amazon S3
9 54 (3.55%) Amazon EC2
9 54 (3.55%) Serverless
10 46 (3.02%) Amazon EMR
11 43 (2.83%) GitHub
12 32 (2.10%) Stackdriver
13 31 (2.04%) AWS Lambda
14 26 (1.71%) Azure Data Factory
15 25 (1.64%) Amazon Kinesis
15 25 (1.64%) Cloud Computing
16 23 (1.51%) Amazon SQS
17 18 (1.18%) AWS CloudFormation
17 18 (1.18%) Logic Apps
Communications & Networking
1 50 (3.29%) Internet
2 26 (1.71%) Firewall
3 22 (1.45%) Skype
4 18 (1.18%) HTTP
5 13 (0.85%) TCP/IP
6 12 (0.79%) SSL
7 10 (0.66%) FTP
8 8 (0.53%) 5G
8 8 (0.53%) SSH
9 7 (0.46%) WAN
10 6 (0.39%) BGP
10 6 (0.39%) Broadband
10 6 (0.39%) MPLS
11 4 (0.26%) DNS
12 3 (0.20%) AMQP
13 2 (0.13%) Kerberos
13 2 (0.13%) SAN
13 2 (0.13%) Unified Communications
14 1 (0.066%) LAN
14 1 (0.066%) VPN
Database & Business Intelligence
1 453 (29.78%) Hadoop
2 231 (15.19%) Data Lake
3 217 (14.27%) NoSQL
4 215 (14.14%) Data Warehouse
5 177 (11.64%) Apache Hive
6 172 (11.31%) Power BI
7 167 (10.98%) SQL Server
8 114 (7.50%) Relational Database
9 96 (6.31%) MongoDB
10 92 (6.05%) PostgreSQL
11 90 (5.92%) Amazon Redshift
12 84 (5.52%) SQL Server Integration Services
13 73 (4.80%) Apache Cassandra
14 72 (4.73%) HBase
14 72 (4.73%) Impala
15 69 (4.54%) MySQL
16 61 (4.01%) Data Mining
16 61 (4.01%) SQL Server Reporting Services
17 60 (3.94%) BigQuery
18 59 (3.88%) Snowflake Schema
Development Applications
1 197 (12.95%) Git (software)
2 86 (5.65%) Jenkins
3 40 (2.63%) Gradle
4 36 (2.37%) JIRA
5 23 (1.51%) Atlassian Bamboo
6 21 (1.38%) JUnit
7 20 (1.31%) Cucumber
7 20 (1.31%) GitLab
8 15 (0.99%) Subversion
8 15 (0.99%) TeamCity
9 14 (0.92%) Sonatype Nexus
10 12 (0.79%) ERwin
11 11 (0.72%) Artifactory
11 11 (0.72%) Maven
12 9 (0.59%) Octopus Deploy
12 9 (0.59%) Selenium
13 8 (0.53%) GoCD
13 8 (0.53%) Visual Studio Team System
14 7 (0.46%) ER Studio
15 6 (0.39%) Team Foundation Server
General
1 373 (24.52%) Finance
2 83 (5.46%) Banking
3 76 (5.00%) Marketing
4 65 (4.27%) Public Sector
5 39 (2.56%) Telecoms
6 36 (2.37%) Advertising
6 36 (2.37%) Pharmaceutical
7 32 (2.10%) Retail
8 31 (2.04%) Manufacturing
9 24 (1.58%) Front Office
9 24 (1.58%) Local Government
10 23 (1.51%) Legal
11 19 (1.25%) Electronics
12 17 (1.12%) Games
13 14 (0.92%) Financial Institution
13 14 (0.92%) Law
14 8 (0.53%) Investment Banking
15 6 (0.39%) Aerospace
15 6 (0.39%) Police
16 3 (0.20%) Publishing
Job Titles
1 393 (25.84%) Developer
2 339 (22.29%) Data Engineer
3 222 (14.60%) Architect
4 146 (9.60%) Java Developer
5 114 (7.50%) Solutions Architect
6 98 (6.44%) Big Data Engineer
7 95 (6.25%) Software Engineer
8 93 (6.11%) Senior Developer
9 91 (5.98%) Data Architect
9 91 (5.98%) Data Scientist
10 67 (4.40%) Senior Data Engineer
11 63 (4.14%) Python Engineer
12 61 (4.01%) Cloud Architect
13 56 (3.68%) AWS Engineer
13 56 (3.68%) Consultant
14 54 (3.55%) Analyst
15 52 (3.42%) DevOps Engineer
16 51 (3.35%) Cloud Solutions Architect
17 48 (3.16%) Senior Data Scientist
18 40 (2.63%) Big Data Architect
Libraries, Frameworks & Software Standards
1 260 (17.09%) Kafka
2 120 (7.89%) Spring
3 108 (7.10%) .NET
4 98 (6.44%) HTML
5 75 (4.93%) Node.js
6 72 (4.73%) AngularJS
7 68 (4.47%) CSS
8 65 (4.27%) React
9 61 (4.01%) Natural Language Processing
10 59 (3.88%) REST
11 51 (3.35%) HTML5
12 50 (3.29%) TensorFlow
13 48 (3.16%) Spring Boot
14 44 (2.89%) RabbitMQ
15 41 (2.70%) Web Services
16 40 (2.63%) Pandas
17 38 (2.50%) ASP.NET
18 35 (2.30%) NumPy
18 35 (2.30%) scikit-learn
19 33 (2.17%) PySpark
Miscellaneous
1 198 (13.02%) Analytical Skills
2 103 (6.77%) Algorithms
3 59 (3.88%) Management Information System
4 48 (3.16%) Internet of Things
5 45 (2.96%) Cloud Native
6 43 (2.83%) Enterprise Software
6 43 (2.83%) Self-Motivation
7 39 (2.56%) User Experience
8 31 (2.04%) Data Structures
9 27 (1.78%) Greenfield Project
9 27 (1.78%) Hybrid Cloud
10 26 (1.71%) Equities
11 25 (1.64%) Data Centre
12 22 (1.45%) Hedge funds
12 22 (1.45%) PKI
12 22 (1.45%) Virtual Team
13 21 (1.38%) Public Cloud
14 20 (1.31%) Mobile App
15 18 (1.18%) Linux Command Line
16 16 (1.05%) FMCG
Operating Systems
1 168 (11.05%) Linux
2 87 (5.72%) Unix
3 67 (4.40%) Windows
4 14 (0.92%) Red Hat Enterprise Linux
5 13 (0.85%) CentOS
6 9 (0.59%) Windows Server 2016
7 5 (0.33%) Apple iOS
7 5 (0.33%) Windows Server
8 4 (0.26%) Debian
8 4 (0.26%) Solaris
9 3 (0.20%) Android
9 3 (0.20%) Windows Server 2008
10 2 (0.13%) Mac OS
10 2 (0.13%) Robot Operating System
10 2 (0.13%) Ubuntu
10 2 (0.13%) Windows Server 2012
11 1 (0.066%) Windows Server 2019
Processes & Methodologies
1 600 (39.45%) Agile Software Development
2 539 (35.44%) Analytics
3 380 (24.98%) DevOps
4 343 (22.55%) Machine Learning
5 311 (20.45%) Data Science
6 276 (18.15%) Business Intelligence
7 266 (17.49%) ETL
8 240 (15.78%) Software Engineering
9 237 (15.58%) Artificial Intelligence
10 222 (14.60%) Microservices
11 207 (13.61%) Data Modelling
12 195 (12.82%) Scrum
13 193 (12.69%) Data Analytics
14 173 (11.37%) Computer Science
15 155 (10.19%) Mathematics
16 149 (9.80%) Visualisation
17 127 (8.35%) Data Engineering
18 120 (7.89%) Problem-Solving
19 116 (7.63%) Cybersecurity
20 101 (6.64%) Mentoring
Programming Languages
1 669 (43.98%) Python
2 565 (37.15%) Java
3 527 (34.65%) SQL
4 242 (15.91%) JavaScript
5 233 (15.32%) Scala
6 173 (11.37%) R
7 140 (9.20%) C#
8 75 (4.93%) C++
9 55 (3.62%) PHP
10 52 (3.42%) PL/SQL
10 52 (3.42%) Shell Script
11 50 (3.29%) Go
12 49 (3.22%) Bash Shell
13 48 (3.16%) C
14 44 (2.89%) T-SQL
15 42 (2.76%) PowerShell
16 41 (2.70%) Java 8
17 39 (2.56%) HiveQL
18 35 (2.30%) Ruby
19 30 (1.97%) Perl
Qualifications
1 324 (21.30%) Degree
2 149 (9.80%) Security Cleared
3 98 (6.44%) Computer Science Degree
4 69 (4.54%) DV Cleared
5 67 (4.40%) SC Cleared
6 34 (2.24%) PhD
7 33 (2.17%) Numerate Degree
8 31 (2.04%) Master's Degree
9 28 (1.84%) BPSS Clearance
10 13 (0.85%) AWS Certification
11 10 (0.66%) Cisco Certification
11 10 (0.66%) PMI Certification
12 9 (0.59%) Microsoft Certification
13 7 (0.46%) CISSP
14 6 (0.39%) CCNP
14 6 (0.39%) JNCIP
14 6 (0.39%) JNCIS
15 5 (0.33%) CCNA
15 5 (0.33%) ISEB
15 5 (0.33%) JNCIA
Quality Assurance & Compliance
1 78 (5.13%) Data Quality
2 38 (2.50%) QA
3 28 (1.84%) GDPR
4 23 (1.51%) NIST
5 15 (0.99%) ISO/IEC 27001
6 12 (0.79%) NCSC
6 12 (0.79%) NIST 800
7 8 (0.53%) SLA
8 7 (0.46%) Sarbanes-Oxley
9 4 (0.26%) GPG13
10 3 (0.20%) PCI DSS
11 1 (0.066%) IFRS
11 1 (0.066%) IFRS 9
11 1 (0.066%) ISO 26262
11 1 (0.066%) MiFID
11 1 (0.066%) PMO
11 1 (0.066%) WCAG
System Software
1 187 (12.29%) Docker
2 87 (5.72%) HDFS
3 24 (1.58%) Active Directory
4 19 (1.25%) VMware Infrastructure
5 18 (1.18%) Apache ZooKeeper
6 11 (0.72%) Hyper-V
6 11 (0.72%) Virtual Machines
7 7 (0.46%) Apache Flume
8 5 (0.33%) Varnish
9 4 (0.26%) VMware ESXi
10 3 (0.20%) VirtualBox
11 2 (0.13%) vCloud
11 2 (0.13%) vSphere
12 1 (0.066%) Oracle RAC
12 1 (0.066%) Virtual Servers
Systems Management
1 229 (15.06%) Kubernetes
2 108 (7.10%) Terraform
3 73 (4.80%) Ansible
4 30 (1.97%) Grafana
5 26 (1.71%) Puppet
6 20 (1.31%) Hadoop YARN
7 18 (1.18%) Kibana
8 14 (0.92%) Opscode Chef
9 12 (0.79%) Netcool
9 12 (0.79%) Opsview
10 8 (0.53%) Oozie
11 7 (0.46%) Istio
12 4 (0.26%) Mesos
12 4 (0.26%) Nagios
12 4 (0.26%) Prometheus
13 3 (0.20%) logstash
13 3 (0.20%) SCCM
13 3 (0.20%) SCOM
14 2 (0.13%) Marathon
14 2 (0.13%) ZABBIX
Vendors
1 173 (11.37%) Microsoft
2 118 (7.76%) Google
3 114 (7.50%) Oracle
4 98 (6.44%) Tableau
5 97 (6.38%) Databricks
6 87 (5.72%) Cloudera
7 71 (4.67%) Talend
8 70 (4.60%) Informatica
9 60 (3.94%) Splunk
10 54 (3.55%) Sparx
11 40 (2.63%) SAP
12 33 (2.17%) ServiceNow
12 33 (2.17%) Teradata
13 26 (1.71%) VMware
14 22 (1.45%) IBM
15 20 (1.31%) Ab Initio
15 20 (1.31%) Hortonworks
16 14 (0.92%) AppDynamics
16 14 (0.92%) Red Hat
17 12 (0.79%) TOWER Software