Period
to 28 March 2020

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 March 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK > UK excluding London
6 months to
28 Mar 2020
Same period 2019 Same period 2018
Rank 149 128 141
Rank change year-on-year -21 +13 +1
Permanent jobs citing Big Data 1,410 2,218 2,512
As % of all permanent jobs advertised in the UK excluding London 2.12% 2.66% 2.45%
As % of the Database & Business Intelligence category 8.07% 9.57% 7.93%
Number of salaries quoted 1,141 1,742 2,151
Median annual salary £55,000 £55,000 £55,000
10th Percentile £33,750 £31,250 £32,500
90th Percentile £85,000 £85,000 £80,000
UK median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 17,463 23,178 31,681
As % of all permanent IT jobs advertised in the UK excluding London 26.25% 27.85% 30.92%
Number of salaries quoted 14,312 18,947 26,803
Median annual salary £45,000 £45,000 £42,500
Median salary % change year-on-year - +5.88% -
10th Percentile £30,000 £28,750 £27,500
90th Percentile £70,000 £68,750 £63,750
UK median annual salary £52,500 £52,500 £50,000
% change year-on-year - +5.00% +5.26%

Big Data
Job Vacancy Trend in the UK excluding London

Job postings citing Big Data as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Big Data in the UK excluding London

Big Data
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Big Data in the UK excluding London.

Salary trend for Big Data in the UK excluding London

Big Data
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Big Data in the UK excluding London over the 6 months to 28 March 2020.

Salary histogram for Big Data in the UK excluding London

Big Data
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK excluding London region over the 6 months to 28 March 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East -7 493 £57,500 +4.55% 90
North of England -18 240 £54,671 +9.34% 50
Midlands +13 194 £60,000 +34.08% 29
South West -57 180 £50,000 -9.09% 37
Scotland -13 145 £50,000 +17.65% 21
North West -44 132 £52,500 -4.55% 27
East of England +8 131 £75,000 +15.38% 36
East Midlands +28 119 £73,750 +40.48% 10
Yorkshire +19 80 £55,000 +10.00% 15
West Midlands -21 75 £55,000 +46.67% 19
North East -7 28 £54,671 +10.81% 8
Wales -24 25 £40,000 -3.61% 11
Northern Ireland +13 4 £37,500 -11.76% 1
Big Data
UK

For the 6 months to 28 March 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Big Data.

1 609 (43.19%) Agile Software Development
2 513 (36.38%) Analytics
3 506 (35.89%) Python
4 475 (33.69%) SQL
5 471 (33.40%) Java
6 416 (29.50%) Hadoop
7 363 (25.74%) Apache Spark
8 347 (24.61%) Machine Learning
9 326 (23.12%) AWS
10 323 (22.91%) Azure
11 307 (21.77%) Degree
12 292 (20.71%) Business Intelligence
13 281 (19.93%) Software Engineering
14 265 (18.79%) Data Science
15 259 (18.37%) DevOps
16 253 (17.94%) Finance
17 235 (16.67%) Artificial Intelligence
17 235 (16.67%) Analytical Skills
18 229 (16.24%) JavaScript
19 220 (15.60%) Linux
20 217 (15.39%) Data Warehouse
21 201 (14.26%) C#
22 199 (14.11%) ETL
23 196 (13.90%) Data Analytics
24 195 (13.83%) Data Modelling
25 174 (12.34%) Scala
26 172 (12.20%) Kafka
27 170 (12.06%) Git (software)
28 166 (11.77%) Apache Hive
29 161 (11.42%) Computer Science

Big Data
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 363 (25.74%) Apache Spark
2 116 (8.23%) Elasticsearch
3 71 (5.04%) Apache
4 28 (1.99%) Apache Solr
5 23 (1.63%) SAS
6 17 (1.21%) OpenStack
7 15 (1.06%) Jupyter
8 12 (0.85%) Confluence
9 11 (0.78%) ArcGIS
10 10 (0.71%) Tornado
11 9 (0.64%) Tomcat
12 8 (0.57%) NServiceBus
12 8 (0.57%) SharePoint
13 6 (0.43%) Apache Pig
14 5 (0.35%) Mule
14 5 (0.35%) WebLogic
15 4 (0.28%) Apache Airflow
15 4 (0.28%) nginx
16 2 (0.14%) CMS
16 2 (0.14%) Oracle SOA Suite
Applications
1 21 (1.49%) Microsoft Excel
2 11 (0.78%) SPSS
3 6 (0.43%) MS Visio
4 5 (0.35%) Microsoft Office
4 5 (0.35%) Microsoft PowerPoint
4 5 (0.35%) Microsoft Project
5 4 (0.28%) Chatbot
6 2 (0.14%) Gephi
Business Applications
1 6 (0.43%) Sparx Enterprise Architect
2 4 (0.28%) SAP CRM
2 4 (0.28%) SAP ERP
2 4 (0.28%) SAP IS-U
3 3 (0.21%) Oracle Subledger Accounting
3 3 (0.21%) SAP S/4HANA
4 2 (0.14%) Oracle Financials
4 2 (0.14%) SAP HCM
4 2 (0.14%) SAP IBP
4 2 (0.14%) SAP Payroll
5 1 (0.071%) NetSuite
5 1 (0.071%) Oracle BPM
Cloud Services
1 326 (23.12%) AWS
2 323 (22.91%) Azure
3 119 (8.44%) Power Platform
4 117 (8.30%) GCP
5 61 (4.33%) SaaS
6 40 (2.84%) Serverless
7 29 (2.06%) Amazon S3
8 28 (1.99%) Cloud Computing
9 25 (1.77%) Amazon EMR
9 25 (1.77%) AWS Lambda
10 23 (1.63%) Azure Data Factory
10 23 (1.63%) PaaS
10 23 (1.63%) Slack
11 21 (1.49%) IaaS
12 16 (1.13%) OpenShift
13 15 (1.06%) Amazon Kinesis
14 14 (0.99%) Amazon SQS
15 12 (0.85%) GitHub
16 11 (0.78%) IBM Cloud
16 11 (0.78%) Office 365
Communications & Networking
1 55 (3.90%) Internet
2 21 (1.49%) TCP/IP
3 18 (1.28%) HTTP
4 17 (1.21%) Firewall
5 16 (1.13%) DNS
6 15 (1.06%) BGP
7 12 (0.85%) MPLS
8 11 (0.78%) SNA
9 10 (0.71%) Broadband
9 10 (0.71%) SAN
9 10 (0.71%) WAN
10 6 (0.43%) MQTT
10 6 (0.43%) OSPF
10 6 (0.43%) SSL
11 5 (0.35%) DSL
11 5 (0.35%) VPN
12 4 (0.28%) 3G
12 4 (0.28%) ATM
12 4 (0.28%) HTTPS
12 4 (0.28%) Wi-Fi
Database & Business Intelligence
1 416 (29.50%) Hadoop
2 217 (15.39%) Data Warehouse
3 166 (11.77%) Apache Hive
4 136 (9.65%) SQL Server
5 132 (9.36%) NoSQL
6 119 (8.44%) Power BI
7 114 (8.09%) Impala
8 109 (7.73%) HBase
9 101 (7.16%) Data Lake
10 99 (7.02%) MongoDB
11 85 (6.03%) Relational Database
12 75 (5.32%) MySQL
13 70 (4.96%) SQL Server Integration Services
14 66 (4.68%) Apache Cassandra
15 63 (4.47%) PostgreSQL
16 60 (4.26%) Amazon Redshift
17 50 (3.55%) SQL Server Reporting Services
18 48 (3.40%) QlikView
19 41 (2.91%) Data Mining
20 38 (2.70%) SQL Server Analysis Services
Development Applications
1 170 (12.06%) Git (software)
2 90 (6.38%) JIRA
3 81 (5.74%) Jenkins
4 26 (1.84%) Bitbucket
5 24 (1.70%) Visual Studio Team System
6 18 (1.28%) GitLab
6 18 (1.28%) Visual Studio
7 17 (1.21%) Eclipse
7 17 (1.21%) Subversion
7 17 (1.21%) Team Foundation Server
8 16 (1.13%) Selenium
9 13 (0.92%) ERwin
10 11 (0.78%) Atlassian Bamboo
10 11 (0.78%) Eclipse RCP
10 11 (0.78%) webpack
11 10 (0.71%) git-flow
11 10 (0.71%) Sonatype Nexus
11 10 (0.71%) TeamCity
12 9 (0.64%) Maven
12 9 (0.64%) Octopus Deploy
General
1 253 (17.94%) Finance
2 64 (4.54%) Marketing
3 53 (3.76%) Retail
4 37 (2.62%) Aerospace
5 31 (2.20%) Law
6 30 (2.13%) Public Sector
7 28 (1.99%) Telecoms
8 26 (1.84%) Legal
9 25 (1.77%) Banking
10 24 (1.70%) Manufacturing
11 16 (1.13%) Automotive
12 15 (1.06%) Pharmaceutical
13 12 (0.85%) Advertising
13 12 (0.85%) Games
13 12 (0.85%) Military
14 8 (0.57%) Local Government
15 7 (0.50%) Billing
16 4 (0.28%) Electronics
16 4 (0.28%) Spanish Language
17 3 (0.21%) Financial Institution
Job Titles
1 387 (27.45%) Developer
2 215 (15.25%) Architect
3 186 (13.19%) Data Engineer
4 159 (11.28%) Java Developer
5 139 (9.86%) Software Engineer
6 126 (8.94%) Data Architect
7 93 (6.60%) Analyst
8 76 (5.39%) Big Data Engineer
9 74 (5.25%) Solutions Architect
10 64 (4.54%) Senior Developer
11 61 (4.33%) Software Developer
12 53 (3.76%) Consultant
13 48 (3.40%) Senior Software Engineer
14 45 (3.19%) Java Engineer
15 44 (3.12%) Data Analyst
16 43 (3.05%) Data Scientist
17 37 (2.62%) Big Data Developer
17 37 (2.62%) Senior Java Developer
18 34 (2.41%) Big Data Architect
19 33 (2.34%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 172 (12.20%) Kafka
2 137 (9.72%) .NET
3 103 (7.30%) HTML
4 96 (6.81%) Node.js
5 95 (6.74%) AngularJS
6 87 (6.17%) CSS
7 81 (5.74%) Spring
8 66 (4.68%) Natural Language Processing
9 57 (4.04%) RESTful
10 55 (3.90%) Web Services
11 54 (3.83%) REST
12 53 (3.76%) React
13 44 (3.12%) Middleware
14 38 (2.70%) JSON
15 36 (2.55%) HTML5
16 30 (2.13%) ASP.NET
17 29 (2.06%) Laravel
18 28 (1.99%) CSS3
18 28 (1.99%) XML
19 27 (1.91%) Spring Boot
Miscellaneous
1 235 (16.67%) Analytical Skills
2 102 (7.23%) Algorithms
3 83 (5.89%) Greenfield Project
4 76 (5.39%) User Experience
5 55 (3.90%) Public Cloud
6 45 (3.19%) Data Structures
7 36 (2.55%) Cloud Native
8 33 (2.34%) Enterprise Software
8 33 (2.34%) Mobile App
9 31 (2.20%) Internet of Things
10 25 (1.77%) Management Information System
10 25 (1.77%) Self-Motivation
11 24 (1.70%) Semantic Web
12 19 (1.35%) Social Media
13 17 (1.21%) Robotics
14 16 (1.13%) PMI
15 14 (0.99%) NHS
15 14 (0.99%) Social Network
16 13 (0.92%) Analytical Mindset
17 12 (0.85%) Linked Data
Operating Systems
1 220 (15.60%) Linux
2 131 (9.29%) Windows
3 90 (6.38%) Unix
4 32 (2.27%) Red Hat Enterprise Linux
5 18 (1.28%) CentOS
6 16 (1.13%) Ubuntu
7 9 (0.64%) Android
7 9 (0.64%) Fedora
7 9 (0.64%) Windows 7
8 6 (0.43%) Apple iOS
8 6 (0.43%) Windows Server
9 4 (0.28%) VME
10 3 (0.21%) Debian
10 3 (0.21%) Mac OS
11 1 (0.071%) Oracle Linux
11 1 (0.071%) Windows Server 2012
Processes & Methodologies
1 609 (43.19%) Agile Software Development
2 513 (36.38%) Analytics
3 347 (24.61%) Machine Learning
4 292 (20.71%) Business Intelligence
5 281 (19.93%) Software Engineering
6 265 (18.79%) Data Science
7 259 (18.37%) DevOps
8 235 (16.67%) Artificial Intelligence
9 199 (14.11%) ETL
10 196 (13.90%) Data Analytics
11 195 (13.83%) Data Modelling
12 161 (11.42%) Computer Science
13 149 (10.57%) Scrum
14 126 (8.94%) Microservices
15 122 (8.65%) Data Engineering
16 120 (8.51%) Data Analysis
17 119 (8.44%) Visualisation
18 117 (8.30%) Mathematics
19 111 (7.87%) Problem-Solving
20 108 (7.66%) SDLC
Programming Languages
1 506 (35.89%) Python
2 475 (33.69%) SQL
3 471 (33.40%) Java
4 229 (16.24%) JavaScript
5 201 (14.26%) C#
6 174 (12.34%) Scala
7 148 (10.50%) C++
8 123 (8.72%) R
9 70 (4.96%) Bash Shell
10 58 (4.11%) Java 8
11 57 (4.04%) C
12 49 (3.48%) PHP
13 45 (3.19%) MATLAB
13 45 (3.19%) PowerShell
14 42 (2.98%) Shell Script
15 37 (2.62%) PL/SQL
16 36 (2.55%) T-SQL
17 27 (1.91%) Perl
18 26 (1.84%) Go
19 22 (1.56%) TypeScript
Qualifications
1 307 (21.77%) Degree
2 141 (10.00%) Security Cleared
3 88 (6.24%) SC Cleared
4 83 (5.89%) DV Cleared
5 75 (5.32%) Computer Science Degree
6 30 (2.13%) Cisco Certification
7 23 (1.63%) CCNA
7 23 (1.63%) CompTIA Security+
8 22 (1.56%) Network+ Certification
8 22 (1.56%) Numerate Degree
9 20 (1.42%) CISSP
9 20 (1.42%) PhD
10 17 (1.21%) Microsoft Certification
11 16 (1.13%) CCNP
12 14 (0.99%) AWS Certification
12 14 (0.99%) GIAC
12 14 (0.99%) Linux+ Certification
12 14 (0.99%) MCSE
12 14 (0.99%) SANS
12 14 (0.99%) SSCP
Quality Assurance & Compliance
1 80 (5.67%) QA
2 39 (2.77%) Data Quality
3 14 (0.99%) GDPR
4 11 (0.78%) ISO/IEC 27001
5 10 (0.71%) Sarbanes-Oxley
6 6 (0.43%) GMP
7 5 (0.35%) SLA
8 4 (0.28%) PMBOK
9 3 (0.21%) PCI DSS
10 2 (0.14%) HIPAA
10 2 (0.14%) ISO 26262
10 2 (0.14%) NCSC
10 2 (0.14%) NIST
10 2 (0.14%) NIST 800
11 1 (0.071%) COBIT
11 1 (0.071%) MiFID
11 1 (0.071%) PMO
System Software
1 157 (11.13%) Docker
2 71 (5.04%) HDFS
3 30 (2.13%) Apache ZooKeeper
3 30 (2.13%) VMware Infrastructure
4 27 (1.91%) Apache Flume
5 12 (0.85%) Active Directory
6 10 (0.71%) VirtualBox
7 9 (0.64%) Microsoft App-V
7 9 (0.64%) NFS
7 9 (0.64%) Samba
7 9 (0.64%) VMware ESXi
7 9 (0.64%) Xen
8 6 (0.43%) Hyper-V
9 5 (0.35%) Virtual Machines
10 3 (0.21%) vSphere
11 1 (0.071%) Oracle RAC
Systems Management
1 117 (8.30%) Ansible
2 105 (7.45%) Kubernetes
3 87 (6.17%) Puppet
4 46 (3.26%) Terraform
5 40 (2.84%) Opscode Chef
6 39 (2.77%) Oozie
7 27 (1.91%) Kibana
8 25 (1.77%) Salt
9 17 (1.21%) Hadoop YARN
10 16 (1.13%) Docker Swarm
11 14 (0.99%) Nagios
12 11 (0.78%) SCCM
13 9 (0.64%) OpenNMS
13 9 (0.64%) vCenter Server
13 9 (0.64%) ZABBIX
14 7 (0.50%) Grafana
14 7 (0.50%) logstash
15 6 (0.43%) Ambari
15 6 (0.43%) Single Sign-On
16 4 (0.28%) Mesos
Vendors
1 143 (10.14%) Microsoft
2 118 (8.37%) Oracle
3 90 (6.38%) Google
4 73 (5.18%) Tableau
5 63 (4.47%) Cloudera
6 60 (4.26%) Informatica
7 47 (3.33%) VMware
8 44 (3.12%) IBM
9 43 (3.05%) Talend
10 41 (2.91%) Sage
11 40 (2.84%) Databricks
12 33 (2.34%) Hortonworks
12 33 (2.34%) SAP
13 30 (2.13%) Salesforce.com
14 21 (1.49%) Red Hat
14 21 (1.49%) Splunk
15 18 (1.28%) EMC
16 17 (1.21%) Juniper
17 15 (1.06%) Cisco
17 15 (1.06%) Sun