Period
to 16 November 2019

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 16 November 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK > UK excluding London
6 months to
16 Nov 2019
Same period 2018 Same period 2017
Rank 137 123 163
Rank change year-on-year -14 +40 -4
Permanent jobs citing Big Data 1,830 2,431 2,261
As % of all permanent IT jobs advertised in the UK excluding London 2.35% 2.65% 2.25%
As % of the Database & Business Intelligence category 9.04% 9.30% 7.26%
Number of salaries quoted 1,460 1,916 1,897
UK excluding London median annual salary £53,450 £55,000 £52,000
Median salary % change year-on-year -2.82% +5.77% -3.70%
10th Percentile £33,750 £32,500 £31,250
90th Percentile £82,500 £85,000 £77,500
UK median annual salary £67,500 £65,000 £62,500
% change year-on-year +3.85% +4.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 20,238 26,138 31,135
As % of all permanent IT jobs advertised in the UK excluding London 26.02% 28.54% 30.99%
Number of salaries quoted 16,730 21,676 26,193
UK excluding London median annual salary £45,000 £45,000 £42,500
Median salary % change year-on-year - +5.88% -
10th Percentile £29,000 £28,250 £27,500
90th Percentile £67,500 £68,750 £63,000
UK median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Big Data
Job Vacancy Trend in the UK excluding London

Job postings citing Big Data as a percentage of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Big Data in the UK excluding London

Big Data
Salary Trend in the UK excluding London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the UK excluding London.

Salary trend for Big Data in the UK excluding London

Big Data
Salary Histogram in the UK excluding London

The salary distribution of IT jobs citing Big Data in the UK excluding London over the 6 months to 16 November 2019.

Salary histogram for Big Data in the UK excluding London

Big Data
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK excluding London region over the 6 months to 16 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East -51 484 £60,000 +9.09% 81
South West -12 351 £50,000 -13.04% 41
North of England +2 296 £55,000 +9.45% 61
Scotland +12 249 £47,600 +4.62% 34
Midlands 0 222 £57,500 -11.54% 41
East of England -21 182 £65,000 +8.33% 43
North West -46 169 £55,000 +10.00% 35
East Midlands +26 150 £57,500 -20.69% 18
Yorkshire +37 94 £55,000 +4.76% 18
West Midlands -35 67 £50,000 -13.04% 23
Wales +23 35 £40,000 -23.08% 5
North East +42 34 £45,412 -49.54% 8
Northern Ireland +8 13 £37,500 -14.29%
Big Data
UK

For the 6 months to 16 November 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Big Data.

1 801 (43.77%) Agile Software Development
2 635 (34.70%) Python
3 561 (30.66%) Java
4 560 (30.60%) SQL
5 513 (28.03%) Analytics
6 480 (26.23%) Hadoop
7 440 (24.04%) Apache Spark
8 411 (22.46%) AWS
9 393 (21.48%) Degree
10 377 (20.60%) Software Engineering
11 363 (19.84%) Machine Learning
12 325 (17.76%) Linux
13 321 (17.54%) Azure
14 302 (16.50%) DevOps
15 294 (16.07%) Data Science
16 277 (15.14%) Git (software)
17 275 (15.03%) Business Intelligence
18 271 (14.81%) ETL
19 258 (14.10%) Apache Hive
20 257 (14.04%) C#
21 250 (13.66%) JavaScript
22 241 (13.17%) Finance
23 234 (12.79%) Artificial Intelligence
24 232 (12.68%) Data Warehouse
25 229 (12.51%) Scala
26 219 (11.97%) Kafka
27 211 (11.53%) Analytical Skills
28 210 (11.48%) Scrum
29 192 (10.49%) .NET
30 191 (10.44%) Mentoring

Big Data
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 440 (24.04%) Apache Spark
2 133 (7.27%) Elasticsearch
3 67 (3.66%) Apache
4 38 (2.08%) OpenStack
5 32 (1.75%) SAS
6 19 (1.04%) NServiceBus
7 16 (0.87%) Confluence
8 15 (0.82%) Apache Pig
9 14 (0.77%) Apache Solr
10 13 (0.71%) WebLogic
11 12 (0.66%) nginx
12 10 (0.55%) Oracle SOA Suite
12 10 (0.55%) Tornado
13 9 (0.49%) Tomcat
14 8 (0.44%) JBoss
15 7 (0.38%) Jupyter
16 6 (0.33%) Apache Airflow
16 6 (0.33%) SharePoint
17 3 (0.16%) Oracle Workflow
17 3 (0.16%) WebLogic Portal
Applications
1 23 (1.26%) Microsoft Excel
2 10 (0.55%) MS Visio
3 7 (0.38%) Gephi
4 6 (0.33%) Chatbot
4 6 (0.33%) Microsoft Office
5 4 (0.22%) Spreadsheet
6 3 (0.16%) Microsoft PowerPoint
6 3 (0.16%) SPSS
7 1 (0.055%) Stata
Business Applications
1 20 (1.09%) Sparx Enterprise Architect
2 10 (0.55%) SAP S/4HANA
3 2 (0.11%) Oracle BPM
3 2 (0.11%) Oracle Financials
4 1 (0.055%) Dynamics NAV
4 1 (0.055%) NetSuite
4 1 (0.055%) Oracle EBS
4 1 (0.055%) SAP BPC
Cloud Services
1 411 (22.46%) AWS
2 321 (17.54%) Azure
3 151 (8.25%) GCP
4 91 (4.97%) Power Platform
5 62 (3.39%) Serverless
6 49 (2.68%) Amazon S3
7 48 (2.62%) Cloud Computing
8 43 (2.35%) GitHub
9 42 (2.30%) OpenShift
10 36 (1.97%) SaaS
11 35 (1.91%) Amazon EC2
12 33 (1.80%) PaaS
13 32 (1.75%) AWS Lambda
14 31 (1.69%) Amazon EMR
14 31 (1.69%) Amazon SQS
15 27 (1.48%) Slack
16 26 (1.42%) Azure Data Factory
17 25 (1.37%) Datadog
18 24 (1.31%) IaaS
19 23 (1.26%) AWS Elastic Beanstalk
Communications & Networking
1 70 (3.83%) Internet
2 58 (3.17%) Firewall
3 57 (3.11%) TCP/IP
4 35 (1.91%) HTTPS
5 31 (1.69%) DNS
6 24 (1.31%) HTTP
7 13 (0.71%) SSL
8 12 (0.66%) DHCP
8 12 (0.66%) VPN
9 9 (0.49%) DMZ
9 9 (0.49%) Network Security
10 8 (0.44%) Ethernet
10 8 (0.44%) MPLS
11 5 (0.27%) SSH
12 4 (0.22%) ATM
12 4 (0.22%) Converged Networks
12 4 (0.22%) NAS
12 4 (0.22%) SAN
12 4 (0.22%) SNA
12 4 (0.22%) Unified Communications
Database & Business Intelligence
1 480 (26.23%) Hadoop
2 258 (14.10%) Apache Hive
3 232 (12.68%) Data Warehouse
4 161 (8.80%) NoSQL
5 156 (8.52%) SQL Server
6 155 (8.47%) Impala
7 125 (6.83%) Data Lake
8 124 (6.78%) HBase
9 118 (6.45%) MongoDB
10 101 (5.52%) MySQL
11 94 (5.14%) Relational Database
12 91 (4.97%) Power BI
13 60 (3.28%) PostgreSQL
14 59 (3.22%) GIS
15 57 (3.11%) Apache Cassandra
16 53 (2.90%) SQL Server Integration Services
17 48 (2.62%) Data Mining
18 45 (2.46%) Amazon Redshift
19 44 (2.40%) Amazon DynamoDB
19 44 (2.40%) Sqoop
Development Applications
1 277 (15.14%) Git (software)
2 169 (9.23%) Jenkins
3 154 (8.42%) JIRA
4 98 (5.36%) Bitbucket
5 71 (3.88%) git-flow
6 49 (2.68%) Selenium
7 46 (2.51%) Visual Studio
8 45 (2.46%) Cucumber
9 41 (2.24%) TeamCity
10 38 (2.08%) Bitbucket Server
11 28 (1.53%) NetBeans
11 28 (1.53%) Octopus Deploy
12 24 (1.31%) GitLab
13 17 (0.93%) Subversion
14 15 (0.82%) Eclipse
15 14 (0.77%) Atlassian Bamboo
15 14 (0.77%) Eclipse RCP
15 14 (0.77%) Team Foundation Server
16 13 (0.71%) Appium
17 11 (0.60%) Sonatype Nexus
General
1 241 (13.17%) Finance
2 74 (4.04%) Retail
3 50 (2.73%) Telecoms
4 45 (2.46%) Legal
5 44 (2.40%) Public Sector
6 38 (2.08%) Marketing
7 33 (1.80%) Banking
7 33 (1.80%) Games
8 28 (1.53%) Manufacturing
9 19 (1.04%) Electronics
10 17 (0.93%) Aerospace
11 16 (0.87%) Local Government
12 15 (0.82%) Pharmaceutical
13 12 (0.66%) Military
14 11 (0.60%) Billing
14 11 (0.60%) Publishing
15 8 (0.44%) Automotive
16 7 (0.38%) Financial Institution
17 5 (0.27%) Advertising
17 5 (0.27%) Back Office
Job Titles
1 526 (28.74%) Developer
2 255 (13.93%) Data Engineer
3 218 (11.91%) Java Developer
4 190 (10.38%) Architect
5 173 (9.45%) Software Engineer
6 131 (7.16%) Consultant
7 111 (6.07%) Analyst
8 110 (6.01%) Senior Developer
9 107 (5.85%) Big Data Engineer
10 105 (5.74%) Data Architect
11 90 (4.92%) Data Scientist
12 72 (3.93%) Java Engineer
12 72 (3.93%) Software Developer
13 70 (3.83%) Senior Data Engineer
14 56 (3.06%) .NET Developer
15 55 (3.01%) Java Software Engineer
16 52 (2.84%) C# Software Engineer
16 52 (2.84%) Data Analyst
16 52 (2.84%) Senior Software Engineer
16 52 (2.84%) Solutions Architect
Libraries, Frameworks & Software Standards
1 219 (11.97%) Kafka
2 192 (10.49%) .NET
3 152 (8.31%) Node.js
4 151 (8.25%) AngularJS
5 143 (7.81%) HTML
6 134 (7.32%) React
7 132 (7.21%) CSS
8 106 (5.79%) Spring
9 92 (5.03%) RESTful
10 74 (4.04%) Web Services
11 67 (3.66%) REST
12 59 (3.22%) ASP.NET
13 58 (3.17%) Elastic Stack
14 54 (2.95%) jQuery
15 52 (2.84%) XML
16 51 (2.79%) Vue.js
17 48 (2.62%) Middleware
18 46 (2.51%) GraphQL
18 46 (2.51%) JSON
19 40 (2.19%) SOAP
Miscellaneous
1 211 (11.53%) Analytical Skills
2 92 (5.03%) Algorithms
3 89 (4.86%) Management Information System
4 78 (4.26%) Robotics
5 65 (3.55%) Greenfield Project
6 58 (3.17%) Internet of Things
7 55 (3.01%) Mobile App
8 52 (2.84%) User Experience
9 43 (2.35%) Data Structures
10 38 (2.08%) Analytical Mindset
10 38 (2.08%) Linux Command Line
11 37 (2.02%) Cyber Kill Chain
12 36 (1.97%) Public Cloud
13 34 (1.86%) Enterprise Software
14 30 (1.64%) Cloud Native
15 27 (1.48%) Data Centre
16 26 (1.42%) Cybercrime
17 22 (1.20%) Self-Motivation
18 17 (0.93%) Social Media
19 15 (0.82%) Cyberattack
Operating Systems
1 325 (17.76%) Linux
2 143 (7.81%) Windows
3 100 (5.46%) Unix
4 58 (3.17%) Android
5 55 (3.01%) Apple iOS
6 32 (1.75%) Red Hat Enterprise Linux
7 23 (1.26%) CentOS
8 14 (0.77%) Ubuntu
9 11 (0.60%) Windows Server
10 10 (0.55%) Mac OS
11 9 (0.49%) Solaris
12 8 (0.44%) Fedora
13 6 (0.33%) VME
14 5 (0.27%) Oracle Linux
15 3 (0.16%) Debian
15 3 (0.16%) Windows 10
16 1 (0.055%) AIX
16 1 (0.055%) Mac OS X
16 1 (0.055%) Windows 7
16 1 (0.055%) Windows Server 2008
Processes & Methodologies
1 801 (43.77%) Agile Software Development
2 513 (28.03%) Analytics
3 377 (20.60%) Software Engineering
4 363 (19.84%) Machine Learning
5 302 (16.50%) DevOps
6 294 (16.07%) Data Science
7 275 (15.03%) Business Intelligence
8 271 (14.81%) ETL
9 234 (12.79%) Artificial Intelligence
10 210 (11.48%) Scrum
11 191 (10.44%) Mentoring
12 185 (10.11%) Problem-Solving
13 181 (9.89%) Cybersecurity
14 180 (9.84%) Data Modelling
15 174 (9.51%) Computer Science
16 168 (9.18%) Visualisation
17 161 (8.80%) Test Automation
18 159 (8.69%) Mathematics
19 140 (7.65%) Data Analytics
20 139 (7.60%) Data Engineering
Programming Languages
1 635 (34.70%) Python
2 561 (30.66%) Java
3 560 (30.60%) SQL
4 257 (14.04%) C#
5 250 (13.66%) JavaScript
6 229 (12.51%) Scala
7 169 (9.23%) R
8 167 (9.13%) C
9 163 (8.91%) C++
10 86 (4.70%) Bash Shell
11 82 (4.48%) Java 8
12 73 (3.99%) Perl
13 63 (3.44%) Shell Script
14 58 (3.17%) PowerShell
15 56 (3.06%) PHP
16 54 (2.95%) PL/SQL
17 52 (2.84%) Ruby
18 33 (1.80%) TypeScript
19 28 (1.53%) Go
20 26 (1.42%) MATLAB
Qualifications
1 393 (21.48%) Degree
2 177 (9.67%) Security Cleared
3 103 (5.63%) DV Cleared
4 77 (4.21%) Computer Science Degree
5 70 (3.83%) SC Cleared
6 49 (2.68%) Microsoft Certification
7 46 (2.51%) Numerate Degree
8 44 (2.40%) CISSP
9 42 (2.30%) CompTIA Security+
10 41 (2.24%) Network+ Certification
11 38 (2.08%) Cisco Certification
12 37 (2.02%) CCNA
13 35 (1.91%) SSCP
14 34 (1.86%) GIAC
14 34 (1.86%) MCSE
14 34 (1.86%) SANS
15 33 (1.80%) Linux+ Certification
16 11 (0.60%) CISM
16 11 (0.60%) PhD
17 9 (0.49%) MCP
Quality Assurance & Compliance
1 66 (3.61%) QA
2 59 (3.22%) Data Quality
3 22 (1.20%) ISO/IEC 27001
4 19 (1.04%) GDPR
5 15 (0.82%) SLA
6 7 (0.38%) HIPAA
7 6 (0.33%) PMO
8 5 (0.27%) COBIT
8 5 (0.27%) PCI DSS
9 4 (0.22%) SEPA
10 3 (0.16%) GMP
11 2 (0.11%) Sarbanes-Oxley
12 1 (0.055%) Actionable Recommendations
12 1 (0.055%) Cyber Essentials
12 1 (0.055%) IFRS
12 1 (0.055%) IFRS 9
12 1 (0.055%) ISO 9001
12 1 (0.055%) MiFID
12 1 (0.055%) NCSC
12 1 (0.055%) NIST
System Software
1 172 (9.40%) Docker
2 59 (3.22%) Apache Flume
3 58 (3.17%) HDFS
4 22 (1.20%) VMware Infrastructure
5 20 (1.09%) Apache ZooKeeper
6 17 (0.93%) NFS
7 15 (0.82%) Active Directory
8 11 (0.60%) VMware ESXi
9 9 (0.49%) Firmware
10 8 (0.44%) Samba
10 8 (0.44%) VirtualBox
10 8 (0.44%) Xen
11 7 (0.38%) Oracle RAC
12 4 (0.22%) Virtual Machines
12 4 (0.22%) vSphere
13 3 (0.16%) Hyper-V
14 2 (0.11%) vCloud
15 1 (0.055%) Virtual Servers
Systems Management
1 150 (8.20%) Ansible
2 131 (7.16%) Kubernetes
3 73 (3.99%) Oozie
4 57 (3.11%) Terraform
5 54 (2.95%) Puppet
6 27 (1.48%) Hadoop YARN
7 24 (1.31%) Kibana
7 24 (1.31%) Opscode Chef
8 12 (0.66%) logstash
9 11 (0.60%) ZABBIX
10 10 (0.55%) Salt
11 9 (0.49%) Nagios
12 8 (0.44%) Docker Swarm
12 8 (0.44%) OpenNMS
12 8 (0.44%) vCenter Server
13 7 (0.38%) Enterprise Manager Cloud Control
14 6 (0.33%) Ambari
15 4 (0.22%) HP Fortify
15 4 (0.22%) SCCM
16 3 (0.16%) HP ALM
Vendors
1 190 (10.38%) Oracle
2 149 (8.14%) Microsoft
3 114 (6.23%) Google
4 75 (4.10%) Tableau
5 72 (3.93%) Cloudera
5 72 (3.93%) Informatica
6 66 (3.61%) Splunk
7 52 (2.84%) SAP
8 48 (2.62%) Teradata
9 35 (1.91%) Hortonworks
9 35 (1.91%) Red Hat
10 34 (1.86%) VMware
11 29 (1.58%) IBM
12 26 (1.42%) Sage
13 25 (1.37%) Databricks
14 23 (1.26%) Atlassian
14 23 (1.26%) Talend
15 20 (1.09%) Sparx
16 18 (0.98%) Ab Initio
16 18 (0.98%) BiZZdesign