Period
to 19 December 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 19 December 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
19 Dec 2018
Same period 2017 Same period 2016
Rank 83 94 88
Rank change year-on-year +11 -6 +11
Permanent jobs citing Big Data 5,805 5,856 5,861
As % of all permanent IT jobs advertised in the UK 3.66% 3.28% 3.17%
As % of the Database & Business Intelligence category 12.73% 10.79% 10.62%
Number of salaries quoted 4,411 4,729 4,916
UK median annual salary £67,500 £62,500 £62,500
Median salary % change year-on-year +8.00% - +4.17%
10th Percentile £37,500 £36,250 £37,500
90th Percentile £97,500 £93,750 £97,500
UK excluding London median annual salary £55,000 £52,500 £53,500
% change year-on-year +4.76% -1.87% +7.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 45,593 54,251 55,166
As % of all permanent IT jobs advertised in the UK 28.73% 30.36% 29.80%
Number of salaries quoted 37,349 44,734 47,211
UK median annual salary £51,000 £48,000 £47,500
Median salary % change year-on-year +6.25% +1.05% +5.56%
10th Percentile £31,250 £30,000 £29,125
90th Percentile £85,000 £77,500 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 19 December 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 19 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +13 5,442 £67,500 +8.00% 685
London +7 3,250 £75,000 +7.14% 405
UK excluding London +42 2,425 £55,000 +4.76% 327
South East +27 785 £55,000 -4.35% 106
South West +49 388 £57,500 +9.52% 41
North of England +4 385 £52,500 +5.00% 68
East of England +49 305 £60,000 +4.35% 33
Midlands +67 292 £60,000 +33.33% 32
North West +6 290 £52,500 +5.00% 29
Scotland 0 241 £45,500 -6.19% 30
West Midlands +39 150 £55,000 +29.41% 18
East Midlands +61 142 £66,500 +20.91% 14
Yorkshire -6 74 £52,500 +10.53% 23
North East +9 25 £50,000 +36.05% 16
Wales -12 18 £52,000 +22.35% 10
Northern Ireland -6 14 £42,500 +54.55% 7

For the 6 months to 19 December 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,437 (41.98%) Agile Software Development
2 2,388 (41.14%) Java
3 2,144 (36.93%) Python
4 1,907 (32.85%) Hadoop
5 1,799 (30.99%) SQL
6 1,740 (29.97%) Analytics
7 1,546 (26.63%) Apache Spark
8 1,507 (25.96%) Finance
9 1,441 (24.82%) Amazon AWS
10 1,264 (21.77%) Machine Learning
11 1,183 (20.38%) Degree
12 1,074 (18.50%) Software Engineering
13 1,060 (18.26%) Microsoft Azure
14 1,049 (18.07%) Data Science
15 949 (16.35%) NoSQL
16 932 (16.06%) Kafka
17 903 (15.56%) Linux
18 901 (15.52%) DevOps
19 859 (14.80%) Scala
20 855 (14.73%) Artificial Intelligence
21 850 (14.64%) Business Intelligence
22 826 (14.23%) ETL
23 810 (13.95%) JavaScript
24 792 (13.64%) Apache Hive
25 785 (13.52%) C#
26 737 (12.70%) Analytical Skills
27 732 (12.61%) Problem-Solving
28 722 (12.44%) TDD
29 721 (12.42%) Data Modelling
30 704 (12.13%) Data Warehouse

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,546 (26.63%) Apache Spark
2 428 (7.37%) Apache
3 372 (6.41%) Elasticsearch
4 229 (3.94%) Apache Pig
5 204 (3.51%) SAS
6 97 (1.67%) Apache Solr
7 61 (1.05%) CMS
8 60 (1.03%) Confluence
9 56 (0.96%) Tomcat
10 23 (0.40%) IIS
11 21 (0.36%) SharePoint
12 20 (0.34%) MS Exchange
12 20 (0.34%) Oracle SOA Suite
12 20 (0.34%) WebLogic
12 20 (0.34%) WildFly
13 19 (0.33%) JBoss
13 19 (0.33%) OpenStack
14 18 (0.31%) Apache Airflow
14 18 (0.31%) Oracle Workflow
14 18 (0.31%) WebSphere
Applications
1 123 (2.12%) Microsoft Excel
2 50 (0.86%) Microsoft PowerPoint
3 48 (0.83%) Microsoft Office
4 41 (0.71%) GNU Octave
5 35 (0.60%) SPSS
6 22 (0.38%) Chatbot
7 16 (0.28%) MS Visio
8 12 (0.21%) Snapchat
9 11 (0.19%) Weka
10 8 (0.14%) RoboHelp
11 7 (0.12%) Stata
12 6 (0.10%) InVision
12 6 (0.10%) Microsoft Project
13 5 (0.086%) Adobe Illustrator
13 5 (0.086%) Photoshop
14 4 (0.069%) Adobe After Effects
14 4 (0.069%) Adobe Creative Suite
14 4 (0.069%) Adobe Premiere
15 3 (0.052%) Simulink
16 1 (0.017%) S-PLUS
Business Applications
1 29 (0.50%) SAP S/4HANA
2 17 (0.29%) Dynamics CRM
3 13 (0.22%) Dynamics NAV
4 11 (0.19%) Dynamics AX
5 8 (0.14%) Oracle Payables
5 8 (0.14%) Oracle Receivables
6 7 (0.12%) SAP ERP
7 5 (0.086%) Changepoint
8 4 (0.069%) Distributed Ledger
8 4 (0.069%) MetaTrader
9 2 (0.034%) Oracle BRM
9 2 (0.034%) Oracle CRM On Demand
9 2 (0.034%) Oracle EBS
9 2 (0.034%) SAP MDG
9 2 (0.034%) SAP MII
9 2 (0.034%) SAP PM
9 2 (0.034%) Sentinel
9 2 (0.034%) Temenos T24
10 1 (0.017%) Actimize
10 1 (0.017%) SAP CRM
Cloud Services
1 1,441 (24.82%) Amazon AWS
2 1,060 (18.26%) Microsoft Azure
3 458 (7.89%) Google Cloud Platform
4 202 (3.48%) Cloud Computing
5 176 (3.03%) PaaS
6 170 (2.93%) SaaS
7 146 (2.52%) Serverless
8 139 (2.39%) Amazon EMR
9 99 (1.71%) GitHub
9 99 (1.71%) IaaS
10 93 (1.60%) AWS Lambda
11 85 (1.46%) Amazon EC2
12 81 (1.40%) Amazon Kinesis
13 73 (1.26%) Azure Data Factory
14 67 (1.15%) Amazon S3
15 50 (0.86%) AWS CloudFormation
16 39 (0.67%) Office 365
17 34 (0.59%) Data Lake Analytics
17 34 (0.59%) IBM Cloud
18 33 (0.57%) Amazon SQS
Communications & Networking
1 154 (2.65%) Internet
2 101 (1.74%) Firewall
3 74 (1.27%) HTTP
4 73 (1.26%) TCP/IP
5 47 (0.81%) SSL
6 38 (0.65%) VPN
7 37 (0.64%) DNS
8 29 (0.50%) Network Security
8 29 (0.50%) WebEx
9 28 (0.48%) WAN
10 22 (0.38%) LAN
10 22 (0.38%) SAN
11 20 (0.34%) Wireless
12 18 (0.31%) AMQP
12 18 (0.31%) Kerberos
12 18 (0.31%) Software-Defined Networking
13 16 (0.28%) SSH
14 14 (0.24%) DHCP
14 14 (0.24%) SNMP
15 11 (0.19%) Sourcefire
Database & Business Intelligence
1 1,907 (32.85%) Hadoop
2 949 (16.35%) NoSQL
3 792 (13.64%) Apache Hive
4 704 (12.13%) Data Warehouse
5 652 (11.23%) SQL Server
6 458 (7.89%) Apache Cassandra
7 451 (7.77%) Relational Database
8 443 (7.63%) MongoDB
9 387 (6.67%) HBase
10 331 (5.70%) Power BI
11 310 (5.34%) Data Lake
12 294 (5.06%) Amazon Redshift
12 294 (5.06%) MySQL
13 266 (4.58%) SQL Server Integration Services
14 260 (4.48%) Impala
15 239 (4.12%) SQL Server Reporting Services
16 231 (3.98%) PostgreSQL
17 194 (3.34%) RDBMS
18 189 (3.26%) Flink
19 146 (2.52%) SQL Server Analysis Services
Development Applications
1 468 (8.06%) Git (software)
2 267 (4.60%) Jenkins
3 237 (4.08%) JIRA
4 133 (2.29%) Selenium
5 120 (2.07%) Maven
5 120 (2.07%) Visual Studio
6 89 (1.53%) Subversion
7 85 (1.46%) JUnit
8 82 (1.41%) Atlassian Bamboo
9 60 (1.03%) Bitbucket
10 59 (1.02%) Team Foundation Server
11 56 (0.96%) TeamCity
12 51 (0.88%) Cucumber
12 51 (0.88%) Eclipse
13 49 (0.84%) SoapUI
14 48 (0.83%) Gradle
15 37 (0.64%) JMeter
16 35 (0.60%) GitLab
16 35 (0.60%) Octopus Deploy
17 33 (0.57%) EasyMock
General
1 1,507 (25.96%) Finance
2 674 (11.61%) Banking
3 450 (7.75%) Retail
4 335 (5.77%) Marketing
5 331 (5.70%) Investment Banking
6 279 (4.81%) Financial Institution
7 227 (3.91%) Telecoms
8 178 (3.07%) Law
9 148 (2.55%) Games
10 135 (2.33%) Military
11 112 (1.93%) Automotive
12 110 (1.89%) Electronics
13 76 (1.31%) Manufacturing
14 72 (1.24%) Advertising
15 64 (1.10%) Publishing
16 60 (1.03%) Pharmaceutical
17 59 (1.02%) Front Office
18 49 (0.84%) Legal
19 12 (0.21%) German Language
19 12 (0.21%) Local Government
Job Titles
1 1,697 (29.23%) Developer
2 811 (13.97%) Architect
3 709 (12.21%) Data Engineer
4 671 (11.56%) Java Developer
5 465 (8.01%) Big Data Engineer
6 401 (6.91%) Software Engineer
7 388 (6.68%) Data Architect
8 318 (5.48%) Data Scientist
9 298 (5.13%) Consultant
10 295 (5.08%) Analyst
11 292 (5.03%) Senior Developer
12 251 (4.32%) Big Data Developer
13 233 (4.01%) Solutions Architect
14 165 (2.84%) Java Engineer
15 156 (2.69%) DevOps Engineer
16 151 (2.60%) Junior
17 139 (2.39%) Senior Data Engineer
18 133 (2.29%) Big Data Architect
18 133 (2.29%) Python Developer
19 132 (2.27%) Graduate
Libraries, Frameworks & Software Standards
1 932 (16.06%) Kafka
2 527 (9.08%) .NET
3 443 (7.63%) Web Services
4 428 (7.37%) HTML
5 404 (6.96%) AngularJS
6 363 (6.25%) Spring
7 339 (5.84%) RESTful
8 312 (5.37%) Node.js
8 312 (5.37%) REST
9 303 (5.22%) React
10 301 (5.19%) CSS
11 195 (3.36%) HTML5
12 175 (3.01%) SOAP
13 165 (2.84%) Hibernate
14 155 (2.67%) XML
15 154 (2.65%) Middleware
16 147 (2.53%) Natural Language Processing
17 145 (2.50%) Django
18 142 (2.45%) ASP.NET
19 132 (2.27%) Spark Streaming
Miscellaneous
1 737 (12.70%) Analytical Skills
2 499 (8.60%) Algorithms
3 283 (4.88%) Greenfield Project
4 241 (4.15%) Fintech
5 237 (4.08%) Cyberthreat
6 215 (3.70%) Data Structures
7 208 (3.58%) User Experience
8 199 (3.43%) Management Information System
9 134 (2.31%) Self-Motivation
10 131 (2.26%) Robotics
11 130 (2.24%) Mobile App
12 126 (2.17%) Data Centre
13 104 (1.79%) Internet of Things
14 102 (1.76%) Public Cloud
15 91 (1.57%) Enterprise Software
16 78 (1.34%) Hedge funds
17 71 (1.22%) Virtual Team
18 61 (1.05%) Social Media
19 58 (1.00%) Equities
20 50 (0.86%) Social Network
Operating Systems
1 903 (15.56%) Linux
2 351 (6.05%) Windows
3 338 (5.82%) Unix
4 139 (2.39%) Android
5 89 (1.53%) Apple iOS
6 74 (1.27%) CentOS
7 66 (1.14%) Ubuntu
8 62 (1.07%) Red Hat Enterprise Linux
9 37 (0.64%) Windows Server
10 32 (0.55%) Mac OS X
11 24 (0.41%) Solaris
12 20 (0.34%) HPUX
13 17 (0.29%) AIX
13 17 (0.29%) Fedora
14 13 (0.22%) Windows Phone
15 10 (0.17%) Windows Server 2008
16 5 (0.086%) VMS
17 4 (0.069%) CoreOS
17 4 (0.069%) zOS
18 3 (0.052%) SUSE
Processes & Methodologies
1 2,437 (41.98%) Agile Software Development
2 1,740 (29.97%) Analytics
3 1,264 (21.77%) Machine Learning
4 1,074 (18.50%) Software Engineering
5 1,049 (18.07%) Data Science
6 901 (15.52%) DevOps
7 855 (14.73%) Artificial Intelligence
8 850 (14.64%) Business Intelligence
9 826 (14.23%) ETL
10 732 (12.61%) Problem-Solving
11 722 (12.44%) TDD
12 721 (12.42%) Data Modelling
13 696 (11.99%) Computer Science
14 608 (10.47%) Continuous Integration
15 602 (10.37%) Microservices
16 593 (10.22%) Visualisation
17 565 (9.73%) Scrum
18 559 (9.63%) Data Analytics
19 498 (8.58%) Open Source
20 492 (8.48%) Mathematics
Programming Languages
1 2,388 (41.14%) Java
2 2,144 (36.93%) Python
3 1,799 (30.99%) SQL
4 859 (14.80%) Scala
5 810 (13.95%) JavaScript
6 785 (13.52%) C#
7 547 (9.42%) R
8 543 (9.35%) C++
9 367 (6.32%) Java 8
10 289 (4.98%) C
11 228 (3.93%) Bash Shell
12 199 (3.43%) PowerShell
12 199 (3.43%) T-SQL
13 157 (2.70%) MATLAB
14 137 (2.36%) PHP
15 127 (2.19%) Ruby
16 111 (1.91%) Perl
17 102 (1.76%) Shell Script
18 95 (1.64%) Go
19 80 (1.38%) PL/SQL
Qualifications
1 1,183 (20.38%) Degree
2 351 (6.05%) Computer Science Degree
3 258 (4.44%) Security Cleared
4 185 (3.19%) PhD
5 139 (2.39%) DV Cleared
6 132 (2.27%) Numerate Degree
7 110 (1.89%) CISSP
8 104 (1.79%) Master's Degree
9 92 (1.58%) SC Cleared
10 68 (1.17%) Cisco Certification
11 64 (1.10%) Microsoft Certification
12 51 (0.88%) SSCP
13 49 (0.84%) GIAC
14 48 (0.83%) CompTIA Security+
15 47 (0.81%) AWS Certification
16 46 (0.79%) MCSE
16 46 (0.79%) SANS
17 44 (0.76%) CISM
17 44 (0.76%) TOGAF Certification
18 40 (0.69%) Network+ Certification
Quality Assurance & Compliance
1 262 (4.51%) Data Quality
2 260 (4.48%) QA
3 117 (2.02%) GDPR
4 60 (1.03%) ISO/IEC 27001
5 28 (0.48%) PMO
6 24 (0.41%) MiFID
6 24 (0.41%) Solvency II
7 22 (0.38%) IFRS
8 21 (0.36%) Dodd-Frank
8 21 (0.36%) FATCA
9 19 (0.33%) COBIT
9 19 (0.33%) PCI DSS
10 14 (0.24%) IFRS 9
11 12 (0.21%) BS7799
12 10 (0.17%) Cyber Essentials
13 5 (0.086%) GxP
13 5 (0.086%) PA-DSS
14 4 (0.069%) HMG Security Policy Framework
14 4 (0.069%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
14 4 (0.069%) SLA
System Software
1 507 (8.73%) Docker
2 229 (3.94%) HDFS
3 163 (2.81%) Apache Flume
4 72 (1.24%) VMware Infrastructure
5 71 (1.22%) Apache ZooKeeper
6 61 (1.05%) Active Directory
7 46 (0.79%) vSphere
8 28 (0.48%) VirtualBox
9 27 (0.47%) VMware ESXi
10 26 (0.45%) Virtual Machines
11 18 (0.31%) Snort
11 18 (0.31%) Virtual Desktop
12 17 (0.29%) Xen
13 16 (0.28%) Hyper-V
13 16 (0.28%) iptables
14 12 (0.21%) VMware NSX
15 9 (0.16%) NFS
15 9 (0.16%) Samba
16 7 (0.12%) LXC
16 7 (0.12%) Oracle RAC
Systems Management
1 308 (5.31%) Kubernetes
2 266 (4.58%) Ansible
3 253 (4.36%) Puppet
4 206 (3.55%) Oozie
5 170 (2.93%) Hadoop YARN
6 163 (2.81%) Terraform
7 128 (2.20%) Opscode Chef
8 89 (1.53%) Kibana
9 70 (1.21%) Salt
10 54 (0.93%) Mesos
11 51 (0.88%) Nagios
12 41 (0.71%) logstash
13 37 (0.64%) Grafana
14 35 (0.60%) Docker Swarm
15 28 (0.48%) Prometheus
16 24 (0.41%) Ambari
16 24 (0.41%) ZABBIX
17 19 (0.33%) Packer
17 19 (0.33%) vCenter Server
18 17 (0.29%) Rancher
Vendors
1 648 (11.16%) Microsoft
2 520 (8.96%) Oracle
3 452 (7.79%) Tableau
4 440 (7.58%) Google
5 363 (6.25%) Cloudera
6 296 (5.10%) Hortonworks
7 232 (4.00%) SAP
8 143 (2.46%) IBM
9 131 (2.26%) MapR
10 128 (2.20%) Informatica
11 112 (1.93%) Databricks
12 105 (1.81%) VMware
13 102 (1.76%) Talend
14 93 (1.60%) Splunk
15 76 (1.31%) Sybase
16 68 (1.17%) Red Hat
17 66 (1.14%) Teradata
18 55 (0.95%) Cisco
19 49 (0.84%) Alteryx
20 44 (0.76%) CA Agile Central