Period
to 15 October 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 15 October 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
15 Oct 2018
Same period 2017 Same period 2016
Rank 77 96 98
Rank change year-on-year +19 +2 +25
Permanent jobs citing Big Data 6,302 5,611 5,636
As % of all permanent IT jobs advertised in the UK 3.83% 3.23% 2.96%
As % of the Database & Business Intelligence category 12.98% 10.60% 9.99%
Number of salaries quoted 4,347 4,539 4,586
UK median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% -
10th Percentile £37,500 £36,250 £37,500
90th Percentile £95,000 £90,650 £100,000
UK excluding London median annual salary £55,000 £52,500 £53,500
% change year-on-year +4.76% -1.87% +7.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 48,563 52,939 56,434
As % of all permanent IT jobs advertised in the UK 29.51% 30.45% 29.63%
Number of salaries quoted 39,632 43,557 48,025
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £82,500 £77,500 £76,250
UK excluding London median annual salary £45,000 £42,500 £41,500
% change year-on-year +5.88% +2.41% +3.75%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 15 October 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 15 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +20 5,947 £65,000 +4.00% 733
London +20 3,802 £70,000 +3.70% 398
UK excluding London +31 2,382 £55,000 +4.76% 378
South East 0 754 £57,500 - 103
North of England -29 373 £50,000 - 93
South West +56 372 £57,500 +9.52% 63
East of England +84 338 £60,000 +20.00% 37
North West -12 300 £50,000 - 56
Midlands +47 282 £62,500 +38.89% 39
Scotland -5 237 £45,500 -9.00% 20
West Midlands +43 149 £55,000 +29.41% 21
East Midlands +22 133 £75,000 +42.86% 18
Yorkshire -31 63 £53,750 +7.50% 19
Wales -4 20 £49,750 +10.56% 17
Northern Ireland +7 12 £45,000 +28.57% 6
North East -12 12 £41,250 +3.13% 18

For the 6 months to 15 October 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,691 (42.70%) Java
2 2,498 (39.64%) Agile Software Development
3 2,187 (34.70%) Python
4 1,998 (31.70%) SQL
5 1,993 (31.62%) Finance
6 1,914 (30.37%) Hadoop
7 1,900 (30.15%) Analytics
8 1,540 (24.44%) Apache Spark
9 1,362 (21.61%) Amazon AWS
10 1,291 (20.49%) Degree
11 1,262 (20.03%) Machine Learning
12 1,256 (19.93%) Problem-Solving
13 1,210 (19.20%) Banking
14 1,071 (16.99%) Analytical Skills
15 1,063 (16.87%) Data Science
16 1,023 (16.23%) JavaScript
17 1,021 (16.20%) Linux
18 1,014 (16.09%) Software Engineering
19 956 (15.17%) Microsoft Azure
20 925 (14.68%) Kafka
21 899 (14.27%) NoSQL
22 890 (14.12%) Investment Banking
23 888 (14.09%) C#
23 888 (14.09%) Risk Management
24 876 (13.90%) Scala
25 866 (13.74%) Business Intelligence
26 843 (13.38%) ETL
27 835 (13.25%) Innovative Thinking
28 832 (13.20%) Low Latency
29 829 (13.15%) Financial Institution

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,540 (24.44%) Apache Spark
2 360 (5.71%) Apache
3 344 (5.46%) Elasticsearch
4 231 (3.67%) Apache Pig
5 202 (3.21%) SAS
6 94 (1.49%) Apache Solr
7 74 (1.17%) Confluence
8 57 (0.90%) Tomcat
9 53 (0.84%) CMS
10 36 (0.57%) IIS
11 23 (0.36%) WebLogic
12 22 (0.35%) WildFly
13 21 (0.33%) OpenStack
13 21 (0.33%) SharePoint
14 19 (0.30%) JBoss
15 17 (0.27%) Adobe Experience Manager
16 16 (0.25%) CloudStack
16 16 (0.25%) Jupyter
16 16 (0.25%) Oracle SOA Suite
17 15 (0.24%) Skype for Business
Applications
1 120 (1.90%) Microsoft Excel
2 65 (1.03%) Microsoft Office
3 46 (0.73%) Microsoft PowerPoint
4 42 (0.67%) GNU Octave
5 28 (0.44%) MS Visio
6 27 (0.43%) SPSS
7 19 (0.30%) Chatbot
8 9 (0.14%) Microsoft Project
9 8 (0.13%) RoboHelp
10 4 (0.063%) Adobe After Effects
10 4 (0.063%) Adobe Creative Suite
10 4 (0.063%) Adobe Illustrator
10 4 (0.063%) Adobe Premiere
10 4 (0.063%) InVision
10 4 (0.063%) Photoshop
10 4 (0.063%) Weka
11 3 (0.048%) Stata
12 2 (0.032%) EViews
12 2 (0.032%) PrintSoft PReS
13 1 (0.016%) Mingle
Business Applications
1 29 (0.46%) SAP S/4HANA
2 24 (0.38%) Dynamics CRM
3 19 (0.30%) Dynamics NAV
4 18 (0.29%) Dynamics AX
5 10 (0.16%) Oracle Payables
6 9 (0.14%) Oracle Receivables
7 6 (0.095%) SAP ERP
7 6 (0.095%) Sentinel
8 5 (0.079%) Actimize
9 4 (0.063%) Oracle ERP
10 3 (0.048%) Oracle Procure-to-Pay
11 2 (0.032%) Changepoint
11 2 (0.032%) Oracle BPM
11 2 (0.032%) Oracle EBS
11 2 (0.032%) SAP Forecasting and Replenishment
11 2 (0.032%) SAP MDG
11 2 (0.032%) SAP MII
11 2 (0.032%) SAP PM
11 2 (0.032%) SAP Retail
11 2 (0.032%) Temenos T24
Cloud Services
1 1,362 (21.61%) Amazon AWS
2 956 (15.17%) Microsoft Azure
3 307 (4.87%) Google Cloud Platform
4 204 (3.24%) SaaS
5 187 (2.97%) Cloud Computing
5 187 (2.97%) PaaS
6 170 (2.70%) Serverless
7 129 (2.05%) Amazon EMR
8 123 (1.95%) Amazon Kinesis
9 117 (1.86%) IaaS
10 84 (1.33%) AWS Lambda
11 80 (1.27%) Azure Data Factory
12 78 (1.24%) Amazon S3
12 78 (1.24%) GitHub
13 77 (1.22%) Amazon EC2
14 49 (0.78%) Cortana Intelligence Suite
15 39 (0.62%) Office 365
16 37 (0.59%) IBM Cloud
17 31 (0.49%) AWS CloudFormation
18 30 (0.48%) Azure Machine Learning
Communications & Networking
1 113 (1.79%) Firewall
2 105 (1.67%) Internet
3 88 (1.40%) TCP/IP
4 87 (1.38%) HTTP
5 66 (1.05%) SSL
6 51 (0.81%) DNS
7 36 (0.57%) WAN
8 33 (0.52%) LAN
9 31 (0.49%) Wireless
10 30 (0.48%) SAN
11 29 (0.46%) Network Security
12 25 (0.40%) DHCP
12 25 (0.40%) Kerberos
12 25 (0.40%) Unified Communications
13 23 (0.36%) Software-Defined Networking
13 23 (0.36%) Sourcefire
14 22 (0.35%) WebEx
15 19 (0.30%) Wireless Security
16 18 (0.29%) SNMP
17 17 (0.27%) Ethernet
Database & Business Intelligence
1 1,914 (30.37%) Hadoop
2 899 (14.27%) NoSQL
3 780 (12.38%) Apache Hive
4 763 (12.11%) Data Warehouse
5 705 (11.19%) SQL Server
6 536 (8.51%) Relational Database
7 481 (7.63%) MongoDB
8 392 (6.22%) Apache Cassandra
9 360 (5.71%) Data Lake
10 352 (5.59%) Power BI
11 318 (5.05%) HBase
12 297 (4.71%) MySQL
13 276 (4.38%) SQL Server Integration Services
14 266 (4.22%) SQL Server Reporting Services
15 257 (4.08%) Amazon Redshift
16 246 (3.90%) Impala
17 220 (3.49%) RDBMS
18 210 (3.33%) PostgreSQL
19 148 (2.35%) DB2
20 141 (2.24%) SQL Server Analysis Services
Development Applications
1 513 (8.14%) Git (software)
2 315 (5.00%) Jenkins
3 266 (4.22%) JIRA
4 150 (2.38%) Selenium
5 144 (2.28%) Maven
6 131 (2.08%) JUnit
7 130 (2.06%) Visual Studio
8 108 (1.71%) Subversion
9 98 (1.56%) Atlassian Bamboo
10 86 (1.36%) Bitbucket
11 70 (1.11%) Gradle
12 69 (1.09%) TeamCity
13 62 (0.98%) Cucumber
14 50 (0.79%) Eclipse
15 46 (0.73%) Team Foundation Server
16 45 (0.71%) git-flow
17 44 (0.70%) CodeSonar
17 44 (0.70%) Robot Framework
18 43 (0.68%) GitLab
19 41 (0.65%) Mockito
General
1 1,993 (31.62%) Finance
2 1,210 (19.20%) Banking
3 890 (14.12%) Investment Banking
4 829 (13.15%) Financial Institution
5 402 (6.38%) Retail
6 368 (5.84%) Marketing
7 193 (3.06%) Telecoms
8 169 (2.68%) Front Office
9 154 (2.44%) Games
10 110 (1.75%) Law
11 108 (1.71%) Electronics
12 89 (1.41%) Military
13 85 (1.35%) Advertising
14 80 (1.27%) Manufacturing
15 72 (1.14%) Automotive
16 65 (1.03%) Legal
17 53 (0.84%) Publishing
18 50 (0.79%) Pharmaceutical
19 26 (0.41%) Multimedia
20 17 (0.27%) German Language
Job Titles
1 1,851 (29.37%) Developer
2 816 (12.95%) Architect
3 702 (11.14%) Data Engineer
4 663 (10.52%) Java Developer
5 472 (7.49%) Big Data Engineer
6 432 (6.85%) Software Engineer
7 369 (5.86%) Data Architect
8 318 (5.05%) Data Scientist
9 303 (4.81%) Consultant
10 300 (4.76%) Big Data Developer
11 295 (4.68%) Senior Developer
12 289 (4.59%) Analyst
13 246 (3.90%) Solutions Architect
14 210 (3.33%) Java Engineer
15 158 (2.51%) Software Developer
16 157 (2.49%) Big Data Architect
16 157 (2.49%) Junior
17 154 (2.44%) DevOps Engineer
18 148 (2.35%) Python Developer
19 145 (2.30%) SQL Developer
Libraries, Frameworks & Software Standards
1 925 (14.68%) Kafka
2 640 (10.16%) .NET
3 569 (9.03%) AngularJS
4 508 (8.06%) Web Services
5 506 (8.03%) HTML
6 446 (7.08%) RESTful
7 411 (6.52%) Spring
8 346 (5.49%) React
9 342 (5.43%) REST
10 326 (5.17%) Node.js
11 314 (4.98%) CSS
12 240 (3.81%) HTML5
13 224 (3.55%) XML
14 168 (2.67%) RabbitMQ
15 164 (2.60%) JSON
15 164 (2.60%) SOAP
16 163 (2.59%) Hibernate
17 158 (2.51%) Django
18 157 (2.49%) ASP.NET
19 154 (2.44%) Natural Language Processing
Miscellaneous
1 1,071 (16.99%) Analytical Skills
2 814 (12.92%) Computer Science
3 774 (12.28%) Cyberthreat
4 545 (8.65%) Algorithms
5 317 (5.03%) Greenfield Project
6 290 (4.60%) Fintech
7 253 (4.01%) Data Structures
8 250 (3.97%) User Experience
9 244 (3.87%) Management Information System
10 238 (3.78%) Self-Motivation
11 160 (2.54%) Data Centre
12 150 (2.38%) Robotics
13 148 (2.35%) Mobile App
14 142 (2.25%) Fixed Income
15 130 (2.06%) Equities
16 119 (1.89%) Enterprise Software
16 119 (1.89%) Public Cloud
17 101 (1.60%) Virtual Team
18 81 (1.29%) Derivative
19 78 (1.24%) Hedge funds
Operating Systems
1 1,021 (16.20%) Linux
2 431 (6.84%) Windows
3 383 (6.08%) Unix
4 121 (1.92%) Android
5 88 (1.40%) Apple iOS
6 66 (1.05%) CentOS
7 62 (0.98%) Red Hat Enterprise Linux
8 58 (0.92%) Ubuntu
9 49 (0.78%) Windows Server
10 44 (0.70%) Mac OS X
11 30 (0.48%) Solaris
12 29 (0.46%) HPUX
13 28 (0.44%) AIX
14 17 (0.27%) Windows Server 2008
15 16 (0.25%) Windows Phone
16 13 (0.21%) Fedora
17 9 (0.14%) Windows 7
18 7 (0.11%) Windows Server 2012
19 6 (0.095%) Debian
19 6 (0.095%) Windows 10
Processes & Methodologies
1 2,498 (39.64%) Agile Software Development
2 1,900 (30.15%) Analytics
3 1,262 (20.03%) Machine Learning
4 1,256 (19.93%) Problem-Solving
5 1,063 (16.87%) Data Science
6 1,014 (16.09%) Software Engineering
7 888 (14.09%) Risk Management
8 866 (13.74%) Business Intelligence
9 843 (13.38%) ETL
10 835 (13.25%) Innovative Thinking
11 832 (13.20%) Low Latency
12 826 (13.11%) DevOps
13 805 (12.77%) Strategic Thinking
14 780 (12.38%) Investment Management
15 776 (12.31%) TDD
16 729 (11.57%) Artificial Intelligence
17 667 (10.58%) Data Modelling
18 655 (10.39%) Continuous Integration
19 647 (10.27%) Visualisation
20 608 (9.65%) Microservices
Programming Languages
1 2,691 (42.70%) Java
2 2,187 (34.70%) Python
3 1,998 (31.70%) SQL
4 1,023 (16.23%) JavaScript
5 888 (14.09%) C#
6 876 (13.90%) Scala
7 644 (10.22%) C++
8 547 (8.68%) R
9 337 (5.35%) Java 8
10 327 (5.19%) C
11 269 (4.27%) Bash Shell
12 246 (3.90%) PowerShell
13 212 (3.36%) T-SQL
14 205 (3.25%) Perl
15 170 (2.70%) PHP
16 156 (2.48%) Shell Script
17 144 (2.28%) Ruby
18 131 (2.08%) MATLAB
19 120 (1.90%) Go
20 77 (1.22%) Objective-C
Qualifications
1 1,291 (20.49%) Degree
2 391 (6.20%) Computer Science Degree
3 275 (4.36%) Security Cleared
4 238 (3.78%) PhD
5 160 (2.54%) DV Cleared
6 153 (2.43%) Master's Degree
7 135 (2.14%) Numerate Degree
8 113 (1.79%) CISSP
9 81 (1.29%) Microsoft Certification
9 81 (1.29%) SC Cleared
10 79 (1.25%) Cisco Certification
11 71 (1.13%) CCNA
12 64 (1.02%) MCSE
13 63 (1.00%) SSCP
14 60 (0.95%) GIAC
15 58 (0.92%) SANS
16 53 (0.84%) CompTIA Security+
16 53 (0.84%) Linux+ Certification
16 53 (0.84%) Network+ Certification
17 43 (0.68%) PMI Certification
Quality Assurance & Compliance
1 271 (4.30%) QA
2 245 (3.89%) Data Quality
3 105 (1.67%) GDPR
4 56 (0.89%) ISO/IEC 27001
5 25 (0.40%) PMO
6 22 (0.35%) MiFID
7 20 (0.32%) Solvency II
8 16 (0.25%) Dodd-Frank
8 16 (0.25%) FATCA
8 16 (0.25%) IFRS
8 16 (0.25%) IFRS 9
9 15 (0.24%) PCI DSS
10 9 (0.14%) COBIT
10 9 (0.14%) Cyber Essentials
10 9 (0.14%) GPG13
11 6 (0.095%) SLA
12 5 (0.079%) Actionable Recommendations
12 5 (0.079%) ISO 14001
12 5 (0.079%) Sarbanes-Oxley
13 4 (0.063%) HMG Security Policy Framework
System Software
1 565 (8.97%) Docker
2 274 (4.35%) HDFS
3 166 (2.63%) Apache Flume
4 84 (1.33%) VMware Infrastructure
5 69 (1.09%) vSphere
6 67 (1.06%) Active Directory
7 52 (0.83%) Virtual Machines
8 47 (0.75%) Apache ZooKeeper
9 34 (0.54%) VirtualBox
10 32 (0.51%) Virtual Desktop
11 28 (0.44%) VMware ESXi
12 27 (0.43%) Snort
13 20 (0.32%) Hyper-V
14 18 (0.29%) iptables
15 15 (0.24%) VMware NSX
16 13 (0.21%) Xen
17 10 (0.16%) NFS
18 9 (0.14%) Samba
19 7 (0.11%) LXC
20 6 (0.095%) XenDesktop
Systems Management
1 319 (5.06%) Kubernetes
2 295 (4.68%) Puppet
3 268 (4.25%) Ansible
4 165 (2.62%) Oozie
5 142 (2.25%) Terraform
6 135 (2.14%) Opscode Chef
7 130 (2.06%) Hadoop YARN
8 99 (1.57%) Kibana
9 81 (1.29%) Salt
10 61 (0.97%) Mesos
11 47 (0.75%) logstash
12 41 (0.65%) Docker Swarm
13 38 (0.60%) Grafana
14 33 (0.52%) Nagios
15 29 (0.46%) Prometheus
16 28 (0.44%) Rancher
16 28 (0.44%) ZABBIX
17 20 (0.32%) Suricata
18 15 (0.24%) Automic
18 15 (0.24%) vCenter Server
Vendors
1 691 (10.96%) Microsoft
2 484 (7.68%) Oracle
3 428 (6.79%) Tableau
4 376 (5.97%) Google
5 353 (5.60%) Cloudera
6 255 (4.05%) Hortonworks
7 198 (3.14%) SAP
8 175 (2.78%) Sybase
9 161 (2.55%) Informatica
10 137 (2.17%) Talend
11 135 (2.14%) IBM
12 131 (2.08%) VMware
13 104 (1.65%) MapR
14 85 (1.35%) Splunk
15 79 (1.25%) Databricks
16 74 (1.17%) Red Hat
17 73 (1.16%) Cisco
18 61 (0.97%) Atlassian
19 52 (0.83%) Adobe
20 49 (0.78%) Teradata