Period
to 25 September 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 25 September 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
25 Sep 2018
Same period 2017 Same period 2016
Rank 77 97 97
Rank change year-on-year +20 0 +34
Permanent jobs citing Big Data 6,453 5,707 5,659
As % of all permanent IT jobs advertised in the UK 3.85% 3.23% 2.96%
As % of the Database & Business Intelligence category 12.97% 10.57% 9.94%
Number of salaries quoted 4,424 4,621 4,583
UK median annual salary £65,000 £62,500 £60,500
Median salary % change year-on-year +4.00% +3.31% +0.83%
10th Percentile £37,500 £35,742 £37,500
90th Percentile £95,000 £91,250 £100,000
UK excluding London median annual salary £55,000 £52,500 £54,000
% change year-on-year +4.76% -2.78% +8.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 49,768 53,977 56,944
As % of all permanent IT jobs advertised in the UK 29.71% 30.60% 29.75%
Number of salaries quoted 40,603 44,428 48,504
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £82,500 £77,500 £76,000
UK excluding London median annual salary £45,000 £42,500 £41,500
% change year-on-year +5.88% +2.41% +3.75%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 25 September 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 25 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +21 6,091 £65,000 +4.00% 687
London +22 3,936 £70,000 +3.70% 364
UK excluding London +25 2,400 £55,000 +4.76% 365
South East -2 746 £60,000 +4.35% 99
North of England -20 397 £50,250 +0.50% 68
South West +53 367 £55,000 +4.76% 59
East of England +98 352 £60,000 +20.00% 47
North West -6 316 £50,000 - 45
Midlands +43 274 £60,000 +33.33% 50
Scotland -11 231 £47,500 -13.64% 20
West Midlands +53 151 £55,000 +29.41% 27
East Midlands +13 123 £75,000 +45.63% 23
Yorkshire -37 69 £53,750 +7.50% 15
Wales -3 24 £49,750 +17.06% 16
Northern Ireland +4 15 £38,750 +10.71% 6
North East -22 12 £31,250 -10.71% 8

For the 6 months to 25 September 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,751 (42.63%) Java
2 2,511 (38.91%) Agile Software Development
3 2,254 (34.93%) Python
4 2,081 (32.25%) SQL
5 2,014 (31.21%) Finance
6 1,998 (30.96%) Analytics
7 1,944 (30.13%) Hadoop
8 1,583 (24.53%) Apache Spark
9 1,374 (21.29%) Amazon AWS
10 1,333 (20.66%) Machine Learning
11 1,321 (20.47%) Problem-Solving
12 1,279 (19.82%) Degree
13 1,226 (19.00%) Banking
14 1,111 (17.22%) Analytical Skills
14 1,111 (17.22%) Data Science
15 1,030 (15.96%) Software Engineering
16 1,004 (15.56%) JavaScript
17 1,000 (15.50%) Linux
18 932 (14.44%) Kafka
19 930 (14.41%) Risk Management
20 928 (14.38%) Microsoft Azure
21 922 (14.29%) Scala
21 922 (14.29%) Investment Banking
22 909 (14.09%) NoSQL
23 891 (13.81%) C#
24 890 (13.79%) Business Intelligence
25 877 (13.59%) Financial Institution
25 877 (13.59%) Innovative Thinking
26 875 (13.56%) ETL
27 863 (13.37%) Low Latency

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,583 (24.53%) Apache Spark
2 354 (5.49%) Apache
3 334 (5.18%) Elasticsearch
4 233 (3.61%) Apache Pig
5 219 (3.39%) SAS
6 95 (1.47%) Apache Solr
7 74 (1.15%) Confluence
8 54 (0.84%) Tomcat
9 48 (0.74%) IIS
10 45 (0.70%) CMS
11 24 (0.37%) WebLogic
12 22 (0.34%) OpenStack
12 22 (0.34%) SharePoint
13 21 (0.33%) JBoss
13 21 (0.33%) WildFly
14 19 (0.29%) CloudStack
15 17 (0.26%) NServiceBus
16 15 (0.23%) Adobe Experience Manager
16 15 (0.23%) WebSphere
17 14 (0.22%) Jupyter
Applications
1 131 (2.03%) Microsoft Excel
2 66 (1.02%) Microsoft Office
3 46 (0.71%) Microsoft PowerPoint
4 40 (0.62%) GNU Octave
5 32 (0.50%) MS Visio
6 30 (0.46%) SPSS
7 21 (0.33%) Chatbot
8 9 (0.14%) Microsoft Project
9 8 (0.12%) RoboHelp
10 4 (0.062%) Adobe After Effects
10 4 (0.062%) Adobe Creative Suite
10 4 (0.062%) Adobe Illustrator
10 4 (0.062%) Adobe Premiere
10 4 (0.062%) Photoshop
11 3 (0.046%) Stata
11 3 (0.046%) Weka
12 2 (0.031%) CPLEX
12 2 (0.031%) EViews
12 2 (0.031%) Mathematica
12 2 (0.031%) PrintSoft PReS
Business Applications
1 26 (0.40%) SAP S/4HANA
2 25 (0.39%) Dynamics CRM
3 19 (0.29%) Dynamics NAV
4 18 (0.28%) Dynamics AX
5 8 (0.12%) Oracle Receivables
6 7 (0.11%) Oracle Payables
7 6 (0.093%) SAP ERP
7 6 (0.093%) Sentinel
8 5 (0.077%) Actimize
9 4 (0.062%) Oracle ERP
9 4 (0.062%) Oracle Procure-to-Pay
9 4 (0.062%) SAP Forecasting and Replenishment
9 4 (0.062%) SAP Retail
10 2 (0.031%) Distributed Ledger
10 2 (0.031%) Oracle BPM
10 2 (0.031%) Oracle EBS
10 2 (0.031%) SAP MII
10 2 (0.031%) SAP PM
10 2 (0.031%) Temenos T24
11 1 (0.015%) BASE24
Cloud Services
1 1,374 (21.29%) Amazon AWS
2 928 (14.38%) Microsoft Azure
3 279 (4.32%) Google Cloud Platform
4 214 (3.32%) SaaS
5 179 (2.77%) Cloud Computing
6 176 (2.73%) Serverless
7 172 (2.67%) PaaS
8 139 (2.15%) Amazon Kinesis
9 138 (2.14%) Amazon EMR
10 125 (1.94%) IaaS
11 108 (1.67%) Amazon S3
12 88 (1.36%) AWS Lambda
13 85 (1.32%) Azure Data Factory
14 75 (1.16%) GitHub
15 71 (1.10%) Amazon EC2
16 61 (0.95%) Cortana Intelligence Suite
17 41 (0.64%) IBM Cloud
18 36 (0.56%) Office 365
19 33 (0.51%) Adobe Analytics
20 29 (0.45%) Google Analytics
Communications & Networking
1 113 (1.75%) Firewall
2 104 (1.61%) Internet
3 83 (1.29%) TCP/IP
4 78 (1.21%) HTTP
5 64 (0.99%) SSL
6 50 (0.77%) DNS
7 46 (0.71%) Wireless
8 40 (0.62%) WAN
9 38 (0.59%) LAN
10 36 (0.56%) SAN
11 29 (0.45%) Network Security
12 28 (0.43%) Unified Communications
13 27 (0.42%) DHCP
13 27 (0.42%) Sourcefire
14 25 (0.39%) Kerberos
15 23 (0.36%) Wireless Security
16 22 (0.34%) Software-Defined Networking
17 20 (0.31%) WebEx
18 17 (0.26%) MPLS
19 16 (0.25%) OSPF
Database & Business Intelligence
1 1,944 (30.13%) Hadoop
2 909 (14.09%) NoSQL
3 786 (12.18%) Apache Hive
4 785 (12.16%) Data Warehouse
5 724 (11.22%) SQL Server
6 540 (8.37%) Relational Database
7 489 (7.58%) MongoDB
8 389 (6.03%) Apache Cassandra
9 369 (5.72%) Power BI
10 368 (5.70%) Data Lake
11 307 (4.76%) HBase
12 298 (4.62%) MySQL
13 276 (4.28%) SQL Server Integration Services
14 270 (4.18%) SQL Server Reporting Services
15 269 (4.17%) Amazon Redshift
16 249 (3.86%) Impala
17 228 (3.53%) RDBMS
18 215 (3.33%) PostgreSQL
19 153 (2.37%) DB2
20 148 (2.29%) SQL Server Analysis Services
Development Applications
1 512 (7.93%) Git (software)
2 297 (4.60%) Jenkins
3 278 (4.31%) JIRA
4 149 (2.31%) Selenium
5 143 (2.22%) JUnit
6 142 (2.20%) Visual Studio
7 131 (2.03%) Maven
8 109 (1.69%) Subversion
9 99 (1.53%) Atlassian Bamboo
10 96 (1.49%) Bitbucket
11 77 (1.19%) TeamCity
12 75 (1.16%) Gradle
13 56 (0.87%) Cucumber
14 52 (0.81%) Team Foundation Server
15 49 (0.76%) Mockito
16 48 (0.74%) Eclipse
17 43 (0.67%) CodeSonar
17 43 (0.67%) git-flow
17 43 (0.67%) Robot Framework
18 42 (0.65%) GitLab
General
1 2,014 (31.21%) Finance
2 1,226 (19.00%) Banking
3 922 (14.29%) Investment Banking
4 877 (13.59%) Financial Institution
5 399 (6.18%) Retail
6 388 (6.01%) Marketing
7 192 (2.98%) Telecoms
8 182 (2.82%) Front Office
9 153 (2.37%) Games
10 115 (1.78%) Electronics
11 98 (1.52%) Advertising
12 94 (1.46%) Law
13 89 (1.38%) Manufacturing
14 78 (1.21%) Military
15 71 (1.10%) Automotive
16 68 (1.05%) Legal
17 61 (0.95%) Pharmaceutical
18 54 (0.84%) Publishing
19 30 (0.46%) Multimedia
20 18 (0.28%) German Language
Job Titles
1 1,872 (29.01%) Developer
2 834 (12.92%) Architect
3 715 (11.08%) Data Engineer
4 655 (10.15%) Java Developer
5 484 (7.50%) Big Data Engineer
6 437 (6.77%) Software Engineer
7 378 (5.86%) Data Architect
8 345 (5.35%) Data Scientist
9 323 (5.01%) Analyst
9 323 (5.01%) Consultant
10 305 (4.73%) Senior Developer
11 297 (4.60%) Big Data Developer
12 239 (3.70%) Solutions Architect
13 212 (3.29%) Java Engineer
14 173 (2.68%) Big Data Architect
15 170 (2.63%) Software Developer
16 162 (2.51%) Junior
17 149 (2.31%) SQL Developer
18 147 (2.28%) DevOps Engineer
18 147 (2.28%) Python Developer
Libraries, Frameworks & Software Standards
1 932 (14.44%) Kafka
2 665 (10.31%) .NET
3 560 (8.68%) AngularJS
4 516 (8.00%) Web Services
5 498 (7.72%) HTML
6 441 (6.83%) RESTful
7 407 (6.31%) Spring
8 350 (5.42%) REST
9 337 (5.22%) React
10 304 (4.71%) Node.js
11 295 (4.57%) CSS
12 259 (4.01%) XML
13 237 (3.67%) HTML5
14 183 (2.84%) JSON
15 182 (2.82%) Natural Language Processing
16 181 (2.80%) RabbitMQ
17 167 (2.59%) SOAP
18 165 (2.56%) Hibernate
19 153 (2.37%) Django
20 150 (2.32%) ASP.NET
Miscellaneous
1 1,111 (17.22%) Analytical Skills
2 820 (12.71%) Computer Science
3 813 (12.60%) Cyberthreat
4 564 (8.74%) Algorithms
5 336 (5.21%) Greenfield Project
6 301 (4.66%) Fintech
7 278 (4.31%) User Experience
8 267 (4.14%) Data Structures
9 260 (4.03%) Management Information System
10 251 (3.89%) Self-Motivation
11 178 (2.76%) Data Centre
12 153 (2.37%) Fixed Income
13 149 (2.31%) Robotics
14 139 (2.15%) Mobile App
15 129 (2.00%) Equities
16 123 (1.91%) Public Cloud
17 119 (1.84%) Enterprise Software
18 105 (1.63%) Virtual Team
19 92 (1.43%) Derivative
20 78 (1.21%) Analytical Mindset
Operating Systems
1 1,000 (15.50%) Linux
2 429 (6.65%) Windows
3 393 (6.09%) Unix
4 126 (1.95%) Android
5 85 (1.32%) Apple iOS
6 60 (0.93%) CentOS
7 57 (0.88%) Red Hat Enterprise Linux
8 54 (0.84%) Ubuntu
8 54 (0.84%) Windows Server
9 43 (0.67%) Mac OS X
10 38 (0.59%) AIX
10 38 (0.59%) HPUX
10 38 (0.59%) Solaris
11 17 (0.26%) Windows Server 2008
12 13 (0.20%) Fedora
12 13 (0.20%) Windows Phone
13 10 (0.15%) Windows 7
13 10 (0.15%) Windows Server 2012
14 7 (0.11%) Windows 10
15 6 (0.093%) Debian
Processes & Methodologies
1 2,511 (38.91%) Agile Software Development
2 1,998 (30.96%) Analytics
3 1,333 (20.66%) Machine Learning
4 1,321 (20.47%) Problem-Solving
5 1,111 (17.22%) Data Science
6 1,030 (15.96%) Software Engineering
7 930 (14.41%) Risk Management
8 890 (13.79%) Business Intelligence
9 877 (13.59%) Innovative Thinking
10 875 (13.56%) ETL
11 863 (13.37%) Low Latency
12 846 (13.11%) Strategic Thinking
13 834 (12.92%) DevOps
14 821 (12.72%) Investment Management
15 782 (12.12%) TDD
16 726 (11.25%) Artificial Intelligence
17 657 (10.18%) Visualisation
18 640 (9.92%) Continuous Integration
19 626 (9.70%) Data Modelling
20 611 (9.47%) Data Analytics
Programming Languages
1 2,751 (42.63%) Java
2 2,254 (34.93%) Python
3 2,081 (32.25%) SQL
4 1,004 (15.56%) JavaScript
5 922 (14.29%) Scala
6 891 (13.81%) C#
7 682 (10.57%) C++
8 577 (8.94%) R
9 331 (5.13%) C
10 312 (4.83%) Java 8
11 266 (4.12%) Bash Shell
12 236 (3.66%) PowerShell
13 225 (3.49%) Perl
14 201 (3.11%) T-SQL
15 178 (2.76%) PHP
16 173 (2.68%) Shell Script
17 147 (2.28%) Ruby
18 139 (2.15%) MATLAB
19 130 (2.01%) Go
20 74 (1.15%) Objective-C
Qualifications
1 1,279 (19.82%) Degree
2 375 (5.81%) Computer Science Degree
3 276 (4.28%) PhD
4 255 (3.95%) Security Cleared
5 153 (2.37%) Master's Degree
6 146 (2.26%) DV Cleared
7 138 (2.14%) Numerate Degree
8 113 (1.75%) CISSP
9 82 (1.27%) Cisco Certification
10 79 (1.22%) Microsoft Certification
11 74 (1.15%) CCNA
12 73 (1.13%) SC Cleared
13 63 (0.98%) MCSE
14 61 (0.95%) SANS
15 59 (0.91%) GIAC
16 57 (0.88%) SSCP
17 51 (0.79%) CompTIA Security+
17 51 (0.79%) Linux+ Certification
17 51 (0.79%) Network+ Certification
18 47 (0.73%) PMI Certification
Quality Assurance & Compliance
1 265 (4.11%) QA
2 251 (3.89%) Data Quality
3 107 (1.66%) GDPR
4 58 (0.90%) ISO/IEC 27001
5 21 (0.33%) PMO
6 20 (0.31%) Solvency II
7 18 (0.28%) MiFID
7 18 (0.28%) PCI DSS
8 16 (0.25%) Dodd-Frank
8 16 (0.25%) FATCA
8 16 (0.25%) IFRS
8 16 (0.25%) IFRS 9
9 11 (0.17%) GPG13
10 10 (0.15%) COBIT
11 8 (0.12%) Sarbanes-Oxley
12 7 (0.11%) SLA
13 6 (0.093%) ISO 14001
14 5 (0.077%) Cyber Essentials
14 5 (0.077%) HMG Security Policy Framework
14 5 (0.077%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 569 (8.82%) Docker
2 292 (4.53%) HDFS
3 177 (2.74%) Apache Flume
4 87 (1.35%) VMware Infrastructure
5 75 (1.16%) vSphere
6 62 (0.96%) Active Directory
7 60 (0.93%) Virtual Machines
8 42 (0.65%) Apache ZooKeeper
9 33 (0.51%) VirtualBox
10 32 (0.50%) Virtual Desktop
10 32 (0.50%) VMware ESXi
11 31 (0.48%) Snort
12 20 (0.31%) Hyper-V
12 20 (0.31%) VMware NSX
13 14 (0.22%) iptables
14 12 (0.19%) NFS
14 12 (0.19%) Xen
15 8 (0.12%) Samba
16 7 (0.11%) LXC
16 7 (0.11%) XenDesktop
Systems Management
1 315 (4.88%) Kubernetes
2 279 (4.32%) Puppet
3 258 (4.00%) Ansible
4 156 (2.42%) Oozie
5 134 (2.08%) Terraform
6 129 (2.00%) Opscode Chef
7 120 (1.86%) Hadoop YARN
8 94 (1.46%) Kibana
9 74 (1.15%) Salt
10 61 (0.95%) Mesos
11 49 (0.76%) logstash
12 40 (0.62%) Docker Swarm
13 37 (0.57%) Grafana
14 29 (0.45%) Prometheus
15 27 (0.42%) Nagios
15 27 (0.42%) Rancher
15 27 (0.42%) ZABBIX
16 24 (0.37%) Suricata
17 17 (0.26%) ITRS Geneos
17 17 (0.26%) vCenter Server
Vendors
1 698 (10.82%) Microsoft
2 515 (7.98%) Oracle
3 442 (6.85%) Tableau
4 375 (5.81%) Google
5 339 (5.25%) Cloudera
6 237 (3.67%) Hortonworks
7 190 (2.94%) SAP
8 181 (2.80%) Sybase
9 163 (2.53%) Informatica
10 144 (2.23%) IBM
11 143 (2.22%) VMware
12 137 (2.12%) Talend
13 94 (1.46%) Splunk
14 93 (1.44%) MapR
15 84 (1.30%) Cisco
16 71 (1.10%) Atlassian
16 71 (1.10%) Red Hat
17 66 (1.02%) Databricks
18 56 (0.87%) Adobe
19 52 (0.81%) EMC