Period
to 19 July 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 19 July 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
19 Jul 2018
Same period 2017 Same period 2016
Rank 76 85 100
Rank change year-on-year +9 +15 +50
Permanent jobs citing Big Data 6,927 5,949 5,951
As % of all permanent IT jobs advertised in the UK 3.98% 3.35% 2.93%
As % of the Database & Business Intelligence category 13.09% 10.91% 9.68%
Number of salaries quoted 4,728 4,873 4,782
UK median annual salary £62,500 £62,500 £60,000
Median salary % change year-on-year - +4.17% -
10th Percentile £37,500 £35,076 £37,500
90th Percentile £95,000 £95,000 £100,000
UK excluding London median annual salary £55,000 £55,000 £52,500
% change year-on-year - +4.76% +5.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 52,926 54,546 61,480
As % of all permanent IT jobs advertised in the UK 30.40% 30.70% 30.26%
Number of salaries quoted 43,136 45,755 52,379
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £28,750
90th Percentile £81,250 £77,500 £75,000
UK excluding London median annual salary £45,000 £42,500 £41,000
% change year-on-year +5.88% +3.66% +2.50%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 19 July 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 19 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +13 6,570 £65,000 +4.00% 731
London +24 4,285 £70,000 +3.70% 434
UK excluding London +12 2,512 £55,000 - 353
South East -6 818 £60,000 +4.35% 109
North of England -12 473 £50,000 -4.76% 81
South West +29 364 £55,000 - 35
East of England +59 339 £60,000 +21.83% 42
North West -11 322 £50,000 -4.76% 59
Midlands +2 276 £55,000 +10.00% 29
Scotland -21 202 £50,000 -16.67% 39
West Midlands +57 174 £55,000 +15.79% 14
Yorkshire +1 123 £55,000 +10.00% 20
East Midlands -39 100 £68,750 +33.50% 15
Wales +4 36 £47,200 +4.89% 8
North East -10 28 £42,500 +21.43% 2
Northern Ireland -5 15 £37,500 +8.70% 9

For the 6 months to 19 July 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,932 (42.33%) Java
2 2,558 (36.93%) Agile Software Development
3 2,485 (35.87%) Python
4 2,384 (34.42%) Analytics
5 2,204 (31.82%) SQL
6 2,080 (30.03%) Hadoop
7 2,078 (30.00%) Finance
8 1,713 (24.73%) Apache Spark
9 1,548 (22.35%) Machine Learning
10 1,489 (21.50%) Problem-Solving
11 1,477 (21.32%) Amazon AWS
12 1,351 (19.50%) Degree
13 1,318 (19.03%) Data Science
14 1,295 (18.69%) Banking
15 1,221 (17.63%) Analytical Skills
16 1,090 (15.74%) Scala
17 1,083 (15.63%) Software Engineering
18 1,048 (15.13%) Business Intelligence
19 1,046 (15.10%) Linux
20 1,010 (14.58%) JavaScript
21 992 (14.32%) Risk Management
21 992 (14.32%) Investment Banking
22 974 (14.06%) NoSQL
23 971 (14.02%) Kafka
24 936 (13.51%) Microsoft Azure
25 935 (13.50%) DevOps
25 935 (13.50%) Innovative Thinking
26 930 (13.43%) Low Latency
26 930 (13.43%) Financial Institution
27 929 (13.41%) ETL

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,713 (24.73%) Apache Spark
2 358 (5.17%) Elasticsearch
3 318 (4.59%) Apache
4 251 (3.62%) Apache Pig
5 246 (3.55%) SAS
6 142 (2.05%) Apache Solr
7 73 (1.05%) Confluence
8 68 (0.98%) Tomcat
9 46 (0.66%) IIS
10 37 (0.53%) CMS
11 32 (0.46%) SharePoint
12 30 (0.43%) JBoss
13 26 (0.38%) OpenStack
14 23 (0.33%) CloudStack
15 22 (0.32%) Jetty
15 22 (0.32%) NServiceBus
16 20 (0.29%) WebLogic
17 19 (0.27%) WildFly
18 16 (0.23%) nginx
18 16 (0.23%) Oracle SOA Suite
Applications
1 124 (1.79%) Microsoft Excel
2 69 (1.00%) Microsoft Office
3 41 (0.59%) SPSS
4 37 (0.53%) MS Visio
5 33 (0.48%) GNU Octave
6 27 (0.39%) Microsoft PowerPoint
7 23 (0.33%) Chatbot
8 11 (0.16%) Microsoft Project
9 5 (0.072%) Mathematica
10 4 (0.058%) InVision
10 4 (0.058%) OmniGraffle
10 4 (0.058%) Stata
10 4 (0.058%) UXPin
11 3 (0.043%) Adobe Creative Suite
11 3 (0.043%) Adobe Illustrator
11 3 (0.043%) Adobe Premiere
11 3 (0.043%) Photoshop
11 3 (0.043%) RoboHelp
11 3 (0.043%) Spreadsheet
11 3 (0.043%) Weka
Business Applications
1 37 (0.53%) Dynamics CRM
2 22 (0.32%) Dynamics AX
3 17 (0.25%) Dynamics NAV
4 15 (0.22%) SAP S/4HANA
5 6 (0.087%) Oracle Procure-to-Pay
5 6 (0.087%) Sentinel
6 5 (0.072%) Actimize
6 5 (0.072%) Distributed Ledger
6 5 (0.072%) SAP MDG
7 4 (0.058%) Cognos Business Intelligence
7 4 (0.058%) JDE OneWorld
7 4 (0.058%) Oracle ERP
7 4 (0.058%) Oracle Payables
7 4 (0.058%) Oracle Receivables
7 4 (0.058%) SAP Forecasting and Replenishment
7 4 (0.058%) SAP Retail
8 3 (0.043%) Cognos TM1
8 3 (0.043%) Markit EDM
8 3 (0.043%) Oracle BPM
9 2 (0.029%) Temenos T24
Cloud Services
1 1,477 (21.32%) Amazon AWS
2 936 (13.51%) Microsoft Azure
3 219 (3.16%) SaaS
4 205 (2.96%) Google Cloud Platform
5 200 (2.89%) Serverless
6 182 (2.63%) Cloud Computing
7 157 (2.27%) Amazon EMR
8 152 (2.19%) IaaS
9 144 (2.08%) Amazon Kinesis
10 143 (2.06%) Amazon S3
11 137 (1.98%) GitHub
12 124 (1.79%) PaaS
13 109 (1.57%) Azure Data Factory
14 98 (1.41%) Cortana Intelligence Suite
15 95 (1.37%) AWS Lambda
16 74 (1.07%) Amazon EC2
17 47 (0.68%) IBM Cloud
18 37 (0.53%) Adobe Analytics
18 37 (0.53%) Office 365
19 36 (0.52%) Google Analytics
Communications & Networking
1 120 (1.73%) Internet
2 109 (1.57%) Firewall
3 101 (1.46%) Wireless
4 79 (1.14%) TCP/IP
5 77 (1.11%) HTTP
6 59 (0.85%) DNS
7 49 (0.71%) SSL
8 48 (0.69%) Unified Communications
9 42 (0.61%) LAN
10 41 (0.59%) WAN
11 39 (0.56%) Wireless Security
12 37 (0.53%) DHCP
13 36 (0.52%) SAN
14 33 (0.48%) Kerberos
15 29 (0.42%) Network Security
15 29 (0.42%) SMS
16 23 (0.33%) Sourcefire
17 22 (0.32%) Cisco IOS
18 19 (0.27%) MPLS
19 18 (0.26%) OSPF
Database & Business Intelligence
1 2,080 (30.03%) Hadoop
2 974 (14.06%) NoSQL
3 828 (11.95%) Data Warehouse
4 820 (11.84%) Apache Hive
5 696 (10.05%) SQL Server
6 545 (7.87%) Relational Database
7 532 (7.68%) MongoDB
8 471 (6.80%) Data Lake
9 448 (6.47%) Apache Cassandra
10 395 (5.70%) Power BI
11 349 (5.04%) HBase
12 317 (4.58%) MySQL
13 307 (4.43%) Impala
14 287 (4.14%) SQL Server Integration Services
15 258 (3.72%) Amazon Redshift
16 256 (3.70%) SQL Server Reporting Services
17 254 (3.67%) RDBMS
18 250 (3.61%) PostgreSQL
19 192 (2.77%) SQL Server Analysis Services
20 184 (2.66%) Sqoop
Development Applications
1 472 (6.81%) Git (software)
2 351 (5.07%) Jenkins
3 312 (4.50%) JIRA
4 164 (2.37%) JUnit
5 158 (2.28%) Visual Studio
6 134 (1.93%) Selenium
7 127 (1.83%) Maven
8 118 (1.70%) Atlassian Bamboo
9 112 (1.62%) Bitbucket
10 108 (1.56%) Subversion
11 96 (1.39%) Gradle
12 95 (1.37%) TeamCity
13 79 (1.14%) Cucumber
13 79 (1.14%) Mockito
14 54 (0.78%) Calabash
14 54 (0.78%) fastlane
15 51 (0.74%) Team Foundation Server
16 47 (0.68%) GitLab
17 39 (0.56%) Eclipse
18 37 (0.53%) Android Studio
General
1 2,078 (30.00%) Finance
2 1,295 (18.69%) Banking
3 992 (14.32%) Investment Banking
4 930 (13.43%) Financial Institution
5 474 (6.84%) Marketing
6 422 (6.09%) Retail
7 234 (3.38%) Telecoms
8 210 (3.03%) Front Office
9 151 (2.18%) Games
10 135 (1.95%) Electronics
11 119 (1.72%) Advertising
12 112 (1.62%) Manufacturing
13 83 (1.20%) Legal
14 82 (1.18%) Law
14 82 (1.18%) Pharmaceutical
15 68 (0.98%) Publishing
16 56 (0.81%) Military
17 35 (0.51%) Automotive
18 33 (0.48%) Multimedia
19 15 (0.22%) Billing
Job Titles
1 1,894 (27.34%) Developer
2 936 (13.51%) Architect
3 771 (11.13%) Data Engineer
4 641 (9.25%) Java Developer
5 518 (7.48%) Big Data Engineer
6 418 (6.03%) Data Scientist
7 417 (6.02%) Software Engineer
8 409 (5.90%) Data Architect
9 405 (5.85%) Analyst
10 325 (4.69%) Consultant
11 323 (4.66%) Big Data Developer
12 298 (4.30%) Senior Developer
13 255 (3.68%) Solutions Architect
14 233 (3.36%) Big Data Architect
15 203 (2.93%) DevOps Engineer
15 203 (2.93%) Java Engineer
16 178 (2.57%) Software Developer
17 172 (2.48%) Technical Architect
18 163 (2.35%) Python Developer
19 162 (2.34%) Junior
Libraries, Frameworks & Software Standards
1 971 (14.02%) Kafka
2 672 (9.70%) .NET
3 583 (8.42%) AngularJS
4 571 (8.24%) Web Services
5 496 (7.16%) HTML
6 433 (6.25%) RESTful
7 381 (5.50%) Spring
8 364 (5.25%) REST
9 310 (4.48%) XML
10 307 (4.43%) React
11 299 (4.32%) Node.js
12 287 (4.14%) CSS
13 243 (3.51%) HTML5
14 240 (3.46%) Natural Language Processing
15 201 (2.90%) JSON
16 194 (2.80%) RabbitMQ
17 154 (2.22%) SOAP
18 144 (2.08%) Django
18 144 (2.08%) TensorFlow
19 130 (1.88%) Hibernate
Miscellaneous
1 1,221 (17.63%) Analytical Skills
2 884 (12.76%) Cyberthreat
3 880 (12.70%) Computer Science
4 626 (9.04%) Algorithms
5 356 (5.14%) Greenfield Project
6 340 (4.91%) User Experience
7 339 (4.89%) Fintech
8 254 (3.67%) Management Information System
9 249 (3.59%) Data Structures
10 247 (3.57%) Self-Motivation
11 192 (2.77%) Data Centre
12 175 (2.53%) Fixed Income
13 164 (2.37%) Mobile App
14 143 (2.06%) Equities
15 138 (1.99%) Public Cloud
16 134 (1.93%) Enterprise Software
17 119 (1.72%) Virtual Team
18 101 (1.46%) Robotics
19 93 (1.34%) Derivative
20 84 (1.21%) Analytical Mindset
Operating Systems
1 1,046 (15.10%) Linux
2 433 (6.25%) Unix
3 401 (5.79%) Windows
4 129 (1.86%) Android
5 96 (1.39%) Apple iOS
6 66 (0.95%) Red Hat Enterprise Linux
7 62 (0.90%) Windows Server
8 54 (0.78%) CentOS
9 43 (0.62%) Ubuntu
10 36 (0.52%) AIX
11 35 (0.51%) Solaris
12 33 (0.48%) HPUX
12 33 (0.48%) Mac OS X
13 17 (0.25%) Windows Server 2012
14 13 (0.19%) Windows Server 2008
15 11 (0.16%) Windows 10
15 11 (0.16%) Windows 7
16 10 (0.14%) Debian
16 10 (0.14%) Mac OS
17 7 (0.10%) Windows Phone
Processes & Methodologies
1 2,558 (36.93%) Agile Software Development
2 2,384 (34.42%) Analytics
3 1,548 (22.35%) Machine Learning
4 1,489 (21.50%) Problem-Solving
5 1,318 (19.03%) Data Science
6 1,083 (15.63%) Software Engineering
7 1,048 (15.13%) Business Intelligence
8 992 (14.32%) Risk Management
9 935 (13.50%) DevOps
9 935 (13.50%) Innovative Thinking
10 930 (13.43%) Low Latency
11 929 (13.41%) ETL
12 914 (13.19%) Strategic Thinking
13 899 (12.98%) Investment Management
14 856 (12.36%) TDD
15 784 (11.32%) Data Analytics
16 698 (10.08%) Visualisation
17 655 (9.46%) Artificial Intelligence
18 645 (9.31%) Mathematics
19 634 (9.15%) Scrum
Programming Languages
1 2,932 (42.33%) Java
2 2,485 (35.87%) Python
3 2,204 (31.82%) SQL
4 1,090 (15.74%) Scala
5 1,010 (14.58%) JavaScript
6 922 (13.31%) C#
7 782 (11.29%) C++
8 682 (9.85%) R
9 326 (4.71%) C
10 255 (3.68%) Bash Shell
10 255 (3.68%) Perl
11 236 (3.41%) Java 8
12 218 (3.15%) T-SQL
13 194 (2.80%) Shell Script
14 188 (2.71%) Go
15 176 (2.54%) PowerShell
16 164 (2.37%) MATLAB
16 164 (2.37%) Ruby
17 149 (2.15%) PHP
18 72 (1.04%) U-SQL
Qualifications
1 1,351 (19.50%) Degree
2 356 (5.14%) Computer Science Degree
3 352 (5.08%) PhD
4 213 (3.07%) Security Cleared
5 169 (2.44%) Master's Degree
6 131 (1.89%) Numerate Degree
7 104 (1.50%) DV Cleared
8 89 (1.28%) CISSP
9 83 (1.20%) Cisco Certification
10 79 (1.14%) CCNA
11 69 (1.00%) Microsoft Certification
12 57 (0.82%) SANS
13 53 (0.77%) SC Cleared
14 49 (0.71%) MCSE
15 48 (0.69%) PMI Certification
16 47 (0.68%) GIAC
17 44 (0.64%) SSCP
18 43 (0.62%) CompTIA Security+
19 42 (0.61%) CCIE
19 42 (0.61%) ISEB
Quality Assurance & Compliance
1 283 (4.09%) QA
2 258 (3.72%) Data Quality
3 133 (1.92%) GDPR
4 59 (0.85%) GCP
5 39 (0.56%) ISO/IEC 27001
6 24 (0.35%) MiFID
7 20 (0.29%) Solvency II
8 19 (0.27%) PCI DSS
9 16 (0.23%) Sarbanes-Oxley
10 15 (0.22%) Dodd-Frank
11 14 (0.20%) FATCA
12 13 (0.19%) IFRS
12 13 (0.19%) IFRS 9
13 11 (0.16%) SLA
14 9 (0.13%) PMO
15 8 (0.12%) GPG13
16 7 (0.10%) COBIT
16 7 (0.10%) HMG Security Policy Framework
16 7 (0.10%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
17 6 (0.087%) EMIR
System Software
1 566 (8.17%) Docker
2 314 (4.53%) HDFS
3 227 (3.28%) Apache Flume
4 104 (1.50%) Virtual Machines
5 98 (1.41%) VMware Infrastructure
6 69 (1.00%) vSphere
7 67 (0.97%) Active Directory
8 44 (0.64%) Apache ZooKeeper
9 31 (0.45%) VMware ESXi
10 28 (0.40%) Hyper-V
11 25 (0.36%) VMware NSX
12 24 (0.35%) Virtual Desktop
13 23 (0.33%) Snort
13 23 (0.33%) VirtualBox
14 17 (0.25%) NFS
15 8 (0.12%) Microsoft App-V
16 7 (0.10%) XenDesktop
17 6 (0.087%) KVM
18 5 (0.072%) Samba
19 4 (0.058%) Xen
Systems Management
1 299 (4.32%) Puppet
2 288 (4.16%) Ansible
2 288 (4.16%) Kubernetes
3 165 (2.38%) Opscode Chef
4 156 (2.25%) Oozie
5 148 (2.14%) Terraform
6 143 (2.06%) Hadoop YARN
7 89 (1.28%) Salt
8 80 (1.15%) Kibana
9 73 (1.05%) Mesos
10 44 (0.64%) logstash
11 37 (0.53%) HockeyApp
12 28 (0.40%) Ambari
13 27 (0.39%) Consul
13 27 (0.39%) Rancher
14 26 (0.38%) Docker Swarm
15 22 (0.32%) Packer
16 20 (0.29%) Suricata
17 19 (0.27%) Grafana
17 19 (0.27%) ZABBIX
Vendors
1 752 (10.86%) Microsoft
2 572 (8.26%) Oracle
3 501 (7.23%) Tableau
4 397 (5.73%) Cloudera
5 372 (5.37%) Google
6 254 (3.67%) Hortonworks
7 207 (2.99%) Sybase
8 177 (2.56%) Informatica
9 165 (2.38%) Talend
10 156 (2.25%) SAP
11 154 (2.22%) IBM
11 154 (2.22%) VMware
12 123 (1.78%) Atlassian
13 118 (1.70%) Cisco
14 106 (1.53%) Splunk
15 92 (1.33%) Red Hat
16 72 (1.04%) MapR
16 72 (1.04%) Teradata
17 71 (1.02%) WorldPay
18 66 (0.95%) Salesforce.com