Period
to 21 May 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 May 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
21 May 2018
Same period 2017 Same period 2016
Rank 75 83 97
Rank change year-on-year +8 +14 +63
Permanent jobs citing Big Data 6,653 5,708 6,040
As % of all permanent IT jobs advertised in the UK 3.87% 3.38% 3.00%
As % of the Database & Business Intelligence category 12.63% 10.94% 9.68%
Number of salaries quoted 4,891 4,799 4,834
UK median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% -
10th Percentile £38,625 £36,250 £37,500
90th Percentile £95,000 £95,000 £96,250
UK excluding London median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 52,686 52,174 62,384
As % of all permanent IT jobs advertised in the UK 30.68% 30.90% 31.03%
Number of salaries quoted 43,330 44,260 53,072
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £28,750
90th Percentile £80,000 £77,500 £75,000
UK excluding London median annual salary £44,000 £42,000 £41,500
% change year-on-year +4.76% +1.20% +3.75%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 21 May 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 21 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +8 6,344 £65,000 +4.00% 873
London +17 4,032 £70,000 +3.70% 553
UK excluding London +14 2,506 £55,000 - 384
South East -2 802 £60,000 +9.09% 97
North of England +26 482 £50,000 -9.09% 85
South West +14 395 £53,750 -2.27% 43
East of England +62 340 £60,000 +20.00% 49
North West -8 324 £50,000 -9.09% 52
Midlands -19 263 £55,000 +4.76% 46
Scotland -22 184 £50,000 -16.67% 46
West Midlands +20 161 £55,000 - 29
Yorkshire +38 127 £55,000 - 24
East Midlands -48 100 £62,500 +19.05% 17
Wales +11 37 £47,500 +5.56% 8
North East -4 31 £42,500 +21.43% 9
Northern Ireland +2 11 £42,500 +21.43% 10

For the 6 months to 21 May 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,774 (41.70%) Java
2 2,434 (36.58%) Python
3 2,402 (36.10%) Agile Software Development
4 2,329 (35.01%) Analytics
5 2,116 (31.81%) Hadoop
6 2,091 (31.43%) SQL
7 1,739 (26.14%) Apache Spark
8 1,737 (26.11%) Finance
9 1,623 (24.40%) Machine Learning
10 1,520 (22.85%) Amazon AWS
11 1,282 (19.27%) Data Science
12 1,211 (18.20%) Problem-Solving
13 1,203 (18.08%) Degree
14 1,135 (17.06%) Scala
15 1,076 (16.17%) Business Intelligence
16 1,053 (15.83%) Analytical Skills
17 1,048 (15.75%) Software Engineering
18 963 (14.47%) Microsoft Azure
19 935 (14.05%) NoSQL
20 925 (13.90%) Linux
21 924 (13.89%) Banking
22 920 (13.83%) DevOps
23 906 (13.62%) TDD
24 899 (13.51%) JavaScript
25 876 (13.17%) Kafka
26 851 (12.79%) ETL
27 816 (12.27%) Computer Science
28 807 (12.13%) Data Analytics
29 801 (12.04%) C#
30 794 (11.93%) Data Warehouse

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,739 (26.14%) Apache Spark
2 383 (5.76%) Elasticsearch
3 290 (4.36%) Apache
4 270 (4.06%) SAS
5 224 (3.37%) Apache Pig
6 155 (2.33%) Apache Solr
7 77 (1.16%) Tomcat
8 59 (0.89%) Confluence
9 44 (0.66%) IIS
10 43 (0.65%) JBoss
11 34 (0.51%) OpenStack
12 26 (0.39%) SharePoint
13 23 (0.35%) CMS
14 21 (0.32%) Jetty
14 21 (0.32%) NServiceBus
14 21 (0.32%) WebSphere
15 20 (0.30%) Apache Airflow
15 20 (0.30%) Oracle SOA Suite
16 19 (0.29%) nginx
17 18 (0.27%) Oracle Service Bus
Applications
1 96 (1.44%) Microsoft Excel
2 66 (0.99%) Microsoft Office
3 49 (0.74%) SPSS
4 30 (0.45%) MS Visio
5 24 (0.36%) GNU Octave
6 18 (0.27%) Microsoft Project
7 17 (0.26%) Microsoft PowerPoint
8 13 (0.20%) Chatbot
9 12 (0.18%) Weka
10 6 (0.090%) Mathematica
10 6 (0.090%) Stata
11 4 (0.060%) InVision
11 4 (0.060%) OmniGraffle
11 4 (0.060%) UXPin
12 3 (0.045%) Spreadsheet
13 2 (0.030%) PrintSoft PReS
14 1 (0.015%) AutoCAD
14 1 (0.015%) CPLEX
14 1 (0.015%) Mingle
14 1 (0.015%) SOLIDWORKS
Business Applications
1 29 (0.44%) Dynamics CRM
2 12 (0.18%) Dynamics AX
3 9 (0.14%) SAP S/4HANA
4 5 (0.075%) Cognos Business Intelligence
4 5 (0.075%) Distributed Ledger
4 5 (0.075%) SAP MDG
5 4 (0.060%) Cognos TM1
5 4 (0.060%) JDE OneWorld
5 4 (0.060%) Oracle BPM
5 4 (0.060%) Oracle Procure-to-Pay
5 4 (0.060%) Oracle Receivables
5 4 (0.060%) SAP Forecasting and Replenishment
5 4 (0.060%) SAP Retail
6 3 (0.045%) Actimize
6 3 (0.045%) Markit EDM
6 3 (0.045%) Sentinel
7 2 (0.030%) Dynamics NAV
7 2 (0.030%) Oracle ERP
7 2 (0.030%) Oracle Payables
7 2 (0.030%) SAP Hybris
Cloud Services
1 1,520 (22.85%) Amazon AWS
2 963 (14.47%) Microsoft Azure
3 223 (3.35%) SaaS
4 206 (3.10%) Google Cloud Platform
5 194 (2.92%) Serverless
6 165 (2.48%) IaaS
7 155 (2.33%) GitHub
8 149 (2.24%) Azure Data Factory
9 145 (2.18%) Cloud Computing
10 142 (2.13%) Amazon S3
11 140 (2.10%) Amazon EMR
12 135 (2.03%) Cortana Intelligence Suite
13 120 (1.80%) Amazon Kinesis
14 110 (1.65%) PaaS
15 84 (1.26%) AWS Lambda
16 61 (0.92%) Amazon EC2
17 52 (0.78%) IBM Cloud
18 42 (0.63%) Bluemix
19 38 (0.57%) Google Analytics
20 35 (0.53%) AWS CloudFormation
Communications & Networking
1 164 (2.47%) Wireless
2 122 (1.83%) Internet
3 87 (1.31%) Firewall
4 74 (1.11%) HTTP
5 62 (0.93%) Unified Communications
6 57 (0.86%) DNS
7 53 (0.80%) TCP/IP
7 53 (0.80%) Wireless Security
8 44 (0.66%) SSL
9 43 (0.65%) LAN
10 42 (0.63%) WAN
11 39 (0.59%) SAN
12 37 (0.56%) Network Security
13 35 (0.53%) Kerberos
14 34 (0.51%) DHCP
15 31 (0.47%) SMS
16 21 (0.32%) Sourcefire
17 18 (0.27%) Cisco IOS
18 15 (0.23%) MPLS
19 14 (0.21%) OSPF
Database & Business Intelligence
1 2,116 (31.81%) Hadoop
2 935 (14.05%) NoSQL
3 794 (11.93%) Data Warehouse
4 776 (11.66%) Apache Hive
5 614 (9.23%) SQL Server
6 557 (8.37%) MongoDB
7 520 (7.82%) Relational Database
8 489 (7.35%) Data Lake
9 476 (7.15%) Apache Cassandra
10 428 (6.43%) HBase
11 383 (5.76%) Power BI
12 304 (4.57%) MySQL
13 303 (4.55%) Impala
14 269 (4.04%) SQL Server Integration Services
15 258 (3.88%) RDBMS
16 244 (3.67%) PostgreSQL
17 233 (3.50%) Amazon Redshift
18 206 (3.10%) SQL Server Reporting Services
19 199 (2.99%) Data Mining
20 185 (2.78%) SQL Server Analysis Services
Development Applications
1 466 (7.00%) Git (software)
2 345 (5.19%) JIRA
3 344 (5.17%) Jenkins
4 167 (2.51%) JUnit
5 158 (2.37%) Atlassian Bamboo
6 155 (2.33%) Visual Studio
7 140 (2.10%) Bitbucket
8 117 (1.76%) Gradle
9 111 (1.67%) Selenium
10 106 (1.59%) Calabash
10 106 (1.59%) fastlane
11 105 (1.58%) Maven
12 103 (1.55%) TeamCity
13 94 (1.41%) Mockito
14 90 (1.35%) Subversion
15 80 (1.20%) Cucumber
16 67 (1.01%) Android Studio
17 49 (0.74%) Eclipse
18 48 (0.72%) Team Foundation Server
19 39 (0.59%) CocoaPods
General
1 1,737 (26.11%) Finance
2 924 (13.89%) Banking
3 656 (9.86%) Investment Banking
4 596 (8.96%) Financial Institution
5 468 (7.03%) Marketing
6 427 (6.42%) Retail
7 290 (4.36%) Telecoms
8 203 (3.05%) Electronics
9 180 (2.71%) Front Office
10 157 (2.36%) Manufacturing
11 148 (2.22%) Games
12 126 (1.89%) Advertising
13 88 (1.32%) Publishing
14 80 (1.20%) Pharmaceutical
15 69 (1.04%) Legal
16 58 (0.87%) Law
17 38 (0.57%) Automotive
17 38 (0.57%) Military
18 25 (0.38%) Multimedia
19 19 (0.29%) Billing
Job Titles
1 1,808 (27.18%) Developer
2 968 (14.55%) Architect
3 743 (11.17%) Data Engineer
4 642 (9.65%) Java Developer
5 487 (7.32%) Big Data Engineer
6 427 (6.42%) Data Architect
7 424 (6.37%) Data Scientist
8 399 (6.00%) Analyst
9 350 (5.26%) Software Engineer
10 328 (4.93%) Consultant
11 323 (4.85%) Senior Developer
12 301 (4.52%) Big Data Developer
13 243 (3.65%) Big Data Architect
14 242 (3.64%) Solutions Architect
15 235 (3.53%) DevOps Engineer
16 185 (2.78%) Technical Architect
17 179 (2.69%) Java Engineer
18 159 (2.39%) Senior Java Developer
19 158 (2.37%) Python Developer
20 155 (2.33%) Software Developer
Libraries, Frameworks & Software Standards
1 876 (13.17%) Kafka
2 591 (8.88%) .NET
3 500 (7.52%) AngularJS
3 500 (7.52%) Web Services
4 441 (6.63%) HTML
5 355 (5.34%) Spring
6 328 (4.93%) RESTful
7 313 (4.70%) Node.js
8 306 (4.60%) REST
9 296 (4.45%) React
10 282 (4.24%) CSS
11 267 (4.01%) XML
12 247 (3.71%) Natural Language Processing
13 183 (2.75%) HTML5
14 175 (2.63%) JSON
15 172 (2.59%) RabbitMQ
16 137 (2.06%) SOAP
17 133 (2.00%) J2EE
18 130 (1.95%) TensorFlow
19 125 (1.88%) Django
Miscellaneous
1 1,053 (15.83%) Analytical Skills
2 816 (12.27%) Computer Science
3 574 (8.63%) Algorithms
4 546 (8.21%) Cyberthreat
5 403 (6.06%) User Experience
6 332 (4.99%) Greenfield Project
7 330 (4.96%) Fintech
8 213 (3.20%) Data Centre
9 208 (3.13%) Management Information System
10 199 (2.99%) Data Structures
11 188 (2.83%) Self-Motivation
12 162 (2.43%) Mobile App
13 123 (1.85%) Fixed Income
14 119 (1.79%) Enterprise Software
15 112 (1.68%) Public Cloud
16 111 (1.67%) Equities
17 92 (1.38%) Virtual Team
18 80 (1.20%) Robotics
19 68 (1.02%) Derivative
19 68 (1.02%) Hedge funds
Operating Systems
1 925 (13.90%) Linux
2 375 (5.64%) Unix
3 307 (4.61%) Windows
4 118 (1.77%) Android
5 89 (1.34%) Apple iOS
6 68 (1.02%) Red Hat Enterprise Linux
7 47 (0.71%) Windows Server
8 44 (0.66%) CentOS
9 34 (0.51%) Ubuntu
10 25 (0.38%) AIX
10 25 (0.38%) Solaris
11 22 (0.33%) HPUX
12 19 (0.29%) Mac OS X
13 16 (0.24%) Mac OS
14 14 (0.21%) Windows Server 2012
15 10 (0.15%) Robot Operating System
15 10 (0.15%) Windows 10
15 10 (0.15%) Windows 7
16 9 (0.14%) Debian
17 6 (0.090%) Oracle Linux
Processes & Methodologies
1 2,402 (36.10%) Agile Software Development
2 2,329 (35.01%) Analytics
3 1,623 (24.40%) Machine Learning
4 1,282 (19.27%) Data Science
5 1,211 (18.20%) Problem-Solving
6 1,076 (16.17%) Business Intelligence
7 1,048 (15.75%) Software Engineering
8 920 (13.83%) DevOps
9 906 (13.62%) TDD
10 851 (12.79%) ETL
11 807 (12.13%) Data Analytics
12 677 (10.18%) Visualisation
13 655 (9.85%) Risk Management
14 640 (9.62%) Artificial Intelligence
14 640 (9.62%) Scrum
15 620 (9.32%) Mathematics
16 613 (9.21%) Microservices
17 586 (8.81%) Low Latency
18 584 (8.78%) Innovative Thinking
19 571 (8.58%) Investment Management
Programming Languages
1 2,774 (41.70%) Java
2 2,434 (36.58%) Python
3 2,091 (31.43%) SQL
4 1,135 (17.06%) Scala
5 899 (13.51%) JavaScript
6 801 (12.04%) C#
7 757 (11.38%) C++
8 663 (9.97%) R
9 261 (3.92%) C
10 234 (3.52%) Java 8
11 230 (3.46%) Bash Shell
12 215 (3.23%) Perl
13 202 (3.04%) Go
14 175 (2.63%) Ruby
15 170 (2.56%) MATLAB
16 168 (2.53%) Shell Script
17 163 (2.45%) T-SQL
18 145 (2.18%) PHP
19 91 (1.37%) PowerShell
20 85 (1.28%) U-SQL
Qualifications
1 1,203 (18.08%) Degree
2 327 (4.92%) PhD
3 296 (4.45%) Computer Science Degree
4 167 (2.51%) Security Cleared
5 139 (2.09%) Master's Degree
6 118 (1.77%) Numerate Degree
7 76 (1.14%) Cisco Certification
8 73 (1.10%) CISSP
9 69 (1.04%) CCNA
10 60 (0.90%) DV Cleared
11 56 (0.84%) CCIE
12 51 (0.77%) Microsoft Certification
13 50 (0.75%) ISEB
13 50 (0.75%) SC Cleared
14 45 (0.68%) CCNP
15 44 (0.66%) TOGAF Certification
16 42 (0.63%) SANS
17 38 (0.57%) CEH
18 31 (0.47%) GIAC
19 26 (0.39%) MCSE
Quality Assurance & Compliance
1 267 (4.01%) QA
2 235 (3.53%) Data Quality
3 133 (2.00%) GDPR
4 50 (0.75%) ISO/IEC 27001
5 42 (0.63%) GCP
6 28 (0.42%) PCI DSS
7 24 (0.36%) Sarbanes-Oxley
8 19 (0.29%) MiFID
9 18 (0.27%) Solvency II
10 15 (0.23%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
11 14 (0.21%) HMG Security Policy Framework
12 12 (0.18%) Dodd-Frank
12 12 (0.18%) GPG13
13 11 (0.17%) FATCA
13 11 (0.17%) SLA
14 9 (0.14%) IFRS
14 9 (0.14%) IFRS 9
15 8 (0.12%) Actionable Recommendations
15 8 (0.12%) PMO
16 7 (0.11%) EMIR
System Software
1 578 (8.69%) Docker
2 300 (4.51%) HDFS
3 227 (3.41%) Apache Flume
4 117 (1.76%) Virtual Machines
5 105 (1.58%) VMware Infrastructure
6 63 (0.95%) Active Directory
7 42 (0.63%) vSphere
8 39 (0.59%) Apache ZooKeeper
9 31 (0.47%) Hyper-V
10 29 (0.44%) VMware ESXi
11 28 (0.42%) VMware NSX
12 21 (0.32%) Snort
13 20 (0.30%) NFS
14 15 (0.23%) VirtualBox
15 8 (0.12%) Virtual Desktop
16 5 (0.075%) BitLocker
16 5 (0.075%) KVM
16 5 (0.075%) Microsoft App-V
17 4 (0.060%) XenDesktop
18 3 (0.045%) Oracle RAC
Systems Management
1 305 (4.58%) Kubernetes
2 296 (4.45%) Ansible
3 267 (4.01%) Puppet
4 169 (2.54%) Hadoop YARN
5 162 (2.43%) Opscode Chef
6 150 (2.25%) Terraform
7 140 (2.10%) Oozie
8 80 (1.20%) Salt
9 79 (1.19%) Mesos
10 67 (1.01%) HockeyApp
11 53 (0.80%) Kibana
12 28 (0.42%) Ambari
12 28 (0.42%) logstash
13 26 (0.39%) Docker Swarm
14 23 (0.35%) Consul
15 22 (0.33%) Packer
15 22 (0.33%) Rancher
16 21 (0.32%) Suricata
17 18 (0.27%) Tivoli Storage Manager
17 18 (0.27%) vCenter Server
Vendors
1 708 (10.64%) Microsoft
2 587 (8.82%) Oracle
3 561 (8.43%) Tableau
4 435 (6.54%) Google
5 399 (6.00%) Cloudera
6 241 (3.62%) Hortonworks
7 189 (2.84%) SAP
8 184 (2.77%) IBM
9 172 (2.59%) Atlassian
10 157 (2.36%) Informatica
10 157 (2.36%) VMware
11 156 (2.34%) Talend
12 150 (2.25%) Sybase
13 136 (2.04%) Cisco
14 100 (1.50%) Splunk
15 94 (1.41%) Teradata
16 89 (1.34%) Red Hat
17 76 (1.14%) Salesforce.com
18 74 (1.11%) WorldPay
19 72 (1.08%) MapR