Period
to 24 May 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 24 May 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
24 May 2018
Same period 2017 Same period 2016
Rank 75 84 97
Rank change year-on-year +9 +13 +63
Permanent jobs citing Big Data 6,710 5,690 6,025
As % of all permanent IT jobs advertised in the UK 3.89% 3.36% 3.00%
As % of the Database & Business Intelligence category 12.68% 10.87% 9.69%
Number of salaries quoted 4,920 4,786 4,817
UK median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% -
10th Percentile £37,500 £36,250 £37,500
90th Percentile £95,000 £95,000 £96,250
UK excluding London median annual salary £55,000 £55,000 £50,750
% change year-on-year - +8.37% +1.50%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 52,907 52,352 62,149
As % of all permanent IT jobs advertised in the UK 30.68% 30.92% 30.95%
Number of salaries quoted 43,483 44,452 52,867
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £28,750
90th Percentile £80,000 £77,500 £75,000
UK excluding London median annual salary £44,471 £42,000 £41,500
% change year-on-year +5.88% +1.20% +3.75%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 24 May 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 24 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +9 6,391 £65,000 +4.00% 882
London +17 4,059 £70,000 +3.70% 570
UK excluding London +18 2,534 £55,000 - 377
South East -7 802 £60,000 +9.09% 102
North of England +17 488 £50,000 -4.76% 86
South West +16 398 £55,000 - 41
East of England +64 342 £60,000 +20.00% 41
North West -3 325 £50,000 -7.83% 50
Midlands -13 272 £55,000 +4.76% 42
Scotland -19 189 £50,000 -16.67% 50
West Midlands +27 165 £52,500 -4.55% 26
Yorkshire +38 131 £55,000 - 28
East Midlands -51 105 £62,500 +19.05% 16
Wales +14 39 £47,450 +5.44% 8
North East -12 32 £42,500 +21.43% 8
Northern Ireland +2 12 £43,750 +25.00% 7

For the 6 months to 24 May 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,793 (41.62%) Java
2 2,458 (36.63%) Python
3 2,419 (36.05%) Agile Software Development
4 2,351 (35.04%) Analytics
5 2,130 (31.74%) Hadoop
6 2,109 (31.43%) SQL
7 1,761 (26.24%) Finance
8 1,754 (26.14%) Apache Spark
9 1,628 (24.26%) Machine Learning
10 1,548 (23.07%) Amazon AWS
11 1,290 (19.23%) Data Science
12 1,225 (18.26%) Problem-Solving
13 1,216 (18.12%) Degree
14 1,150 (17.14%) Scala
15 1,085 (16.17%) Analytical Skills
16 1,073 (15.99%) Business Intelligence
17 1,056 (15.74%) Software Engineering
18 975 (14.53%) Microsoft Azure
19 953 (14.20%) Banking
20 937 (13.96%) NoSQL
21 934 (13.92%) Linux
22 929 (13.85%) DevOps
23 917 (13.67%) JavaScript
24 915 (13.64%) TDD
25 888 (13.23%) Kafka
26 860 (12.82%) ETL
27 821 (12.24%) Computer Science
28 819 (12.21%) C#
29 808 (12.04%) Data Analytics
30 791 (11.79%) Data Warehouse

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,754 (26.14%) Apache Spark
2 377 (5.62%) Elasticsearch
3 290 (4.32%) Apache
4 273 (4.07%) SAS
5 227 (3.38%) Apache Pig
6 155 (2.31%) Apache Solr
7 77 (1.15%) Tomcat
8 60 (0.89%) Confluence
9 45 (0.67%) IIS
10 44 (0.66%) JBoss
11 33 (0.49%) OpenStack
12 27 (0.40%) SharePoint
13 25 (0.37%) CMS
14 22 (0.33%) NServiceBus
15 21 (0.31%) Jetty
15 21 (0.31%) Oracle SOA Suite
15 21 (0.31%) WebSphere
16 20 (0.30%) Apache Airflow
17 19 (0.28%) nginx
18 18 (0.27%) Oracle Service Bus
Applications
1 97 (1.45%) Microsoft Excel
2 65 (0.97%) Microsoft Office
3 48 (0.72%) SPSS
4 30 (0.45%) MS Visio
5 25 (0.37%) GNU Octave
6 17 (0.25%) Microsoft Project
7 16 (0.24%) Microsoft PowerPoint
8 14 (0.21%) Chatbot
9 11 (0.16%) Weka
10 6 (0.089%) Mathematica
10 6 (0.089%) Stata
11 4 (0.060%) InVision
11 4 (0.060%) OmniGraffle
11 4 (0.060%) UXPin
12 3 (0.045%) Spreadsheet
13 2 (0.030%) PrintSoft PReS
14 1 (0.015%) AutoCAD
14 1 (0.015%) CPLEX
14 1 (0.015%) Mingle
14 1 (0.015%) SOLIDWORKS
Business Applications
1 28 (0.42%) Dynamics CRM
2 12 (0.18%) Dynamics AX
3 9 (0.13%) SAP S/4HANA
4 6 (0.089%) Distributed Ledger
5 5 (0.075%) Cognos Business Intelligence
5 5 (0.075%) SAP MDG
6 4 (0.060%) Cognos TM1
6 4 (0.060%) JDE OneWorld
6 4 (0.060%) Oracle BPM
6 4 (0.060%) Oracle Procure-to-Pay
6 4 (0.060%) Oracle Receivables
6 4 (0.060%) SAP Forecasting and Replenishment
6 4 (0.060%) SAP Retail
7 3 (0.045%) Actimize
7 3 (0.045%) Sentinel
8 2 (0.030%) Dynamics NAV
8 2 (0.030%) Markit EDM
8 2 (0.030%) Oracle ERP
8 2 (0.030%) Oracle Payables
8 2 (0.030%) SAP Hybris
Cloud Services
1 1,548 (23.07%) Amazon AWS
2 975 (14.53%) Microsoft Azure
3 222 (3.31%) SaaS
4 211 (3.14%) Google Cloud Platform
5 198 (2.95%) Serverless
6 168 (2.50%) IaaS
7 154 (2.30%) GitHub
8 149 (2.22%) Azure Data Factory
8 149 (2.22%) Cloud Computing
9 144 (2.15%) Amazon EMR
9 144 (2.15%) Amazon S3
10 135 (2.01%) Cortana Intelligence Suite
11 123 (1.83%) Amazon Kinesis
12 113 (1.68%) PaaS
13 86 (1.28%) AWS Lambda
14 62 (0.92%) Amazon EC2
15 53 (0.79%) IBM Cloud
16 43 (0.64%) Bluemix
17 39 (0.58%) Google Analytics
18 34 (0.51%) AWS CloudFormation
Communications & Networking
1 157 (2.34%) Wireless
2 124 (1.85%) Internet
3 89 (1.33%) Firewall
4 71 (1.06%) HTTP
5 62 (0.92%) Unified Communications
6 57 (0.85%) DNS
7 54 (0.80%) TCP/IP
8 53 (0.79%) Wireless Security
9 43 (0.64%) LAN
9 43 (0.64%) SSL
10 42 (0.63%) WAN
11 39 (0.58%) SAN
12 37 (0.55%) Network Security
13 35 (0.52%) Kerberos
14 34 (0.51%) DHCP
15 32 (0.48%) SMS
16 20 (0.30%) Sourcefire
17 18 (0.27%) Cisco IOS
18 15 (0.22%) MPLS
19 14 (0.21%) OSPF
Database & Business Intelligence
1 2,130 (31.74%) Hadoop
2 937 (13.96%) NoSQL
3 791 (11.79%) Data Warehouse
4 771 (11.49%) Apache Hive
5 617 (9.20%) SQL Server
6 554 (8.26%) MongoDB
7 519 (7.73%) Relational Database
8 492 (7.33%) Data Lake
9 474 (7.06%) Apache Cassandra
10 423 (6.30%) HBase
11 385 (5.74%) Power BI
12 306 (4.56%) Impala
13 297 (4.43%) MySQL
14 272 (4.05%) SQL Server Integration Services
15 256 (3.82%) RDBMS
16 242 (3.61%) PostgreSQL
17 241 (3.59%) Amazon Redshift
18 205 (3.06%) SQL Server Reporting Services
19 192 (2.86%) Data Mining
20 187 (2.79%) Sqoop
Development Applications
1 473 (7.05%) Git (software)
2 349 (5.20%) Jenkins
3 337 (5.02%) JIRA
4 166 (2.47%) JUnit
5 158 (2.35%) Visual Studio
6 150 (2.24%) Atlassian Bamboo
7 135 (2.01%) Bitbucket
8 114 (1.70%) Gradle
9 113 (1.68%) Selenium
10 108 (1.61%) Maven
11 103 (1.54%) TeamCity
12 99 (1.48%) Calabash
12 99 (1.48%) fastlane
13 92 (1.37%) Subversion
14 90 (1.34%) Mockito
15 82 (1.22%) Cucumber
16 63 (0.94%) Android Studio
17 52 (0.77%) Eclipse
18 49 (0.73%) Team Foundation Server
19 39 (0.58%) GitLab
General
1 1,761 (26.24%) Finance
2 953 (14.20%) Banking
3 674 (10.04%) Investment Banking
4 616 (9.18%) Financial Institution
5 472 (7.03%) Marketing
6 433 (6.45%) Retail
7 292 (4.35%) Telecoms
8 196 (2.92%) Electronics
9 181 (2.70%) Front Office
10 159 (2.37%) Manufacturing
11 150 (2.24%) Games
12 123 (1.83%) Advertising
13 86 (1.28%) Publishing
14 79 (1.18%) Pharmaceutical
15 71 (1.06%) Legal
16 57 (0.85%) Law
17 37 (0.55%) Automotive
17 37 (0.55%) Military
18 26 (0.39%) Multimedia
19 19 (0.28%) Billing
Job Titles
1 1,819 (27.11%) Developer
2 967 (14.41%) Architect
3 753 (11.22%) Data Engineer
4 645 (9.61%) Java Developer
5 495 (7.38%) Big Data Engineer
6 428 (6.38%) Data Scientist
7 424 (6.32%) Data Architect
8 398 (5.93%) Analyst
9 353 (5.26%) Software Engineer
10 335 (4.99%) Consultant
11 323 (4.81%) Senior Developer
12 305 (4.55%) Big Data Developer
13 243 (3.62%) Big Data Architect
13 243 (3.62%) Solutions Architect
14 237 (3.53%) DevOps Engineer
15 187 (2.79%) Technical Architect
16 174 (2.59%) Java Engineer
17 160 (2.38%) Senior Java Developer
18 157 (2.34%) Python Developer
18 157 (2.34%) Software Developer
Libraries, Frameworks & Software Standards
1 888 (13.23%) Kafka
2 606 (9.03%) .NET
3 518 (7.72%) AngularJS
4 505 (7.53%) Web Services
5 453 (6.75%) HTML
6 355 (5.29%) Spring
7 335 (4.99%) RESTful
8 319 (4.75%) Node.js
9 307 (4.58%) REST
10 302 (4.50%) React
11 286 (4.26%) CSS
12 270 (4.02%) XML
13 251 (3.74%) Natural Language Processing
14 192 (2.86%) HTML5
15 177 (2.64%) JSON
16 170 (2.53%) RabbitMQ
17 136 (2.03%) J2EE
18 133 (1.98%) SOAP
19 132 (1.97%) TensorFlow
20 125 (1.86%) Django
Miscellaneous
1 1,085 (16.17%) Analytical Skills
2 821 (12.24%) Computer Science
3 577 (8.60%) Algorithms
4 566 (8.44%) Cyberthreat
5 406 (6.05%) User Experience
6 339 (5.05%) Greenfield Project
7 338 (5.04%) Fintech
8 210 (3.13%) Data Centre
8 210 (3.13%) Management Information System
9 199 (2.97%) Data Structures
10 192 (2.86%) Self-Motivation
11 163 (2.43%) Mobile App
12 128 (1.91%) Fixed Income
13 121 (1.80%) Enterprise Software
14 117 (1.74%) Equities
15 112 (1.67%) Public Cloud
16 92 (1.37%) Virtual Team
17 81 (1.21%) Robotics
18 70 (1.04%) Derivative
19 68 (1.01%) Hedge funds
Operating Systems
1 934 (13.92%) Linux
2 386 (5.75%) Unix
3 314 (4.68%) Windows
4 117 (1.74%) Android
5 87 (1.30%) Apple iOS
6 70 (1.04%) Red Hat Enterprise Linux
7 50 (0.75%) Windows Server
8 46 (0.69%) CentOS
9 36 (0.54%) Ubuntu
10 25 (0.37%) AIX
10 25 (0.37%) Solaris
11 22 (0.33%) HPUX
12 18 (0.27%) Mac OS X
13 17 (0.25%) Mac OS
14 14 (0.21%) Windows Server 2012
15 11 (0.16%) Debian
16 10 (0.15%) Robot Operating System
16 10 (0.15%) Windows 10
16 10 (0.15%) Windows 7
17 6 (0.089%) Oracle Linux
Processes & Methodologies
1 2,419 (36.05%) Agile Software Development
2 2,351 (35.04%) Analytics
3 1,628 (24.26%) Machine Learning
4 1,290 (19.23%) Data Science
5 1,225 (18.26%) Problem-Solving
6 1,073 (15.99%) Business Intelligence
7 1,056 (15.74%) Software Engineering
8 929 (13.85%) DevOps
9 915 (13.64%) TDD
10 860 (12.82%) ETL
11 808 (12.04%) Data Analytics
12 680 (10.13%) Visualisation
13 675 (10.06%) Risk Management
14 648 (9.66%) Artificial Intelligence
15 639 (9.52%) Scrum
16 624 (9.30%) Mathematics
17 620 (9.24%) Microservices
18 606 (9.03%) Low Latency
19 605 (9.02%) Innovative Thinking
20 589 (8.78%) Investment Management
Programming Languages
1 2,793 (41.62%) Java
2 2,458 (36.63%) Python
3 2,109 (31.43%) SQL
4 1,150 (17.14%) Scala
5 917 (13.67%) JavaScript
6 819 (12.21%) C#
7 757 (11.28%) C++
8 676 (10.07%) R
9 264 (3.93%) C
10 241 (3.59%) Java 8
11 232 (3.46%) Bash Shell
12 218 (3.25%) Perl
13 204 (3.04%) Go
14 173 (2.58%) MATLAB
14 173 (2.58%) Ruby
15 170 (2.53%) Shell Script
16 164 (2.44%) T-SQL
17 144 (2.15%) PHP
18 96 (1.43%) PowerShell
19 85 (1.27%) U-SQL
Qualifications
1 1,216 (18.12%) Degree
2 334 (4.98%) PhD
3 300 (4.47%) Computer Science Degree
4 167 (2.49%) Security Cleared
5 140 (2.09%) Master's Degree
6 116 (1.73%) Numerate Degree
7 76 (1.13%) Cisco Certification
8 75 (1.12%) CISSP
9 69 (1.03%) CCNA
10 59 (0.88%) DV Cleared
11 56 (0.83%) CCIE
12 52 (0.77%) Microsoft Certification
13 50 (0.75%) SC Cleared
14 49 (0.73%) ISEB
15 45 (0.67%) CCNP
15 45 (0.67%) SANS
16 41 (0.61%) TOGAF Certification
17 38 (0.57%) CEH
18 33 (0.49%) GIAC
19 27 (0.40%) MCSE
Quality Assurance & Compliance
1 269 (4.01%) QA
2 241 (3.59%) Data Quality
3 136 (2.03%) GDPR
4 50 (0.75%) ISO/IEC 27001
5 45 (0.67%) GCP
6 29 (0.43%) PCI DSS
7 25 (0.37%) Sarbanes-Oxley
8 20 (0.30%) MiFID
8 20 (0.30%) Solvency II
9 15 (0.22%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
10 14 (0.21%) Dodd-Frank
10 14 (0.21%) HMG Security Policy Framework
11 13 (0.19%) FATCA
12 11 (0.16%) GPG13
12 11 (0.16%) IFRS
12 11 (0.16%) IFRS 9
12 11 (0.16%) SLA
13 10 (0.15%) Actionable Recommendations
14 8 (0.12%) PMO
15 7 (0.10%) EMIR
System Software
1 586 (8.73%) Docker
2 307 (4.58%) HDFS
3 228 (3.40%) Apache Flume
4 119 (1.77%) Virtual Machines
5 106 (1.58%) VMware Infrastructure
6 63 (0.94%) Active Directory
7 42 (0.63%) Apache ZooKeeper
7 42 (0.63%) vSphere
8 30 (0.45%) Hyper-V
9 29 (0.43%) VMware ESXi
10 28 (0.42%) VMware NSX
11 20 (0.30%) NFS
11 20 (0.30%) Snort
12 15 (0.22%) VirtualBox
13 10 (0.15%) Virtual Desktop
14 5 (0.075%) BitLocker
14 5 (0.075%) KVM
14 5 (0.075%) Microsoft App-V
15 4 (0.060%) XenDesktop
16 3 (0.045%) Oracle RAC
Systems Management
1 311 (4.63%) Kubernetes
2 299 (4.46%) Ansible
3 272 (4.05%) Puppet
4 170 (2.53%) Hadoop YARN
5 162 (2.41%) Opscode Chef
6 151 (2.25%) Terraform
7 144 (2.15%) Oozie
8 79 (1.18%) Mesos
8 79 (1.18%) Salt
9 63 (0.94%) HockeyApp
10 53 (0.79%) Kibana
11 28 (0.42%) Ambari
11 28 (0.42%) logstash
12 26 (0.39%) Docker Swarm
13 22 (0.33%) Consul
13 22 (0.33%) Rancher
14 21 (0.31%) Packer
15 20 (0.30%) Suricata
16 18 (0.27%) Tivoli Storage Manager
16 18 (0.27%) vCenter Server
Vendors
1 718 (10.70%) Microsoft
2 584 (8.70%) Oracle
3 567 (8.45%) Tableau
4 443 (6.60%) Google
5 403 (6.01%) Cloudera
6 242 (3.61%) Hortonworks
7 192 (2.86%) SAP
8 186 (2.77%) IBM
9 166 (2.47%) Atlassian
10 162 (2.41%) Talend
11 159 (2.37%) Informatica
12 156 (2.32%) VMware
13 155 (2.31%) Sybase
14 135 (2.01%) Cisco
15 102 (1.52%) Splunk
16 92 (1.37%) Teradata
17 90 (1.34%) Red Hat
18 74 (1.10%) Salesforce.com
18 74 (1.10%) WorldPay
19 73 (1.09%) MapR