Period
to 22 October 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 22 October 2017 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
22 Oct 2017
Same period 2016 Same period 2015
Rank 95 94 120
Rank change year-on-year -1 +26 +60
Permanent jobs citing Big Data 5644 5662 5666
As % of all permanent IT jobs advertised in the UK 3.24% 2.99% 2.59%
As % of the Database & Business Intelligence category 10.62% 10.08% 8.21%
Number of salaries quoted 4554 4635 4520
UK median annual salary £62,500 £60,500 £60,000
Median salary % change year-on-year +3.31% +0.83% +3.45%
10th Percentile £36,250 £37,500 £35,000
90th Percentile £91,250 £100,000 £92,500
UK excluding London median annual salary £52,500 £53,500 £50,000
% change year-on-year -1.87% +7.00% +3.09%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 53154 56190 69051
As % of all permanent IT jobs advertised in the UK 30.50% 29.63% 31.58%
Number of salaries quoted 43667 47838 58226
UK median annual salary £48,000 £47,500 £45,000
Median salary % change year-on-year +1.05% +5.56% -
10th Percentile £30,000 £28,750 £28,000
90th Percentile £77,500 £76,250 £73,750
UK excluding London median annual salary £42,500 £41,500 £40,000
% change year-on-year +2.41% +3.75% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 22 October 2017.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 22 October 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -2 5240 £62,500 - 304
London +3 3303 £67,500 -3.57% 191
UK excluding London +2 2199 £52,500 -1.87% 123
South East +35 774 £57,500 +4.55% 41
North of England +20 480 £50,000 -1.96% 31
North West +19 333 £50,000 - 19
Scotland +36 258 £50,000 +5.26% 7
Midlands -1 230 £45,000 -18.18% 13
South West -65 221 £52,500 -4.55% 15
East of England -46 202 £50,000 -9.09% 13
West Midlands +5 130 £42,500 -22.73% 5
Yorkshire -23 124 £47,500 -9.52% 11
East Midlands +6 97 £52,500 -14.63% 8
Wales +1 28 £42,500 -2.30% 3
North East +10 17 £40,000 -11.11% 1
Northern Ireland -15 12 £40,000 +17.65%

For the 6 months to 22 October 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Big Data.

1 2497 (44.24%) Agile Software Development
2 2298 (40.72%) Java
3 2047 (36.27%) Analytics
4 1983 (35.13%) Hadoop
5 1856 (32.88%) Python
6 1747 (30.95%) SQL
7 1498 (26.54%) Apache Spark
8 1444 (25.58%) Finance
9 1146 (20.30%) Business Intelligence
10 1079 (19.12%) Amazon AWS
11 976 (17.29%) Machine Learning
12 903 (16.00%) NoSQL
13 861 (15.26%) Software Engineering
14 848 (15.02%) Degree
15 846 (14.99%) Scala
16 841 (14.90%) Data Warehouse
17 807 (14.30%) Linux
18 786 (13.93%) DevOps
19 778 (13.78%) Data Analytics
20 776 (13.75%) JavaScript
21 741 (13.13%) TDD
22 717 (12.70%) Analytical Skills
23 709 (12.56%) SQL Server
24 694 (12.30%) Scrum
25 688 (12.19%) Microsoft Azure
26 642 (11.37%) ETL
27 630 (11.16%) Open Source
28 626 (11.09%) R
29 596 (10.56%) Continuous Integration
30 583 (10.33%) Apache Cassandra

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1498 (26.54%) Apache Spark
2 372 (6.59%) Apache
3 350 (6.20%) Elasticsearch
4 281 (4.98%) SAS
5 167 (2.96%) Apache Pig
6 140 (2.48%) Apache Solr
7 128 (2.27%) Tomcat
8 97 (1.72%) Confluence
9 95 (1.68%) JBoss
10 92 (1.63%) WebSphere
11 77 (1.36%) WebLogic
12 73 (1.29%) OpenStack
13 67 (1.19%) CMS
14 44 (0.78%) Oracle SOA Suite
15 42 (0.74%) Jetty
16 34 (0.60%) SharePoint
17 33 (0.58%) Moodle
18 28 (0.50%) nginx
19 25 (0.44%) Apache Airflow
19 25 (0.44%) WildFly
Applications
1 96 (1.70%) Microsoft Excel
2 91 (1.61%) SPSS
3 27 (0.48%) Microsoft PowerPoint
4 15 (0.27%) Microsoft Office
5 14 (0.25%) Chatbot
6 12 (0.21%) Spreadsheet
7 11 (0.19%) Microsoft Project
7 11 (0.19%) OmniGraffle
7 11 (0.19%) Photoshop
8 10 (0.18%) Adobe Illustrator
8 10 (0.18%) MS Visio
9 5 (0.089%) Stata
10 4 (0.071%) GNU Octave
10 4 (0.071%) S-PLUS
11 2 (0.035%) Mathematica
11 2 (0.035%) Weka
12 1 (0.018%) InVision
Business Applications
1 24 (0.43%) Dynamics CRM
2 13 (0.23%) Dynamics AX
3 12 (0.21%) Markit EDM
4 11 (0.19%) Oracle Applications
5 10 (0.18%) HFM
6 9 (0.16%) BusinessWorks
6 9 (0.16%) Hyperion Enterprise
6 9 (0.16%) TIBCO BusinessEvents
7 8 (0.14%) Cognos Business Intelligence
7 8 (0.14%) Eloqua
7 8 (0.14%) Oracle BPM
7 8 (0.14%) Oracle EBS
7 8 (0.14%) SAP CO
7 8 (0.14%) SAP FI
7 8 (0.14%) SAP FI/CO
7 8 (0.14%) SessionCam
7 8 (0.14%) Social Studio
8 7 (0.12%) Oracle ERP
9 5 (0.089%) Oracle TCA
9 5 (0.089%) SAP S/4HANA
Cloud Services
1 1079 (19.12%) Amazon AWS
2 688 (12.19%) Microsoft Azure
3 274 (4.85%) Google Cloud Platform
4 207 (3.67%) SaaS
5 177 (3.14%) Cloud Computing
6 119 (2.11%) GitHub
7 100 (1.77%) PaaS
8 70 (1.24%) IaaS
9 69 (1.22%) Azure Machine Learning
10 60 (1.06%) Amazon EC2
10 60 (1.06%) AWS CloudFormation
11 59 (1.05%) Amazon EMR
12 43 (0.76%) Serverless
13 41 (0.73%) Amazon S3
14 37 (0.66%) Google Analytics
15 30 (0.53%) Amazon Kinesis
15 30 (0.53%) OpenShift
16 29 (0.51%) Adobe Analytics
17 26 (0.46%) Azure Data Factory
18 25 (0.44%) AWS Lambda
Communications & Networking
1 125 (2.21%) Internet
2 97 (1.72%) HTTP
3 41 (0.73%) Firewall
4 32 (0.57%) Network Security
4 32 (0.57%) Wireless
5 31 (0.55%) SSL
6 30 (0.53%) Kerberos
7 27 (0.48%) TCP/IP
8 25 (0.44%) LDAP
9 17 (0.30%) DNS
10 11 (0.19%) Ethernet
11 10 (0.18%) DSL
12 9 (0.16%) WAN
13 8 (0.14%) OpenVPN
14 7 (0.12%) DHCP
14 7 (0.12%) SAN
14 7 (0.12%) VPN
15 6 (0.11%) GSM
15 6 (0.11%) Remote Desktop
15 6 (0.11%) Unified Communications
Database & Business Intelligence
1 1983 (35.13%) Hadoop
2 903 (16.00%) NoSQL
3 841 (14.90%) Data Warehouse
4 709 (12.56%) SQL Server
5 583 (10.33%) Apache Cassandra
6 565 (10.01%) Relational Database
7 529 (9.37%) Apache Hive
8 487 (8.63%) MongoDB
9 346 (6.13%) HBase
10 330 (5.85%) MySQL
11 318 (5.63%) SQL Server Integration Services
12 314 (5.56%) RDBMS
13 274 (4.85%) Power BI
14 254 (4.50%) SQL Server Reporting Services
15 226 (4.00%) Data Mining
16 209 (3.70%) SQL Server Analysis Services
17 196 (3.47%) QlikView
18 180 (3.19%) PostgreSQL
19 177 (3.14%) Data Lake
20 164 (2.91%) Redis
Development Applications
1 443 (7.85%) Git (software)
2 338 (5.99%) Jenkins
3 274 (4.85%) JIRA
4 186 (3.30%) Selenium
5 181 (3.21%) Maven
6 119 (2.11%) Cucumber
7 97 (1.72%) Bitbucket
8 96 (1.70%) Talend Open Studio
9 95 (1.68%) JUnit
10 80 (1.42%) Atlassian Bamboo
11 55 (0.97%) WebDriver
12 52 (0.92%) Team Foundation Server
13 51 (0.90%) Eclipse
14 50 (0.89%) Visual Studio
15 48 (0.85%) Gradle
16 47 (0.83%) Subversion
16 47 (0.83%) TeamCity
17 44 (0.78%) Hudson
18 35 (0.62%) Calabash
19 34 (0.60%) gulp
General
1 1444 (25.58%) Finance
2 537 (9.51%) Banking
3 469 (8.31%) Marketing
4 429 (7.60%) Retail
5 253 (4.48%) Investment Banking
6 238 (4.22%) Telecoms
7 193 (3.42%) Manufacturing
8 182 (3.22%) Electronics
9 167 (2.96%) Front Office
10 166 (2.94%) Retail Banking
11 157 (2.78%) Games
12 108 (1.91%) Legal
13 103 (1.82%) Advertising
14 66 (1.17%) Publishing
15 65 (1.15%) Law
16 40 (0.71%) Financial Institution
17 36 (0.64%) Pharmaceutical
18 30 (0.53%) Military
19 27 (0.48%) Aerospace
20 25 (0.44%) Back Office
Job Titles
1 1818 (32.21%) Developer
2 692 (12.26%) Architect
3 634 (11.23%) Java Developer
4 399 (7.07%) Consultant
5 396 (7.02%) Data Scientist
6 381 (6.75%) Data Engineer
7 366 (6.48%) Software Engineer
8 349 (6.18%) Senior Developer
9 322 (5.71%) Analyst
10 274 (4.85%) Big Data Developer
11 264 (4.68%) Big Data Engineer
12 252 (4.46%) Data Architect
13 214 (3.79%) Python Developer
14 204 (3.61%) Solutions Architect
15 190 (3.37%) SQL Developer
16 166 (2.94%) Software Developer
17 165 (2.92%) DevOps Engineer
18 160 (2.83%) Business Intelligence Developer
19 150 (2.66%) Senior Java Developer
20 149 (2.64%) Scala Developer
Libraries, Frameworks & Software Standards
1 529 (9.37%) .NET
2 487 (8.63%) Spring
3 486 (8.61%) AngularJS
4 462 (8.19%) Kafka
5 456 (8.08%) HTML
6 431 (7.64%) Web Services
7 354 (6.27%) CSS
8 348 (6.17%) Node.js
9 288 (5.10%) React
10 257 (4.55%) REST
11 224 (3.97%) RESTful
12 212 (3.76%) HTML5
13 211 (3.74%) Hibernate
14 190 (3.37%) XML
15 188 (3.33%) JSON
16 153 (2.71%) J2EE
17 151 (2.68%) Natural Language Processing
18 147 (2.60%) jQuery
19 142 (2.52%) ASP.NET
20 118 (2.09%) SOAP
Miscellaneous
1 717 (12.70%) Analytical Skills
2 570 (10.10%) Computer Science
3 414 (7.34%) Algorithms
4 397 (7.03%) Greenfield Project
5 267 (4.73%) User Experience
6 236 (4.18%) Enterprise Software
7 235 (4.16%) Fintech
8 148 (2.62%) Data Structures
9 138 (2.45%) Mobile App
10 88 (1.56%) Public Cloud
11 85 (1.51%) Management Information System
12 84 (1.49%) Data Centre
13 79 (1.40%) Robotics
14 75 (1.33%) Internet of Things
15 72 (1.28%) Social Media
16 62 (1.10%) Foreign Exchange (FX)
17 50 (0.89%) Credit Risk
18 45 (0.80%) Virtual Team
19 43 (0.76%) Derivative
19 43 (0.76%) Linux Command Line
Operating Systems
1 807 (14.30%) Linux
2 277 (4.91%) Windows
3 254 (4.50%) Unix
4 93 (1.65%) Android
5 71 (1.26%) Apple iOS
6 67 (1.19%) CentOS
7 44 (0.78%) Ubuntu
8 41 (0.73%) Red Hat Enterprise Linux
9 22 (0.39%) Windows Server
10 20 (0.35%) Solaris
11 14 (0.25%) AIX
12 12 (0.21%) Debian
13 11 (0.19%) Mac OS X
14 8 (0.14%) Windows Server 2008
14 8 (0.14%) Windows Server 2012
15 4 (0.071%) HPUX
16 3 (0.053%) Kali Linux
16 3 (0.053%) Mac OS
17 2 (0.035%) CoreOS
17 2 (0.035%) Mesosphere
Processes & Methodologies
1 2497 (44.24%) Agile Software Development
2 2047 (36.27%) Analytics
3 1146 (20.30%) Business Intelligence
4 976 (17.29%) Machine Learning
5 861 (15.26%) Software Engineering
6 786 (13.93%) DevOps
7 778 (13.78%) Data Analytics
8 741 (13.13%) TDD
9 694 (12.30%) Scrum
10 642 (11.37%) ETL
11 630 (11.16%) Open Source
12 596 (10.56%) Continuous Integration
13 477 (8.45%) Visualisation
14 475 (8.42%) Test Automation
15 463 (8.20%) BDD
16 446 (7.90%) Data Modelling
17 441 (7.81%) Mathematics
18 435 (7.71%) Microservices
19 433 (7.67%) OO
20 400 (7.09%) Big Data Analytics
Programming Languages
1 2298 (40.72%) Java
2 1856 (32.88%) Python
3 1747 (30.95%) SQL
4 846 (14.99%) Scala
5 776 (13.75%) JavaScript
6 626 (11.09%) R
7 550 (9.74%) C#
8 467 (8.27%) C++
9 209 (3.70%) C
10 192 (3.40%) T-SQL
11 183 (3.24%) Go
12 182 (3.22%) Perl
13 170 (3.01%) Bash Shell
14 164 (2.91%) Ruby
15 145 (2.57%) PHP
16 138 (2.45%) MATLAB
17 118 (2.09%) Shell Script
18 73 (1.29%) PL/SQL
19 60 (1.06%) PowerShell
20 53 (0.94%) Clojure
Qualifications
1 848 (15.02%) Degree
2 245 (4.34%) PhD
3 225 (3.99%) Security Cleared
4 210 (3.72%) Computer Science Degree
5 122 (2.16%) SC Cleared
6 115 (2.04%) Numerate Degree
7 112 (1.98%) DV Cleared
8 85 (1.51%) Master's Degree
9 54 (0.96%) ISEB
10 31 (0.55%) PMI Certification
11 26 (0.46%) CISSP
12 25 (0.44%) Microsoft Certification
13 22 (0.39%) PMP
14 19 (0.34%) MBA
15 16 (0.28%) ISTQB
16 14 (0.25%) CITP
17 12 (0.21%) CESG Certified Professional
17 12 (0.21%) Cisco Certification
18 9 (0.16%) CTC Cleared
18 9 (0.16%) MCSE
Quality Assurance & Compliance
1 267 (4.73%) QA
2 245 (4.34%) Data Quality
3 53 (0.94%) GDPR
4 45 (0.80%) GCP
5 26 (0.46%) ISO/IEC 27001
6 19 (0.34%) MiFID
7 18 (0.32%) Sarbanes-Oxley
8 16 (0.28%) PCI DSS
9 15 (0.27%) COBIT
9 15 (0.27%) PMO
10 13 (0.23%) Solvency II
11 12 (0.21%) Dodd-Frank
12 11 (0.19%) EMIR
12 11 (0.19%) SLA
13 6 (0.11%) Actionable Recommendations
13 6 (0.11%) ISO 9001
14 4 (0.071%) Government Security Classifications
14 4 (0.071%) ISO 14001
15 2 (0.035%) HMG Security Policy Framework
16 1 (0.018%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 499 (8.84%) Docker
2 196 (3.47%) HDFS
3 143 (2.53%) Apache Flume
4 44 (0.78%) Active Directory
5 43 (0.76%) Apache ZooKeeper
6 27 (0.48%) VMware Infrastructure
7 17 (0.30%) KVM
8 13 (0.23%) Hyper-V
9 11 (0.19%) Virtual Machines
10 10 (0.18%) Varnish
11 6 (0.11%) Snort
12 4 (0.071%) VMware NSX
12 4 (0.071%) Xen
13 3 (0.053%) Oracle RAC
13 3 (0.053%) VirtualBox
14 2 (0.035%) OpenAM
14 2 (0.035%) vSphere
15 1 (0.018%) MapR-FS
15 1 (0.018%) PowerHA
15 1 (0.018%) vCloud
Systems Management
1 260 (4.61%) Puppet
2 228 (4.04%) Ansible
3 224 (3.97%) Opscode Chef
4 169 (2.99%) Kubernetes
5 112 (1.98%) Mesos
6 80 (1.42%) Oozie
7 79 (1.40%) Terraform
8 40 (0.71%) Hadoop YARN
9 39 (0.69%) Kibana
10 37 (0.66%) Salt
11 33 (0.58%) logstash
12 29 (0.51%) Ambari
13 25 (0.44%) Packer
14 23 (0.41%) ZABBIX
15 19 (0.34%) Marathon
16 14 (0.25%) Nagios
17 9 (0.16%) ITRS Geneos
18 8 (0.14%) HockeyApp
19 7 (0.12%) Graphite
19 7 (0.12%) Rancher
Vendors
1 523 (9.27%) Microsoft
2 519 (9.20%) Oracle
3 394 (6.98%) Tableau
4 358 (6.34%) Google
5 266 (4.71%) SAP
6 249 (4.41%) Cloudera
7 160 (2.83%) Hortonworks
8 139 (2.46%) Splunk
9 118 (2.09%) Red Hat
10 114 (2.02%) Informatica
11 110 (1.95%) IBM
12 96 (1.70%) Talend
13 93 (1.65%) Teradata
14 77 (1.36%) Cognos
15 70 (1.24%) MapR
16 69 (1.22%) Salesforce.com
17 56 (0.99%) VMware
18 46 (0.82%) Atlassian
18 46 (0.82%) MicroStrategy
19 40 (0.71%) TIBCO