Period
to 21 November 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 November 2017 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
21 Nov 2017
Same period 2016 Same period 2015
Rank 99 90 106
Rank change year-on-year -9 +16 +84
Permanent jobs citing Big Data 5823 5794 5994
As % of all permanent IT jobs advertised in the UK 3.22% 3.07% 2.76%
As % of the Database & Business Intelligence category 10.64% 10.34% 8.75%
Number of salaries quoted 4681 4823 4781
UK median annual salary £62,500 £62,500 £60,000
Median salary % change year-on-year - +4.17% +4.35%
10th Percentile £35,379 £37,500 £36,250
90th Percentile £92,500 £100,000 £92,500
UK excluding London median annual salary £52,000 £54,000 £50,000
% change year-on-year -3.70% +8.00% +5.26%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 54745 56049 68490
As % of all permanent IT jobs advertised in the UK 30.26% 29.67% 31.51%
Number of salaries quoted 45083 47949 57675
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +2.27%
10th Percentile £30,000 £29,000 £28,250
90th Percentile £77,500 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £40,000
% change year-on-year - +6.25% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 21 November 2017.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 21 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -7 5413 £62,500 - 450
London +5 3412 £70,000 - 290
UK excluding London -6 2270 £52,000 -3.70% 173
South East +26 788 £57,500 +7.48% 52
North of England +6 473 £50,000 -4.76% 50
North West -8 319 £50,000 -4.76% 37
Scotland +24 264 £50,000 +5.26% 9
South West -57 253 £52,500 -4.55% 24
East of England -34 230 £52,500 -4.55% 26
Midlands -18 223 £45,000 -25.00% 9
Yorkshire -1 132 £47,500 -9.95% 13
West Midlands +15 130 £42,500 -22.73% 6
East Midlands -26 92 £52,500 -16.00% 3
Wales -4 34 £42,500 -15.00% 3
North East +4 16 £40,000 -11.11%
Northern Ireland -20 8 £27,500 -19.12% 1

For the 6 months to 21 November 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Big Data.

1 2531 (43.47%) Agile Software Development
2 2395 (41.13%) Java
3 2065 (35.46%) Analytics
4 2020 (34.69%) Hadoop
5 1978 (33.97%) Python
6 1782 (30.60%) SQL
7 1559 (26.77%) Apache Spark
8 1418 (24.35%) Finance
9 1147 (19.70%) Amazon AWS
10 1082 (18.58%) Business Intelligence
11 1046 (17.96%) Machine Learning
12 980 (16.83%) Degree
13 913 (15.68%) Software Engineering
14 893 (15.34%) NoSQL
15 885 (15.20%) Scala
16 823 (14.13%) DevOps
17 805 (13.82%) Linux
18 801 (13.76%) Data Warehouse
18 801 (13.76%) Data Analytics
19 797 (13.69%) JavaScript
20 751 (12.90%) TDD
21 732 (12.57%) Analytical Skills
22 704 (12.09%) SQL Server
23 697 (11.97%) Scrum
24 688 (11.82%) Microsoft Azure
25 658 (11.30%) Computer Science
26 647 (11.11%) Open Source
27 619 (10.63%) R
28 607 (10.42%) ETL
29 589 (10.12%) Continuous Integration

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1559 (26.77%) Apache Spark
2 399 (6.85%) Elasticsearch
3 365 (6.27%) Apache
4 274 (4.71%) SAS
5 164 (2.82%) Apache Pig
6 129 (2.22%) Apache Solr
7 110 (1.89%) Confluence
8 108 (1.85%) Tomcat
9 92 (1.58%) JBoss
10 80 (1.37%) WebSphere
11 73 (1.25%) OpenStack
12 70 (1.20%) WebLogic
13 56 (0.96%) CMS
14 37 (0.64%) Oracle SOA Suite
15 33 (0.57%) Jetty
15 33 (0.57%) Moodle
16 31 (0.53%) SharePoint
17 29 (0.50%) Apache Airflow
18 25 (0.43%) Cloud Foundry
18 25 (0.43%) nginx
Applications
1 109 (1.87%) Microsoft Excel
2 89 (1.53%) SPSS
3 30 (0.52%) Microsoft PowerPoint
4 20 (0.34%) Microsoft Office
5 19 (0.33%) Chatbot
5 19 (0.33%) Microsoft Project
6 13 (0.22%) OmniGraffle
6 13 (0.22%) Photoshop
7 12 (0.21%) Adobe Illustrator
7 12 (0.21%) MS Visio
8 8 (0.14%) Mathematica
9 7 (0.12%) Spreadsheet
10 5 (0.086%) GNU Octave
11 4 (0.069%) Stata
12 3 (0.052%) S-PLUS
12 3 (0.052%) Weka
13 2 (0.034%) HipChat
14 1 (0.017%) InVision
Business Applications
1 26 (0.45%) Dynamics CRM
2 17 (0.29%) Dynamics AX
3 14 (0.24%) Markit EDM
4 11 (0.19%) BusinessWorks
4 11 (0.19%) TIBCO BusinessEvents
5 10 (0.17%) HFM
6 9 (0.15%) Cognos Business Intelligence
6 9 (0.15%) SAP CO
6 9 (0.15%) SAP FI
6 9 (0.15%) SAP FI/CO
7 8 (0.14%) Oracle Applications
7 8 (0.14%) Oracle EBS
8 7 (0.12%) Hyperion Enterprise
8 7 (0.12%) Oracle ERP
9 5 (0.086%) Eloqua
9 5 (0.086%) Oracle TCA
9 5 (0.086%) SAP S/4HANA
9 5 (0.086%) SessionCam
9 5 (0.086%) Social Studio
10 4 (0.069%) Payment Gateway
Cloud Services
1 1147 (19.70%) Amazon AWS
2 688 (11.82%) Microsoft Azure
3 265 (4.55%) Google Cloud Platform
4 221 (3.80%) SaaS
5 176 (3.02%) Cloud Computing
6 138 (2.37%) GitHub
7 118 (2.03%) PaaS
8 85 (1.46%) IaaS
9 68 (1.17%) AWS CloudFormation
10 65 (1.12%) Amazon EC2
11 63 (1.08%) Amazon EMR
12 61 (1.05%) Azure Machine Learning
13 57 (0.98%) Amazon S3
14 54 (0.93%) Serverless
15 46 (0.79%) Amazon Kinesis
16 39 (0.67%) Google Analytics
17 36 (0.62%) Azure Data Factory
18 31 (0.53%) OpenShift
19 30 (0.52%) Amazon CloudWatch
19 30 (0.52%) AWS Lambda
Communications & Networking
1 129 (2.22%) Internet
2 107 (1.84%) HTTP
3 50 (0.86%) Wireless
4 36 (0.62%) SSL
5 35 (0.60%) Kerberos
6 34 (0.58%) Firewall
7 33 (0.57%) TCP/IP
8 30 (0.52%) Network Security
9 27 (0.46%) LDAP
10 20 (0.34%) DNS
11 11 (0.19%) SAN
11 11 (0.19%) Unified Communications
12 10 (0.17%) Ethernet
12 10 (0.17%) WAN
13 8 (0.14%) DSL
14 7 (0.12%) GSM
14 7 (0.12%) NAS
14 7 (0.12%) Skype
14 7 (0.12%) SMS
14 7 (0.12%) Wi-Fi
Database & Business Intelligence
1 2020 (34.69%) Hadoop
2 893 (15.34%) NoSQL
3 801 (13.76%) Data Warehouse
4 704 (12.09%) SQL Server
5 579 (9.94%) Apache Cassandra
6 554 (9.51%) Relational Database
7 537 (9.22%) Apache Hive
8 491 (8.43%) MongoDB
9 357 (6.13%) MySQL
10 346 (5.94%) HBase
11 304 (5.22%) RDBMS
12 296 (5.08%) SQL Server Integration Services
13 270 (4.64%) Power BI
14 224 (3.85%) Data Mining
15 220 (3.78%) SQL Server Reporting Services
16 197 (3.38%) SQL Server Analysis Services
17 192 (3.30%) Data Lake
18 184 (3.16%) PostgreSQL
19 170 (2.92%) QlikView
20 146 (2.51%) Amazon Redshift
Development Applications
1 439 (7.54%) Git (software)
2 340 (5.84%) Jenkins
3 301 (5.17%) JIRA
4 180 (3.09%) Selenium
5 159 (2.73%) Maven
6 126 (2.16%) Cucumber
7 119 (2.04%) Bitbucket
8 115 (1.97%) JUnit
9 103 (1.77%) Atlassian Bamboo
10 98 (1.68%) Talend Open Studio
11 68 (1.17%) Team Foundation Server
12 63 (1.08%) Visual Studio
13 61 (1.05%) Eclipse
13 61 (1.05%) Gradle
14 57 (0.98%) Subversion
15 55 (0.94%) WebDriver
16 49 (0.84%) TeamCity
17 42 (0.72%) Mockito
18 39 (0.67%) IntelliJ
19 37 (0.64%) Calabash
General
1 1418 (24.35%) Finance
2 558 (9.58%) Banking
3 469 (8.05%) Marketing
4 424 (7.28%) Retail
5 256 (4.40%) Investment Banking
5 256 (4.40%) Telecoms
6 191 (3.28%) Electronics
6 191 (3.28%) Manufacturing
7 179 (3.07%) Front Office
8 167 (2.87%) Games
9 159 (2.73%) Retail Banking
10 111 (1.91%) Advertising
11 96 (1.65%) Legal
12 70 (1.20%) Law
13 59 (1.01%) Publishing
14 51 (0.88%) Financial Institution
15 44 (0.76%) Pharmaceutical
16 37 (0.64%) Military
17 25 (0.43%) Back Office
18 23 (0.39%) Aerospace
Job Titles
1 1868 (32.08%) Developer
2 679 (11.66%) Architect
3 659 (11.32%) Java Developer
4 417 (7.16%) Data Engineer
5 403 (6.92%) Software Engineer
6 402 (6.90%) Data Scientist
7 396 (6.80%) Consultant
8 373 (6.41%) Senior Developer
9 345 (5.92%) Analyst
10 308 (5.29%) Big Data Engineer
11 272 (4.67%) Big Data Developer
12 252 (4.33%) Data Architect
13 229 (3.93%) Python Developer
14 193 (3.31%) Solutions Architect
15 183 (3.14%) Software Developer
16 171 (2.94%) SQL Developer
17 170 (2.92%) Senior Java Developer
18 162 (2.78%) DevOps Engineer
19 153 (2.63%) Lead Developer
20 150 (2.58%) Java Engineer
Libraries, Frameworks & Software Standards
1 524 (9.00%) Spring
2 499 (8.57%) .NET
3 492 (8.45%) Kafka
4 491 (8.43%) AngularJS
5 476 (8.17%) HTML
6 420 (7.21%) Web Services
7 389 (6.68%) CSS
8 381 (6.54%) Node.js
9 302 (5.19%) React
10 292 (5.01%) REST
11 231 (3.97%) RESTful
12 229 (3.93%) Hibernate
13 223 (3.83%) HTML5
14 173 (2.97%) JSON
15 172 (2.95%) Natural Language Processing
15 172 (2.95%) XML
16 170 (2.92%) J2EE
17 149 (2.56%) jQuery
18 140 (2.40%) ASP.NET
19 133 (2.28%) SOAP
Miscellaneous
1 732 (12.57%) Analytical Skills
2 658 (11.30%) Computer Science
3 458 (7.87%) Algorithms
4 389 (6.68%) Greenfield Project
5 310 (5.32%) User Experience
6 254 (4.36%) Fintech
7 219 (3.76%) Enterprise Software
8 162 (2.78%) Mobile App
9 132 (2.27%) Data Structures
10 114 (1.96%) Data Centre
11 99 (1.70%) Robotics
12 88 (1.51%) Management Information System
13 87 (1.49%) Public Cloud
14 75 (1.29%) Internet of Things
15 61 (1.05%) Social Media
16 51 (0.88%) Credit Risk
17 49 (0.84%) Linux Command Line
18 47 (0.81%) Virtual Team
19 44 (0.76%) Client/Server
20 42 (0.72%) Hedge funds
Operating Systems
1 805 (13.82%) Linux
2 295 (5.07%) Windows
3 289 (4.96%) Unix
4 106 (1.82%) Android
5 80 (1.37%) Apple iOS
6 71 (1.22%) CentOS
7 56 (0.96%) Ubuntu
8 42 (0.72%) Red Hat Enterprise Linux
9 21 (0.36%) Solaris
10 18 (0.31%) Mac OS X
11 17 (0.29%) AIX
12 16 (0.27%) Windows Server
13 11 (0.19%) Mac OS
14 8 (0.14%) Debian
15 7 (0.12%) HPUX
15 7 (0.12%) Windows Server 2012
16 6 (0.10%) Windows Server 2008
17 3 (0.052%) CoreOS
17 3 (0.052%) VMS
18 2 (0.034%) Mesosphere
Processes & Methodologies
1 2531 (43.47%) Agile Software Development
2 2065 (35.46%) Analytics
3 1082 (18.58%) Business Intelligence
4 1046 (17.96%) Machine Learning
5 913 (15.68%) Software Engineering
6 823 (14.13%) DevOps
7 801 (13.76%) Data Analytics
8 751 (12.90%) TDD
9 697 (11.97%) Scrum
10 647 (11.11%) Open Source
11 607 (10.42%) ETL
12 589 (10.12%) Continuous Integration
13 497 (8.54%) Mathematics
14 496 (8.52%) BDD
15 495 (8.50%) Visualisation
16 488 (8.38%) Test Automation
17 465 (7.99%) Microservices
18 456 (7.83%) Data Modelling
19 418 (7.18%) OO
20 408 (7.01%) Big Data Analytics
Programming Languages
1 2395 (41.13%) Java
2 1978 (33.97%) Python
3 1782 (30.60%) SQL
4 885 (15.20%) Scala
5 797 (13.69%) JavaScript
6 619 (10.63%) R
7 569 (9.77%) C#
8 489 (8.40%) C++
9 256 (4.40%) C
10 203 (3.49%) Ruby
11 199 (3.42%) Bash Shell
11 199 (3.42%) Go
12 169 (2.90%) Perl
13 165 (2.83%) T-SQL
14 161 (2.76%) PHP
15 150 (2.58%) MATLAB
16 117 (2.01%) Shell Script
17 83 (1.43%) PL/SQL
18 76 (1.31%) PowerShell
19 56 (0.96%) Clojure
Qualifications
1 980 (16.83%) Degree
2 275 (4.72%) PhD
3 251 (4.31%) Computer Science Degree
4 235 (4.04%) Security Cleared
5 137 (2.35%) Numerate Degree
6 121 (2.08%) SC Cleared
7 110 (1.89%) DV Cleared
8 99 (1.70%) Master's Degree
9 57 (0.98%) ISEB
10 39 (0.67%) CISSP
11 29 (0.50%) PMI Certification
12 25 (0.43%) MBA
13 24 (0.41%) Microsoft Certification
14 23 (0.39%) Cisco Certification
14 23 (0.39%) PMP
15 21 (0.36%) CCNA
16 20 (0.34%) ISTQB
17 13 (0.22%) CESG Certified Professional
17 13 (0.22%) MCSE
18 11 (0.19%) CCIE
Quality Assurance & Compliance
1 267 (4.59%) QA
2 239 (4.10%) Data Quality
3 56 (0.96%) GDPR
4 51 (0.88%) GCP
5 35 (0.60%) ISO/IEC 27001
6 21 (0.36%) Solvency II
7 20 (0.34%) Sarbanes-Oxley
8 16 (0.27%) MiFID
9 15 (0.26%) PMO
10 14 (0.24%) COBIT
10 14 (0.24%) PCI DSS
11 13 (0.22%) Dodd-Frank
12 12 (0.21%) SLA
13 9 (0.15%) Actionable Recommendations
13 9 (0.15%) GPG13
14 8 (0.14%) EMIR
15 6 (0.10%) ISO 9001
16 5 (0.086%) IFRS
16 5 (0.086%) IFRS 9
17 4 (0.069%) Government Security Classifications
System Software
1 534 (9.17%) Docker
2 197 (3.38%) HDFS
3 146 (2.51%) Apache Flume
4 47 (0.81%) Apache ZooKeeper
5 38 (0.65%) Active Directory
6 35 (0.60%) VMware Infrastructure
7 19 (0.33%) Virtual Machines
8 15 (0.26%) KVM
9 14 (0.24%) Hyper-V
10 11 (0.19%) Snort
11 9 (0.15%) Varnish
12 8 (0.14%) vSphere
13 4 (0.069%) VMware NSX
13 4 (0.069%) Xen
14 3 (0.052%) Oracle RAC
14 3 (0.052%) VirtualBox
15 2 (0.034%) MapR-FS
15 2 (0.034%) OpenAM
16 1 (0.017%) iptables
16 1 (0.017%) vCloud
Systems Management
1 234 (4.02%) Puppet
2 218 (3.74%) Ansible
3 205 (3.52%) Opscode Chef
4 178 (3.06%) Kubernetes
5 105 (1.80%) Mesos
6 85 (1.46%) Oozie
7 84 (1.44%) Terraform
8 62 (1.06%) Hadoop YARN
9 39 (0.67%) Kibana
10 34 (0.58%) Salt
11 29 (0.50%) Ambari
12 25 (0.43%) logstash
12 25 (0.43%) ZABBIX
13 20 (0.34%) Marathon
13 20 (0.34%) Packer
14 18 (0.31%) HockeyApp
15 13 (0.22%) Nagios
16 9 (0.15%) ITRS Geneos
17 8 (0.14%) Suricata
18 7 (0.12%) Rancher
Vendors
1 536 (9.20%) Oracle
2 505 (8.67%) Microsoft
3 393 (6.75%) Google
4 380 (6.53%) Tableau
5 247 (4.24%) Cloudera
6 243 (4.17%) SAP
7 159 (2.73%) Hortonworks
8 154 (2.64%) Splunk
9 125 (2.15%) IBM
10 122 (2.10%) Red Hat
11 116 (1.99%) Informatica
12 101 (1.73%) Teradata
13 98 (1.68%) Talend
14 77 (1.32%) Salesforce.com
15 76 (1.31%) Cognos
16 67 (1.15%) VMware
17 65 (1.12%) Atlassian
18 63 (1.08%) MapR
19 42 (0.72%) HP
19 42 (0.72%) Twitter