Period
to 23 August 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 23 August 2017 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
23 Aug 2017
Same period 2016 Same period 2015
Rank 94 98 138
Rank change year-on-year +4 +40 +37
Permanent jobs citing Big Data 5817 5759 5062
As % of all permanent IT jobs advertised in the UK 3.31% 2.93% 2.34%
As % of the Database & Business Intelligence category 10.75% 9.76% 7.36%
Number of salaries quoted 4724 4644 4023
UK median annual salary £62,500 £60,000 £60,000
Median salary % change year-on-year +4.17% - -
10th Percentile £35,379 £37,500 £35,900
90th Percentile £92,500 £100,000 £93,750
UK excluding London median annual salary £53,500 £53,500 £50,000
% change year-on-year - +7.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 54094 58998 68754
As % of all permanent IT jobs advertised in the UK 30.74% 29.99% 31.74%
Number of salaries quoted 44880 50389 57983
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +2.27%
10th Percentile £30,000 £28,750 £27,500
90th Percentile £77,500 £75,000 £72,500
UK excluding London median annual salary £42,500 £41,000 £40,000
% change year-on-year +3.66% +2.50% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 23 August 2017.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 23 August 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +3 5396 £62,500 +3.31% 387
London +6 3300 £67,500 - 238
UK excluding London +21 2386 £53,500 - 173
South East +36 858 £57,500 +6.48% 56
North of England +29 523 £50,000 -4.76% 46
North West +40 352 £52,500 +5.00% 29
South West -43 263 £55,000 - 10
Scotland +47 259 £60,000 +14.29% 18
Midlands +37 239 £47,500 -17.39% 16
East of England -38 200 £47,500 -9.52% 21
Yorkshire -26 146 £50,000 -9.09% 14
East Midlands +46 136 £50,000 -18.70% 4
West Midlands -13 100 £42,500 -22.73% 12
Wales -8 40 £42,500 -5.56% 4
North East +20 25 £35,000 -39.13% 3
Northern Ireland +3 19 £34,500 +1.47% 2

For the 6 months to 23 August 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Big Data.

1 2535 (43.58%) Agile Software Development
2 2425 (41.69%) Java
3 2093 (35.98%) Hadoop
4 1963 (33.75%) Analytics
5 1813 (31.17%) Python
6 1807 (31.06%) SQL
7 1536 (26.41%) Apache Spark
8 1394 (23.96%) Finance
9 1256 (21.59%) Business Intelligence
10 1049 (18.03%) NoSQL
11 1034 (17.78%) Amazon AWS
12 1019 (17.52%) Machine Learning
13 933 (16.04%) Degree
14 880 (15.13%) Data Warehouse
15 854 (14.68%) Software Engineering
16 846 (14.54%) SQL Server
17 816 (14.03%) Scala
18 815 (14.01%) JavaScript
19 777 (13.36%) Linux
20 755 (12.98%) TDD
21 744 (12.79%) Scrum
22 729 (12.53%) ETL
23 724 (12.45%) Analytical Skills
24 719 (12.36%) DevOps
25 710 (12.21%) Microsoft Azure
26 672 (11.55%) R
27 664 (11.41%) Data Analytics
28 649 (11.16%) Apache Cassandra
29 645 (11.09%) Microsoft
30 622 (10.69%) Open Source

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1536 (26.41%) Apache Spark
2 371 (6.38%) Apache
3 367 (6.31%) Elasticsearch
4 335 (5.76%) SAS
5 205 (3.52%) Apache Pig
6 198 (3.40%) Apache Solr
7 147 (2.53%) Tomcat
8 120 (2.06%) JBoss
9 93 (1.60%) WebSphere
10 92 (1.58%) OpenStack
11 70 (1.20%) WebLogic
12 69 (1.19%) CMS
12 69 (1.19%) Confluence
13 57 (0.98%) Jetty
14 46 (0.79%) Oracle SOA Suite
15 27 (0.46%) GlassFish
16 26 (0.45%) nginx
17 25 (0.43%) IIS
17 25 (0.43%) SharePoint
18 22 (0.38%) WildFly
Applications
1 121 (2.08%) Microsoft Excel
2 100 (1.72%) SPSS
3 33 (0.57%) Microsoft PowerPoint
4 21 (0.36%) Spreadsheet
5 20 (0.34%) Microsoft Office
6 14 (0.24%) MS Visio
7 12 (0.21%) Chatbot
8 6 (0.10%) Stata
9 5 (0.086%) S-PLUS
10 4 (0.069%) Microsoft Project
10 4 (0.069%) OmniGraffle
10 4 (0.069%) Pipeline Pilot
11 3 (0.052%) Adobe Illustrator
11 3 (0.052%) Photoshop
11 3 (0.052%) SPSS Modeler
12 2 (0.034%) GNU Octave
12 2 (0.034%) InVision
12 2 (0.034%) Mathcad
12 2 (0.034%) Simulink
12 2 (0.034%) Weka
Business Applications
1 16 (0.28%) Dynamics CRM
2 15 (0.26%) Oracle BPM
3 10 (0.17%) Eloqua
3 10 (0.17%) HFM
3 10 (0.17%) Oracle Applications
3 10 (0.17%) SessionCam
3 10 (0.17%) Social Studio
4 9 (0.15%) Dynamics AX
4 9 (0.15%) Hyperion Enterprise
5 8 (0.14%) SAP GRC
6 7 (0.12%) Markit EDM
7 6 (0.10%) Cognos Business Intelligence
7 6 (0.10%) SAP CO
7 6 (0.10%) SAP FI
7 6 (0.10%) SAP FI/CO
8 5 (0.086%) BusinessWorks
8 5 (0.086%) TIBCO BusinessEvents
9 4 (0.069%) Hyperion Planning
9 4 (0.069%) Oracle CRM
9 4 (0.069%) SAP Retail
Cloud Services
1 1034 (17.78%) Amazon AWS
2 710 (12.21%) Microsoft Azure
3 255 (4.38%) Google Cloud Platform
4 217 (3.73%) SaaS
5 182 (3.13%) Cloud Computing
6 96 (1.65%) GitHub
7 78 (1.34%) Azure Machine Learning
8 72 (1.24%) PaaS
9 62 (1.07%) Amazon EMR
10 52 (0.89%) Amazon EC2
11 50 (0.86%) IaaS
12 35 (0.60%) Google Analytics
13 34 (0.58%) Amazon S3
14 28 (0.48%) OpenShift
15 25 (0.43%) Adobe Analytics
15 25 (0.43%) AWS CloudFormation
16 21 (0.36%) AWS Lambda
17 20 (0.34%) Amazon Kinesis
18 17 (0.29%) Azure Data Factory
19 14 (0.24%) Office 365
Communications & Networking
1 147 (2.53%) Internet
2 58 (1.00%) HTTP
3 45 (0.77%) Network Security
4 38 (0.65%) Firewall
5 36 (0.62%) Kerberos
6 27 (0.46%) Wireless
7 22 (0.38%) SSL
8 21 (0.36%) TCP/IP
9 16 (0.28%) LDAP
10 11 (0.19%) DNS
11 10 (0.17%) DSL
12 8 (0.14%) OpenVPN
13 7 (0.12%) Unified Communications
13 7 (0.12%) VPN
13 7 (0.12%) WAN
14 6 (0.10%) DHCP
14 6 (0.10%) Ethernet
14 6 (0.10%) SAN
14 6 (0.10%) Wireshark
15 5 (0.086%) LAN
Database & Business Intelligence
1 2093 (35.98%) Hadoop
2 1049 (18.03%) NoSQL
3 880 (15.13%) Data Warehouse
4 846 (14.54%) SQL Server
5 649 (11.16%) Apache Cassandra
6 618 (10.62%) Apache Hive
7 611 (10.50%) MongoDB
8 596 (10.25%) Relational Database
9 402 (6.91%) HBase
10 397 (6.82%) SQL Server Integration Services
11 370 (6.36%) MySQL
12 320 (5.50%) SQL Server Reporting Services
13 309 (5.31%) RDBMS
14 294 (5.05%) Power BI
15 270 (4.64%) SQL Server Analysis Services
16 254 (4.37%) Data Mining
17 240 (4.13%) QlikView
18 195 (3.35%) Redis
19 181 (3.11%) PostgreSQL
20 180 (3.09%) Data Lake
Development Applications
1 440 (7.56%) Git (software)
2 306 (5.26%) Jenkins
3 238 (4.09%) JIRA
4 184 (3.16%) Selenium
5 160 (2.75%) Maven
6 99 (1.70%) Cucumber
7 94 (1.62%) Talend Open Studio
8 91 (1.56%) JUnit
9 68 (1.17%) Bitbucket
10 65 (1.12%) Subversion
11 63 (1.08%) Atlassian Bamboo
12 57 (0.98%) Calabash
13 55 (0.95%) Eclipse
14 54 (0.93%) Hudson
15 51 (0.88%) WebDriver
16 45 (0.77%) Mockito
17 43 (0.74%) Gradle
17 43 (0.74%) Team Foundation Server
17 43 (0.74%) TeamCity
18 31 (0.53%) NUnit
General
1 1394 (23.96%) Finance
2 559 (9.61%) Retail
3 479 (8.23%) Banking
4 464 (7.98%) Marketing
5 260 (4.47%) Telecoms
6 205 (3.52%) Investment Banking
7 192 (3.30%) Electronics
8 183 (3.15%) Manufacturing
9 164 (2.82%) Games
10 144 (2.48%) Front Office
11 131 (2.25%) Retail Banking
12 129 (2.22%) Advertising
13 118 (2.03%) Legal
14 75 (1.29%) Publishing
15 52 (0.89%) Law
16 33 (0.57%) Pharmaceutical
17 29 (0.50%) Aerospace
18 28 (0.48%) Military
19 27 (0.46%) Local Government
20 26 (0.45%) Financial Institution
Job Titles
1 1914 (32.90%) Developer
2 744 (12.79%) Architect
3 693 (11.91%) Java Developer
4 425 (7.31%) Data Scientist
5 422 (7.25%) Data Engineer
6 390 (6.70%) Consultant
7 370 (6.36%) Senior Developer
8 355 (6.10%) Software Engineer
9 322 (5.54%) Analyst
10 287 (4.93%) Big Data Developer
11 286 (4.92%) Big Data Engineer
12 279 (4.80%) Data Architect
13 208 (3.58%) Python Developer
14 201 (3.46%) SQL Developer
15 195 (3.35%) Solutions Architect
16 193 (3.32%) Business Intelligence Developer
17 186 (3.20%) Java Engineer
18 171 (2.94%) Software Developer
19 164 (2.82%) Big Data Architect
20 163 (2.80%) Data Consultant
Libraries, Frameworks & Software Standards
1 607 (10.43%) .NET
2 512 (8.80%) AngularJS
3 508 (8.73%) Spring
4 482 (8.29%) Kafka
5 457 (7.86%) Web Services
6 408 (7.01%) HTML
7 371 (6.38%) Node.js
8 324 (5.57%) CSS
9 310 (5.33%) React
10 293 (5.04%) REST
11 247 (4.25%) RESTful
12 207 (3.56%) JSON
13 204 (3.51%) Hibernate
14 202 (3.47%) XML
15 195 (3.35%) HTML5
16 163 (2.80%) J2EE
17 154 (2.65%) ASP.NET
18 144 (2.48%) jQuery
19 140 (2.41%) Natural Language Processing
20 129 (2.22%) SOAP
Miscellaneous
1 724 (12.45%) Analytical Skills
2 621 (10.68%) Computer Science
3 479 (8.23%) Greenfield Project
4 434 (7.46%) Algorithms
5 252 (4.33%) Enterprise Software
6 219 (3.76%) User Experience
7 191 (3.28%) Fintech
8 160 (2.75%) Data Structures
9 119 (2.05%) Mobile App
10 108 (1.86%) Management Information System
11 102 (1.75%) Internet of Things
12 99 (1.70%) Social Media
13 91 (1.56%) Public Cloud
14 79 (1.36%) Data Centre
15 74 (1.27%) Virtual Team
16 69 (1.19%) Foreign Exchange (FX)
17 62 (1.07%) Credit Risk
18 52 (0.89%) Derivative
19 47 (0.81%) Semantic Web
20 43 (0.74%) Robotics
Operating Systems
1 777 (13.36%) Linux
2 221 (3.80%) Windows
3 210 (3.61%) Unix
4 114 (1.96%) Android
5 94 (1.62%) Apple iOS
6 52 (0.89%) CentOS
7 46 (0.79%) Red Hat Enterprise Linux
8 33 (0.57%) Ubuntu
9 30 (0.52%) Windows Server
10 14 (0.24%) Debian
11 13 (0.22%) AIX
12 11 (0.19%) Windows Server 2008
13 10 (0.17%) Windows Server 2003
14 9 (0.15%) Mac OS X
15 7 (0.12%) Solaris
16 6 (0.10%) Mac OS
17 5 (0.086%) HPUX
17 5 (0.086%) Kali Linux
17 5 (0.086%) Windows 2000
18 2 (0.034%) MVS
Processes & Methodologies
1 2535 (43.58%) Agile Software Development
2 1963 (33.75%) Analytics
3 1256 (21.59%) Business Intelligence
4 1019 (17.52%) Machine Learning
5 854 (14.68%) Software Engineering
6 755 (12.98%) TDD
7 744 (12.79%) Scrum
8 729 (12.53%) ETL
9 719 (12.36%) DevOps
10 664 (11.41%) Data Analytics
11 622 (10.69%) Open Source
12 534 (9.18%) Continuous Integration
13 516 (8.87%) Visualisation
14 470 (8.08%) Test Automation
15 449 (7.72%) Data Modelling
16 438 (7.53%) OO
17 434 (7.46%) Mathematics
18 431 (7.41%) Mentoring
19 424 (7.29%) BDD
20 422 (7.25%) Microservices
Programming Languages
1 2425 (41.69%) Java
2 1813 (31.17%) Python
3 1807 (31.06%) SQL
4 816 (14.03%) Scala
5 815 (14.01%) JavaScript
6 672 (11.55%) R
7 607 (10.43%) C#
8 473 (8.13%) C++
9 259 (4.45%) T-SQL
10 218 (3.75%) C
11 173 (2.97%) Ruby
12 172 (2.96%) Perl
13 168 (2.89%) PHP
14 166 (2.85%) Go
15 148 (2.54%) Bash Shell
15 148 (2.54%) MATLAB
16 115 (1.98%) Shell Script
17 76 (1.31%) PL/SQL
18 65 (1.12%) Clojure
19 57 (0.98%) Groovy
Qualifications
1 933 (16.04%) Degree
2 258 (4.44%) PhD
3 237 (4.07%) Security Cleared
4 226 (3.89%) Computer Science Degree
5 123 (2.11%) DV Cleared
6 121 (2.08%) Master's Degree
6 121 (2.08%) SC Cleared
7 118 (2.03%) Numerate Degree
8 52 (0.89%) ISEB
9 38 (0.65%) PMI Certification
10 31 (0.53%) PMP
11 28 (0.48%) Microsoft Certification
12 25 (0.43%) CISSP
13 22 (0.38%) CITP
14 18 (0.31%) ISTQB
15 11 (0.19%) CESG Certified Professional
16 10 (0.17%) CISM
17 9 (0.15%) Cisco Certification
18 8 (0.14%) GIAC
19 7 (0.12%) ITIL Certification
Quality Assurance & Compliance
1 292 (5.02%) QA
2 218 (3.75%) Data Quality
3 27 (0.46%) GCP
3 27 (0.46%) ISO/IEC 27001
4 26 (0.45%) COBIT
5 23 (0.40%) GDPR
6 19 (0.33%) MiFID
7 17 (0.29%) Sarbanes-Oxley
8 16 (0.28%) PCI DSS
9 14 (0.24%) SLA
10 12 (0.21%) Dodd-Frank
11 11 (0.19%) EMIR
12 10 (0.17%) PMO
13 6 (0.10%) ISO 9001
14 5 (0.086%) Actionable Recommendations
15 4 (0.069%) Government Security Classifications
15 4 (0.069%) ISO 14001
15 4 (0.069%) ISO/IEC 20000
16 1 (0.017%) FedRAMP
System Software
1 413 (7.10%) Docker
2 195 (3.35%) HDFS
3 126 (2.17%) Apache Flume
4 35 (0.60%) Apache ZooKeeper
5 34 (0.58%) VMware Infrastructure
6 28 (0.48%) Active Directory
7 22 (0.38%) KVM
8 13 (0.22%) Varnish
9 12 (0.21%) Virtual Machines
10 11 (0.19%) Hyper-V
11 8 (0.14%) Snort
12 5 (0.086%) Oracle RAC
13 4 (0.069%) Firmware
13 4 (0.069%) VirtualBox
13 4 (0.069%) Xen
14 2 (0.034%) Cronacle
14 2 (0.034%) etcd
14 2 (0.034%) flannel
14 2 (0.034%) OpenAM
14 2 (0.034%) vCloud
Systems Management
1 264 (4.54%) Puppet
2 255 (4.38%) Ansible
3 245 (4.21%) Opscode Chef
4 150 (2.58%) Kubernetes
5 120 (2.06%) Mesos
6 93 (1.60%) Oozie
7 70 (1.20%) Terraform
8 66 (1.13%) Kibana
9 59 (1.01%) logstash
10 49 (0.84%) Salt
11 37 (0.64%) Hadoop YARN
12 29 (0.50%) Packer
13 20 (0.34%) Ambari
14 13 (0.22%) Marathon
14 13 (0.22%) Nagios
15 8 (0.14%) Docker Swarm
15 8 (0.14%) Graphite
15 8 (0.14%) HockeyApp
15 8 (0.14%) Red Hat Satellite
16 7 (0.12%) ZABBIX
Vendors
1 645 (11.09%) Microsoft
2 570 (9.80%) Oracle
3 442 (7.60%) Tableau
4 337 (5.79%) Google
5 289 (4.97%) SAP
6 241 (4.14%) Cloudera
7 163 (2.80%) Hortonworks
8 126 (2.17%) Splunk
9 109 (1.87%) Red Hat
10 100 (1.72%) Informatica
11 94 (1.62%) Talend
12 90 (1.55%) IBM
13 87 (1.50%) Teradata
14 83 (1.43%) MapR
15 68 (1.17%) VMware
16 60 (1.03%) Cognos
17 47 (0.81%) Atlassian
17 47 (0.81%) Salesforce.com
18 46 (0.79%) Cisco
19 44 (0.76%) Netezza