Period
to 17 February 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 17 February 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
17 Feb 2018
Same period 2017 Same period 2016
Rank 90 83 91
Rank change year-on-year -7 +8 +83
Permanent jobs citing Big Data 5,983 5,787 6,421
As % of all permanent IT jobs advertised in the UK 3.42% 3.29% 3.05%
As % of the Database & Business Intelligence category 11.16% 10.99% 9.60%
Number of salaries quoted 4,880 4,922 5,214
UK median annual salary £62,500 £62,500 £60,000
Median salary % change year-on-year - +4.17% +4.35%
10th Percentile £37,500 £36,250 £37,250
90th Percentile £95,000 £95,000 £95,000
UK excluding London median annual salary £52,500 £55,000 £50,000
% change year-on-year -4.55% +10.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 53,622 52,644 66,899
As % of all permanent IT jobs advertised in the UK 30.62% 29.97% 31.73%
Number of salaries quoted 44,637 44,957 56,481
UK median annual salary £48,500 £47,500 £45,000
Median salary % change year-on-year +2.11% +5.56% -
10th Percentile £30,000 £29,500 £28,750
90th Percentile £77,500 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £41,000
% change year-on-year - +3.66% +2.50%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 17 February 2018.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 17 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -6 5,616 £65,000 +4.00% 883
London +5 3,499 £70,000 - 523
UK excluding London -11 2,345 £52,500 -4.55% 402
South East +6 760 £55,000 +1.85% 130
North of England -11 462 £48,500 -7.62% 95
South West -25 332 £52,500 -4.55% 56
North West -24 311 £50,000 -4.76% 53
East of England +13 283 £60,000 +9.09% 33
Scotland +19 234 £45,000 -5.26% 31
Midlands -55 234 £50,000 -16.67% 45
West Midlands -18 144 £44,500 -22.61% 26
Yorkshire +4 116 £50,000 -9.09% 34
East Midlands -63 90 £60,000 - 19
Wales -4 39 £48,750 - 4
North East -5 29 £36,750 -3.77% 8
Northern Ireland -19 5 £45,000 +32.35% 8

For the 6 months to 17 February 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,455 (41.03%) Java
2 2,335 (39.03%) Agile Software Development
3 2,155 (36.02%) Python
4 2,070 (34.60%) Analytics
5 2,020 (33.76%) Hadoop
6 1,857 (31.04%) SQL
7 1,605 (26.83%) Apache Spark
8 1,379 (23.05%) Amazon AWS
9 1,365 (22.81%) Machine Learning
10 1,278 (21.36%) Finance
11 1,172 (19.59%) Data Science
12 1,043 (17.43%) Scala
13 1,025 (17.13%) Degree
14 985 (16.46%) Business Intelligence
15 957 (16.00%) Software Engineering
16 919 (15.36%) DevOps
17 868 (14.51%) NoSQL
18 854 (14.27%) JavaScript
19 853 (14.26%) Linux
20 829 (13.86%) TDD
21 808 (13.50%) Data Analytics
22 767 (12.82%) Microsoft Azure
23 735 (12.28%) Data Warehouse
24 727 (12.15%) Analytical Skills
25 719 (12.02%) Computer Science
26 690 (11.53%) C#
27 688 (11.50%) ETL
28 656 (10.96%) Scrum
29 622 (10.40%) Kafka
30 618 (10.33%) Apache Hive

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,605 (26.83%) Apache Spark
2 439 (7.34%) Elasticsearch
3 296 (4.95%) Apache
4 242 (4.04%) SAS
5 198 (3.31%) Apache Pig
6 128 (2.14%) Apache Solr
7 81 (1.35%) Confluence
8 76 (1.27%) Tomcat
9 54 (0.90%) JBoss
10 45 (0.75%) OpenStack
11 40 (0.67%) WebSphere
12 30 (0.50%) WebLogic
13 28 (0.47%) Apache Airflow
14 27 (0.45%) CMS
15 24 (0.40%) nginx
15 24 (0.40%) Oracle SOA Suite
16 22 (0.37%) IIS
16 22 (0.37%) SharePoint
17 21 (0.35%) Jetty
18 16 (0.27%) Luigi
Applications
1 85 (1.42%) Microsoft Excel
2 66 (1.10%) SPSS
3 39 (0.65%) Microsoft Office
4 31 (0.52%) Microsoft Project
5 25 (0.42%) Microsoft PowerPoint
6 14 (0.23%) MS Visio
7 13 (0.22%) Chatbot
7 13 (0.22%) Weka
8 11 (0.18%) OmniGraffle
8 11 (0.18%) Photoshop
9 10 (0.17%) Adobe Illustrator
9 10 (0.17%) GNU Octave
9 10 (0.17%) Mathematica
10 5 (0.084%) Stata
11 2 (0.033%) HipChat
12 1 (0.017%) InVision
12 1 (0.017%) Siemens NX
12 1 (0.017%) SOLIDWORKS
12 1 (0.017%) S-PLUS
12 1 (0.017%) Spreadsheet
Business Applications
1 44 (0.74%) Dynamics CRM
2 21 (0.35%) Dynamics AX
3 11 (0.18%) SAP S/4HANA
4 10 (0.17%) Markit EDM
5 8 (0.13%) Cognos Business Intelligence
6 7 (0.12%) BusinessWorks
6 7 (0.12%) TIBCO BusinessEvents
7 6 (0.10%) Oracle EBS
8 5 (0.084%) Oracle Applications
8 5 (0.084%) Oracle ERP
8 5 (0.084%) SAP CO
8 5 (0.084%) SAP FI
8 5 (0.084%) SAP FI/CO
9 4 (0.067%) Oracle Receivables
9 4 (0.067%) SAP MDG
10 3 (0.050%) Distributed Ledger
10 3 (0.050%) Hyperion Planning
10 3 (0.050%) Oracle TCA
10 3 (0.050%) Payment Gateway
10 3 (0.050%) SAP Hybris
Cloud Services
1 1,379 (23.05%) Amazon AWS
2 767 (12.82%) Microsoft Azure
3 221 (3.69%) SaaS
4 207 (3.46%) Google Cloud Platform
5 188 (3.14%) GitHub
6 131 (2.19%) IaaS
7 129 (2.16%) Cloud Computing
8 121 (2.02%) Serverless
9 117 (1.96%) PaaS
10 104 (1.74%) Azure Data Factory
11 90 (1.50%) Amazon S3
12 84 (1.40%) Cortana Intelligence Suite
13 80 (1.34%) Amazon EMR
14 79 (1.32%) Amazon Kinesis
15 68 (1.14%) AWS CloudFormation
16 58 (0.97%) Amazon EC2
17 57 (0.95%) AWS Lambda
18 46 (0.77%) Google Analytics
19 43 (0.72%) Azure Machine Learning
20 38 (0.64%) OpenShift
Communications & Networking
1 131 (2.19%) Wireless
2 123 (2.06%) Internet
3 111 (1.86%) HTTP
4 52 (0.87%) Firewall
5 47 (0.79%) SSL
6 41 (0.69%) TCP/IP
7 39 (0.65%) Network Security
8 36 (0.60%) Unified Communications
9 33 (0.55%) DNS
10 31 (0.52%) Kerberos
10 31 (0.52%) Wireless Security
11 24 (0.40%) WAN
12 23 (0.38%) SAN
13 21 (0.35%) LAN
14 16 (0.27%) SMS
15 14 (0.23%) SMTP
16 12 (0.20%) DHCP
17 10 (0.17%) Ethernet
17 10 (0.17%) VPN
18 8 (0.13%) GSM
Database & Business Intelligence
1 2,020 (33.76%) Hadoop
2 868 (14.51%) NoSQL
3 735 (12.28%) Data Warehouse
4 618 (10.33%) Apache Hive
5 608 (10.16%) SQL Server
6 543 (9.08%) MongoDB
7 502 (8.39%) Apache Cassandra
8 475 (7.94%) Relational Database
9 448 (7.49%) HBase
10 350 (5.85%) MySQL
11 299 (5.00%) Data Lake
12 287 (4.80%) Power BI
13 255 (4.26%) RDBMS
14 227 (3.79%) SQL Server Integration Services
15 221 (3.69%) Data Mining
16 202 (3.38%) Impala
16 202 (3.38%) PostgreSQL
17 175 (2.92%) Amazon Redshift
18 163 (2.72%) SQL Server Analysis Services
19 158 (2.64%) SQL Server Reporting Services
Development Applications
1 455 (7.60%) Git (software)
2 363 (6.07%) Jenkins
3 348 (5.82%) JIRA
4 164 (2.74%) Selenium
5 161 (2.69%) Bitbucket
6 152 (2.54%) Atlassian Bamboo
7 143 (2.39%) JUnit
8 127 (2.12%) Maven
9 121 (2.02%) Visual Studio
10 102 (1.70%) Cucumber
11 96 (1.60%) Gradle
12 89 (1.49%) Calabash
13 74 (1.24%) Team Foundation Server
14 70 (1.17%) TeamCity
15 65 (1.09%) Mockito
16 57 (0.95%) Android Studio
16 57 (0.95%) Subversion
17 49 (0.82%) Eclipse
18 41 (0.69%) WebDriver
19 40 (0.67%) gulp
General
1 1,278 (21.36%) Finance
2 474 (7.92%) Banking
3 414 (6.92%) Marketing
4 383 (6.40%) Retail
5 259 (4.33%) Telecoms
6 200 (3.34%) Investment Banking
7 182 (3.04%) Electronics
8 155 (2.59%) Games
9 145 (2.42%) Manufacturing
10 134 (2.24%) Front Office
11 114 (1.91%) Financial Institution
12 105 (1.75%) Advertising
13 76 (1.27%) Publishing
14 70 (1.17%) Legal
15 67 (1.12%) Pharmaceutical
16 66 (1.10%) Retail Banking
17 62 (1.04%) Law
18 42 (0.70%) Automotive
19 29 (0.48%) Military
20 19 (0.32%) Back Office
Job Titles
1 1,845 (30.84%) Developer
2 805 (13.45%) Architect
3 656 (10.96%) Java Developer
4 557 (9.31%) Data Engineer
5 414 (6.92%) Big Data Engineer
6 387 (6.47%) Data Scientist
7 370 (6.18%) Senior Developer
8 355 (5.93%) Analyst
9 345 (5.77%) Data Architect
9 345 (5.77%) Software Engineer
10 341 (5.70%) Consultant
11 265 (4.43%) Big Data Developer
12 216 (3.61%) DevOps Engineer
13 199 (3.33%) Solutions Architect
14 191 (3.19%) Python Developer
15 188 (3.14%) Big Data Architect
16 183 (3.06%) Senior Java Developer
17 178 (2.98%) Software Developer
18 172 (2.87%) Java Engineer
19 148 (2.47%) Technical Architect
Libraries, Frameworks & Software Standards
1 622 (10.40%) Kafka
2 488 (8.16%) HTML
3 475 (7.94%) AngularJS
4 457 (7.64%) .NET
5 437 (7.30%) Spring
6 435 (7.27%) Web Services
7 392 (6.55%) Node.js
8 384 (6.42%) CSS
9 316 (5.28%) REST
10 300 (5.01%) React
11 216 (3.61%) RESTful
12 211 (3.53%) Natural Language Processing
13 201 (3.36%) HTML5
14 192 (3.21%) Hibernate
15 185 (3.09%) XML
16 166 (2.77%) SOAP
17 160 (2.67%) JSON
18 155 (2.59%) J2EE
19 124 (2.07%) RabbitMQ
20 121 (2.02%) jQuery
Miscellaneous
1 727 (12.15%) Analytical Skills
2 719 (12.02%) Computer Science
3 523 (8.74%) Algorithms
4 391 (6.54%) User Experience
5 318 (5.32%) Greenfield Project
6 306 (5.11%) Fintech
7 182 (3.04%) Data Centre
8 175 (2.92%) Mobile App
9 142 (2.37%) Enterprise Software
10 132 (2.21%) Data Structures
11 120 (2.01%) Robotics
12 104 (1.74%) Management Information System
13 68 (1.14%) Public Cloud
14 61 (1.02%) Equities
14 61 (1.02%) Hedge funds
15 59 (0.99%) Clustering
15 59 (0.99%) Cyberthreat
16 55 (0.92%) Internet of Things
17 53 (0.89%) Linux Command Line
18 48 (0.80%) Virtual Team
Operating Systems
1 853 (14.26%) Linux
2 308 (5.15%) Unix
3 286 (4.78%) Windows
4 116 (1.94%) Android
5 96 (1.60%) Apple iOS
6 61 (1.02%) Red Hat Enterprise Linux
7 56 (0.94%) CentOS
8 48 (0.80%) Ubuntu
9 25 (0.42%) Solaris
10 23 (0.38%) Mac OS X
11 20 (0.33%) Windows Server
12 17 (0.28%) Mac OS
13 11 (0.18%) AIX
14 10 (0.17%) Robot Operating System
15 8 (0.13%) HPUX
15 8 (0.13%) VMS
16 7 (0.12%) Windows Server 2012
17 6 (0.10%) Oracle Linux
18 4 (0.067%) CoreOS
18 4 (0.067%) Windows 8
Processes & Methodologies
1 2,335 (39.03%) Agile Software Development
2 2,070 (34.60%) Analytics
3 1,365 (22.81%) Machine Learning
4 1,172 (19.59%) Data Science
5 985 (16.46%) Business Intelligence
6 957 (16.00%) Software Engineering
7 919 (15.36%) DevOps
8 829 (13.86%) TDD
9 808 (13.50%) Data Analytics
10 688 (11.50%) ETL
11 656 (10.96%) Scrum
12 601 (10.05%) Visualisation
13 564 (9.43%) Mathematics
14 530 (8.86%) Microservices
15 509 (8.51%) Test Automation
16 501 (8.37%) BDD
17 500 (8.36%) Open Source
18 496 (8.29%) Continuous Integration
19 470 (7.86%) Data Modelling
20 373 (6.23%) Data Visualisation
Programming Languages
1 2,455 (41.03%) Java
2 2,155 (36.02%) Python
3 1,857 (31.04%) SQL
4 1,043 (17.43%) Scala
5 854 (14.27%) JavaScript
6 690 (11.53%) C#
7 603 (10.08%) R
8 595 (9.94%) C++
9 231 (3.86%) C
10 224 (3.74%) Ruby
11 221 (3.69%) Bash Shell
12 212 (3.54%) Go
13 163 (2.72%) Perl
13 163 (2.72%) PHP
14 158 (2.64%) MATLAB
15 116 (1.94%) T-SQL
16 99 (1.65%) Shell Script
17 69 (1.15%) PL/SQL
18 66 (1.10%) PowerShell
19 52 (0.87%) Objective-C
Qualifications
1 1,025 (17.13%) Degree
2 300 (5.01%) PhD
3 253 (4.23%) Computer Science Degree
4 162 (2.71%) Security Cleared
5 148 (2.47%) Numerate Degree
6 104 (1.74%) Master's Degree
7 71 (1.19%) DV Cleared
8 70 (1.17%) SC Cleared
9 61 (1.02%) ISEB
10 53 (0.89%) CISSP
11 49 (0.82%) Cisco Certification
12 43 (0.72%) CCNA
13 35 (0.58%) CCIE
14 34 (0.57%) Microsoft Certification
15 30 (0.50%) MBA
16 29 (0.48%) CCNP
17 24 (0.40%) SANS
18 22 (0.37%) CEH
19 20 (0.33%) GIAC
20 19 (0.32%) CCDP
Quality Assurance & Compliance
1 270 (4.51%) QA
2 227 (3.79%) Data Quality
3 110 (1.84%) GDPR
4 50 (0.84%) GCP
5 43 (0.72%) ISO/IEC 27001
6 34 (0.57%) Solvency II
7 32 (0.53%) Sarbanes-Oxley
8 22 (0.37%) PCI DSS
9 18 (0.30%) PMO
10 14 (0.23%) HMG Security Policy Framework
10 14 (0.23%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
11 13 (0.22%) GPG13
12 12 (0.20%) Dodd-Frank
12 12 (0.20%) SLA
13 11 (0.18%) FATCA
13 11 (0.18%) MiFID
14 10 (0.17%) Actionable Recommendations
14 10 (0.17%) IFRS
14 10 (0.17%) IFRS 9
15 5 (0.084%) EMIR
System Software
1 589 (9.84%) Docker
2 212 (3.54%) HDFS
3 180 (3.01%) Apache Flume
4 72 (1.20%) VMware Infrastructure
5 56 (0.94%) Virtual Machines
6 48 (0.80%) Apache ZooKeeper
7 47 (0.79%) Active Directory
8 26 (0.43%) Hyper-V
9 17 (0.28%) vSphere
10 15 (0.25%) VMware NSX
11 12 (0.20%) Snort
12 11 (0.18%) NFS
12 11 (0.18%) VMware ESXi
13 7 (0.12%) Varnish
14 4 (0.067%) BitLocker
14 4 (0.067%) VirtualBox
15 3 (0.050%) KVM
16 2 (0.033%) MapR-FS
16 2 (0.033%) Oracle RAC
17 1 (0.017%) Microsoft App-V
Systems Management
1 246 (4.11%) Puppet
2 241 (4.03%) Ansible
3 232 (3.88%) Kubernetes
4 171 (2.86%) Opscode Chef
5 137 (2.29%) Hadoop YARN
6 111 (1.86%) Terraform
7 89 (1.49%) Oozie
8 80 (1.34%) Mesos
9 53 (0.89%) HockeyApp
10 48 (0.80%) Salt
11 38 (0.64%) Kibana
12 30 (0.50%) Ambari
13 23 (0.38%) ZABBIX
14 21 (0.35%) Packer
15 17 (0.28%) logstash
16 15 (0.25%) Marathon
17 14 (0.23%) Docker Swarm
18 13 (0.22%) Rancher
19 12 (0.20%) Suricata
20 11 (0.18%) Simian Army
Vendors
1 574 (9.59%) Oracle
2 567 (9.48%) Microsoft
3 478 (7.99%) Google
4 464 (7.76%) Tableau
5 317 (5.30%) Cloudera
6 199 (3.33%) SAP
7 179 (2.99%) Hortonworks
8 174 (2.91%) IBM
9 141 (2.36%) Atlassian
10 132 (2.21%) Talend
11 129 (2.16%) Informatica
12 121 (2.02%) Splunk
13 116 (1.94%) Teradata
14 111 (1.86%) VMware
15 105 (1.75%) Red Hat
16 101 (1.69%) Salesforce.com
17 79 (1.32%) Cisco
18 66 (1.10%) Twitter
19 65 (1.09%) MapR
20 58 (0.97%) Cognos