Period
to 21 March 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 March 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
21 Mar 2019
Same period 2018 Same period 2017
Rank 83 85 82
Rank change year-on-year +2 -3 +13
Permanent jobs citing Big Data 5,299 6,229 5,842
As % of all permanent IT jobs advertised in the UK 3.57% 3.54% 3.39%
As % of the Database & Business Intelligence category 12.54% 11.56% 11.17%
Number of salaries quoted 4,215 4,996 4,976
UK median annual salary £67,500 £62,500 £62,500
Median salary % change year-on-year +8.00% - +4.17%
10th Percentile £35,250 £37,500 £36,250
90th Percentile £101,250 £95,000 £95,000
UK excluding London median annual salary £55,000 £52,500 £55,000
% change year-on-year +4.76% -4.55% +10.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 42,246 53,906 52,290
As % of all permanent IT jobs advertised in the UK 28.49% 30.64% 30.36%
Number of salaries quoted 34,759 45,102 44,612
UK median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £30,011 £29,500
90th Percentile £85,000 £78,750 £76,250
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +2.41%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 21 March 2019.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 21 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -1 4,898 £70,000 +7.69% 792
London -6 2,906 £75,000 +7.14% 421
UK excluding London +16 2,216 £55,000 +4.76% 445
South East +10 681 £55,000 - 112
South West +21 413 £57,500 +9.52% 77
North of England +10 395 £50,000 - 76
North West +3 262 £55,000 +10.00% 41
Midlands +35 261 £44,500 -19.09% 62
Scotland +10 213 £45,000 -10.00% 53
East of England -3 207 £64,375 +7.29% 44
West Midlands +25 149 £37,500 -25.00% 39
East Midlands +32 112 £52,500 -12.50% 23
Yorkshire +5 101 £50,000 - 16
Wales +13 39 £41,500 -13.54% 16
North East +21 36 £49,337 +27.32% 20
Northern Ireland -16 8 £42,500 - 3
Channel Islands - 1 £95,000 - 2

For the 6 months to 21 March 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,297 (43.35%) Agile Software Development
2 2,157 (40.71%) Python
3 2,152 (40.61%) Java
4 1,879 (35.46%) Analytics
5 1,774 (33.48%) Hadoop
6 1,644 (31.02%) SQL
7 1,530 (28.87%) Apache Spark
8 1,483 (27.99%) Amazon AWS
9 1,360 (25.67%) Machine Learning
10 1,165 (21.99%) Finance
11 1,163 (21.95%) Software Engineering
12 1,057 (19.95%) Data Science
13 1,031 (19.46%) Degree
14 1,020 (19.25%) Kafka
15 990 (18.68%) Microsoft Azure
16 989 (18.66%) DevOps
17 986 (18.61%) NoSQL
18 946 (17.85%) Scala
19 886 (16.72%) Artificial Intelligence
20 878 (16.57%) Business Intelligence
21 833 (15.72%) Linux
22 830 (15.66%) ETL
23 766 (14.46%) Data Modelling
24 755 (14.25%) Apache Hive
25 664 (12.53%) Data Analytics
26 661 (12.47%) Data Warehouse
27 657 (12.40%) C#
28 647 (12.21%) Analytical Skills
29 630 (11.89%) JavaScript
30 606 (11.44%) Google Cloud Platform

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,530 (28.87%) Apache Spark
2 440 (8.30%) Apache
3 401 (7.57%) Elasticsearch
4 268 (5.06%) Apache Pig
5 183 (3.45%) SAS
6 99 (1.87%) Apache Solr
7 69 (1.30%) Confluence
8 44 (0.83%) Tomcat
9 43 (0.81%) CMS
10 32 (0.60%) Apache Airflow
11 30 (0.57%) JBoss
12 25 (0.47%) SharePoint
13 20 (0.38%) Oracle SOA Suite
13 20 (0.38%) WebSphere
14 19 (0.36%) Oracle Workflow
15 18 (0.34%) Adobe Experience Manager
15 18 (0.34%) NServiceBus
16 16 (0.30%) WebLogic
17 15 (0.28%) Apache Geronimo
17 15 (0.28%) GlassFish
Applications
1 91 (1.72%) Microsoft Excel
2 37 (0.70%) Microsoft PowerPoint
3 30 (0.57%) Microsoft Office
4 26 (0.49%) GNU Octave
5 25 (0.47%) SPSS
6 18 (0.34%) Weka
7 15 (0.28%) Chatbot
8 12 (0.23%) Snapchat
9 10 (0.19%) MS Visio
10 7 (0.13%) Stata
11 6 (0.11%) InVision
12 4 (0.075%) Simulink
13 2 (0.038%) Adobe Illustrator
13 2 (0.038%) Gephi
13 2 (0.038%) Microsoft Project
13 2 (0.038%) Open Workbench
13 2 (0.038%) Photoshop
13 2 (0.038%) S-PLUS
13 2 (0.038%) Spreadsheet
14 1 (0.019%) OmniGraffle
Business Applications
1 28 (0.53%) SAP S/4HANA
2 9 (0.17%) Distributed Ledger
2 9 (0.17%) Dynamics CRM
3 7 (0.13%) Dynamics NAV
4 6 (0.11%) Oracle BPM
4 6 (0.11%) Oracle Payables
4 6 (0.11%) Oracle Receivables
5 5 (0.094%) MetaTrader
6 4 (0.075%) Changepoint
6 4 (0.075%) SAP ERP
7 3 (0.057%) Oracle BRM
7 3 (0.057%) Oracle CRM On Demand
7 3 (0.057%) SAP BPC
8 2 (0.038%) SAP CRM
9 1 (0.019%) Oracle CRM
9 1 (0.019%) Oracle EBS
9 1 (0.019%) Oracle Financials
9 1 (0.019%) SAP CO
9 1 (0.019%) SAP FI
9 1 (0.019%) SAP FI/CO
Cloud Services
1 1,483 (27.99%) Amazon AWS
2 990 (18.68%) Microsoft Azure
3 606 (11.44%) Google Cloud Platform
4 197 (3.72%) Serverless
5 170 (3.21%) Cloud Computing
6 149 (2.81%) GitHub
7 129 (2.43%) PaaS
8 128 (2.42%) AWS Lambda
9 124 (2.34%) Amazon EMR
10 121 (2.28%) SaaS
11 119 (2.25%) Amazon EC2
12 108 (2.04%) Amazon S3
13 75 (1.42%) Amazon SQS
14 64 (1.21%) Azure Data Factory
15 61 (1.15%) AWS CloudFormation
16 56 (1.06%) Amazon Kinesis
16 56 (1.06%) IaaS
17 38 (0.72%) Amazon CloudWatch
18 35 (0.66%) Azure Machine Learning
19 33 (0.62%) IBM Cloud
Communications & Networking
1 182 (3.43%) Internet
2 60 (1.13%) Firewall
3 55 (1.04%) HTTP
4 47 (0.89%) VPN
5 43 (0.81%) TCP/IP
6 29 (0.55%) SSH
7 28 (0.53%) Wireless
8 27 (0.51%) AMQP
9 21 (0.40%) DNS
9 21 (0.40%) Network Security
10 13 (0.25%) Kerberos
10 13 (0.25%) SSL
10 13 (0.25%) WAN
10 13 (0.25%) WebEx
11 12 (0.23%) SNMP
12 11 (0.21%) Unified Communications
13 10 (0.19%) DHCP
13 10 (0.19%) MQTT
13 10 (0.19%) SAN
14 9 (0.17%) Wi-Fi
Database & Business Intelligence
1 1,774 (33.48%) Hadoop
2 986 (18.61%) NoSQL
3 755 (14.25%) Apache Hive
4 661 (12.47%) Data Warehouse
5 539 (10.17%) SQL Server
6 498 (9.40%) Apache Cassandra
7 476 (8.98%) HBase
8 451 (8.51%) MongoDB
9 367 (6.93%) Relational Database
10 331 (6.25%) Amazon Redshift
11 316 (5.96%) Data Lake
12 296 (5.59%) MySQL
13 293 (5.53%) Power BI
14 283 (5.34%) Impala
15 241 (4.55%) PostgreSQL
16 219 (4.13%) SQL Server Integration Services
17 204 (3.85%) Flink
18 175 (3.30%) RDBMS
19 156 (2.94%) Sqoop
20 152 (2.87%) QlikView
Development Applications
1 387 (7.30%) Git (software)
2 322 (6.08%) Jenkins
3 228 (4.30%) JIRA
4 120 (2.26%) Maven
5 97 (1.83%) Selenium
6 94 (1.77%) Eclipse
7 86 (1.62%) Visual Studio
8 79 (1.49%) Eclipse RCP
9 70 (1.32%) Gradle
10 69 (1.30%) Cucumber
11 61 (1.15%) Subversion
12 57 (1.08%) Atlassian Bamboo
13 50 (0.94%) Ant
14 46 (0.87%) Bitbucket
14 46 (0.87%) JUnit
15 40 (0.75%) TeamCity
16 34 (0.64%) Team Foundation Server
17 32 (0.60%) Octopus Deploy
18 28 (0.53%) ERwin
18 28 (0.53%) SoapUI
General
1 1,165 (21.99%) Finance
2 416 (7.85%) Banking
3 373 (7.04%) Retail
4 261 (4.93%) Law
5 249 (4.70%) Marketing
6 225 (4.25%) Telecoms
7 203 (3.83%) Military
8 98 (1.85%) Games
8 98 (1.85%) Investment Banking
9 97 (1.83%) Automotive
10 72 (1.36%) Manufacturing
11 71 (1.34%) Electronics
12 64 (1.21%) Pharmaceutical
13 60 (1.13%) Advertising
14 59 (1.11%) Publishing
15 46 (0.87%) Legal
16 42 (0.79%) Financial Institution
17 23 (0.43%) Front Office
18 13 (0.25%) Local Government
19 12 (0.23%) Retail Banking
Job Titles
1 1,404 (26.50%) Developer
2 814 (15.36%) Data Engineer
3 735 (13.87%) Architect
4 578 (10.91%) Java Developer
5 475 (8.96%) Big Data Engineer
6 416 (7.85%) Software Engineer
7 383 (7.23%) Data Architect
8 295 (5.57%) Analyst
8 295 (5.57%) Data Scientist
9 258 (4.87%) Senior Developer
10 248 (4.68%) Consultant
11 217 (4.10%) Solutions Architect
12 198 (3.74%) Big Data Developer
13 185 (3.49%) Senior Software Engineer
14 180 (3.40%) DevOps Engineer
15 177 (3.34%) Python Engineer
16 158 (2.98%) Junior
17 154 (2.91%) Senior Data Engineer
18 152 (2.87%) Java Engineer
19 151 (2.85%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 1,020 (19.25%) Kafka
2 436 (8.23%) HTML
3 410 (7.74%) .NET
4 394 (7.44%) Web Services
5 342 (6.45%) CSS
6 296 (5.59%) AngularJS
6 296 (5.59%) Spring
7 269 (5.08%) RESTful
8 267 (5.04%) REST
9 248 (4.68%) Node.js
9 248 (4.68%) React
10 199 (3.76%) Middleware
11 163 (3.08%) Spark Streaming
12 161 (3.04%) HTML5
13 159 (3.00%) Natural Language Processing
14 144 (2.72%) JSON
15 120 (2.26%) SOAP
16 118 (2.23%) XML
17 114 (2.15%) ASP.NET
18 111 (2.09%) Apache NiFi
Miscellaneous
1 647 (12.21%) Analytical Skills
2 455 (8.59%) Algorithms
3 240 (4.53%) Greenfield Project
4 217 (4.10%) Fintech
5 209 (3.94%) User Experience
6 190 (3.59%) Data Structures
7 132 (2.49%) Internet of Things
8 125 (2.36%) Management Information System
9 96 (1.81%) Mobile App
10 83 (1.57%) Enterprise Software
11 82 (1.55%) Robotics
12 77 (1.45%) Hedge funds
13 71 (1.34%) Public Cloud
14 63 (1.19%) Virtual Team
15 62 (1.17%) Self-Motivation
16 55 (1.04%) Social Media
17 53 (1.00%) Linux Command Line
18 52 (0.98%) Data Centre
19 51 (0.96%) Semantic Web
20 48 (0.91%) Clustering
Operating Systems
1 833 (15.72%) Linux
2 316 (5.96%) Unix
3 274 (5.17%) Windows
4 131 (2.47%) Android
5 82 (1.55%) CentOS
6 70 (1.32%) Apple iOS
6 70 (1.32%) Red Hat Enterprise Linux
6 70 (1.32%) Ubuntu
7 26 (0.49%) Windows Server
8 9 (0.17%) Solaris
9 8 (0.15%) Debian
10 7 (0.13%) Mac OS X
11 6 (0.11%) Fedora
11 6 (0.11%) Windows Phone
12 4 (0.075%) AIX
12 4 (0.075%) HPUX
12 4 (0.075%) Oracle Linux
13 3 (0.057%) VMS
13 3 (0.057%) Windows 10
13 3 (0.057%) Windows 7
Processes & Methodologies
1 2,297 (43.35%) Agile Software Development
2 1,879 (35.46%) Analytics
3 1,360 (25.67%) Machine Learning
4 1,163 (21.95%) Software Engineering
5 1,057 (19.95%) Data Science
6 989 (18.66%) DevOps
7 886 (16.72%) Artificial Intelligence
8 878 (16.57%) Business Intelligence
9 830 (15.66%) ETL
10 766 (14.46%) Data Modelling
11 664 (12.53%) Data Analytics
12 580 (10.95%) Computer Science
13 578 (10.91%) TDD
14 557 (10.51%) Visualisation
15 529 (9.98%) Data Analysis
16 528 (9.96%) Scrum
17 525 (9.91%) Continuous Integration
17 525 (9.91%) Microservices
18 489 (9.23%) Mathematics
19 475 (8.96%) Problem-Solving
Programming Languages
1 2,157 (40.71%) Python
2 2,152 (40.61%) Java
3 1,644 (31.02%) SQL
4 946 (17.85%) Scala
5 657 (12.40%) C#
6 630 (11.89%) JavaScript
7 484 (9.13%) C++
8 443 (8.36%) R
9 283 (5.34%) Java 8
10 233 (4.40%) C
11 168 (3.17%) T-SQL
12 157 (2.96%) Bash Shell
13 149 (2.81%) MATLAB
14 112 (2.11%) PHP
15 111 (2.09%) Shell Script
16 102 (1.92%) PL/SQL
17 85 (1.60%) PowerShell
18 84 (1.59%) Go
19 82 (1.55%) Ruby
20 65 (1.23%) Groovy
Qualifications
1 1,031 (19.46%) Degree
2 288 (5.43%) Computer Science Degree
3 286 (5.40%) Security Cleared
4 170 (3.21%) PhD
5 141 (2.66%) SC Cleared
6 128 (2.42%) DV Cleared
7 95 (1.79%) Numerate Degree
8 65 (1.23%) CISSP
9 61 (1.15%) Master's Degree
10 48 (0.91%) CISM
11 40 (0.75%) Cisco Certification
12 36 (0.68%) AWS Certification
13 28 (0.53%) PMI Certification
14 26 (0.49%) CISA
14 26 (0.49%) ISEB
15 23 (0.43%) Microsoft Certification
15 23 (0.43%) SSCP
16 22 (0.42%) SANS
16 22 (0.42%) TOGAF Certification
17 21 (0.40%) CCIE
Quality Assurance & Compliance
1 229 (4.32%) QA
2 224 (4.23%) Data Quality
3 106 (2.00%) GDPR
4 46 (0.87%) ISO/IEC 27001
5 22 (0.42%) MiFID
6 18 (0.34%) COBIT
7 17 (0.32%) IFRS
8 15 (0.28%) Solvency II
9 14 (0.26%) BS7799
9 14 (0.26%) Dodd-Frank
9 14 (0.26%) PCI DSS
10 13 (0.25%) FATCA
10 13 (0.25%) PMO
11 5 (0.094%) Cyber Essentials
11 5 (0.094%) SLA
12 4 (0.075%) IFRS 9
13 3 (0.057%) GxP
13 3 (0.057%) ISO 20022
13 3 (0.057%) ISO 9001
13 3 (0.057%) PA-DSS
System Software
1 513 (9.68%) Docker
2 208 (3.93%) HDFS
3 196 (3.70%) Apache Flume
4 99 (1.87%) Apache ZooKeeper
5 35 (0.66%) VMware Infrastructure
6 34 (0.64%) Active Directory
7 23 (0.43%) Oracle RAC
8 18 (0.34%) VirtualBox
9 14 (0.26%) Virtual Machines
10 10 (0.19%) Hyper-V
10 10 (0.19%) VMware ESXi
11 8 (0.15%) vSphere
12 7 (0.13%) Xen
13 6 (0.11%) NFS
13 6 (0.11%) Samba
14 5 (0.094%) XenApp
15 4 (0.075%) iptables
15 4 (0.075%) VMware NSX
15 4 (0.075%) VMware Server
16 3 (0.057%) GridGain
Systems Management
1 289 (5.45%) Ansible
2 286 (5.40%) Kubernetes
3 262 (4.94%) Oozie
4 218 (4.11%) Terraform
5 191 (3.60%) Hadoop YARN
6 166 (3.13%) Puppet
7 109 (2.06%) Opscode Chef
8 74 (1.40%) Ambari
9 54 (1.02%) Kibana
10 48 (0.91%) Mesos
10 48 (0.91%) Nagios
11 28 (0.53%) Salt
12 22 (0.42%) Docker Swarm
13 18 (0.34%) Enterprise Manager Cloud Control
13 18 (0.34%) logstash
14 17 (0.32%) Marathon
15 12 (0.23%) Packer
15 12 (0.23%) systemd
16 10 (0.19%) vCenter Server
17 9 (0.17%) Graphite
Vendors
1 502 (9.47%) Oracle
2 475 (8.96%) Microsoft
3 454 (8.57%) Google
4 430 (8.11%) Tableau
5 403 (7.61%) Cloudera
6 296 (5.59%) Hortonworks
7 207 (3.91%) SAP
8 149 (2.81%) Informatica
9 140 (2.64%) Databricks
10 139 (2.62%) IBM
11 130 (2.45%) MapR
12 109 (2.06%) Talend
13 85 (1.60%) Red Hat
14 77 (1.45%) Teradata
15 74 (1.40%) Splunk
16 51 (0.96%) Sybase
17 50 (0.94%) VMware
18 43 (0.81%) Alteryx
19 40 (0.75%) CA Agile Central
19 40 (0.75%) Netezza