Period
to 20 August 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 20 August 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
20 Aug 2019
Same period 2018 Same period 2017
Rank 92 76 96
Rank change year-on-year -16 +20 +6
Permanent jobs citing Big Data 4,377 6,263 5,411
As % of all permanent IT jobs advertised in England 3.34% 3.97% 3.27%
As % of the Database & Business Intelligence category 12.30% 13.22% 10.74%
Number of salaries quoted 3,480 4,208 4,384
England median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +2.46%
10th Percentile £40,000 £38,750 £36,250
90th Percentile £105,000 £95,000 £92,500
UK median annual salary £67,500 £65,000 £62,500
% change year-on-year +3.85% +4.00% +4.17%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 35,596 47,391 50,362
As % of all permanent IT jobs advertised in England 27.17% 30.03% 30.46%
Number of salaries quoted 29,498 38,753 42,341
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,589 £31,250 £30,000
90th Percentile £86,250 £82,500 £77,500
UK median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 20 August 2019.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 20 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -18 2,578 £77,500 +10.71% 283
South East -29 541 £55,000 -7.56% 74
South West +36 494 £50,000 -9.09% 39
North of England -32 328 £55,000 +10.00% 59
Midlands +19 240 £55,000 - 36
North West -34 201 £55,000 +10.00% 46
East of England -24 181 £65,000 +8.33% 34
East Midlands +49 149 £50,000 -26.20% 9
West Midlands -29 88 £55,000 - 27
Yorkshire -4 87 £54,500 -0.91% 11
North East +44 41 £55,000 +41.94% 2
Big Data
UK

For the 6 months to 20 August 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 1,875 (42.84%) Agile Software Development
2 1,794 (40.99%) Python
3 1,635 (37.35%) Analytics
4 1,539 (35.16%) Java
5 1,444 (32.99%) Hadoop
6 1,411 (32.24%) Apache Spark
7 1,387 (31.69%) SQL
8 1,257 (28.72%) Amazon AWS
9 1,085 (24.79%) Machine Learning
10 1,032 (23.58%) Data Science
11 921 (21.04%) DevOps
12 907 (20.72%) Microsoft Azure
13 813 (18.57%) Scala
13 813 (18.57%) Kafka
14 784 (17.91%) Finance
15 774 (17.68%) Business Intelligence
16 751 (17.16%) Apache Hive
17 745 (17.02%) Degree
18 732 (16.72%) Data Warehouse
19 723 (16.52%) Software Engineering
20 693 (15.83%) NoSQL
21 689 (15.74%) ETL
22 661 (15.10%) Linux
23 634 (14.48%) Docker
24 585 (13.37%) Artificial Intelligence
25 559 (12.77%) Google Cloud Platform
26 552 (12.61%) Analytical Skills
27 547 (12.50%) Data Modelling
28 515 (11.77%) Data Analytics
29 508 (11.61%) JavaScript

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,411 (32.24%) Apache Spark
2 342 (7.81%) Elasticsearch
3 245 (5.60%) Apache
4 178 (4.07%) Apache Pig
5 85 (1.94%) SAS
6 80 (1.83%) Apache Solr
7 60 (1.37%) Confluence
8 56 (1.28%) OpenStack
9 42 (0.96%) Apache Airflow
10 30 (0.69%) Jupyter
11 29 (0.66%) NServiceBus
12 24 (0.55%) SharePoint
13 17 (0.39%) CMS
13 17 (0.39%) Oracle SOA Suite
14 16 (0.37%) Adobe Experience Manager
14 16 (0.37%) JBoss
15 15 (0.34%) Tornado
16 13 (0.30%) WildFly
17 12 (0.27%) nginx
18 11 (0.25%) WebLogic
Applications
1 57 (1.30%) Microsoft Excel
2 21 (0.48%) SPSS
3 20 (0.46%) Microsoft Office
4 16 (0.37%) Microsoft PowerPoint
5 11 (0.25%) GNU Octave
5 11 (0.25%) Microsoft Project
6 8 (0.18%) MS Visio
7 7 (0.16%) Gephi
8 6 (0.14%) Chatbot
9 5 (0.11%) Sketch
9 5 (0.11%) Spreadsheet
10 3 (0.069%) Weka
11 2 (0.046%) Stata
12 1 (0.023%) Adobe Premiere
12 1 (0.023%) InVision
12 1 (0.023%) Mathematica
12 1 (0.023%) Simulink
Business Applications
1 45 (1.03%) Sparx Enterprise Architect
2 26 (0.59%) SAP S/4HANA
3 9 (0.21%) Dynamics NAV
4 8 (0.18%) nopCommerce
5 6 (0.14%) Dynamics CRM
5 6 (0.14%) Oracle BPM
6 4 (0.091%) SDL Web 8
7 3 (0.069%) Adobe Campaign
7 3 (0.069%) SAP BPC
7 3 (0.069%) SAP Business ByDesign
7 3 (0.069%) SAP ERP
7 3 (0.069%) SAP HCM
7 3 (0.069%) SAP Oil and Gas
7 3 (0.069%) SAP Payroll
8 1 (0.023%) Data Workbench
8 1 (0.023%) Hyperion Planning
8 1 (0.023%) Oracle Payables
8 1 (0.023%) Oracle Receivables
8 1 (0.023%) Payment Gateway
8 1 (0.023%) SAP SCM
Cloud Services
1 1,257 (28.72%) Amazon AWS
2 907 (20.72%) Microsoft Azure
3 559 (12.77%) Google Cloud Platform
4 313 (7.15%) Power Platform
5 195 (4.46%) Serverless
6 140 (3.20%) Amazon S3
7 122 (2.79%) Amazon EMR
8 120 (2.74%) Cloud Computing
9 117 (2.67%) SaaS
10 115 (2.63%) PaaS
11 102 (2.33%) Amazon EC2
12 89 (2.03%) Azure Data Factory
13 87 (1.99%) AWS Lambda
14 84 (1.92%) GitHub
15 75 (1.71%) Amazon SQS
16 72 (1.64%) OpenShift
17 70 (1.60%) Amazon Kinesis
18 56 (1.28%) Azure Machine Learning
19 49 (1.12%) Amazon ECS
19 49 (1.12%) AWS CloudFormation
Communications & Networking
1 149 (3.40%) Internet
2 70 (1.60%) TCP/IP
3 62 (1.42%) Firewall
4 38 (0.87%) HTTPS
5 36 (0.82%) HTTP
6 21 (0.48%) VPN
7 18 (0.41%) SSH
8 16 (0.37%) DNS
9 14 (0.32%) Network Security
9 14 (0.32%) Wi-Fi
10 13 (0.30%) SSL
11 10 (0.23%) Kerberos
11 10 (0.23%) Wireless
12 7 (0.16%) Ethernet
12 7 (0.16%) MPLS
12 7 (0.16%) Unified Communications
13 6 (0.14%) DHCP
14 5 (0.11%) 5G
14 5 (0.11%) SNMP
15 4 (0.091%) SAN
Database & Business Intelligence
1 1,444 (32.99%) Hadoop
2 751 (17.16%) Apache Hive
3 732 (16.72%) Data Warehouse
4 693 (15.83%) NoSQL
5 428 (9.78%) SQL Server
6 375 (8.57%) MongoDB
7 351 (8.02%) Data Lake
8 328 (7.49%) HBase
9 313 (7.15%) Power BI
10 291 (6.65%) Impala
11 266 (6.08%) Apache Cassandra
12 258 (5.89%) Relational Database
13 218 (4.98%) Amazon Redshift
14 198 (4.52%) MySQL
15 192 (4.39%) PostgreSQL
16 161 (3.68%) SQL Server Integration Services
17 145 (3.31%) Sqoop
18 117 (2.67%) SQL Server Reporting Services
19 113 (2.58%) QlikView
20 111 (2.54%) BigQuery
Development Applications
1 456 (10.42%) Git (software)
2 357 (8.16%) Jenkins
3 222 (5.07%) JIRA
4 126 (2.88%) Bitbucket
5 98 (2.24%) git-flow
6 87 (1.99%) Selenium
7 76 (1.74%) Maven
8 67 (1.53%) Cucumber
9 62 (1.42%) Visual Studio
10 54 (1.23%) Octopus Deploy
11 46 (1.05%) Atlassian Bamboo
12 44 (1.01%) Gradle
13 43 (0.98%) Bitbucket Server
14 37 (0.85%) Subversion
14 37 (0.85%) Team Foundation Server
15 32 (0.73%) JUnit
15 32 (0.73%) TeamCity
16 31 (0.71%) Artifactory
16 31 (0.71%) GitLab
17 24 (0.55%) Visual Studio Team System
General
1 784 (17.91%) Finance
2 249 (5.69%) Retail
3 225 (5.14%) Banking
4 205 (4.68%) Marketing
5 157 (3.59%) Law
6 124 (2.83%) Telecoms
7 111 (2.54%) Games
8 109 (2.49%) Public Sector
9 61 (1.39%) Manufacturing
10 55 (1.26%) Advertising
11 51 (1.17%) Front Office
12 49 (1.12%) Legal
12 49 (1.12%) Pharmaceutical
12 49 (1.12%) Publishing
13 45 (1.03%) Financial Institution
14 44 (1.01%) Automotive
15 42 (0.96%) Electronics
16 38 (0.87%) Investment Banking
17 21 (0.48%) Billing
18 20 (0.46%) Local Government
Job Titles
1 1,186 (27.10%) Developer
2 753 (17.20%) Data Engineer
3 550 (12.57%) Architect
4 451 (10.30%) Java Developer
5 360 (8.22%) Big Data Engineer
6 299 (6.83%) Data Architect
7 280 (6.40%) Consultant
8 260 (5.94%) Data Scientist
9 239 (5.46%) Software Engineer
10 232 (5.30%) Senior Developer
11 209 (4.77%) Senior Data Engineer
12 184 (4.20%) Analyst
13 176 (4.02%) Python Engineer
14 174 (3.98%) DevOps Engineer
15 173 (3.95%) Big Data Developer
16 169 (3.86%) Solutions Architect
17 126 (2.88%) Python Developer
18 118 (2.70%) Java Engineer
19 115 (2.63%) AWS Engineer
20 113 (2.58%) .NET Developer
Libraries, Frameworks & Software Standards
1 813 (18.57%) Kafka
2 351 (8.02%) .NET
3 315 (7.20%) Web Services
4 253 (5.78%) AngularJS
5 252 (5.76%) Spring
6 247 (5.64%) Node.js
7 240 (5.48%) React
8 232 (5.30%) HTML
9 216 (4.93%) REST
10 202 (4.62%) CSS
11 201 (4.59%) RESTful
12 125 (2.86%) ASP.NET
13 124 (2.83%) Natural Language Processing
14 121 (2.76%) Elastic Stack
15 118 (2.70%) JSON
16 112 (2.56%) Apache NiFi
17 110 (2.51%) Pandas
18 88 (2.01%) XML
19 86 (1.96%) Vue.js
20 82 (1.87%) scikit-learn
Miscellaneous
1 552 (12.61%) Analytical Skills
2 326 (7.45%) Algorithms
3 217 (4.96%) Greenfield Project
4 186 (4.25%) Data Structures
5 160 (3.66%) Management Information System
6 157 (3.59%) User Experience
7 108 (2.47%) Mobile App
8 97 (2.22%) Internet of Things
9 70 (1.60%) Linux Command Line
10 67 (1.53%) Enterprise Software
11 64 (1.46%) Social Media
12 60 (1.37%) Data Centre
13 59 (1.35%) Virtual Team
14 58 (1.33%) Public Cloud
14 58 (1.33%) Self-Motivation
15 53 (1.21%) Analytical Mindset
16 52 (1.19%) Data Protection Act
17 51 (1.17%) Cloud Native
18 48 (1.10%) Credit Risk
19 44 (1.01%) Life Science
Operating Systems
1 661 (15.10%) Linux
2 259 (5.92%) Unix
3 151 (3.45%) Windows
4 107 (2.44%) Android
5 79 (1.80%) Apple iOS
6 61 (1.39%) Red Hat Enterprise Linux
7 55 (1.26%) CentOS
8 51 (1.17%) Ubuntu
9 16 (0.37%) Windows Server
10 11 (0.25%) Debian
11 10 (0.23%) Fedora
12 4 (0.091%) AIX
12 4 (0.091%) Oracle Linux
12 4 (0.091%) Windows 10
13 3 (0.069%) Mac OS
13 3 (0.069%) Solaris
13 3 (0.069%) Windows Server 2012
14 2 (0.046%) VME
14 2 (0.046%) Windows 7
14 2 (0.046%) Windows Server 2008
Processes & Methodologies
1 1,875 (42.84%) Agile Software Development
2 1,635 (37.35%) Analytics
3 1,085 (24.79%) Machine Learning
4 1,032 (23.58%) Data Science
5 921 (21.04%) DevOps
6 774 (17.68%) Business Intelligence
7 723 (16.52%) Software Engineering
8 689 (15.74%) ETL
9 585 (13.37%) Artificial Intelligence
10 547 (12.50%) Data Modelling
11 515 (11.77%) Data Analytics
12 498 (11.38%) Microservices
13 475 (10.85%) Scrum
14 437 (9.98%) Visualisation
15 433 (9.89%) Data Engineering
16 403 (9.21%) Computer Science
17 385 (8.80%) Problem-Solving
18 350 (8.00%) Open Source
19 342 (7.81%) Continuous Integration
20 341 (7.79%) Mathematics
Programming Languages
1 1,794 (40.99%) Python
2 1,539 (35.16%) Java
3 1,387 (31.69%) SQL
4 813 (18.57%) Scala
5 508 (11.61%) JavaScript
6 447 (10.21%) C#
7 424 (9.69%) R
8 267 (6.10%) C
9 204 (4.66%) Bash Shell
10 202 (4.62%) C++
11 138 (3.15%) Java 8
12 95 (2.17%) PHP
12 95 (2.17%) PowerShell
13 94 (2.15%) Perl
14 88 (2.01%) Shell Script
15 79 (1.80%) PL/SQL
16 77 (1.76%) Ruby
17 73 (1.67%) T-SQL
18 72 (1.64%) Go
19 56 (1.28%) MATLAB
Qualifications
1 745 (17.02%) Degree
2 299 (6.83%) Security Cleared
3 183 (4.18%) Computer Science Degree
4 166 (3.79%) DV Cleared
5 138 (3.15%) SC Cleared
6 114 (2.60%) PhD
7 70 (1.60%) CISSP
8 68 (1.55%) Numerate Degree
9 56 (1.28%) Microsoft Certification
10 52 (1.19%) Cisco Certification
11 50 (1.14%) Master's Degree
12 45 (1.03%) GIAC
12 45 (1.03%) SSCP
13 44 (1.01%) SANS
14 41 (0.94%) CCNA
15 39 (0.89%) MCSE
16 37 (0.85%) CompTIA Security+
16 37 (0.85%) Linux+ Certification
16 37 (0.85%) Network+ Certification
17 27 (0.62%) CISM
Quality Assurance & Compliance
1 179 (4.09%) Data Quality
2 172 (3.93%) QA
3 74 (1.69%) GDPR
4 32 (0.73%) ISO/IEC 27001
5 21 (0.48%) PCI DSS
6 8 (0.18%) PSD2
7 6 (0.14%) NIST
8 5 (0.11%) MiFID
8 5 (0.11%) SLA
9 4 (0.091%) COBIT
10 2 (0.046%) Basel III
10 2 (0.046%) COREP
10 2 (0.046%) CRD IV
10 2 (0.046%) GxP
10 2 (0.046%) ISO 20022
10 2 (0.046%) NIST 800
10 2 (0.046%) PMO
11 1 (0.023%) Dodd-Frank
11 1 (0.023%) EMIR
11 1 (0.023%) NCSC
System Software
1 634 (14.48%) Docker
2 157 (3.59%) HDFS
3 141 (3.22%) Apache Flume
4 88 (2.01%) Apache ZooKeeper
5 29 (0.66%) VMware Infrastructure
6 23 (0.53%) Active Directory
7 20 (0.46%) Oracle RAC
8 18 (0.41%) VirtualBox
9 14 (0.32%) VMware ESXi
10 12 (0.27%) NFS
11 11 (0.25%) Xen
12 10 (0.23%) Samba
13 8 (0.18%) Virtual Machines
13 8 (0.18%) vSphere
14 3 (0.069%) Hyper-V
15 2 (0.046%) Firmware
15 2 (0.046%) Tivoli Workload Scheduler
15 2 (0.046%) vCloud
15 2 (0.046%) Virtual Servers
15 2 (0.046%) XenApp
Systems Management
1 404 (9.23%) Kubernetes
2 299 (6.83%) Ansible
3 246 (5.62%) Terraform
4 192 (4.39%) Oozie
5 154 (3.52%) Hadoop YARN
6 140 (3.20%) Puppet
7 114 (2.60%) Opscode Chef
8 73 (1.67%) Ambari
9 32 (0.73%) Docker Swarm
9 32 (0.73%) Kibana
10 26 (0.59%) Nagios
11 23 (0.53%) Enterprise Manager Cloud Control
12 21 (0.48%) Salt
13 20 (0.46%) Mesos
14 15 (0.34%) logstash
15 14 (0.32%) Marathon
16 13 (0.30%) Consul
17 11 (0.25%) ZABBIX
18 10 (0.23%) OpenNMS
18 10 (0.23%) vCenter Server
Vendors
1 428 (9.78%) Microsoft
2 383 (8.75%) Google
3 334 (7.63%) Oracle
4 279 (6.37%) Cloudera
5 277 (6.33%) Tableau
6 197 (4.50%) Hortonworks
7 184 (4.20%) Informatica
8 155 (3.54%) Databricks
9 137 (3.13%) SAP
10 96 (2.19%) Teradata
11 92 (2.10%) IBM
12 91 (2.08%) Splunk
13 89 (2.03%) Talend
14 78 (1.78%) Red Hat
15 66 (1.51%) Salesforce.com
16 65 (1.49%) MapR
17 55 (1.26%) VMware
18 45 (1.03%) Sparx
19 43 (0.98%) HP
20 42 (0.96%) BiZZdesign