Period
to 2 April 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 2 April 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
2 Apr 2020
Same period 2019 Same period 2018
Rank 114 82 85
Rank change year-on-year -32 +3 -2
Permanent jobs citing Big Data 3,167 5,310 6,388
As % of all permanent jobs advertised in the UK 2.70% 3.59% 3.61%
As % of the Database & Business Intelligence category 10.12% 12.64% 11.76%
Number of salaries quoted 2,602 4,421 5,295
Median annual salary £70,000 £67,500 £65,000
Median salary % change year-on-year +3.70% +3.85% +4.00%
10th Percentile £40,000 £35,000 £37,500
90th Percentile £110,000 £102,500 £95,000
UK excluding London median annual salary £55,000 £55,000 £55,000

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 31,291 42,023 54,306
As % of all permanent IT jobs advertised in the UK 26.71% 28.38% 30.68%
Number of salaries quoted 25,575 34,511 45,391
Median annual salary £52,500 £52,500 £50,000
Median salary % change year-on-year - +5.00% +5.26%
10th Percentile £32,500 £31,250 £30,375
90th Percentile £87,500 £85,000 £80,000
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 2 April 2020.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 2 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -31 2,976 £70,000 - 452
London -27 1,751 £75,000 -2.60% 228
UK excluding London -27 1,390 £55,000 - 251
South East -3 495 £59,000 +7.27% 85
North of England -25 235 £54,671 +9.34% 48
Midlands +17 194 £60,000 +34.83% 20
Work from Home -33 180 £75,000 +7.14% 30
South West -58 179 £50,000 -9.09% 31
Scotland -9 137 £50,000 +25.00% 15
North West -53 130 £52,500 -4.55% 26
East of England +5 125 £75,000 +11.94% 41
East Midlands +30 117 £75,000 +42.86% 8
Yorkshire +30 77 £55,000 +10.00% 15
West Midlands -16 77 £55,000 +46.67% 12
North East -5 28 £54,671 +10.81% 7
Wales -26 23 £41,250 -0.60% 12
Northern Ireland +15 4 £37,500 -11.76%

For the 6 months to 2 April 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 1,330 (42.00%) Python
2 1,320 (41.68%) Agile Software Development
3 1,186 (37.45%) Analytics
4 1,094 (34.54%) SQL
5 1,075 (33.94%) Java
6 999 (31.54%) Hadoop
7 992 (31.32%) AWS
8 966 (30.50%) Apache Spark
9 823 (25.99%) Machine Learning
10 795 (25.10%) Data Science
11 757 (23.90%) Azure
12 706 (22.29%) Finance
13 669 (21.12%) DevOps
14 591 (18.66%) Artificial Intelligence
15 586 (18.50%) Degree
16 569 (17.97%) Business Intelligence
17 563 (17.78%) Software Engineering
18 549 (17.34%) Scala
19 539 (17.02%) ETL
20 521 (16.45%) Kafka
21 511 (16.14%) Data Warehouse
22 487 (15.38%) Analytical Skills
23 486 (15.35%) JavaScript
24 480 (15.16%) NoSQL
25 448 (14.15%) Docker
26 433 (13.67%) Data Analytics
27 429 (13.55%) GCP
28 424 (13.39%) Data Modelling
29 411 (12.98%) Linux
30 403 (12.72%) Microservices

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 966 (30.50%) Apache Spark
2 197 (6.22%) Elasticsearch
3 164 (5.18%) Apache
4 78 (2.46%) Apache Airflow
5 52 (1.64%) SAS
6 43 (1.36%) Apache Solr
7 40 (1.26%) Confluence
8 36 (1.14%) Jupyter
9 34 (1.07%) Luigi
10 28 (0.88%) OpenStack
11 22 (0.69%) Cloud Foundry
12 21 (0.66%) Apache Pig
12 21 (0.66%) Tornado
13 17 (0.54%) ArcGIS
14 15 (0.47%) Tomcat
15 10 (0.32%) IIS
15 10 (0.32%) SharePoint
16 8 (0.25%) nginx
16 8 (0.25%) NServiceBus
17 7 (0.22%) Oracle Workflow
Applications
1 53 (1.67%) Microsoft Excel
2 22 (0.69%) SPSS
3 13 (0.41%) Microsoft Office
4 10 (0.32%) Microsoft PowerPoint
5 6 (0.19%) Microsoft Project
6 5 (0.16%) Chatbot
6 5 (0.16%) MS Visio
7 2 (0.063%) Gephi
7 2 (0.063%) InVision
7 2 (0.063%) Sketch
8 1 (0.032%) Simulink
Business Applications
1 16 (0.51%) SAP S/4HANA
2 9 (0.28%) Sparx Enterprise Architect
3 7 (0.22%) SAP HCM
4 6 (0.19%) SAP ERP
5 5 (0.16%) SAP CRM
5 5 (0.16%) SAP IS-U
5 5 (0.16%) SAP MDG
5 5 (0.16%) SAP Payroll
6 4 (0.13%) Oracle Subledger Accounting
7 3 (0.095%) Dynamics CRM
7 3 (0.095%) NetSuite
7 3 (0.095%) SAP BPC
8 2 (0.063%) Adobe Campaign
8 2 (0.063%) Eikon
8 2 (0.063%) Oracle Financials
8 2 (0.063%) R3 Corda
8 2 (0.063%) SAP IBP
8 2 (0.063%) SAP MM
9 1 (0.032%) Distributed Ledger
9 1 (0.032%) SAP POS DM
Cloud Services
1 992 (31.32%) AWS
2 757 (23.90%) Azure
3 429 (13.55%) GCP
4 218 (6.88%) Power Platform
5 149 (4.70%) Amazon S3
6 125 (3.95%) Amazon EMR
7 124 (3.92%) SaaS
8 120 (3.79%) Serverless
9 87 (2.75%) Cloud Computing
10 79 (2.49%) Amazon EC2
11 74 (2.34%) Amazon Kinesis
12 71 (2.24%) AWS Lambda
13 65 (2.05%) PaaS
14 61 (1.93%) Azure Data Factory
15 44 (1.39%) IaaS
16 41 (1.29%) OpenShift
17 40 (1.26%) GitHub
18 28 (0.88%) Slack
19 26 (0.82%) Amazon SQS
20 23 (0.73%) IBM Cloud
Communications & Networking
1 93 (2.94%) Internet
2 34 (1.07%) Firewall
3 29 (0.92%) HTTP
4 28 (0.88%) TCP/IP
5 21 (0.66%) DNS
6 17 (0.54%) BGP
7 14 (0.44%) MPLS
7 14 (0.44%) SAN
8 12 (0.38%) Broadband
8 12 (0.38%) WAN
9 11 (0.35%) SNA
10 10 (0.32%) HTTPS
10 10 (0.32%) SSL
10 10 (0.32%) VPN
11 9 (0.28%) SSH
12 8 (0.25%) Intrusion Detection
13 7 (0.22%) Kerberos
14 6 (0.19%) MQTT
14 6 (0.19%) OSPF
15 5 (0.16%) DSL
Database & Business Intelligence
1 999 (31.54%) Hadoop
2 511 (16.14%) Data Warehouse
3 480 (15.16%) NoSQL
4 385 (12.16%) Apache Hive
5 341 (10.77%) SQL Server
6 255 (8.05%) Relational Database
7 252 (7.96%) Data Lake
8 223 (7.04%) MongoDB
9 218 (6.88%) Power BI
10 208 (6.57%) PostgreSQL
11 207 (6.54%) Amazon Redshift
12 190 (6.00%) HBase
13 175 (5.53%) Apache Cassandra
14 136 (4.29%) Impala
15 132 (4.17%) SQL Server Integration Services
16 126 (3.98%) MySQL
17 115 (3.63%) Amazon DynamoDB
18 96 (3.03%) Neo4j
19 93 (2.94%) BigQuery
20 91 (2.87%) Data Mining
Development Applications
1 394 (12.44%) Git (software)
2 187 (5.90%) Jenkins
3 170 (5.37%) JIRA
4 46 (1.45%) Atlassian Bamboo
5 44 (1.39%) Bitbucket
6 38 (1.20%) GitLab
7 34 (1.07%) JUnit
7 34 (1.07%) Maven
7 34 (1.07%) Visual Studio Team System
8 30 (0.95%) Visual Studio
9 27 (0.85%) Vagrant
10 23 (0.73%) ERwin
11 22 (0.69%) Subversion
11 22 (0.69%) TeamCity
12 19 (0.60%) Sonatype Nexus
12 19 (0.60%) Team Foundation Server
13 18 (0.57%) Eclipse
13 18 (0.57%) webpack
14 17 (0.54%) git-flow
15 15 (0.47%) Octopus Deploy
General
1 706 (22.29%) Finance
2 187 (5.90%) Marketing
3 166 (5.24%) Banking
4 146 (4.61%) Retail
5 86 (2.72%) Public Sector
6 65 (2.05%) Telecoms
7 60 (1.89%) Legal
8 57 (1.80%) Law
9 53 (1.67%) Front Office
10 52 (1.64%) Advertising
11 48 (1.52%) Games
12 41 (1.29%) Manufacturing
13 40 (1.26%) Aerospace
14 34 (1.07%) Automotive
15 19 (0.60%) Financial Institution
15 19 (0.60%) Pharmaceutical
16 18 (0.57%) Investment Banking
17 17 (0.54%) Billing
18 15 (0.47%) Local Government
19 14 (0.44%) Brand Awareness
Job Titles
1 807 (25.48%) Developer
2 589 (18.60%) Data Engineer
3 412 (13.01%) Architect
4 344 (10.86%) Java Developer
5 248 (7.83%) Data Architect
6 202 (6.38%) Software Engineer
7 183 (5.78%) Big Data Engineer
8 180 (5.68%) Analyst
9 167 (5.27%) Senior Developer
10 158 (4.99%) Data Scientist
11 129 (4.07%) Solutions Architect
12 127 (4.01%) Consultant
13 120 (3.79%) Senior Data Engineer
14 113 (3.57%) Java Engineer
15 110 (3.47%) Python Engineer
16 98 (3.09%) DevOps Engineer
17 89 (2.81%) Big Data Architect
18 88 (2.78%) Data Analyst
19 87 (2.75%) Software Developer
20 79 (2.49%) Python Developer
Libraries, Frameworks & Software Standards
1 521 (16.45%) Kafka
2 227 (7.17%) React
3 226 (7.14%) AngularJS
4 222 (7.01%) .NET
4 222 (7.01%) Node.js
5 206 (6.50%) HTML
6 177 (5.59%) Web Services
7 167 (5.27%) CSS
8 155 (4.89%) Spring
9 148 (4.67%) Natural Language Processing
10 132 (4.17%) RESTful
11 120 (3.79%) REST
12 92 (2.90%) HTML5
13 84 (2.65%) TensorFlow
13 84 (2.65%) XML
14 83 (2.62%) JSON
15 72 (2.27%) J2EE
16 65 (2.05%) Django
17 63 (1.99%) scikit-learn
17 63 (1.99%) Spring Boot
Miscellaneous
1 487 (15.38%) Analytical Skills
2 249 (7.86%) Algorithms
3 178 (5.62%) Greenfield Project
4 176 (5.56%) Data Structures
5 170 (5.37%) User Experience
6 91 (2.87%) Public Cloud
7 85 (2.68%) Cloud Native
8 81 (2.56%) Enterprise Software
9 70 (2.21%) Management Information System
10 60 (1.89%) Internet of Things
11 54 (1.71%) Mobile App
12 49 (1.55%) Self-Motivation
13 43 (1.36%) Social Media
14 34 (1.07%) Hybrid Cloud
14 34 (1.07%) Semantic Web
15 32 (1.01%) Virtual Team
16 31 (0.98%) Data Centre
17 26 (0.82%) Hedge funds
17 26 (0.82%) Linux Command Line
18 25 (0.79%) PMI
Operating Systems
1 411 (12.98%) Linux
2 163 (5.15%) Windows
3 139 (4.39%) Unix
4 45 (1.42%) Red Hat Enterprise Linux
5 32 (1.01%) CentOS
6 30 (0.95%) Ubuntu
7 17 (0.54%) Android
8 16 (0.51%) Fedora
9 15 (0.47%) Apple iOS
10 14 (0.44%) Windows Server
11 12 (0.38%) Windows 7
12 6 (0.19%) Debian
13 4 (0.13%) Solaris
13 4 (0.13%) VME
14 3 (0.095%) Mac OS
14 3 (0.095%) Windows 10
15 1 (0.032%) Oracle Linux
15 1 (0.032%) Windows Server 2012
Processes & Methodologies
1 1,320 (41.68%) Agile Software Development
2 1,186 (37.45%) Analytics
3 823 (25.99%) Machine Learning
4 795 (25.10%) Data Science
5 669 (21.12%) DevOps
6 591 (18.66%) Artificial Intelligence
7 569 (17.97%) Business Intelligence
8 563 (17.78%) Software Engineering
9 539 (17.02%) ETL
10 433 (13.67%) Data Analytics
11 424 (13.39%) Data Modelling
12 403 (12.72%) Microservices
13 397 (12.54%) Computer Science
14 305 (9.63%) Data Engineering
15 287 (9.06%) Visualisation
16 286 (9.03%) Scrum
17 253 (7.99%) Problem-Solving
18 238 (7.51%) Continuous Integration
19 235 (7.42%) Project Management
20 226 (7.14%) OO
Programming Languages
1 1,330 (42.00%) Python
2 1,094 (34.54%) SQL
3 1,075 (33.94%) Java
4 549 (17.34%) Scala
5 486 (15.35%) JavaScript
6 376 (11.87%) C#
7 294 (9.28%) R
8 246 (7.77%) C++
9 137 (4.33%) Bash Shell
9 137 (4.33%) C
10 112 (3.54%) Java 8
11 94 (2.97%) PHP
12 87 (2.75%) T-SQL
13 84 (2.65%) Go
14 78 (2.46%) TypeScript
15 69 (2.18%) PowerShell
16 68 (2.15%) PL/SQL
17 57 (1.80%) Kotlin
17 57 (1.80%) Shell Script
18 55 (1.74%) ES6
Qualifications
1 586 (18.50%) Degree
2 225 (7.10%) Security Cleared
3 204 (6.44%) Computer Science Degree
4 135 (4.26%) SC Cleared
5 129 (4.07%) DV Cleared
6 78 (2.46%) PhD
7 44 (1.39%) Cisco Certification
8 37 (1.17%) CCNA
9 34 (1.07%) CompTIA Security+
10 33 (1.04%) Microsoft Certification
10 33 (1.04%) Network+ Certification
11 32 (1.01%) CISSP
11 32 (1.01%) Numerate Degree
12 31 (0.98%) Master's Degree
13 25 (0.79%) GIAC
13 25 (0.79%) Linux+ Certification
13 25 (0.79%) MCSE
13 25 (0.79%) SANS
13 25 (0.79%) SSCP
14 23 (0.73%) PMI Certification
Quality Assurance & Compliance
1 179 (5.65%) QA
2 154 (4.86%) Data Quality
3 44 (1.39%) GDPR
4 17 (0.54%) ISO/IEC 27001
5 12 (0.38%) Sarbanes-Oxley
6 10 (0.32%) SLA
7 6 (0.19%) GMP
8 5 (0.16%) PCI DSS
8 5 (0.16%) PMO
9 4 (0.13%) PMBOK
10 3 (0.095%) MiFID
10 3 (0.095%) NCSC
10 3 (0.095%) NIST
10 3 (0.095%) NIST 800
11 2 (0.063%) HIPAA
11 2 (0.063%) ISO 26262
12 1 (0.032%) Actionable Recommendations
12 1 (0.032%) EMIR
12 1 (0.032%) IFRS
12 1 (0.032%) IFRS 9
System Software
1 448 (14.15%) Docker
2 121 (3.82%) HDFS
3 53 (1.67%) Apache ZooKeeper
4 50 (1.58%) Apache Flume
5 47 (1.48%) VMware Infrastructure
6 40 (1.26%) VirtualBox
7 22 (0.69%) Active Directory
8 19 (0.60%) NFS
9 17 (0.54%) VMware ESXi
10 16 (0.51%) Samba
10 16 (0.51%) Xen
11 10 (0.32%) Hyper-V
12 9 (0.28%) Microsoft App-V
13 5 (0.16%) Virtual Machines
13 5 (0.16%) vSphere
14 3 (0.095%) Firmware
14 3 (0.095%) Varnish
15 1 (0.032%) Gluster
15 1 (0.032%) Oracle RAC
15 1 (0.032%) VMware Workstation
Systems Management
1 361 (11.40%) Kubernetes
2 237 (7.48%) Ansible
3 161 (5.08%) Terraform
4 150 (4.74%) Puppet
5 87 (2.75%) Opscode Chef
6 67 (2.12%) Oozie
7 52 (1.64%) Docker Swarm
8 49 (1.55%) Hadoop YARN
9 39 (1.23%) Salt
10 31 (0.98%) Kibana
11 27 (0.85%) Nagios
12 17 (0.54%) ZABBIX
13 16 (0.51%) OpenNMS
13 16 (0.51%) vCenter Server
14 14 (0.44%) Mesos
15 12 (0.38%) Grafana
16 11 (0.35%) SCCM
17 10 (0.32%) Ambari
17 10 (0.32%) Single Sign-On
18 7 (0.22%) logstash
Vendors
1 300 (9.47%) Google
2 294 (9.28%) Microsoft
3 242 (7.64%) Oracle
4 161 (5.08%) Tableau
5 135 (4.26%) Informatica
6 126 (3.98%) Cloudera
7 97 (3.06%) Talend
8 95 (3.00%) Databricks
8 95 (3.00%) IBM
9 93 (2.94%) Hortonworks
10 83 (2.62%) SAP
11 67 (2.12%) VMware
12 48 (1.52%) Splunk
13 44 (1.39%) Red Hat
13 44 (1.39%) Salesforce.com
14 41 (1.29%) Sage
15 39 (1.23%) Teradata
16 29 (0.92%) Facebook
17 26 (0.82%) Adobe
18 25 (0.79%) EMC