Period
to 30 March 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 30 March 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
30 Mar 2020
Same period 2019 Same period 2018
Rank 112 87 83
Rank change year-on-year -25 -4 -1
Permanent jobs citing Big Data 3,020 4,924 5,994
As % of all permanent jobs advertised in England 2.77% 3.56% 3.61%
As % of the Database & Business Intelligence category 10.40% 12.58% 11.74%
Number of salaries quoted 2,483 4,104 5,002
Median annual salary £70,000 £70,000 £65,000
Median salary % change year-on-year - +7.69% +4.00%
10th Percentile £40,383 £38,000 £38,750
90th Percentile £110,000 £105,000 £96,250
UK median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 29,052 39,152 51,041
As % of all permanent IT jobs advertised in England 26.62% 28.29% 30.75%
Number of salaries quoted 23,902 32,482 42,967
Median annual salary £53,000 £52,500 £50,000
Median salary % change year-on-year +0.95% +5.00% +5.26%
10th Percentile £32,500 £31,250 £31,000
90th Percentile £88,750 £86,250 £80,000
UK median annual salary £52,500 £52,500 £50,000
% change year-on-year - +5.00% +5.26%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

Salary distribution for jobs citing Big Data in England over the 6 months to 30 March 2020.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 30 March 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -29 1,788 £75,000 -2.60% 245
South East +5 494 £58,250 +5.91% 93
North of England -29 236 £54,671 +9.34% 54
Midlands +20 196 £60,000 +34.08% 27
South West -51 180 £50,000 -9.09% 41
North West -37 132 £52,500 -4.55% 29
East of England +4 128 £75,000 +15.38% 37
East Midlands +24 118 £72,500 +38.10% 9
West Midlands -5 78 £55,000 +46.67% 18
Yorkshire +16 77 £55,000 +10.00% 17
North East -1 27 £54,671 +10.81% 8
Big Data
UK

For the 6 months to 30 March 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 1,286 (42.58%) Python
2 1,266 (41.92%) Agile Software Development
3 1,143 (37.85%) Analytics
4 1,048 (34.70%) SQL
5 1,023 (33.87%) Java
6 977 (32.35%) Hadoop
7 970 (32.12%) AWS
8 941 (31.16%) Apache Spark
9 809 (26.79%) Machine Learning
10 789 (26.13%) Data Science
11 703 (23.28%) Azure
12 657 (21.75%) Finance
13 624 (20.66%) DevOps
14 567 (18.77%) Artificial Intelligence
15 563 (18.64%) Degree
16 537 (17.78%) Scala
17 536 (17.75%) Business Intelligence
18 534 (17.68%) ETL
19 533 (17.65%) Software Engineering
20 504 (16.69%) Data Warehouse
21 495 (16.39%) Kafka
22 472 (15.63%) Analytical Skills
22 472 (15.63%) NoSQL
23 450 (14.90%) JavaScript
24 439 (14.54%) Docker
25 423 (14.01%) Data Analytics
26 417 (13.81%) GCP
27 405 (13.41%) Data Modelling
28 391 (12.95%) Linux
28 391 (12.95%) Microservices

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 941 (31.16%) Apache Spark
2 188 (6.23%) Elasticsearch
3 157 (5.20%) Apache
4 78 (2.58%) Apache Airflow
5 49 (1.62%) SAS
6 43 (1.42%) Apache Solr
7 40 (1.32%) Confluence
8 35 (1.16%) Jupyter
9 34 (1.13%) Luigi
10 29 (0.96%) OpenStack
11 23 (0.76%) Apache Pig
12 21 (0.70%) Tornado
13 18 (0.60%) Cloud Foundry
14 17 (0.56%) ArcGIS
15 11 (0.36%) IIS
15 11 (0.36%) Tomcat
16 10 (0.33%) SharePoint
17 9 (0.30%) nginx
18 8 (0.26%) NServiceBus
19 7 (0.23%) Oracle Workflow
Applications
1 54 (1.79%) Microsoft Excel
2 22 (0.73%) SPSS
3 12 (0.40%) Microsoft Office
4 9 (0.30%) Microsoft PowerPoint
5 5 (0.17%) Microsoft Project
5 5 (0.17%) MS Visio
6 2 (0.066%) Chatbot
6 2 (0.066%) Gephi
6 2 (0.066%) InVision
6 2 (0.066%) Sketch
7 1 (0.033%) Simulink
Business Applications
1 16 (0.53%) SAP S/4HANA
2 10 (0.33%) Sparx Enterprise Architect
3 7 (0.23%) SAP HCM
4 5 (0.17%) SAP ERP
4 5 (0.17%) SAP MDG
4 5 (0.17%) SAP Payroll
5 4 (0.13%) SAP CRM
5 4 (0.13%) SAP IS-U
6 3 (0.099%) Dynamics CRM
6 3 (0.099%) NetSuite
6 3 (0.099%) Oracle Subledger Accounting
6 3 (0.099%) SAP BPC
7 2 (0.066%) Adobe Campaign
7 2 (0.066%) Eikon
7 2 (0.066%) Oracle Financials
7 2 (0.066%) PolarLake
7 2 (0.066%) R3 Corda
7 2 (0.066%) SAP IBP
7 2 (0.066%) SAP MM
8 1 (0.033%) Distributed Ledger
Cloud Services
1 970 (32.12%) AWS
2 703 (23.28%) Azure
3 417 (13.81%) GCP
4 199 (6.59%) Power Platform
5 151 (5.00%) Amazon S3
6 124 (4.11%) Amazon EMR
7 119 (3.94%) Serverless
8 114 (3.77%) SaaS
9 80 (2.65%) Amazon EC2
10 79 (2.62%) Cloud Computing
11 72 (2.38%) Amazon Kinesis
12 70 (2.32%) AWS Lambda
13 59 (1.95%) Azure Data Factory
14 53 (1.75%) PaaS
15 41 (1.36%) GitHub
16 34 (1.13%) OpenShift
17 33 (1.09%) IaaS
18 28 (0.93%) Amazon SQS
18 28 (0.93%) Slack
19 25 (0.83%) IBM Cloud
Communications & Networking
1 93 (3.08%) Internet
2 31 (1.03%) Firewall
3 29 (0.96%) TCP/IP
4 23 (0.76%) HTTP
5 17 (0.56%) DNS
6 15 (0.50%) BGP
7 13 (0.43%) SAN
8 12 (0.40%) MPLS
9 11 (0.36%) SNA
10 10 (0.33%) Broadband
10 10 (0.33%) WAN
11 9 (0.30%) SSH
12 8 (0.26%) HTTPS
12 8 (0.26%) Intrusion Detection
12 8 (0.26%) SSL
12 8 (0.26%) VPN
13 6 (0.20%) MQTT
13 6 (0.20%) OSPF
14 5 (0.17%) NAS
14 5 (0.17%) Network Security
Database & Business Intelligence
1 977 (32.35%) Hadoop
2 504 (16.69%) Data Warehouse
3 472 (15.63%) NoSQL
4 382 (12.65%) Apache Hive
5 338 (11.19%) SQL Server
6 248 (8.21%) Relational Database
7 241 (7.98%) Data Lake
8 224 (7.42%) MongoDB
9 208 (6.89%) PostgreSQL
10 203 (6.72%) Amazon Redshift
11 199 (6.59%) Power BI
12 187 (6.19%) HBase
13 173 (5.73%) Apache Cassandra
14 134 (4.44%) Impala
15 120 (3.97%) SQL Server Integration Services
16 115 (3.81%) Amazon DynamoDB
17 102 (3.38%) MySQL
18 98 (3.25%) Neo4j
19 94 (3.11%) BigQuery
20 83 (2.75%) Amazon Athena
Development Applications
1 364 (12.05%) Git (software)
2 178 (5.89%) Jenkins
3 167 (5.53%) JIRA
4 47 (1.56%) Atlassian Bamboo
5 45 (1.49%) Bitbucket
6 38 (1.26%) GitLab
7 33 (1.09%) Maven
8 29 (0.96%) JUnit
8 29 (0.96%) Vagrant
9 28 (0.93%) Visual Studio Team System
10 27 (0.89%) Visual Studio
11 24 (0.79%) ERwin
12 19 (0.63%) Sonatype Nexus
12 19 (0.63%) Subversion
12 19 (0.63%) Team Foundation Server
13 18 (0.60%) webpack
14 17 (0.56%) git-flow
15 16 (0.53%) Eclipse
16 15 (0.50%) Octopus Deploy
17 14 (0.46%) TeamCity
General
1 657 (21.75%) Finance
2 186 (6.16%) Marketing
3 162 (5.36%) Banking
4 139 (4.60%) Retail
5 78 (2.58%) Public Sector
6 63 (2.09%) Legal
7 61 (2.02%) Telecoms
8 59 (1.95%) Front Office
9 58 (1.92%) Law
10 48 (1.59%) Advertising
11 44 (1.46%) Games
12 39 (1.29%) Aerospace
13 34 (1.13%) Automotive
14 33 (1.09%) Manufacturing
15 18 (0.60%) Billing
15 18 (0.60%) Pharmaceutical
16 17 (0.56%) Investment Banking
17 15 (0.50%) Financial Institution
18 14 (0.46%) Brand Awareness
19 13 (0.43%) Local Government
Job Titles
1 763 (25.26%) Developer
2 565 (18.71%) Data Engineer
3 406 (13.44%) Architect
4 335 (11.09%) Java Developer
5 246 (8.15%) Data Architect
6 188 (6.23%) Software Engineer
7 176 (5.83%) Analyst
8 171 (5.66%) Big Data Engineer
9 168 (5.56%) Senior Developer
10 149 (4.93%) Data Scientist
11 123 (4.07%) Solutions Architect
12 113 (3.74%) Consultant
13 112 (3.71%) Senior Data Engineer
14 109 (3.61%) Java Engineer
15 100 (3.31%) Python Engineer
16 94 (3.11%) DevOps Engineer
17 87 (2.88%) Data Analyst
18 86 (2.85%) Big Data Architect
19 84 (2.78%) Software Developer
20 79 (2.62%) Python Developer
Libraries, Frameworks & Software Standards
1 495 (16.39%) Kafka
2 209 (6.92%) React
3 206 (6.82%) .NET
3 206 (6.82%) Node.js
4 199 (6.59%) AngularJS
5 175 (5.79%) HTML
6 169 (5.60%) Web Services
7 148 (4.90%) Natural Language Processing
8 144 (4.77%) Spring
9 143 (4.74%) CSS
10 127 (4.21%) RESTful
11 111 (3.68%) REST
12 85 (2.81%) TensorFlow
13 84 (2.78%) HTML5
13 84 (2.78%) XML
14 74 (2.45%) J2EE
14 74 (2.45%) JSON
15 65 (2.15%) scikit-learn
16 63 (2.09%) Django
17 60 (1.99%) Spring Boot
Miscellaneous
1 472 (15.63%) Analytical Skills
2 237 (7.85%) Algorithms
3 180 (5.96%) Data Structures
4 178 (5.89%) Greenfield Project
5 162 (5.36%) User Experience
6 82 (2.72%) Public Cloud
7 78 (2.58%) Cloud Native
8 75 (2.48%) Enterprise Software
9 67 (2.22%) Management Information System
10 59 (1.95%) Internet of Things
11 44 (1.46%) Self-Motivation
12 39 (1.29%) Social Media
13 35 (1.16%) Semantic Web
14 33 (1.09%) Virtual Team
15 32 (1.06%) Mobile App
16 29 (0.96%) Data Centre
17 28 (0.93%) Linux Command Line
18 27 (0.89%) Foreign Exchange (FX)
18 27 (0.89%) Hybrid Cloud
19 25 (0.83%) PMI
Operating Systems
1 391 (12.95%) Linux
2 154 (5.10%) Windows
3 133 (4.40%) Unix
4 45 (1.49%) Red Hat Enterprise Linux
5 33 (1.09%) CentOS
6 31 (1.03%) Ubuntu
7 16 (0.53%) Fedora
8 15 (0.50%) Android
9 14 (0.46%) Windows Server
10 12 (0.40%) Apple iOS
10 12 (0.40%) Windows 7
11 7 (0.23%) Debian
12 4 (0.13%) Solaris
12 4 (0.13%) VME
13 3 (0.099%) Mac OS
13 3 (0.099%) Windows 10
14 1 (0.033%) Oracle Linux
14 1 (0.033%) Windows Server 2012
Processes & Methodologies
1 1,266 (41.92%) Agile Software Development
2 1,143 (37.85%) Analytics
3 809 (26.79%) Machine Learning
4 789 (26.13%) Data Science
5 624 (20.66%) DevOps
6 567 (18.77%) Artificial Intelligence
7 536 (17.75%) Business Intelligence
8 534 (17.68%) ETL
9 533 (17.65%) Software Engineering
10 423 (14.01%) Data Analytics
11 405 (13.41%) Data Modelling
12 391 (12.95%) Microservices
13 374 (12.38%) Computer Science
14 291 (9.64%) Data Engineering
15 274 (9.07%) Visualisation
16 271 (8.97%) Scrum
17 243 (8.05%) Problem-Solving
18 229 (7.58%) Continuous Integration
19 224 (7.42%) Project Management
20 219 (7.25%) Open Source
Programming Languages
1 1,286 (42.58%) Python
2 1,048 (34.70%) SQL
3 1,023 (33.87%) Java
4 537 (17.78%) Scala
5 450 (14.90%) JavaScript
6 346 (11.46%) C#
7 289 (9.57%) R
8 235 (7.78%) C++
9 142 (4.70%) C
10 136 (4.50%) Bash Shell
11 101 (3.34%) Java 8
12 87 (2.88%) T-SQL
13 81 (2.68%) Go
14 78 (2.58%) TypeScript
15 70 (2.32%) PHP
16 69 (2.28%) PowerShell
17 59 (1.95%) PL/SQL
18 57 (1.89%) Shell Script
19 56 (1.85%) Kotlin
20 54 (1.79%) ES6
Qualifications
1 563 (18.64%) Degree
2 218 (7.22%) Security Cleared
3 200 (6.62%) Computer Science Degree
4 130 (4.30%) SC Cleared
5 127 (4.21%) DV Cleared
6 82 (2.72%) PhD
7 42 (1.39%) Cisco Certification
8 35 (1.16%) CCNA
9 34 (1.13%) CompTIA Security+
10 33 (1.09%) Microsoft Certification
10 33 (1.09%) Network+ Certification
11 32 (1.06%) Master's Degree
12 31 (1.03%) CISSP
13 25 (0.83%) GIAC
13 25 (0.83%) Linux+ Certification
13 25 (0.83%) MCSE
13 25 (0.83%) SANS
13 25 (0.83%) SSCP
14 23 (0.76%) PMI Certification
15 22 (0.73%) Numerate Degree
Quality Assurance & Compliance
1 182 (6.03%) QA
2 157 (5.20%) Data Quality
3 42 (1.39%) GDPR
4 15 (0.50%) ISO/IEC 27001
5 11 (0.36%) Sarbanes-Oxley
6 10 (0.33%) SLA
7 6 (0.20%) GMP
8 5 (0.17%) PCI DSS
9 4 (0.13%) PMBOK
10 3 (0.099%) MiFID
11 2 (0.066%) HIPAA
11 2 (0.066%) ISO 26262
11 2 (0.066%) NCSC
11 2 (0.066%) NIST
11 2 (0.066%) NIST 800
11 2 (0.066%) PMO
12 1 (0.033%) Actionable Recommendations
12 1 (0.033%) EMIR
12 1 (0.033%) IFRS
12 1 (0.033%) IFRS 9
System Software
1 439 (14.54%) Docker
2 113 (3.74%) HDFS
3 52 (1.72%) Apache Flume
3 52 (1.72%) Apache ZooKeeper
4 47 (1.56%) VMware Infrastructure
5 42 (1.39%) VirtualBox
6 22 (0.73%) Active Directory
7 19 (0.63%) NFS
8 17 (0.56%) VMware ESXi
9 16 (0.53%) Samba
9 16 (0.53%) Xen
10 10 (0.33%) Hyper-V
11 9 (0.30%) Microsoft App-V
12 5 (0.17%) Virtual Machines
12 5 (0.17%) vSphere
13 3 (0.099%) Firmware
13 3 (0.099%) Varnish
14 1 (0.033%) Gluster
14 1 (0.033%) Oracle RAC
14 1 (0.033%) VMware Workstation
Systems Management
1 348 (11.52%) Kubernetes
2 229 (7.58%) Ansible
3 162 (5.36%) Terraform
4 147 (4.87%) Puppet
5 86 (2.85%) Opscode Chef
6 66 (2.19%) Oozie
7 54 (1.79%) Docker Swarm
8 48 (1.59%) Hadoop YARN
9 39 (1.29%) Salt
10 27 (0.89%) Nagios
11 23 (0.76%) Kibana
12 17 (0.56%) ZABBIX
13 16 (0.53%) OpenNMS
13 16 (0.53%) vCenter Server
14 14 (0.46%) Mesos
15 12 (0.40%) Grafana
16 11 (0.36%) SCCM
17 8 (0.26%) Ambari
17 8 (0.26%) Single Sign-On
18 7 (0.23%) logstash
Vendors
1 299 (9.90%) Google
2 276 (9.14%) Microsoft
3 229 (7.58%) Oracle
4 160 (5.30%) Tableau
5 134 (4.44%) Informatica
6 125 (4.14%) Cloudera
7 95 (3.15%) IBM
7 95 (3.15%) Talend
8 93 (3.08%) Hortonworks
9 84 (2.78%) Databricks
10 80 (2.65%) SAP
11 66 (2.19%) VMware
12 44 (1.46%) Splunk
13 42 (1.39%) Salesforce.com
14 41 (1.36%) Sage
15 39 (1.29%) Red Hat
15 39 (1.29%) Teradata
16 28 (0.93%) Facebook
17 25 (0.83%) EMC
18 23 (0.76%) Adobe