Period
to 30 September 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 30 September 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
30 Sep 2020
Same period 2019 Same period 2018
Rank 101 93 77
Rank change year-on-year -8 -16 +22
Permanent jobs citing Big Data 1,416 4,222 5,974
As % of all permanent jobs advertised in England 3.20% 3.28% 3.90%
As % of the Database & Business Intelligence category 11.12% 12.15% 13.16%
Number of salaries quoted 1,235 3,640 4,191
Median annual salary £67,500 £70,000 £65,000
Median salary % change year-on-year -3.57% +7.69% +4.00%
10th Percentile £42,500 £38,750 £38,750
90th Percentile £102,500 £105,000 £95,000
UK median annual salary £65,000 £67,500 £65,000
% change year-on-year -3.70% +3.85% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 12,735 34,756 45,412
As % of all permanent IT jobs advertised in England 28.74% 27.00% 29.64%
Number of salaries quoted 10,735 28,726 37,190
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% -
10th Percentile £33,750 £31,500 £31,250
90th Percentile £90,000 £86,250 £83,750
UK median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

Salary distribution for jobs citing Big Data in England over the 6 months to 30 September 2020.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 30 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -22 775 £75,000 -3.23% 124
South East +55 239 £62,500 +13.64% 27
North of England +67 145 £55,000 +0.92% 37
Midlands +41 102 £55,000 - 24
South West -36 96 £61,250 +22.50% 19
North West +46 89 £70,000 +27.27% 28
East of England +39 58 £60,000 -7.69% 14
West Midlands +87 57 £55,000 - 9
Yorkshire +91 44 £55,000 +1.85% 7
East Midlands +9 43 £68,750 +25.00% 15
North East -6 12 £42,250 -21.86% 2
Big Data
UK

For the 6 months to 30 September 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 623 (44.00%) Python
2 571 (40.32%) Agile Software Development
3 529 (37.36%) Java
4 512 (36.16%) Analytics
5 509 (35.95%) AWS
6 492 (34.75%) SQL
7 405 (28.60%) Hadoop
8 386 (27.26%) Azure
9 351 (24.79%) DevOps
10 346 (24.44%) Finance
11 345 (24.36%) Apache Spark
12 313 (22.10%) Degree
13 311 (21.96%) Machine Learning
14 297 (20.97%) Data Science
15 260 (18.36%) Business Intelligence
16 255 (18.01%) ETL
17 241 (17.02%) Kafka
18 227 (16.03%) Artificial Intelligence
18 227 (16.03%) Software Engineering
19 226 (15.96%) JavaScript
20 224 (15.82%) Data Lake
21 220 (15.54%) Scala
22 217 (15.32%) NoSQL
23 214 (15.11%) Microservices
24 210 (14.83%) Kubernetes
25 196 (13.84%) Data Warehouse
26 191 (13.49%) GCP
27 190 (13.42%) Data Modelling
28 189 (13.35%) Scrum
28 189 (13.35%) Analytical Skills

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 345 (24.36%) Apache Spark
2 109 (7.70%) Apache
3 88 (6.21%) Elasticsearch
4 47 (3.32%) SAS
5 38 (2.68%) Apache Airflow
6 20 (1.41%) Confluence
7 16 (1.13%) Jupyter
8 13 (0.92%) Tomcat
9 11 (0.78%) CMS
9 11 (0.78%) Moodle
10 10 (0.71%) Luigi
11 9 (0.64%) Apache Pig
12 8 (0.56%) nginx
13 7 (0.49%) Cloud Foundry
14 5 (0.35%) JBoss
14 5 (0.35%) WebLogic
15 4 (0.28%) IBM Domino
16 3 (0.21%) Apache Synapse
16 3 (0.21%) Tornado
17 2 (0.14%) Headless CMS
Applications
1 8 (0.56%) Microsoft Excel
1 8 (0.56%) MS Visio
2 6 (0.42%) Microsoft Office
3 4 (0.28%) Microsoft Project
4 2 (0.14%) Microsoft PowerPoint
Business Applications
1 12 (0.85%) Sparx Enterprise Architect
2 8 (0.56%) Sentinel
3 5 (0.35%) SAP IS-U
4 4 (0.28%) Eikon
5 3 (0.21%) SAP S/4HANA
6 2 (0.14%) NetSuite
6 2 (0.14%) Oracle Subledger Accounting
6 2 (0.14%) SAP R/3
7 1 (0.071%) Payment Gateway
7 1 (0.071%) SAP BPC
7 1 (0.071%) SAP CO
7 1 (0.071%) SAP CRM
7 1 (0.071%) SAP ERP
7 1 (0.071%) SAP FI
7 1 (0.071%) SAP FI/CO
7 1 (0.071%) Workday HCM
Cloud Services
1 509 (35.95%) AWS
2 386 (27.26%) Azure
3 191 (13.49%) GCP
4 161 (11.37%) Power Platform
5 118 (8.33%) SaaS
6 67 (4.73%) PaaS
7 63 (4.45%) IaaS
8 54 (3.81%) Amazon EC2
8 54 (3.81%) Serverless
9 52 (3.67%) Amazon S3
10 46 (3.25%) Amazon EMR
11 37 (2.61%) GitHub
12 33 (2.33%) AWS Lambda
13 26 (1.84%) Stackdriver
14 25 (1.77%) Amazon Kinesis
15 22 (1.55%) Amazon SQS
15 22 (1.55%) Azure Data Factory
16 21 (1.48%) Cloud Computing
17 20 (1.41%) AWS CloudFormation
18 17 (1.20%) Logic Apps
Communications & Networking
1 45 (3.18%) Internet
2 23 (1.62%) Firewall
3 20 (1.41%) Skype
4 18 (1.27%) HTTP
5 13 (0.92%) TCP/IP
6 10 (0.71%) FTP
7 8 (0.56%) 5G
7 8 (0.56%) SSH
7 8 (0.56%) SSL
8 7 (0.49%) WAN
9 6 (0.42%) BGP
9 6 (0.42%) Broadband
9 6 (0.42%) MPLS
10 4 (0.28%) DNS
11 3 (0.21%) AMQP
12 2 (0.14%) Kerberos
12 2 (0.14%) SAN
13 1 (0.071%) 3G
13 1 (0.071%) DSL
13 1 (0.071%) VPN
Database & Business Intelligence
1 405 (28.60%) Hadoop
2 224 (15.82%) Data Lake
3 217 (15.32%) NoSQL
4 196 (13.84%) Data Warehouse
5 170 (12.01%) Apache Hive
6 161 (11.37%) Power BI
7 155 (10.95%) SQL Server
8 104 (7.34%) Relational Database
9 91 (6.43%) Amazon Redshift
10 88 (6.21%) MongoDB
11 85 (6.00%) PostgreSQL
12 79 (5.58%) SQL Server Integration Services
13 69 (4.87%) Apache Cassandra
13 69 (4.87%) Impala
14 68 (4.80%) HBase
15 67 (4.73%) MySQL
16 62 (4.38%) Data Mining
16 62 (4.38%) SQL Server Reporting Services
17 60 (4.24%) BigQuery
18 59 (4.17%) Snowflake Schema
Development Applications
1 185 (13.06%) Git (software)
2 86 (6.07%) Jenkins
3 35 (2.47%) Gradle
3 35 (2.47%) JIRA
4 24 (1.69%) Atlassian Bamboo
5 20 (1.41%) Cucumber
6 18 (1.27%) GitLab
7 17 (1.20%) JUnit
8 14 (0.99%) Maven
8 14 (0.99%) Subversion
9 13 (0.92%) ERwin
9 13 (0.92%) TeamCity
10 11 (0.78%) Sonatype Nexus
11 9 (0.64%) Octopus Deploy
11 9 (0.64%) Selenium
12 8 (0.56%) ER Studio
12 8 (0.56%) Visual Studio Team System
13 7 (0.49%) Artifactory
13 7 (0.49%) GoCD
14 6 (0.42%) Bitbucket
General
1 346 (24.44%) Finance
2 77 (5.44%) Marketing
3 75 (5.30%) Banking
4 54 (3.81%) Public Sector
5 37 (2.61%) Telecoms
6 35 (2.47%) Pharmaceutical
7 32 (2.26%) Retail
8 31 (2.19%) Advertising
9 30 (2.12%) Manufacturing
10 24 (1.69%) Front Office
10 24 (1.69%) Legal
10 24 (1.69%) Local Government
11 19 (1.34%) Electronics
12 13 (0.92%) Law
13 8 (0.56%) Games
14 7 (0.49%) Financial Institution
14 7 (0.49%) Investment Banking
15 5 (0.35%) Aerospace
15 5 (0.35%) Police
16 4 (0.28%) Publishing
Job Titles
1 354 (25.00%) Developer
2 309 (21.82%) Data Engineer
3 214 (15.11%) Architect
4 134 (9.46%) Java Developer
5 111 (7.84%) Solutions Architect
6 94 (6.64%) Software Engineer
7 88 (6.21%) Data Architect
8 87 (6.14%) Data Scientist
9 82 (5.79%) Big Data Engineer
10 81 (5.72%) Senior Developer
11 60 (4.24%) Senior Data Engineer
12 59 (4.17%) Cloud Architect
13 56 (3.95%) AWS Engineer
14 54 (3.81%) Consultant
15 52 (3.67%) Python Engineer
16 50 (3.53%) Cloud Solutions Architect
17 49 (3.46%) Analyst
18 48 (3.39%) DevOps Engineer
18 48 (3.39%) Senior Data Scientist
19 38 (2.68%) Big Data Architect
Libraries, Frameworks & Software Standards
1 241 (17.02%) Kafka
2 112 (7.91%) Spring
3 98 (6.92%) .NET
4 84 (5.93%) HTML
5 72 (5.08%) Node.js
6 70 (4.94%) AngularJS
7 61 (4.31%) Natural Language Processing
8 60 (4.24%) CSS
8 60 (4.24%) React
9 53 (3.74%) REST
10 51 (3.60%) Spring Boot
11 50 (3.53%) TensorFlow
12 48 (3.39%) HTML5
13 44 (3.11%) Web Services
14 39 (2.75%) RabbitMQ
15 38 (2.68%) Pandas
16 34 (2.40%) ASP.NET
16 34 (2.40%) scikit-learn
17 33 (2.33%) NumPy
18 29 (2.05%) PySpark
Miscellaneous
1 189 (13.35%) Analytical Skills
2 94 (6.64%) Algorithms
3 60 (4.24%) Management Information System
4 46 (3.25%) Self-Motivation
5 44 (3.11%) Cloud Native
5 44 (3.11%) Internet of Things
6 40 (2.82%) Enterprise Software
7 37 (2.61%) User Experience
8 27 (1.91%) Data Structures
9 24 (1.69%) Data Centre
9 24 (1.69%) Equities
9 24 (1.69%) Hybrid Cloud
10 23 (1.62%) Virtual Team
11 22 (1.55%) Hedge funds
11 22 (1.55%) Public Cloud
12 21 (1.48%) Mobile App
13 20 (1.41%) Greenfield Project
13 20 (1.41%) PKI
14 17 (1.20%) FMCG
15 16 (1.13%) Linux Command Line
Operating Systems
1 154 (10.88%) Linux
2 73 (5.16%) Unix
3 61 (4.31%) Windows
4 15 (1.06%) Red Hat Enterprise Linux
5 14 (0.99%) CentOS
6 4 (0.28%) Debian
6 4 (0.28%) Solaris
7 3 (0.21%) Android
7 3 (0.21%) Apple iOS
7 3 (0.21%) Windows Server
7 3 (0.21%) Windows Server 2008
8 2 (0.14%) Mac OS
8 2 (0.14%) Robot Operating System
8 2 (0.14%) Ubuntu
8 2 (0.14%) Windows Server 2012
8 2 (0.14%) Windows Server 2016
9 1 (0.071%) Windows Server 2019
Processes & Methodologies
1 571 (40.32%) Agile Software Development
2 512 (36.16%) Analytics
3 351 (24.79%) DevOps
4 311 (21.96%) Machine Learning
5 297 (20.97%) Data Science
6 260 (18.36%) Business Intelligence
7 255 (18.01%) ETL
8 227 (16.03%) Artificial Intelligence
8 227 (16.03%) Software Engineering
9 214 (15.11%) Microservices
10 190 (13.42%) Data Modelling
11 189 (13.35%) Scrum
12 179 (12.64%) Data Analytics
13 171 (12.08%) Computer Science
14 152 (10.73%) Mathematics
15 133 (9.39%) Visualisation
16 119 (8.40%) Data Engineering
17 115 (8.12%) Problem-Solving
18 111 (7.84%) Cybersecurity
19 97 (6.85%) Mentoring
Programming Languages
1 623 (44.00%) Python
2 529 (37.36%) Java
3 492 (34.75%) SQL
4 226 (15.96%) JavaScript
5 220 (15.54%) Scala
6 162 (11.44%) R
7 122 (8.62%) C#
8 66 (4.66%) C++
9 53 (3.74%) Bash Shell
10 50 (3.53%) PHP
10 50 (3.53%) PL/SQL
11 49 (3.46%) Go
12 47 (3.32%) C
13 45 (3.18%) Shell Script
13 45 (3.18%) T-SQL
14 40 (2.82%) Java 8
15 38 (2.68%) HiveQL
16 31 (2.19%) PowerShell
16 31 (2.19%) Ruby
17 28 (1.98%) Perl
Qualifications
1 313 (22.10%) Degree
2 136 (9.60%) Security Cleared
3 100 (7.06%) Computer Science Degree
4 64 (4.52%) DV Cleared
5 56 (3.95%) SC Cleared
6 34 (2.40%) PhD
7 33 (2.33%) Numerate Degree
8 31 (2.19%) Master's Degree
9 28 (1.98%) BPSS Clearance
10 12 (0.85%) AWS Certification
11 10 (0.71%) Cisco Certification
12 7 (0.49%) CISSP
12 7 (0.49%) PMI Certification
13 6 (0.42%) CCNP
13 6 (0.42%) JNCIP
13 6 (0.42%) JNCIS
14 5 (0.35%) CCNA
14 5 (0.35%) IIBA
14 5 (0.35%) ISEB
14 5 (0.35%) JNCIA
Quality Assurance & Compliance
1 69 (4.87%) Data Quality
2 32 (2.26%) QA
3 29 (2.05%) GDPR
4 24 (1.69%) NIST
5 17 (1.20%) ISO/IEC 27001
6 13 (0.92%) NCSC
6 13 (0.92%) NIST 800
7 9 (0.64%) SLA
8 7 (0.49%) Sarbanes-Oxley
9 4 (0.28%) GPG13
10 3 (0.21%) PCI DSS
11 1 (0.071%) IFRS
11 1 (0.071%) IFRS 9
11 1 (0.071%) ISO 26262
11 1 (0.071%) MiFID
11 1 (0.071%) PMO
11 1 (0.071%) WCAG
System Software
1 183 (12.92%) Docker
2 83 (5.86%) HDFS
3 24 (1.69%) Active Directory
4 20 (1.41%) VMware Infrastructure
5 18 (1.27%) Apache ZooKeeper
6 12 (0.85%) Virtual Machines
7 11 (0.78%) Hyper-V
8 6 (0.42%) Apache Flume
8 6 (0.42%) Varnish
9 4 (0.28%) VMware ESXi
10 3 (0.21%) VirtualBox
11 2 (0.14%) vCloud
11 2 (0.14%) vSphere
12 1 (0.071%) Oracle RAC
12 1 (0.071%) Virtual Servers
Systems Management
1 210 (14.83%) Kubernetes
2 96 (6.78%) Terraform
3 74 (5.23%) Ansible
4 25 (1.77%) Puppet
5 24 (1.69%) Grafana
6 19 (1.34%) Hadoop YARN
7 17 (1.20%) Kibana
8 11 (0.78%) Netcool
8 11 (0.78%) Opscode Chef
8 11 (0.78%) Opsview
9 8 (0.56%) Istio
10 7 (0.49%) Oozie
11 5 (0.35%) Prometheus
12 4 (0.28%) Mesos
12 4 (0.28%) Nagios
13 3 (0.21%) logstash
13 3 (0.21%) SCCM
13 3 (0.21%) SCOM
13 3 (0.21%) ZABBIX
14 2 (0.14%) HP Fortify
Vendors
1 168 (11.86%) Microsoft
2 106 (7.49%) Google
2 106 (7.49%) Oracle
3 91 (6.43%) Databricks
4 84 (5.93%) Tableau
5 83 (5.86%) Cloudera
6 69 (4.87%) Informatica
6 69 (4.87%) Talend
7 52 (3.67%) Sparx
8 47 (3.32%) Splunk
9 39 (2.75%) SAP
10 33 (2.33%) Teradata
11 27 (1.91%) VMware
12 26 (1.84%) ServiceNow
13 22 (1.55%) IBM
14 20 (1.41%) Hortonworks
15 18 (1.27%) Ab Initio
16 13 (0.92%) AppDynamics
17 12 (0.85%) BiZZdesign
17 12 (0.85%) Red Hat