Period
to 19 January 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 19 January 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
19 Jan 2021
Same period 2020 Same period 2019
Rank 121 99 86
Rank change year-on-year -22 -13 +7
Permanent jobs citing Big Data 1,549 3,583 4,987
As % of all permanent jobs advertised in England 2.72% 3.11% 3.56%
As % of the Database & Business Intelligence category 9.84% 11.52% 12.39%
Number of salaries quoted 1,364 3,034 4,203
Median annual salary £67,500 £70,000 £70,000
Median salary % change year-on-year -3.57% - +7.69%
10th Percentile £42,000 £40,000 £40,000
90th Percentile £100,000 £112,500 £100,000
UK median annual salary £65,000 £70,000 £67,500
% change year-on-year -7.14% +3.70% +8.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 15,738 31,112 40,245
As % of all permanent IT jobs advertised in England 27.59% 27.03% 28.73%
Number of salaries quoted 13,316 25,975 33,657
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +5.00%
10th Percentile £34,000 £32,374 £31,250
90th Percentile £88,750 £90,000 £85,000
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +9.38%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

Salary distribution for jobs citing Big Data in England over the 6 months to 19 January 2021.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 19 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -12 902 £75,000 -3.23% 181
South East +15 208 £62,500 +13.64% 30
North of England +31 202 £55,000 +0.60% 38
South West +3 122 £52,500 +5.00% 18
Yorkshire +41 111 £55,000 - 17
North West +5 74 £70,000 +40.00% 21
Midlands -42 60 £55,500 -7.50% 26
West Midlands +31 35 £60,000 +9.09% 12
East of England +2 34 £66,250 -11.67% 21
East Midlands -30 25 £55,000 -21.43% 13
North East -4 17 £43,000 -5.31%
Big Data
UK

For the 6 months to 19 January 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 731 (47.19%) Python
2 651 (42.03%) AWS
3 648 (41.83%) Agile Software Development
4 625 (40.35%) Analytics
5 601 (38.80%) Java
6 548 (35.38%) SQL
7 506 (32.67%) Azure
8 409 (26.40%) Hadoop
9 388 (25.05%) DevOps
10 370 (23.89%) Machine Learning
11 359 (23.18%) Apache Spark
12 353 (22.79%) Data Science
13 326 (21.05%) Software Engineering
14 318 (20.53%) ETL
15 297 (19.17%) Finance
16 268 (17.30%) GCP
17 262 (16.91%) NoSQL
18 260 (16.79%) Degree
19 257 (16.59%) Business Intelligence
20 251 (16.20%) Artificial Intelligence
20 251 (16.20%) Kafka
21 243 (15.69%) JavaScript
22 242 (15.62%) Data Analytics
23 233 (15.04%) Microservices
24 225 (14.53%) Kubernetes
25 224 (14.46%) Data Warehouse
26 213 (13.75%) Docker
27 209 (13.49%) Scrum
28 203 (13.11%) Scala
29 193 (12.46%) Data Lake

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 359 (23.18%) Apache Spark
2 134 (8.65%) Apache
3 97 (6.26%) Elasticsearch
4 76 (4.91%) SAS
5 66 (4.26%) Apache Airflow
6 32 (2.07%) Confluence
7 21 (1.36%) Luigi
8 16 (1.03%) Apache Pig
9 13 (0.84%) Tornado
10 11 (0.71%) Moodle
11 10 (0.65%) Jupyter
12 9 (0.58%) nginx
13 8 (0.52%) ArcGIS
13 8 (0.52%) Tomcat
14 7 (0.45%) SharePoint
15 5 (0.32%) IIS
15 5 (0.32%) Oracle Workflow
16 4 (0.26%) JBoss
16 4 (0.26%) Oracle SOA Suite
16 4 (0.26%) WebLogic
Applications
1 15 (0.97%) SPSS
2 3 (0.19%) Microsoft Excel
3 1 (0.065%) Adobe Creative Suite
3 1 (0.065%) Figma
3 1 (0.065%) Microsoft Office
Business Applications
1 8 (0.52%) Sentinel
2 6 (0.39%) Dynamics CRM
3 5 (0.32%) SAP CRM
4 3 (0.19%) Oracle EBS
4 3 (0.19%) SAP IS-U
4 3 (0.19%) SAP S/4HANA
4 3 (0.19%) Sparx Enterprise Architect
5 2 (0.13%) SAP R/3
6 1 (0.065%) SAP APO
6 1 (0.065%) SAP ERP
6 1 (0.065%) SAP Hybris
Cloud Services
1 651 (42.03%) AWS
2 506 (32.67%) Azure
3 268 (17.30%) GCP
4 117 (7.55%) Power Platform
5 113 (7.30%) SaaS
6 71 (4.58%) PaaS
7 61 (3.94%) Serverless
8 54 (3.49%) GitHub
9 50 (3.23%) AWS Lambda
10 47 (3.03%) IaaS
11 37 (2.39%) Amazon EMR
12 32 (2.07%) Cloud Computing
13 29 (1.87%) AWS CloudFormation
14 28 (1.81%) Azure Data Factory
15 27 (1.74%) Amazon EC2
15 27 (1.74%) Amazon S3
16 22 (1.42%) Stackdriver
17 17 (1.10%) Amazon Kinesis
18 15 (0.97%) Dynamics 365
19 14 (0.90%) Logic Apps
Communications & Networking
1 56 (3.62%) Internet
2 32 (2.07%) Firewall
3 19 (1.23%) HTTP
4 12 (0.77%) Skype
5 10 (0.65%) TCP/IP
6 9 (0.58%) DNS
7 8 (0.52%) SSH
7 8 (0.52%) WAN
8 7 (0.45%) VPN
9 6 (0.39%) SSL
10 5 (0.32%) Kerberos
10 5 (0.32%) LAN
11 4 (0.26%) 5G
11 4 (0.26%) 802.11
11 4 (0.26%) Fibre Channel
11 4 (0.26%) FTP
11 4 (0.26%) SAN
11 4 (0.26%) SNMP
11 4 (0.26%) Wireless
12 3 (0.19%) Software-Defined Networking
Database & Business Intelligence
1 409 (26.40%) Hadoop
2 262 (16.91%) NoSQL
3 224 (14.46%) Data Warehouse
4 193 (12.46%) Data Lake
5 162 (10.46%) Apache Hive
6 117 (7.55%) Power BI
7 116 (7.49%) MongoDB
8 103 (6.65%) Tableau
9 98 (6.33%) PostgreSQL
10 97 (6.26%) SQL Server
11 94 (6.07%) Amazon Redshift
12 93 (6.00%) Relational Database
13 71 (4.58%) Apache Cassandra
14 62 (4.00%) MySQL
14 62 (4.00%) Snowflake Schema
15 61 (3.94%) Impala
16 55 (3.55%) BigQuery
16 55 (3.55%) Data Mining
16 55 (3.55%) HBase
17 54 (3.49%) BusinessObjects
Development Applications
1 133 (8.59%) Git (software)
2 87 (5.62%) Jenkins
3 68 (4.39%) JIRA
4 31 (2.00%) Maven
5 30 (1.94%) Gradle
6 18 (1.16%) Atlassian Bamboo
7 17 (1.10%) GitLab
8 16 (1.03%) TeamCity
9 15 (0.97%) Selenium
10 14 (0.90%) Cucumber
11 11 (0.71%) Bitbucket
11 11 (0.71%) SpecFlow
12 10 (0.65%) ERwin
13 9 (0.58%) Octopus Deploy
13 9 (0.58%) Team Foundation Server
14 8 (0.52%) Eclipse
14 8 (0.52%) Eclipse RCP
14 8 (0.52%) JUnit
14 8 (0.52%) Visual Studio Team System
15 6 (0.39%) Visual Studio
General
1 297 (19.17%) Finance
2 116 (7.49%) Banking
3 62 (4.00%) Public Sector
4 56 (3.62%) Marketing
5 46 (2.97%) Law
6 38 (2.45%) Retail
7 31 (2.00%) Telecoms
8 30 (1.94%) Legal
9 27 (1.74%) Games
10 26 (1.68%) Advertising
11 23 (1.48%) Pharmaceutical
12 19 (1.23%) Local Government
13 16 (1.03%) Front Office
14 13 (0.84%) Manufacturing
15 11 (0.71%) Electronics
16 10 (0.65%) Military
17 9 (0.58%) Aerospace
17 9 (0.58%) Investment Banking
18 6 (0.39%) Financial Institution
19 5 (0.32%) Publishing
Job Titles
1 351 (22.66%) Developer
2 293 (18.92%) Data Engineer
3 196 (12.65%) Architect
4 159 (10.26%) Software Engineer
5 122 (7.88%) Java Developer
6 100 (6.46%) Data Architect
6 100 (6.46%) Data Scientist
7 97 (6.26%) Senior Developer
8 94 (6.07%) Consultant
8 94 (6.07%) Solutions Architect
9 88 (5.68%) Big Data Engineer
10 70 (4.52%) Analyst
11 67 (4.33%) DevOps Engineer
12 62 (4.00%) Java Engineer
13 52 (3.36%) AWS Engineer
14 47 (3.03%) Python Engineer
15 42 (2.71%) Senior Data Engineer
16 40 (2.58%) Business Analyst
16 40 (2.58%) Senior Data Scientist
17 36 (2.32%) Software Developer
Libraries, Frameworks & Software Standards
1 251 (16.20%) Kafka
2 136 (8.78%) Node.js
3 107 (6.91%) Spring
4 99 (6.39%) .NET
5 92 (5.94%) HTML
6 83 (5.36%) Web Services
7 66 (4.26%) Spring Boot
8 62 (4.00%) AngularJS
9 60 (3.87%) CSS
9 60 (3.87%) Natural Language Processing
9 60 (3.87%) React
10 54 (3.49%) RabbitMQ
11 53 (3.42%) REST
12 39 (2.52%) Apache NiFi
12 39 (2.52%) TensorFlow
13 37 (2.39%) HTML5
14 36 (2.32%) RESTful
15 35 (2.26%) JSON
16 28 (1.81%) ActiveMQ
17 27 (1.74%) XML
Miscellaneous
1 156 (10.07%) Analytical Skills
2 85 (5.49%) Algorithms
3 52 (3.36%) Management Information System
4 50 (3.23%) Internet of Things
4 50 (3.23%) User Experience
5 46 (2.97%) Cloud Native
6 45 (2.91%) Self-Motivation
7 37 (2.39%) Data Centre
7 37 (2.39%) Enterprise Software
8 31 (2.00%) Data Structures
9 28 (1.81%) Greenfield Project
9 28 (1.81%) Public Cloud
10 26 (1.68%) Linux Command Line
11 25 (1.61%) Mobile App
12 21 (1.36%) Cyberattack
13 18 (1.16%) Life Science
14 16 (1.03%) PKI
15 15 (0.97%) Social Media
16 12 (0.77%) Credit Risk
16 12 (0.77%) Virtual Team
Operating Systems
1 168 (10.85%) Linux
2 57 (3.68%) Unix
3 53 (3.42%) Windows
4 37 (2.39%) Red Hat Enterprise Linux
5 30 (1.94%) CentOS
6 9 (0.58%) Windows Server 2008
7 8 (0.52%) Windows Server
8 7 (0.45%) Ubuntu
9 6 (0.39%) Android
10 5 (0.32%) Apple iOS
11 4 (0.26%) Solaris
12 3 (0.19%) Oracle Linux
13 2 (0.13%) VMS
13 2 (0.13%) Windows Server 2012
13 2 (0.13%) Windows Server 2016
14 1 (0.065%) Debian
14 1 (0.065%) Mac OS
14 1 (0.065%) Windows Server 2019
Processes & Methodologies
1 648 (41.83%) Agile Software Development
2 625 (40.35%) Analytics
3 388 (25.05%) DevOps
4 370 (23.89%) Machine Learning
5 353 (22.79%) Data Science
6 326 (21.05%) Software Engineering
7 318 (20.53%) ETL
8 257 (16.59%) Business Intelligence
9 251 (16.20%) Artificial Intelligence
10 242 (15.62%) Data Analytics
11 233 (15.04%) Microservices
12 209 (13.49%) Scrum
13 184 (11.88%) Data Modelling
14 172 (11.10%) Mathematics
15 169 (10.91%) Data Engineering
16 157 (10.14%) Visualisation
17 137 (8.84%) Computer Science
18 125 (8.07%) Mentoring
19 122 (7.88%) Open Source
20 114 (7.36%) Problem-Solving
Programming Languages
1 731 (47.19%) Python
2 601 (38.80%) Java
3 548 (35.38%) SQL
4 243 (15.69%) JavaScript
5 203 (13.11%) Scala
6 185 (11.94%) C#
7 137 (8.84%) R
8 91 (5.87%) Bash Shell
9 78 (5.04%) C++
10 72 (4.65%) C
11 47 (3.03%) PL/SQL
12 43 (2.78%) Shell Script
13 41 (2.65%) Go
13 41 (2.65%) TypeScript
14 36 (2.32%) HiveQL
15 33 (2.13%) Java 8
16 32 (2.07%) PHP
17 29 (1.87%) Perl
18 27 (1.74%) PowerShell
19 22 (1.42%) Ruby
Qualifications
1 260 (16.79%) Degree
2 139 (8.97%) Security Cleared
3 97 (6.26%) SC Cleared
4 75 (4.84%) Numerate Degree
5 52 (3.36%) Computer Science Degree
6 48 (3.10%) DV Cleared
7 32 (2.07%) PhD
8 28 (1.81%) BPSS Clearance
9 23 (1.48%) CISSP
10 17 (1.10%) Cisco Certification
11 14 (0.90%) (ISC)2 CCSP
12 10 (0.65%) Master's Degree
13 7 (0.45%) CISM
14 6 (0.39%) AWS Certification
14 6 (0.39%) DBS Check
14 6 (0.39%) SSCP
15 4 (0.26%) TOGAF Certification
16 3 (0.19%) CCNA
16 3 (0.19%) CCNP
16 3 (0.19%) SAP Certification
Quality Assurance & Compliance
1 67 (4.33%) Data Quality
2 43 (2.78%) QA
3 24 (1.55%) GDPR
4 16 (1.03%) ISO/IEC 27001
5 13 (0.84%) NIST
6 12 (0.77%) NCSC
7 8 (0.52%) PCI DSS
8 7 (0.45%) GPG13
8 7 (0.45%) SLA
9 6 (0.39%) Cyber Essentials
9 6 (0.39%) NIST 800
10 3 (0.19%) MiFID
10 3 (0.19%) PMO
10 3 (0.19%) WCAG
11 2 (0.13%) Dodd-Frank
11 2 (0.13%) EMIR
11 2 (0.13%) ISO/IEC 15288
12 1 (0.065%) IFRS
12 1 (0.065%) IFRS 9
12 1 (0.065%) ISO 26262
System Software
1 213 (13.75%) Docker
2 75 (4.84%) HDFS
3 24 (1.55%) Apache ZooKeeper
4 23 (1.48%) VMware Infrastructure
5 19 (1.23%) Active Directory
6 15 (0.97%) Virtual Machines
7 5 (0.32%) Apache Flume
7 5 (0.32%) Firmware
8 4 (0.26%) Hyper-V
8 4 (0.26%) VMware ESXi
9 3 (0.19%) Varnish
10 1 (0.065%) NFS
10 1 (0.065%) Oracle RAC
10 1 (0.065%) oVirt
10 1 (0.065%) VirtualBox
10 1 (0.065%) vSphere
Systems Management
1 225 (14.53%) Kubernetes
2 119 (7.68%) Terraform
3 103 (6.65%) Ansible
4 48 (3.10%) Puppet
5 29 (1.87%) Opscode Chef
6 28 (1.81%) Grafana
7 20 (1.29%) Hadoop YARN
8 11 (0.71%) Nagios
8 11 (0.71%) Oozie
9 8 (0.52%) Istio
10 7 (0.45%) Graphite
10 7 (0.45%) Opsview
11 5 (0.32%) Prometheus
11 5 (0.32%) ZABBIX
12 3 (0.19%) HAProxy
12 3 (0.19%) Kibana
12 3 (0.19%) Mesos
12 3 (0.19%) Oracle ZFS
12 3 (0.19%) SCOM
13 2 (0.13%) SELinux
Vendors
1 165 (10.65%) Microsoft
2 147 (9.49%) Google
3 132 (8.52%) Oracle
4 112 (7.23%) Databricks
5 84 (5.42%) Talend
6 76 (4.91%) Cloudera
7 75 (4.84%) Informatica
8 42 (2.71%) SAP
9 34 (2.19%) IBM
9 34 (2.19%) Red Hat
10 33 (2.13%) Splunk
11 31 (2.00%) Sparx
11 31 (2.00%) VMware
12 23 (1.48%) ServiceNow
13 20 (1.29%) Teradata
14 15 (0.97%) Xamarin
15 12 (0.77%) Salesforce.com
16 9 (0.58%) Ab Initio
17 7 (0.45%) Yahoo!
18 5 (0.32%) MuleSoft