Period
to 25 June 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 25 June 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
25 Jun 2021
Same period 2020 Same period 2019
Rank 114 110 94
Rank change year-on-year -4 -16 -18
Permanent jobs citing Big Data 2,753 2,137 4,444
As % of all permanent jobs advertised in England 2.94% 2.90% 3.33%
As % of the Database & Business Intelligence category 10.79% 10.65% 11.95%
Number of salaries quoted 1,736 1,658 3,529
10th Percentile £45,000 £40,000 £37,500
25th Percentile £50,000 £51,250 £50,000
Median annual salary (50th Percentile) £67,500 £67,500 £70,000
Median % change year-on-year - -3.57% +7.69%
75th Percentile £87,500 £85,000 £87,500
90th Percentile £105,000 £105,000 £105,000
UK median annual salary £67,500 £65,000 £65,000
% change year-on-year +3.85% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 25,519 20,075 37,180
As % of all permanent IT jobs advertised in England 27.22% 27.21% 27.87%
Number of salaries quoted 18,135 16,637 30,974
10th Percentile £34,250 £32,500 £31,250
25th Percentile £42,500 £41,250 £38,750
Median annual salary (50th Percentile) £55,000 £55,000 £52,500
Median % change year-on-year - +4.76% +5.00%
75th Percentile £75,000 £73,750 £70,000
90th Percentile £91,250 £90,000 £86,250
UK median annual salary £55,000 £55,000 £52,000
% change year-on-year - +5.77% +4.00%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

Salary distribution for jobs citing Big Data in England over the 6 months to 25 June 2021.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 25 June 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +15 1,647 £77,500 +3.33% 250
South East -33 370 £58,497 -2.51% 45
North of England +5 241 £55,000 -8.33% 46
South West -17 221 £55,000 - 15
Midlands -52 134 £57,500 +4.55% 19
Yorkshire +30 131 £55,000 -4.35% 15
North West -30 104 £57,500 -6.12% 24
West Midlands -36 102 £57,500 +4.55% 14
East of England -14 93 £77,500 +16.98% 20
East Midlands -53 32 £54,500 -27.33% 5
North East -24 6 £56,914 -18.70% 7
Big Data
UK

For the 6 months to 25 June 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 1,233 (44.79%) AWS
2 1,206 (43.81%) Agile Software Development
3 1,177 (42.75%) Python
4 1,038 (37.70%) Java
5 994 (36.11%) Analytics
6 921 (33.45%) SQL
7 851 (30.91%) Software Engineering
8 823 (29.89%) Docker
9 790 (28.70%) Azure
10 787 (28.59%) Artificial Intelligence
11 730 (26.52%) Apache Spark
12 714 (25.94%) GCP
13 712 (25.86%) DevOps
14 697 (25.32%) Hadoop
15 686 (24.92%) Machine Learning
16 685 (24.88%) Kubernetes
17 656 (23.83%) Data Science
18 640 (23.25%) Microservices
19 573 (20.81%) ETL
20 532 (19.32%) Kafka
20 532 (19.32%) Social Skills
21 525 (19.07%) Jenkins
22 523 (19.00%) Finance
23 514 (18.67%) Open Source
24 490 (17.80%) Degree
25 473 (17.18%) Scrum
26 446 (16.20%) NoSQL
27 436 (15.84%) Data Pipeline
28 430 (15.62%) Terraform
29 413 (15.00%) Data Engineering

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 730 (26.52%) Apache Spark
2 233 (8.46%) Apache
3 224 (8.14%) Apache Airflow
4 198 (7.19%) Elasticsearch
5 115 (4.18%) Confluence
6 67 (2.43%) GemFire
7 52 (1.89%) Luigi
8 50 (1.82%) SAS
9 44 (1.60%) Cloud Foundry
10 34 (1.24%) Apache Pig
11 27 (0.98%) IIS
12 24 (0.87%) Oracle SOA Suite
13 17 (0.62%) Oracle Workflow
14 10 (0.36%) OpenStack
15 7 (0.25%) Jupyter
15 7 (0.25%) Tomcat
15 7 (0.25%) WebLogic
16 6 (0.22%) Apache Synapse
17 5 (0.18%) NServiceBus
17 5 (0.18%) SharePoint
Applications
1 38 (1.38%) Microsoft Excel
2 28 (1.02%) SPSS
3 16 (0.58%) Microsoft Office
4 12 (0.44%) Spreadsheet
5 11 (0.40%) Figma
6 6 (0.22%) Gephi
7 5 (0.18%) Microsoft PowerPoint
8 4 (0.15%) Adobe Creative Suite
8 4 (0.15%) Adobe Illustrator
8 4 (0.15%) GIMP
8 4 (0.15%) Inkscape
8 4 (0.15%) Photoshop
9 3 (0.11%) Sketch
10 2 (0.073%) Stata
11 1 (0.036%) Microsoft Project
Business Applications
1 10 (0.36%) Oracle ERP
1 10 (0.36%) Primavera
2 9 (0.33%) HFM
2 9 (0.33%) Hyperion Planning
2 9 (0.33%) Sentinel
3 8 (0.29%) Sparx Enterprise Architect
4 4 (0.15%) Oracle EBS
5 3 (0.11%) Distributed Ledger
6 2 (0.073%) Oracle BPM
6 2 (0.073%) R3 Corda
6 2 (0.073%) SAP S/4HANA
7 1 (0.036%) Dynamics CRM
7 1 (0.036%) Eikon
7 1 (0.036%) Oracle Procure-to-Pay
7 1 (0.036%) SAP CRM
7 1 (0.036%) SAP ERP
7 1 (0.036%) SAP Hybris
7 1 (0.036%) SAP R/3
Cloud Services
1 1,233 (44.79%) AWS
2 790 (28.70%) Azure
3 714 (25.94%) GCP
4 282 (10.24%) Serverless
5 233 (8.46%) GitHub
6 189 (6.87%) Power Platform
7 157 (5.70%) Snowflake
8 143 (5.19%) SaaS
9 132 (4.79%) Cloud Computing
10 103 (3.74%) Amazon EMR
10 103 (3.74%) PaaS
11 91 (3.31%) Amazon Kinesis
12 88 (3.20%) IaaS
13 83 (3.01%) Amazon S3
14 75 (2.72%) Amazon EC2
15 73 (2.65%) AWS Lambda
16 67 (2.43%) IBM Cloud
17 62 (2.25%) Cloud Functions
18 43 (1.56%) AWS CloudFormation
19 37 (1.34%) Azure Data Factory
Communications & Networking
1 93 (3.38%) Internet
2 74 (2.69%) Firewall
3 50 (1.82%) HTTP
4 28 (1.02%) DNS
5 27 (0.98%) VPN
6 16 (0.58%) Wireless
7 15 (0.54%) 5G
8 12 (0.44%) 4G
9 11 (0.40%) BGP
9 11 (0.40%) IPsec
9 11 (0.40%) SSL
10 9 (0.33%) SMTP
11 8 (0.29%) Network Security
12 7 (0.25%) Intrusion Detection
12 7 (0.25%) LAN
12 7 (0.25%) Unified Communications
12 7 (0.25%) WAN
13 6 (0.22%) Broadband
13 6 (0.22%) Ethernet
13 6 (0.22%) MPLS
Database & Business Intelligence
1 697 (25.32%) Hadoop
2 446 (16.20%) NoSQL
3 409 (14.86%) Data Warehouse
4 261 (9.48%) Amazon Redshift
5 232 (8.43%) PostgreSQL
6 223 (8.10%) Relational Database
7 219 (7.95%) Data Lake
8 183 (6.65%) Power BI
9 175 (6.36%) BigQuery
10 174 (6.32%) Apache Hive
11 161 (5.85%) Tableau
12 148 (5.38%) MongoDB
13 140 (5.09%) SQL Server
14 138 (5.01%) HBase
15 127 (4.61%) Redis
16 111 (4.03%) MySQL
17 97 (3.52%) Amazon Athena
17 97 (3.52%) Apache Cassandra
17 97 (3.52%) MariaDB
18 90 (3.27%) SQL Server Integration Services
Development Applications
1 525 (19.07%) Jenkins
2 250 (9.08%) Git (software)
3 190 (6.90%) JIRA
4 131 (4.76%) Atlassian Bamboo
5 103 (3.74%) JUnit
6 89 (3.23%) Vagrant
7 83 (3.01%) Cucumber
7 83 (3.01%) Cypress.io
8 80 (2.91%) Gradle
9 71 (2.58%) Sonatype Nexus
10 65 (2.36%) Protractor
11 64 (2.32%) Storybook
12 61 (2.22%) Eclipse
12 61 (2.22%) IntelliJ
13 57 (2.07%) SonarQube
14 54 (1.96%) Mockito
15 46 (1.67%) Bitbucket
16 43 (1.56%) Selenium
17 35 (1.27%) Team Foundation Server
18 31 (1.13%) TeamCity
General
1 532 (19.32%) Social Skills
2 523 (19.00%) Finance
3 232 (8.43%) Analytical Skills
4 218 (7.92%) Banking
5 145 (5.27%) Retail
6 139 (5.05%) Law
7 117 (4.25%) Legal
8 107 (3.89%) Marketing
9 105 (3.81%) Presentation Skills
10 88 (3.20%) Telecoms
11 54 (1.96%) Games
12 48 (1.74%) Public Sector
13 42 (1.53%) Influencing Skills
14 41 (1.49%) Manufacturing
15 39 (1.42%) Advertising
16 29 (1.05%) Investment Banking
17 25 (0.91%) Organisational Skills
18 23 (0.84%) Financial Institution
19 21 (0.76%) Front Office
20 19 (0.69%) Local Government
Job Titles
1 649 (23.57%) Developer
2 528 (19.18%) Data Engineer
3 371 (13.48%) Software Engineer
4 340 (12.35%) Architect
5 235 (8.54%) Java Developer
6 186 (6.76%) Big Data Engineer
7 176 (6.39%) Data Architect
8 138 (5.01%) Senior Developer
9 128 (4.65%) Analyst
10 123 (4.47%) Java Engineer
11 118 (4.29%) Consultant
12 114 (4.14%) Senior Software Engineer
13 110 (4.00%) AWS Engineer
14 108 (3.92%) Senior Data Engineer
15 98 (3.56%) Python Engineer
16 92 (3.34%) Solutions Architect
17 89 (3.23%) Platform Engineer
18 83 (3.01%) Lead Developer
19 81 (2.94%) Data Scientist
20 72 (2.62%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 532 (19.32%) Kafka
2 295 (10.72%) Node.js
3 292 (10.61%) Spring
4 288 (10.46%) React
5 285 (10.35%) REST
6 217 (7.88%) AngularJS
7 198 (7.19%) Web Services
8 194 (7.05%) GraphQL
9 193 (7.01%) .NET
10 186 (6.76%) CSS
11 156 (5.67%) Spark Streaming
12 140 (5.09%) CGI
13 136 (4.94%) RESTful
14 133 (4.83%) Middleware
15 120 (4.36%) JSON
16 116 (4.21%) HTML
16 116 (4.21%) Redux
17 113 (4.10%) Hibernate
18 107 (3.89%) Spring Boot
19 102 (3.71%) RabbitMQ
Miscellaneous
1 227 (8.25%) User Experience
2 145 (5.27%) Algorithms
3 126 (4.58%) Hybrid Cloud
4 113 (4.10%) Self-Motivation
5 108 (3.92%) Linux Command Line
6 94 (3.41%) Cloud Native
7 90 (3.27%) Cyberattack
8 82 (2.98%) Data Structures
9 77 (2.80%) Hedge funds
10 55 (2.00%) Public Cloud
11 44 (1.60%) Greenfield Project
11 44 (1.60%) Management Information System
12 40 (1.45%) Robotics
13 39 (1.42%) Internet of Things
14 37 (1.34%) Data Centre
15 34 (1.24%) Virtual Team
16 33 (1.20%) Enterprise Software
17 24 (0.87%) Life Science
18 19 (0.69%) Equities
19 18 (0.65%) Mobile App
Operating Systems
1 326 (11.84%) Linux
2 117 (4.25%) Unix
3 71 (2.58%) Red Hat Enterprise Linux
4 52 (1.89%) CentOS
5 33 (1.20%) Windows
6 17 (0.62%) VMS
7 13 (0.47%) Fedora
8 8 (0.29%) Ubuntu
9 6 (0.22%) Android
10 3 (0.11%) Apple iOS
11 2 (0.073%) Debian
11 2 (0.073%) Windows Server
12 1 (0.036%) Mac OS X
12 1 (0.036%) Solaris
Processes & Methodologies
1 1,206 (43.81%) Agile Software Development
2 994 (36.11%) Analytics
3 851 (30.91%) Software Engineering
4 787 (28.59%) Artificial Intelligence
5 712 (25.86%) DevOps
6 686 (24.92%) Machine Learning
7 656 (23.83%) Data Science
8 640 (23.25%) Microservices
9 573 (20.81%) ETL
10 514 (18.67%) Open Source
11 473 (17.18%) Scrum
12 436 (15.84%) Data Pipeline
13 413 (15.00%) Data Engineering
14 398 (14.46%) Continuous Integration
15 393 (14.28%) Business Intelligence
16 389 (14.13%) Computer Science
17 350 (12.71%) TDD
18 338 (12.28%) Problem-Solving
19 337 (12.24%) Data Analytics
20 307 (11.15%) Data Modelling
Programming Languages
1 1,177 (42.75%) Python
2 1,038 (37.70%) Java
3 921 (33.45%) SQL
4 383 (13.91%) JavaScript
5 269 (9.77%) C#
6 258 (9.37%) Scala
7 169 (6.14%) TypeScript
8 164 (5.96%) Java 8
9 129 (4.69%) C
10 126 (4.58%) C++
11 123 (4.47%) Go
12 92 (3.34%) R
13 74 (2.69%) Shell Script
14 68 (2.47%) Bash Shell
15 60 (2.18%) Groovy
16 59 (2.14%) PHP
17 55 (2.00%) PowerShell
18 47 (1.71%) Ruby
19 37 (1.34%) T-SQL
20 33 (1.20%) Perl
Qualifications
1 490 (17.80%) Degree
2 243 (8.83%) Security Cleared
3 174 (6.32%) SC Cleared
4 126 (4.58%) Computer Science Degree
5 79 (2.87%) Numerate Degree
6 75 (2.72%) DV Cleared
7 64 (2.32%) Oracle Certification
8 57 (2.07%) PhD
9 54 (1.96%) OCP
10 26 (0.94%) Master's Degree
11 16 (0.58%) CISSP
12 14 (0.51%) SSCP
13 12 (0.44%) Cisco Certification
13 12 (0.44%) MCSE
13 12 (0.44%) Microsoft Certification
14 10 (0.36%) CCNA
15 9 (0.33%) ACCA
15 9 (0.33%) AWS Certification
15 9 (0.33%) CIMA
16 8 (0.29%) SANS
Quality Assurance & Compliance
1 120 (4.36%) Data Quality
2 111 (4.03%) QA
3 75 (2.72%) GDPR
4 22 (0.80%) Accessibility
5 10 (0.36%) ISO/IEC 27001
5 10 (0.36%) NIST
6 9 (0.33%) PCI DSS
7 6 (0.22%) Cyber Essentials
7 6 (0.22%) NCSC
7 6 (0.22%) SLA
8 5 (0.18%) GRC
9 4 (0.15%) GxP
9 4 (0.15%) Sarbanes-Oxley
9 4 (0.15%) WCAG
10 3 (0.11%) PMO
11 2 (0.073%) COBIT
11 2 (0.073%) ISO/IEC 15288
11 2 (0.073%) MiFID
11 2 (0.073%) Solvency II
12 1 (0.036%) GPG13
System Software
1 823 (29.89%) Docker
2 92 (3.34%) HDFS
3 72 (2.62%) VirtualBox
4 67 (2.43%) VMware Infrastructure
5 45 (1.63%) Active Directory
6 25 (0.91%) Apache ZooKeeper
7 17 (0.62%) Apache Flume
8 7 (0.25%) Virtual Machines
9 6 (0.22%) Ceph
9 6 (0.22%) Oracle RAC
9 6 (0.22%) VMware ESXi
10 3 (0.11%) KVM
11 2 (0.073%) NFS
11 2 (0.073%) Samba
11 2 (0.073%) Xen
12 1 (0.036%) Firmware
12 1 (0.036%) VMware NSX
12 1 (0.036%) vSphere
Systems Management
1 685 (24.88%) Kubernetes
2 430 (15.62%) Terraform
3 389 (14.13%) Ansible
4 100 (3.63%) Docker Swarm
5 94 (3.41%) Puppet
6 88 (3.20%) Opscode Chef
7 68 (2.47%) Grafana
8 65 (2.36%) Prometheus
9 25 (0.91%) Hadoop YARN
10 22 (0.80%) ZABBIX
11 20 (0.73%) Nagios
12 18 (0.65%) Consul
12 18 (0.65%) Graphite
12 18 (0.65%) Opsview
12 18 (0.65%) Packer
12 18 (0.65%) Salt
12 18 (0.65%) SCCM
13 11 (0.40%) Kibana
13 11 (0.40%) Oozie
14 7 (0.25%) ITRS Geneos
Vendors
1 355 (12.90%) Google
2 202 (7.34%) Oracle
3 166 (6.03%) Microsoft
4 133 (4.83%) Cloudera
5 124 (4.50%) Informatica
6 110 (4.00%) Databricks
7 108 (3.92%) Talend
8 95 (3.45%) VMware
9 91 (3.31%) IBM
10 85 (3.09%) Hortonworks
11 64 (2.32%) Okta
12 55 (2.00%) Red Hat
13 51 (1.85%) SAP
14 38 (1.38%) Yahoo!
15 31 (1.13%) Splunk
16 25 (0.91%) Hyperion
17 23 (0.84%) Salesforce.com
18 14 (0.51%) Alteryx
18 14 (0.51%) Instagram
18 14 (0.51%) Teradata