Period
to 28 September 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 September 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
28 Sep 2021
Same period 2020 Same period 2019
Rank 121 101 95
Rank change year-on-year -20 -6 -16
Permanent jobs citing Big Data 3,153 1,419 4,225
As % of all permanent jobs advertised in England 2.91% 3.21% 3.28%
As % of the Database & Business Intelligence category 10.35% 11.05% 11.97%
Number of salaries quoted 1,795 1,126 3,397
10th Percentile £45,000 £42,500 £38,750
25th Percentile £53,042 £48,750 £50,000
Median annual salary (50th Percentile) £72,500 £67,500 £70,000
Median % change year-on-year +7.41% -3.57% +7.69%
75th Percentile £92,500 £83,750 £87,500
90th Percentile £108,750 £103,750 £106,100
UK median annual salary £72,500 £65,000 £67,500
% change year-on-year +11.54% -3.70% +3.85%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 30,470 12,837 35,284
As % of all permanent IT jobs advertised in England 28.13% 29.04% 27.39%
Number of salaries quoted 20,061 10,890 29,420
10th Percentile £35,000 £33,750 £31,500
25th Percentile £42,500 £42,500 £38,750
Median annual salary (50th Percentile) £57,500 £55,000 £52,500
Median % change year-on-year +4.55% +4.76% +5.00%
75th Percentile £77,500 £73,750 £70,000
90th Percentile £95,000 £90,000 £86,250
UK median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

Salary distribution for jobs citing Big Data in England over the 6 months to 28 September 2021.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 28 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +1 1,913 £80,000 +6.67% 202
South East -15 512 £67,500 +12.50% 38
North of England -53 253 £55,000 - 39
South West -49 160 £60,000 +4.35% 11
Midlands -88 145 £57,500 +4.55% 25
Yorkshire -13 132 £55,000 - 5
North West -74 114 £60,000 -14.29% 30
West Midlands -62 106 £57,500 +4.55% 17
East of England -51 101 £80,000 +33.33% 14
East Midlands -78 39 £59,500 -15.00% 8
North East -37 7 £90,000 +111.76% 4
Big Data
UK

For the 6 months to 28 September 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 1,403 (44.50%) Python
2 1,377 (43.67%) AWS
3 1,364 (43.26%) Agile Software Development
4 1,269 (40.25%) Analytics
5 1,256 (39.84%) Java
6 1,157 (36.70%) SQL
7 927 (29.40%) Azure
8 874 (27.72%) Apache Spark
9 837 (26.55%) DevOps
10 824 (26.13%) Docker
11 817 (25.91%) GCP
12 814 (25.82%) Software Engineering
13 778 (24.67%) Microservices
14 758 (24.04%) Artificial Intelligence
15 746 (23.66%) Hadoop
16 720 (22.84%) Data Science
17 705 (22.36%) Kubernetes
18 686 (21.76%) Machine Learning
19 685 (21.73%) Kafka
20 668 (21.19%) Finance
21 649 (20.58%) Jenkins
22 642 (20.36%) Social Skills
23 627 (19.89%) Degree
24 610 (19.35%) ETL
25 579 (18.36%) Open Source
26 578 (18.33%) NoSQL
27 562 (17.82%) Computer Science
27 562 (17.82%) Scrum
28 515 (16.33%) Continuous Integration
29 512 (16.24%) Data Warehouse

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 874 (27.72%) Apache Spark
2 316 (10.02%) Apache
3 210 (6.66%) Apache Airflow
4 208 (6.60%) Elasticsearch
5 123 (3.90%) GemFire
6 110 (3.49%) Confluence
7 71 (2.25%) Cloud Foundry
8 39 (1.24%) Luigi
9 37 (1.17%) IIS
10 33 (1.05%) Apache Pig
11 28 (0.89%) Jupyter
12 25 (0.79%) SAS
13 18 (0.57%) SharePoint
14 11 (0.35%) Apache Solr
14 11 (0.35%) Tomcat
15 10 (0.32%) Oracle SOA Suite
15 10 (0.32%) Oracle Workflow
16 8 (0.25%) OpenStack
17 7 (0.22%) CMS
18 6 (0.19%) Apache Synapse
Applications
1 44 (1.40%) Microsoft Excel
2 31 (0.98%) Figma
3 18 (0.57%) Microsoft Office
4 14 (0.44%) Adobe Creative Suite
4 14 (0.44%) SPSS
5 12 (0.38%) Sketch
6 10 (0.32%) Spreadsheet
7 6 (0.19%) Chatbot
8 5 (0.16%) InVision
9 4 (0.13%) InfoPath
9 4 (0.13%) Microsoft PowerPoint
10 3 (0.095%) Adobe Illustrator
10 3 (0.095%) GIMP
10 3 (0.095%) GNU Octave
10 3 (0.095%) Inkscape
10 3 (0.095%) Photoshop
11 2 (0.063%) Microsoft Project
11 2 (0.063%) Stata
12 1 (0.032%) MS Visio
12 1 (0.032%) OmniGraffle
Business Applications
1 17 (0.54%) Oracle ERP
2 13 (0.41%) IBM Planning Analytics
3 12 (0.38%) Sentinel
4 10 (0.32%) Primavera
5 6 (0.19%) Distributed Ledger
6 5 (0.16%) R3 Corda
7 4 (0.13%) Oracle BPM
8 3 (0.095%) Dynamics CRM
8 3 (0.095%) Oracle EBS R12
9 2 (0.063%) Oracle EBS
9 2 (0.063%) Oracle Procure-to-Pay
9 2 (0.063%) SAP R/3
9 2 (0.063%) SAP S/4HANA
10 1 (0.032%) Eikon
10 1 (0.032%) HFM
10 1 (0.032%) Hyperion Planning
10 1 (0.032%) Maximo
10 1 (0.032%) NetSuite
Cloud Services
1 1,377 (43.67%) AWS
2 927 (29.40%) Azure
3 817 (25.91%) GCP
4 372 (11.80%) Serverless
5 360 (11.42%) GitHub
6 253 (8.02%) Power Platform
7 200 (6.34%) Amazon Kinesis
8 193 (6.12%) SaaS
9 172 (5.46%) PaaS
10 170 (5.39%) Snowflake
11 160 (5.07%) IaaS
12 134 (4.25%) Cloud Computing
13 123 (3.90%) Amazon EC2
14 114 (3.62%) Amazon S3
15 113 (3.58%) AWS Lambda
16 107 (3.39%) Amazon EMR
17 93 (2.95%) Azure Data Factory
18 68 (2.16%) Azure Synapse Analytics
19 62 (1.97%) Amazon SQS
20 52 (1.65%) Cloud Functions
Communications & Networking
1 59 (1.87%) HTTP
2 55 (1.74%) Internet
3 54 (1.71%) Firewall
4 28 (0.89%) DNS
5 24 (0.76%) VPN
5 24 (0.76%) Wireless
6 19 (0.60%) Broadband
7 17 (0.54%) BGP
8 15 (0.48%) 4G
8 15 (0.48%) 5G
9 14 (0.44%) IPsec
10 12 (0.38%) Cisco IPT
10 12 (0.38%) Network Security
11 11 (0.35%) LAN
11 11 (0.35%) WAN
12 8 (0.25%) Sourcefire
13 7 (0.22%) SSL
13 7 (0.22%) TCP/IP
14 6 (0.19%) Cisco ASA
14 6 (0.19%) SMS
Database & Business Intelligence
1 746 (23.66%) Hadoop
2 578 (18.33%) NoSQL
3 512 (16.24%) Data Warehouse
4 344 (10.91%) Relational Database
5 324 (10.28%) Data Lake
6 303 (9.61%) PostgreSQL
7 260 (8.25%) MongoDB
8 256 (8.12%) Amazon Redshift
9 247 (7.83%) Power BI
10 234 (7.42%) HBase
11 224 (7.10%) Apache Hive
12 208 (6.60%) Tableau
13 195 (6.18%) BigQuery
14 187 (5.93%) Redis
15 177 (5.61%) SQL Server
16 171 (5.42%) MariaDB
17 155 (4.92%) Apache Cassandra
18 142 (4.50%) MySQL
19 128 (4.06%) Amazon DynamoDB
20 118 (3.74%) Metadata
Development Applications
1 649 (20.58%) Jenkins
2 360 (11.42%) Git (software)
3 191 (6.06%) JIRA
4 169 (5.36%) JUnit
5 147 (4.66%) Gradle
6 142 (4.50%) Cypress.io
7 129 (4.09%) Cucumber
8 123 (3.90%) Sonatype Nexus
9 121 (3.84%) Atlassian Bamboo
9 121 (3.84%) Protractor
9 121 (3.84%) Storybook
10 117 (3.71%) IntelliJ
11 116 (3.68%) Eclipse
12 110 (3.49%) Mockito
13 91 (2.89%) SonarQube
14 67 (2.12%) Artifactory
15 66 (2.09%) Bitbucket
16 64 (2.03%) Vagrant
17 46 (1.46%) Selenium
18 39 (1.24%) TeamCity
General
1 668 (21.19%) Finance
2 642 (20.36%) Social Skills
3 324 (10.28%) Analytical Skills
4 315 (9.99%) Banking
5 224 (7.10%) Law
6 221 (7.01%) Inclusion and Diversity
7 185 (5.87%) Retail
8 138 (4.38%) Presentation Skills
9 90 (2.85%) Marketing
10 89 (2.82%) Legal
11 71 (2.25%) Telecoms
12 68 (2.16%) Public Sector
13 58 (1.84%) Advertising
14 57 (1.81%) Games
15 39 (1.24%) Publishing
16 31 (0.98%) Influencing Skills
16 31 (0.98%) Investment Banking
17 30 (0.95%) Automotive
17 30 (0.95%) Organisational Skills
18 29 (0.92%) Financial Institution
Job Titles
1 784 (24.87%) Developer
2 550 (17.44%) Data Engineer
3 413 (13.10%) Architect
4 412 (13.07%) Software Engineer
5 305 (9.67%) Java Developer
6 193 (6.12%) Data Architect
6 193 (6.12%) Senior Developer
7 170 (5.39%) Big Data Engineer
8 167 (5.30%) Analyst
9 128 (4.06%) Senior Software Engineer
10 118 (3.74%) Solutions Architect
11 115 (3.65%) Lead Developer
12 103 (3.27%) Java Engineer
12 103 (3.27%) Senior Data Engineer
13 93 (2.95%) Consultant
14 91 (2.89%) Data Scientist
15 89 (2.82%) Python Engineer
16 87 (2.76%) Data Analyst
16 87 (2.76%) Lead Software Engineer
16 87 (2.76%) Software Developer
Libraries, Frameworks & Software Standards
1 685 (21.73%) Kafka
2 457 (14.49%) Spring
3 409 (12.97%) React
4 391 (12.40%) Node.js
5 348 (11.04%) REST
6 273 (8.66%) AngularJS
7 251 (7.96%) GraphQL
8 241 (7.64%) CSS
9 236 (7.48%) Web Services
10 208 (6.60%) RESTful
11 202 (6.41%) Middleware
12 198 (6.28%) JSON
13 191 (6.06%) Spark Streaming
14 179 (5.68%) Redux
15 177 (5.61%) .NET
16 170 (5.39%) RabbitMQ
17 162 (5.14%) Spring Boot
18 157 (4.98%) Express
19 155 (4.92%) Hibernate
20 144 (4.57%) HTML
Miscellaneous
1 279 (8.85%) User Experience
2 171 (5.42%) Algorithms
3 167 (5.30%) Cloud Native
4 157 (4.98%) Self-Motivation
5 150 (4.76%) Linux Command Line
6 136 (4.31%) Hybrid Cloud
7 99 (3.14%) Data Structures
8 97 (3.08%) Public Cloud
9 73 (2.32%) Cyberattack
10 56 (1.78%) Management Information System
11 52 (1.65%) Greenfield Project
12 45 (1.43%) Life Science
13 38 (1.21%) Virtual Team
14 34 (1.08%) Hedge funds
15 32 (1.01%) Enterprise Software
16 31 (0.98%) Data Centre
17 29 (0.92%) Private Cloud
17 29 (0.92%) Robotics
18 26 (0.82%) Social Media
19 24 (0.76%) Mobile App
Operating Systems
1 387 (12.27%) Linux
2 215 (6.82%) Unix
3 54 (1.71%) Red Hat Enterprise Linux
4 37 (1.17%) VMS
4 37 (1.17%) Windows
5 36 (1.14%) CentOS
6 14 (0.44%) Fedora
7 11 (0.35%) Apple iOS
8 5 (0.16%) Android
8 5 (0.16%) Mac OS
9 4 (0.13%) DC/OS
9 4 (0.13%) Windows Server
10 3 (0.095%) Mesosphere
11 1 (0.032%) Mac OS X
11 1 (0.032%) Ubuntu
Processes & Methodologies
1 1,364 (43.26%) Agile Software Development
2 1,269 (40.25%) Analytics
3 837 (26.55%) DevOps
4 814 (25.82%) Software Engineering
5 778 (24.67%) Microservices
6 758 (24.04%) Artificial Intelligence
7 720 (22.84%) Data Science
8 686 (21.76%) Machine Learning
9 610 (19.35%) ETL
10 579 (18.36%) Open Source
11 562 (17.82%) Computer Science
11 562 (17.82%) Scrum
12 515 (16.33%) Continuous Integration
13 507 (16.08%) TDD
14 499 (15.83%) Business Intelligence
15 478 (15.16%) Problem-Solving
16 460 (14.59%) Data Pipeline
17 411 (13.04%) Data Modelling
18 405 (12.84%) Data Analytics
19 346 (10.97%) Data Engineering
Programming Languages
1 1,403 (44.50%) Python
2 1,256 (39.84%) Java
3 1,157 (36.70%) SQL
4 388 (12.31%) JavaScript
5 322 (10.21%) Scala
6 320 (10.15%) C#
7 203 (6.44%) Java 8
8 181 (5.74%) TypeScript
9 156 (4.95%) Go
10 148 (4.69%) Shell Script
11 147 (4.66%) PowerShell
12 124 (3.93%) R
13 118 (3.74%) C++
13 118 (3.74%) Groovy
14 84 (2.66%) C
15 83 (2.63%) Bash Shell
16 47 (1.49%) Ruby
17 39 (1.24%) PHP
18 35 (1.11%) T-SQL
19 32 (1.01%) Java 11
Qualifications
1 627 (19.89%) Degree
2 252 (7.99%) Security Cleared
3 209 (6.63%) SC Cleared
4 137 (4.35%) Computer Science Degree
5 123 (3.90%) Oracle Certification
6 109 (3.46%) OCP
7 74 (2.35%) Numerate Degree
8 38 (1.21%) PhD
9 37 (1.17%) Master's Degree
10 31 (0.98%) AWS Certification
11 27 (0.86%) DV Cleared
12 17 (0.54%) Cisco Certification
13 14 (0.44%) CISSP
14 12 (0.38%) (ISC)2 CCSP
15 11 (0.35%) Microsoft Certification
16 10 (0.32%) CCSP
17 8 (0.25%) MCSA
18 6 (0.19%) ISEB
19 5 (0.16%) BPSS Clearance
19 5 (0.16%) TOGAF Certification
Quality Assurance & Compliance
1 186 (5.90%) Data Quality
2 143 (4.54%) QA
3 87 (2.76%) GDPR
4 38 (1.21%) Accessibility
5 9 (0.29%) GxP
6 8 (0.25%) PMO
7 6 (0.19%) Sarbanes-Oxley
8 5 (0.16%) Actionable Recommendations
8 5 (0.16%) NIST
9 4 (0.13%) ISO/IEC 27001
9 4 (0.13%) PCI DSS
10 3 (0.095%) SLA
10 3 (0.095%) WCAG
11 2 (0.063%) COBIT
11 2 (0.063%) MiFID
11 2 (0.063%) Solvency II
12 1 (0.032%) Cyber Essentials
12 1 (0.032%) IFRS
12 1 (0.032%) IFRS 9
12 1 (0.032%) NCSC
System Software
1 824 (26.13%) Docker
2 146 (4.63%) HDFS
3 98 (3.11%) VMware Infrastructure
4 63 (2.00%) Active Directory
5 45 (1.43%) VirtualBox
6 32 (1.01%) Apache ZooKeeper
7 12 (0.38%) Apache Flume
7 12 (0.38%) Virtual Machines
8 7 (0.22%) Ceph
9 4 (0.13%) Hyper-V
10 3 (0.095%) KVM
10 3 (0.095%) VMware ESXi
11 1 (0.032%) Firmware
Systems Management
1 705 (22.36%) Kubernetes
2 492 (15.60%) Terraform
3 440 (13.95%) Ansible
4 108 (3.43%) Opscode Chef
5 101 (3.20%) Puppet
6 79 (2.51%) Docker Swarm
6 79 (2.51%) Prometheus
7 73 (2.32%) Grafana
8 32 (1.01%) SCCM
9 22 (0.70%) Salt
10 21 (0.67%) Hadoop YARN
11 20 (0.63%) Consul
11 20 (0.63%) Graphite
12 19 (0.60%) Packer
13 18 (0.57%) Nagios
13 18 (0.57%) Oozie
13 18 (0.57%) Opsview
13 18 (0.57%) ZABBIX
14 9 (0.29%) ITRS Geneos
15 7 (0.22%) Control-M
Vendors
1 381 (12.08%) Google
2 208 (6.60%) Microsoft
3 190 (6.03%) Oracle
4 180 (5.71%) Databricks
5 132 (4.19%) VMware
6 125 (3.96%) Informatica
7 121 (3.84%) Okta
8 98 (3.11%) Cloudera
9 87 (2.76%) Talend
10 83 (2.63%) IBM
11 77 (2.44%) Hortonworks
12 60 (1.90%) SAP
13 42 (1.33%) Red Hat
14 39 (1.24%) Splunk
15 32 (1.01%) Adobe
16 27 (0.86%) Palantir
17 26 (0.82%) Teradata
18 25 (0.79%) Salesforce.com
18 25 (0.79%) StreamSets
19 23 (0.73%) Cisco