Period
to 12 April 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 12 April 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
12 Apr 2021
Same period 2020 Same period 2019
Rank 118 113 86
Rank change year-on-year -5 -27 -6
Permanent jobs citing Big Data 2,011 2,885 4,875
As % of all permanent jobs advertised in England 2.73% 2.76% 3.53%
As % of the Database & Business Intelligence category 10.27% 10.24% 12.46%
Number of salaries quoted 1,453 2,262 3,903
10th Percentile £42,600 £40,000 £37,500
25th Percentile £48,000 £52,500 £49,337
Median annual salary (50th Percentile) £65,000 £70,000 £70,000
Median % change year-on-year -7.14% - +7.69%
75th Percentile £85,000 £86,250 £89,373
90th Percentile £100,000 £110,000 £105,000
UK median annual salary £65,000 £70,000 £67,500
% change year-on-year -7.14% +3.70% +3.85%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 19,586 28,173 39,110
As % of all permanent IT jobs advertised in England 26.64% 26.90% 28.34%
Number of salaries quoted 16,011 23,422 32,672
10th Percentile £33,750 £32,500 £31,250
25th Percentile £42,500 £40,000 £38,750
Median annual salary (50th Percentile) £55,000 £53,931 £52,500
Median % change year-on-year +1.98% +2.73% +5.00%
75th Percentile £75,000 £72,500 £71,250
90th Percentile £88,750 £90,000 £86,250
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

Salary distribution for jobs citing Big Data in England over the 6 months to 12 April 2021.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 12 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +7 1,187 £75,000 - 221
South East -40 237 £58,497 -2.51% 38
North of England +31 215 £55,000 - 49
South West +27 208 £52,500 +5.00% 14
Yorkshire +63 140 £55,000 - 11
Midlands -67 84 £55,500 -7.50% 21
North West -20 67 £57,500 +9.52% 35
West Midlands +6 60 £58,750 +6.82% 14
East of England -10 48 £70,000 -6.67% 30
East Midlands -53 24 £55,500 -26.00% 7
North East -5 8 £43,000 -21.35% 3
Big Data
UK

For the 6 months to 12 April 2021, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 917 (45.60%) Python
2 898 (44.65%) AWS
3 862 (42.86%) Agile Software Development
4 742 (36.90%) Analytics
5 672 (33.42%) SQL
6 667 (33.17%) Java
7 632 (31.43%) Azure
8 547 (27.20%) Software Engineering
9 530 (26.36%) Hadoop
10 525 (26.11%) Machine Learning
11 518 (25.76%) Data Science
12 511 (25.41%) DevOps
13 504 (25.06%) Apache Spark
14 489 (24.32%) Artificial Intelligence
15 449 (22.33%) GCP
16 440 (21.88%) Docker
17 431 (21.43%) ETL
18 401 (19.94%) Kubernetes
19 371 (18.45%) Kafka
20 350 (17.40%) Data Engineering
21 343 (17.06%) Microservices
22 341 (16.96%) Finance
23 331 (16.46%) Business Intelligence
24 323 (16.06%) Degree
25 316 (15.71%) NoSQL
26 300 (14.92%) Data Warehouse
27 276 (13.72%) Scrum
28 262 (13.03%) JavaScript
29 260 (12.93%) Open Source
30 256 (12.73%) Google

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 504 (25.06%) Apache Spark
2 139 (6.91%) Apache
2 139 (6.91%) Apache Airflow
3 130 (6.46%) Elasticsearch
4 80 (3.98%) Confluence
5 64 (3.18%) SAS
6 51 (2.54%) Luigi
7 32 (1.59%) Apache Pig
8 25 (1.24%) Oracle SOA Suite
9 14 (0.70%) IIS
10 12 (0.60%) GemFire
10 12 (0.60%) Oracle Workflow
11 9 (0.45%) Moodle
12 8 (0.40%) Jupyter
12 8 (0.40%) OpenStack
13 7 (0.35%) Tornado
13 7 (0.35%) WebLogic
14 6 (0.30%) ArcGIS
14 6 (0.30%) nginx
14 6 (0.30%) SharePoint
Applications
1 21 (1.04%) SPSS
2 18 (0.90%) Microsoft Excel
3 8 (0.40%) Microsoft Office
4 7 (0.35%) Spreadsheet
5 6 (0.30%) Gephi
6 4 (0.20%) Figma
6 4 (0.20%) Microsoft PowerPoint
7 3 (0.15%) Adobe Illustrator
7 3 (0.15%) GIMP
7 3 (0.15%) Inkscape
7 3 (0.15%) Photoshop
8 1 (0.050%) Adobe Creative Suite
Business Applications
1 9 (0.45%) HFM
1 9 (0.45%) Hyperion Planning
1 9 (0.45%) Sparx Enterprise Architect
2 7 (0.35%) Dynamics CRM
3 5 (0.25%) SAP CRM
4 4 (0.20%) Oracle EBS
5 2 (0.099%) Oracle ERP
5 2 (0.099%) SAP IS-U
5 2 (0.099%) SAP S/4HANA
5 2 (0.099%) Sentinel
6 1 (0.050%) SAP APO
6 1 (0.050%) SAP ERP
6 1 (0.050%) SAP Hybris
Cloud Services
1 898 (44.65%) AWS
2 632 (31.43%) Azure
3 449 (22.33%) GCP
4 133 (6.61%) Power Platform
5 111 (5.52%) Serverless
6 109 (5.42%) SaaS
7 82 (4.08%) Cloud Computing
8 75 (3.73%) Amazon EMR
9 62 (3.08%) PaaS
10 55 (2.73%) AWS Lambda
11 49 (2.44%) Amazon S3
12 48 (2.39%) IaaS
13 43 (2.14%) Amazon Kinesis
14 39 (1.94%) GitHub
15 37 (1.84%) AWS CloudFormation
15 37 (1.84%) IBM Cloud
16 33 (1.64%) Amazon EC2
16 33 (1.64%) Azure Data Factory
17 27 (1.34%) Cloud Functions
18 19 (0.94%) Matillion
Communications & Networking
1 102 (5.07%) Internet
2 57 (2.83%) Firewall
3 22 (1.09%) HTTP
4 17 (0.85%) DNS
5 12 (0.60%) VPN
6 10 (0.50%) SSL
7 8 (0.40%) Unified Communications
7 8 (0.40%) Wireless
8 7 (0.35%) Intrusion Detection
9 6 (0.30%) Ethernet
9 6 (0.30%) IMAP
9 6 (0.30%) MPLS
9 6 (0.30%) SMTP
10 5 (0.25%) FTP
10 5 (0.25%) SAN
10 5 (0.25%) Skype
11 4 (0.20%) Kerberos
11 4 (0.20%) SNMP
11 4 (0.20%) TCP/IP
11 4 (0.20%) WAN
Database & Business Intelligence
1 530 (26.36%) Hadoop
2 316 (15.71%) NoSQL
3 300 (14.92%) Data Warehouse
4 175 (8.70%) Data Lake
5 151 (7.51%) Amazon Redshift
6 146 (7.26%) Apache Hive
7 144 (7.16%) Tableau
8 133 (6.61%) Power BI
9 127 (6.32%) Relational Database
10 119 (5.92%) SQL Server
11 109 (5.42%) PostgreSQL
12 108 (5.37%) MongoDB
13 102 (5.07%) BigQuery
14 90 (4.48%) Apache Cassandra
15 87 (4.33%) MySQL
16 71 (3.53%) SQL Server Integration Services
17 70 (3.48%) HBase
18 69 (3.43%) Data Mining
19 68 (3.38%) Snowflake Schema
20 58 (2.88%) Amazon Athena
Development Applications
1 206 (10.24%) Jenkins
2 144 (7.16%) Git (software)
3 126 (6.27%) JIRA
4 61 (3.03%) Atlassian Bamboo
5 45 (2.24%) Vagrant
6 29 (1.44%) TeamCity
7 28 (1.39%) Bitbucket
7 28 (1.39%) Maven
8 25 (1.24%) GitLab
9 24 (1.19%) Cucumber
10 21 (1.04%) Octopus Deploy
11 20 (0.99%) Team Foundation Server
12 19 (0.94%) SonarQube
13 17 (0.85%) Gradle
13 17 (0.85%) JUnit
13 17 (0.85%) Selenium
14 16 (0.80%) Eclipse
14 16 (0.80%) Sonatype Nexus
15 14 (0.70%) Cypress.io
16 10 (0.50%) IntelliJ
General
1 341 (16.96%) Finance
2 132 (6.56%) Banking
3 91 (4.53%) Legal
4 72 (3.58%) Marketing
5 68 (3.38%) Retail
6 64 (3.18%) Law
7 53 (2.64%) Public Sector
8 50 (2.49%) Telecoms
9 38 (1.89%) Games
10 26 (1.29%) Advertising
10 26 (1.29%) Local Government
11 22 (1.09%) Manufacturing
12 15 (0.75%) Front Office
12 15 (0.75%) Investment Banking
13 13 (0.65%) Aerospace
14 11 (0.55%) Electronics
14 11 (0.55%) Pharmaceutical
15 10 (0.50%) French Language
15 10 (0.50%) Military
16 9 (0.45%) Brand Awareness
Job Titles
1 418 (20.79%) Data Engineer
2 369 (18.35%) Developer
3 235 (11.69%) Architect
4 231 (11.49%) Software Engineer
5 136 (6.76%) Consultant
6 134 (6.66%) Big Data Engineer
7 131 (6.51%) Data Architect
8 114 (5.67%) Java Developer
9 99 (4.92%) Data Scientist
10 96 (4.77%) Analyst
11 93 (4.62%) Senior Developer
12 92 (4.57%) Java Engineer
13 78 (3.88%) AWS Engineer
13 78 (3.88%) Senior Data Engineer
14 74 (3.68%) Solutions Architect
15 62 (3.08%) DevOps Engineer
16 61 (3.03%) Python Engineer
17 56 (2.78%) Platform Engineer
18 55 (2.73%) Java Software Engineer
19 49 (2.44%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 371 (18.45%) Kafka
2 175 (8.70%) Node.js
3 138 (6.86%) .NET
4 119 (5.92%) React
5 114 (5.67%) Web Services
6 101 (5.02%) HTML
7 97 (4.82%) REST
8 93 (4.62%) CSS
9 87 (4.33%) AngularJS
10 82 (4.08%) Spring
11 72 (3.58%) Apache NiFi
12 66 (3.28%) Spark Streaming
13 59 (2.93%) Spring Boot
14 56 (2.78%) Natural Language Processing
15 49 (2.44%) HTML5
16 45 (2.24%) Redux
17 41 (2.04%) JSON
17 41 (2.04%) RESTful
18 40 (1.99%) Velocity
18 40 (1.99%) XML
Miscellaneous
1 151 (7.51%) Analytical Skills
2 106 (5.27%) Algorithms
3 102 (5.07%) User Experience
4 69 (3.43%) Cyberattack
5 61 (3.03%) Data Structures
6 60 (2.98%) Internet of Things
7 58 (2.88%) Cloud Native
8 49 (2.44%) Hedge funds
9 48 (2.39%) Self-Motivation
10 47 (2.34%) Linux Command Line
10 47 (2.34%) Management Information System
11 41 (2.04%) Greenfield Project
12 40 (1.99%) Hybrid Cloud
13 35 (1.74%) Data Centre
14 33 (1.64%) Enterprise Software
15 30 (1.49%) Public Cloud
16 25 (1.24%) Life Science
17 21 (1.04%) Mobile App
17 21 (1.04%) Virtual Team
18 16 (0.80%) Robotics
Operating Systems
1 229 (11.39%) Linux
2 65 (3.23%) Red Hat Enterprise Linux
3 54 (2.69%) CentOS
4 48 (2.39%) Windows
5 40 (1.99%) Unix
6 14 (0.70%) Ubuntu
7 8 (0.40%) Windows Server
8 7 (0.35%) Android
9 6 (0.30%) Windows Server 2008
10 4 (0.20%) Apple iOS
11 3 (0.15%) Fedora
11 3 (0.15%) Oracle Linux
12 2 (0.099%) Debian
12 2 (0.099%) Solaris
12 2 (0.099%) VMS
Processes & Methodologies
1 862 (42.86%) Agile Software Development
2 742 (36.90%) Analytics
3 547 (27.20%) Software Engineering
4 525 (26.11%) Machine Learning
5 518 (25.76%) Data Science
6 511 (25.41%) DevOps
7 489 (24.32%) Artificial Intelligence
8 431 (21.43%) ETL
9 350 (17.40%) Data Engineering
10 343 (17.06%) Microservices
11 331 (16.46%) Business Intelligence
12 276 (13.72%) Scrum
13 260 (12.93%) Open Source
14 252 (12.53%) Data Analytics
15 224 (11.14%) Data Modelling
16 209 (10.39%) Visualisation
17 201 (10.00%) Mathematics
18 185 (9.20%) Computer Science
19 176 (8.75%) Data Architecture
20 173 (8.60%) Mentoring
Programming Languages
1 917 (45.60%) Python
2 672 (33.42%) SQL
3 667 (33.17%) Java
4 262 (13.03%) JavaScript
5 226 (11.24%) C#
6 207 (10.29%) Scala
7 121 (6.02%) C
8 112 (5.57%) C++
9 108 (5.37%) R
10 93 (4.62%) TypeScript
11 81 (4.03%) Bash Shell
12 61 (3.03%) Go
13 57 (2.83%) PHP
14 46 (2.29%) Java 8
14 46 (2.29%) Perl
15 36 (1.79%) T-SQL
16 27 (1.34%) PowerShell
17 24 (1.19%) Shell Script
18 20 (0.99%) PL/SQL
19 19 (0.94%) Kotlin
Qualifications
1 323 (16.06%) Degree
2 161 (8.01%) Security Cleared
3 102 (5.07%) SC Cleared
4 81 (4.03%) DV Cleared
5 80 (3.98%) Computer Science Degree
6 79 (3.93%) Numerate Degree
7 51 (2.54%) PhD
8 25 (1.24%) CISSP
9 18 (0.90%) Master's Degree
10 17 (0.85%) Cisco Certification
10 17 (0.85%) SSCP
11 9 (0.45%) ACCA
11 9 (0.45%) BPSS Clearance
11 9 (0.45%) CCNA
11 9 (0.45%) CIMA
11 9 (0.45%) CISM
12 8 (0.40%) (ISC)2 CCSP
12 8 (0.40%) CompTIA Security+
12 8 (0.40%) Microsoft Certification
12 8 (0.40%) SANS
Quality Assurance & Compliance
1 79 (3.93%) Data Quality
2 68 (3.38%) QA
3 37 (1.84%) GDPR
4 16 (0.80%) ISO/IEC 27001
5 15 (0.75%) NIST
6 14 (0.70%) NCSC
7 9 (0.45%) Cyber Essentials
7 9 (0.45%) GRC
7 9 (0.45%) PCI DSS
8 5 (0.25%) NIST 800
8 5 (0.25%) SLA
9 4 (0.20%) PMO
10 3 (0.15%) GPG13
10 3 (0.15%) WCAG
11 2 (0.099%) Dodd-Frank
11 2 (0.099%) EMIR
11 2 (0.099%) ISO/IEC 15288
11 2 (0.099%) MiFID
11 2 (0.099%) Sarbanes-Oxley
12 1 (0.050%) Actionable Recommendations
System Software
1 440 (21.88%) Docker
2 55 (2.73%) HDFS
3 40 (1.99%) VirtualBox
4 35 (1.74%) VMware Infrastructure
5 25 (1.24%) Apache ZooKeeper
6 18 (0.90%) Active Directory
7 14 (0.70%) Apache Flume
8 11 (0.55%) Virtual Machines
9 6 (0.30%) Oracle RAC
10 4 (0.20%) VMware ESXi
11 3 (0.15%) Firmware
11 3 (0.15%) NFS
12 2 (0.099%) Samba
12 2 (0.099%) Xen
13 1 (0.050%) Ceph
13 1 (0.050%) oVirt
13 1 (0.050%) VMware NSX
13 1 (0.050%) vSphere
Systems Management
1 401 (19.94%) Kubernetes
2 222 (11.04%) Ansible
3 199 (9.90%) Terraform
4 79 (3.93%) Puppet
5 62 (3.08%) Opscode Chef
6 46 (2.29%) Docker Swarm
7 32 (1.59%) Grafana
8 30 (1.49%) Prometheus
9 20 (0.99%) Hadoop YARN
10 19 (0.94%) Nagios
11 16 (0.80%) Oozie
12 14 (0.70%) ZABBIX
13 13 (0.65%) Graphite
13 13 (0.65%) Opsview
14 8 (0.40%) SCCM
15 7 (0.35%) ITRS Geneos
15 7 (0.35%) Kibana
16 6 (0.30%) Data Guard
16 6 (0.30%) Oracle RMAN
16 6 (0.30%) Salt
Vendors
1 256 (12.73%) Google
2 182 (9.05%) Oracle
3 172 (8.55%) Microsoft
4 107 (5.32%) Databricks
5 101 (5.02%) Cloudera
6 98 (4.87%) Informatica
7 89 (4.43%) Talend
8 72 (3.58%) IBM
9 56 (2.78%) Red Hat
10 52 (2.59%) SAP
11 51 (2.54%) VMware
12 47 (2.34%) Hortonworks
13 30 (1.49%) Splunk
14 25 (1.24%) Salesforce.com
14 25 (1.24%) Yahoo!
15 19 (0.94%) Sparx
16 17 (0.85%) Teradata
17 15 (0.75%) Hyperion
18 14 (0.70%) Ab Initio
18 14 (0.70%) Twitter