Big Data
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 10 December 2023 with a comparison to the same period in the previous 2 years.

6 months to
10 Dec 2023
Same period 2022 Same period 2021
Rank 257 127 140
Rank change year-on-year -130 +13 -19
Permanent jobs citing Big Data 693 3,383 3,486
As % of all permanent jobs advertised in the UK 1.33% 2.77% 2.74%
As % of the Database & Business Intelligence category 6.18% 11.91% 10.16%
Number of salaries quoted 394 1,449 1,985
10th Percentile £48,250 £48,750 £45,000
25th Percentile £65,000 £60,000 £56,250
Median annual salary (50th Percentile) £79,632 £80,000 £75,000
Median % change year-on-year -0.46% +6.67% +15.38%
75th Percentile £97,447 £97,500 £95,000
90th Percentile £120,000 £115,000 £110,000
UK excluding London median annual salary £70,576 £67,500 £65,000
% change year-on-year +4.56% +3.85% +18.18%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 11,214 28,399 34,324
As % of all permanent jobs advertised in the UK 21.45% 23.23% 27.01%
Number of salaries quoted 8,322 17,485 22,575
10th Percentile £36,750 £36,750 £35,457
25th Percentile £46,875 £46,250 £42,625
Median annual salary (50th Percentile) £60,000 £62,500 £58,500
Median % change year-on-year -4.00% +6.84% +6.36%
75th Percentile £80,000 £82,500 £77,500
90th Percentile £95,000 £100,000 £95,000
UK excluding London median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% +2.04%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 10 December 2023.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 10 December 2023. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -144 540 £79,632 -0.46% 278
UK excluding London -103 388 £70,576 +4.56% 127
Work from Home -30 363 £79,632 -0.46% 154
London -103 260 £92,060 +8.31% 185
South West +12 131 £75,000 +11.11% 7
Scotland +15 119 £70,576 +8.58% 14
North of England -146 47 £72,500 +11.54% 20
South East -10 45 £71,688 -4.42% 47
Midlands -66 25 £60,000 -14.29% 17
North West -93 23 £66,425 +3.79% 13
Yorkshire -80 22 £77,593 +14.95% 5
West Midlands -27 16 £65,000 -10.34% 11
East of England +8 9 £55,000 -26.67% 13
East Midlands -7 9 £60,000 - 6
Wales +7 7 £58,605 -2.33% 7
Northern Ireland +21 5 £100,000 +60.00% 2
North East +27 2 £57,500 -17.86% 2

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 303 (43.72%) Apache Spark
2 113 (16.31%) Apache
3 51 (7.36%) Apache Airflow
4 25 (3.61%) Jupyter
5 10 (1.44%) nginx
5 10 (1.44%) Tomcat
6 8 (1.15%) Jetty
7 7 (1.01%) SAS
8 3 (0.43%) Apache Pig
9 2 (0.29%) JBoss
9 2 (0.29%) Luigi
9 2 (0.29%) WebSphere
10 1 (0.14%) Apache Pulsar
10 1 (0.14%) Apache Solr
10 1 (0.14%) Apache Synapse
10 1 (0.14%) Confluence
10 1 (0.14%) IIS
10 1 (0.14%) OpenStack
Applications
1 7 (1.01%) MS Visio
2 5 (0.72%) Microsoft Excel
3 3 (0.43%) Microsoft Office
4 2 (0.29%) Trello
5 1 (0.14%) Chatbot
5 1 (0.14%) Microsoft Project
Business Applications
1 1 (0.14%) Magento
Cloud Services
1 299 (43.15%) AWS
2 232 (33.48%) Azure
3 180 (25.97%) GCP
4 89 (12.84%) Power Platform
5 70 (10.10%) GitHub
6 66 (9.52%) Amazon S3
7 50 (7.22%) GitHub Actions
8 48 (6.93%) OpenShift
9 47 (6.78%) SaaS
9 47 (6.78%) Vertex AI
10 37 (5.34%) Serverless
11 26 (3.75%) AWS Lambda
11 26 (3.75%) Snowflake
12 25 (3.61%) Azure DevOps
13 22 (3.17%) Amazon EMR
14 21 (3.03%) Amazon SQS
15 20 (2.89%) Cloud Computing
16 19 (2.74%) Azure Data Factory
16 19 (2.74%) Azure Synapse Analytics
17 16 (2.31%) Amazon Kinesis
Communications & Networking
1 30 (4.33%) Wireless
2 12 (1.73%) Firewall
2 12 (1.73%) Internet
3 8 (1.15%) HTTP
4 7 (1.01%) IPv4
4 7 (1.01%) OSPF
4 7 (1.01%) SSH
4 7 (1.01%) VLAN
4 7 (1.01%) VPN
5 6 (0.87%) DSL
5 6 (0.87%) Network Security
5 6 (0.87%) NGFW
6 5 (0.72%) AMQP
6 5 (0.72%) TCP/IP
6 5 (0.72%) WAN
7 4 (0.58%) DNS
7 4 (0.58%) SMTP
8 2 (0.29%) FTP
9 1 (0.14%) LAN
9 1 (0.14%) SAN
Database & Business Intelligence
1 179 (25.83%) Hadoop
2 176 (25.40%) NoSQL
3 167 (24.10%) Data Lake
4 131 (18.90%) Data Warehouse
5 93 (13.42%) Relational Database
6 89 (12.84%) Power BI
7 80 (11.54%) BigQuery
8 76 (10.97%) Apache Hive
9 71 (10.25%) PostgreSQL
10 67 (9.67%) MySQL
10 67 (9.67%) Tableau
11 57 (8.23%) Looker
12 48 (6.93%) Bigtable
13 42 (6.06%) Presto
14 36 (5.19%) Amazon Redshift
15 32 (4.62%) SQL Server
16 31 (4.47%) MongoDB
17 29 (4.18%) Elasticsearch
18 26 (3.75%) Apache Cassandra
19 19 (2.74%) Flink
Development Applications
1 96 (13.85%) Jenkins
2 46 (6.64%) Git
3 15 (2.16%) Atlassian Bamboo
3 15 (2.16%) Maven
4 10 (1.44%) JUnit
5 9 (1.30%) Cucumber
6 8 (1.15%) JIRA
7 6 (0.87%) CircleCI
7 6 (0.87%) ScalaTest
7 6 (0.87%) WebDriver
8 5 (0.72%) Bitbucket Server
8 5 (0.72%) Oracle Forms
8 5 (0.72%) SonarQube
8 5 (0.72%) Visual Website Optimizer
9 4 (0.58%) Bitbucket
9 4 (0.58%) ERwin
9 4 (0.58%) Gradle
9 4 (0.58%) Travis CI
10 3 (0.43%) Checkstyle
10 3 (0.43%) Selenium
General
1 275 (39.68%) Finance
2 165 (23.81%) Inclusion and Diversity
3 120 (17.32%) Banking
4 118 (17.03%) Social Skills
5 85 (12.27%) Law
6 73 (10.53%) Retail
7 63 (9.09%) Marketing
8 60 (8.66%) Analytical Skills
9 54 (7.79%) Legal
10 32 (4.62%) Influencing Skills
11 25 (3.61%) Public Sector
12 14 (2.02%) Financial Institution
13 11 (1.59%) Retail Banking
14 10 (1.44%) Investment Banking
15 9 (1.30%) Presentation Skills
16 8 (1.15%) Advertising
17 7 (1.01%) Publishing
18 6 (0.87%) Front Office
18 6 (0.87%) Games
18 6 (0.87%) Private Banking
Job Titles
1 198 (28.57%) Data Engineer
2 134 (19.34%) Architect
3 99 (14.29%) Lead
3 99 (14.29%) Software Engineer
4 92 (13.28%) Senior
5 72 (10.39%) Data Architect
6 65 (9.38%) Big Data Engineer
6 65 (9.38%) Developer
7 53 (7.65%) Solutions Architect
8 48 (6.93%) Big Data Software Engineer
9 42 (6.06%) Lead Data Engineer
10 41 (5.92%) DevOps Engineer
11 38 (5.48%) Senior Data Engineer
12 35 (5.05%) Data Scientist
13 32 (4.62%) Analyst
13 32 (4.62%) AWS Engineer
13 32 (4.62%) Java Engineer
14 31 (4.47%) Cloud Architect
15 29 (4.18%) Java Software Engineer
16 28 (4.04%) Scala Software Engineer
Libraries, Frameworks & Software Standards
1 167 (24.10%) Kafka
2 69 (9.96%) Spring
3 56 (8.08%) HTML
4 55 (7.94%) Spring Boot
5 39 (5.63%) JSON
6 35 (5.05%) React
7 33 (4.76%) .NET
7 33 (4.76%) Pandas
7 33 (4.76%) PySpark
8 30 (4.33%) XML
9 29 (4.18%) Node.js
10 25 (3.61%) RESTful
11 24 (3.46%) AngularJS
12 23 (3.32%) REST
13 21 (3.03%) PyTorch
13 21 (3.03%) scikit-learn
14 20 (2.89%) CSS
15 19 (2.74%) Apache NiFi
15 19 (2.74%) Web Services
16 18 (2.60%) ActiveMQ
Miscellaneous
1 111 (16.02%) Algorithms
2 63 (9.09%) Public Cloud
3 47 (6.78%) Cloud Native
3 47 (6.78%) Cyberattack
4 41 (5.92%) Hybrid Cloud
5 35 (5.05%) Distributed Systems
6 29 (4.18%) Management Information System
7 26 (3.75%) Data Structures
8 24 (3.46%) Product Ownership
9 23 (3.32%) Blockchain
10 22 (3.17%) Onboarding
10 22 (3.17%) Robotics
11 19 (2.74%) Greenfield Project
11 19 (2.74%) Self-Motivation
12 16 (2.31%) Cyber Defence
13 14 (2.02%) SWIFT Messaging Network
14 13 (1.88%) Enterprise Software
15 11 (1.59%) Distributed Computing
15 11 (1.59%) Hedge funds
16 10 (1.44%) Legacy Systems
Operating Systems
1 87 (12.55%) Linux
2 17 (2.45%) Unix
3 12 (1.73%) CentOS
3 12 (1.73%) Windows
4 11 (1.59%) Red Hat Enterprise Linux
5 7 (1.01%) Android
5 7 (1.01%) Apple iOS
6 6 (0.87%) Debian
6 6 (0.87%) Ubuntu
Processes & Methodologies
1 297 (42.86%) Agile
2 251 (36.22%) Machine Learning
3 234 (33.77%) Analytics
4 227 (32.76%) CI/CD
5 197 (28.43%) Software Engineering
6 195 (28.14%) Artificial Intelligence
7 168 (24.24%) ETL
8 164 (23.67%) Visualisation
9 160 (23.09%) DevOps
10 156 (22.51%) Data Science
11 149 (21.50%) Business Intelligence
12 144 (20.78%) Data Modelling
13 136 (19.62%) Data Pipeline
14 125 (18.04%) Data Engineering
15 122 (17.60%) Computer Science
16 114 (16.45%) Problem-Solving
16 114 (16.45%) SDLC
17 111 (16.02%) Mentoring
18 105 (15.15%) Data Analytics
19 101 (14.57%) Decision-Making
Programming Languages
1 335 (48.34%) Python
2 292 (42.14%) Java
3 258 (37.23%) SQL
4 111 (16.02%) Scala
5 82 (11.83%) JavaScript
6 64 (9.24%) Bash
7 49 (7.07%) R
8 46 (6.64%) Go
9 38 (5.48%) C#
10 27 (3.90%) PowerShell
11 26 (3.75%) C++
12 20 (2.89%) Shell Script
13 18 (2.60%) Ruby
14 13 (1.88%) Perl
15 12 (1.73%) PL/SQL
16 11 (1.59%) TypeScript
17 10 (1.44%) Rust
17 10 (1.44%) VB
18 8 (1.15%) Kotlin
19 6 (0.87%) Kusto Query Language
Qualifications
1 145 (20.92%) Security Cleared
2 139 (20.06%) Degree
3 81 (11.69%) SC Cleared
4 65 (9.38%) Computer Science Degree
5 53 (7.65%) DV Cleared
6 27 (3.90%) Master's Degree
7 14 (2.02%) Numerate Degree
8 9 (1.30%) PhD
9 8 (1.15%) AWS Certification
10 5 (0.72%) Azure Certification
10 5 (0.72%) BPSS Clearance
11 4 (0.58%) DBS Check
11 4 (0.58%) Microsoft Certification
12 2 (0.29%) IIBA
13 1 (0.14%) CCA
13 1 (0.14%) CISM
13 1 (0.14%) CISSP
13 1 (0.14%) ISACA
13 1 (0.14%) PMI Certification
13 1 (0.14%) SANS
Quality Assurance & Compliance
1 59 (8.51%) Data Quality
2 20 (2.89%) QA
3 13 (1.88%) SEPA
4 8 (1.15%) SLA
5 3 (0.43%) GMP
5 3 (0.43%) PMO
6 2 (0.29%) Accessibility
6 2 (0.29%) GDPR
7 1 (0.14%) GRC
System Software
1 119 (17.17%) Docker
2 19 (2.74%) HDFS
3 9 (1.30%) VMware Infrastructure
4 4 (0.58%) Ceph
5 3 (0.43%) Apache ZooKeeper
5 3 (0.43%) KVM
5 3 (0.43%) VMware ESXi
6 2 (0.29%) Apache Flume
7 1 (0.14%) Slurm Workload Manager
Systems Management
1 162 (23.38%) Kubernetes
2 105 (15.15%) Terraform
3 68 (9.81%) Ansible
4 22 (3.17%) Puppet
5 16 (2.31%) Grafana
5 16 (2.31%) Prometheus
6 10 (1.44%) HAProxy
7 7 (1.01%) Oozie
7 7 (1.01%) Progress Chef
8 6 (0.87%) CSIRT
9 3 (0.43%) Kibana
9 3 (0.43%) Nagios
9 3 (0.43%) vCenter Server
9 3 (0.43%) vRealize
10 2 (0.29%) Apache Ranger
10 2 (0.29%) Hadoop YARN
10 2 (0.29%) logstash
11 1 (0.14%) HP ALM
11 1 (0.14%) Kustomize
11 1 (0.14%) Mesos
Vendors
1 117 (16.88%) Databricks
2 102 (14.72%) Google
3 56 (8.08%) Microsoft
4 40 (5.77%) Oracle
5 18 (2.60%) Informatica
5 18 (2.60%) SAP
6 16 (2.31%) VMware
7 14 (2.02%) Talend
8 12 (1.73%) Dell
8 12 (1.73%) IBM
8 12 (1.73%) Salesforce
9 10 (1.44%) Atlassian
9 10 (1.44%) Red Hat
9 10 (1.44%) Splunk
10 9 (1.30%) Cloudera
11 7 (1.01%) Alteryx
11 7 (1.01%) Intel
12 6 (0.87%) Cognos
12 6 (0.87%) Sybase
12 6 (0.87%) Teradata