Big Data
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 25 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
25 Apr 2024
Same period 2023 Same period 2022
Rank 246 122 113
Rank change year-on-year -124 -9 +18
Permanent jobs citing Big Data 1,185 2,960 4,926
As % of all permanent jobs advertised in the UK 1.21% 2.81% 3.20%
As % of the Database & Business Intelligence category 6.54% 12.98% 11.58%
Number of salaries quoted 474 1,124 1,902
10th Percentile £43,750 £50,000 £46,250
25th Percentile £57,500 £62,500 £60,000
Median annual salary (50th Percentile) £80,000 £70,000 £80,000
Median % change year-on-year +14.29% -12.50% +23.08%
75th Percentile £107,188 £95,000 £95,000
90th Percentile £119,625 £115,000 £110,000
UK excluding London median annual salary £65,000 £70,000 £65,000
% change year-on-year -7.14% +7.69% +18.18%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,123 22,799 42,552
As % of all permanent jobs advertised in the UK 18.46% 21.68% 27.65%
Number of salaries quoted 12,600 14,080 21,369
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £76,250 £83,750 £78,750
90th Percentile £95,000 £103,750 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,000
% change year-on-year -4.55% +5.77% +6.12%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 25 April 2024.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 25 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -106 849 £65,000 -7.14% 138
England -250 575 £80,000 +14.29% 281
Scotland +76 564 £70,576 +0.82% 19
London -149 303 £95,000 +18.32% 167
Work from Home -173 300 £85,000 +21.43% 105
South West -49 106 £80,000 +14.29% 14
North of England -226 66 £55,000 -21.43% 24
North West -160 45 £55,000 -18.52% 16
East of England -56 37 £57,500 -11.54% 20
South East -176 37 £54,500 -22.14% 26
Midlands -144 23 £60,000 -11.11% 27
West Midlands -117 16 £62,500 - 22
North East -3 11 £42,500 -37.04%
Wales -14 10 £44,316 -36.69% 5
Yorkshire -113 10 £87,500 +25.00% 8
East Midlands -52 7 £60,000 -20.00% 5
Northern Ireland +21 6 £115,000 +31.43% 5

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 726 (61.27%) Apache Spark
2 231 (19.49%) Apache
3 154 (13.00%) Apache Airflow
4 43 (3.63%) SAS
5 19 (1.60%) Jupyter
6 17 (1.43%) nginx
7 9 (0.76%) Apache Pig
8 6 (0.51%) OpenStack
9 3 (0.25%) Exchange Server 2013
9 3 (0.25%) Microsoft Exchange
10 2 (0.17%) Confluence
10 2 (0.17%) Kinematics
10 2 (0.17%) Luigi
11 1 (0.084%) CMS
Applications
1 33 (2.78%) Microsoft Excel
2 25 (2.11%) Microsoft Office
3 15 (1.27%) SPSS
4 6 (0.51%) Trello
5 5 (0.42%) Microsoft PowerPoint
6 4 (0.34%) MS Visio
7 1 (0.084%) Microsoft Project
7 1 (0.084%) Spreadsheet
Business Applications
1 7 (0.59%) Dynamics CRM
2 6 (0.51%) Payment Gateway
3 5 (0.42%) Sparx Enterprise Architect
4 4 (0.34%) Primavera
4 4 (0.34%) Relativity
5 3 (0.25%) SAP Business One
6 2 (0.17%) Veritas eDiscovery
7 1 (0.084%) Magento
7 1 (0.084%) Ringtail
Cloud Services
1 623 (52.57%) AWS
2 265 (22.36%) Azure
3 163 (13.76%) GCP
4 127 (10.72%) Serverless
5 94 (7.93%) AWS Lambda
6 92 (7.76%) Power Platform
7 80 (6.75%) Amazon SQS
7 80 (6.75%) SaaS
8 79 (6.67%) Amazon EKS
9 70 (5.91%) Amazon EMR
10 67 (5.65%) Snowflake
11 55 (4.64%) Amazon S3
12 53 (4.47%) Amazon EC2
13 52 (4.39%) Amazon ECS
13 52 (4.39%) OpenShift
14 44 (3.71%) Azure Synapse Analytics
15 40 (3.38%) Cloud Computing
15 40 (3.38%) GitHub
16 39 (3.29%) dbt
17 38 (3.21%) Azure Data Factory
Communications & Networking
1 25 (2.11%) Wireless
2 24 (2.03%) AMQP
3 18 (1.52%) DSL
4 17 (1.43%) Firewall
5 10 (0.84%) Internet
6 5 (0.42%) Network Security
7 4 (0.34%) RS-232
7 4 (0.34%) SD-WAN
8 3 (0.25%) DNS
8 3 (0.25%) Fibre Channel
8 3 (0.25%) iSCSI
8 3 (0.25%) LAN
8 3 (0.25%) MQTT
8 3 (0.25%) SAN
8 3 (0.25%) VoIP
8 3 (0.25%) WAN
8 3 (0.25%) WebEx
9 2 (0.17%) 4G
9 2 (0.17%) Intrusion Detection
9 2 (0.17%) RFID
Database & Business Intelligence
1 400 (33.76%) NoSQL
2 329 (27.76%) Hadoop
3 176 (14.85%) Data Lake
4 125 (10.55%) Data Warehouse
5 96 (8.10%) Apache Hive
6 81 (6.84%) Power BI
7 73 (6.16%) Tableau
8 55 (4.64%) Relational Database
9 53 (4.47%) SQL Server
10 52 (4.39%) Electronic Patient Records
11 42 (3.54%) Data Mining
12 40 (3.38%) Amazon Athena
12 40 (3.38%) HBase
12 40 (3.38%) MongoDB
13 39 (3.29%) BigQuery
14 35 (2.95%) Flink
15 34 (2.87%) Elasticsearch
16 31 (2.62%) Dremio
17 30 (2.53%) Apache Arrow
18 28 (2.36%) Amazon Redshift
Development Applications
1 97 (8.19%) Git
2 93 (7.85%) Jenkins
3 37 (3.12%) Bitbucket Server
4 19 (1.60%) JIRA
5 17 (1.43%) Atlassian Bamboo
6 10 (0.84%) CircleCI
6 10 (0.84%) JUnit
7 9 (0.76%) SonarQube
8 8 (0.68%) Checkstyle
8 8 (0.68%) Oracle Forms
9 6 (0.51%) GitLab
9 6 (0.51%) Jasmine
9 6 (0.51%) Karma Test Runner
9 6 (0.51%) Visual Studio Code
10 5 (0.42%) MLflow
11 4 (0.34%) Maven
11 4 (0.34%) Octopus Deploy
11 4 (0.34%) Subversion
11 4 (0.34%) Visual Studio
12 3 (0.25%) Selenium
General
1 668 (56.37%) Finance
2 566 (47.76%) Inclusion and Diversity
3 514 (43.38%) Law
4 286 (24.14%) Marketing
5 266 (22.45%) Legal
6 181 (15.27%) Social Skills
7 171 (14.43%) Influencing Skills
8 131 (11.05%) Banking
9 111 (9.37%) Analytical Skills
10 79 (6.67%) Financial Institution
11 52 (4.39%) Retail
12 37 (3.12%) Aerospace
13 31 (2.62%) Presentation Skills
14 26 (2.19%) Investment Banking
15 19 (1.60%) Private Banking
16 16 (1.35%) Public Sector
17 15 (1.27%) Games
18 14 (1.18%) Retail Banking
19 10 (0.84%) Korean Language
19 10 (0.84%) Pharmaceutical
Job Titles
1 494 (41.69%) Software Engineer
2 443 (37.38%) Big Data Engineer
3 389 (32.83%) Big Data Software Engineer
4 354 (29.87%) Data Engineer
5 209 (17.64%) Scala Engineer
5 209 (17.64%) Scala Software Engineer
6 199 (16.79%) Lead
7 193 (16.29%) Senior
8 181 (15.27%) Java Engineer
9 178 (15.02%) AWS Engineer
9 178 (15.02%) Java Software Engineer
10 149 (12.57%) Lead Big Data Engineer
11 148 (12.49%) Lead Software Engineer
12 144 (12.15%) AWS Software Engineer
13 119 (10.04%) Java Scala Software Engineer
14 110 (9.28%) Python Engineer
15 108 (9.11%) Architect
16 96 (8.10%) Lead Java Engineer
17 94 (7.93%) Python Software Engineer
18 75 (6.33%) Developer
Libraries, Frameworks & Software Standards
1 185 (15.61%) Kafka
2 132 (11.14%) PySpark
3 120 (10.13%) Spring
4 112 (9.45%) Spring Boot
5 59 (4.98%) gRPC
6 56 (4.73%) AngularJS
7 45 (3.80%) React
8 43 (3.63%) RabbitMQ
9 37 (3.12%) .NET
10 34 (2.87%) Node.js
11 33 (2.78%) REST
12 30 (2.53%) OpenAPI
12 30 (2.53%) Protocol Buffers
12 30 (2.53%) Swagger
13 28 (2.36%) Apache Beam
14 26 (2.19%) Apache NiFi
15 24 (2.03%) Material-UI
16 23 (1.94%) GraphQL
17 21 (1.77%) ActiveMQ
17 21 (1.77%) RESTful
Miscellaneous
1 257 (21.69%) Cloud Native
2 222 (18.73%) Algorithms
3 68 (5.74%) Data Structures
4 61 (5.15%) Management Information System
5 57 (4.81%) Product Ownership
6 56 (4.73%) Public Cloud
7 43 (3.63%) Legacy Code
8 42 (3.54%) Onboarding
9 35 (2.95%) Hedge funds
10 31 (2.62%) Clustering
10 31 (2.62%) Self-Motivation
11 25 (2.11%) Distributed Systems
12 21 (1.77%) Enterprise Software
13 20 (1.69%) IoT
14 19 (1.60%) Greenfield Project
14 19 (1.60%) Legacy Systems
15 18 (1.52%) Hybrid Cloud
15 18 (1.52%) Robotics
16 15 (1.27%) Blockchain
16 15 (1.27%) Cybercrime
Operating Systems
1 96 (8.10%) Linux
2 37 (3.12%) Unix
3 25 (2.11%) CentOS
3 25 (2.11%) Debian
3 25 (2.11%) Red Hat Enterprise Linux
3 25 (2.11%) Ubuntu
4 22 (1.86%) Windows
5 13 (1.10%) Windows Server
6 6 (0.51%) Mesosphere
7 4 (0.34%) Android
7 4 (0.34%) Apple iOS
7 4 (0.34%) FreeRTOS
8 3 (0.25%) Windows Server 2012
Processes & Methodologies
1 734 (61.94%) Agile
2 630 (53.16%) Software Engineering
3 557 (47.00%) CI/CD
4 510 (43.04%) SDLC
5 402 (33.92%) Operational Stability
6 361 (30.46%) Machine Learning
7 315 (26.58%) Artificial Intelligence
8 252 (21.27%) Visualisation
9 249 (21.01%) Risk Management
10 241 (20.34%) Problem-Solving
11 238 (20.08%) Performance Tuning
12 230 (19.41%) Community of Practice
13 218 (18.40%) Analytics
14 200 (16.88%) Continuous Improvement
15 195 (16.46%) Data Modelling
16 191 (16.12%) Data Science
17 185 (15.61%) DevOps
18 166 (14.01%) Business Intelligence
19 159 (13.42%) Mentoring
20 153 (12.91%) Decision-Making
Programming Languages
1 656 (55.36%) SQL
2 568 (47.93%) Java
3 550 (46.41%) Python
4 380 (32.07%) Scala
5 94 (7.93%) JavaScript
6 79 (6.67%) Go
7 56 (4.73%) C#
8 55 (4.64%) PL/SQL
9 54 (4.56%) R
10 45 (3.80%) Bash
11 19 (1.60%) Shell Script
12 18 (1.52%) T-SQL
13 13 (1.10%) C
14 11 (0.93%) Data Analysis Expressions
14 11 (0.93%) TypeScript
15 10 (0.84%) C++
16 8 (0.68%) Ruby
16 8 (0.68%) VB
17 7 (0.59%) Kotlin
17 7 (0.59%) PHP
Qualifications
1 195 (16.46%) Degree
2 91 (7.68%) Security Cleared
3 59 (4.98%) SC Cleared
4 55 (4.64%) DV Cleared
5 49 (4.14%) Computer Science Degree
6 48 (4.05%) Master's Degree
7 16 (1.35%) Microsoft Certification
8 15 (1.27%) AWS Certification
8 15 (1.27%) PhD
9 14 (1.18%) Azure Certification
10 10 (0.84%) AWS Certified Solutions Architect
11 8 (0.68%) BPSS Clearance
12 7 (0.59%) DBS Check
13 6 (0.51%) IIBA
14 5 (0.42%) CCNA
14 5 (0.42%) Cisco Certification
14 5 (0.42%) CISSP
15 4 (0.34%) CIMA
15 4 (0.34%) Network+ Certification
16 3 (0.25%) MBA
Quality Assurance & Compliance
1 46 (3.88%) Data Quality
2 34 (2.87%) SLA
3 24 (2.03%) GDPR
4 22 (1.86%) QA
5 17 (1.43%) Accessibility
6 7 (0.59%) SEPA
7 6 (0.51%) WAI
8 4 (0.34%) ISO/IEC 27001
9 1 (0.084%) GMP
9 1 (0.084%) PMO
System Software
1 99 (8.35%) Docker
2 56 (4.73%) HDFS
3 9 (0.76%) VMware Infrastructure
4 6 (0.51%) Hyper-V
5 3 (0.25%) Active Directory
5 3 (0.25%) Virtual Machines
5 3 (0.25%) vSphere
6 2 (0.17%) Firmware
6 2 (0.17%) IAG
7 1 (0.084%) Apache Flume
7 1 (0.084%) KVM
7 1 (0.084%) Slurm Workload Manager
7 1 (0.084%) VMware ESXi
Systems Management
1 245 (20.68%) Kubernetes
2 158 (13.33%) Terraform
3 71 (5.99%) Ansible
4 49 (4.14%) Prometheus
5 38 (3.21%) Puppet
6 18 (1.52%) Grafana
7 17 (1.43%) HAProxy
8 9 (0.76%) Progress Chef
9 6 (0.51%) Docker Swarm
10 4 (0.34%) Microsoft Intune
11 3 (0.25%) Perfmon
12 2 (0.17%) Argo
12 2 (0.17%) Kibana
12 2 (0.17%) Kubeflow
12 2 (0.17%) Podman
13 1 (0.084%) HP ALM
13 1 (0.084%) Kustomize
13 1 (0.084%) Rancher
13 1 (0.084%) vCenter Server
13 1 (0.084%) vRealize
Vendors
1 199 (16.79%) Databricks
2 113 (9.54%) Microsoft
3 82 (6.92%) Google
4 38 (3.21%) Informatica
5 31 (2.62%) Oracle
6 24 (2.03%) Dell
6 24 (2.03%) Red Hat
6 24 (2.03%) SaltStack
7 22 (1.86%) Alteryx
7 22 (1.86%) Cloudera
8 20 (1.69%) Cognos
9 18 (1.52%) Sybase
9 18 (1.52%) VMware
10 12 (1.01%) Teradata
11 11 (0.93%) Salesforce
11 11 (0.93%) SAP
12 8 (0.68%) Atlassian
12 8 (0.68%) YouTube
13 7 (0.59%) Citrix
14 6 (0.51%) Sparx