Big Data
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 May 2024
Same period 2023 Same period 2022
Rank 249 135 113
Rank change year-on-year -114 -22 +18
Permanent jobs citing Big Data 1,180 2,560 5,430
As % of all permanent jobs advertised in the UK 1.15% 2.63% 3.25%
As % of the Database & Business Intelligence category 6.44% 12.19% 11.54%
Number of salaries quoted 489 1,006 1,884
10th Percentile £43,750 £51,250 £46,250
25th Percentile £57,500 £62,500 £60,000
Median annual salary (50th Percentile) £80,000 £70,000 £77,500
Median % change year-on-year +14.29% -9.68% +19.23%
75th Percentile £110,000 £92,500 £95,000
90th Percentile £122,500 £110,000 £110,000
UK excluding London median annual salary £63,250 £70,000 £68,500
% change year-on-year -9.64% +2.19% +24.55%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,328 21,007 47,066
As % of all permanent jobs advertised in the UK 17.86% 21.58% 28.19%
Number of salaries quoted 12,523 13,073 21,105
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £77,500 £82,500 £80,000
90th Percentile £97,500 £103,750 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +10.53%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 28 May 2024.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 28 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -86 831 £63,250 -9.64% 121
England -242 601 £80,000 +14.29% 220
Scotland +74 537 £71,788 +2.55% 17
London -127 319 £95,000 +18.32% 117
Work from Home -185 291 £87,500 +25.00% 110
South West -43 108 £80,000 +14.29% 16
North of England -207 64 £55,000 -21.43% 28
North West -141 46 £55,000 -21.43% 18
South East -186 45 £54,500 -22.14% 26
East of England -50 35 £60,000 -7.69% 10
Midlands -121 28 £58,750 -9.62% 17
West Midlands -84 18 £57,500 -4.17% 15
North East -5 11 £42,500 -37.04% 5
Wales -22 11 £46,131 -34.10% 2
East Midlands -49 10 £60,000 -20.00% 2
Yorkshire -120 7 £92,778 +32.54% 5
Northern Ireland +7 3 £115,000 +31.43% 8

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 701 (59.41%) Apache Spark
2 230 (19.49%) Apache
3 178 (15.08%) Apache Airflow
4 42 (3.56%) SAS
5 19 (1.61%) Jupyter
6 18 (1.53%) nginx
7 7 (0.59%) Apache Pig
8 6 (0.51%) Luigi
8 6 (0.51%) OpenStack
9 5 (0.42%) Kinematics
10 3 (0.25%) Confluence
10 3 (0.25%) Exchange Server 2013
10 3 (0.25%) Microsoft Exchange
11 1 (0.085%) Apache Solr
11 1 (0.085%) CMS
Applications
1 33 (2.80%) Microsoft Excel
2 28 (2.37%) Microsoft Office
3 15 (1.27%) SPSS
4 6 (0.51%) Trello
5 5 (0.42%) Microsoft PowerPoint
6 4 (0.34%) MS Visio
7 1 (0.085%) Microsoft Project
7 1 (0.085%) Spreadsheet
Business Applications
1 7 (0.59%) Dynamics CRM
2 6 (0.51%) Payment Gateway
3 5 (0.42%) Sparx Enterprise Architect
4 4 (0.34%) Primavera
4 4 (0.34%) Relativity
5 3 (0.25%) SAP Business One
6 2 (0.17%) Veritas eDiscovery
7 1 (0.085%) NEC Housing
7 1 (0.085%) Ringtail
Cloud Services
1 638 (54.07%) AWS
2 263 (22.29%) Azure
3 153 (12.97%) GCP
4 126 (10.68%) Serverless
5 94 (7.97%) AWS Lambda
6 93 (7.88%) Snowflake
7 90 (7.63%) Power Platform
8 82 (6.95%) Amazon EKS
9 75 (6.36%) Amazon SQS
10 69 (5.85%) dbt
11 68 (5.76%) Amazon EMR
12 67 (5.68%) SaaS
13 53 (4.49%) OpenShift
14 51 (4.32%) Amazon EC2
14 51 (4.32%) Amazon S3
15 50 (4.24%) Amazon ECS
16 46 (3.90%) Azure Synapse Analytics
17 40 (3.39%) Azure Data Factory
18 39 (3.31%) Cloud Computing
19 33 (2.80%) AWS CloudFormation
Communications & Networking
1 28 (2.37%) AMQP
2 20 (1.69%) Firewall
3 19 (1.61%) Wireless
4 17 (1.44%) DSL
5 13 (1.10%) Internet
6 5 (0.42%) Network Security
6 5 (0.42%) RFID
7 4 (0.34%) RS-232
7 4 (0.34%) SD-WAN
8 3 (0.25%) DNS
8 3 (0.25%) Fibre Channel
8 3 (0.25%) iSCSI
8 3 (0.25%) LAN
8 3 (0.25%) MQTT
8 3 (0.25%) SAN
8 3 (0.25%) VoIP
8 3 (0.25%) WAN
8 3 (0.25%) WebEx
9 2 (0.17%) 4G
9 2 (0.17%) Intrusion Detection
Database & Business Intelligence
1 375 (31.78%) NoSQL
2 322 (27.29%) Hadoop
3 191 (16.19%) Data Lake
4 127 (10.76%) Data Warehouse
5 89 (7.54%) Apache Hive
6 79 (6.69%) Power BI
7 70 (5.93%) Amazon Athena
7 70 (5.93%) Tableau
8 63 (5.34%) Dremio
9 62 (5.25%) Apache Arrow
10 59 (5.00%) SQL Server
11 53 (4.49%) Electronic Patient Records
12 50 (4.24%) Relational Database
13 41 (3.47%) Data Mining
13 41 (3.47%) MongoDB
14 39 (3.31%) HBase
15 32 (2.71%) Flink
16 31 (2.63%) Amazon Redshift
17 30 (2.54%) Elasticsearch
18 29 (2.46%) BigQuery
Development Applications
1 101 (8.56%) Git
2 83 (7.03%) Jenkins
3 36 (3.05%) Bitbucket Server
4 17 (1.44%) Atlassian Bamboo
5 16 (1.36%) JIRA
6 9 (0.76%) CircleCI
7 8 (0.68%) JUnit
7 8 (0.68%) Oracle Forms
7 8 (0.68%) SonarQube
8 6 (0.51%) Checkstyle
8 6 (0.51%) GitLab
8 6 (0.51%) Jasmine
8 6 (0.51%) Karma Test Runner
8 6 (0.51%) MLflow
8 6 (0.51%) Visual Studio Code
9 4 (0.34%) Cucumber
9 4 (0.34%) Octopus Deploy
9 4 (0.34%) Spinnaker
9 4 (0.34%) Subversion
9 4 (0.34%) Visual Studio
General
1 660 (55.93%) Finance
2 543 (46.02%) Inclusion and Diversity
3 501 (42.46%) Law
4 278 (23.56%) Marketing
5 251 (21.27%) Legal
6 181 (15.34%) Social Skills
7 162 (13.73%) Influencing Skills
8 113 (9.58%) Banking
9 107 (9.07%) Analytical Skills
10 76 (6.44%) Financial Institution
11 45 (3.81%) Aerospace
12 37 (3.14%) Retail
13 31 (2.63%) Investment Banking
14 30 (2.54%) Presentation Skills
15 18 (1.53%) Private Banking
15 18 (1.53%) Public Sector
16 13 (1.10%) Pharmaceutical
16 13 (1.10%) Retail Banking
17 12 (1.02%) Electronics
17 12 (1.02%) Games
Job Titles
1 476 (40.34%) Software Engineer
2 460 (38.98%) Big Data Engineer
3 382 (32.37%) Big Data Software Engineer
4 346 (29.32%) Data Engineer
5 205 (17.37%) Scala Engineer
5 205 (17.37%) Scala Software Engineer
6 198 (16.78%) AWS Engineer
7 189 (16.02%) Senior
8 188 (15.93%) Lead
9 179 (15.17%) Java Engineer
10 176 (14.92%) Java Software Engineer
11 148 (12.54%) Lead Big Data Engineer
12 146 (12.37%) Lead Software Engineer
13 140 (11.86%) AWS Software Engineer
14 119 (10.08%) Java Scala Software Engineer
15 107 (9.07%) Python Engineer
16 97 (8.22%) Architect
17 96 (8.14%) Lead Java Engineer
18 94 (7.97%) Python Software Engineer
19 66 (5.59%) Developer
Libraries, Frameworks & Software Standards
1 151 (12.80%) Kafka
2 133 (11.27%) PySpark
3 113 (9.58%) Spring
4 104 (8.81%) Spring Boot
5 88 (7.46%) gRPC
6 57 (4.83%) AngularJS
7 54 (4.58%) Protocol Buffers
8 47 (3.98%) RabbitMQ
9 46 (3.90%) React
10 40 (3.39%) Node.js
11 38 (3.22%) REST
12 34 (2.88%) OpenAPI
12 34 (2.88%) Swagger
13 32 (2.71%) .NET
14 28 (2.37%) Material-UI
15 26 (2.20%) Apache Beam
16 25 (2.12%) Apache NiFi
17 20 (1.69%) ActiveMQ
18 19 (1.61%) Elastic Stack
18 19 (1.61%) Pandas
Miscellaneous
1 256 (21.69%) Cloud Native
2 215 (18.22%) Algorithms
3 66 (5.59%) Hedge funds
4 65 (5.51%) Data Structures
5 59 (5.00%) Management Information System
6 55 (4.66%) Clustering
6 55 (4.66%) Product Ownership
7 52 (4.41%) Public Cloud
8 43 (3.64%) Onboarding
9 42 (3.56%) Legacy Code
10 28 (2.37%) Self-Motivation
11 21 (1.78%) Enterprise Software
11 21 (1.78%) IoT
12 20 (1.69%) Distributed Systems
13 19 (1.61%) Greenfield Project
13 19 (1.61%) Hybrid Cloud
14 18 (1.53%) Legacy Systems
15 15 (1.27%) Cyber Defence
15 15 (1.27%) Cybercrime
16 14 (1.19%) Distributed Computing
Operating Systems
1 99 (8.39%) Linux
2 37 (3.14%) Unix
3 30 (2.54%) CentOS
3 30 (2.54%) Debian
3 30 (2.54%) Red Hat Enterprise Linux
3 30 (2.54%) Ubuntu
4 22 (1.86%) Windows
5 13 (1.10%) Windows Server
6 6 (0.51%) Mesosphere
7 4 (0.34%) FreeRTOS
8 3 (0.25%) Windows Server 2012
9 1 (0.085%) Android
9 1 (0.085%) Apple iOS
Processes & Methodologies
1 713 (60.42%) Agile
2 606 (51.36%) Software Engineering
3 537 (45.51%) CI/CD
4 487 (41.27%) SDLC
5 392 (33.22%) Operational Stability
6 355 (30.08%) Machine Learning
7 307 (26.02%) Artificial Intelligence
8 250 (21.19%) Risk Management
9 239 (20.25%) Visualisation
10 232 (19.66%) Performance Tuning
11 229 (19.41%) Analytics
12 228 (19.32%) Problem-Solving
13 225 (19.07%) Community of Practice
14 212 (17.97%) DevOps
15 199 (16.86%) Data Modelling
16 193 (16.36%) Continuous Improvement
17 190 (16.10%) Data Science
18 156 (13.22%) Business Intelligence
19 152 (12.88%) Mentoring
20 142 (12.03%) Decision-Making
Programming Languages
1 655 (55.51%) SQL
2 572 (48.47%) Python
3 565 (47.88%) Java
4 363 (30.76%) Scala
5 120 (10.17%) JavaScript
6 95 (8.05%) Go
7 58 (4.92%) R
8 54 (4.58%) C#
9 53 (4.49%) PL/SQL
10 34 (2.88%) Bash
11 21 (1.78%) T-SQL
12 20 (1.69%) Shell Script
13 16 (1.36%) C
14 12 (1.02%) C++
15 11 (0.93%) Data Analysis Expressions
16 10 (0.85%) TypeScript
17 8 (0.68%) Ruby
18 6 (0.51%) PHP
19 5 (0.42%) XAML
20 4 (0.34%) VB
Qualifications
1 208 (17.63%) Degree
2 100 (8.47%) Security Cleared
3 68 (5.76%) SC Cleared
4 59 (5.00%) DV Cleared
5 57 (4.83%) Computer Science Degree
6 52 (4.41%) Master's Degree
7 18 (1.53%) PhD
8 16 (1.36%) Microsoft Certification
9 14 (1.19%) AWS Certification
9 14 (1.19%) Azure Certification
10 11 (0.93%) DBS Check
11 10 (0.85%) AWS Certified Solutions Architect
12 8 (0.68%) BPSS Clearance
13 6 (0.51%) IIBA
14 5 (0.42%) CCNA
14 5 (0.42%) Cisco Certification
14 5 (0.42%) CISSP
15 4 (0.34%) CIMA
15 4 (0.34%) Network+ Certification
16 3 (0.25%) MBA
Quality Assurance & Compliance
1 63 (5.34%) Data Quality
2 33 (2.80%) SLA
3 27 (2.29%) GDPR
4 26 (2.20%) QA
5 17 (1.44%) Accessibility
6 6 (0.51%) WAI
7 4 (0.34%) ISO/IEC 27001
8 2 (0.17%) SEPA
9 1 (0.085%) PMO
System Software
1 82 (6.95%) Docker
2 53 (4.49%) HDFS
3 7 (0.59%) VMware Infrastructure
4 6 (0.51%) Hyper-V
5 5 (0.42%) Firmware
6 3 (0.25%) Active Directory
6 3 (0.25%) Virtual Machines
6 3 (0.25%) vSphere
7 2 (0.17%) IAG
8 1 (0.085%) Apache Flume
8 1 (0.085%) KVM
8 1 (0.085%) Slurm Workload Manager
8 1 (0.085%) VMware ESXi
Systems Management
1 250 (21.19%) Kubernetes
2 177 (15.00%) Terraform
3 79 (6.69%) Ansible
4 72 (6.10%) Prometheus
5 43 (3.64%) Puppet
6 17 (1.44%) Grafana
6 17 (1.44%) HAProxy
7 8 (0.68%) Progress Chef
8 6 (0.51%) Docker Swarm
9 4 (0.34%) Microsoft Intune
10 3 (0.25%) Perfmon
10 3 (0.25%) Podman
11 2 (0.17%) Argo
11 2 (0.17%) Kibana
11 2 (0.17%) Kubeflow
11 2 (0.17%) Kustomize
12 1 (0.085%) HP ALM
12 1 (0.085%) Nagios
12 1 (0.085%) vCenter Server
12 1 (0.085%) vRealize
Vendors
1 198 (16.78%) Databricks
2 115 (9.75%) Microsoft
3 76 (6.44%) Google
4 38 (3.22%) Informatica
5 32 (2.71%) Oracle
6 28 (2.37%) Red Hat
6 28 (2.37%) SaltStack
7 22 (1.86%) Alteryx
7 22 (1.86%) Cloudera
8 19 (1.61%) Cognos
9 17 (1.44%) Dell
9 17 (1.44%) Sybase
10 13 (1.10%) VMware
11 12 (1.02%) Teradata
12 11 (0.93%) Salesforce
12 11 (0.93%) SAP
13 8 (0.68%) YouTube
14 7 (0.59%) Citrix
14 7 (0.59%) Sparx
15 4 (0.34%) Cisco