Big Data Jobs

Big Data
UK

The table below provides summary statistics for permanent job vacancies requiring Big Data skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Big Data over the 6 months leading up to 25 June 2024, comparing them to the same period in the previous two years.

6 months to
25 Jun 2024
Same period 2023 Same period 2022
Rank 270 135 113
Rank change year-on-year -135 -22 +14
Permanent jobs citing Big Data 1,098 2,415 5,616
As % of all permanent jobs advertised in the UK 1.00% 2.61% 3.25%
As % of the Database & Business Intelligence category 5.92% 12.23% 11.60%
Number of salaries quoted 492 978 1,891
10th Percentile £43,750 £52,500 £46,250
25th Percentile £56,250 £63,750 £61,250
Median annual salary (50th Percentile) £80,000 £70,000 £77,500
Median % change year-on-year +14.29% -9.68% +15.66%
75th Percentile £110,000 £92,500 £95,000
90th Percentile £122,500 £110,000 £110,000
UK excluding London median annual salary £62,500 £70,000 £70,000
% change year-on-year -10.71% - +27.27%

All Database and Business Intelligence Skills
UK

Big Data falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,558 19,753 48,423
As % of all permanent jobs advertised in the UK 16.89% 21.36% 28.03%
Number of salaries quoted 12,633 12,748 20,937
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £77,500 £82,500 £80,000
90th Percentile £98,750 £102,500 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +10.53%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 25 June 2024.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 25 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -116 742 £62,500 -10.71% 69
England -247 609 £80,000 +14.29% 152
Scotland +54 447 £70,576 +0.82% 7
London -134 326 £90,000 +12.09% 98
Work from Home -177 288 £87,500 +25.00% 77
South West -55 107 £80,000 +14.29% 13
North of England -233 63 £55,000 -21.43% 16
North West -158 49 £55,000 -21.43% 10
South East -199 47 £55,000 -21.43% 16
East of England -48 35 £60,000 -9.09% 3
Midlands -151 29 £58,750 -11.65% 13
West Midlands -98 18 £57,500 -11.54% 8
Wales -12 11 £46,131 -34.10% 2
North East -17 11 £42,500 -36.80% 3
East Midlands -63 11 £60,000 -20.00% 5
Northern Ireland +6 3 £115,000 +31.43% 2
Yorkshire -111 3 £55,000 -21.43% 3

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 621 (56.56%) Apache Spark
2 219 (19.95%) Apache
3 179 (16.30%) Apache Airflow
4 40 (3.64%) SAS
5 18 (1.64%) Jupyter
6 17 (1.55%) nginx
7 6 (0.55%) Luigi
7 6 (0.55%) OpenStack
8 5 (0.46%) Apache Pig
8 5 (0.46%) Kinematics
9 3 (0.27%) Confluence
9 3 (0.27%) Exchange Server 2013
9 3 (0.27%) Microsoft Exchange
10 1 (0.091%) Apache Solr
10 1 (0.091%) CMS
Applications
1 32 (2.91%) Microsoft Excel
2 27 (2.46%) Microsoft Office
3 15 (1.37%) SPSS
4 6 (0.55%) Trello
5 5 (0.46%) Microsoft PowerPoint
6 4 (0.36%) MS Visio
7 1 (0.091%) Microsoft Project
7 1 (0.091%) Spreadsheet
Business Applications
1 7 (0.64%) Dynamics CRM
2 6 (0.55%) Payment Gateway
3 5 (0.46%) Sparx Enterprise Architect
4 4 (0.36%) Primavera
4 4 (0.36%) Relativity
5 3 (0.27%) SAP Business One
6 2 (0.18%) Veritas eDiscovery
7 1 (0.091%) NEC Housing
7 1 (0.091%) Ringtail
Cloud Services
1 587 (53.46%) AWS
2 264 (24.04%) Azure
3 141 (12.84%) GCP
4 115 (10.47%) Serverless
5 97 (8.83%) Power Platform
6 95 (8.65%) Snowflake
7 84 (7.65%) AWS Lambda
8 78 (7.10%) dbt
9 75 (6.83%) Amazon EKS
10 61 (5.56%) Amazon SQS
10 61 (5.56%) SaaS
11 56 (5.10%) Amazon EMR
12 53 (4.83%) OpenShift
13 48 (4.37%) Azure Synapse Analytics
14 46 (4.19%) Amazon S3
15 43 (3.92%) Amazon EC2
16 42 (3.83%) Amazon ECS
17 40 (3.64%) Azure Data Factory
18 34 (3.10%) AWS CloudFormation
19 33 (3.01%) Cloud Computing
Communications & Networking
1 29 (2.64%) AMQP
2 20 (1.82%) Firewall
3 15 (1.37%) Wireless
4 13 (1.18%) Internet
5 10 (0.91%) DSL
6 5 (0.46%) Network Security
6 5 (0.46%) RFID
7 4 (0.36%) RS-232
7 4 (0.36%) SD-WAN
8 3 (0.27%) DNS
8 3 (0.27%) Fibre Channel
8 3 (0.27%) iSCSI
8 3 (0.27%) LAN
8 3 (0.27%) MQTT
8 3 (0.27%) SAN
8 3 (0.27%) VoIP
8 3 (0.27%) WAN
8 3 (0.27%) WebEx
9 2 (0.18%) 4G
9 2 (0.18%) Intrusion Detection
Database & Business Intelligence
1 317 (28.87%) NoSQL
2 282 (25.68%) Hadoop
3 186 (16.94%) Data Lake
4 122 (11.11%) Data Warehouse
5 86 (7.83%) Power BI
6 75 (6.83%) Amazon Athena
7 74 (6.74%) Tableau
8 71 (6.47%) Dremio
9 70 (6.38%) Apache Arrow
10 69 (6.28%) Apache Hive
11 58 (5.28%) SQL Server
12 50 (4.55%) Relational Database
13 45 (4.10%) Electronic Patient Records
14 41 (3.73%) Data Mining
15 37 (3.37%) MongoDB
16 35 (3.19%) Amazon Redshift
17 34 (3.10%) HBase
18 31 (2.82%) BigQuery
19 30 (2.73%) PostgreSQL
20 29 (2.64%) Cloudera CDH
Development Applications
1 95 (8.65%) Git
2 77 (7.01%) Jenkins
3 30 (2.73%) Bitbucket Server
4 16 (1.46%) Atlassian Bamboo
4 16 (1.46%) JIRA
5 7 (0.64%) CircleCI
5 7 (0.64%) MLflow
5 7 (0.64%) Oracle Forms
6 6 (0.55%) GitLab
6 6 (0.55%) Jasmine
6 6 (0.55%) JUnit
6 6 (0.55%) Karma Test Runner
6 6 (0.55%) SonarQube
6 6 (0.55%) Visual Studio Code
7 5 (0.46%) Visual Studio
8 4 (0.36%) Checkstyle
8 4 (0.36%) Cucumber
8 4 (0.36%) Octopus Deploy
8 4 (0.36%) Spinnaker
8 4 (0.36%) Subversion
General
1 574 (52.28%) Finance
2 452 (41.17%) Inclusion and Diversity
3 417 (37.98%) Law
4 234 (21.31%) Marketing
5 217 (19.76%) Legal
6 182 (16.58%) Social Skills
7 140 (12.75%) Influencing Skills
8 101 (9.20%) Analytical Skills
9 96 (8.74%) Banking
10 63 (5.74%) Financial Institution
11 46 (4.19%) Aerospace
12 32 (2.91%) Investment Banking
13 29 (2.64%) Presentation Skills
14 28 (2.55%) Retail
15 18 (1.64%) Public Sector
16 16 (1.46%) Front Office
17 14 (1.28%) Electronics
18 13 (1.18%) Pharmaceutical
19 12 (1.09%) Games
20 11 (1.00%) Private Banking
Job Titles
1 409 (37.25%) Software Engineer
2 408 (37.16%) Big Data Engineer
3 331 (30.15%) Big Data Software Engineer
4 313 (28.51%) Data Engineer
5 187 (17.03%) Senior
6 174 (15.85%) AWS Engineer
7 173 (15.76%) Scala Engineer
7 173 (15.76%) Scala Software Engineer
8 169 (15.39%) Lead
9 144 (13.11%) Java Engineer
10 141 (12.84%) Java Software Engineer
11 132 (12.02%) Lead Big Data Engineer
12 130 (11.84%) Lead Software Engineer
13 114 (10.38%) AWS Software Engineer
14 103 (9.38%) Python Engineer
15 99 (9.02%) Java Scala Software Engineer
16 92 (8.38%) Architect
17 91 (8.29%) Python Software Engineer
18 90 (8.20%) Lead Java Engineer
19 61 (5.56%) Big Data Manager
Libraries, Frameworks & Software Standards
1 142 (12.93%) Kafka
2 135 (12.30%) PySpark
3 90 (8.20%) gRPC
4 84 (7.65%) Spring
5 82 (7.47%) Spring Boot
6 54 (4.92%) Protocol Buffers
7 47 (4.28%) RabbitMQ
8 45 (4.10%) AngularJS
9 42 (3.83%) Node.js
9 42 (3.83%) React
10 41 (3.73%) REST
11 35 (3.19%) OpenAPI
11 35 (3.19%) Swagger
12 32 (2.91%) .NET
13 29 (2.64%) Material-UI
14 25 (2.28%) Apache Beam
15 24 (2.19%) Apache NiFi
16 19 (1.73%) ActiveMQ
17 18 (1.64%) CSS
17 18 (1.64%) HTML
Miscellaneous
1 218 (19.85%) Cloud Native
2 176 (16.03%) Algorithms
3 74 (6.74%) Hedge funds
4 55 (5.01%) Clustering
5 53 (4.83%) Product Ownership
6 52 (4.74%) Data Structures
7 44 (4.01%) Management Information System
8 43 (3.92%) Public Cloud
9 37 (3.37%) Onboarding
10 34 (3.10%) Legacy Code
11 26 (2.37%) Self-Motivation
12 22 (2.00%) IoT
13 19 (1.73%) Hybrid Cloud
14 17 (1.55%) Derivative
14 17 (1.55%) Distributed Systems
14 17 (1.55%) Fixed Income
14 17 (1.55%) Greenfield Project
15 16 (1.46%) Equities
15 16 (1.46%) Foreign Exchange (FX)
16 15 (1.37%) Cyber Defence
Operating Systems
1 99 (9.02%) Linux
2 31 (2.82%) CentOS
2 31 (2.82%) Debian
2 31 (2.82%) Red Hat Enterprise Linux
2 31 (2.82%) Ubuntu
2 31 (2.82%) Unix
3 22 (2.00%) Windows
4 13 (1.18%) Windows Server
5 6 (0.55%) Mesosphere
6 4 (0.36%) FreeRTOS
7 3 (0.27%) Windows Server 2012
8 1 (0.091%) Android
8 1 (0.091%) Apple iOS
Processes & Methodologies
1 638 (58.11%) Agile
2 516 (46.99%) Software Engineering
3 466 (42.44%) CI/CD
4 415 (37.80%) SDLC
5 323 (29.42%) Operational Stability
6 295 (26.87%) Machine Learning
7 258 (23.50%) Artificial Intelligence
8 226 (20.58%) Analytics
9 218 (19.85%) DevOps
10 213 (19.40%) Risk Management
11 204 (18.58%) Visualisation
12 201 (18.31%) Problem-Solving
13 195 (17.76%) Performance Tuning
14 193 (17.58%) Data Science
15 183 (16.67%) Community of Practice
16 178 (16.21%) Data Modelling
17 151 (13.75%) Continuous Improvement
18 147 (13.39%) Business Intelligence
19 143 (13.02%) Mentoring
20 135 (12.30%) ETL
Programming Languages
1 592 (53.92%) SQL
2 542 (49.36%) Python
3 478 (43.53%) Java
4 306 (27.87%) Scala
5 115 (10.47%) JavaScript
6 89 (8.11%) Go
7 58 (5.28%) R
8 53 (4.83%) C#
9 40 (3.64%) PL/SQL
10 28 (2.55%) Bash
11 21 (1.91%) T-SQL
12 19 (1.73%) Shell Script
13 16 (1.46%) C
14 12 (1.09%) C++
15 10 (0.91%) Data Analysis Expressions
15 10 (0.91%) TypeScript
16 8 (0.73%) Ruby
17 6 (0.55%) PHP
18 5 (0.46%) Kotlin
18 5 (0.46%) XAML
Qualifications
1 206 (18.76%) Degree
2 105 (9.56%) Security Cleared
3 73 (6.65%) SC Cleared
4 62 (5.65%) Computer Science Degree
5 60 (5.46%) DV Cleared
6 52 (4.74%) Master's Degree
7 18 (1.64%) PhD
8 16 (1.46%) Microsoft Certification
9 14 (1.28%) AWS Certification
9 14 (1.28%) Azure Certification
10 11 (1.00%) DBS Check
11 10 (0.91%) AWS Certified Solutions Architect
12 8 (0.73%) BPSS Clearance
13 6 (0.55%) IIBA
14 5 (0.46%) CCNA
14 5 (0.46%) Cisco Certification
14 5 (0.46%) CISSP
15 4 (0.36%) CIMA
15 4 (0.36%) Network+ Certification
16 3 (0.27%) MBA
Quality Assurance & Compliance
1 63 (5.74%) Data Quality
2 27 (2.46%) GDPR
3 25 (2.28%) QA
4 24 (2.19%) SLA
5 17 (1.55%) Accessibility
6 6 (0.55%) WAI
7 4 (0.36%) ISO/IEC 27001
8 2 (0.18%) SEPA
9 1 (0.091%) PMO
System Software
1 82 (7.47%) Docker
2 44 (4.01%) HDFS
3 7 (0.64%) VMware Infrastructure
4 6 (0.55%) Hyper-V
5 5 (0.46%) Firmware
6 3 (0.27%) Active Directory
6 3 (0.27%) Virtual Machines
6 3 (0.27%) vSphere
7 2 (0.18%) IAG
8 1 (0.091%) Apache Flume
8 1 (0.091%) KVM
8 1 (0.091%) Slurm Workload Manager
8 1 (0.091%) VMware ESXi
Systems Management
1 240 (21.86%) Kubernetes
2 177 (16.12%) Terraform
3 79 (7.19%) Ansible
4 71 (6.47%) Prometheus
5 44 (4.01%) Puppet
6 16 (1.46%) Grafana
6 16 (1.46%) HAProxy
7 8 (0.73%) Progress Chef
8 6 (0.55%) Docker Swarm
9 4 (0.36%) Microsoft Intune
10 3 (0.27%) Perfmon
10 3 (0.27%) Podman
11 2 (0.18%) Argo
11 2 (0.18%) Kibana
11 2 (0.18%) Kubeflow
11 2 (0.18%) Kustomize
12 1 (0.091%) Hadoop YARN
12 1 (0.091%) HP ALM
12 1 (0.091%) vCenter Server
12 1 (0.091%) vRealize
Vendors
1 171 (15.57%) Databricks
2 116 (10.56%) Microsoft
3 73 (6.65%) Google
4 32 (2.91%) Informatica
5 29 (2.64%) Red Hat
5 29 (2.64%) SaltStack
6 24 (2.19%) Oracle
7 15 (1.37%) Alteryx
8 14 (1.28%) Cloudera
9 13 (1.18%) VMware
10 12 (1.09%) Cognos
10 12 (1.09%) Dell
11 11 (1.00%) Salesforce
11 11 (1.00%) SAP
11 11 (1.00%) Teradata
12 10 (0.91%) Sybase
13 8 (0.73%) YouTube
14 7 (0.64%) Citrix
14 7 (0.64%) Sparx
15 4 (0.36%) Cisco