Big Data Jobs

Big Data
UK

The table below provides summary statistics for permanent job vacancies requiring Big Data skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Big Data over the 6 months leading up to 26 July 2024, comparing them to the same period in the previous two years.

6 months to
26 Jul 2024
Same period 2023 Same period 2022
Rank 278 168 122
Rank change year-on-year -110 -46 +3
Permanent jobs citing Big Data 884 1,749 5,581
As % of all permanent jobs advertised in the UK 0.98% 2.17% 3.18%
As % of the Database & Business Intelligence category 6.01% 10.35% 11.52%
Number of salaries quoted 408 888 1,939
10th Percentile £48,900 £52,500 £47,238
25th Percentile £58,750 £63,750 £61,250
Median annual salary (50th Percentile) £80,000 £70,000 £80,000
Median % change year-on-year +14.29% -12.50% +14.29%
75th Percentile £115,000 £91,250 £95,000
90th Percentile £132,500 £110,000 £110,000
UK excluding London median annual salary £62,500 £70,000 £70,000
% change year-on-year -10.71% - +21.74%

All Database and Business Intelligence Skills
UK

Big Data falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 14,713 16,902 48,438
As % of all permanent jobs advertised in the UK 16.28% 20.95% 27.64%
Number of salaries quoted 9,555 11,871 21,175
10th Percentile £36,250 £37,500 £36,250
25th Percentile £44,942 £47,500 £45,000
Median annual salary (50th Percentile) £60,000 £62,500 £60,000
Median % change year-on-year -4.00% +4.17% +9.09%
75th Percentile £82,500 £81,250 £80,000
90th Percentile £110,000 £100,000 £96,250
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +8.25%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 26 July 2024.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 26 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -111 582 £62,500 -10.71% 59
England -195 547 £85,000 +21.43% 80
Scotland +46 303 £75,000 +7.14% 5
London -84 275 £105,000 +30.77% 39
Work from Home -138 230 £87,500 +25.00% 55
South West -27 97 £80,000 +14.29% 14
South East -116 63 £54,500 -22.14% 18
North of England -183 62 £56,509 -19.27% 7
North West -134 50 £58,254 -16.78% 2
Midlands -110 32 £62,500 -3.85% 8
West Midlands -73 22 £62,500 -3.85% 7
East of England -33 17 £80,000 +22.14% 1
East Midlands -50 10 £52,000 -30.67% 1
North East -13 9 £42,500 -36.80% 3
Wales -2 8 £65,766 -6.05% 1
Yorkshire -56 3 £55,000 -21.43% 2

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 450 (50.90%) Apache Spark
2 186 (21.04%) Apache
3 157 (17.76%) Apache Airflow
4 19 (2.15%) nginx
5 18 (2.04%) Jupyter
6 16 (1.81%) SAS
7 7 (0.79%) Kinematics
8 5 (0.57%) Luigi
9 4 (0.45%) Apache Pig
9 4 (0.45%) Confluence
10 3 (0.34%) Apache Solr
11 2 (0.23%) OpenStack
12 1 (0.11%) CMS
Applications
1 31 (3.51%) Microsoft Excel
2 22 (2.49%) Microsoft Office
3 9 (1.02%) MS Visio
4 7 (0.79%) SPSS
5 6 (0.68%) Trello
6 5 (0.57%) Microsoft PowerPoint
7 1 (0.11%) Microsoft Project
7 1 (0.11%) Spreadsheet
Business Applications
1 5 (0.57%) Sparx Enterprise Architect
2 3 (0.34%) Relativity
3 2 (0.23%) NEC Housing
3 2 (0.23%) Primavera
3 2 (0.23%) Veritas eDiscovery
4 1 (0.11%) SAP Business One
Cloud Services
1 494 (55.88%) AWS
2 219 (24.77%) Azure
3 128 (14.48%) GCP
4 105 (11.88%) Power Platform
5 94 (10.63%) Snowflake
6 92 (10.41%) dbt
7 91 (10.29%) Serverless
8 70 (7.92%) AWS Lambda
9 62 (7.01%) Amazon EKS
10 52 (5.88%) OpenShift
11 41 (4.64%) Amazon S3
12 40 (4.52%) Amazon SQS
12 40 (4.52%) Azure Synapse Analytics
13 37 (4.19%) SaaS
14 36 (4.07%) Amazon EMR
15 35 (3.96%) Cloud Computing
16 32 (3.62%) AWS CloudFormation
17 30 (3.39%) Amazon EC2
18 29 (3.28%) Amazon ECS
19 27 (3.05%) Azure Data Factory
Communications & Networking
1 29 (3.28%) AMQP
2 16 (1.81%) Firewall
3 12 (1.36%) Internet
4 7 (0.79%) RFID
5 4 (0.45%) Modbus
5 4 (0.45%) SNMP
5 4 (0.45%) Wireless
6 3 (0.34%) SD-WAN
7 2 (0.23%) 4G
7 2 (0.23%) Intrusion Detection
7 2 (0.23%) Network Security
7 2 (0.23%) RS-232
8 1 (0.11%) MQTT
Database & Business Intelligence
1 237 (26.81%) NoSQL
2 209 (23.64%) Hadoop
3 152 (17.19%) Data Lake
4 93 (10.52%) Data Warehouse
5 92 (10.41%) Power BI
6 82 (9.28%) Apache Arrow
6 82 (9.28%) Dremio
7 76 (8.60%) Tableau
8 75 (8.48%) Amazon Athena
9 57 (6.45%) Apache Hive
10 45 (5.09%) Relational Database
11 38 (4.30%) Data Mining
12 36 (4.07%) Amazon Redshift
13 34 (3.85%) HBase
14 33 (3.73%) PostgreSQL
15 32 (3.62%) Electronic Patient Records
16 30 (3.39%) BigQuery
17 29 (3.28%) Cloudera CDH
18 28 (3.17%) MongoDB
19 27 (3.05%) SQL Server
Development Applications
1 79 (8.94%) Git
2 78 (8.82%) Jenkins
3 30 (3.39%) Bitbucket Server
4 16 (1.81%) Atlassian Bamboo
5 15 (1.70%) JIRA
6 11 (1.24%) GitLab
7 9 (1.02%) MLflow
8 6 (0.68%) Visual Studio
9 5 (0.57%) Cucumber
9 5 (0.57%) JUnit
9 5 (0.57%) SonarQube
10 4 (0.45%) CircleCI
10 4 (0.45%) Octopus Deploy
11 3 (0.34%) Gatling
11 3 (0.34%) Selenium
11 3 (0.34%) Spinnaker
11 3 (0.34%) SQL Server Management Studio (SSMS)
12 2 (0.23%) Checkstyle
12 2 (0.23%) Rational DOORS
12 2 (0.23%) Subversion
General
1 446 (50.45%) Finance
2 312 (35.29%) Inclusion and Diversity
3 285 (32.24%) Law
4 195 (22.06%) Social Skills
5 155 (17.53%) Marketing
6 149 (16.86%) Legal
7 93 (10.52%) Influencing Skills
8 91 (10.29%) Analytical Skills
9 71 (8.03%) Banking
10 46 (5.20%) Aerospace
11 38 (4.30%) Financial Institution
12 34 (3.85%) Investment Banking
13 29 (3.28%) Front Office
14 28 (3.17%) Presentation Skills
15 18 (2.04%) Pharmaceutical
16 17 (1.92%) Retail
17 13 (1.47%) Electronics
17 13 (1.47%) Public Sector
18 4 (0.45%) Korean Language
18 4 (0.45%) Telecoms
Job Titles
1 319 (36.09%) Big Data Engineer
2 296 (33.48%) Software Engineer
3 242 (27.38%) Big Data Software Engineer
4 222 (25.11%) Data Engineer
5 167 (18.89%) Senior
6 148 (16.74%) AWS Engineer
7 129 (14.59%) Lead
8 116 (13.12%) Scala Engineer
8 116 (13.12%) Scala Software Engineer
9 97 (10.97%) Lead Big Data Engineer
10 95 (10.75%) Lead Software Engineer
11 88 (9.95%) Java Engineer
12 86 (9.73%) AWS Software Engineer
13 85 (9.62%) Architect
13 85 (9.62%) Java Software Engineer
14 82 (9.28%) Python Engineer
15 73 (8.26%) Python Software Engineer
16 61 (6.90%) Java Scala Software Engineer
16 61 (6.90%) Lead Java Engineer
17 60 (6.79%) Analyst
Libraries, Frameworks & Software Standards
1 102 (11.54%) PySpark
2 96 (10.86%) Kafka
3 90 (10.18%) gRPC
4 58 (6.56%) Spring
4 58 (6.56%) Spring Boot
5 54 (6.11%) Protocol Buffers
6 45 (5.09%) Node.js
6 45 (5.09%) RabbitMQ
7 42 (4.75%) React
8 35 (3.96%) REST
9 32 (3.62%) AngularJS
10 29 (3.28%) Material-UI
10 29 (3.28%) OpenAPI
10 29 (3.28%) Swagger
11 21 (2.38%) Pandas
12 18 (2.04%) .NET
12 18 (2.04%) Apache NiFi
13 17 (1.92%) ActiveMQ
13 17 (1.92%) Apache Beam
13 17 (1.92%) Elastic Stack
Miscellaneous
1 149 (16.86%) Cloud Native
2 133 (15.05%) Algorithms
3 85 (9.62%) Hedge funds
4 55 (6.22%) Clustering
5 43 (4.86%) Product Ownership
6 35 (3.96%) Onboarding
7 31 (3.51%) Data Structures
8 30 (3.39%) Fixed Income
9 29 (3.28%) Derivative
9 29 (3.28%) Equities
10 28 (3.17%) Foreign Exchange (FX)
11 22 (2.49%) Legacy Systems
12 21 (2.38%) IoT
12 21 (2.38%) Legacy Code
12 21 (2.38%) Public Cloud
13 20 (2.26%) Distributed Systems
13 20 (2.26%) Management Information System
14 18 (2.04%) Hybrid Cloud
15 16 (1.81%) Self-Motivation
16 15 (1.70%) Data Centre
Operating Systems
1 96 (10.86%) Linux
2 35 (3.96%) CentOS
2 35 (3.96%) Red Hat Enterprise Linux
3 32 (3.62%) Unix
4 31 (3.51%) Debian
4 31 (3.51%) Ubuntu
5 19 (2.15%) Windows
6 10 (1.13%) Windows Server
7 2 (0.23%) FreeRTOS
7 2 (0.23%) Mesosphere
8 1 (0.11%) Android
8 1 (0.11%) Apple iOS
Processes & Methodologies
1 486 (54.98%) Agile
2 361 (40.84%) Software Engineering
3 351 (39.71%) CI/CD
4 299 (33.82%) SDLC
5 236 (26.70%) Machine Learning
6 222 (25.11%) Operational Stability
7 221 (25.00%) Analytics
8 216 (24.43%) DevOps
9 203 (22.96%) Artificial Intelligence
10 170 (19.23%) Problem-Solving
10 170 (19.23%) Visualisation
11 161 (18.21%) Risk Management
12 139 (15.72%) Data Science
13 135 (15.27%) Data Modelling
14 130 (14.71%) Community of Practice
15 128 (14.48%) Performance Tuning
16 122 (13.80%) Continuous Improvement
17 115 (13.01%) Data Engineering
18 114 (12.90%) ETL
19 104 (11.76%) Mentoring
Programming Languages
1 456 (51.58%) Python
2 452 (51.13%) SQL
3 341 (38.57%) Java
4 197 (22.29%) Scala
5 110 (12.44%) JavaScript
6 73 (8.26%) Go
7 43 (4.86%) R
8 34 (3.85%) C#
9 30 (3.39%) PL/SQL
10 25 (2.83%) Bash
11 24 (2.71%) Shell Script
12 18 (2.04%) C++
13 17 (1.92%) T-SQL
14 12 (1.36%) C
15 7 (0.79%) XAML
16 6 (0.68%) Ruby
16 6 (0.68%) TypeScript
17 5 (0.57%) PHP
17 5 (0.57%) PowerShell
18 4 (0.45%) Perl
Qualifications
1 184 (20.81%) Degree
2 105 (11.88%) Security Cleared
3 73 (8.26%) SC Cleared
4 65 (7.35%) Master's Degree
5 64 (7.24%) Computer Science Degree
6 59 (6.67%) DV Cleared
7 18 (2.04%) AWS Certification
7 18 (2.04%) PhD
8 12 (1.36%) Azure Certification
9 11 (1.24%) DBS Check
10 8 (0.90%) CTC Cleared
11 7 (0.79%) PMI Certification
12 6 (0.68%) AWS Certified Solutions Architect
12 6 (0.68%) BPSS Clearance
12 6 (0.68%) IIBA
12 6 (0.68%) Microsoft Certification
13 5 (0.57%) MBA
14 4 (0.45%) CISSP
15 3 (0.34%) CCNA
15 3 (0.34%) Cisco Certification
Quality Assurance & Compliance
1 71 (8.03%) Data Quality
2 27 (3.05%) QA
3 16 (1.81%) GDPR
4 14 (1.58%) SLA
5 4 (0.45%) Accessibility
5 4 (0.45%) ISO/IEC 27001
6 2 (0.23%) SEPA
7 1 (0.11%) PMO
System Software
1 66 (7.47%) Docker
2 37 (4.19%) HDFS
3 7 (0.79%) Firmware
4 4 (0.45%) VMware Infrastructure
5 2 (0.23%) Hyper-V
5 2 (0.23%) IAG
6 1 (0.11%) Apache Flume
6 1 (0.11%) KVM
6 1 (0.11%) Virtual Machines
6 1 (0.11%) VMware ESXi
Systems Management
1 191 (21.61%) Kubernetes
2 186 (21.04%) Terraform
3 74 (8.37%) Prometheus
4 73 (8.26%) Ansible
5 40 (4.52%) Puppet
6 24 (2.71%) Grafana
7 16 (1.81%) HAProxy
8 5 (0.57%) Nagios
9 4 (0.45%) Cacti
9 4 (0.45%) Progress Chef
10 3 (0.34%) Microsoft Intune
10 3 (0.34%) Perfmon
10 3 (0.34%) Podman
11 2 (0.23%) Argo
11 2 (0.23%) Docker Swarm
11 2 (0.23%) Kibana
11 2 (0.23%) Kubeflow
11 2 (0.23%) Kustomize
12 1 (0.11%) Hadoop YARN
12 1 (0.11%) logstash
Vendors
1 135 (15.27%) Databricks
2 84 (9.50%) Microsoft
3 67 (7.58%) Google
4 33 (3.73%) Informatica
5 29 (3.28%) Red Hat
5 29 (3.28%) SaltStack
6 13 (1.47%) SAP
7 9 (1.02%) MuleSoft
8 8 (0.90%) Sparx
9 7 (0.79%) Citrix
9 7 (0.79%) Cloudera
9 7 (0.79%) Oracle
10 6 (0.68%) Alteryx
10 6 (0.68%) VMware
11 5 (0.57%) Salesforce
11 5 (0.57%) Sony
11 5 (0.57%) webMethods
12 4 (0.45%) Dell
12 4 (0.45%) Teradata
13 3 (0.34%) CA