Big Data Engineer
UK

The median Big Data Engineer salary in the UK is £87,500 per year according to job vacancies posted during the 6 months to 23 April 2024.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

6 months to
23 Apr 2024
Same period 2023 Same period 2022
Rank 498 902 970
Rank change year-on-year +404 +68 -239
Permanent jobs requiring a Big Data Engineer 436 76 245
As % of all permanent jobs advertised in the UK 0.45% 0.072% 0.16%
As % of the Job Titles category 0.47% 0.079% 0.17%
Number of salaries quoted 55 34 108
10th Percentile £70,000 £52,500 £51,250
25th Percentile £72,500 £65,000 £65,000
Median annual salary (50th Percentile) £87,500 £80,294 £77,500
Median % change year-on-year +8.98% +3.60% -3.13%
75th Percentile £118,750 £103,125 £90,000
90th Percentile £143,750 £108,875 £120,000
UK excluding London median annual salary £80,000 £75,876 £65,000
% change year-on-year +5.44% +16.73% -

All Permanent IT Job Vacancies
UK

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

Permanent vacancies in the UK with a recognized job title 92,477 96,786 147,852
% of permanent jobs with a recognized job title 94.63% 91.57% 96.05%
Number of salaries quoted 66,588 60,676 85,408
10th Percentile £28,500 £32,500 £32,500
25th Percentile £38,500 £45,000 £42,500
Median annual salary (50th Percentile) £53,000 £60,000 £60,000
Median % change year-on-year -11.67% - +9.09%
75th Percentile £71,250 £81,250 £78,750
90th Percentile £90,000 £100,000 £96,075
UK excluding London median annual salary £50,000 £52,500 £50,000
% change year-on-year -4.76% +5.00% +5.26%

Big Data Engineer
Job Vacancy Trend

Job postings that featured Big Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data Engineer in the UK

Big Data Engineer
Salary Trend

3-month moving average salary quoted in jobs citing Big Data Engineer.

Salary trend for Big Data Engineer in the UK

Big Data Engineer
Salary Histogram

Salary distribution for jobs citing Big Data Engineer over the 6 months to 23 April 2024.

Salary histogram for Big Data Engineer in the UK

Big Data Engineer
Top 9 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data Engineer within the UK over the 6 months to 23 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London +338 403 £80,000 +5.44% 2
Scotland - 381 - - 1
England +93 55 £87,500 +8.98% 4
London +101 33 £112,500 +40.11% 3
Work from Home +104 32 £112,500 +87.50% 2
South West -2 18 £80,000 -21.38% 1
East of England - 3 £80,000 -
West Midlands +31 1 £72,500 +52.63%
Midlands +21 1 £72,500 +52.63%

Big Data Engineer Skill Set
Top 30 Co-occurring Skills and Capabilities

For the 6 months to 23 April 2024, Big Data Engineer job roles required the following skills and capabilities in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Big Data Engineer in the job title.

1 436 (100.00%) Big Data
2 412 (94.50%) Finance
3 388 (88.99%) Apache Spark
4 382 (87.61%) Agile
4 382 (87.61%) Software Engineering
5 381 (87.39%) Law
5 381 (87.39%) Inclusion and Diversity
6 349 (80.05%) CI/CD
7 339 (77.75%) Operational Stability
7 339 (77.75%) SDLC
8 285 (65.37%) Java
8 285 (65.37%) SQL
9 276 (63.30%) AWS
10 243 (55.73%) NoSQL
11 224 (51.38%) Scala
12 223 (51.15%) Legal
12 223 (51.15%) Risk Management
13 183 (41.97%) Python
14 177 (40.60%) Hadoop
15 171 (39.22%) Community of Practice
16 158 (36.24%) Marketing
17 157 (36.01%) Performance Tuning
18 152 (34.86%) Cloud Native
19 134 (30.73%) Machine Learning
20 133 (30.50%) Artificial Intelligence
21 130 (29.82%) Visualisation
21 130 (29.82%) Continuous Improvement
21 130 (29.82%) Algorithms
22 118 (27.06%) Apache
23 109 (25.00%) Problem-Solving

Big Data Engineer Skill Set
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 388 (88.99%) Apache Spark
2 118 (27.06%) Apache
3 107 (24.54%) Apache Airflow
4 18 (4.13%) Jupyter
4 18 (4.13%) nginx
Cloud Services
1 276 (63.30%) AWS
2 51 (11.70%) Serverless
3 50 (11.47%) Amazon EC2
3 50 (11.47%) Amazon ECS
3 50 (11.47%) Amazon EKS
3 50 (11.47%) Amazon EMR
3 50 (11.47%) Amazon SQS
3 50 (11.47%) AWS Lambda
4 30 (6.88%) dbt
4 30 (6.88%) Snowflake
5 18 (4.13%) Amazon S3
5 18 (4.13%) MinIO
5 18 (4.13%) OpenShift
6 9 (2.06%) Cloud Computing
7 2 (0.46%) Azure
8 1 (0.23%) GCP
Database & Business Intelligence
1 436 (100.00%) Big Data
2 243 (55.73%) NoSQL
3 177 (40.60%) Hadoop
4 50 (11.47%) Electronic Patient Records
5 45 (10.32%) Apache Hive
6 32 (7.34%) Data Lake
7 30 (6.88%) Amazon Athena
7 30 (6.88%) Apache Arrow
7 30 (6.88%) Dremio
7 30 (6.88%) HBase
8 18 (4.13%) Presto
9 16 (3.67%) Impala
10 2 (0.46%) Data Warehouse
11 1 (0.23%) Elasticsearch
Development Applications
1 48 (11.01%) Jenkins
2 29 (6.65%) Bitbucket Server
2 29 (6.65%) Git
3 18 (4.13%) Atlassian Bamboo
General
1 412 (94.50%) Finance
2 381 (87.39%) Inclusion and Diversity
2 381 (87.39%) Law
3 223 (51.15%) Legal
4 158 (36.24%) Marketing
5 106 (24.31%) Influencing Skills
6 1 (0.23%) Social Skills
Libraries, Frameworks & Software Standards
1 77 (17.66%) PySpark
2 42 (9.63%) Spring
2 42 (9.63%) Spring Boot
3 41 (9.40%) Kafka
4 30 (6.88%) gRPC
4 30 (6.88%) Protocol Buffers
5 19 (4.36%) Apache NiFi
5 19 (4.36%) RabbitMQ
6 18 (4.13%) ActiveMQ
6 18 (4.13%) Elastic Stack
6 18 (4.13%) YAML
Miscellaneous
1 152 (34.86%) Cloud Native
2 130 (29.82%) Algorithms
3 42 (9.63%) Legacy Code
4 30 (6.88%) Clustering
4 30 (6.88%) Hedge funds
5 18 (4.13%) Hybrid Cloud
6 16 (3.67%) Public Cloud
7 9 (2.06%) Onboarding
8 4 (0.92%) Distributed Computing
9 2 (0.46%) Greenfield Project
Operating Systems
1 29 (6.65%) Unix
2 21 (4.82%) Linux
Processes & Methodologies
1 382 (87.61%) Agile
1 382 (87.61%) Software Engineering
2 349 (80.05%) CI/CD
3 339 (77.75%) Operational Stability
3 339 (77.75%) SDLC
4 223 (51.15%) Risk Management
5 171 (39.22%) Community of Practice
6 157 (36.01%) Performance Tuning
7 134 (30.73%) Machine Learning
8 133 (30.50%) Artificial Intelligence
9 130 (29.82%) Continuous Improvement
9 130 (29.82%) Visualisation
10 109 (25.00%) Problem-Solving
11 90 (20.64%) Site Reliability Engineering
12 68 (15.60%) Decision-Making
13 56 (12.84%) Technical Leadership
14 50 (11.47%) Tech Ops
15 48 (11.01%) DevOps
16 42 (9.63%) Data Modelling
17 40 (9.17%) Microservices
Programming Languages
1 285 (65.37%) Java
1 285 (65.37%) SQL
2 224 (51.38%) Scala
3 183 (41.97%) Python
4 30 (6.88%) Go
4 30 (6.88%) JavaScript
5 29 (6.65%) PL/SQL
6 18 (4.13%) Bash
6 18 (4.13%) Shell Script
Qualifications
1 19 (4.36%) DV Cleared
1 19 (4.36%) Security Cleared
2 1 (0.23%) Computer Science Degree
2 1 (0.23%) Degree
2 1 (0.23%) SC Cleared
Quality Assurance & Compliance
1 16 (3.67%) SLA
2 1 (0.23%) Data Quality
System Software
1 29 (6.65%) HDFS
2 22 (5.05%) Docker
Systems Management
1 90 (20.64%) Kubernetes
2 77 (17.66%) Terraform
3 48 (11.01%) Prometheus
4 19 (4.36%) Ansible
5 18 (4.13%) Grafana
5 18 (4.13%) HAProxy
Vendors
1 51 (11.70%) Databricks
2 29 (6.65%) Informatica
3 1 (0.23%) Cloudera
3 1 (0.23%) Google