Apache Hadoop
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 25 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
25 Apr 2024
Same period 2023 Same period 2022
Rank 457 336 357
Rank change year-on-year -121 +21 -55
Permanent jobs citing Hadoop 511 1,086 1,589
As % of all permanent jobs advertised in the UK 0.52% 1.03% 1.03%
As % of the Database & Business Intelligence category 2.82% 4.76% 3.73%
Number of salaries quoted 142 421 693
10th Percentile £42,500 £51,250 £47,739
25th Percentile £53,125 £62,500 £56,250
Median annual salary (50th Percentile) £77,500 £75,554 £73,000
Median % change year-on-year +2.58% +3.50% +4.29%
75th Percentile £92,188 £97,500 £95,000
90th Percentile £107,250 £112,500 £112,500
UK excluding London median annual salary £70,576 £68,823 £61,500
% change year-on-year +2.55% +11.91% +2.50%

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,123 22,799 42,552
As % of all permanent jobs advertised in the UK 18.46% 21.68% 27.65%
Number of salaries quoted 12,600 14,080 21,369
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £76,250 £83,750 £78,750
90th Percentile £95,000 £103,750 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,000
% change year-on-year -4.55% +5.77% +6.12%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 25 April 2024.

Salary histogram for Hadoop in the UK

Hadoop
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 25 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -25 365 £70,576 +2.55% 44
Scotland +84 263 - - 7
England -267 241 £77,500 +2.58% 87
London -144 139 £80,000 -0.37% 51
Work from Home -220 81 £80,000 +6.67% 88
South West -69 47 £80,000 +15.20% 4
South East -32 25 £45,000 -35.71% 10
North of England -43 22 £62,500 -4.36% 10
North West -13 20 £62,500 -9.09% 8
East of England -8 6 £71,250 +29.55% 6
Yorkshire +47 2 £76,250 +16.68%
West Midlands +6 1 £72,500 -7.05% 3
Wales +2 1 £77,500 +47.62% 2
Midlands -28 1 £72,500 +11.54% 4

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 435 (85.13%) Apache Spark
2 169 (33.07%) Apache
3 32 (6.26%) Apache Airflow
4 17 (3.33%) Jupyter
4 17 (3.33%) nginx
5 9 (1.76%) Apache Pig
6 2 (0.39%) OpenStack
7 1 (0.20%) Confluence
7 1 (0.20%) SAS
Applications
1 5 (0.98%) Microsoft Excel
2 4 (0.78%) Spreadsheet
3 2 (0.39%) Abaqus
Cloud Services
1 383 (74.95%) AWS
2 156 (30.53%) Azure
3 134 (26.22%) GCP
4 96 (18.79%) Serverless
5 91 (17.81%) Amazon EKS
6 83 (16.24%) AWS Lambda
7 75 (14.68%) Amazon SQS
8 60 (11.74%) Amazon EMR
9 56 (10.96%) Amazon S3
10 52 (10.18%) Amazon EC2
11 51 (9.98%) Amazon ECS
12 43 (8.41%) OpenShift
13 31 (6.07%) SaaS
14 24 (4.70%) AWS CloudFormation
15 23 (4.50%) Google Docs
15 23 (4.50%) Lucidchart
15 23 (4.50%) Miro
15 23 (4.50%) Slack
16 18 (3.52%) Power Platform
17 17 (3.33%) MinIO
Communications & Networking
1 25 (4.89%) AMQP
2 2 (0.39%) Ethernet
2 2 (0.39%) InfiniBand
3 1 (0.20%) Firewall
3 1 (0.20%) Intrusion Detection
3 1 (0.20%) tcpdump
3 1 (0.20%) Wireshark
Database & Business Intelligence
1 329 (64.38%) Big Data
2 195 (38.16%) NoSQL
3 121 (23.68%) Apache Hive
4 75 (14.68%) HBase
5 59 (11.55%) Elasticsearch
6 57 (11.15%) Data Warehouse
7 51 (9.98%) Electronic Patient Records
8 50 (9.78%) Data Lake
9 42 (8.22%) Data Mining
10 29 (5.68%) Apache Ignite
11 27 (5.28%) Relational Database
12 26 (5.09%) MongoDB
13 24 (4.70%) Cloudera CDH
14 23 (4.50%) BigQuery
14 23 (4.50%) PostgreSQL
14 23 (4.50%) Redis
14 23 (4.50%) Scylla
15 22 (4.31%) Flink
16 21 (4.11%) Impala
16 21 (4.11%) SQL Server
Development Applications
1 84 (16.44%) Jenkins
2 68 (13.31%) Git
3 56 (10.96%) Bitbucket Server
4 17 (3.33%) Atlassian Bamboo
5 10 (1.96%) JUnit
6 9 (1.76%) SonarQube
7 8 (1.57%) Checkstyle
7 8 (1.57%) CircleCI
7 8 (1.57%) Oracle Forms
8 4 (0.78%) MLflow
9 2 (0.39%) Team Foundation Server
10 1 (0.20%) Artifactory
10 1 (0.20%) Cucumber
10 1 (0.20%) ERwin
10 1 (0.20%) GitLab
10 1 (0.20%) JIRA
10 1 (0.20%) Postman
General
1 271 (53.03%) Finance
1 271 (53.03%) Inclusion and Diversity
2 238 (46.58%) Law
3 217 (42.47%) Legal
4 70 (13.70%) Social Skills
5 63 (12.33%) Analytical Skills
6 34 (6.65%) Banking
6 34 (6.65%) Marketing
7 25 (4.89%) Aerospace
8 16 (3.13%) Presentation Skills
9 15 (2.94%) Retail
10 9 (1.76%) Games
11 8 (1.57%) Retail Banking
12 4 (0.78%) Influencing Skills
13 3 (0.59%) Documentation Skills
13 3 (0.59%) Electronics
13 3 (0.59%) Investment Banking
13 3 (0.59%) Telecoms
14 2 (0.39%) Financial Institution
Job Titles
1 286 (55.97%) Software Engineer
2 179 (35.03%) Big Data Engineer
3 160 (31.31%) Big Data Software Engineer
4 151 (29.55%) Data Engineer
5 142 (27.79%) AWS Engineer
6 139 (27.20%) AWS Software Engineer
7 101 (19.77%) Scala Engineer
7 101 (19.77%) Scala Software Engineer
8 84 (16.44%) Java Engineer
9 83 (16.24%) Java Software Engineer
10 76 (14.87%) Senior
11 75 (14.68%) Developer
12 56 (10.96%) Database Developer
12 56 (10.96%) Database Engineer
12 56 (10.96%) Developer/Software Engineer
13 45 (8.81%) Python Engineer
14 39 (7.63%) Senior Data Engineer
15 38 (7.44%) Architect
15 38 (7.44%) AWS Developer
16 37 (7.24%) AWS Database Engineer
Libraries, Frameworks & Software Standards
1 129 (25.24%) Kafka
2 93 (18.20%) Spring
3 77 (15.07%) Spring Boot
4 47 (9.20%) Node.js
5 43 (8.41%) RabbitMQ
5 43 (8.41%) React
6 42 (8.22%) REST
7 27 (5.28%) AngularJS
8 25 (4.89%) gRPC
9 24 (4.70%) Apache NiFi
9 24 (4.70%) Material-UI
9 24 (4.70%) OpenAPI
9 24 (4.70%) Swagger
10 23 (4.50%) GraphQL
11 21 (4.11%) ActiveMQ
11 21 (4.11%) Apache Beam
12 20 (3.91%) Elastic Stack
12 20 (3.91%) PySpark
13 17 (3.33%) YAML
14 16 (3.13%) JPA
Miscellaneous
1 202 (39.53%) Algorithms
2 97 (18.98%) Cloud Native
3 43 (8.41%) Legacy Code
4 42 (8.22%) Data Structures
5 19 (3.72%) Distributed Systems
6 17 (3.33%) Hybrid Cloud
6 17 (3.33%) Public Cloud
7 14 (2.74%) Management Information System
8 12 (2.35%) Self-Motivation
9 9 (1.76%) Distributed Applications
9 9 (1.76%) Product Ownership
10 8 (1.57%) Client/Server
10 8 (1.57%) Greenfield Project
10 8 (1.57%) Onboarding
11 7 (1.37%) Legacy Systems
12 5 (0.98%) Blog
13 4 (0.78%) Distributed Computing
13 4 (0.78%) IoT
14 3 (0.59%) Analytical Mindset
15 2 (0.39%) Beowulf
Operating Systems
1 72 (14.09%) Unix
2 50 (9.78%) Linux
3 26 (5.09%) Red Hat Enterprise Linux
4 25 (4.89%) CentOS
4 25 (4.89%) Debian
4 25 (4.89%) Ubuntu
5 2 (0.39%) Android
5 2 (0.39%) Apple iOS
5 2 (0.39%) SUSE
5 2 (0.39%) SUSE Linux Enterprise Server
6 1 (0.20%) Windows
Processes & Methodologies
1 341 (66.73%) Agile
2 323 (63.21%) Software Engineering
3 293 (57.34%) CI/CD
4 233 (45.60%) Risk Management
5 212 (41.49%) SDLC
6 203 (39.73%) Visualisation
7 196 (38.36%) Operational Stability
8 174 (34.05%) Machine Learning
9 161 (31.51%) Continuous Improvement
10 134 (26.22%) Artificial Intelligence
11 114 (22.31%) Problem-Solving
12 110 (21.53%) Microservices
13 107 (20.94%) Data Modelling
14 106 (20.74%) Decision-Making
15 94 (18.40%) Open Source
16 82 (16.05%) Data Engineering
17 78 (15.26%) Data Science
18 76 (14.87%) Analytics
19 69 (13.50%) DevOps
19 69 (13.50%) TDD
Programming Languages
1 357 (69.86%) Java
2 354 (69.28%) SQL
3 290 (56.75%) Python
4 186 (36.40%) Scala
5 56 (10.96%) PL/SQL
6 43 (8.41%) Bash
7 32 (6.26%) Go
8 28 (5.48%) JavaScript
9 25 (4.89%) R
10 20 (3.91%) Shell Script
11 7 (1.37%) C#
12 6 (1.17%) C++
13 4 (0.78%) C
14 2 (0.39%) F#
14 2 (0.39%) Perl
15 1 (0.20%) Data Analysis Expressions
15 1 (0.20%) JCL
15 1 (0.20%) TypeScript
Qualifications
1 90 (17.61%) Degree
2 71 (13.89%) Security Cleared
3 52 (10.18%) DV Cleared
4 51 (9.98%) SC Cleared
5 25 (4.89%) Computer Science Degree
6 17 (3.33%) Master's Degree
7 9 (1.76%) PhD
8 5 (0.98%) Azure Certification
9 4 (0.78%) Numerate Degree
10 3 (0.59%) Microsoft Certification
11 2 (0.39%) DBS Check
12 1 (0.20%) AWS Certification
12 1 (0.20%) AWS Certified Solutions Architect
12 1 (0.20%) MBA
Quality Assurance & Compliance
1 24 (4.70%) Data Quality
2 17 (3.33%) QA
3 16 (3.13%) SLA
4 4 (0.78%) Solvency II
5 2 (0.39%) Accessibility
5 2 (0.39%) GDPR
6 1 (0.20%) NIST
System Software
1 95 (18.59%) HDFS
2 39 (7.63%) Docker
3 3 (0.59%) Apache Flume
4 2 (0.39%) IAG
4 2 (0.39%) Lustre
4 2 (0.39%) Slurm Workload Manager
Systems Management
1 108 (21.14%) Terraform
2 96 (18.79%) Kubernetes
3 45 (8.81%) Ansible
4 25 (4.89%) Puppet
5 17 (3.33%) Grafana
5 17 (3.33%) HAProxy
5 17 (3.33%) Prometheus
6 5 (0.98%) logstash
7 3 (0.59%) Podman
8 2 (0.39%) Kibana
8 2 (0.39%) Kubeflow
9 1 (0.20%) Control-M
9 1 (0.20%) Kustomize
9 1 (0.20%) Rancher
Vendors
1 104 (20.35%) Databricks
2 98 (19.18%) Google
3 92 (18.00%) Cloudera
4 64 (12.52%) Informatica
5 44 (8.61%) Microsoft
6 26 (5.09%) Red Hat
7 24 (4.70%) Dell
7 24 (4.70%) SaltStack
8 16 (3.13%) Teradata
9 15 (2.94%) Oracle
10 8 (1.57%) YouTube
11 4 (0.78%) IBM
11 4 (0.78%) Intel
11 4 (0.78%) Splunk
12 3 (0.59%) Facebook
13 2 (0.39%) Apple
13 2 (0.39%) Cognos
13 2 (0.39%) EMC
13 2 (0.39%) MicroStrategy
13 2 (0.39%) NetApp