Apache Hadoop
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 28 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 May 2024
Same period 2023 Same period 2022
Rank 468 325 356
Rank change year-on-year -143 +31 -52
Permanent jobs citing Hadoop 498 1,019 1,793
As % of all permanent jobs advertised in the UK 0.49% 1.05% 1.07%
As % of the Database & Business Intelligence category 2.72% 4.85% 3.81%
Number of salaries quoted 153 408 650
10th Percentile - £51,250 £47,500
25th Percentile £42,500 £62,500 £56,250
Median annual salary (50th Percentile) £70,576 £75,000 £72,500
Median % change year-on-year -5.90% +3.45% -
75th Percentile £87,500 £97,500 £95,000
90th Percentile £100,000 £106,250 £110,000
UK excluding London median annual salary £56,250 £68,823 £62,500
% change year-on-year -18.27% +10.12% +0.46%

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,328 21,007 47,066
As % of all permanent jobs advertised in the UK 17.86% 21.58% 28.19%
Number of salaries quoted 12,523 13,073 21,105
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £77,500 £82,500 £80,000
90th Percentile £97,500 £103,750 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +10.53%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 28 May 2024.

Salary histogram for Hadoop in the UK

Hadoop
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 28 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London -8 374 £56,250 -18.27% 46
Scotland +94 254 £70,000 +2.23% 7
England -291 238 £72,500 -3.69% 80
London -163 118 £80,000 -0.37% 41
Work from Home -248 68 £80,000 +6.67% 51
South West -77 47 £80,000 +15.20% 4
South East -23 46 £45,000 -35.71% 12
North of England -32 20 £62,500 -7.41% 15
North West -18 18 £62,500 -10.71% 9
East of England -40 5 £71,250 -32.14% 3
Yorkshire +42 2 £76,250 +16.68% 2
West Midlands +1 1 £72,500 +3.57% 4
Wales 0 1 £77,500 +47.62%
Midlands -35 1 £72,500 +11.54% 4

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 411 (82.53%) Apache Spark
2 168 (33.73%) Apache
3 30 (6.02%) Apache Airflow
4 17 (3.41%) Jupyter
4 17 (3.41%) nginx
5 7 (1.41%) Apache Pig
6 2 (0.40%) Confluence
6 2 (0.40%) OpenStack
6 2 (0.40%) SAS
Applications
1 4 (0.80%) Microsoft Excel
1 4 (0.80%) Spreadsheet
2 2 (0.40%) Abaqus
3 1 (0.20%) Microsoft Office
Cloud Services
1 376 (75.50%) AWS
2 161 (32.33%) Azure
3 116 (23.29%) GCP
4 96 (19.28%) Serverless
5 93 (18.67%) Amazon EKS
6 84 (16.87%) AWS Lambda
7 68 (13.65%) Amazon SQS
8 57 (11.45%) Amazon EMR
9 51 (10.24%) Amazon EC2
10 50 (10.04%) Amazon ECS
11 48 (9.64%) Amazon S3
12 47 (9.44%) OpenShift
13 28 (5.62%) AWS CloudFormation
14 24 (4.82%) SaaS
15 17 (3.41%) Google Docs
15 17 (3.41%) Lucidchart
15 17 (3.41%) MinIO
15 17 (3.41%) Miro
15 17 (3.41%) Slack
16 16 (3.21%) Power Platform
Communications & Networking
1 29 (5.82%) AMQP
2 3 (0.60%) Network Security
3 2 (0.40%) Ethernet
3 2 (0.40%) InfiniBand
4 1 (0.20%) Firewall
4 1 (0.20%) Intrusion Detection
4 1 (0.20%) tcpdump
4 1 (0.20%) Wireshark
Database & Business Intelligence
1 322 (64.66%) Big Data
2 192 (38.55%) NoSQL
3 110 (22.09%) Apache Hive
4 73 (14.66%) HBase
5 50 (10.04%) Electronic Patient Records
6 49 (9.84%) Data Warehouse
7 45 (9.04%) MongoDB
8 44 (8.84%) PostgreSQL
9 40 (8.03%) Data Lake
10 39 (7.83%) Elasticsearch
11 30 (6.02%) Data Mining
12 29 (5.82%) Relational Database
13 28 (5.62%) Cloudera CDH
14 22 (4.42%) SQL Server
15 20 (4.02%) Impala
16 19 (3.82%) BigQuery
16 19 (3.82%) Flink
17 17 (3.41%) Apache Ignite
17 17 (3.41%) Presto
17 17 (3.41%) Scylla
Development Applications
1 83 (16.67%) Jenkins
2 67 (13.45%) Git
3 55 (11.04%) Bitbucket Server
4 17 (3.41%) Atlassian Bamboo
5 8 (1.61%) JUnit
5 8 (1.61%) Oracle Forms
5 8 (1.61%) SonarQube
6 7 (1.41%) CircleCI
7 6 (1.20%) Checkstyle
8 5 (1.00%) MLflow
9 2 (0.40%) Cucumber
9 2 (0.40%) GitLab
9 2 (0.40%) Team Foundation Server
10 1 (0.20%) Artifactory
10 1 (0.20%) ERwin
10 1 (0.20%) JIRA
General
1 262 (52.61%) Inclusion and Diversity
2 259 (52.01%) Finance
3 234 (46.99%) Law
4 213 (42.77%) Legal
5 64 (12.85%) Social Skills
6 49 (9.84%) Analytical Skills
7 34 (6.83%) Marketing
8 32 (6.43%) Banking
9 30 (6.02%) Aerospace
10 17 (3.41%) Retail
11 15 (3.01%) Presentation Skills
12 7 (1.41%) Games
12 7 (1.41%) Retail Banking
13 4 (0.80%) Influencing Skills
13 4 (0.80%) Investment Banking
14 3 (0.60%) Electronics
14 3 (0.60%) Telecoms
15 1 (0.20%) Financial Institution
Job Titles
1 281 (56.43%) Software Engineer
2 176 (35.34%) Big Data Engineer
3 157 (31.53%) Big Data Software Engineer
4 143 (28.71%) Data Engineer
5 140 (28.11%) AWS Engineer
6 137 (27.51%) AWS Software Engineer
7 99 (19.88%) Scala Engineer
7 99 (19.88%) Scala Software Engineer
8 82 (16.47%) Java Engineer
9 81 (16.27%) Java Software Engineer
10 70 (14.06%) Developer
11 62 (12.45%) Senior
12 57 (11.45%) DevOps Engineer
13 55 (11.04%) Database Developer
13 55 (11.04%) Database Engineer
13 55 (11.04%) Developer/Software Engineer
14 40 (8.03%) Python Engineer
15 38 (7.63%) AWS Developer
16 37 (7.43%) AWS Database Engineer
17 33 (6.63%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 125 (25.10%) Kafka
2 93 (18.67%) Spring
3 78 (15.66%) Spring Boot
4 70 (14.06%) Node.js
5 47 (9.44%) RabbitMQ
6 46 (9.24%) React
6 46 (9.24%) REST
7 30 (6.02%) AngularJS
8 29 (5.82%) gRPC
9 28 (5.62%) Material-UI
9 28 (5.62%) OpenAPI
9 28 (5.62%) Swagger
10 23 (4.62%) Apache NiFi
11 20 (4.02%) ActiveMQ
12 19 (3.82%) Elastic Stack
13 18 (3.61%) Apache Beam
14 17 (3.41%) GraphQL
14 17 (3.41%) YAML
15 16 (3.21%) PySpark
16 15 (3.01%) JPA
Miscellaneous
1 191 (38.35%) Algorithms
2 98 (19.68%) Cloud Native
3 42 (8.43%) Legacy Code
4 33 (6.63%) Data Structures
5 18 (3.61%) Hybrid Cloud
6 17 (3.41%) Public Cloud
7 13 (2.61%) Distributed Systems
7 13 (2.61%) Management Information System
8 9 (1.81%) Self-Motivation
9 8 (1.61%) Distributed Applications
9 8 (1.61%) Product Ownership
10 7 (1.41%) Greenfield Project
11 6 (1.20%) Client/Server
11 6 (1.20%) Legacy Systems
11 6 (1.20%) Onboarding
12 5 (1.00%) Blog
13 4 (0.80%) Distributed Computing
13 4 (0.80%) IoT
14 3 (0.60%) Analytical Mindset
15 2 (0.40%) Mobile App
Operating Systems
1 71 (14.26%) Unix
2 58 (11.65%) Linux
3 31 (6.22%) Red Hat Enterprise Linux
4 30 (6.02%) CentOS
4 30 (6.02%) Debian
4 30 (6.02%) Ubuntu
5 2 (0.40%) Android
5 2 (0.40%) Apple iOS
5 2 (0.40%) SUSE
5 2 (0.40%) SUSE Linux Enterprise Server
6 1 (0.20%) Windows
Processes & Methodologies
1 319 (64.06%) Agile
2 313 (62.85%) Software Engineering
3 286 (57.43%) CI/CD
4 228 (45.78%) Risk Management
5 202 (40.56%) SDLC
6 192 (38.55%) Operational Stability
6 192 (38.55%) Visualisation
7 163 (32.73%) Machine Learning
8 156 (31.33%) Continuous Improvement
9 133 (26.71%) Artificial Intelligence
10 114 (22.89%) Microservices
11 103 (20.68%) Decision-Making
12 102 (20.48%) Problem-Solving
13 98 (19.68%) Open Source
14 97 (19.48%) Data Modelling
15 86 (17.27%) DevOps
16 75 (15.06%) Analytics
17 74 (14.86%) Data Engineering
18 72 (14.46%) Data Science
19 68 (13.65%) TDD
Programming Languages
1 363 (72.89%) Java
2 356 (71.49%) SQL
3 297 (59.64%) Python
4 169 (33.94%) Scala
5 55 (11.04%) PL/SQL
6 36 (7.23%) Bash
6 36 (7.23%) JavaScript
7 25 (5.02%) Go
8 24 (4.82%) R
9 21 (4.22%) Shell Script
10 6 (1.20%) C#
11 5 (1.00%) C++
12 4 (0.80%) C
13 2 (0.40%) Perl
14 1 (0.20%) Data Analysis Expressions
14 1 (0.20%) F#
14 1 (0.20%) JCL
14 1 (0.20%) TypeScript
Qualifications
1 96 (19.28%) Security Cleared
2 82 (16.47%) Degree
3 75 (15.06%) SC Cleared
4 56 (11.24%) DV Cleared
5 29 (5.82%) Computer Science Degree
6 19 (3.82%) Master's Degree
7 10 (2.01%) PhD
8 5 (1.00%) Azure Certification
9 4 (0.80%) Numerate Degree
10 3 (0.60%) Microsoft Certification
11 2 (0.40%) DBS Check
12 1 (0.20%) AWS Certification
12 1 (0.20%) AWS Certified Solutions Architect
Quality Assurance & Compliance
1 22 (4.42%) Data Quality
2 16 (3.21%) SLA
3 12 (2.41%) QA
4 4 (0.80%) Solvency II
5 3 (0.60%) Accessibility
6 2 (0.40%) GDPR
7 1 (0.20%) NIST
System Software
1 90 (18.07%) HDFS
2 39 (7.83%) Docker
3 2 (0.40%) IAG
3 2 (0.40%) Lustre
3 2 (0.40%) Slurm Workload Manager
4 1 (0.20%) Apache Flume
Systems Management
1 110 (22.09%) Terraform
2 92 (18.47%) Kubernetes
3 52 (10.44%) Ansible
4 30 (6.02%) Puppet
5 17 (3.41%) Grafana
5 17 (3.41%) HAProxy
5 17 (3.41%) Prometheus
6 5 (1.00%) logstash
7 4 (0.80%) Podman
8 2 (0.40%) Kibana
8 2 (0.40%) Kubeflow
8 2 (0.40%) Kustomize
Vendors
1 97 (19.48%) Databricks
2 88 (17.67%) Cloudera
3 79 (15.86%) Google
4 63 (12.65%) Informatica
5 33 (6.63%) Microsoft
6 30 (6.02%) Red Hat
7 28 (5.62%) SaltStack
8 17 (3.41%) Dell
9 16 (3.21%) Oracle
10 15 (3.01%) Teradata
11 6 (1.20%) Splunk
11 6 (1.20%) YouTube
12 4 (0.80%) IBM
12 4 (0.80%) Intel
13 3 (0.60%) Facebook
14 2 (0.40%) Apple
14 2 (0.40%) Cognos
14 2 (0.40%) EMC
14 2 (0.40%) MicroStrategy
14 2 (0.40%) NetApp