Apache Hadoop
UK

The table below provides summary statistics for permanent job vacancies requiring Hadoop skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Hadoop over the 6 months leading up to 26 July 2024, comparing them to the same period in the previous two years.

6 months to
26 Jul 2024
Same period 2023 Same period 2022
Rank 537 466 365
Rank change year-on-year -71 -101 -58
Permanent jobs citing Hadoop 330 508 1,787
As % of all permanent jobs advertised in the UK 0.37% 0.63% 1.02%
As % of the Database & Business Intelligence category 2.24% 3.01% 3.69%
Number of salaries quoted 129 387 642
10th Percentile - £55,000 £48,750
25th Percentile £42,500 £63,631 £57,500
Median annual salary (50th Percentile) £62,500 £75,000 £77,500
Median % change year-on-year -16.67% -3.23% +3.33%
75th Percentile £85,000 £96,250 £99,232
90th Percentile £91,750 £105,000 £111,250
UK excluding London median annual salary £53,750 £70,000 £63,750
% change year-on-year -23.21% +9.80% +6.25%

All Database and Business Intelligence Skills
UK

Hadoop falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 14,713 16,902 48,438
As % of all permanent jobs advertised in the UK 16.28% 20.95% 27.64%
Number of salaries quoted 9,555 11,871 21,175
10th Percentile £36,250 £37,500 £36,250
25th Percentile £44,942 £47,500 £45,000
Median annual salary (50th Percentile) £60,000 £62,500 £60,000
Median % change year-on-year -4.00% +4.17% +9.09%
75th Percentile £82,500 £81,250 £80,000
90th Percentile £110,000 £100,000 £96,250
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +8.25%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 26 July 2024.

Salary histogram for Hadoop in the UK

Hadoop
Top 13 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 26 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London +54 267 £53,750 -23.21% 24
England -164 190 £57,500 -23.89% 22
Scotland +62 136 £80,000 +15.20% 5
South East +46 66 £45,000 -35.71% 4
London -111 58 £80,000 -5.88% 10
Work from Home -139 40 £77,500 +3.33% 22
South West -36 38 £80,000 +15.20% 5
North of England -12 21 £62,500 -11.94% 3
North West -12 18 £62,500 -17.28% 1
East of England -1 5 £92,500 -11.90% 2
Yorkshire +42 3 £76,250 +9.80% 1
West Midlands -9 1 £72,500 +3.57%
Midlands -32 1 £72,500 +3.57% 1

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 236 (71.52%) Apache Spark
2 109 (33.03%) Apache
3 16 (4.85%) Jupyter
3 16 (4.85%) nginx
4 13 (3.94%) Apache Airflow
5 4 (1.21%) Apache Pig
6 2 (0.61%) Confluence
6 2 (0.61%) OpenStack
6 2 (0.61%) SAS
Applications
1 3 (0.91%) Microsoft Excel
2 2 (0.61%) Abaqus
2 2 (0.61%) Microsoft Office
Cloud Services
1 245 (74.24%) AWS
2 131 (39.70%) Azure
3 76 (23.03%) GCP
4 69 (20.91%) Serverless
5 62 (18.79%) AWS Lambda
6 59 (17.88%) Amazon EKS
7 46 (13.94%) OpenShift
8 33 (10.00%) Amazon EMR
8 33 (10.00%) Amazon SQS
9 31 (9.39%) Amazon EC2
10 29 (8.79%) Amazon ECS
10 29 (8.79%) AWS CloudFormation
11 26 (7.88%) Amazon S3
12 16 (4.85%) MinIO
13 8 (2.42%) Power Platform
14 6 (1.82%) Azure Data Factory
14 6 (1.82%) SaaS
14 6 (1.82%) Snowflake
15 5 (1.52%) Azure DevOps
16 4 (1.21%) Slack
Communications & Networking
1 30 (9.09%) AMQP
2 9 (2.73%) Network Security
3 2 (0.61%) Ethernet
3 2 (0.61%) InfiniBand
Database & Business Intelligence
1 209 (63.33%) Big Data
2 115 (34.85%) NoSQL
3 61 (18.48%) MongoDB
3 61 (18.48%) PostgreSQL
4 59 (17.88%) Apache Hive
5 34 (10.30%) HBase
6 29 (8.79%) Cloudera CDH
6 29 (8.79%) Electronic Patient Records
7 23 (6.97%) Data Warehouse
8 22 (6.67%) Relational Database
9 18 (5.45%) Data Lake
9 18 (5.45%) Impala
10 16 (4.85%) Presto
11 11 (3.33%) BigQuery
12 10 (3.03%) Data Mining
13 9 (2.73%) Elasticsearch
13 9 (2.73%) SQL Server
14 8 (2.42%) Power BI
14 8 (2.42%) Tableau
15 7 (2.12%) Flink
Development Applications
1 51 (15.45%) Jenkins
2 39 (11.82%) Git
3 30 (9.09%) Bitbucket Server
4 16 (4.85%) Atlassian Bamboo
5 6 (1.82%) MLflow
6 5 (1.52%) JUnit
6 5 (1.52%) SonarQube
7 4 (1.21%) GitLab
8 3 (0.91%) Cucumber
9 2 (0.61%) Checkstyle
9 2 (0.61%) CircleCI
9 2 (0.61%) Oracle Forms
9 2 (0.61%) Team Foundation Server
10 1 (0.30%) Artifactory
10 1 (0.30%) ERwin
10 1 (0.30%) JIRA
10 1 (0.30%) JMeter
10 1 (0.30%) Subversion
10 1 (0.30%) TestCafe
10 1 (0.30%) Zephyr
General
1 142 (43.03%) Inclusion and Diversity
2 137 (41.52%) Finance
3 131 (39.70%) Law
4 124 (37.58%) Legal
5 47 (14.24%) Social Skills
6 31 (9.39%) Aerospace
7 21 (6.36%) Analytical Skills
8 19 (5.76%) Banking
9 10 (3.03%) Retail
10 5 (1.52%) Presentation Skills
11 4 (1.21%) Investment Banking
11 4 (1.21%) Marketing
12 3 (0.91%) Games
13 2 (0.61%) Back Office
13 2 (0.61%) Retail Banking
13 2 (0.61%) Telecoms
14 1 (0.30%) Advertising
14 1 (0.30%) Electronics
14 1 (0.30%) Financial Institution
14 1 (0.30%) Front Office
Job Titles
1 167 (50.61%) Software Engineer
2 107 (32.42%) Big Data Engineer
3 94 (28.48%) Data Engineer
4 90 (27.27%) AWS Engineer
4 90 (27.27%) Big Data Software Engineer
5 86 (26.06%) AWS Software Engineer
6 73 (22.12%) DevOps Engineer
7 55 (16.67%) Scala Engineer
7 55 (16.67%) Scala Software Engineer
8 38 (11.52%) Developer
9 31 (9.39%) AWS Developer
10 30 (9.09%) AWS Database Engineer
10 30 (9.09%) Database Developer
10 30 (9.09%) Database Engineer
10 30 (9.09%) Developer/Software Engineer
11 29 (8.79%) DV Cleared Software Engineer
12 23 (6.97%) Java Engineer
13 22 (6.67%) Java Software Engineer
13 22 (6.67%) Senior
14 21 (6.36%) Architect
Libraries, Frameworks & Software Standards
1 98 (29.70%) Kafka
2 88 (26.67%) Node.js
3 53 (16.06%) Spring
3 53 (16.06%) Spring Boot
4 45 (13.64%) RabbitMQ
5 34 (10.30%) React
6 33 (10.00%) REST
7 30 (9.09%) AngularJS
8 29 (8.79%) gRPC
8 29 (8.79%) Material-UI
8 29 (8.79%) OpenAPI
8 29 (8.79%) Swagger
9 17 (5.15%) ActiveMQ
9 17 (5.15%) Apache NiFi
10 16 (4.85%) Elastic Stack
10 16 (4.85%) YAML
11 11 (3.33%) CSS
11 11 (3.33%) HTML
12 10 (3.03%) PySpark
13 9 (2.73%) PyTorch
Miscellaneous
1 100 (30.30%) Algorithms
2 70 (21.21%) Cloud Native
3 21 (6.36%) Legacy Code
4 18 (5.45%) Hybrid Cloud
5 16 (4.85%) Public Cloud
6 11 (3.33%) Data Structures
7 6 (1.82%) Management Information System
8 5 (1.52%) Blog
8 5 (1.52%) Distributed Systems
8 5 (1.52%) Product Ownership
9 4 (1.21%) Distributed Computing
10 3 (0.91%) Analytical Mindset
10 3 (0.91%) Distributed Applications
10 3 (0.91%) Onboarding
10 3 (0.91%) Self-Motivation
11 2 (0.61%) Beowulf
11 2 (0.61%) Data Fabric
11 2 (0.61%) IoT
11 2 (0.61%) Mobile App
11 2 (0.61%) Social Network
Operating Systems
1 62 (18.79%) Linux
2 32 (9.70%) Red Hat Enterprise Linux
2 32 (9.70%) Unix
3 31 (9.39%) CentOS
3 31 (9.39%) Debian
3 31 (9.39%) Ubuntu
4 2 (0.61%) Android
4 2 (0.61%) Apple iOS
4 2 (0.61%) SUSE
4 2 (0.61%) SUSE Linux Enterprise Server
Processes & Methodologies
1 177 (53.64%) Software Engineering
2 173 (52.42%) Agile
3 162 (49.09%) CI/CD
4 124 (37.58%) Risk Management
5 111 (33.64%) Visualisation
6 106 (32.12%) SDLC
7 100 (30.30%) Operational Stability
8 92 (27.88%) DevOps
9 87 (26.36%) Continuous Improvement
10 82 (24.85%) Machine Learning
11 73 (22.12%) Microservices
12 71 (21.52%) Open Source
13 67 (20.30%) Artificial Intelligence
14 60 (18.18%) Problem-Solving
15 55 (16.67%) Decision-Making
16 53 (16.06%) Containerisation
17 51 (15.45%) Analytics
18 48 (14.55%) Data Engineering
18 48 (14.55%) Data Modelling
18 48 (14.55%) Infrastructure as Code
Programming Languages
1 235 (71.21%) Java
2 222 (67.27%) Python
3 219 (66.36%) SQL
4 89 (26.97%) Scala
5 45 (13.64%) JavaScript
6 30 (9.09%) PL/SQL
7 22 (6.67%) Bash
8 21 (6.36%) Shell Script
9 14 (4.24%) R
10 6 (1.82%) Go
11 5 (1.52%) C++
12 2 (0.61%) C#
12 2 (0.61%) Perl
12 2 (0.61%) TypeScript
13 1 (0.30%) C
13 1 (0.30%) Groovy
13 1 (0.30%) JCL
Qualifications
1 106 (32.12%) Security Cleared
2 87 (26.36%) SC Cleared
3 50 (15.15%) Degree
3 50 (15.15%) DV Cleared
4 30 (9.09%) Computer Science Degree
5 21 (6.36%) Master's Degree
6 10 (3.03%) PhD
7 3 (0.91%) Azure Certification
7 3 (0.91%) Microsoft Certification
8 2 (0.61%) DBS Check
9 1 (0.30%) AWS Certification
9 1 (0.30%) AWS Certified Solutions Architect
Quality Assurance & Compliance
1 21 (6.36%) Data Quality
2 14 (4.24%) SLA
3 5 (1.52%) QA
4 4 (1.21%) Accessibility
5 2 (0.61%) GDPR
6 1 (0.30%) ISO 20022
System Software
1 40 (12.12%) HDFS
2 27 (8.18%) Docker
3 2 (0.61%) IAG
3 2 (0.61%) Lustre
3 2 (0.61%) Slurm Workload Manager
4 1 (0.30%) Apache Flume
Systems Management
1 84 (25.45%) Terraform
2 70 (21.21%) Kubernetes
3 52 (15.76%) Ansible
4 32 (9.70%) Puppet
5 16 (4.85%) Grafana
5 16 (4.85%) HAProxy
5 16 (4.85%) Prometheus
6 5 (1.52%) logstash
7 4 (1.21%) Podman
8 2 (0.61%) Kubeflow
8 2 (0.61%) Kustomize
9 1 (0.30%) Apache Ranger
9 1 (0.30%) Hadoop YARN
9 1 (0.30%) Kibana
Vendors
1 51 (15.45%) Google
2 45 (13.64%) Databricks
3 39 (11.82%) Cloudera
4 38 (11.52%) Informatica
5 31 (9.39%) Red Hat
6 29 (8.79%) SaltStack
7 19 (5.76%) Microsoft
8 10 (3.03%) Splunk
9 8 (2.42%) Oracle
10 7 (2.12%) Teradata
11 4 (1.21%) Alteryx
11 4 (1.21%) Dell
12 3 (0.91%) Foundry
12 3 (0.91%) IBM
12 3 (0.91%) Palantir
12 3 (0.91%) StreamSets
13 2 (0.61%) EMC
13 2 (0.61%) Mellanox
13 2 (0.61%) NetApp
13 2 (0.61%) YouTube