Apache Hadoop
UK

The table below provides summary statistics for permanent job vacancies requiring Hadoop skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Hadoop over the 6 months leading up to 16 June 2024, comparing them to the same period in the previous two years.

6 months to
16 Jun 2024
Same period 2023 Same period 2022
Rank 509 373 355
Rank change year-on-year -136 -18 -49
Permanent jobs citing Hadoop 453 799 1,844
As % of all permanent jobs advertised in the UK 0.41% 0.86% 1.07%
As % of the Database & Business Intelligence category 2.44% 4.04% 3.81%
Number of salaries quoted 160 426 653
10th Percentile - £55,000 £48,750
25th Percentile £42,500 £63,345 £56,250
Median annual salary (50th Percentile) £70,000 £75,554 £72,500
Median % change year-on-year -7.35% +4.21% -3.33%
75th Percentile £87,500 £97,500 £95,000
90th Percentile £100,000 £105,000 £110,000
UK excluding London median annual salary £55,000 £70,000 £62,500
% change year-on-year -21.43% +12.00% +4.17%

All Database and Business Intelligence Skills
UK

Hadoop falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 18,558 19,753 48,423
As % of all permanent jobs advertised in the UK 16.89% 21.36% 28.03%
Number of salaries quoted 12,633 12,748 20,937
10th Percentile £35,000 £37,500 £36,250
25th Percentile £42,725 £47,500 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £77,500 £82,500 £80,000
90th Percentile £98,750 £102,500 £95,000
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +10.53%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 16 June 2024.

Salary histogram for Hadoop in the UK

Hadoop
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 16 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
UK excluding London +60 338 £55,000 -21.43% 34
England -258 237 £70,000 -7.35% 67
Scotland +82 210 £75,000 +8.00% 6
London -195 109 £80,000 -0.37% 38
Work from Home -171 65 £80,000 +6.67% 49
South East -8 55 £45,000 -35.71% 7
South West -69 46 £80,000 +15.20% 3
North of England -22 21 £62,500 -11.94% 10
North West -32 18 £62,500 -17.28% 8
East of England -8 4 £71,250 -32.14% 5
Yorkshire +43 3 £76,250 +9.80%
West Midlands -17 1 £72,500 +3.57% 4
Midlands -51 1 £72,500 +11.54% 5
Wales - 1 £77,500 -

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 359 (79.25%) Apache Spark
2 150 (33.11%) Apache
3 20 (4.42%) Apache Airflow
4 16 (3.53%) Jupyter
4 16 (3.53%) nginx
5 5 (1.10%) Apache Pig
6 2 (0.44%) Confluence
6 2 (0.44%) OpenStack
6 2 (0.44%) SAS
Applications
1 4 (0.88%) Spreadsheet
2 3 (0.66%) Microsoft Excel
3 2 (0.44%) Abaqus
4 1 (0.22%) Microsoft Office
Cloud Services
1 338 (74.61%) AWS
2 163 (35.98%) Azure
3 107 (23.62%) GCP
4 84 (18.54%) Serverless
5 78 (17.22%) Amazon EKS
6 74 (16.34%) AWS Lambda
7 54 (11.92%) Amazon SQS
8 47 (10.38%) OpenShift
9 46 (10.15%) Amazon EMR
10 43 (9.49%) Amazon EC2
11 42 (9.27%) Amazon ECS
12 39 (8.61%) Amazon S3
13 29 (6.40%) AWS CloudFormation
14 19 (4.19%) SaaS
15 16 (3.53%) MinIO
16 15 (3.31%) Azure Data Factory
16 15 (3.31%) Power Platform
17 12 (2.65%) Google Docs
17 12 (2.65%) Lucidchart
17 12 (2.65%) Slack
Communications & Networking
1 30 (6.62%) AMQP
2 4 (0.88%) Network Security
3 2 (0.44%) Ethernet
3 2 (0.44%) InfiniBand
4 1 (0.22%) Firewall
4 1 (0.22%) Intrusion Detection
4 1 (0.22%) tcpdump
4 1 (0.22%) Wireshark
Database & Business Intelligence
1 282 (62.25%) Big Data
2 170 (37.53%) NoSQL
3 89 (19.65%) Apache Hive
4 60 (13.25%) HBase
5 54 (11.92%) MongoDB
5 54 (11.92%) PostgreSQL
6 44 (9.71%) Data Warehouse
7 42 (9.27%) Electronic Patient Records
8 36 (7.95%) Data Lake
9 31 (6.84%) Elasticsearch
10 29 (6.40%) Cloudera CDH
11 28 (6.18%) Relational Database
12 27 (5.96%) Data Mining
13 22 (4.86%) SQL Server
14 18 (3.97%) BigQuery
14 18 (3.97%) Impala
15 17 (3.75%) Flink
16 16 (3.53%) Presto
16 16 (3.53%) Tableau
17 15 (3.31%) Power BI
Development Applications
1 74 (16.34%) Jenkins
2 60 (13.25%) Git
3 49 (10.82%) Bitbucket Server
4 16 (3.53%) Atlassian Bamboo
5 7 (1.55%) Oracle Forms
6 6 (1.32%) JUnit
6 6 (1.32%) SonarQube
7 5 (1.10%) CircleCI
7 5 (1.10%) MLflow
8 4 (0.88%) Checkstyle
9 2 (0.44%) Cucumber
9 2 (0.44%) GitLab
9 2 (0.44%) Team Foundation Server
10 1 (0.22%) Artifactory
10 1 (0.22%) ERwin
10 1 (0.22%) JIRA
10 1 (0.22%) Subversion
General
1 216 (47.68%) Finance
1 216 (47.68%) Inclusion and Diversity
2 194 (42.83%) Law
3 179 (39.51%) Legal
4 62 (13.69%) Social Skills
5 45 (9.93%) Analytical Skills
6 31 (6.84%) Aerospace
7 29 (6.40%) Banking
8 28 (6.18%) Marketing
9 17 (3.75%) Retail
10 15 (3.31%) Presentation Skills
11 7 (1.55%) Games
12 5 (1.10%) Retail Banking
13 4 (0.88%) Influencing Skills
13 4 (0.88%) Investment Banking
14 3 (0.66%) Electronics
14 3 (0.66%) Telecoms
15 1 (0.22%) Advertising
15 1 (0.22%) Dutch Language
15 1 (0.22%) Financial Institution
Job Titles
1 238 (52.54%) Software Engineer
2 149 (32.89%) Big Data Engineer
3 131 (28.92%) Big Data Software Engineer
4 128 (28.26%) Data Engineer
5 125 (27.59%) AWS Engineer
6 121 (26.71%) AWS Software Engineer
7 83 (18.32%) Scala Engineer
7 83 (18.32%) Scala Software Engineer
8 65 (14.35%) DevOps Engineer
9 62 (13.69%) Developer
10 57 (12.58%) Senior
11 52 (11.48%) Java Engineer
12 51 (11.26%) Java Software Engineer
13 49 (10.82%) Database Developer
13 49 (10.82%) Database Engineer
13 49 (10.82%) Developer/Software Engineer
14 38 (8.39%) AWS Developer
15 37 (8.17%) AWS Database Engineer
16 31 (6.84%) Senior Data Engineer
17 30 (6.62%) Python Engineer
Libraries, Frameworks & Software Standards
1 124 (27.37%) Kafka
2 78 (17.22%) Node.js
3 76 (16.78%) Spring
4 69 (15.23%) Spring Boot
5 47 (10.38%) RabbitMQ
6 39 (8.61%) React
6 39 (8.61%) REST
7 31 (6.84%) AngularJS
8 30 (6.62%) gRPC
9 29 (6.40%) Material-UI
9 29 (6.40%) OpenAPI
9 29 (6.40%) Swagger
10 22 (4.86%) Apache NiFi
11 19 (4.19%) ActiveMQ
12 18 (3.97%) Elastic Stack
13 16 (3.53%) YAML
14 15 (3.31%) Apache Beam
14 15 (3.31%) PySpark
15 12 (2.65%) GraphQL
16 8 (1.77%) PyTorch
Miscellaneous
1 164 (36.20%) Algorithms
2 89 (19.65%) Cloud Native
3 34 (7.51%) Legacy Code
4 27 (5.96%) Data Structures
5 18 (3.97%) Hybrid Cloud
6 15 (3.31%) Public Cloud
7 9 (1.99%) Distributed Systems
8 7 (1.55%) Management Information System
8 7 (1.55%) Product Ownership
8 7 (1.55%) Self-Motivation
9 6 (1.32%) Distributed Applications
10 5 (1.10%) Blog
10 5 (1.10%) Greenfield Project
11 4 (0.88%) Client/Server
11 4 (0.88%) Distributed Computing
11 4 (0.88%) IoT
12 3 (0.66%) Analytical Mindset
12 3 (0.66%) Onboarding
13 2 (0.44%) Beowulf
13 2 (0.44%) Data Fabric
Operating Systems
1 59 (13.02%) Linux
2 57 (12.58%) Unix
3 32 (7.06%) Red Hat Enterprise Linux
4 31 (6.84%) CentOS
4 31 (6.84%) Debian
4 31 (6.84%) Ubuntu
5 2 (0.44%) Android
5 2 (0.44%) Apple iOS
5 2 (0.44%) SUSE
5 2 (0.44%) SUSE Linux Enterprise Server
6 1 (0.22%) Windows
Processes & Methodologies
1 273 (60.26%) Agile
2 266 (58.72%) Software Engineering
3 241 (53.20%) CI/CD
4 188 (41.50%) Risk Management
5 166 (36.64%) Visualisation
6 164 (36.20%) SDLC
7 160 (35.32%) Operational Stability
8 139 (30.68%) Machine Learning
9 132 (29.14%) Continuous Improvement
10 111 (24.50%) Artificial Intelligence
11 99 (21.85%) Microservices
12 93 (20.53%) Open Source
13 92 (20.31%) DevOps
13 92 (20.31%) Problem-Solving
14 85 (18.76%) Data Modelling
15 81 (17.88%) Decision-Making
16 70 (15.45%) Analytics
17 68 (15.01%) Data Engineering
18 67 (14.79%) Data Science
19 65 (14.35%) Computer Science
Programming Languages
1 323 (71.30%) Java
2 320 (70.64%) SQL
3 280 (61.81%) Python
4 141 (31.13%) Scala
5 49 (10.82%) PL/SQL
6 39 (8.61%) JavaScript
7 30 (6.62%) Bash
8 23 (5.08%) R
9 20 (4.42%) Shell Script
10 19 (4.19%) Go
11 6 (1.32%) C#
12 5 (1.10%) C++
13 4 (0.88%) C
14 2 (0.44%) Perl
15 1 (0.22%) Data Analysis Expressions
15 1 (0.22%) F#
15 1 (0.22%) JCL
15 1 (0.22%) TypeScript
Qualifications
1 104 (22.96%) Security Cleared
2 85 (18.76%) SC Cleared
3 81 (17.88%) Degree
4 56 (12.36%) DV Cleared
5 30 (6.62%) Computer Science Degree
6 20 (4.42%) Master's Degree
7 10 (2.21%) PhD
8 5 (1.10%) Azure Certification
9 4 (0.88%) Numerate Degree
10 3 (0.66%) Microsoft Certification
11 2 (0.44%) DBS Check
12 1 (0.22%) AWS Certification
12 1 (0.22%) AWS Certified Solutions Architect
Quality Assurance & Compliance
1 22 (4.86%) Data Quality
2 14 (3.09%) SLA
3 10 (2.21%) QA
4 4 (0.88%) Solvency II
5 3 (0.66%) Accessibility
6 2 (0.44%) GDPR
7 1 (0.22%) NIST
System Software
1 73 (16.11%) HDFS
2 37 (8.17%) Docker
3 2 (0.44%) IAG
3 2 (0.44%) Lustre
3 2 (0.44%) Slurm Workload Manager
4 1 (0.22%) Apache Flume
Systems Management
1 104 (22.96%) Terraform
2 87 (19.21%) Kubernetes
3 52 (11.48%) Ansible
4 31 (6.84%) Puppet
5 16 (3.53%) Grafana
5 16 (3.53%) HAProxy
5 16 (3.53%) Prometheus
6 5 (1.10%) logstash
7 4 (0.88%) Podman
8 2 (0.44%) Kibana
8 2 (0.44%) Kubeflow
8 2 (0.44%) Kustomize
9 1 (0.22%) Apache Ranger
9 1 (0.22%) Hadoop YARN
Vendors
1 82 (18.10%) Databricks
2 72 (15.89%) Cloudera
2 72 (15.89%) Google
3 57 (12.58%) Informatica
4 31 (6.84%) Red Hat
5 30 (6.62%) Microsoft
6 29 (6.40%) SaltStack
7 15 (3.31%) Oracle
8 14 (3.09%) Teradata
9 12 (2.65%) Dell
10 7 (1.55%) Splunk
11 6 (1.32%) YouTube
12 4 (0.88%) IBM
12 4 (0.88%) Intel
13 3 (0.66%) Alteryx
13 3 (0.66%) Facebook
14 2 (0.44%) Apple
14 2 (0.44%) Cognos
14 2 (0.44%) EMC
14 2 (0.44%) Mellanox