Apache Hadoop
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 7 December 2023 with a comparison to the same period in the previous 2 years.

6 months to
7 Dec 2023
Same period 2022 Same period 2021
Rank 459 360 333
Rank change year-on-year -99 -27 -54
Permanent jobs citing Hadoop 286 1,141 1,389
As % of all permanent jobs advertised in the UK 0.54% 0.93% 1.08%
As % of the Database & Business Intelligence category 2.54% 3.99% 4.00%
Number of salaries quoted 163 475 809
10th Percentile £57,200 £50,000 £46,250
25th Percentile £67,500 £58,750 £55,000
Median annual salary (50th Percentile) £77,500 £80,000 £75,000
Median % change year-on-year -3.13% +6.67% +7.14%
75th Percentile £100,000 £105,000 £96,250
90th Percentile £111,000 £120,000 £112,500
UK excluding London median annual salary £73,750 £62,500 £61,900
% change year-on-year +18.00% +0.97% +12.55%

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 11,277 28,579 34,744
As % of all permanent jobs advertised in the UK 21.28% 23.27% 27.11%
Number of salaries quoted 8,446 17,544 22,627
10th Percentile £36,750 £36,750 £35,500
25th Percentile £46,580 £46,250 £42,500
Median annual salary (50th Percentile) £60,000 £62,500 £58,500
Median % change year-on-year -4.00% +6.84% +6.36%
75th Percentile £80,000 £82,500 £77,500
90th Percentile £95,000 £100,000 £95,000
UK excluding London median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% +2.04%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 7 December 2023.

Salary histogram for Hadoop in the UK

Hadoop
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 7 December 2023. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -75 243 £76,527 -4.34% 82
London +15 165 £90,000 - 63
Work from Home -46 120 £72,788 -9.02% 52
UK excluding London -37 104 £73,750 +18.00% 34
South West +47 40 £75,000 +11.11% 2
Scotland +20 34 £75,554 +25.92% 4
South East +49 12 £45,196 -30.47% 17
North of England +49 11 £70,452 +12.72% 6
North West +87 8 £65,351 +24.48% 3
West Midlands +95 3 £70,000 -12.50% 1
Midlands +76 3 £70,000 - 2
East of England +73 3 - - 1
Yorkshire +61 3 £75,554 +11.93% 2
Northern Ireland +35 1 £100,000 +53.85%

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 178 (62.24%) Apache Spark
2 42 (14.69%) Apache
3 33 (11.54%) Apache Airflow
4 14 (4.90%) Jupyter
5 13 (4.55%) Tomcat
6 11 (3.85%) Jetty
6 11 (3.85%) nginx
7 3 (1.05%) Apache Pig
8 2 (0.70%) JBoss
8 2 (0.70%) Luigi
8 2 (0.70%) WebSphere
9 1 (0.35%) Apache Pulsar
9 1 (0.35%) Apache Solr
9 1 (0.35%) Confluence
9 1 (0.35%) SAS
Applications
1 8 (2.80%) Microsoft Excel
2 1 (0.35%) Microsoft Office
2 1 (0.35%) Microsoft PowerPoint
Cloud Services
1 182 (63.64%) AWS
2 135 (47.20%) Azure
3 85 (29.72%) GCP
4 40 (13.99%) Amazon S3
5 22 (7.69%) OpenShift
5 22 (7.69%) Serverless
6 19 (6.64%) Power Platform
7 16 (5.59%) AWS Lambda
8 15 (5.24%) MinIO
9 14 (4.90%) Amazon EKS
10 13 (4.55%) Amazon SQS
10 13 (4.55%) Snowflake
11 12 (4.20%) Amazon EMR
11 12 (4.20%) AWS Step Functions
11 12 (4.20%) SaaS
12 10 (3.50%) Amazon EC2
13 9 (3.15%) Azure Data Factory
13 9 (3.15%) Google Docs
13 9 (3.15%) Lucidchart
13 9 (3.15%) Slack
Communications & Networking
1 11 (3.85%) Internet
2 7 (2.45%) SSH
3 6 (2.10%) HTTP
3 6 (2.10%) Network Security
4 5 (1.75%) AMQP
4 5 (1.75%) WAN
5 1 (0.35%) Firewall
5 1 (0.35%) TCP/IP
Database & Business Intelligence
1 170 (59.44%) Big Data
2 68 (23.78%) Apache Hive
3 59 (20.63%) Elasticsearch
4 52 (18.18%) MongoDB
5 51 (17.83%) Data Warehouse
6 44 (15.38%) Data Lake
7 38 (13.29%) NoSQL
8 35 (12.24%) Presto
9 34 (11.89%) Metadata
10 31 (10.84%) Amazon Redshift
11 29 (10.14%) BigQuery
12 25 (8.74%) Data Mining
13 19 (6.64%) Power BI
14 17 (5.94%) Apache Ignite
15 16 (5.59%) Relational Database
16 15 (5.24%) Apache Cassandra
16 15 (5.24%) Impala
17 14 (4.90%) Tableau
18 13 (4.55%) Amazon Athena
18 13 (4.55%) Flink
Development Applications
1 32 (11.19%) Jenkins
2 20 (6.99%) Atlassian Bamboo
3 19 (6.64%) Git
4 14 (4.90%) JUnit
5 10 (3.50%) WebDriver
6 6 (2.10%) CircleCI
6 6 (2.10%) Cucumber
6 6 (2.10%) Maven
6 6 (2.10%) ScalaTest
7 5 (1.75%) Oracle Forms
7 5 (1.75%) Selenium
8 4 (1.40%) Bitbucket
8 4 (1.40%) Bitbucket Server
8 4 (1.40%) JMeter
8 4 (1.40%) Travis CI
9 3 (1.05%) Checkstyle
9 3 (1.05%) SonarQube
9 3 (1.05%) Sonatype Nexus
9 3 (1.05%) Spinnaker
10 2 (0.70%) Gradle
General
1 109 (38.11%) Finance
2 66 (23.08%) Social Skills
3 64 (22.38%) Inclusion and Diversity
4 59 (20.63%) Analytical Skills
5 40 (13.99%) Banking
6 22 (7.69%) Law
7 18 (6.29%) Legal
8 14 (4.90%) Retail Banking
9 13 (4.55%) Retail
10 9 (3.15%) Marketing
11 7 (2.45%) Presentation Skills
12 5 (1.75%) Documentation Skills
13 3 (1.05%) Games
14 2 (0.70%) Aviation
15 1 (0.35%) Financial Institution
15 1 (0.35%) Investment Banking
15 1 (0.35%) Manufacturing
15 1 (0.35%) Telecoms
Job Titles
1 97 (33.92%) Data Engineer
2 57 (19.93%) Senior
3 43 (15.03%) Lead
4 42 (14.69%) Architect
5 41 (14.34%) Software Engineer
6 27 (9.44%) Big Data Engineer
6 27 (9.44%) Developer
7 24 (8.39%) Lead Data Engineer
8 23 (8.04%) Data Architect
9 20 (6.99%) Analyst
9 20 (6.99%) Data Analyst
10 19 (6.64%) DevOps Engineer
11 18 (6.29%) Senior Data Engineer
12 17 (5.94%) Cloud Architect
12 17 (5.94%) IT Architect
12 17 (5.94%) Java Developer
13 14 (4.90%) Big Data Software Engineer
13 14 (4.90%) Python Engineer
13 14 (4.90%) Solutions Architect
14 13 (4.55%) Java Engineer
Libraries, Frameworks & Software Standards
1 91 (31.82%) Kafka
2 46 (16.08%) React
3 36 (12.59%) HTML
4 33 (11.54%) Spring
5 23 (8.04%) PySpark
6 21 (7.34%) JSON
6 21 (7.34%) REST
7 19 (6.64%) ActiveMQ
7 19 (6.64%) Apache NiFi
8 18 (6.29%) CSS
9 17 (5.94%) jQuery
10 16 (5.59%) Elastic Stack
10 16 (5.59%) RabbitMQ
11 13 (4.55%) XML
12 12 (4.20%) Node.js
12 12 (4.20%) Spring Boot
13 11 (3.85%) .NET
13 11 (3.85%) YAML
14 9 (3.15%) Apache Beam
14 9 (3.15%) GraphQL
Miscellaneous
1 47 (16.43%) Algorithms
2 43 (15.03%) Cloud Native
3 35 (12.24%) Product Ownership
4 28 (9.79%) Distributed Systems
5 24 (8.39%) Cyberattack
6 21 (7.34%) Data Structures
7 15 (5.24%) Greenfield Project
8 14 (4.90%) Self-Motivation
9 13 (4.55%) Public Cloud
10 11 (3.85%) Hybrid Cloud
10 11 (3.85%) Onboarding
10 11 (3.85%) Online Banking
11 10 (3.50%) Management Information System
12 7 (2.45%) Hackathon
13 5 (1.75%) Cyber Defence
13 5 (1.75%) Legacy Systems
14 4 (1.40%) Clustering
14 4 (1.40%) FPGA
14 4 (1.40%) Legacy Code
15 3 (1.05%) Client/Server
Operating Systems
1 38 (13.29%) Linux
2 15 (5.24%) Unix
3 12 (4.20%) CentOS
4 11 (3.85%) Red Hat Enterprise Linux
5 6 (2.10%) Debian
5 6 (2.10%) Ubuntu
6 1 (0.35%) Windows
Processes & Methodologies
1 142 (49.65%) Agile
2 98 (34.27%) Data Engineering
3 95 (33.22%) Data Modelling
4 76 (26.57%) Mentoring
5 72 (25.17%) CI/CD
6 71 (24.83%) Software Engineering
7 69 (24.13%) Analytics
7 69 (24.13%) Machine Learning
8 66 (23.08%) ETL
9 58 (20.28%) DevOps
10 56 (19.58%) Problem-Solving
11 52 (18.18%) Data Science
12 50 (17.48%) Visualisation
13 46 (16.08%) Data Pipeline
14 45 (15.73%) Continuous Integration
15 43 (15.03%) Test Automation
16 39 (13.64%) Computer Science
17 36 (12.59%) Design Patterns
18 35 (12.24%) Decision-Making
18 35 (12.24%) SDLC
Programming Languages
1 162 (56.64%) Python
2 134 (46.85%) Java
3 130 (45.45%) SQL
4 73 (25.52%) Scala
5 34 (11.89%) Bash
6 29 (10.14%) Go
7 28 (9.79%) JavaScript
8 20 (6.99%) C++
9 17 (5.94%) Shell Script
10 16 (5.59%) C#
11 13 (4.55%) R
12 8 (2.80%) C
13 7 (2.45%) Groovy
14 6 (2.10%) TypeScript
15 5 (1.75%) PL/SQL
16 4 (1.40%) PowerShell
17 3 (1.05%) Perl
18 1 (0.35%) F#
18 1 (0.35%) Rust
18 1 (0.35%) T-SQL
Qualifications
1 59 (20.63%) Security Cleared
2 52 (18.18%) Degree
3 44 (15.38%) DV Cleared
4 16 (5.59%) Master's Degree
5 15 (5.24%) Computer Science Degree
6 9 (3.15%) AWS Certification
6 9 (3.15%) SC Cleared
7 3 (1.05%) Azure Certification
8 1 (0.35%) MBA
8 1 (0.35%) Microsoft Certification
Quality Assurance & Compliance
1 41 (14.34%) Data Quality
2 10 (3.50%) QA
3 7 (2.45%) Accessibility
4 5 (1.75%) GDPR
5 2 (0.70%) SLA
System Software
1 29 (10.14%) Docker
2 22 (7.69%) HDFS
3 4 (1.40%) Apache Flume
3 4 (1.40%) Ceph
3 4 (1.40%) VMware Infrastructure
4 1 (0.35%) Apache ZooKeeper
Systems Management
1 62 (21.68%) Kubernetes
2 31 (10.84%) Terraform
3 24 (8.39%) Ansible
4 15 (5.24%) Grafana
4 15 (5.24%) Prometheus
5 11 (3.85%) HAProxy
6 8 (2.80%) Oozie
6 8 (2.80%) Puppet
7 1 (0.35%) Apache Ranger
7 1 (0.35%) Control-M
7 1 (0.35%) Hadoop YARN
7 1 (0.35%) Kibana
7 1 (0.35%) Kustomize
7 1 (0.35%) Progress Chef
7 1 (0.35%) Rancher
7 1 (0.35%) SELinux
Vendors
1 50 (17.48%) Google
2 44 (15.38%) Databricks
3 38 (13.29%) Oracle
4 27 (9.44%) Microsoft
5 14 (4.90%) Cloudera
6 10 (3.50%) Dell
6 10 (3.50%) Red Hat
6 10 (3.50%) Splunk
6 10 (3.50%) Teradata
7 8 (2.80%) Informatica
8 5 (1.75%) SaltStack
9 4 (1.40%) VMware
10 2 (0.70%) Talend
10 2 (0.70%) YouTube
11 1 (0.35%) Ab Initio
11 1 (0.35%) Adobe
11 1 (0.35%) Alteryx
11 1 (0.35%) MicroStrategy
11 1 (0.35%) Minitab
11 1 (0.35%) SAP