Period
to 27 October 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 27 October 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
27 Oct 2021
Same period 2020 Same period 2019
Rank 108 94 144
Rank change year-on-year -14 +50 +10
Permanent jobs citing Hadoop 166 109 215
As % of all permanent jobs advertised in the City of London 2.76% 2.98% 2.16%
As % of the Database & Business Intelligence category 9.27% 10.70% 7.10%
Number of salaries quoted 158 99 187
10th Percentile £47,500 £51,250 £55,750
25th Percentile £58,750 £61,875 £64,375
Median annual salary (50th Percentile) £82,500 £75,000 £76,000
Median % change year-on-year +10.00% -1.32% -1.94%
75th Percentile £103,750 £104,375 £95,000
90th Percentile £110,000 £110,000 £112,500
Central London median annual salary £80,000 £75,000 £77,500
% change year-on-year +6.67% -3.23% +0.98%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,791 1,019 3,030
As % of all permanent IT jobs advertised in the City of London 29.82% 27.87% 30.44%
Number of salaries quoted 1,591 853 2,715
10th Percentile £46,250 £42,500 £43,000
25th Percentile £56,250 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £95,000 £85,250 £85,000
90th Percentile £108,750 £100,000 £100,000
Central London median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% -

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

Salary distribution for jobs citing Hadoop in the City of London over the 6 months to 27 October 2021.

Salary histogram for Hadoop in the City of London

For the 6 months to 27 October 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 123 (74.10%) Java
1 123 (74.10%) Big Data
2 89 (53.61%) Agile Software Development
3 75 (45.18%) Apache Spark
4 61 (36.75%) SQL
4 61 (36.75%) Kafka
5 56 (33.73%) AWS
6 50 (30.12%) Analytics
6 50 (30.12%) Python
7 43 (25.90%) Multithreading
7 43 (25.90%) MongoDB
8 38 (22.89%) Amazon Redshift
9 37 (22.29%) Apache Cassandra
9 37 (22.29%) Azure
10 36 (21.69%) NoSQL
11 34 (20.48%) Software Engineering
12 33 (19.88%) Elasticsearch
13 32 (19.28%) DevOps
14 31 (18.67%) Scala
14 31 (18.67%) Data Warehouse
15 30 (18.07%) Oracle
15 30 (18.07%) GCP
16 29 (17.47%) Finance
16 29 (17.47%) Kubernetes
17 26 (15.66%) Data Engineering
17 26 (15.66%) Java 8
18 25 (15.06%) Data Pipeline
18 25 (15.06%) Data Lake
19 24 (14.46%) Fintech
19 24 (14.46%) Self-Motivation

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 75 (45.18%) Apache Spark
2 33 (19.88%) Elasticsearch
3 15 (9.04%) Apache
4 13 (7.83%) SAS
5 5 (3.01%) Apache Airflow
6 4 (2.41%) Appian
7 3 (1.81%) Apache Pig
7 3 (1.81%) OpenStack
8 2 (1.20%) nginx
9 1 (0.60%) Apache Pulsar
9 1 (0.60%) GemFire
Applications
1 3 (1.81%) Microsoft Excel
Cloud Services
1 56 (33.73%) AWS
2 37 (22.29%) Azure
3 30 (18.07%) GCP
4 12 (7.23%) Amazon EC2
4 12 (7.23%) SaaS
5 11 (6.63%) Power Platform
6 9 (5.42%) Snowflake
7 5 (3.01%) AWS Data Pipeline
8 4 (2.41%) Collibra
9 3 (1.81%) Amazon Kinesis
9 3 (1.81%) Azure Data Factory
9 3 (1.81%) Cloud Computing
9 3 (1.81%) OpenShift
10 2 (1.20%) AWS Step Functions
10 2 (1.20%) Azure Synapse Analytics
10 2 (1.20%) MinIO
11 1 (0.60%) Amazon EMR
11 1 (0.60%) IBM Cloud
Communications & Networking
1 10 (6.02%) HTTP
2 2 (1.20%) Firewall
3 1 (0.60%) DNS
3 1 (0.60%) Internet
3 1 (0.60%) VLAN
Database & Business Intelligence
1 123 (74.10%) Big Data
2 43 (25.90%) MongoDB
3 38 (22.89%) Amazon Redshift
4 37 (22.29%) Apache Cassandra
5 36 (21.69%) NoSQL
6 31 (18.67%) Data Warehouse
7 25 (15.06%) Data Lake
8 22 (13.25%) Flink
8 22 (13.25%) MySQL
9 21 (12.65%) PostgreSQL
10 19 (11.45%) Amazon RDS
10 19 (11.45%) Apache Hive
11 15 (9.04%) SQL Server
12 12 (7.23%) BigQuery
12 12 (7.23%) Relational Database
13 11 (6.63%) Power BI
13 11 (6.63%) Tableau
14 8 (4.82%) Impala
14 8 (4.82%) OLTP
15 7 (4.22%) Spark SQL
Development Applications
1 18 (10.84%) Jenkins
2 17 (10.24%) Atlassian Bamboo
3 9 (5.42%) JIRA
4 8 (4.82%) Git (software)
4 8 (4.82%) Gradle
4 8 (4.82%) JMeter
4 8 (4.82%) JUnit
5 7 (4.22%) ER Studio
5 7 (4.22%) ERwin
5 7 (4.22%) PowerDesigner
5 7 (4.22%) Subversion
6 5 (3.01%) REST Assured
6 5 (3.01%) Toad
6 5 (3.01%) TortoiseSVN
7 4 (2.41%) Selenium
7 4 (2.41%) WebDriver
8 3 (1.81%) Maven
9 2 (1.20%) GitLab
9 2 (1.20%) Travis CI
10 1 (0.60%) Vagrant
General
1 29 (17.47%) Finance
2 10 (6.02%) Social Skills
3 8 (4.82%) Analytical Skills
4 7 (4.22%) Advertising
5 5 (3.01%) Public Sector
5 5 (3.01%) Retail Banking
6 2 (1.20%) Front Office
6 2 (1.20%) Mandarin Language
7 1 (0.60%) Banking
7 1 (0.60%) Documentation Skills
7 1 (0.60%) Financial Institution
7 1 (0.60%) Manufacturing
7 1 (0.60%) Presentation Skills
7 1 (0.60%) Retail
Job Titles
1 62 (37.35%) Developer
2 50 (30.12%) Java Developer
3 39 (23.49%) Data Engineer
4 26 (15.66%) Big Data Engineer
5 22 (13.25%) Senior Developer
5 22 (13.25%) Senior Java Developer
6 21 (12.65%) Java Engineer
7 16 (9.64%) Scala Developer
8 15 (9.04%) AWS Engineer
9 14 (8.43%) Software Engineer
10 13 (7.83%) Architect
10 13 (7.83%) Data Architect
10 13 (7.83%) Java Software Engineer
11 11 (6.63%) Apache Spark Developer
11 11 (6.63%) Data Analytics Engineer
11 11 (6.63%) Hadoop Developer
12 10 (6.02%) Big Data Software Engineer
12 10 (6.02%) Hadoop Engineer
13 7 (4.22%) DevOps Engineer
14 6 (3.61%) DevOps Manager
Libraries, Frameworks & Software Standards
1 61 (36.75%) Kafka
2 19 (11.45%) ActiveMQ
2 19 (11.45%) JMS
3 15 (9.04%) Apache Thrift
4 11 (6.63%) Akka
5 9 (5.42%) AngularJS
6 8 (4.82%) JSON
6 8 (4.82%) RabbitMQ
6 8 (4.82%) REST
7 7 (4.22%) CSS
7 7 (4.22%) Lucene
7 7 (4.22%) Protocol Buffers
7 7 (4.22%) Web Services
8 4 (2.41%) RESTful
8 4 (2.41%) Spring
9 3 (1.81%) HTML
9 3 (1.81%) HTML5
9 3 (1.81%) Node.js
9 3 (1.81%) React
10 2 (1.20%) LEMP Stack
Miscellaneous
1 24 (14.46%) Self-Motivation
2 16 (9.64%) Greenfield Project
3 5 (3.01%) Data Structures
4 2 (1.20%) Derivative
4 2 (1.20%) Management Information System
4 2 (1.20%) Mobile App
4 2 (1.20%) Private Cloud
4 2 (1.20%) Virtual Team
5 1 (0.60%) Acoustics
5 1 (0.60%) Blog
5 1 (0.60%) Enterprise Software
5 1 (0.60%) Equities
5 1 (0.60%) Market Risk
Operating Systems
1 17 (10.24%) Unix
2 8 (4.82%) Linux
3 2 (1.20%) CentOS
Processes & Methodologies
1 89 (53.61%) Agile Software Development
2 50 (30.12%) Analytics
3 43 (25.90%) Multithreading
4 34 (20.48%) Software Engineering
5 32 (19.28%) DevOps
6 26 (15.66%) Data Engineering
7 25 (15.06%) Data Pipeline
8 24 (14.46%) Fintech
9 23 (13.86%) Data Modelling
9 23 (13.86%) Mentoring
10 21 (12.65%) Data Science
10 21 (12.65%) Scrum
11 20 (12.05%) Concurrent Programming
12 19 (11.45%) Clean Code
12 19 (11.45%) ETL
13 18 (10.84%) Coaching
14 17 (10.24%) Data Management
14 17 (10.24%) OO
14 17 (10.24%) Software Testing
15 16 (9.64%) Data Analysis
Programming Languages
1 123 (74.10%) Java
2 61 (36.75%) SQL
3 50 (30.12%) Python
4 31 (18.67%) Scala
5 26 (15.66%) Java 8
6 11 (6.63%) Bash Shell
7 9 (5.42%) C#
8 8 (4.82%) JavaScript
8 8 (4.82%) Kotlin
9 6 (3.61%) PL/SQL
10 5 (3.01%) HiveQL
10 5 (3.01%) Perl
10 5 (3.01%) Ruby
11 3 (1.81%) ES6
11 3 (1.81%) Go
11 3 (1.81%) PHP
11 3 (1.81%) TypeScript
12 2 (1.20%) PowerShell
12 2 (1.20%) R
13 1 (0.60%) Groovy
Qualifications
1 12 (7.23%) Degree
2 6 (3.61%) Master's Degree
2 6 (3.61%) SC Cleared
2 6 (3.61%) Security Cleared
3 5 (3.01%) SAS Certification
4 3 (1.81%) Computer Science Degree
5 1 (0.60%) BPSS Clearance
Quality Assurance & Compliance
1 24 (14.46%) Data Quality
2 12 (7.23%) QA
System Software
1 12 (7.23%) Docker
2 10 (6.02%) Apache ZooKeeper
3 8 (4.82%) HDFS
4 2 (1.20%) Apache Flume
4 2 (1.20%) VMware Infrastructure
5 1 (0.60%) Virtual Machines
5 1 (0.60%) VirtualBox
Systems Management
1 29 (17.47%) Kubernetes
2 13 (7.83%) Ansible
3 11 (6.63%) Puppet
4 7 (4.22%) Prometheus
5 6 (3.61%) Terraform
6 3 (1.81%) HAProxy
6 3 (1.81%) Opscode Chef
7 2 (1.20%) Control-M
7 2 (1.20%) Docker Swarm
7 2 (1.20%) Grafana
8 1 (0.60%) Graphite
8 1 (0.60%) Salt
Vendors
1 30 (18.07%) Oracle
2 18 (10.84%) Talend
3 12 (7.23%) Google
4 10 (6.02%) Informatica
5 9 (5.42%) Databricks
6 7 (4.22%) Cloudera
7 5 (3.01%) Hortonworks
7 5 (3.01%) Teradata
8 4 (2.41%) Alteryx
9 3 (1.81%) Splunk
10 2 (1.20%) DataFlux
10 2 (1.20%) F5
10 2 (1.20%) Microsoft
10 2 (1.20%) VMware
11 1 (0.60%) IBM