Period
to 30 July 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 30 July 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
30 Jul 2021
Same period 2020 Same period 2019
Rank 92 113 152
Rank change year-on-year +21 +39 -8
Permanent jobs citing Hadoop 183 122 211
As % of all permanent jobs advertised in the City of London 3.25% 2.30% 2.06%
As % of the Database & Business Intelligence category 11.25% 9.55% 6.44%
Number of salaries quoted 177 105 180
10th Percentile £53,750 £49,000 £53,750
25th Percentile £65,000 £60,000 £63,750
Median annual salary (50th Percentile) £82,500 £75,000 £77,500
Median % change year-on-year +10.00% -3.23% +3.33%
75th Percentile £103,750 £95,000 £95,000
90th Percentile £110,000 £111,500 £112,500
Central London median annual salary £82,500 £75,000 £78,500
% change year-on-year +10.00% -4.46% +4.67%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,626 1,278 3,276
As % of all permanent IT jobs advertised in the City of London 28.85% 24.13% 32.01%
Number of salaries quoted 1,440 1,104 2,961
10th Percentile £45,000 £42,500 £42,500
25th Percentile £53,750 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £92,500 £85,000 £85,000
90th Percentile £108,750 £96,250 £100,000
Central London median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

Salary distribution for jobs citing Hadoop in the City of London over the 6 months to 30 July 2021.

Salary histogram for Hadoop in the City of London

For the 6 months to 30 July 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 152 (83.06%) Big Data
2 145 (79.23%) Java
3 106 (57.92%) Apache Spark
4 86 (46.99%) Agile Software Development
5 74 (40.44%) Kafka
6 73 (39.89%) AWS
6 73 (39.89%) SQL
7 62 (33.88%) Python
8 58 (31.69%) Analytics
9 56 (30.60%) DevOps
10 49 (26.78%) Kubernetes
11 48 (26.23%) MongoDB
11 48 (26.23%) NoSQL
12 43 (23.50%) Amazon Redshift
12 43 (23.50%) Data Engineering
13 42 (22.95%) Multithreading
14 40 (21.86%) Azure
14 40 (21.86%) Open Source
15 38 (20.77%) Scala
16 37 (20.22%) GCP
17 36 (19.67%) Apache Cassandra
17 36 (19.67%) Finance
18 35 (19.13%) Microservices
19 33 (18.03%) Software Engineering
20 31 (16.94%) Artificial Intelligence
20 31 (16.94%) Fintech
20 31 (16.94%) Java 8
21 30 (16.39%) Apache Hive
22 29 (15.85%) OO
23 26 (14.21%) Docker

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 106 (57.92%) Apache Spark
2 21 (11.48%) Elasticsearch
3 14 (7.65%) Apache
4 7 (3.83%) SAS
5 5 (2.73%) Apache Airflow
5 5 (2.73%) OpenStack
6 2 (1.09%) Apache Pig
7 1 (0.55%) Apache Pulsar
7 1 (0.55%) Appian
7 1 (0.55%) GemFire
7 1 (0.55%) nginx
Applications
1 1 (0.55%) Microsoft Excel
Cloud Services
1 73 (39.89%) AWS
2 40 (21.86%) Azure
3 37 (20.22%) GCP
4 16 (8.74%) SaaS
5 13 (7.10%) Amazon EC2
6 9 (4.92%) Power Platform
7 7 (3.83%) Cloud Computing
8 6 (3.28%) AWS Data Pipeline
8 6 (3.28%) Snowflake
9 4 (2.19%) OpenShift
10 3 (1.64%) Amazon Kinesis
10 3 (1.64%) Azure Data Factory
11 2 (1.09%) Amazon EMR
11 2 (1.09%) AWS Step Functions
11 2 (1.09%) Azure Synapse Analytics
12 1 (0.55%) Collibra
12 1 (0.55%) IBM Cloud
12 1 (0.55%) Matillion
12 1 (0.55%) MinIO
12 1 (0.55%) PaaS
Communications & Networking
1 15 (8.20%) HTTP
2 2 (1.09%) Firewall
3 1 (0.55%) DNS
3 1 (0.55%) VLAN
Database & Business Intelligence
1 152 (83.06%) Big Data
2 48 (26.23%) MongoDB
2 48 (26.23%) NoSQL
3 43 (23.50%) Amazon Redshift
4 36 (19.67%) Apache Cassandra
5 30 (16.39%) Apache Hive
6 24 (13.11%) Data Lake
7 23 (12.57%) Data Warehouse
8 22 (12.02%) BigQuery
9 19 (10.38%) Amazon RDS
10 15 (8.20%) Flink
11 14 (7.65%) MySQL
12 13 (7.10%) Relational Database
12 13 (7.10%) SQL Server
13 11 (6.01%) PostgreSQL
14 9 (4.92%) Power BI
14 9 (4.92%) Tableau
15 8 (4.37%) HBase
16 7 (3.83%) Spark SQL
17 6 (3.28%) OLTP
Development Applications
1 25 (13.66%) Jenkins
2 22 (12.02%) Atlassian Bamboo
3 16 (8.74%) Git (software)
4 11 (6.01%) JMeter
4 11 (6.01%) JUnit
5 10 (5.46%) Gradle
6 9 (4.92%) JIRA
7 8 (4.37%) REST Assured
8 6 (3.28%) ER Studio
8 6 (3.28%) ERwin
8 6 (3.28%) Maven
8 6 (3.28%) PowerDesigner
9 5 (2.73%) Selenium
9 5 (2.73%) WebDriver
10 4 (2.19%) Subversion
10 4 (2.19%) Toad
10 4 (2.19%) TortoiseSVN
11 2 (1.09%) SonarQube
12 1 (0.55%) GitLab
12 1 (0.55%) Travis CI
General
1 36 (19.67%) Finance
2 14 (7.65%) Banking
3 9 (4.92%) Analytical Skills
4 6 (3.28%) Advertising
4 6 (3.28%) Retail Banking
5 5 (2.73%) Social Skills
6 4 (2.19%) Front Office
6 4 (2.19%) Games
7 3 (1.64%) Inclusion and Diversity
8 2 (1.09%) Marketing
9 1 (0.55%) Manufacturing
9 1 (0.55%) Retail
Job Titles
1 71 (38.80%) Developer
2 62 (33.88%) Java Developer
3 41 (22.40%) Big Data Engineer
4 39 (21.31%) Data Engineer
5 38 (20.77%) Java Engineer
6 29 (15.85%) Software Engineer
7 27 (14.75%) Java Software Engineer
8 23 (12.57%) Data Analytics Engineer
9 22 (12.02%) Big Data Software Engineer
10 20 (10.93%) Senior Developer
10 20 (10.93%) Senior Java Developer
11 17 (9.29%) AWS Engineer
12 14 (7.65%) Hadoop Engineer
12 14 (7.65%) Scala Developer
13 9 (4.92%) Apache Spark Developer
13 9 (4.92%) Hadoop Developer
14 8 (4.37%) DevOps Engineer
15 7 (3.83%) Java Developer - Fintech
16 6 (3.28%) DevOps Manager
16 6 (3.28%) Java Scala Developer
Libraries, Frameworks & Software Standards
1 74 (40.44%) Kafka
2 20 (10.93%) ActiveMQ
2 20 (10.93%) JMS
3 19 (10.38%) AngularJS
4 17 (9.29%) RESTful
5 16 (8.74%) Apache Thrift
6 15 (8.20%) HTML
7 14 (7.65%) CSS
7 14 (7.65%) HTML5
7 14 (7.65%) React
8 13 (7.10%) Node.js
9 11 (6.01%) JSON
9 11 (6.01%) REST
9 11 (6.01%) Web Services
10 9 (4.92%) Akka
11 8 (4.37%) RabbitMQ
12 6 (3.28%) Spring
13 5 (2.73%) Lucene
13 5 (2.73%) Protocol Buffers
13 5 (2.73%) TensorFlow
Miscellaneous
1 25 (13.66%) Self-Motivation
2 14 (7.65%) Greenfield Project
3 5 (2.73%) Private Cloud
4 3 (1.64%) Data Structures
4 3 (1.64%) Derivative
5 2 (1.09%) Equities
5 2 (1.09%) Public Cloud
6 1 (0.55%) Acoustics
6 1 (0.55%) Blog
6 1 (0.55%) Data Centre
6 1 (0.55%) Equity Derivative
6 1 (0.55%) Fixed Income
6 1 (0.55%) Management Information System
6 1 (0.55%) Market Risk
6 1 (0.55%) Mobile App
Operating Systems
1 12 (6.56%) Linux
2 5 (2.73%) Unix
3 2 (1.09%) CentOS
Processes & Methodologies
1 86 (46.99%) Agile Software Development
2 58 (31.69%) Analytics
3 56 (30.60%) DevOps
4 43 (23.50%) Data Engineering
5 42 (22.95%) Multithreading
6 40 (21.86%) Open Source
7 35 (19.13%) Microservices
8 33 (18.03%) Software Engineering
9 31 (16.94%) Artificial Intelligence
9 31 (16.94%) Fintech
10 29 (15.85%) OO
11 24 (13.11%) Data Science
12 23 (12.57%) Computer Science
13 22 (12.02%) Data Pipeline
14 20 (10.93%) Clean Code
15 18 (9.84%) Continuous Integration
16 17 (9.29%) TDD
17 16 (8.74%) ETL
18 15 (8.20%) Data Modelling
18 15 (8.20%) Data Transformation
Programming Languages
1 145 (79.23%) Java
2 73 (39.89%) SQL
3 62 (33.88%) Python
4 38 (20.77%) Scala
5 31 (16.94%) Java 8
6 20 (10.93%) Kotlin
7 18 (9.84%) JavaScript
8 17 (9.29%) C#
9 14 (7.65%) ES6
9 14 (7.65%) PHP
9 14 (7.65%) TypeScript
10 13 (7.10%) Bash Shell
11 5 (2.73%) R
12 2 (1.09%) HiveQL
12 2 (1.09%) PL/SQL
12 2 (1.09%) PowerShell
12 2 (1.09%) Shell Script
13 1 (0.55%) C
13 1 (0.55%) C++
13 1 (0.55%) Perl
Qualifications
1 23 (12.57%) Degree
2 16 (8.74%) Computer Science Degree
3 4 (2.19%) Master's Degree
3 4 (2.19%) PhD
4 2 (1.09%) SC Cleared
4 2 (1.09%) Security Cleared
5 1 (0.55%) BPSS Clearance
5 1 (0.55%) SAS Certification
Quality Assurance & Compliance
1 11 (6.01%) Data Quality
2 10 (5.46%) QA
3 1 (0.55%) GDPR
System Software
1 26 (14.21%) Docker
2 10 (5.46%) Apache ZooKeeper
3 6 (3.28%) HDFS
4 4 (2.19%) VMware Infrastructure
5 3 (1.64%) Apache Flume
6 1 (0.55%) Virtual Machines
6 1 (0.55%) VirtualBox
Systems Management
1 49 (26.78%) Kubernetes
2 19 (10.38%) Ansible
3 13 (7.10%) Puppet
4 7 (3.83%) Prometheus
4 7 (3.83%) Terraform
5 3 (1.64%) Opscode Chef
6 2 (1.09%) Docker Swarm
6 2 (1.09%) HAProxy
7 1 (0.55%) Control-M
7 1 (0.55%) Grafana
7 1 (0.55%) Graphite
7 1 (0.55%) Salt
7 1 (0.55%) ZABBIX
Vendors
1 18 (9.84%) Oracle
2 15 (8.20%) Talend
3 9 (4.92%) Databricks
4 7 (3.83%) Cloudera
5 4 (2.19%) VMware
6 3 (1.64%) Google
6 3 (1.64%) Informatica
6 3 (1.64%) Microsoft
7 2 (1.09%) Hortonworks
7 2 (1.09%) Splunk
8 1 (0.55%) Alteryx
8 1 (0.55%) DataFlux
8 1 (0.55%) F5
8 1 (0.55%) IBM