Period
to 13 April 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 13 April 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
13 Apr 2021
Same period 2020 Same period 2019
Rank 86 136 184
Rank change year-on-year +50 +48 -54
Permanent jobs citing Hadoop 163 171 161
As % of all permanent jobs advertised in the City of London 3.36% 2.01% 1.57%
As % of the Database & Business Intelligence category 11.44% 8.29% 5.11%
Number of salaries quoted 152 157 142
10th Percentile £52,500 £54,000 £49,337
25th Percentile £57,500 £60,000 £56,563
Median annual salary (50th Percentile) £80,000 £72,500 £75,000
Median % change year-on-year +10.34% -3.33% -
75th Percentile £110,000 £87,500 £97,500
90th Percentile £112,500 £107,750 £111,250
Central London median annual salary £80,000 £72,500 £75,000
% change year-on-year +10.34% -3.33% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,425 2,062 3,148
As % of all permanent IT jobs advertised in the City of London 29.34% 24.22% 30.68%
Number of salaries quoted 1,244 1,816 2,841
10th Percentile £44,300 £42,500 £41,250
25th Percentile £53,750 £51,250 £51,250
Median annual salary (50th Percentile) £72,500 £67,500 £67,500
Median % change year-on-year +7.41% - +8.00%
75th Percentile £88,750 £83,750 £82,500
90th Percentile £105,000 £100,000 £97,500
Central London median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +8.33%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

Salary distribution for jobs citing Hadoop in the City of London over the 6 months to 13 April 2021.

Salary histogram for Hadoop in the City of London

For the 6 months to 13 April 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 114 (69.94%) Java
2 112 (68.71%) Big Data
3 91 (55.83%) Apache Spark
4 76 (46.63%) AWS
5 68 (41.72%) Python
6 65 (39.88%) SQL
7 63 (38.65%) Agile Software Development
8 56 (34.36%) Analytics
9 54 (33.13%) Kafka
10 51 (31.29%) Azure
11 49 (30.06%) Data Engineering
12 48 (29.45%) Kubernetes
13 40 (24.54%) Data Science
14 39 (23.93%) DevOps
14 39 (23.93%) Open Source
15 38 (23.31%) NoSQL
16 36 (22.09%) GCP
17 35 (21.47%) Amazon Redshift
17 35 (21.47%) Apache Hive
18 33 (20.25%) ETL
19 32 (19.63%) Artificial Intelligence
19 32 (19.63%) Finance
20 31 (19.02%) Software Engineering
21 30 (18.40%) MongoDB
22 29 (17.79%) Apache Cassandra
22 29 (17.79%) Microservices
22 29 (17.79%) Degree
23 28 (17.18%) Docker
24 27 (16.56%) Computer Science
25 26 (15.95%) Scala

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 91 (55.83%) Apache Spark
2 21 (12.88%) SAS
3 11 (6.75%) Apache
3 11 (6.75%) Apache Airflow
4 5 (3.07%) Elasticsearch
5 2 (1.23%) OpenStack
Business Applications
1 1 (0.61%) SAP APO
Cloud Services
1 76 (46.63%) AWS
2 51 (31.29%) Azure
3 36 (22.09%) GCP
4 14 (8.59%) Power Platform
5 9 (5.52%) Amazon SageMaker
6 8 (4.91%) SaaS
7 6 (3.68%) Amazon EC2
8 5 (3.07%) PaaS
9 4 (2.45%) Amazon EMR
9 4 (2.45%) IaaS
10 3 (1.84%) Azure Data Factory
10 3 (1.84%) Matillion
10 3 (1.84%) OpenShift
11 2 (1.23%) Amazon Kinesis
11 2 (1.23%) Amazon S3
11 2 (1.23%) Cloud Computing
12 1 (0.61%) AWS Lambda
12 1 (0.61%) Azure Machine Learning
12 1 (0.61%) Serverless
12 1 (0.61%) Slack
Communications & Networking
1 6 (3.68%) HTTP
2 2 (1.23%) Firewall
Database & Business Intelligence
1 112 (68.71%) Big Data
2 38 (23.31%) NoSQL
3 35 (21.47%) Amazon Redshift
3 35 (21.47%) Apache Hive
4 30 (18.40%) MongoDB
5 29 (17.79%) Apache Cassandra
6 22 (13.50%) BigQuery
7 17 (10.43%) Data Lake
7 17 (10.43%) Data Warehouse
8 14 (8.59%) Power BI
9 13 (7.98%) Oracle Database
9 13 (7.98%) Pentaho
10 12 (7.36%) SQL Server
11 11 (6.75%) Presto
12 10 (6.13%) Tableau
13 9 (5.52%) Impala
14 8 (4.91%) BusinessObjects
15 7 (4.29%) Amazon RDS
15 7 (4.29%) Data Mining
16 6 (3.68%) Relational Database
Development Applications
1 25 (15.34%) Git (software)
2 17 (10.43%) Jenkins
3 11 (6.75%) Maven
4 8 (4.91%) Atlassian Bamboo
4 8 (4.91%) Bitbucket
5 6 (3.68%) Artifactory
6 5 (3.07%) Gradle
7 3 (1.84%) JIRA
7 3 (1.84%) JMeter
7 3 (1.84%) JUnit
7 3 (1.84%) REST Assured
8 2 (1.23%) ER Studio
8 2 (1.23%) ERwin
8 2 (1.23%) PowerDesigner
8 2 (1.23%) Selenium
8 2 (1.23%) SonarQube
8 2 (1.23%) WebDriver
9 1 (0.61%) Team Foundation Server
9 1 (0.61%) TeamCity
9 1 (0.61%) Visual Studio
General
1 32 (19.63%) Finance
2 17 (10.43%) Banking
3 11 (6.75%) Marketing
4 7 (4.29%) Games
5 4 (2.45%) Advertising
5 4 (2.45%) Front Office
6 1 (0.61%) Retail Banking
Job Titles
1 51 (31.29%) Developer
2 45 (27.61%) Java Developer
3 40 (24.54%) Data Engineer
4 32 (19.63%) Big Data Engineer
5 24 (14.72%) Java Engineer
6 20 (12.27%) Software Engineer
7 19 (11.66%) Java Software Engineer
8 18 (11.04%) Big Data Software Engineer
8 18 (11.04%) Data Analytics Engineer
8 18 (11.04%) Data Scientist
9 9 (5.52%) Cloud Engineer
9 9 (5.52%) Hadoop Engineer
9 9 (5.52%) Senior Data Scientist
10 8 (4.91%) AWS Engineer
11 7 (4.29%) Architect
11 7 (4.29%) Software Manager
12 5 (3.07%) Big Data Manager
12 5 (3.07%) Engineering Manager
12 5 (3.07%) Senior Developer
12 5 (3.07%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 54 (33.13%) Kafka
2 20 (12.27%) ActiveMQ
2 20 (12.27%) JMS
3 18 (11.04%) HTML
3 18 (11.04%) RESTful
4 17 (10.43%) AngularJS
4 17 (10.43%) CSS
5 16 (9.82%) HTML5
5 16 (9.82%) React
6 14 (8.59%) Node.js
7 8 (4.91%) Natural Language Processing
7 8 (4.91%) TensorFlow
8 5 (3.07%) Apache Thrift
8 5 (3.07%) Web Services
9 4 (2.45%) Spring
10 3 (1.84%) Akka
10 3 (1.84%) JSON
10 3 (1.84%) REST
11 2 (1.23%) Spark Streaming
11 2 (1.23%) Spring Boot
Miscellaneous
1 20 (12.27%) Self-Motivation
2 10 (6.13%) Algorithms
2 10 (6.13%) Public Cloud
3 9 (5.52%) Analytical Skills
4 4 (2.45%) Private Cloud
5 3 (1.84%) Data Structures
5 3 (1.84%) Greenfield Project
5 3 (1.84%) Management Information System
6 1 (0.61%) Data Centre
6 1 (0.61%) Derivative
6 1 (0.61%) Equities
6 1 (0.61%) Equity Derivative
6 1 (0.61%) Fixed Income
6 1 (0.61%) Reinsurance
6 1 (0.61%) Wiki
Operating Systems
1 10 (6.13%) Linux
2 9 (5.52%) Unix
3 2 (1.23%) CentOS
4 1 (0.61%) Windows
Processes & Methodologies
1 63 (38.65%) Agile Software Development
2 56 (34.36%) Analytics
3 49 (30.06%) Data Engineering
4 40 (24.54%) Data Science
5 39 (23.93%) DevOps
5 39 (23.93%) Open Source
6 33 (20.25%) ETL
7 32 (19.63%) Artificial Intelligence
8 31 (19.02%) Software Engineering
9 29 (17.79%) Microservices
10 27 (16.56%) Computer Science
11 24 (14.72%) Multithreading
12 22 (13.50%) TDD
13 20 (12.27%) Business Intelligence
13 20 (12.27%) OO
14 19 (11.66%) Data Analytics
15 18 (11.04%) Machine Learning
16 17 (10.43%) Project Delivery
17 15 (9.20%) Visualisation
18 13 (7.98%) Data Visualisation
Programming Languages
1 114 (69.94%) Java
2 68 (41.72%) Python
3 65 (39.88%) SQL
4 26 (15.95%) Scala
5 25 (15.34%) JavaScript
6 23 (14.11%) Java 8
7 20 (12.27%) C#
8 18 (11.04%) R
9 17 (10.43%) Kotlin
10 16 (9.82%) ES6
10 16 (9.82%) PHP
10 16 (9.82%) TypeScript
11 13 (7.98%) PL/SQL
12 7 (4.29%) HiveQL
12 7 (4.29%) Shell Script
13 6 (3.68%) Bash Shell
14 1 (0.61%) Julia
14 1 (0.61%) T-SQL
Qualifications
1 29 (17.79%) Degree
2 19 (11.66%) Computer Science Degree
3 16 (9.82%) PhD
Quality Assurance & Compliance
1 6 (3.68%) QA
2 1 (0.61%) Data Quality
2 1 (0.61%) GDPR
System Software
1 28 (17.18%) Docker
2 8 (4.91%) HDFS
3 6 (3.68%) Apache ZooKeeper
4 3 (1.84%) Apache Flume
4 3 (1.84%) VMware Infrastructure
Systems Management
1 48 (29.45%) Kubernetes
2 14 (8.59%) Ansible
3 10 (6.13%) Terraform
4 5 (3.07%) Puppet
5 2 (1.23%) Prometheus
5 2 (1.23%) ZABBIX
Vendors
1 19 (11.66%) Talend
2 17 (10.43%) Oracle
3 16 (9.82%) Cloudera
4 12 (7.36%) Informatica
5 9 (5.52%) Databricks
6 5 (3.07%) Google
6 5 (3.07%) Microsoft
7 3 (1.84%) Intel
7 3 (1.84%) NVIDIA
7 3 (1.84%) VMware
8 2 (1.23%) Splunk
9 1 (0.61%) IBM
9 1 (0.61%) Palantir
9 1 (0.61%) SAP
9 1 (0.61%) Teradata