Period
to 20 January 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 20 January 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
20 Jan 2021
Same period 2020 Same period 2019
Rank 96 143 178
Rank change year-on-year +47 +35 -51
Permanent jobs citing Hadoop 134 187 174
As % of all permanent jobs advertised in the City of London 3.11% 2.05% 1.71%
As % of the Database & Business Intelligence category 10.34% 7.49% 5.67%
Number of salaries quoted 143 178 169
Median annual salary £80,000 £75,000 £77,500
Median salary % change year-on-year +6.67% -3.23% +3.33%
10th Percentile £52,500 £57,500 £47,500
90th Percentile £110,000 £112,500 £105,000
Central London median annual salary £80,000 £75,000 £75,000
% change year-on-year +6.67% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,296 2,495 3,069
As % of all permanent IT jobs advertised in the City of London 30.04% 27.31% 30.25%
Number of salaries quoted 1,088 2,219 2,775
Median annual salary £72,500 £67,500 £65,000
Median salary % change year-on-year +7.41% +3.85% +8.33%
10th Percentile £45,750 £42,500 £41,250
90th Percentile £103,750 £102,500 £96,250
Central London median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +8.33%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

Salary distribution for jobs citing Hadoop in the City of London over the 6 months to 20 January 2021.

Salary histogram for Hadoop in the City of London

For the 6 months to 20 January 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 88 (65.67%) Big Data
2 82 (61.19%) Java
3 66 (49.25%) AWS
3 66 (49.25%) Apache Spark
4 62 (46.27%) Python
5 58 (43.28%) Azure
6 49 (36.57%) SQL
6 49 (36.57%) Agile Software Development
7 43 (32.09%) ETL
7 43 (32.09%) Analytics
8 40 (29.85%) Kafka
9 39 (29.10%) Kubernetes
10 38 (28.36%) Data Science
11 33 (24.63%) GCP
12 30 (22.39%) Data Engineering
12 30 (22.39%) Apache Cassandra
13 29 (21.64%) SAS
14 28 (20.90%) Degree
15 27 (20.15%) Scala
15 27 (20.15%) Cloudera
16 26 (19.40%) Machine Learning
16 26 (19.40%) Apache Hive
17 25 (18.66%) MongoDB
18 24 (17.91%) R
18 24 (17.91%) NoSQL
19 23 (17.16%) Talend
19 23 (17.16%) Business Intelligence
19 23 (17.16%) Oracle
20 22 (16.42%) Computer Science
20 22 (16.42%) Artificial Intelligence

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 66 (49.25%) Apache Spark
2 29 (21.64%) SAS
3 13 (9.70%) Apache
3 13 (9.70%) Apache Airflow
4 7 (5.22%) Elasticsearch
5 1 (0.75%) Apache Pig
5 1 (0.75%) CMS
5 1 (0.75%) SharePoint
Business Applications
1 1 (0.75%) SAP APO
Cloud Services
1 66 (49.25%) AWS
2 58 (43.28%) Azure
3 33 (24.63%) GCP
4 21 (15.67%) Power Platform
5 10 (7.46%) Amazon SageMaker
6 5 (3.73%) IaaS
6 5 (3.73%) PaaS
7 3 (2.24%) Amazon EMR
7 3 (2.24%) Amazon Kinesis
7 3 (2.24%) Azure Data Factory
7 3 (2.24%) OpenShift
7 3 (2.24%) SaaS
8 2 (1.49%) Amazon EC2
8 2 (1.49%) Amazon S3
8 2 (1.49%) Serverless
9 1 (0.75%) AWS Lambda
9 1 (0.75%) Azure Machine Learning
9 1 (0.75%) Power Automate
9 1 (0.75%) PowerApps
9 1 (0.75%) Slack
Communications & Networking
1 4 (2.99%) Firewall
2 2 (1.49%) HTTP
3 1 (0.75%) HTTPS
3 1 (0.75%) Kerberos
3 1 (0.75%) Network Security
3 1 (0.75%) SSL
Database & Business Intelligence
1 88 (65.67%) Big Data
2 30 (22.39%) Apache Cassandra
3 26 (19.40%) Apache Hive
4 25 (18.66%) MongoDB
5 24 (17.91%) NoSQL
6 22 (16.42%) Amazon Redshift
7 21 (15.67%) Power BI
8 19 (14.18%) Oracle Database
8 19 (14.18%) Pentaho
9 13 (9.70%) Presto
10 12 (8.96%) Data Warehouse
10 12 (8.96%) SQL Server
10 12 (8.96%) Tableau
11 11 (8.21%) BusinessObjects
11 11 (8.21%) Impala
12 10 (7.46%) BigQuery
12 10 (7.46%) Data Lake
12 10 (7.46%) PostgreSQL
13 8 (5.97%) Bigtable
14 7 (5.22%) Data Mining
Development Applications
1 22 (16.42%) Git (software)
2 13 (9.70%) Jenkins
3 12 (8.96%) Bitbucket
3 12 (8.96%) Maven
4 9 (6.72%) Artifactory
5 3 (2.24%) Atlassian Bamboo
5 3 (2.24%) Gradle
6 2 (1.49%) JIRA
7 1 (0.75%) ER Studio
7 1 (0.75%) ERwin
7 1 (0.75%) PowerDesigner
7 1 (0.75%) Team Foundation Server
7 1 (0.75%) Visual Studio
General
1 20 (14.93%) Finance
2 7 (5.22%) Banking
2 7 (5.22%) Marketing
3 5 (3.73%) Games
4 2 (1.49%) Advertising
4 2 (1.49%) Front Office
5 1 (0.75%) Legal
5 1 (0.75%) Public Sector
Job Titles
1 43 (32.09%) Developer
2 36 (26.87%) Data Engineer
3 35 (26.12%) Java Developer
4 20 (14.93%) Big Data Engineer
5 19 (14.18%) Data Scientist
6 17 (12.69%) Java Engineer
7 14 (10.45%) Architect
8 12 (8.96%) Data Architect
9 11 (8.21%) Senior Data Scientist
10 8 (5.97%) Big Data Developer
11 7 (5.22%) Big Data Architect
11 7 (5.22%) Java Architect
11 7 (5.22%) Software Engineer
12 6 (4.48%) Big Data Software Engineer
12 6 (4.48%) Data Analytics Engineer
12 6 (4.48%) Java Software Engineer
12 6 (4.48%) Scala Developer
13 5 (3.73%) Data Manager
13 5 (3.73%) Kubernetes Engineer
13 5 (3.73%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 40 (29.85%) Kafka
2 19 (14.18%) ActiveMQ
2 19 (14.18%) JMS
3 15 (11.19%) RESTful
4 12 (8.96%) Natural Language Processing
5 11 (8.21%) TensorFlow
6 10 (7.46%) CSS
6 10 (7.46%) HTML
6 10 (7.46%) React
7 8 (5.97%) AngularJS
7 8 (5.97%) HTML5
7 8 (5.97%) Node.js
7 8 (5.97%) PySpark
7 8 (5.97%) Spring
8 7 (5.22%) Apache Beam
9 6 (4.48%) scikit-learn
10 5 (3.73%) Matplotlib
10 5 (3.73%) NumPy
10 5 (3.73%) PyTorch
10 5 (3.73%) SciPy
Miscellaneous
1 19 (14.18%) Algorithms
1 19 (14.18%) Self-Motivation
2 6 (4.48%) Public Cloud
3 5 (3.73%) Analytical Skills
3 5 (3.73%) Mobile App
4 2 (1.49%) Management Information System
5 1 (0.75%) Data Centre
5 1 (0.75%) Derivative
5 1 (0.75%) Equities
5 1 (0.75%) Private Cloud
5 1 (0.75%) Reference Data
5 1 (0.75%) Reinsurance
5 1 (0.75%) Wiki
Operating Systems
1 11 (8.21%) Unix
2 9 (6.72%) Linux
3 3 (2.24%) CentOS
4 1 (0.75%) Windows
Processes & Methodologies
1 49 (36.57%) Agile Software Development
2 43 (32.09%) Analytics
2 43 (32.09%) ETL
3 38 (28.36%) Data Science
4 30 (22.39%) Data Engineering
5 26 (19.40%) Machine Learning
6 23 (17.16%) Business Intelligence
7 22 (16.42%) Artificial Intelligence
7 22 (16.42%) Computer Science
7 22 (16.42%) Visualisation
8 21 (15.67%) Software Engineering
9 19 (14.18%) Data Visualisation
9 19 (14.18%) Multithreading
9 19 (14.18%) Requirements Gathering
10 18 (13.43%) Data Analytics
11 17 (12.69%) DevOps
11 17 (12.69%) Open Source
11 17 (12.69%) Scrum
12 16 (11.94%) Statistics
12 16 (11.94%) TDD
Programming Languages
1 82 (61.19%) Java
2 62 (46.27%) Python
3 49 (36.57%) SQL
4 27 (20.15%) Scala
5 24 (17.91%) R
6 21 (15.67%) JavaScript
7 19 (14.18%) Java 8
7 19 (14.18%) PL/SQL
8 14 (10.45%) C#
9 10 (7.46%) HiveQL
9 10 (7.46%) Shell Script
10 9 (6.72%) PHP
11 8 (5.97%) ES6
11 8 (5.97%) Kotlin
11 8 (5.97%) TypeScript
12 5 (3.73%) MATLAB
13 4 (2.99%) Bash Shell
14 2 (1.49%) C++
15 1 (0.75%) Julia
15 1 (0.75%) T-SQL
Qualifications
1 28 (20.90%) Degree
2 16 (11.94%) Computer Science Degree
3 14 (10.45%) PhD
4 5 (3.73%) Master's Degree
5 1 (0.75%) SC Cleared
5 1 (0.75%) Security Cleared
Quality Assurance & Compliance
1 4 (2.99%) QA
2 2 (1.49%) Data Quality
System Software
1 16 (11.94%) Docker
2 12 (8.96%) HDFS
3 3 (2.24%) Apache ZooKeeper
3 3 (2.24%) VMware Infrastructure
4 2 (1.49%) Apache Flume
Systems Management
1 39 (29.10%) Kubernetes
2 21 (15.67%) Terraform
3 14 (10.45%) Ansible
4 4 (2.99%) Puppet
5 3 (2.24%) Prometheus
5 3 (2.24%) ZABBIX
6 1 (0.75%) Ambari
6 1 (0.75%) Hadoop YARN
6 1 (0.75%) Oozie
6 1 (0.75%) Opscode Chef
6 1 (0.75%) Single Sign-On
Vendors
1 27 (20.15%) Cloudera
2 23 (17.16%) Oracle
2 23 (17.16%) Talend
3 16 (11.94%) Informatica
4 14 (10.45%) Databricks
5 6 (4.48%) Google
6 5 (3.73%) Microsoft
7 4 (2.99%) NVIDIA
7 4 (2.99%) Splunk
8 3 (2.24%) Intel
8 3 (2.24%) VMware
9 1 (0.75%) Ab Initio
9 1 (0.75%) Hortonworks
9 1 (0.75%) IBM
9 1 (0.75%) Palantir
9 1 (0.75%) SAP
9 1 (0.75%) Teradata
9 1 (0.75%) TIBCO