Period
to 27 September 2020

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 27 September 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
27 Sep 2020
Same period 2019 Same period 2018
Rank 96 142 153
Rank change year-on-year +46 +11 -12
Permanent jobs citing Hadoop 103 219 239
As % of all permanent jobs advertised in the City of London 2.78% 2.16% 2.17%
As % of the Database & Business Intelligence category 10.26% 7.03% 7.01%
Number of salaries quoted 112 197 220
Median annual salary £76,500 £77,500 £75,000
Median salary % change year-on-year -1.29% +3.33% +8.50%
10th Percentile £51,625 £55,000 £47,500
90th Percentile £110,000 £112,500 £105,250
Central London median annual salary £75,000 £77,500 £75,000
% change year-on-year -3.23% +3.33% +7.14%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,004 3,115 3,411
As % of all permanent IT jobs advertised in the City of London 27.14% 30.79% 30.95%
Number of salaries quoted 833 2,806 3,091
Median annual salary £70,000 £67,500 £65,000
Median salary % change year-on-year +3.70% +3.85% +8.33%
10th Percentile £42,500 £43,750 £40,000
90th Percentile £100,000 £98,750 £95,000
Central London median annual salary £70,000 £65,000 £65,000
% change year-on-year +7.69% - +8.33%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

Salary distribution for jobs citing Hadoop in the City of London over the 6 months to 27 September 2020.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 27 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate +2 4 £70,000 +16.67%
Hadoop
Central London

For the 6 months to 27 September 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 70 (67.96%) Big Data
2 60 (58.25%) Python
2 60 (58.25%) Apache Spark
3 57 (55.34%) Java
4 49 (47.57%) AWS
5 47 (45.63%) Kafka
6 46 (44.66%) Agile Software Development
7 39 (37.86%) Azure
8 35 (33.98%) SQL
9 34 (33.01%) Data Science
10 31 (30.10%) Apache Cassandra
10 31 (30.10%) Kubernetes
11 29 (28.16%) Scala
12 27 (26.21%) MongoDB
12 27 (26.21%) Machine Learning
13 26 (25.24%) Apache Hive
13 26 (25.24%) Artificial Intelligence
13 26 (25.24%) JavaScript
14 25 (24.27%) R
14 25 (24.27%) DevOps
15 24 (23.30%) Analytics
15 24 (23.30%) Computer Science
15 24 (23.30%) Finance
16 23 (22.33%) Multithreading
17 22 (21.36%) ETL
18 21 (20.39%) Git (software)
19 20 (19.42%) Tableau
19 20 (19.42%) JMS
19 20 (19.42%) Java 8
20 19 (18.45%) NoSQL

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 60 (58.25%) Apache Spark
2 17 (16.50%) SAS
3 14 (13.59%) Apache
4 6 (5.83%) Apache Airflow
4 6 (5.83%) Elasticsearch
5 3 (2.91%) Confluence
5 3 (2.91%) IBM Domino
5 3 (2.91%) Tomcat
6 1 (0.97%) Apache Pig
6 1 (0.97%) CMS
6 1 (0.97%) SharePoint
Cloud Services
1 49 (47.57%) AWS
2 39 (37.86%) Azure
3 17 (16.50%) Power Platform
4 16 (15.53%) GCP
5 11 (10.68%) Amazon S3
6 4 (3.88%) Amazon EMR
6 4 (3.88%) Amazon Kinesis
6 4 (3.88%) SaaS
6 4 (3.88%) Serverless
7 3 (2.91%) Amazon SQS
7 3 (2.91%) AWS Lambda
7 3 (2.91%) Azure Data Factory
8 2 (1.94%) Amazon ECS
8 2 (1.94%) Amazon ElastiCache
8 2 (1.94%) Amazon SageMaker
8 2 (1.94%) Azure Active Directory
8 2 (1.94%) IaaS
8 2 (1.94%) Logic Apps
8 2 (1.94%) OpenShift
8 2 (1.94%) PaaS
Communications & Networking
1 4 (3.88%) Firewall
1 4 (3.88%) HTTP
2 2 (1.94%) HTTPS
2 2 (1.94%) Kerberos
2 2 (1.94%) Network Security
2 2 (1.94%) SSL
3 1 (0.97%) TCP/IP
Database & Business Intelligence
1 70 (67.96%) Big Data
2 31 (30.10%) Apache Cassandra
3 27 (26.21%) MongoDB
4 26 (25.24%) Apache Hive
5 19 (18.45%) NoSQL
6 17 (16.50%) Power BI
6 17 (16.50%) SQL Server
7 11 (10.68%) Amazon Redshift
7 11 (10.68%) HBase
8 9 (8.74%) Presto
9 8 (7.77%) PostgreSQL
10 7 (6.80%) Data Mining
10 7 (6.80%) Impala
11 6 (5.83%) Oracle Database
11 6 (5.83%) Pentaho
11 6 (5.83%) RDBMS
11 6 (5.83%) Redis
11 6 (5.83%) Relational Database
12 5 (4.85%) Bigtable
12 5 (4.85%) Sqoop
Development Applications
1 21 (20.39%) Git (software)
2 7 (6.80%) Atlassian Bamboo
2 7 (6.80%) Bitbucket
3 6 (5.83%) Jenkins
4 4 (3.88%) JIRA
4 4 (3.88%) Maven
5 2 (1.94%) Gradle
5 2 (1.94%) JUnit
6 1 (0.97%) Artifactory
6 1 (0.97%) Cucumber
6 1 (0.97%) GoCD
6 1 (0.97%) JMeter
6 1 (0.97%) Octopus Deploy
6 1 (0.97%) TeamCity
General
1 24 (23.30%) Finance
2 11 (10.68%) Banking
3 8 (7.77%) Front Office
4 3 (2.91%) Advertising
5 2 (1.94%) Games
6 1 (0.97%) Legal
6 1 (0.97%) Manufacturing
6 1 (0.97%) Pharmaceutical
6 1 (0.97%) Public Sector
6 1 (0.97%) Retail
6 1 (0.97%) Retail Banking
6 1 (0.97%) Telecoms
Job Titles
1 49 (47.57%) Developer
2 33 (32.04%) Java Developer
3 18 (17.48%) Data Engineer
4 10 (9.71%) Data Scientist
5 9 (8.74%) Architect
5 9 (8.74%) Data Architect
5 9 (8.74%) Scala Developer
6 8 (7.77%) Java Engineer
7 7 (6.80%) AWS Engineer
7 7 (6.80%) Mid-Level Java Developer
8 6 (5.83%) Big Data Developer
8 6 (5.83%) Big Data Engineer
8 6 (5.83%) Data Manager
8 6 (5.83%) Full Stack Developer
8 6 (5.83%) JavaScript Developer
8 6 (5.83%) Senior Manager
9 5 (4.85%) Big Data Architect
9 5 (4.85%) Data Science Manager
9 5 (4.85%) Java Architect
9 5 (4.85%) Senior Developer
Libraries, Frameworks & Software Standards
1 47 (45.63%) Kafka
2 20 (19.42%) JMS
3 17 (16.50%) ActiveMQ
4 16 (15.53%) React
5 14 (13.59%) AngularJS
5 14 (13.59%) Natural Language Processing
6 13 (12.62%) Node.js
7 12 (11.65%) TensorFlow
8 11 (10.68%) RESTful
8 11 (10.68%) Spring
9 10 (9.71%) PySpark
10 9 (8.74%) Apache Beam
10 9 (8.74%) HTML
10 9 (8.74%) NumPy
10 9 (8.74%) Pandas
11 8 (7.77%) HTML5
12 7 (6.80%) CSS
12 7 (6.80%) Keras
12 7 (6.80%) PyTorch
12 7 (6.80%) scikit-learn
Miscellaneous
1 18 (17.48%) Self-Motivation
2 11 (10.68%) Algorithms
3 5 (4.85%) Analytical Skills
3 5 (4.85%) Mobile App
4 4 (3.88%) Cloud Native
4 4 (3.88%) Greenfield Project
5 3 (2.91%) Hedge funds
5 3 (2.91%) Market Risk
6 1 (0.97%) Data Centre
6 1 (0.97%) Derivative
6 1 (0.97%) Equities
6 1 (0.97%) FMCG
6 1 (0.97%) Reference Data
Operating Systems
1 10 (9.71%) Linux
2 8 (7.77%) Unix
3 3 (2.91%) Red Hat Enterprise Linux
4 2 (1.94%) CentOS
Processes & Methodologies
1 46 (44.66%) Agile Software Development
2 34 (33.01%) Data Science
3 27 (26.21%) Machine Learning
4 26 (25.24%) Artificial Intelligence
5 25 (24.27%) DevOps
6 24 (23.30%) Analytics
6 24 (23.30%) Computer Science
7 23 (22.33%) Multithreading
8 22 (21.36%) ETL
9 17 (16.50%) Software Engineering
10 16 (15.53%) Business Intelligence
11 15 (14.56%) Microservices
12 14 (13.59%) Continuous Integration
12 14 (13.59%) Mentoring
13 11 (10.68%) Mathematics
13 11 (10.68%) Reinforcement Learning
14 10 (9.71%) Continuous Delivery
14 10 (9.71%) Open Source
15 9 (8.74%) Data Analytics
15 9 (8.74%) Visualisation
Programming Languages
1 60 (58.25%) Python
2 57 (55.34%) Java
3 35 (33.98%) SQL
4 29 (28.16%) Scala
5 26 (25.24%) JavaScript
6 25 (24.27%) R
7 20 (19.42%) Java 8
8 16 (15.53%) C#
9 7 (6.80%) Kotlin
9 7 (6.80%) PHP
10 6 (5.83%) ES6
10 6 (5.83%) Go
10 6 (5.83%) MATLAB
10 6 (5.83%) PL/SQL
10 6 (5.83%) Shell Script
10 6 (5.83%) TypeScript
11 5 (4.85%) Bash Shell
11 5 (4.85%) HiveQL
12 3 (2.91%) C++
13 2 (1.94%) T-SQL
Qualifications
1 17 (16.50%) Degree
2 15 (14.56%) Computer Science Degree
3 6 (5.83%) Master's Degree
4 1 (0.97%) SC Cleared
4 1 (0.97%) Security Cleared
Quality Assurance & Compliance
1 5 (4.85%) QA
2 1 (0.97%) Data Quality
System Software
1 14 (13.59%) Docker
2 9 (8.74%) HDFS
3 4 (3.88%) Apache ZooKeeper
4 2 (1.94%) VMware Infrastructure
5 1 (0.97%) Apache Flume
5 1 (0.97%) Hyper-V
Systems Management
1 31 (30.10%) Kubernetes
2 10 (9.71%) Terraform
3 8 (7.77%) Ansible
4 3 (2.91%) Prometheus
4 3 (2.91%) Puppet
5 2 (1.94%) Single Sign-On
5 2 (1.94%) ZABBIX
6 1 (0.97%) Ambari
6 1 (0.97%) Hadoop YARN
6 1 (0.97%) Nagios
6 1 (0.97%) Oozie
6 1 (0.97%) Opscode Chef
Vendors
1 20 (19.42%) Tableau
2 14 (13.59%) Cloudera
3 11 (10.68%) Databricks
3 11 (10.68%) Oracle
4 9 (8.74%) Splunk
5 7 (6.80%) Informatica
6 6 (5.83%) Talend
7 3 (2.91%) Google
8 2 (1.94%) Hortonworks
8 2 (1.94%) NVIDIA
8 2 (1.94%) VMware
9 1 (0.97%) Alteryx
9 1 (0.97%) Atlassian
9 1 (0.97%) Automation Anywhere
9 1 (0.97%) Blue Prism
9 1 (0.97%) Foundry
9 1 (0.97%) MapR
9 1 (0.97%) Palantir
9 1 (0.97%) Teradata
9 1 (0.97%) UiPath