Period
to 28 May 2020

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 28 May 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
28 May 2020
Same period 2019 Same period 2018
Rank 120 172 131
Rank change year-on-year +52 -41 +31
Permanent jobs citing Hadoop 147 170 251
As % of all permanent jobs advertised in the City of London 2.15% 1.69% 2.36%
As % of the Database & Business Intelligence category 9.05% 5.48% 7.54%
Number of salaries quoted 139 142 251
Median annual salary £75,000 £75,000 £75,000
10th Percentile £55,000 £49,337 £55,000
90th Percentile £113,750 £113,625 £108,750
Central London median annual salary £75,000 £76,000 £75,000
% change year-on-year -1.32% +1.33% +3.45%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,624 3,105 3,330
As % of all permanent IT jobs advertised in the City of London 23.75% 30.90% 31.35%
Number of salaries quoted 1,410 2,810 2,974
Median annual salary £67,500 £67,500 £65,000
Median salary % change year-on-year - +3.85% +8.33%
10th Percentile £42,461 £41,250 £41,250
90th Percentile £100,000 £97,500 £90,000
Central London median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% +4.17%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

Salary distribution for jobs citing Hadoop in the City of London over the 6 months to 28 May 2020.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 28 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 8 £65,000 - 1
Hadoop
Central London

For the 6 months to 28 May 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 99 (67.35%) Apache Spark
2 95 (64.63%) Big Data
3 86 (58.50%) Python
4 75 (51.02%) SQL
5 74 (50.34%) Kafka
6 70 (47.62%) Java
7 60 (40.82%) AWS
8 53 (36.05%) Scala
9 52 (35.37%) NoSQL
10 51 (34.69%) Agile Software Development
11 43 (29.25%) Azure
12 42 (28.57%) Artificial Intelligence
13 41 (27.89%) Apache Hive
13 41 (27.89%) Apache Cassandra
14 39 (26.53%) Kubernetes
15 38 (25.85%) Data Science
15 38 (25.85%) Machine Learning
16 35 (23.81%) Microservices
17 34 (23.13%) DevOps
18 32 (21.77%) Analytics
18 32 (21.77%) Git (software)
19 30 (20.41%) MongoDB
19 30 (20.41%) JavaScript
20 29 (19.73%) ETL
20 29 (19.73%) Finance
20 29 (19.73%) Computer Science
21 28 (19.05%) Degree
22 27 (18.37%) Docker
22 27 (18.37%) Fintech
23 26 (17.69%) Data Warehouse

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 99 (67.35%) Apache Spark
2 25 (17.01%) Apache
3 13 (8.84%) Apache Airflow
4 11 (7.48%) Luigi
5 9 (6.12%) Elasticsearch
6 8 (5.44%) SAS
7 4 (2.72%) Apache Pig
8 3 (2.04%) IBM Domino
9 1 (0.68%) Confluence
Cloud Services
1 60 (40.82%) AWS
2 43 (29.25%) Azure
3 22 (14.97%) GCP
4 14 (9.52%) Amazon S3
5 13 (8.84%) Amazon EMR
6 7 (4.76%) SaaS
7 6 (4.08%) Cloud Computing
7 6 (4.08%) OpenShift
8 5 (3.40%) Amazon EC2
8 5 (3.40%) Serverless
9 4 (2.72%) Amazon Kinesis
10 3 (2.04%) AWS IoT
10 3 (2.04%) Firebase
10 3 (2.04%) Power Platform
11 2 (1.36%) Azure Data Factory
11 2 (1.36%) GitHub
12 1 (0.68%) Amazon CloudWatch
12 1 (0.68%) Amazon SQS
12 1 (0.68%) AWS Lambda
12 1 (0.68%) IBM Cloud
Communications & Networking
1 5 (3.40%) HTTP
2 2 (1.36%) Firewall
Database & Business Intelligence
1 95 (64.63%) Big Data
2 52 (35.37%) NoSQL
3 41 (27.89%) Apache Cassandra
3 41 (27.89%) Apache Hive
4 30 (20.41%) MongoDB
5 26 (17.69%) Data Warehouse
6 19 (12.93%) Amazon Redshift
7 17 (11.56%) PostgreSQL
8 14 (9.52%) HBase
9 13 (8.84%) Relational Database
9 13 (8.84%) SQL Server
10 12 (8.16%) RDBMS
11 9 (6.12%) BigQuery
12 7 (4.76%) HDInsight
13 6 (4.08%) Amazon DynamoDB
13 6 (4.08%) Electronic Patient Records
13 6 (4.08%) Sqoop
14 5 (3.40%) Impala
15 4 (2.72%) Azkaban
15 4 (2.72%) Data Lake
Development Applications
1 32 (21.77%) Git (software)
2 20 (13.61%) Jenkins
3 6 (4.08%) Bitbucket
3 6 (4.08%) Maven
4 5 (3.40%) JIRA
4 5 (3.40%) JUnit
5 4 (2.72%) Artifactory
5 4 (2.72%) Atlassian Bamboo
5 4 (2.72%) Octopus Deploy
5 4 (2.72%) TeamCity
6 3 (2.04%) Visual Studio Team System
7 2 (1.36%) Gradle
8 1 (0.68%) GoCD
8 1 (0.68%) JMeter
8 1 (0.68%) Vagrant
General
1 29 (19.73%) Finance
2 14 (9.52%) Marketing
3 9 (6.12%) Banking
3 9 (6.12%) Retail
4 3 (2.04%) Advertising
5 2 (1.36%) Games
5 2 (1.36%) Investment Banking
5 2 (1.36%) Manufacturing
5 2 (1.36%) Retail Banking
6 1 (0.68%) Automotive
6 1 (0.68%) Back Office
6 1 (0.68%) Front Office
6 1 (0.68%) Law
6 1 (0.68%) Legal
6 1 (0.68%) Pharmaceutical
6 1 (0.68%) Publishing
6 1 (0.68%) Telecoms
Job Titles
1 51 (34.69%) Developer
2 49 (33.33%) Data Engineer
3 29 (19.73%) Java Developer
4 17 (11.56%) Scala Developer
5 11 (7.48%) Apache Spark Developer
5 11 (7.48%) Data Scientist
5 11 (7.48%) Full Stack Developer
6 9 (6.12%) Big Data Engineer
6 9 (6.12%) Senior Data Engineer
7 8 (5.44%) Java Scala Developer
7 8 (5.44%) JavaScript Developer
8 7 (4.76%) Automation Developer
9 6 (4.08%) Senior Developer
10 5 (3.40%) Architect
10 5 (3.40%) Software Engineer
11 4 (2.72%) Hadoop Developer
11 4 (2.72%) Python Developer
11 4 (2.72%) Senior Java Developer
11 4 (2.72%) Software Architect
11 4 (2.72%) Technical Architect
Libraries, Frameworks & Software Standards
1 74 (50.34%) Kafka
2 16 (10.88%) React
3 15 (10.20%) Node.js
3 15 (10.20%) RESTful
4 12 (8.16%) CSS
4 12 (8.16%) HTML
5 11 (7.48%) .NET
5 11 (7.48%) Apache Beam
6 9 (6.12%) AngularJS
6 9 (6.12%) HTML5
6 9 (6.12%) JSON
7 8 (5.44%) .NET Core
7 8 (5.44%) Spring
8 7 (4.76%) GraphQL
8 7 (4.76%) REST
9 6 (4.08%) ActiveMQ
9 6 (4.08%) Apache Thrift
9 6 (4.08%) Elastic Stack
9 6 (4.08%) JMS
9 6 (4.08%) Natural Language Processing
Miscellaneous
1 11 (7.48%) Mobile App
2 10 (6.80%) Algorithms
2 10 (6.80%) Greenfield Project
3 8 (5.44%) Cloud Native
3 8 (5.44%) Self-Motivation
4 4 (2.72%) Analytical Skills
4 4 (2.72%) Social Media
5 3 (2.04%) Hedge funds
6 2 (1.36%) Blog
6 2 (1.36%) Equities
6 2 (1.36%) Foreign Exchange (FX)
6 2 (1.36%) Hybrid Cloud
6 2 (1.36%) Market Risk
6 2 (1.36%) Semantic Web
6 2 (1.36%) Taxonomies
7 1 (0.68%) Acoustics
7 1 (0.68%) Client/Server
7 1 (0.68%) Data Structures
7 1 (0.68%) Derivative
7 1 (0.68%) Public Cloud
Operating Systems
1 10 (6.80%) Linux
2 4 (2.72%) Unix
2 4 (2.72%) Windows
3 2 (1.36%) CentOS
4 1 (0.68%) Windows Server
Processes & Methodologies
1 51 (34.69%) Agile Software Development
2 42 (28.57%) Artificial Intelligence
3 38 (25.85%) Data Science
3 38 (25.85%) Machine Learning
4 35 (23.81%) Microservices
5 34 (23.13%) DevOps
6 32 (21.77%) Analytics
7 29 (19.73%) Computer Science
7 29 (19.73%) ETL
8 27 (18.37%) Fintech
9 24 (16.33%) Data Engineering
10 20 (13.61%) TDD
11 16 (10.88%) Software Engineering
12 15 (10.20%) Continuous Integration
12 15 (10.20%) Multithreading
12 15 (10.20%) OO
12 15 (10.20%) Open Source
13 13 (8.84%) Problem-Solving
14 12 (8.16%) Data Modelling
14 12 (8.16%) Project Delivery
Programming Languages
1 86 (58.50%) Python
2 75 (51.02%) SQL
3 70 (47.62%) Java
4 53 (36.05%) Scala
5 30 (20.41%) JavaScript
6 19 (12.93%) C#
7 17 (11.56%) Go
8 15 (10.20%) R
9 14 (9.52%) Kotlin
10 13 (8.84%) Java 8
11 12 (8.16%) PHP
12 9 (6.12%) ES6
12 9 (6.12%) TypeScript
13 7 (4.76%) C++
14 5 (3.40%) PL/SQL
15 3 (2.04%) Bash Shell
15 3 (2.04%) Ruby
15 3 (2.04%) Shell Script
15 3 (2.04%) T-SQL
16 2 (1.36%) PowerShell
Qualifications
1 28 (19.05%) Degree
2 21 (14.29%) Computer Science Degree
3 1 (0.68%) Numerate Degree
Quality Assurance & Compliance
1 5 (3.40%) Data Quality
2 1 (0.68%) QA
System Software
1 27 (18.37%) Docker
2 9 (6.12%) HDFS
3 8 (5.44%) Apache ZooKeeper
4 5 (3.40%) Apache Flume
5 2 (1.36%) VMware Infrastructure
6 1 (0.68%) VirtualBox
Systems Management
1 39 (26.53%) Kubernetes
2 20 (13.61%) Ansible
3 11 (7.48%) Terraform
4 8 (5.44%) Puppet
5 6 (4.08%) Opscode Chef
6 5 (3.40%) Salt
7 4 (2.72%) Prometheus
8 3 (2.04%) Hadoop YARN
9 2 (1.36%) Oozie
9 2 (1.36%) ZABBIX
10 1 (0.68%) Docker Swarm
10 1 (0.68%) Nagios
10 1 (0.68%) Zipkin
Vendors
1 14 (9.52%) Oracle
2 13 (8.84%) Google
3 10 (6.80%) Cloudera
4 7 (4.76%) Tableau
5 6 (4.08%) Hortonworks
6 5 (3.40%) Databricks
6 5 (3.40%) Splunk
7 4 (2.72%) Microsoft
8 3 (2.04%) MapR
9 2 (1.36%) Facebook
9 2 (1.36%) VMware
10 1 (0.68%) Alteryx
10 1 (0.68%) Foundry
10 1 (0.68%) IBM
10 1 (0.68%) Netezza
10 1 (0.68%) Palantir
10 1 (0.68%) Talend
10 1 (0.68%) Teradata