Period
to 24 January 2020

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 24 January 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
24 Jan 2020
Same period 2019 Same period 2018
Rank 150 167 120
Rank change year-on-year +17 -47 +13
Permanent jobs citing Hadoop 179 178 270
As % of all permanent IT jobs advertised in the City of London 1.95% 1.72% 2.56%
As % of the Database & Business Intelligence category 7.32% 5.73% 8.30%
Number of salaries quoted 166 163 255
City of London median annual salary £75,000 £75,000 £75,000
10th Percentile £57,500 £47,500 £52,500
90th Percentile £112,500 £105,000 £114,500
Central London median annual salary £75,000 £75,000 £75,000

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 2,446 3,108 3,254
As % of all permanent IT jobs advertised in the City of London 26.71% 30.09% 30.90%
Number of salaries quoted 2,152 2,795 2,919
City of London median annual salary £67,500 £65,000 £60,000
Median salary % change year-on-year +3.85% +8.33% +4.35%
10th Percentile £42,500 £41,250 £41,250
90th Percentile £102,500 £96,250 £88,750
Central London median annual salary £67,500 £65,000 £60,000
% change year-on-year +3.85% +8.33% +4.35%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

The salary distribution of IT jobs citing Hadoop in the City of London over the 6 months to 24 January 2020.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 24 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 4 £65,000 - 1
Hadoop
Central London

For the 6 months to 24 January 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 130 (72.63%) Apache Spark
2 115 (64.25%) Big Data
3 98 (54.75%) Python
4 97 (54.19%) Java
5 92 (51.40%) SQL
6 79 (44.13%) AWS
7 76 (42.46%) Azure
8 74 (41.34%) Scala
9 67 (37.43%) Apache Hive
10 64 (35.75%) Agile Software Development
11 59 (32.96%) Analytics
12 52 (29.05%) Docker
13 49 (27.37%) DevOps
13 49 (27.37%) Kubernetes
14 48 (26.82%) Kafka
15 46 (25.70%) Data Science
15 46 (25.70%) JavaScript
15 46 (25.70%) NoSQL
16 45 (25.14%) Machine Learning
17 44 (24.58%) Finance
18 42 (23.46%) Computer Science
19 40 (22.35%) Degree
20 38 (21.23%) Google
21 37 (20.67%) Artificial Intelligence
21 37 (20.67%) ETL
22 36 (20.11%) Data Engineering
23 33 (18.44%) Git (software)
24 30 (16.76%) Data Warehouse
24 30 (16.76%) Algorithms
25 29 (16.20%) Microservices

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 130 (72.63%) Apache Spark
2 16 (8.94%) Apache
3 11 (6.15%) Apache Airflow
4 10 (5.59%) SAS
5 7 (3.91%) Elasticsearch
6 6 (3.35%) Luigi
7 3 (1.68%) Apache Pig
8 1 (0.56%) Apache Solr
8 1 (0.56%) CMS
8 1 (0.56%) MQSeries
8 1 (0.56%) OpenStack
8 1 (0.56%) Oracle SOA Suite
8 1 (0.56%) WebSphere
8 1 (0.56%) WebSphere Application Server
Applications
1 1 (0.56%) Chatbot
Business Applications
1 1 (0.56%) FINCAD Analytics
Cloud Services
1 79 (44.13%) AWS
2 76 (42.46%) Azure
3 25 (13.97%) GCP
4 10 (5.59%) Amazon EMR
5 7 (3.91%) Amazon S3
6 5 (2.79%) Cloud Computing
6 5 (2.79%) GitHub
7 4 (2.23%) OpenShift
7 4 (2.23%) Power Platform
8 3 (1.68%) Amazon Kinesis
8 3 (1.68%) SaaS
8 3 (1.68%) Serverless
9 2 (1.12%) AWS IoT
9 2 (1.12%) Google Analytics
9 2 (1.12%) IBM Cloud
10 1 (0.56%) Amazon EC2
10 1 (0.56%) AWS Lambda
10 1 (0.56%) Azure Machine Learning
10 1 (0.56%) Heroku
10 1 (0.56%) Salesforce Service Cloud
Communications & Networking
1 7 (3.91%) Broadband
1 7 (3.91%) Internet
2 2 (1.12%) HTTP
2 2 (1.12%) Kerberos
Database & Business Intelligence
1 115 (64.25%) Big Data
2 67 (37.43%) Apache Hive
3 46 (25.70%) NoSQL
4 30 (16.76%) Data Warehouse
5 28 (15.64%) Apache Cassandra
6 17 (9.50%) Amazon Redshift
7 16 (8.94%) MongoDB
7 16 (8.94%) MySQL
8 15 (8.38%) HBase
9 13 (7.26%) Presto
10 12 (6.70%) PostgreSQL
11 9 (5.03%) Relational Database
12 8 (4.47%) Amazon Athena
12 8 (4.47%) Flink
12 8 (4.47%) Pentaho
12 8 (4.47%) SQL Server
13 7 (3.91%) BigQuery
13 7 (3.91%) HDInsight
13 7 (3.91%) Neo4j
14 6 (3.35%) Redis
Development Applications
1 33 (18.44%) Git (software)
2 18 (10.06%) Jenkins
3 12 (6.70%) Maven
4 8 (4.47%) Artifactory
4 8 (4.47%) Bitbucket
5 4 (2.23%) JIRA
6 2 (1.12%) SonarQube
6 2 (1.12%) TeamCity
7 1 (0.56%) Ant
7 1 (0.56%) Atlassian Bamboo
7 1 (0.56%) Gradle
7 1 (0.56%) IBM UrbanCode
7 1 (0.56%) Jasmine
7 1 (0.56%) JUnit
7 1 (0.56%) Mocha
7 1 (0.56%) Octopus Deploy
7 1 (0.56%) PVCS
7 1 (0.56%) Selenium
7 1 (0.56%) Vagrant
7 1 (0.56%) Visual Studio Team System
General
1 44 (24.58%) Finance
2 11 (6.15%) Banking
3 8 (4.47%) Retail
4 7 (3.91%) Marketing
5 5 (2.79%) Investment Banking
5 5 (2.79%) Public Sector
6 4 (2.23%) Manufacturing
7 3 (1.68%) Front Office
7 3 (1.68%) Legal
8 2 (1.12%) Electronics
8 2 (1.12%) Games
8 2 (1.12%) Telecoms
9 1 (0.56%) Advertising
9 1 (0.56%) Automotive
9 1 (0.56%) Back Office
9 1 (0.56%) Retail Banking
Job Titles
1 65 (36.31%) Data Engineer
2 62 (34.64%) Developer
3 36 (20.11%) Java Developer
4 21 (11.73%) Scala Developer
5 20 (11.17%) Senior Data Engineer
6 19 (10.61%) Apache Spark Developer
7 18 (10.06%) Architect
8 9 (5.03%) Applications Developer
8 9 (5.03%) Full Stack Developer
8 9 (5.03%) Java Scala Developer
8 9 (5.03%) React Developer
8 9 (5.03%) Senior Developer
9 8 (4.47%) Big Data Engineer
10 7 (3.91%) Business Intelligence Architect
10 7 (3.91%) Mobile Applications Developer
10 7 (3.91%) Principal Engineer
11 6 (3.35%) Business Architect
11 6 (3.35%) Python Engineer
11 6 (3.35%) Senior Java Developer
12 5 (2.79%) Data Scientist
Libraries, Frameworks & Software Standards
1 48 (26.82%) Kafka
2 21 (11.73%) RESTful
3 18 (10.06%) AngularJS
3 18 (10.06%) GraphQL
3 18 (10.06%) Node.js
3 18 (10.06%) Pandas
3 18 (10.06%) TensorFlow
4 17 (9.50%) HTML
4 17 (9.50%) HTML5
4 17 (9.50%) React
5 15 (8.38%) Keras
5 15 (8.38%) scikit-learn
6 14 (7.82%) CSS
7 6 (3.35%) Akka
7 6 (3.35%) Apache Beam
7 6 (3.35%) Spring
8 5 (2.79%) RabbitMQ
8 5 (2.79%) Web Services
9 4 (2.23%) .NET
9 4 (2.23%) REST
Miscellaneous
1 30 (16.76%) Algorithms
2 23 (12.85%) Analytical Skills
3 21 (11.73%) Data Structures
4 17 (9.50%) Linux Command Line
5 15 (8.38%) Mobile App
6 13 (7.26%) Greenfield Project
7 5 (2.79%) Market Risk
8 4 (2.23%) Cloud Native
9 3 (1.68%) Blog
9 3 (1.68%) Foreign Exchange (FX)
10 2 (1.12%) Derivative
10 2 (1.12%) Equities
10 2 (1.12%) Fixed Income
10 2 (1.12%) Semantic Web
10 2 (1.12%) Social Media
10 2 (1.12%) Spread Betting
10 2 (1.12%) Taxonomies
11 1 (0.56%) Client/Server
11 1 (0.56%) Hedge funds
11 1 (0.56%) Robotics
Operating Systems
1 23 (12.85%) Unix
2 21 (11.73%) Linux
3 2 (1.12%) CentOS
3 2 (1.12%) Debian
4 1 (0.56%) Windows
4 1 (0.56%) zOS
Processes & Methodologies
1 64 (35.75%) Agile Software Development
2 59 (32.96%) Analytics
3 49 (27.37%) DevOps
4 46 (25.70%) Data Science
5 45 (25.14%) Machine Learning
6 42 (23.46%) Computer Science
7 37 (20.67%) Artificial Intelligence
7 37 (20.67%) ETL
8 36 (20.11%) Data Engineering
9 29 (16.20%) Microservices
10 28 (15.64%) Data Modelling
11 24 (13.41%) Business Intelligence
11 24 (13.41%) Data Analytics
11 24 (13.41%) Open Source
11 24 (13.41%) Problem-Solving
12 23 (12.85%) Statistics
12 23 (12.85%) TDD
13 22 (12.29%) Fintech
14 20 (11.17%) Mentoring
15 19 (10.61%) Mathematics
Programming Languages
1 98 (54.75%) Python
2 97 (54.19%) Java
3 92 (51.40%) SQL
4 74 (41.34%) Scala
5 46 (25.70%) JavaScript
6 27 (15.08%) TypeScript
7 26 (14.53%) PHP
8 21 (11.73%) PL/SQL
9 20 (11.17%) C#
10 19 (10.61%) Kotlin
11 17 (9.50%) C++
12 14 (7.82%) ES6
13 13 (7.26%) R
14 11 (6.15%) Go
15 6 (3.35%) Java 8
16 4 (2.23%) PHP 7
17 3 (1.68%) Bash Shell
17 3 (1.68%) T-SQL
18 2 (1.12%) Haskell
18 2 (1.12%) Ruby
Qualifications
1 40 (22.35%) Degree
2 21 (11.73%) Computer Science Degree
3 15 (8.38%) Master's Degree
4 13 (7.26%) PhD
5 2 (1.12%) Numerate Degree
5 2 (1.12%) Security Cleared
6 1 (0.56%) APMP
6 1 (0.56%) ITIL Certification
Quality Assurance & Compliance
1 8 (4.47%) Data Quality
2 7 (3.91%) QA
3 3 (1.68%) GDPR
3 3 (1.68%) ISO/IEC 27001
System Software
1 52 (29.05%) Docker
2 14 (7.82%) HDFS
3 6 (3.35%) Apache ZooKeeper
4 3 (1.68%) Apache Flume
5 1 (0.56%) VirtualBox
Systems Management
1 49 (27.37%) Kubernetes
2 25 (13.97%) Terraform
3 15 (8.38%) Ansible
4 13 (7.26%) Consul
5 8 (4.47%) Oozie
6 2 (1.12%) Docker Swarm
6 2 (1.12%) Hadoop YARN
6 2 (1.12%) Opscode Chef
6 2 (1.12%) Puppet
6 2 (1.12%) SELinux
7 1 (0.56%) Prometheus
7 1 (0.56%) Zipkin
Vendors
1 38 (21.23%) Google
2 14 (7.82%) Oracle
3 13 (7.26%) Cloudera
3 13 (7.26%) Teradata
4 11 (6.15%) Microsoft
5 9 (5.03%) Tableau
6 4 (2.23%) IBM
6 4 (2.23%) MapR
7 3 (1.68%) Alteryx
7 3 (1.68%) Databricks
7 3 (1.68%) Hortonworks
7 3 (1.68%) Informatica
8 2 (1.12%) Facebook
8 2 (1.12%) Salesforce.com
8 2 (1.12%) SAP
8 2 (1.12%) Talend
9 1 (0.56%) Conga
9 1 (0.56%) Marketo
9 1 (0.56%) Netezza
9 1 (0.56%) Pega