Period
to 10 August 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 10 August 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
10 Aug 2020
Same period 2019 Same period 2018
Rank 162 126 127
Rank change year-on-year -36 +1 +10
Permanent jobs citing Hadoop 560 1,497 1,886
As % of all permanent jobs advertised in London 2.11% 2.63% 2.69%
As % of the Database & Business Intelligence category 7.56% 9.24% 8.52%
Number of salaries quoted 416 1,211 1,380
Median annual salary £75,000 £80,000 £75,000
Median salary % change year-on-year -6.25% +6.67% +7.14%
10th Percentile £49,375 £52,500 £47,500
90th Percentile £120,000 £115,000 £105,000
England median annual salary £73,000 £70,000 £67,500
% change year-on-year +4.29% +3.70% +8.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 7,411 16,209 22,127
As % of all permanent IT jobs advertised in London 27.87% 28.51% 31.60%
Number of salaries quoted 5,961 13,535 17,467
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,110 £38,750 £37,500
90th Percentile £101,250 £96,250 £92,500
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 10 August 2020.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 10 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +45 129 £75,000 -6.25% 18
South London +43 23 £67,500 -18.18% 3
West London +11 23 £70,000 - 6
East London +7 3 £73,375 -2.81% 8
North London +2 2 £82,500 +6.45% 1
Hadoop
England

For the 6 months to 10 August 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 372 (66.43%) Python
2 346 (61.79%) Apache Spark
3 341 (60.89%) Big Data
4 307 (54.82%) Java
5 252 (45.00%) AWS
6 239 (42.68%) SQL
7 229 (40.89%) Analytics
8 226 (40.36%) Agile Software Development
9 189 (33.75%) Kafka
10 185 (33.04%) Azure
10 185 (33.04%) Data Science
11 165 (29.46%) Apache Hive
12 158 (28.21%) Finance
13 151 (26.96%) Machine Learning
14 144 (25.71%) NoSQL
15 140 (25.00%) Scala
16 139 (24.82%) Degree
17 125 (22.32%) Software Engineering
18 122 (21.79%) DevOps
19 113 (20.18%) GCP
20 107 (19.11%) ETL
20 107 (19.11%) Data Analytics
21 105 (18.75%) R
22 102 (18.21%) Apache Cassandra
23 97 (17.32%) Computer Science
24 91 (16.25%) MongoDB
24 91 (16.25%) Artificial Intelligence
25 89 (15.89%) Git (software)
25 89 (15.89%) Microservices
26 86 (15.36%) Linux

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 346 (61.79%) Apache Spark
2 62 (11.07%) Apache
3 38 (6.79%) SAS
4 36 (6.43%) Elasticsearch
5 21 (3.75%) Jupyter
6 20 (3.57%) Confluence
7 17 (3.04%) Apache Airflow
8 15 (2.68%) Tomcat
9 12 (2.14%) Apache Solr
10 6 (1.07%) Apache Pig
10 6 (1.07%) Luigi
10 6 (1.07%) Tornado
11 5 (0.89%) IBM Domino
12 4 (0.71%) Apache Synapse
12 4 (0.71%) CMS
13 3 (0.54%) Cloud Foundry
14 2 (0.36%) BizTalk Server
14 2 (0.36%) JBoss
15 1 (0.18%) NetWeaver
15 1 (0.18%) nginx
Applications
1 6 (1.07%) Microsoft Excel
2 1 (0.18%) Microsoft Office
2 1 (0.18%) SPSS
Business Applications
1 6 (1.07%) SAP ERP
2 5 (0.89%) SAP CRM
2 5 (0.89%) SAP IS-U
3 1 (0.18%) SAP BPC
3 1 (0.18%) SAP Hybris
3 1 (0.18%) SAP InfiniteInsight
Cloud Services
1 252 (45.00%) AWS
2 185 (33.04%) Azure
3 113 (20.18%) GCP
4 55 (9.82%) Power Platform
5 34 (6.07%) Amazon EMR
6 25 (4.46%) Amazon S3
7 22 (3.93%) SaaS
8 21 (3.75%) Azure Data Factory
9 12 (2.14%) Cloud Computing
9 12 (2.14%) Serverless
10 11 (1.96%) IaaS
11 9 (1.61%) Amazon SQS
12 8 (1.43%) Amazon EC2
12 8 (1.43%) Amazon Kinesis
13 7 (1.25%) Azure Machine Learning
13 7 (1.25%) IBM Cloud
14 6 (1.07%) Amazon SageMaker
14 6 (1.07%) Office 365
14 6 (1.07%) PaaS
15 5 (0.89%) OpenShift
Communications & Networking
1 22 (3.93%) HTTP
2 11 (1.96%) Kerberos
3 7 (1.25%) TCP/IP
4 6 (1.07%) DSL
4 6 (1.07%) SSH
5 5 (0.89%) 5G
6 4 (0.71%) Firewall
6 4 (0.71%) Internet
7 3 (0.54%) FTP
8 2 (0.36%) HTTPS
8 2 (0.36%) SSL
9 1 (0.18%) DHCP
9 1 (0.18%) DNS
9 1 (0.18%) Intrusion Detection
9 1 (0.18%) Network Security
Database & Business Intelligence
1 341 (60.89%) Big Data
2 165 (29.46%) Apache Hive
3 144 (25.71%) NoSQL
4 102 (18.21%) Apache Cassandra
5 91 (16.25%) MongoDB
6 81 (14.46%) HBase
7 73 (13.04%) SQL Server
8 64 (11.43%) Data Warehouse
9 59 (10.54%) Amazon Redshift
10 55 (9.82%) Power BI
11 54 (9.64%) Data Mining
12 46 (8.21%) Flink
13 41 (7.32%) Impala
14 40 (7.14%) Relational Database
15 37 (6.61%) Data Lake
16 35 (6.25%) PostgreSQL
17 28 (5.00%) Redis
18 27 (4.82%) Sqoop
19 25 (4.46%) BusinessObjects
19 25 (4.46%) RDBMS
Development Applications
1 89 (15.89%) Git (software)
2 52 (9.29%) Jenkins
3 30 (5.36%) Atlassian Bamboo
4 24 (4.29%) JIRA
5 22 (3.93%) Maven
6 20 (3.57%) Bitbucket
7 14 (2.50%) Artifactory
8 12 (2.14%) Sonatype Nexus
9 11 (1.96%) JUnit
10 9 (1.61%) Vagrant
11 8 (1.43%) TeamCity
12 7 (1.25%) GoCD
13 6 (1.07%) RStudio
14 5 (0.89%) Ant
14 5 (0.89%) IBM UrbanCode
15 4 (0.71%) GitLab
15 4 (0.71%) JMeter
16 3 (0.54%) CircleCI
16 3 (0.54%) Cucumber
16 3 (0.54%) Octopus Deploy
General
1 158 (28.21%) Finance
2 64 (11.43%) Banking
3 43 (7.68%) Retail
4 38 (6.79%) Front Office
5 31 (5.54%) Marketing
6 20 (3.57%) Telecoms
7 16 (2.86%) Investment Banking
8 14 (2.50%) Manufacturing
9 11 (1.96%) Advertising
10 10 (1.79%) Games
11 9 (1.61%) Public Sector
12 6 (1.07%) Financial Institution
13 3 (0.54%) Pharmaceutical
14 2 (0.36%) Retail Banking
15 1 (0.18%) Automotive
15 1 (0.18%) Law
15 1 (0.18%) Legal
15 1 (0.18%) Publishing
Job Titles
1 177 (31.61%) Data Engineer
2 118 (21.07%) Developer
3 71 (12.68%) Data Scientist
4 65 (11.61%) Java Developer
5 54 (9.64%) Architect
6 53 (9.46%) Big Data Engineer
7 43 (7.68%) Data Architect
8 37 (6.61%) Senior Data Scientist
9 32 (5.71%) AWS Engineer
9 32 (5.71%) Senior Data Engineer
10 29 (5.18%) Python Engineer
11 24 (4.29%) Hadoop Engineer
11 24 (4.29%) Software Engineer
12 20 (3.57%) Consultant
12 20 (3.57%) Senior Developer
13 19 (3.39%) Platform Engineer
14 16 (2.86%) Big Data Architect
14 16 (2.86%) Java Engineer
14 16 (2.86%) Scala Developer
15 12 (2.14%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 189 (33.75%) Kafka
2 53 (9.46%) React
3 52 (9.29%) Web Services
4 49 (8.75%) Natural Language Processing
5 46 (8.21%) Spring
6 45 (8.04%) AngularJS
7 35 (6.25%) TensorFlow
8 34 (6.07%) scikit-learn
9 31 (5.54%) REST
10 29 (5.18%) JMS
11 27 (4.82%) .NET
11 27 (4.82%) Node.js
11 27 (4.82%) NumPy
12 25 (4.46%) HTML
12 25 (4.46%) Pandas
13 23 (4.11%) ActiveMQ
14 22 (3.93%) Spark Streaming
15 20 (3.57%) Akka
15 20 (3.57%) HTML5
16 19 (3.39%) Keras
Miscellaneous
1 74 (13.21%) Algorithms
2 48 (8.57%) Analytical Skills
3 40 (7.14%) Hedge funds
4 30 (5.36%) Equities
5 25 (4.46%) Hybrid Cloud
6 24 (4.29%) Self-Motivation
7 21 (3.75%) Data Structures
8 20 (3.57%) Greenfield Project
9 19 (3.39%) Management Information System
10 16 (2.86%) Cloud Native
11 15 (2.68%) Market Risk
12 13 (2.32%) Enterprise Software
13 12 (2.14%) Linux Command Line
13 12 (2.14%) Virtual Team
14 11 (1.96%) FMCG
14 11 (1.96%) Reference Data
15 10 (1.79%) Mobile App
16 9 (1.61%) Blog
17 8 (1.43%) Analytical Mindset
17 8 (1.43%) Pricing Data
Operating Systems
1 86 (15.36%) Linux
2 54 (9.64%) Unix
3 14 (2.50%) Windows
4 12 (2.14%) Red Hat Enterprise Linux
5 8 (1.43%) CentOS
6 3 (0.54%) Android
6 3 (0.54%) Apple iOS
7 2 (0.36%) Windows Server
Processes & Methodologies
1 229 (40.89%) Analytics
2 226 (40.36%) Agile Software Development
3 185 (33.04%) Data Science
4 151 (26.96%) Machine Learning
5 125 (22.32%) Software Engineering
6 122 (21.79%) DevOps
7 107 (19.11%) Data Analytics
7 107 (19.11%) ETL
8 97 (17.32%) Computer Science
9 91 (16.25%) Artificial Intelligence
10 89 (15.89%) Microservices
11 82 (14.64%) Mathematics
12 78 (13.93%) Data Modelling
13 70 (12.50%) Mentoring
14 64 (11.43%) Business Intelligence
14 64 (11.43%) Visualisation
15 59 (10.54%) Data Engineering
15 59 (10.54%) TDD
16 58 (10.36%) Scrum
17 55 (9.82%) Statistics
Programming Languages
1 372 (66.43%) Python
2 307 (54.82%) Java
3 239 (42.68%) SQL
4 140 (25.00%) Scala
5 105 (18.75%) R
6 82 (14.64%) JavaScript
7 49 (8.75%) C#
8 38 (6.79%) Bash Shell
9 33 (5.89%) C++
10 25 (4.46%) PL/SQL
11 22 (3.93%) Java 8
11 22 (3.93%) Shell Script
12 21 (3.75%) Go
13 20 (3.57%) HiveQL
14 17 (3.04%) PHP
15 12 (2.14%) C
15 12 (2.14%) Kotlin
16 11 (1.96%) PowerShell
17 10 (1.79%) T-SQL
17 10 (1.79%) TypeScript
Qualifications
1 139 (24.82%) Degree
2 69 (12.32%) Computer Science Degree
3 19 (3.39%) PhD
4 17 (3.04%) BPSS Clearance
5 14 (2.50%) Security Cleared
6 12 (2.14%) DV Cleared
7 11 (1.96%) Master's Degree
8 10 (1.79%) SC Cleared
9 8 (1.43%) Numerate Degree
10 6 (1.07%) Microsoft Certification
11 4 (0.71%) PMI Certification
12 2 (0.36%) AWS Certification
12 2 (0.36%) ISTQB
13 1 (0.18%) MBA
Quality Assurance & Compliance
1 25 (4.46%) Data Quality
2 12 (2.14%) QA
3 11 (1.96%) GDPR
4 6 (1.07%) SLA
System Software
1 75 (13.39%) Docker
2 47 (8.39%) HDFS
3 38 (6.79%) Apache ZooKeeper
4 16 (2.86%) VMware Infrastructure
5 9 (1.61%) VirtualBox
6 7 (1.25%) Active Directory
6 7 (1.25%) Apache Flume
6 7 (1.25%) Hyper-V
7 6 (1.07%) Samba
8 1 (0.18%) Virtual Machines
Systems Management
1 84 (15.00%) Kubernetes
2 41 (7.32%) Ansible
3 25 (4.46%) Terraform
4 23 (4.11%) Hadoop YARN
5 14 (2.50%) Puppet
6 10 (1.79%) Oozie
7 9 (1.61%) Docker Swarm
8 8 (1.43%) vRealize Orchestrator
9 7 (1.25%) Ambari
10 6 (1.07%) Opscode Chef
11 5 (0.89%) Salt
12 4 (0.71%) Kibana
12 4 (0.71%) Nagios
12 4 (0.71%) Prometheus
13 3 (0.54%) Cobbler
13 3 (0.54%) Red Hat Satellite
14 2 (0.36%) HP Fortify
14 2 (0.36%) Single Sign-On
14 2 (0.36%) ZABBIX
15 1 (0.18%) HAProxy
Vendors
1 78 (13.93%) Tableau
2 58 (10.36%) Cloudera
3 57 (10.18%) Oracle
4 55 (9.82%) Google
5 33 (5.89%) Talend
6 29 (5.18%) Microsoft
7 28 (5.00%) Databricks
8 22 (3.93%) Informatica
8 22 (3.93%) Splunk
9 16 (2.86%) Hortonworks
9 16 (2.86%) VMware
10 14 (2.50%) IBM
11 10 (1.79%) SAP
12 9 (1.61%) Alteryx
13 7 (1.25%) Sybase
14 6 (1.07%) LogicMonitor
15 5 (0.89%) EXASOL
15 5 (0.89%) Teradata
16 4 (0.71%) Foundry
16 4 (0.71%) Palantir