Period
to 26 September 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 26 September 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
26 Sep 2020
Same period 2019 Same period 2018
Rank 151 154 134
Rank change year-on-year +3 -20 0
Permanent jobs citing Hadoop 440 1,258 1,782
As % of all permanent jobs advertised in London 2.22% 2.26% 2.59%
As % of the Database & Business Intelligence category 7.81% 7.95% 8.33%
Number of salaries quoted 344 1,002 1,353
Median annual salary £76,500 £79,750 £75,000
Median salary % change year-on-year -4.08% +6.33% +11.11%
10th Percentile £48,750 £50,000 £47,500
90th Percentile £124,775 £112,500 £104,875
England median annual salary £73,000 £70,000 £70,000
% change year-on-year +4.29% - +12.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 5,632 15,817 21,395
As % of all permanent IT jobs advertised in London 28.42% 28.39% 31.11%
Number of salaries quoted 4,686 13,093 17,004
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,500 £38,550 £37,500
90th Percentile £105,000 £97,500 £93,750
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +2.04%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 26 September 2020.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 26 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +55 111 £75,000 -3.23% 30
South London +58 12 £90,000 +12.50% 1
West London +22 10 £77,500 +10.71% 4
East London +17 4 £68,750 -13.52% 9
Hadoop
England

For the 6 months to 26 September 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 283 (64.32%) Big Data
2 274 (62.27%) Python
3 253 (57.50%) Apache Spark
4 241 (54.77%) Java
5 225 (51.14%) AWS
6 188 (42.73%) SQL
7 172 (39.09%) Agile Software Development
8 171 (38.86%) Analytics
9 158 (35.91%) Kafka
10 155 (35.23%) Azure
11 139 (31.59%) Finance
12 137 (31.14%) Apache Hive
13 124 (28.18%) Data Science
14 116 (26.36%) Machine Learning
15 112 (25.45%) Degree
16 105 (23.86%) ETL
16 105 (23.86%) DevOps
17 101 (22.95%) Software Engineering
18 95 (21.59%) Scala
19 86 (19.55%) Git (software)
20 83 (18.86%) JavaScript
20 83 (18.86%) Kubernetes
21 82 (18.64%) Computer Science
22 81 (18.41%) Mathematics
23 79 (17.95%) Data Analytics
23 79 (17.95%) NoSQL
23 79 (17.95%) GCP
24 75 (17.05%) Cloudera
25 68 (15.45%) Artificial Intelligence
25 68 (15.45%) Mentoring

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 253 (57.50%) Apache Spark
2 50 (11.36%) SAS
3 47 (10.68%) Apache
4 32 (7.27%) Elasticsearch
5 17 (3.86%) Apache Airflow
6 16 (3.64%) Jupyter
7 9 (2.05%) Confluence
8 7 (1.59%) Tomcat
9 5 (1.14%) Apache Synapse
9 5 (1.14%) IBM Domino
10 4 (0.91%) Apache Pig
10 4 (0.91%) Apache Solr
10 4 (0.91%) CMS
11 2 (0.45%) Tornado
12 1 (0.23%) SharePoint
Applications
1 2 (0.45%) Microsoft Excel
2 1 (0.23%) Microsoft Office
Business Applications
1 3 (0.68%) Distributed Ledger
1 3 (0.68%) Oracle Cash Management
2 1 (0.23%) SAP CRM
2 1 (0.23%) SAP ERP
2 1 (0.23%) SAP Hybris
2 1 (0.23%) SAP IS-U
Cloud Services
1 225 (51.14%) AWS
2 155 (35.23%) Azure
3 79 (17.95%) GCP
4 50 (11.36%) Power Platform
5 25 (5.68%) Amazon S3
6 21 (4.77%) Amazon EMR
7 19 (4.32%) SaaS
8 15 (3.41%) IaaS
9 13 (2.95%) Amazon Kinesis
10 12 (2.73%) Serverless
11 11 (2.50%) Amazon SQS
12 9 (2.05%) PaaS
13 8 (1.82%) Azure Data Factory
14 7 (1.59%) AWS Lambda
14 7 (1.59%) Office 365
15 6 (1.36%) Amazon CloudWatch
15 6 (1.36%) AWS CloudFormation
15 6 (1.36%) AWS CodePipeline
16 5 (1.14%) Amazon ElastiCache
16 5 (1.14%) OpenShift
Communications & Networking
1 22 (5.00%) HTTP
2 12 (2.73%) Kerberos
3 8 (1.82%) TCP/IP
4 7 (1.59%) 5G
4 7 (1.59%) Internet
4 7 (1.59%) SSH
5 6 (1.36%) DSL
6 5 (1.14%) Firewall
7 3 (0.68%) FTP
7 3 (0.68%) HTTPS
7 3 (0.68%) SSL
8 2 (0.45%) Network Security
9 1 (0.23%) DHCP
9 1 (0.23%) DNS
Database & Business Intelligence
1 283 (64.32%) Big Data
2 137 (31.14%) Apache Hive
3 79 (17.95%) NoSQL
4 65 (14.77%) Apache Cassandra
5 62 (14.09%) MongoDB
6 53 (12.05%) Impala
7 50 (11.36%) Amazon Redshift
7 50 (11.36%) Power BI
8 49 (11.14%) Data Mining
9 48 (10.91%) SQL Server
10 45 (10.23%) HBase
11 44 (10.00%) Flink
12 40 (9.09%) Data Warehouse
13 39 (8.86%) Oracle Database
14 37 (8.41%) Pentaho
15 34 (7.73%) BusinessObjects
16 33 (7.50%) Data Lake
16 33 (7.50%) Relational Database
17 28 (6.36%) PostgreSQL
18 26 (5.91%) RDBMS
Development Applications
1 86 (19.55%) Git (software)
2 41 (9.32%) Jenkins
3 16 (3.64%) Artifactory
3 16 (3.64%) JIRA
4 15 (3.41%) Bitbucket
4 15 (3.41%) Maven
5 14 (3.18%) Atlassian Bamboo
6 13 (2.95%) TeamCity
7 8 (1.82%) Cucumber
8 7 (1.59%) Sonatype Nexus
9 6 (1.36%) RStudio
10 5 (1.14%) Selenium
11 4 (0.91%) GitLab
11 4 (0.91%) GoCD
11 4 (0.91%) JUnit
11 4 (0.91%) Octopus Deploy
12 3 (0.68%) JMeter
13 2 (0.45%) Gradle
13 2 (0.45%) Team Foundation Server
13 2 (0.45%) Vagrant
General
1 139 (31.59%) Finance
2 49 (11.14%) Banking
3 35 (7.95%) Front Office
4 17 (3.86%) Retail
5 12 (2.73%) Advertising
5 12 (2.73%) Telecoms
6 11 (2.50%) Investment Banking
6 11 (2.50%) Manufacturing
7 10 (2.27%) Marketing
8 6 (1.36%) Financial Institution
9 4 (0.91%) Games
9 4 (0.91%) Law
9 4 (0.91%) Pharmaceutical
9 4 (0.91%) Public Sector
10 1 (0.23%) iGaming
10 1 (0.23%) Legal
10 1 (0.23%) Online Betting
10 1 (0.23%) Retail Banking
Job Titles
1 148 (33.64%) Data Engineer
2 102 (23.18%) Developer
3 61 (13.86%) Java Developer
4 55 (12.50%) Data Scientist
5 38 (8.64%) Architect
5 38 (8.64%) Big Data Engineer
6 33 (7.50%) Senior Data Engineer
7 32 (7.27%) AWS Engineer
7 32 (7.27%) Senior Data Scientist
8 30 (6.82%) Data Architect
9 25 (5.68%) Hadoop Engineer
9 25 (5.68%) Python Engineer
10 23 (5.23%) Java Engineer
11 22 (5.00%) Software Engineer
12 14 (3.18%) Kubernetes Engineer
12 14 (3.18%) Platform Engineer
13 12 (2.73%) Senior Developer
14 11 (2.50%) Consultant
14 11 (2.50%) Java Software Engineer
14 11 (2.50%) Lead Software Engineer
Libraries, Frameworks & Software Standards
1 158 (35.91%) Kafka
2 48 (10.91%) Natural Language Processing
3 42 (9.55%) React
4 39 (8.86%) Spring
5 34 (7.73%) TensorFlow
6 32 (7.27%) scikit-learn
7 31 (7.05%) AngularJS
8 28 (6.36%) NumPy
8 28 (6.36%) PySpark
9 27 (6.14%) Pandas
10 24 (5.45%) JMS
11 23 (5.23%) Keras
11 23 (5.23%) Web Services
12 21 (4.77%) Node.js
13 20 (4.55%) ActiveMQ
14 19 (4.32%) Akka
14 19 (4.32%) RESTful
15 16 (3.64%) HTML
15 16 (3.64%) Shiny
16 15 (3.41%) .NET
Miscellaneous
1 63 (14.32%) Algorithms
2 36 (8.18%) Analytical Skills
3 35 (7.95%) Hedge funds
4 27 (6.14%) Equities
5 21 (4.77%) Hybrid Cloud
6 20 (4.55%) Management Information System
7 18 (4.09%) Self-Motivation
8 13 (2.95%) Cloud Native
9 9 (2.05%) Fixed Income
9 9 (2.05%) Greenfield Project
10 8 (1.82%) Derivative
10 8 (1.82%) FMCG
10 8 (1.82%) Market Risk
11 7 (1.59%) Data Structures
11 7 (1.59%) Enterprise Software
11 7 (1.59%) Linux Command Line
12 6 (1.36%) Mobile App
13 5 (1.14%) Data Centre
13 5 (1.14%) Life Science
13 5 (1.14%) Private Cloud
Operating Systems
1 62 (14.09%) Linux
2 55 (12.50%) Unix
3 9 (2.05%) CentOS
3 9 (2.05%) Windows
4 8 (1.82%) Red Hat Enterprise Linux
Processes & Methodologies
1 172 (39.09%) Agile Software Development
2 171 (38.86%) Analytics
3 124 (28.18%) Data Science
4 116 (26.36%) Machine Learning
5 105 (23.86%) DevOps
5 105 (23.86%) ETL
6 101 (22.95%) Software Engineering
7 82 (18.64%) Computer Science
8 81 (18.41%) Mathematics
9 79 (17.95%) Data Analytics
10 68 (15.45%) Artificial Intelligence
10 68 (15.45%) Mentoring
11 66 (15.00%) Microservices
12 58 (13.18%) Scrum
13 55 (12.50%) Visualisation
14 52 (11.82%) Data Engineering
15 47 (10.68%) Requirements Gathering
16 46 (10.45%) Business Intelligence
17 44 (10.00%) Problem-Solving
18 42 (9.55%) Data Modelling
Programming Languages
1 274 (62.27%) Python
2 241 (54.77%) Java
3 188 (42.73%) SQL
4 95 (21.59%) Scala
5 83 (18.86%) JavaScript
6 65 (14.77%) R
7 39 (8.86%) PL/SQL
7 39 (8.86%) Shell Script
8 33 (7.50%) C#
9 32 (7.27%) HiveQL
10 27 (6.14%) Bash Shell
10 27 (6.14%) Java 8
11 16 (3.64%) Go
12 14 (3.18%) C++
12 14 (3.18%) Kotlin
13 11 (2.50%) PHP
14 8 (1.82%) C
14 8 (1.82%) TypeScript
15 7 (1.59%) ES6
16 6 (1.36%) Groovy
Qualifications
1 112 (25.45%) Degree
2 62 (14.09%) Computer Science Degree
3 25 (5.68%) BPSS Clearance
4 19 (4.32%) PhD
5 13 (2.95%) Master's Degree
6 7 (1.59%) Security Cleared
7 4 (0.91%) PMI Certification
7 4 (0.91%) SC Cleared
8 3 (0.68%) AWS Certification
8 3 (0.68%) DV Cleared
9 2 (0.45%) Numerate Degree
10 1 (0.23%) TOGAF Certification
Quality Assurance & Compliance
1 12 (2.73%) GDPR
2 11 (2.50%) Data Quality
3 10 (2.27%) QA
4 6 (1.36%) SLA
5 3 (0.68%) ISO 20022
5 3 (0.68%) PSD2
5 3 (0.68%) TARGET2
System Software
1 60 (13.64%) Docker
2 56 (12.73%) HDFS
3 20 (4.55%) Apache ZooKeeper
4 17 (3.86%) VMware Infrastructure
5 8 (1.82%) Active Directory
5 8 (1.82%) Hyper-V
6 6 (1.36%) Apache Flume
6 6 (1.36%) Samba
7 2 (0.45%) VirtualBox
8 1 (0.23%) Virtual Machines
Systems Management
1 83 (18.86%) Kubernetes
2 29 (6.59%) Ansible
3 28 (6.36%) Terraform
4 21 (4.77%) Hadoop YARN
5 9 (2.05%) Oozie
6 8 (1.82%) Ambari
6 8 (1.82%) vRealize Orchestrator
7 7 (1.59%) Puppet
8 4 (0.91%) Kibana
8 4 (0.91%) Nagios
9 3 (0.68%) Cobbler
9 3 (0.68%) Opscode Chef
9 3 (0.68%) Prometheus
9 3 (0.68%) Red Hat Satellite
9 3 (0.68%) Single Sign-On
10 2 (0.45%) Docker Swarm
10 2 (0.45%) HP Fortify
10 2 (0.45%) ZABBIX
Vendors
1 75 (17.05%) Cloudera
2 63 (14.32%) Oracle
2 63 (14.32%) Tableau
3 41 (9.32%) Talend
4 37 (8.41%) Databricks
4 37 (8.41%) Informatica
5 22 (5.00%) Google
6 17 (3.86%) VMware
7 14 (3.18%) Microsoft
8 12 (2.73%) Splunk
9 9 (2.05%) Hortonworks
10 7 (1.59%) LogicMonitor
11 6 (1.36%) IBM
12 4 (0.91%) Foundry
12 4 (0.91%) Netezza
12 4 (0.91%) Palantir
12 4 (0.91%) Spotify
12 4 (0.91%) Sybase
12 4 (0.91%) Teradata
13 3 (0.68%) StreamSets