Period
to 30 March 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 30 March 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
30 Mar 2020
Same period 2019 Same period 2018
Rank 189 123 120
Rank change year-on-year -66 -3 +10
Permanent jobs citing Hadoop 919 1,679 1,984
As % of all permanent jobs advertised in London 1.89% 2.73% 2.84%
As % of the Database & Business Intelligence category 6.92% 9.32% 9.27%
Number of salaries quoted 738 1,340 1,603
Median annual salary £73,750 £75,000 £72,500
Median salary % change year-on-year -1.67% +3.45% -
10th Percentile £50,250 £50,000 £46,500
90th Percentile £112,500 £110,000 £107,500
England median annual salary £70,000 £70,000 £66,000
% change year-on-year - +6.06% +1.54%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 13,271 18,020 21,394
As % of all permanent IT jobs advertised in London 27.30% 29.32% 30.61%
Number of salaries quoted 10,835 14,980 17,669
Median annual salary £65,000 £65,000 £60,000
Median salary % change year-on-year - +8.33% +0.84%
10th Percentile £39,000 £38,750 £37,500
90th Percentile £102,500 £95,000 £91,250
England median annual salary £53,000 £52,500 £50,000
% change year-on-year +0.95% +5.00% +5.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 30 March 2020.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 30 March 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +37 207 £75,000 - 49
West London +15 38 £65,000 -7.14% 8
South London +27 20 £67,500 -10.00% 4
East London +6 14 £81,000 +24.62% 9
North London -19 2 £82,500 +6.45%
Hadoop
England

For the 6 months to 30 March 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 631 (68.66%) Python
2 626 (68.12%) Apache Spark
3 609 (66.27%) Big Data
4 437 (47.55%) AWS
5 431 (46.90%) SQL
6 427 (46.46%) Java
7 407 (44.29%) Agile Software Development
8 398 (43.31%) Analytics
9 349 (37.98%) Data Science
10 338 (36.78%) Azure
11 320 (34.82%) NoSQL
12 304 (33.08%) Scala
13 274 (29.82%) Machine Learning
14 237 (25.79%) Kafka
15 230 (25.03%) Apache Hive
16 220 (23.94%) GCP
17 219 (23.83%) Finance
18 204 (22.20%) DevOps
19 196 (21.33%) ETL
19 196 (21.33%) Artificial Intelligence
20 176 (19.15%) Degree
21 175 (19.04%) Data Modelling
22 170 (18.50%) Software Engineering
23 162 (17.63%) Data Analytics
24 158 (17.19%) Docker
25 154 (16.76%) Google
26 149 (16.21%) Visualisation
26 149 (16.21%) Data Engineering
27 148 (16.10%) R
28 147 (16.00%) Computer Science

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 626 (68.12%) Apache Spark
2 76 (8.27%) Apache
3 56 (6.09%) Elasticsearch
4 55 (5.98%) SAS
5 54 (5.88%) Apache Airflow
6 35 (3.81%) Luigi
7 27 (2.94%) Confluence
8 25 (2.72%) Jupyter
9 22 (2.39%) Tomcat
10 18 (1.96%) Apache Pig
11 14 (1.52%) Apache Solr
12 11 (1.20%) IIS
13 6 (0.65%) IPython
14 5 (0.54%) Oracle SOA Suite
14 5 (0.54%) Tornado
15 4 (0.44%) Cloud Foundry
15 4 (0.44%) GemFire
16 3 (0.33%) JBoss
16 3 (0.33%) NetWeaver
16 3 (0.33%) nginx
Applications
1 16 (1.74%) Microsoft Excel
2 9 (0.98%) SPSS
3 2 (0.22%) Microsoft Office
3 2 (0.22%) Microsoft PowerPoint
4 1 (0.11%) Simulink
Business Applications
1 6 (0.65%) SAP ERP
2 5 (0.54%) SAP BPC
3 4 (0.44%) SAP CRM
3 4 (0.44%) SAP IS-U
4 2 (0.22%) Eikon
4 2 (0.22%) SAP InfiniteInsight
4 2 (0.22%) SAP S/4HANA
5 1 (0.11%) Adobe Campaign
5 1 (0.11%) Data Workbench
5 1 (0.11%) Sparx Enterprise Architect
5 1 (0.11%) WebTrends
Cloud Services
1 437 (47.55%) AWS
2 338 (36.78%) Azure
3 220 (23.94%) GCP
4 99 (10.77%) Amazon EMR
5 75 (8.16%) Amazon S3
6 48 (5.22%) Power Platform
7 42 (4.57%) Amazon EC2
8 39 (4.24%) Serverless
9 35 (3.81%) Azure Data Factory
10 32 (3.48%) Amazon Kinesis
11 26 (2.83%) IBM Cloud
12 23 (2.50%) AWS Lambda
12 23 (2.50%) Azure Machine Learning
12 23 (2.50%) SaaS
13 21 (2.29%) Cloud Computing
13 21 (2.29%) GitHub
14 18 (1.96%) Amazon SageMaker
14 18 (1.96%) PaaS
15 14 (1.52%) Amazon EKS
16 11 (1.20%) npm
Communications & Networking
1 16 (1.74%) Firewall
2 15 (1.63%) TCP/IP
3 13 (1.41%) HTTP
3 13 (1.41%) SSL
4 11 (1.20%) DNS
5 6 (0.65%) Kerberos
6 4 (0.44%) Internet
6 4 (0.44%) Reverse Proxy
6 4 (0.44%) SSH
6 4 (0.44%) VPN
7 2 (0.22%) HTTPS
8 1 (0.11%) 4G
8 1 (0.11%) Broadband
8 1 (0.11%) Intrusion Detection
8 1 (0.11%) IPFS
Database & Business Intelligence
1 609 (66.27%) Big Data
2 320 (34.82%) NoSQL
3 230 (25.03%) Apache Hive
4 144 (15.67%) Data Warehouse
5 131 (14.25%) Apache Cassandra
6 128 (13.93%) Amazon Redshift
7 107 (11.64%) Relational Database
8 105 (11.43%) HBase
9 104 (11.32%) PostgreSQL
10 98 (10.66%) MongoDB
11 94 (10.23%) SQL Server
12 82 (8.92%) Neo4j
13 64 (6.96%) Data Lake
14 63 (6.86%) BigQuery
15 54 (5.88%) Amazon Athena
15 54 (5.88%) Amazon DynamoDB
16 48 (5.22%) Power BI
17 47 (5.11%) Data Mining
18 42 (4.57%) Flink
19 40 (4.35%) Snowflake Schema
Development Applications
1 137 (14.91%) Git (software)
2 118 (12.84%) Jenkins
3 58 (6.31%) JIRA
4 54 (5.88%) Atlassian Bamboo
5 48 (5.22%) Maven
6 40 (4.35%) Vagrant
7 28 (3.05%) Artifactory
8 22 (2.39%) Bitbucket
8 22 (2.39%) TeamCity
9 20 (2.18%) Visual Studio Team System
10 19 (2.07%) Ant
11 15 (1.63%) JUnit
11 15 (1.63%) SonarQube
12 14 (1.52%) Octopus Deploy
13 11 (1.20%) Bower
13 11 (1.20%) Chocolatey
13 11 (1.20%) MSBuild
13 11 (1.20%) Team Foundation Server
13 11 (1.20%) TestRail
13 11 (1.20%) Zephyr
General
1 219 (23.83%) Finance
2 83 (9.03%) Retail
3 76 (8.27%) Banking
4 51 (5.55%) Marketing
5 42 (4.57%) Front Office
6 32 (3.48%) Manufacturing
7 31 (3.37%) Public Sector
8 24 (2.61%) Telecoms
9 18 (1.96%) Automotive
10 17 (1.85%) Legal
11 15 (1.63%) Investment Banking
12 12 (1.31%) Games
13 6 (0.65%) Billing
14 3 (0.33%) Advertising
15 2 (0.22%) Back Office
15 2 (0.22%) Electronics
15 2 (0.22%) Financial Institution
15 2 (0.22%) Publishing
15 2 (0.22%) Retail Banking
16 1 (0.11%) Local Government
Job Titles
1 298 (32.43%) Data Engineer
2 159 (17.30%) Developer
3 109 (11.86%) Architect
4 95 (10.34%) Data Scientist
5 92 (10.01%) Java Developer
6 76 (8.27%) Data Architect
7 64 (6.96%) Big Data Engineer
8 48 (5.22%) Senior Data Scientist
9 46 (5.01%) Python Engineer
10 42 (4.57%) Senior Data Engineer
11 36 (3.92%) DevOps Engineer
12 32 (3.48%) Consultant
13 31 (3.37%) Senior Developer
14 28 (3.05%) Big Data Architect
15 27 (2.94%) AWS Engineer
15 27 (2.94%) Platform Engineer
16 26 (2.83%) Java Engineer
16 26 (2.83%) Scala Developer
16 26 (2.83%) Software Engineer
16 26 (2.83%) Solutions Architect
Libraries, Frameworks & Software Standards
1 237 (25.79%) Kafka
2 93 (10.12%) React
3 78 (8.49%) TensorFlow
4 73 (7.94%) Natural Language Processing
5 72 (7.83%) Spark Streaming
6 70 (7.62%) Web Services
7 67 (7.29%) AngularJS
8 59 (6.42%) Node.js
9 57 (6.20%) HTML
10 52 (5.66%) scikit-learn
11 46 (5.01%) HTML5
12 44 (4.79%) REST
13 41 (4.46%) Spring
14 32 (3.48%) RESTful
15 29 (3.16%) CSS
15 29 (3.16%) JSON
16 26 (2.83%) XML
17 24 (2.61%) .NET
18 23 (2.50%) Elastic Stack
18 23 (2.50%) MXNet
Miscellaneous
1 128 (13.93%) Analytical Skills
2 103 (11.21%) Algorithms
3 65 (7.07%) Data Structures
4 43 (4.68%) Management Information System
5 39 (4.24%) Greenfield Project
6 29 (3.16%) Blog
7 27 (2.94%) Self-Motivation
8 24 (2.61%) Acoustics
8 24 (2.61%) Linux Command Line
9 21 (2.29%) Cloud Native
9 21 (2.29%) Mobile App
10 20 (2.18%) User Experience
10 20 (2.18%) Virtual Team
11 18 (1.96%) Social Media
12 16 (1.74%) Hedge funds
13 13 (1.41%) Derivative
13 13 (1.41%) Market Risk
14 11 (1.20%) Enterprise Software
14 11 (1.20%) Foreign Exchange (FX)
14 11 (1.20%) Reference Data
Operating Systems
1 146 (15.89%) Linux
2 44 (4.79%) Unix
3 29 (3.16%) Windows
4 14 (1.52%) Windows Server
5 9 (0.98%) CentOS
6 6 (0.65%) Red Hat Enterprise Linux
7 5 (0.54%) Debian
8 3 (0.33%) Android
8 3 (0.33%) Apple iOS
8 3 (0.33%) Ubuntu
8 3 (0.33%) zOS
9 1 (0.11%) Solaris
Processes & Methodologies
1 407 (44.29%) Agile Software Development
2 398 (43.31%) Analytics
3 349 (37.98%) Data Science
4 274 (29.82%) Machine Learning
5 204 (22.20%) DevOps
6 196 (21.33%) Artificial Intelligence
6 196 (21.33%) ETL
7 175 (19.04%) Data Modelling
8 170 (18.50%) Software Engineering
9 162 (17.63%) Data Analytics
10 149 (16.21%) Data Engineering
10 149 (16.21%) Visualisation
11 147 (16.00%) Computer Science
12 138 (15.02%) Business Intelligence
13 129 (14.04%) Microservices
14 111 (12.08%) Fintech
15 108 (11.75%) Statistics
16 103 (11.21%) TDD
17 95 (10.34%) Continuous Integration
18 92 (10.01%) Open Source
Programming Languages
1 631 (68.66%) Python
2 431 (46.90%) SQL
3 427 (46.46%) Java
4 304 (33.08%) Scala
5 148 (16.10%) R
6 135 (14.69%) JavaScript
7 92 (10.01%) C#
8 72 (7.83%) C++
9 57 (6.20%) Bash Shell
10 45 (4.90%) C
11 39 (4.24%) PHP
12 32 (3.48%) TypeScript
13 29 (3.16%) PL/SQL
13 29 (3.16%) PowerShell
13 29 (3.16%) T-SQL
14 28 (3.05%) Kotlin
15 24 (2.61%) Go
16 19 (2.07%) ES6
16 19 (2.07%) Java 8
17 16 (1.74%) MATLAB
Qualifications
1 176 (19.15%) Degree
2 76 (8.27%) Computer Science Degree
3 29 (3.16%) PhD
4 21 (2.29%) Security Cleared
5 20 (2.18%) Numerate Degree
6 18 (1.96%) SC Cleared
7 13 (1.41%) DV Cleared
8 9 (0.98%) Master's Degree
9 7 (0.76%) MBA
9 7 (0.76%) Microsoft Certification
10 5 (0.54%) Postgraduate
11 2 (0.22%) ACCA
11 2 (0.22%) AWS Certification
11 2 (0.22%) CIMA
11 2 (0.22%) ISTQB
12 1 (0.11%) PMI Certification
Quality Assurance & Compliance
1 63 (6.86%) Data Quality
2 32 (3.48%) QA
3 11 (1.20%) GDPR
4 6 (0.65%) ISO/IEC 27001
5 1 (0.11%) Actionable Recommendations
System Software
1 158 (17.19%) Docker
2 54 (5.88%) HDFS
3 42 (4.57%) Apache ZooKeeper
4 38 (4.13%) VirtualBox
5 19 (2.07%) Apache Flume
6 6 (0.65%) Active Directory
7 5 (0.54%) VMware Infrastructure
8 4 (0.44%) Hyper-V
9 2 (0.22%) Varnish
10 1 (0.11%) Alluxio
10 1 (0.11%) Ceph
10 1 (0.11%) etcd
10 1 (0.11%) Gluster
Systems Management
1 136 (14.80%) Kubernetes
2 98 (10.66%) Ansible
3 91 (9.90%) Terraform
4 43 (4.68%) Docker Swarm
5 41 (4.46%) Puppet
6 32 (3.48%) Oozie
7 30 (3.26%) Opscode Chef
8 27 (2.94%) Hadoop YARN
9 14 (1.52%) Salt
10 4 (0.44%) Ambari
10 4 (0.44%) Consul
10 4 (0.44%) Single Sign-On
11 2 (0.22%) HAProxy
11 2 (0.22%) HP Quality Center
11 2 (0.22%) Kibana
11 2 (0.22%) Mesos
11 2 (0.22%) Rancher
11 2 (0.22%) SELinux
12 1 (0.11%) Istio
12 1 (0.11%) Zipkin
Vendors
1 154 (16.76%) Google
2 91 (9.90%) Oracle
3 87 (9.47%) Cloudera
4 83 (9.03%) Tableau
5 72 (7.83%) Microsoft
6 66 (7.18%) Hortonworks
7 53 (5.77%) Databricks
8 37 (4.03%) IBM
9 35 (3.81%) Talend
10 34 (3.70%) Informatica
11 31 (3.37%) Teradata
12 27 (2.94%) Splunk
13 19 (2.07%) SAP
14 18 (1.96%) Dataiku
15 13 (1.41%) EXASOL
16 12 (1.31%) Alteryx
17 11 (1.20%) Atlassian
17 11 (1.20%) Black Duck
17 11 (1.20%) Netezza
17 11 (1.20%) Sybase