Period
to 9 July 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 9 July 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
9 Jul 2020
Same period 2019 Same period 2018
Rank 169 123 128
Rank change year-on-year -46 +5 +18
Permanent jobs citing Hadoop 663 1,571 1,980
As % of all permanent jobs advertised in London 2.04% 2.67% 2.74%
As % of the Database & Business Intelligence category 7.37% 9.36% 8.72%
Number of salaries quoted 497 1,277 1,461
Median annual salary £75,000 £77,500 £74,000
Median salary % change year-on-year -3.23% +4.73% +5.71%
10th Percentile £51,250 £51,250 £46,500
90th Percentile £115,000 £113,750 £107,500
England median annual salary £72,500 £70,000 £66,000
% change year-on-year +3.57% +6.06% +1.54%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 8,996 16,788 22,716
As % of all permanent IT jobs advertised in London 27.70% 28.52% 31.49%
Number of salaries quoted 7,302 14,000 17,940
Median annual salary £67,500 £65,000 £61,500
Median salary % change year-on-year +3.85% +5.69% +2.50%
10th Percentile £41,250 £38,475 £37,500
90th Percentile £102,500 £95,000 £92,500
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 9 July 2020.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 9 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +42 151 £75,000 - 19
West London -3 27 £67,500 +12.50% 4
South London +35 21 £67,500 -20.59%
East London +8 2 £72,500 +11.54% 5
North London -7 2 £82,500 +6.45% 1
Hadoop
England

For the 6 months to 9 July 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 446 (67.27%) Python
2 432 (65.16%) Apache Spark
3 403 (60.78%) Big Data
4 350 (52.79%) Java
5 318 (47.96%) AWS
6 295 (44.49%) SQL
7 294 (44.34%) Analytics
8 270 (40.72%) Agile Software Development
9 242 (36.50%) Data Science
10 225 (33.94%) Kafka
11 208 (31.37%) NoSQL
12 207 (31.22%) Azure
13 199 (30.02%) Scala
14 178 (26.85%) Finance
15 174 (26.24%) Machine Learning
16 169 (25.49%) Apache Hive
17 160 (24.13%) Degree
18 151 (22.78%) GCP
19 139 (20.97%) Software Engineering
20 133 (20.06%) ETL
20 133 (20.06%) DevOps
21 129 (19.46%) Data Analytics
22 124 (18.70%) Artificial Intelligence
23 121 (18.25%) R
24 118 (17.80%) Apache Cassandra
25 112 (16.89%) Computer Science
25 112 (16.89%) Kubernetes
26 107 (16.14%) Docker
27 98 (14.78%) Amazon Redshift
28 97 (14.63%) Microservices

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 432 (65.16%) Apache Spark
2 74 (11.16%) Apache
3 42 (6.33%) Apache Airflow
3 42 (6.33%) Elasticsearch
4 41 (6.18%) SAS
5 25 (3.77%) Luigi
6 24 (3.62%) Jupyter
7 18 (2.71%) Confluence
8 15 (2.26%) Tomcat
9 13 (1.96%) Apache Solr
10 11 (1.66%) Apache Pig
11 6 (0.90%) Tornado
12 5 (0.75%) IBM Domino
13 4 (0.60%) Apache Synapse
13 4 (0.60%) Cloud Foundry
13 4 (0.60%) GemFire
13 4 (0.60%) Oracle SOA Suite
14 3 (0.45%) CMS
14 3 (0.45%) NetWeaver
15 2 (0.30%) BizTalk Server
Applications
1 13 (1.96%) Microsoft Excel
2 7 (1.06%) SPSS
3 2 (0.30%) Microsoft Office
4 1 (0.15%) Microsoft PowerPoint
Business Applications
1 7 (1.06%) SAP ERP
2 5 (0.75%) SAP BPC
2 5 (0.75%) SAP CRM
2 5 (0.75%) SAP IS-U
3 2 (0.30%) SAP InfiniteInsight
3 2 (0.30%) SAP S/4HANA
4 1 (0.15%) Adobe Campaign
4 1 (0.15%) SAP Hybris
Cloud Services
1 318 (47.96%) AWS
2 207 (31.22%) Azure
3 151 (22.78%) GCP
4 72 (10.86%) Amazon EMR
5 45 (6.79%) Amazon S3
5 45 (6.79%) Power Platform
6 29 (4.37%) Amazon EC2
7 21 (3.17%) Azure Data Factory
7 21 (3.17%) SaaS
8 20 (3.02%) IBM Cloud
9 17 (2.56%) Serverless
10 15 (2.26%) Cloud Computing
11 12 (1.81%) Amazon Kinesis
12 10 (1.51%) Azure Machine Learning
12 10 (1.51%) GitHub
13 7 (1.06%) Amazon SageMaker
13 7 (1.06%) Amazon SQS
14 6 (0.90%) Amazon CloudWatch
14 6 (0.90%) AWS Lambda
15 5 (0.75%) AWS CloudFormation
Communications & Networking
1 14 (2.11%) HTTP
2 9 (1.36%) Kerberos
3 6 (0.90%) DSL
4 4 (0.60%) Reverse Proxy
5 3 (0.45%) FTP
6 2 (0.30%) 5G
6 2 (0.30%) Firewall
6 2 (0.30%) Internet
6 2 (0.30%) TCP/IP
7 1 (0.15%) DHCP
7 1 (0.15%) DNS
7 1 (0.15%) Intrusion Detection
7 1 (0.15%) SSH
Database & Business Intelligence
1 403 (60.78%) Big Data
2 208 (31.37%) NoSQL
3 169 (25.49%) Apache Hive
4 118 (17.80%) Apache Cassandra
5 98 (14.78%) Amazon Redshift
6 97 (14.63%) MongoDB
7 93 (14.03%) HBase
8 88 (13.27%) Data Warehouse
9 69 (10.41%) SQL Server
10 63 (9.50%) Relational Database
11 60 (9.05%) PostgreSQL
12 49 (7.39%) Data Mining
13 46 (6.94%) Neo4j
14 45 (6.79%) Flink
14 45 (6.79%) Power BI
15 40 (6.03%) BigQuery
16 37 (5.58%) Data Lake
16 37 (5.58%) MySQL
17 36 (5.43%) Impala
18 33 (4.98%) Redis
Development Applications
1 89 (13.42%) Git (software)
2 85 (12.82%) Jenkins
3 46 (6.94%) Atlassian Bamboo
4 31 (4.68%) JIRA
5 25 (3.77%) Bitbucket
5 25 (3.77%) Maven
5 25 (3.77%) Vagrant
6 19 (2.87%) Artifactory
7 15 (2.26%) JUnit
8 12 (1.81%) Sonatype Nexus
9 11 (1.66%) TeamCity
10 7 (1.06%) GoCD
11 6 (0.90%) Octopus Deploy
11 6 (0.90%) RStudio
12 5 (0.75%) Ant
12 5 (0.75%) IBM UrbanCode
12 5 (0.75%) Postman
12 5 (0.75%) Visual Studio Team System
13 4 (0.60%) JMeter
13 4 (0.60%) Visual Studio
General
1 178 (26.85%) Finance
2 69 (10.41%) Banking
3 67 (10.11%) Retail
4 40 (6.03%) Front Office
5 38 (5.73%) Marketing
6 28 (4.22%) Manufacturing
7 22 (3.32%) Public Sector
8 19 (2.87%) Telecoms
9 13 (1.96%) Automotive
9 13 (1.96%) Investment Banking
10 11 (1.66%) Games
10 11 (1.66%) Legal
11 6 (0.90%) Advertising
11 6 (0.90%) Financial Institution
12 3 (0.45%) Pharmaceutical
12 3 (0.45%) Retail Banking
13 1 (0.15%) Law
13 1 (0.15%) Local Government
13 1 (0.15%) Publishing
Job Titles
1 225 (33.94%) Data Engineer
2 128 (19.31%) Developer
3 72 (10.86%) Java Developer
4 68 (10.26%) Data Scientist
5 65 (9.80%) Architect
6 63 (9.50%) Big Data Engineer
7 49 (7.39%) Data Architect
8 42 (6.33%) Senior Data Engineer
9 38 (5.73%) Senior Data Scientist
10 33 (4.98%) Python Engineer
11 32 (4.83%) AWS Engineer
12 25 (3.77%) Hadoop Engineer
12 25 (3.77%) Platform Engineer
13 24 (3.62%) Senior Developer
13 24 (3.62%) Software Engineer
14 21 (3.17%) Consultant
15 20 (3.02%) Java Engineer
16 19 (2.87%) Big Data Architect
17 18 (2.71%) Scala Developer
18 16 (2.41%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 225 (33.94%) Kafka
2 66 (9.95%) Web Services
3 62 (9.35%) React
4 53 (7.99%) Spark Streaming
5 50 (7.54%) Natural Language Processing
6 48 (7.24%) AngularJS
6 48 (7.24%) Spring
7 45 (6.79%) TensorFlow
8 35 (5.28%) REST
9 29 (4.37%) scikit-learn
10 27 (4.07%) JMS
10 27 (4.07%) Node.js
11 26 (3.92%) .NET
12 24 (3.62%) HTML
13 22 (3.32%) NumPy
13 22 (3.32%) Spring Boot
14 21 (3.17%) ActiveMQ
15 20 (3.02%) Akka
15 20 (3.02%) RabbitMQ
15 20 (3.02%) XML
Miscellaneous
1 76 (11.46%) Algorithms
2 61 (9.20%) Analytical Skills
3 39 (5.88%) Data Structures
3 39 (5.88%) Hedge funds
4 32 (4.83%) Management Information System
5 27 (4.07%) Equities
6 26 (3.92%) Self-Motivation
7 25 (3.77%) Blog
7 25 (3.77%) Greenfield Project
8 24 (3.62%) Hybrid Cloud
9 21 (3.17%) Acoustics
10 19 (2.87%) Cloud Native
11 15 (2.26%) Market Risk
12 14 (2.11%) Enterprise Software
12 14 (2.11%) Mobile App
13 13 (1.96%) Reference Data
13 13 (1.96%) Virtual Team
14 12 (1.81%) Linux Command Line
15 11 (1.66%) Pricing Data
16 10 (1.51%) Fixed Income
Operating Systems
1 89 (13.42%) Linux
2 55 (8.30%) Unix
3 11 (1.66%) Red Hat Enterprise Linux
3 11 (1.66%) Windows
4 3 (0.45%) Android
4 3 (0.45%) Apple iOS
4 3 (0.45%) CentOS
4 3 (0.45%) Windows Server
Processes & Methodologies
1 294 (44.34%) Analytics
2 270 (40.72%) Agile Software Development
3 242 (36.50%) Data Science
4 174 (26.24%) Machine Learning
5 139 (20.97%) Software Engineering
6 133 (20.06%) DevOps
6 133 (20.06%) ETL
7 129 (19.46%) Data Analytics
8 124 (18.70%) Artificial Intelligence
9 112 (16.89%) Computer Science
10 97 (14.63%) Microservices
11 96 (14.48%) Data Modelling
12 82 (12.37%) Data Engineering
13 77 (11.61%) Continuous Integration
14 74 (11.16%) Mathematics
15 73 (11.01%) Mentoring
15 73 (11.01%) TDD
16 71 (10.71%) Visualisation
17 65 (9.80%) Statistics
18 63 (9.50%) Problem-Solving
Programming Languages
1 446 (67.27%) Python
2 350 (52.79%) Java
3 295 (44.49%) SQL
4 199 (30.02%) Scala
5 121 (18.25%) R
6 84 (12.67%) JavaScript
7 55 (8.30%) C++
8 52 (7.84%) C#
9 36 (5.43%) Bash Shell
10 26 (3.92%) Go
11 25 (3.77%) Java 8
11 25 (3.77%) PL/SQL
12 21 (3.17%) PHP
13 17 (2.56%) Shell Script
13 17 (2.56%) VBA
14 16 (2.41%) C
15 14 (2.11%) Kotlin
16 12 (1.81%) HiveQL
16 12 (1.81%) PowerShell
16 12 (1.81%) TypeScript
Qualifications
1 160 (24.13%) Degree
2 81 (12.22%) Computer Science Degree
3 19 (2.87%) PhD
4 18 (2.71%) Security Cleared
5 14 (2.11%) DV Cleared
5 14 (2.11%) SC Cleared
6 9 (1.36%) BPSS Clearance
6 9 (1.36%) Numerate Degree
7 8 (1.21%) Master's Degree
8 7 (1.06%) Microsoft Certification
9 5 (0.75%) Postgraduate
10 4 (0.60%) MBA
10 4 (0.60%) PMI Certification
11 2 (0.30%) ACCA
11 2 (0.30%) AWS Certification
11 2 (0.30%) CIMA
11 2 (0.30%) ISTQB
Quality Assurance & Compliance
1 30 (4.52%) Data Quality
2 11 (1.66%) QA
3 7 (1.06%) GDPR
4 6 (0.90%) SLA
5 1 (0.15%) Actionable Recommendations
System Software
1 107 (16.14%) Docker
2 48 (7.24%) Apache ZooKeeper
3 40 (6.03%) HDFS
4 25 (3.77%) VirtualBox
5 16 (2.41%) Apache Flume
6 11 (1.66%) VMware Infrastructure
7 6 (0.90%) Samba
8 3 (0.45%) Active Directory
9 2 (0.30%) Hyper-V
10 1 (0.15%) Virtual Machines
Systems Management
1 112 (16.89%) Kubernetes
2 73 (11.01%) Ansible
3 55 (8.30%) Terraform
4 29 (4.37%) Docker Swarm
5 23 (3.47%) Hadoop YARN
6 21 (3.17%) Puppet
7 16 (2.41%) Oozie
8 13 (1.96%) Opscode Chef
9 11 (1.66%) Salt
10 8 (1.21%) vRealize Orchestrator
11 6 (0.90%) Ambari
12 4 (0.60%) Kibana
12 4 (0.60%) Nagios
12 4 (0.60%) Prometheus
13 2 (0.30%) Cobbler
13 2 (0.30%) Mesos
13 2 (0.30%) Red Hat Satellite
13 2 (0.30%) ZABBIX
14 1 (0.15%) HAProxy
14 1 (0.15%) Zipkin
Vendors
1 94 (14.18%) Google
2 80 (12.07%) Tableau
3 70 (10.56%) Cloudera
4 68 (10.26%) Oracle
5 36 (5.43%) Hortonworks
6 35 (5.28%) Microsoft
6 35 (5.28%) Talend
7 28 (4.22%) IBM
7 28 (4.22%) Informatica
8 27 (4.07%) Databricks
9 21 (3.17%) Splunk
10 16 (2.41%) SAP
11 11 (1.66%) Alteryx
11 11 (1.66%) VMware
12 10 (1.51%) Sybase
13 9 (1.36%) Teradata
14 7 (1.06%) EXASOL
15 5 (0.75%) Dataiku
15 5 (0.75%) Foundry
15 5 (0.75%) Netezza