Period
to 8 March 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 8 March 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
8 Mar 2021
Same period 2020 Same period 2019
Rank 192 188 135
Rank change year-on-year -4 -53 -18
Permanent jobs citing Hadoop 499 964 1,590
As % of all permanent jobs advertised in London 1.76% 1.93% 2.56%
As % of the Database & Business Intelligence category 6.12% 6.90% 8.61%
Number of salaries quoted 416 803 1,295
Median annual salary £75,000 £75,000 £75,000
10th Percentile £48,750 £50,250 £48,000
90th Percentile £110,625 £113,750 £110,000
England median annual salary £72,500 £70,000 £70,000
% change year-on-year +3.57% - +7.69%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 8,159 13,972 18,463
As % of all permanent IT jobs advertised in London 28.82% 27.98% 29.78%
Number of salaries quoted 6,648 11,515 15,506
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,500 £38,750 £38,250
90th Percentile £100,000 £105,000 £95,000
England median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 8 March 2021.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 8 March 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +49 164 £80,000 +6.67% 34
West London +39 4 £70,000 +7.69% 18
East London +4 4 £65,000 -18.50% 2
Hadoop
England

For the 6 months to 8 March 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 344 (68.94%) Big Data
2 305 (61.12%) Apache Spark
3 301 (60.32%) Python
4 293 (58.72%) AWS
5 287 (57.52%) Java
6 239 (47.90%) SQL
7 198 (39.68%) Azure
8 193 (38.68%) Agile Software Development
9 179 (35.87%) Kafka
10 171 (34.27%) Analytics
11 169 (33.87%) ETL
12 159 (31.86%) GCP
13 151 (30.26%) Data Science
14 142 (28.46%) NoSQL
15 140 (28.06%) Kubernetes
16 134 (26.85%) Software Engineering
17 128 (25.65%) Docker
18 116 (23.25%) Finance
19 114 (22.85%) Scala
20 113 (22.65%) Apache Hive
21 112 (22.44%) Data Engineering
22 98 (19.64%) Microservices
22 98 (19.64%) Machine Learning
23 94 (18.84%) Artificial Intelligence
24 88 (17.64%) Oracle
25 84 (16.83%) MongoDB
25 84 (16.83%) Computer Science
25 84 (16.83%) DevOps
26 83 (16.63%) Cloudera
27 81 (16.23%) Degree

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 305 (61.12%) Apache Spark
2 60 (12.02%) SAS
3 48 (9.62%) Apache Airflow
4 47 (9.42%) Elasticsearch
5 36 (7.21%) Apache
6 24 (4.81%) Apache Pig
7 21 (4.21%) Luigi
8 13 (2.61%) Tornado
9 8 (1.60%) IIS
10 7 (1.40%) Confluence
11 6 (1.20%) Oracle Workflow
12 4 (0.80%) Oracle SOA Suite
12 4 (0.80%) WebLogic
13 3 (0.60%) Cloud Foundry
13 3 (0.60%) CloudStack
13 3 (0.60%) nginx
13 3 (0.60%) OpenStack
14 2 (0.40%) Jupyter
15 1 (0.20%) Apache Solr
15 1 (0.20%) GlassFish
Applications
1 8 (1.60%) SPSS
2 3 (0.60%) Microsoft Office
3 2 (0.40%) Microsoft Excel
Business Applications
1 4 (0.80%) Oracle EBS
2 1 (0.20%) Distributed Ledger
2 1 (0.20%) Oracle Cash Management
2 1 (0.20%) SAP APO
2 1 (0.20%) SAP Hybris
Cloud Services
1 293 (58.72%) AWS
2 198 (39.68%) Azure
3 159 (31.86%) GCP
4 45 (9.02%) Power Platform
5 40 (8.02%) Amazon EMR
6 31 (6.21%) Serverless
7 26 (5.21%) Amazon Kinesis
8 19 (3.81%) Amazon S3
8 19 (3.81%) IBM Cloud
9 18 (3.61%) AWS Lambda
10 17 (3.41%) Azure Data Factory
10 17 (3.41%) SaaS
11 15 (3.01%) Amazon EC2
12 12 (2.40%) Cloud Functions
13 11 (2.20%) IaaS
13 11 (2.20%) PaaS
14 10 (2.00%) Amazon SageMaker
14 10 (2.00%) AWS CloudFormation
15 8 (1.60%) Google Compute Engine
15 8 (1.60%) OpenShift
Communications & Networking
1 13 (2.61%) Firewall
2 11 (2.20%) HTTP
3 9 (1.80%) FTP
4 7 (1.40%) Internet
4 7 (1.40%) TCP/IP
5 4 (0.80%) 802.11
5 4 (0.80%) DNS
5 4 (0.80%) Fibre Channel
5 4 (0.80%) LAN
5 4 (0.80%) SAN
5 4 (0.80%) SNMP
5 4 (0.80%) SSH
5 4 (0.80%) WAN
5 4 (0.80%) Wireless
6 3 (0.60%) DMZ
6 3 (0.60%) Reverse Proxy
6 3 (0.60%) Software-Defined Networking
6 3 (0.60%) VLAN
6 3 (0.60%) VPN
7 2 (0.40%) SMS
Database & Business Intelligence
1 344 (68.94%) Big Data
2 142 (28.46%) NoSQL
3 113 (22.65%) Apache Hive
4 84 (16.83%) MongoDB
5 79 (15.83%) Amazon Redshift
6 78 (15.63%) Data Warehouse
7 74 (14.83%) Apache Cassandra
8 70 (14.03%) Data Lake
9 47 (9.42%) Tableau
10 46 (9.22%) Relational Database
11 45 (9.02%) PostgreSQL
11 45 (9.02%) Power BI
12 40 (8.02%) Oracle Database
12 40 (8.02%) SQL Server
13 37 (7.41%) Impala
14 35 (7.01%) Data Mining
14 35 (7.01%) HBase
14 35 (7.01%) Pentaho
15 33 (6.61%) MySQL
16 31 (6.21%) Amazon Athena
Development Applications
1 72 (14.43%) Jenkins
2 60 (12.02%) Git (software)
3 34 (6.81%) Maven
4 33 (6.61%) Atlassian Bamboo
5 20 (4.01%) Vagrant
6 15 (3.01%) Bitbucket
6 15 (3.01%) JIRA
7 14 (2.81%) JMeter
7 14 (2.81%) Selenium
8 13 (2.61%) TeamCity
9 12 (2.40%) Cucumber
10 11 (2.20%) JUnit
11 10 (2.00%) Artifactory
12 9 (1.80%) SonarQube
12 9 (1.80%) WebDriver
13 8 (1.60%) ER Studio
13 8 (1.60%) Gradle
13 8 (1.60%) Postman
13 8 (1.60%) REST Assured
13 8 (1.60%) Sonatype Nexus
General
1 116 (23.25%) Finance
2 65 (13.03%) Banking
3 23 (4.61%) Games
4 21 (4.21%) Retail
5 20 (4.01%) Telecoms
6 19 (3.81%) Law
7 17 (3.41%) Marketing
8 15 (3.01%) Front Office
8 15 (3.01%) Investment Banking
9 12 (2.40%) Advertising
10 10 (2.00%) Manufacturing
11 7 (1.40%) Legal
12 4 (0.80%) Financial Institution
13 3 (0.60%) Electronics
13 3 (0.60%) Public Sector
14 1 (0.20%) Pharmaceutical
14 1 (0.20%) Retail Banking
Job Titles
1 179 (35.87%) Data Engineer
2 115 (23.05%) Developer
3 67 (13.43%) Java Developer
4 61 (12.22%) Big Data Engineer
5 47 (9.42%) Architect
6 40 (8.02%) Java Engineer
7 39 (7.82%) Data Scientist
8 38 (7.62%) Software Engineer
9 33 (6.61%) Data Architect
10 30 (6.01%) Consultant
11 29 (5.81%) Platform Engineer
11 29 (5.81%) Senior Data Engineer
12 25 (5.01%) AWS Engineer
13 24 (4.81%) Java Software Engineer
14 22 (4.41%) Senior Developer
15 18 (3.61%) Big Data Developer
16 17 (3.41%) Big Data Software Engineer
17 15 (3.01%) Hadoop Engineer
18 14 (2.81%) Data Consultant
18 14 (2.81%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 179 (35.87%) Kafka
2 44 (8.82%) Spring
3 38 (7.62%) Node.js
3 38 (7.62%) React
3 38 (7.62%) Spring Boot
3 38 (7.62%) Web Services
4 33 (6.61%) RESTful
5 28 (5.61%) AngularJS
5 28 (5.61%) Spark Streaming
6 26 (5.21%) REST
7 25 (5.01%) CSS
7 25 (5.01%) HTML
7 25 (5.01%) JSON
8 23 (4.61%) Natural Language Processing
8 23 (4.61%) TensorFlow
9 20 (4.01%) RabbitMQ
10 19 (3.81%) ActiveMQ
10 19 (3.81%) HTML5
11 18 (3.61%) JMS
12 15 (3.01%) PySpark
Miscellaneous
1 53 (10.62%) Analytical Skills
2 34 (6.81%) Algorithms
3 24 (4.81%) Self-Motivation
4 21 (4.21%) Hybrid Cloud
5 19 (3.81%) Data Structures
6 16 (3.21%) Cloud Native
6 16 (3.21%) Virtual Team
7 14 (2.81%) Public Cloud
8 13 (2.61%) Hedge funds
9 12 (2.40%) Equities
10 11 (2.20%) Credit Risk
10 11 (2.20%) Market Risk
11 10 (2.00%) Derivative
11 10 (2.00%) Greenfield Project
12 8 (1.60%) Private Cloud
13 7 (1.40%) Cyberattack
14 6 (1.20%) Acoustics
14 6 (1.20%) Blog
14 6 (1.20%) Data Centre
14 6 (1.20%) Replication
Operating Systems
1 53 (10.62%) Linux
2 52 (10.42%) Unix
3 14 (2.81%) CentOS
3 14 (2.81%) Windows
4 11 (2.20%) Red Hat Enterprise Linux
5 5 (1.00%) Windows Server
5 5 (1.00%) Windows Server 2016
6 4 (0.80%) Ubuntu
7 3 (0.60%) Oracle Linux
8 1 (0.20%) Android
8 1 (0.20%) Apple iOS
Processes & Methodologies
1 193 (38.68%) Agile Software Development
2 171 (34.27%) Analytics
3 169 (33.87%) ETL
4 151 (30.26%) Data Science
5 134 (26.85%) Software Engineering
6 112 (22.44%) Data Engineering
7 98 (19.64%) Machine Learning
7 98 (19.64%) Microservices
8 94 (18.84%) Artificial Intelligence
9 84 (16.83%) Computer Science
9 84 (16.83%) DevOps
10 75 (15.03%) Visualisation
11 67 (13.43%) Data Analytics
12 66 (13.23%) Business Intelligence
13 65 (13.03%) Open Source
14 52 (10.42%) Scrum
15 49 (9.82%) Mentoring
16 46 (9.22%) Site Reliability Engineering
17 44 (8.82%) Continuous Integration
17 44 (8.82%) Data Visualisation
Programming Languages
1 301 (60.32%) Python
2 287 (57.52%) Java
3 239 (47.90%) SQL
4 114 (22.85%) Scala
5 58 (11.62%) JavaScript
6 47 (9.42%) C#
7 38 (7.62%) R
8 36 (7.21%) PL/SQL
9 30 (6.01%) Bash Shell
10 29 (5.81%) PHP
11 28 (5.61%) Shell Script
12 24 (4.81%) HiveQL
12 24 (4.81%) Java 8
13 22 (4.41%) Kotlin
14 21 (4.21%) TypeScript
15 19 (3.81%) C
15 19 (3.81%) C++
15 19 (3.81%) Perl
16 16 (3.21%) ES6
17 8 (1.60%) PowerShell
Qualifications
1 81 (16.23%) Degree
2 40 (8.02%) Computer Science Degree
3 19 (3.81%) PhD
4 14 (2.81%) BPSS Clearance
5 9 (1.80%) SC Cleared
5 9 (1.80%) Security Cleared
6 7 (1.40%) TOGAF Certification
7 4 (0.80%) Master's Degree
8 2 (0.40%) AWS Certification
9 1 (0.20%) DV Cleared
9 1 (0.20%) HND
Quality Assurance & Compliance
1 34 (6.81%) QA
2 14 (2.81%) Data Quality
3 2 (0.40%) GDPR
3 2 (0.40%) ISO/IEC 27001
4 1 (0.20%) ISO 20022
4 1 (0.20%) ISO 9001
4 1 (0.20%) PMO
4 1 (0.20%) PSD2
4 1 (0.20%) SLA
4 1 (0.20%) TARGET2
System Software
1 128 (25.65%) Docker
2 43 (8.62%) HDFS
3 19 (3.81%) VirtualBox
4 7 (1.40%) Apache ZooKeeper
4 7 (1.40%) VMware Infrastructure
5 4 (0.80%) Apache Flume
5 4 (0.80%) Oracle RAC
6 1 (0.20%) Active Directory
6 1 (0.20%) NFS
6 1 (0.20%) oVirt
Systems Management
1 140 (28.06%) Kubernetes
2 72 (14.43%) Ansible
3 59 (11.82%) Terraform
4 26 (5.21%) Puppet
5 23 (4.61%) Opscode Chef
6 19 (3.81%) Docker Swarm
7 6 (1.20%) ITRS Geneos
7 6 (1.20%) Prometheus
8 4 (0.80%) Data Guard
8 4 (0.80%) Nagios
8 4 (0.80%) Oozie
8 4 (0.80%) Oracle RMAN
9 3 (0.60%) ZABBIX
10 1 (0.20%) Hadoop YARN
Vendors
1 88 (17.64%) Oracle
2 83 (16.63%) Cloudera
3 73 (14.63%) Google
4 60 (12.02%) Databricks
5 59 (11.82%) Talend
6 58 (11.62%) Informatica
7 23 (4.61%) Hortonworks
8 22 (4.41%) IBM
9 19 (3.81%) Microsoft
10 13 (2.61%) Splunk
11 11 (2.20%) Red Hat
12 9 (1.80%) SAP
13 7 (1.40%) Alteryx
13 7 (1.40%) Teradata
13 7 (1.40%) VMware
14 6 (1.20%) AppDynamics
14 6 (1.20%) Facebook
14 6 (1.20%) Marin
14 6 (1.20%) NVIDIA
14 6 (1.20%) Salesforce.com