Period
to 14 June 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 14 June 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
14 Jun 2021
Same period 2020 Same period 2019
Rank 190 181 124
Rank change year-on-year -9 -57 +2
Permanent jobs citing Hadoop 730 695 1,589
As % of all permanent jobs advertised in London 1.92% 2.00% 2.76%
As % of the Database & Business Intelligence category 6.28% 7.08% 9.53%
Number of salaries quoted 510 508 1,245
10th Percentile £46,250 £51,175 £50,000
25th Percentile £57,500 £62,500 £60,000
Median annual salary (50th Percentile) £80,000 £75,000 £75,000
Median % change year-on-year +6.67% - +3.45%
75th Percentile £98,750 £95,000 £95,000
90th Percentile £113,875 £120,000 £111,250
England median annual salary £75,000 £72,500 £70,000
% change year-on-year +3.45% +3.57% +3.70%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 11,625 9,817 16,667
As % of all permanent IT jobs advertised in London 30.55% 28.19% 28.95%
Number of salaries quoted 7,726 8,014 13,977
10th Percentile £43,750 £40,500 £38,000
25th Percentile £52,500 £50,000 £47,500
Median annual salary (50th Percentile) £70,000 £67,500 £65,000
Median % change year-on-year +3.70% +3.85% +8.33%
75th Percentile £87,500 £85,000 £82,500
90th Percentile £102,500 £105,000 £95,000
England median annual salary £55,000 £55,000 £52,500
% change year-on-year - +4.76% +5.00%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 14 June 2021.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 14 June 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +44 187 £80,000 +6.67% 32
West London -20 4 - - 5
South London -14 2 £75,000 +11.11% 3
Hadoop
England

For the 6 months to 14 June 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 530 (72.60%) Big Data
2 488 (66.85%) Apache Spark
3 413 (56.58%) AWS
4 404 (55.34%) Python
5 371 (50.82%) SQL
6 363 (49.73%) Java
7 300 (41.10%) GCP
8 296 (40.55%) Agile Software Development
9 293 (40.14%) Analytics
10 279 (38.22%) Kubernetes
11 268 (36.71%) Azure
12 251 (34.38%) Docker
13 245 (33.56%) Kafka
14 239 (32.74%) Software Engineering
15 223 (30.55%) NoSQL
16 220 (30.14%) ETL
16 220 (30.14%) Data Pipeline
17 206 (28.22%) Data Science
18 196 (26.85%) Data Engineering
19 174 (23.84%) Artificial Intelligence
20 161 (22.05%) Finance
21 159 (21.78%) Amazon Redshift
22 153 (20.96%) Scala
23 147 (20.14%) Jenkins
24 146 (20.00%) Microservices
25 141 (19.32%) Google
26 137 (18.77%) Ansible
27 135 (18.49%) Continuous Integration
28 134 (18.36%) Apache Hive
29 129 (17.67%) DevOps

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 488 (66.85%) Apache Spark
2 80 (10.96%) Elasticsearch
3 75 (10.27%) Apache Airflow
4 59 (8.08%) Apache
5 41 (5.62%) SAS
6 35 (4.79%) Apache Pig
7 32 (4.38%) Luigi
8 14 (1.92%) Confluence
9 8 (1.10%) IIS
9 8 (1.10%) OpenStack
10 7 (0.96%) Jupyter
10 7 (0.96%) Oracle Workflow
11 6 (0.82%) Oracle SOA Suite
11 6 (0.82%) WebLogic
12 4 (0.55%) Cloud Foundry
12 4 (0.55%) CloudStack
12 4 (0.55%) CMS
12 4 (0.55%) nginx
13 3 (0.41%) Mule
14 2 (0.27%) GemFire
Applications
1 8 (1.10%) SPSS
2 5 (0.68%) Microsoft Office
3 3 (0.41%) Microsoft Excel
4 1 (0.14%) Microsoft PowerPoint
4 1 (0.14%) Spreadsheet
Business Applications
1 3 (0.41%) Oracle EBS
2 1 (0.14%) SAP Hybris
Cloud Services
1 413 (56.58%) AWS
2 300 (41.10%) GCP
3 268 (36.71%) Azure
4 89 (12.19%) Amazon EMR
5 77 (10.55%) Serverless
6 71 (9.73%) IBM Cloud
7 70 (9.59%) Snowflake
8 53 (7.26%) Cloud Functions
9 37 (5.07%) Power Platform
9 37 (5.07%) SaaS
10 35 (4.79%) AWS Lambda
11 31 (4.25%) Google Compute Engine
12 30 (4.11%) Google App Engine
12 30 (4.11%) Google Container Engine
13 29 (3.97%) Amazon EC2
14 28 (3.84%) Cloud Computing
15 26 (3.56%) Amazon Kinesis
16 20 (2.74%) Amazon S3
17 14 (1.92%) AWS CloudFormation
18 11 (1.51%) Azure Data Factory
Communications & Networking
1 36 (4.93%) HTTP
2 17 (2.33%) Internet
3 15 (2.05%) Wireless
4 10 (1.37%) FTP
5 7 (0.96%) Firewall
6 5 (0.68%) SMS
6 5 (0.68%) TCP/IP
7 4 (0.55%) VLAN
8 2 (0.27%) DNS
9 1 (0.14%) 802.11
9 1 (0.14%) Broadband
9 1 (0.14%) DHCP
9 1 (0.14%) Fibre Channel
9 1 (0.14%) Intranet
9 1 (0.14%) Kerberos
9 1 (0.14%) LAN
9 1 (0.14%) SAN
9 1 (0.14%) SNMP
9 1 (0.14%) SSH
9 1 (0.14%) WAN
Database & Business Intelligence
1 530 (72.60%) Big Data
2 223 (30.55%) NoSQL
3 159 (21.78%) Amazon Redshift
4 134 (18.36%) Apache Hive
5 107 (14.66%) Data Warehouse
6 94 (12.88%) MongoDB
7 93 (12.74%) Data Lake
8 82 (11.23%) Relational Database
9 78 (10.68%) Amazon Athena
9 78 (10.68%) Neo4j
10 71 (9.73%) Electronic Patient Records
11 66 (9.04%) SQL Server
12 65 (8.90%) Apache Cassandra
13 57 (7.81%) HBase
13 57 (7.81%) Tableau
14 53 (7.26%) PostgreSQL
15 48 (6.58%) MySQL
16 47 (6.44%) BigQuery
17 42 (5.75%) Flink
18 37 (5.07%) Power BI
Development Applications
1 147 (20.14%) Jenkins
2 111 (15.21%) Atlassian Bamboo
3 77 (10.55%) Vagrant
4 50 (6.85%) Git (software)
5 48 (6.58%) JMeter
6 32 (4.38%) JIRA
7 30 (4.11%) Gradle
8 28 (3.84%) Postman
9 25 (3.42%) JUnit
10 23 (3.15%) Cypress.io
10 23 (3.15%) Selenium
11 21 (2.88%) WebDriver
12 18 (2.47%) Maven
13 17 (2.33%) ER Studio
13 17 (2.33%) ERwin
14 13 (1.78%) TeamCity
15 11 (1.51%) SonarQube
15 11 (1.51%) Subversion
16 9 (1.23%) PowerDesigner
17 7 (0.96%) Sonatype Nexus
General
1 161 (22.05%) Finance
2 103 (14.11%) Social Skills
3 71 (9.73%) Analytical Skills
4 57 (7.81%) Banking
5 26 (3.56%) Advertising
5 26 (3.56%) Marketing
6 21 (2.88%) Law
7 16 (2.19%) Investment Banking
7 16 (2.19%) Retail
7 16 (2.19%) Telecoms
8 14 (1.92%) Front Office
8 14 (1.92%) Games
8 14 (1.92%) Legal
9 8 (1.10%) Manufacturing
10 7 (0.96%) Presentation Skills
11 4 (0.55%) Financial Institution
11 4 (0.55%) Retail Banking
12 3 (0.41%) Automotive
12 3 (0.41%) Publishing
13 2 (0.27%) Electronics
Job Titles
1 243 (33.29%) Data Engineer
2 144 (19.73%) Developer
3 94 (12.88%) Architect
4 89 (12.19%) Big Data Engineer
5 88 (12.05%) Software Engineer
6 80 (10.96%) Data Architect
7 77 (10.55%) Java Developer
8 68 (9.32%) Platform Engineer
9 50 (6.85%) Java Engineer
10 46 (6.30%) AWS Engineer
10 46 (6.30%) Senior Data Engineer
11 40 (5.48%) Java Software Engineer
12 34 (4.66%) Platform Architect
13 32 (4.38%) Data Scientist
14 26 (3.56%) Hadoop Engineer
14 26 (3.56%) Senior Developer
15 25 (3.42%) Consultant
16 24 (3.29%) Big Data Software Engineer
16 24 (3.29%) Data Analytics Engineer
16 24 (3.29%) Senior Platform Engineer
Libraries, Frameworks & Software Standards
1 245 (33.56%) Kafka
2 91 (12.47%) Spark Streaming
3 62 (8.49%) Web Services
4 56 (7.67%) AngularJS
5 53 (7.26%) REST
6 49 (6.71%) Spring
7 45 (6.16%) JSON
7 45 (6.16%) Spring Boot
8 41 (5.62%) React
9 36 (4.93%) Node.js
10 34 (4.66%) Apache Thrift
11 33 (4.52%) HTML
12 30 (4.11%) RESTful
13 28 (3.84%) CSS
14 26 (3.56%) Akka
15 25 (3.42%) GraphQL
16 23 (3.15%) HTML5
17 21 (2.88%) RabbitMQ
18 20 (2.74%) TensorFlow
19 19 (2.60%) JMS
Miscellaneous
1 44 (6.03%) Hybrid Cloud
2 28 (3.84%) Hedge funds
2 28 (3.84%) Self-Motivation
3 24 (3.29%) Equities
4 23 (3.15%) Virtual Team
5 22 (3.01%) Data Structures
6 20 (2.74%) Algorithms
6 20 (2.74%) Greenfield Project
7 16 (2.19%) Public Cloud
8 15 (2.05%) User Experience
9 14 (1.92%) Cyberattack
10 12 (1.64%) Private Cloud
11 9 (1.23%) Cloud Native
11 9 (1.23%) Derivative
11 9 (1.23%) Reference Data
12 8 (1.10%) Internet of Things
12 8 (1.10%) LIMS
13 7 (0.96%) Data Centre
14 6 (0.82%) Fixed Income
14 6 (0.82%) Replication
Operating Systems
1 69 (9.45%) Linux
2 60 (8.22%) Unix
3 15 (2.05%) Red Hat Enterprise Linux
4 11 (1.51%) CentOS
4 11 (1.51%) Windows
5 3 (0.41%) Windows Server
5 3 (0.41%) Windows Server 2016
6 1 (0.14%) Ubuntu
Processes & Methodologies
1 296 (40.55%) Agile Software Development
2 293 (40.14%) Analytics
3 239 (32.74%) Software Engineering
4 220 (30.14%) Data Pipeline
4 220 (30.14%) ETL
5 206 (28.22%) Data Science
6 196 (26.85%) Data Engineering
7 174 (23.84%) Artificial Intelligence
8 146 (20.00%) Microservices
9 135 (18.49%) Continuous Integration
10 129 (17.67%) DevOps
11 113 (15.48%) Open Source
12 109 (14.93%) Unit Testing
13 98 (13.42%) Machine Learning
14 95 (13.01%) Data Munging
15 93 (12.74%) Visualisation
16 89 (12.19%) Configuration Management
17 84 (11.51%) Data Modelling
18 81 (11.10%) Business Intelligence
19 76 (10.41%) Computer Science
Programming Languages
1 404 (55.34%) Python
2 371 (50.82%) SQL
3 363 (49.73%) Java
4 153 (20.96%) Scala
5 60 (8.22%) C#
6 54 (7.40%) JavaScript
7 52 (7.12%) TypeScript
8 41 (5.62%) Java 8
9 34 (4.66%) R
10 26 (3.56%) Bash Shell
11 24 (3.29%) PHP
12 22 (3.01%) Kotlin
12 22 (3.01%) Perl
13 18 (2.47%) ES6
14 17 (2.33%) C++
15 16 (2.19%) C
16 15 (2.05%) Shell Script
17 14 (1.92%) PL/SQL
17 14 (1.92%) PowerShell
18 11 (1.51%) HiveQL
Qualifications
1 102 (13.97%) Degree
2 56 (7.67%) Computer Science Degree
3 16 (2.19%) Security Cleared
4 11 (1.51%) SC Cleared
5 8 (1.10%) BPSS Clearance
5 8 (1.10%) PhD
6 7 (0.96%) Master's Degree
7 4 (0.55%) TOGAF Certification
8 3 (0.41%) DV Cleared
8 3 (0.41%) SAS Certification
9 2 (0.27%) CFA
10 1 (0.14%) AWS Certification
Quality Assurance & Compliance
1 39 (5.34%) QA
2 24 (3.29%) Data Quality
3 11 (1.51%) GDPR
4 1 (0.14%) ISO/IEC 27001
4 1 (0.14%) SLA
System Software
1 251 (34.38%) Docker
2 76 (10.41%) VirtualBox
3 42 (5.75%) HDFS
4 13 (1.78%) Apache ZooKeeper
5 6 (0.82%) Apache Flume
5 6 (0.82%) Oracle RAC
6 4 (0.55%) VMware Infrastructure
7 1 (0.14%) NFS
7 1 (0.14%) oVirt
Systems Management
1 279 (38.22%) Kubernetes
2 137 (18.77%) Ansible
3 102 (13.97%) Terraform
4 76 (10.41%) Docker Swarm
5 32 (4.38%) Puppet
6 22 (3.01%) Opscode Chef
7 9 (1.23%) Prometheus
8 7 (0.96%) ITRS Geneos
9 6 (0.82%) Data Guard
9 6 (0.82%) Oozie
9 6 (0.82%) Oracle RMAN
10 3 (0.41%) Hadoop YARN
11 1 (0.14%) Control-M
11 1 (0.14%) Nagios
11 1 (0.14%) Tivoli
11 1 (0.14%) ZABBIX
Vendors
1 141 (19.32%) Google
2 123 (16.85%) Cloudera
3 100 (13.70%) Talend
4 88 (12.05%) Informatica
5 85 (11.64%) Hortonworks
6 83 (11.37%) Oracle
7 74 (10.14%) IBM
8 55 (7.53%) Databricks
9 28 (3.84%) Teradata
10 22 (3.01%) Microsoft
11 18 (2.47%) Splunk
12 10 (1.37%) Alteryx
12 10 (1.37%) Red Hat
12 10 (1.37%) Salesforce.com
12 10 (1.37%) SAP
13 9 (1.23%) AppDynamics
14 6 (0.82%) Facebook
14 6 (0.82%) Marin
15 5 (0.68%) Dataiku
16 4 (0.55%) VMware