Period
to 22 September 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 22 September 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
22 Sep 2021
Same period 2020 Same period 2019
Rank 218 155 155
Rank change year-on-year -63 0 -23
Permanent jobs citing Hadoop 835 460 1,249
As % of all permanent jobs advertised in London 1.70% 2.24% 2.27%
As % of the Database & Business Intelligence category 5.29% 7.77% 7.85%
Number of salaries quoted 523 338 961
10th Percentile £47,500 £48,750 £51,250
25th Percentile £63,250 £62,500 £62,500
Median annual salary (50th Percentile) £80,000 £75,500 £80,000
Median % change year-on-year +5.96% -5.63% +6.67%
75th Percentile £98,750 £103,750 £95,000
90th Percentile £115,000 £127,500 £112,500
England median annual salary £80,000 £74,625 £70,000
% change year-on-year +7.20% +6.61% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,776 5,918 15,904
As % of all permanent IT jobs advertised in London 32.10% 28.82% 28.86%
Number of salaries quoted 9,336 4,946 13,295
10th Percentile £45,000 £42,500 £37,570
25th Percentile £53,750 £52,500 £48,750
Median annual salary (50th Percentile) £70,000 £70,000 £65,000
Median % change year-on-year - +7.69% +4.00%
75th Percentile £90,000 £87,500 £82,500
90th Percentile £107,500 £105,000 £97,500
England median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 22 September 2021.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 22 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -4 179 £82,500 +10.00% 32
West London -65 9 - - 9
South London -36 1 - - 1
Hadoop
England

For the 6 months to 22 September 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 567 (67.90%) Big Data
2 543 (65.03%) Apache Spark
3 443 (53.05%) Python
4 415 (49.70%) SQL
5 408 (48.86%) AWS
6 383 (45.87%) Java
7 366 (43.83%) Agile Software Development
8 345 (41.32%) GCP
9 342 (40.96%) Analytics
10 314 (37.60%) Kafka
11 287 (34.37%) Azure
11 287 (34.37%) Kubernetes
12 250 (29.94%) Docker
13 249 (29.82%) Data Science
14 240 (28.74%) NoSQL
15 229 (27.43%) ETL
16 207 (24.79%) Software Engineering
17 201 (24.07%) Finance
18 194 (23.23%) Scala
19 177 (21.20%) Data Pipeline
20 167 (20.00%) Data Engineering
20 167 (20.00%) Google
21 163 (19.52%) Apache Hive
22 157 (18.80%) Artificial Intelligence
23 149 (17.84%) Jenkins
24 146 (17.49%) Social Skills
25 145 (17.37%) DevOps
25 145 (17.37%) Data Warehouse
26 140 (16.77%) Data Modelling
27 136 (16.29%) Machine Learning

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 543 (65.03%) Apache Spark
2 124 (14.85%) Elasticsearch
3 108 (12.93%) Apache
4 85 (10.18%) Apache Airflow
5 48 (5.75%) SAS
6 29 (3.47%) Jupyter
7 27 (3.23%) Apache Pig
8 21 (2.51%) Luigi
9 7 (0.84%) Confluence
9 7 (0.84%) Oracle SOA Suite
10 6 (0.72%) CMS
10 6 (0.72%) OpenStack
11 4 (0.48%) Appian
11 4 (0.48%) Oracle Workflow
12 3 (0.36%) Mule
13 2 (0.24%) GemFire
13 2 (0.24%) IIS
13 2 (0.24%) nginx
13 2 (0.24%) Tomcat
13 2 (0.24%) WebSphere
Applications
1 16 (1.92%) Microsoft Excel
2 12 (1.44%) Microsoft PowerPoint
3 4 (0.48%) Chatbot
4 2 (0.24%) Microsoft Office
5 1 (0.12%) Spreadsheet
5 1 (0.12%) SPSS
Business Applications
1 7 (0.84%) Oracle BPM
2 1 (0.12%) Oracle EBS
2 1 (0.12%) SAP Oil and Gas
Cloud Services
1 408 (48.86%) AWS
2 345 (41.32%) GCP
3 287 (34.37%) Azure
4 86 (10.30%) Snowflake
5 80 (9.58%) Serverless
6 66 (7.90%) Power Platform
7 63 (7.54%) Amazon EMR
8 55 (6.59%) Amazon Kinesis
9 50 (5.99%) IBM Cloud
10 48 (5.75%) Cloud Computing
11 40 (4.79%) AWS Lambda
11 40 (4.79%) Cloud Functions
11 40 (4.79%) SaaS
12 30 (3.59%) Amazon S3
13 27 (3.23%) PaaS
14 26 (3.11%) Google Compute Engine
15 24 (2.87%) Amazon EC2
16 23 (2.75%) Google App Engine
17 21 (2.51%) Google Container Engine
18 17 (2.04%) OpenShift
Communications & Networking
1 65 (7.78%) HTTP
2 25 (2.99%) Internet
3 24 (2.87%) Wireless
4 9 (1.08%) SMS
5 5 (0.60%) TCP/IP
6 4 (0.48%) Sourcefire
7 2 (0.24%) DNS
7 2 (0.24%) Firewall
7 2 (0.24%) FTP
7 2 (0.24%) VLAN
8 1 (0.12%) Broadband
Database & Business Intelligence
1 567 (67.90%) Big Data
2 240 (28.74%) NoSQL
3 163 (19.52%) Apache Hive
4 145 (17.37%) Data Warehouse
5 136 (16.29%) Amazon Redshift
6 127 (15.21%) MongoDB
7 114 (13.65%) Data Lake
8 89 (10.66%) Relational Database
9 88 (10.54%) HBase
10 84 (10.06%) Tableau
11 83 (9.94%) Apache Cassandra
12 73 (8.74%) BigQuery
12 73 (8.74%) PostgreSQL
13 71 (8.50%) SQL Server
14 68 (8.14%) Flink
15 66 (7.90%) Power BI
16 64 (7.66%) Neo4j
17 58 (6.95%) MySQL
18 48 (5.75%) Amazon Athena
19 47 (5.63%) Electronic Patient Records
Development Applications
1 149 (17.84%) Jenkins
2 106 (12.69%) Atlassian Bamboo
3 61 (7.31%) Git (software)
4 59 (7.07%) JMeter
5 54 (6.47%) Vagrant
6 46 (5.51%) JUnit
7 36 (4.31%) Gradle
8 35 (4.19%) Selenium
9 34 (4.07%) WebDriver
10 28 (3.35%) Postman
11 27 (3.23%) Maven
12 22 (2.63%) JIRA
13 19 (2.28%) Cypress.io
14 16 (1.92%) TeamCity
15 15 (1.80%) Bitbucket
16 11 (1.32%) ER Studio
16 11 (1.32%) ERwin
17 9 (1.08%) Eclipse
17 9 (1.08%) IntelliJ
17 9 (1.08%) PowerDesigner
General
1 201 (24.07%) Finance
2 146 (17.49%) Social Skills
3 66 (7.90%) Retail
4 65 (7.78%) Analytical Skills
5 51 (6.11%) Banking
6 26 (3.11%) Telecoms
7 24 (2.87%) Presentation Skills
8 22 (2.63%) Inclusion and Diversity
8 22 (2.63%) Marketing
9 18 (2.16%) Advertising
10 16 (1.92%) Games
11 15 (1.80%) Investment Banking
12 14 (1.68%) Law
12 14 (1.68%) Manufacturing
13 12 (1.44%) Retail Banking
14 10 (1.20%) Pharmaceutical
15 8 (0.96%) Automotive
15 8 (0.96%) Front Office
16 6 (0.72%) Legal
16 6 (0.72%) Public Sector
Job Titles
1 223 (26.71%) Data Engineer
2 154 (18.44%) Developer
3 132 (15.81%) Architect
4 114 (13.65%) Data Architect
5 101 (12.10%) Software Engineer
6 87 (10.42%) Java Developer
7 84 (10.06%) Big Data Engineer
8 60 (7.19%) Data Scientist
9 52 (6.23%) Java Engineer
10 48 (5.75%) Senior Data Engineer
11 45 (5.39%) Platform Engineer
12 43 (5.15%) Senior Developer
13 38 (4.55%) Big Data Architect
14 35 (4.19%) Scala Engineer
14 35 (4.19%) Senior Java Developer
15 33 (3.95%) Java Software Engineer
16 28 (3.35%) AWS Engineer
16 28 (3.35%) Platform Architect
16 28 (3.35%) Scala Developer
17 25 (2.99%) Consultant
Libraries, Frameworks & Software Standards
1 314 (37.60%) Kafka
2 74 (8.86%) REST
3 72 (8.62%) Spark Streaming
4 70 (8.38%) Web Services
5 65 (7.78%) JSON
6 64 (7.66%) Spring
7 57 (6.83%) Apache Thrift
8 55 (6.59%) Spring Boot
9 48 (5.75%) AngularJS
10 41 (4.91%) Akka
11 38 (4.55%) PySpark
12 37 (4.43%) RESTful
13 34 (4.07%) Apache Beam
14 33 (3.95%) HTML
15 30 (3.59%) Node.js
16 29 (3.47%) React
17 27 (3.23%) Dask
18 23 (2.75%) CSS
19 21 (2.51%) Lucene
19 21 (2.51%) RabbitMQ
Miscellaneous
1 72 (8.62%) Algorithms
2 34 (4.07%) Data Structures
3 30 (3.59%) Hybrid Cloud
4 29 (3.47%) Virtual Team
5 27 (3.23%) Self-Motivation
6 23 (2.75%) User Experience
7 22 (2.63%) Greenfield Project
8 20 (2.40%) Cloud Native
8 20 (2.40%) Public Cloud
9 19 (2.28%) Equities
10 18 (2.16%) Hedge funds
10 18 (2.16%) Management Information System
11 12 (1.44%) Internet of Things
12 11 (1.32%) Social Media
13 9 (1.08%) Private Cloud
14 8 (0.96%) Derivative
14 8 (0.96%) LIMS
14 8 (0.96%) Social Network
15 7 (0.84%) Credit Risk
15 7 (0.84%) Fixed Income
Operating Systems
1 79 (9.46%) Unix
2 53 (6.35%) Linux
3 9 (1.08%) Windows
4 3 (0.36%) DC/OS
5 1 (0.12%) CentOS
5 1 (0.12%) Red Hat Enterprise Linux
5 1 (0.12%) Windows Server
5 1 (0.12%) Windows Server 2012
Processes & Methodologies
1 366 (43.83%) Agile Software Development
2 342 (40.96%) Analytics
3 249 (29.82%) Data Science
4 229 (27.43%) ETL
5 207 (24.79%) Software Engineering
6 177 (21.20%) Data Pipeline
7 167 (20.00%) Data Engineering
8 157 (18.80%) Artificial Intelligence
9 145 (17.37%) DevOps
10 140 (16.77%) Data Modelling
11 136 (16.29%) Machine Learning
11 136 (16.29%) Microservices
12 127 (15.21%) Business Intelligence
13 126 (15.09%) Continuous Integration
14 117 (14.01%) Visualisation
15 100 (11.98%) Unit Testing
16 95 (11.38%) Open Source
17 94 (11.26%) Data Management
18 87 (10.42%) Mentoring
19 78 (9.34%) Fintech
Programming Languages
1 443 (53.05%) Python
2 415 (49.70%) SQL
3 383 (45.87%) Java
4 194 (23.23%) Scala
5 63 (7.54%) R
6 52 (6.23%) JavaScript
7 45 (5.39%) TypeScript
8 43 (5.15%) C#
9 42 (5.03%) Shell Script
10 37 (4.43%) Java 8
11 20 (2.40%) Bash Shell
11 20 (2.40%) PL/SQL
12 18 (2.16%) Go
13 16 (1.92%) PowerShell
14 14 (1.68%) C
15 13 (1.56%) Kotlin
16 12 (1.44%) C++
17 9 (1.08%) Clojure
17 9 (1.08%) HiveQL
18 8 (0.96%) ES6
Qualifications
1 108 (12.93%) Degree
2 36 (4.31%) Computer Science Degree
3 31 (3.71%) Security Cleared
4 20 (2.40%) Master's Degree
5 15 (1.80%) SC Cleared
6 13 (1.56%) PhD
7 10 (1.20%) SAS Certification
8 7 (0.84%) BPSS Clearance
9 5 (0.60%) AWS Certification
9 5 (0.60%) TOGAF Certification
10 4 (0.48%) MCSA
10 4 (0.48%) Microsoft Certification
11 3 (0.36%) CFA
12 2 (0.24%) CCA
12 2 (0.24%) DV Cleared
13 1 (0.12%) PMI Certification
13 1 (0.12%) PMP
Quality Assurance & Compliance
1 40 (4.79%) Data Quality
2 34 (4.07%) QA
3 32 (3.83%) GDPR
System Software
1 250 (29.94%) Docker
2 54 (6.47%) VirtualBox
3 43 (5.15%) HDFS
4 25 (2.99%) Apache ZooKeeper
5 8 (0.96%) Apache Flume
6 3 (0.36%) Virtual Machines
6 3 (0.36%) VMware Infrastructure
7 1 (0.12%) Active Directory
7 1 (0.12%) Hyper-V
7 1 (0.12%) Oracle RAC
Systems Management
1 287 (34.37%) Kubernetes
2 99 (11.86%) Ansible
3 76 (9.10%) Terraform
4 55 (6.59%) Docker Swarm
5 19 (2.28%) Puppet
6 11 (1.32%) Opscode Chef
7 10 (1.20%) Control-M
7 10 (1.20%) Oozie
8 9 (1.08%) Prometheus
9 6 (0.72%) Hadoop YARN
10 3 (0.36%) Apache Brooklyn
10 3 (0.36%) Marathon
10 3 (0.36%) Mesos
10 3 (0.36%) Single Sign-On
10 3 (0.36%) Tivoli
11 2 (0.24%) HAProxy
11 2 (0.24%) Istio
11 2 (0.24%) Knative
11 2 (0.24%) Salt
12 1 (0.12%) Consul
Vendors
1 167 (20.00%) Google
2 105 (12.57%) Oracle
3 90 (10.78%) Cloudera
4 75 (8.98%) Hortonworks
5 74 (8.86%) Talend
6 67 (8.02%) Informatica
7 65 (7.78%) Databricks
8 58 (6.95%) IBM
8 58 (6.95%) Microsoft
9 44 (5.27%) Teradata
10 30 (3.59%) Splunk
11 21 (2.51%) Samsung
12 12 (1.44%) Cisco
12 12 (1.44%) MicroStrategy
13 10 (1.20%) Cognizant
14 8 (0.96%) Alteryx
15 7 (0.84%) Dataiku
15 7 (0.84%) SAP
16 5 (0.60%) Apple
16 5 (0.60%) MapR