Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 24 January 2022

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 24 January 2022 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
24 Jan 2022		 Same period 2021 Same period 2020
Rank 260 191 201
Rank change year-on-year -69 +10 -61
Permanent jobs citing Hadoop 718 429 954
As % of all permanent jobs advertised in London 1.41% 1.80% 1.86%
As % of the Database & Business Intelligence category 4.74% 6.33% 6.56%
Number of salaries quoted 431 320 768
10th Percentile £48,750 £48,750 £52,500
25th Percentile £61,875 £57,500 £62,438
Median annual salary (50th Percentile) £80,000 £77,000 £75,000
Median % change year-on-year +3.90% +2.67% -
75th Percentile £105,000 £100,000 £93,750
90th Percentile £115,000 £111,375 £115,000
England median annual salary £75,000 £70,000 £70,000
% change year-on-year +7.14% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,146 6,778 14,544
As % of all permanent IT jobs advertised in London 29.84% 28.45% 28.41%
Number of salaries quoted 9,083 5,815 12,086
10th Percentile £45,000 £42,500 £38,750
25th Percentile £55,000 £52,500 £49,879
Median annual salary (50th Percentile) £70,000 £70,000 £65,000
Median % change year-on-year - +7.69% +4.00%
75th Percentile £90,000 £85,750 £85,000
90th Percentile £108,750 £100,000 £105,000
England median annual salary £60,000 £55,000 £52,500
% change year-on-year +9.09% +4.76% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 24 January 2022.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 24 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
Central London -39 146 £77,500 +3.33% 26
West London -65 16 £75,000 -3.23% 9
South London -15 2 - -
Hadoop
England

For the 6 months to 24 January 2022, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 446 (62.12%) Python
2 442 (61.56%) Apache Spark
3 410 (57.10%) Big Data
4 349 (48.61%) SQL
5 344 (47.91%) Java
6 339 (47.21%) AWS
7 335 (46.66%) Agile Software Development
8 321 (44.71%) Analytics
9 275 (38.30%) GCP
10 270 (37.60%) Kafka
11 266 (37.05%) Data Science
12 231 (32.17%) NoSQL
13 225 (31.34%) ETL
14 215 (29.94%) Azure
15 194 (27.02%) Apache Hive
16 185 (25.77%) Data Modelling
17 181 (25.21%) Scala
18 170 (23.68%) Machine Learning
19 169 (23.54%) Data Warehouse
19 169 (23.54%) DevOps
20 166 (23.12%) CI/CD
21 159 (22.14%) Google
22 157 (21.87%) MongoDB
23 156 (21.73%) Kubernetes
24 155 (21.59%) Data Pipeline
25 153 (21.31%) Docker
26 146 (20.33%) Data Engineering
27 145 (20.19%) Business Intelligence
28 144 (20.06%) Software Engineering
29 139 (19.36%) Social Skills

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 442 (61.56%) Apache Spark
2 104 (14.48%) Apache Airflow
3 88 (12.26%) Apache
4 87 (12.12%) Elasticsearch
5 61 (8.50%) SAS
6 25 (3.48%) Luigi
7 18 (2.51%) Jupyter
8 15 (2.09%) Apache Pig
8 15 (2.09%) Apache Pulsar
9 7 (0.97%) Confluence
10 5 (0.70%) OpenStack
10 5 (0.70%) Tornado
11 4 (0.56%) Appian
11 4 (0.56%) nginx
11 4 (0.56%) Oracle SOA Suite
11 4 (0.56%) Oracle Workflow
12 3 (0.42%) Apache Solr
13 1 (0.14%) CloudStack
13 1 (0.14%) CMS
13 1 (0.14%) IIS
Applications
1 10 (1.39%) Microsoft Excel
2 5 (0.70%) Microsoft PowerPoint
3 4 (0.56%) Chatbot
4 1 (0.14%) SPSS
Business Applications
1 8 (1.11%) Oracle BPM
2 1 (0.14%) Oracle EBS
2 1 (0.14%) SAP Oil and Gas
Cloud Services
1 339 (47.21%) AWS
2 275 (38.30%) GCP
3 215 (29.94%) Azure
4 78 (10.86%) Amazon S3
5 70 (9.75%) Snowflake
6 63 (8.77%) Amazon Kinesis
7 56 (7.80%) Power Platform
8 48 (6.69%) Serverless
9 45 (6.27%) Amazon EMR
10 29 (4.04%) GitHub
11 27 (3.76%) SaaS
12 22 (3.06%) Amazon EC2
13 18 (2.51%) OpenShift
13 18 (2.51%) PaaS
14 17 (2.37%) Cloud Computing
15 16 (2.23%) Azure Cosmos DB
16 15 (2.09%) Google Compute Engine
16 15 (2.09%) Matillion
17 14 (1.95%) Amazon ECS
17 14 (1.95%) AWS Lambda
Communications & Networking
1 40 (5.57%) HTTP
2 23 (3.20%) Wireless
3 8 (1.11%) TCP/IP
4 7 (0.97%) Internet
5 6 (0.84%) DNS
5 6 (0.84%) VLAN
6 4 (0.56%) Firewall
7 3 (0.42%) SMS
8 2 (0.28%) Broadband
8 2 (0.28%) SSL
9 1 (0.14%) 4G
9 1 (0.14%) Kerberos
9 1 (0.14%) LAN
9 1 (0.14%) WAN
Database & Business Intelligence
1 410 (57.10%) Big Data
2 231 (32.17%) NoSQL
3 194 (27.02%) Apache Hive
4 169 (23.54%) Data Warehouse
5 157 (21.87%) MongoDB
6 120 (16.71%) Data Lake
7 112 (15.60%) PostgreSQL
8 111 (15.46%) MySQL
9 109 (15.18%) HBase
10 108 (15.04%) Amazon Redshift
11 104 (14.48%) Flink
12 103 (14.35%) Apache Cassandra
13 89 (12.40%) BigQuery
14 80 (11.14%) Tableau
15 75 (10.45%) Relational Database
16 69 (9.61%) SQL Server
17 64 (8.91%) Impala
18 56 (7.80%) Power BI
19 51 (7.10%) Looker
20 41 (5.71%) Metadata
Development Applications
1 78 (10.86%) Jenkins
2 49 (6.82%) Git (software)
3 33 (4.60%) JUnit
4 29 (4.04%) Atlassian Bamboo
5 27 (3.76%) Bitbucket
6 21 (2.92%) Maven
7 19 (2.65%) GitLab
8 13 (1.81%) ERwin
8 13 (1.81%) JIRA
9 12 (1.67%) ER Studio
9 12 (1.67%) JMeter
9 12 (1.67%) PowerDesigner
9 12 (1.67%) Selenium
10 11 (1.53%) WebDriver
11 10 (1.39%) CircleCI
12 8 (1.11%) Gradle
12 8 (1.11%) Vagrant
13 6 (0.84%) Subversion
13 6 (0.84%) TeamCity
14 5 (0.70%) Octopus Deploy
General
1 139 (19.36%) Social Skills
2 126 (17.55%) Finance
3 61 (8.50%) Inclusion and Diversity
4 54 (7.52%) Analytical Skills
5 48 (6.69%) Retail
6 38 (5.29%) Banking
7 36 (5.01%) Marketing
8 33 (4.60%) Games
9 27 (3.76%) Presentation Skills
10 21 (2.92%) Public Sector
11 18 (2.51%) Law
12 17 (2.37%) Advertising
13 16 (2.23%) Telecoms
14 10 (1.39%) Investment Banking
15 9 (1.25%) Automotive
16 7 (0.97%) Manufacturing
17 5 (0.70%) Influencing Skills
17 5 (0.70%) Legal
17 5 (0.70%) Retail Banking
18 4 (0.56%) Front Office
Job Titles
1 248 (34.54%) Data Engineer
2 122 (16.99%) Developer
3 80 (11.14%) Architect
4 74 (10.31%) Data Architect
5 66 (9.19%) Java Developer
6 53 (7.38%) Big Data Engineer
7 46 (6.41%) Senior Data Engineer
8 35 (4.87%) Data Scientist
9 34 (4.74%) Python Engineer
10 33 (4.60%) Senior Developer
11 32 (4.46%) Data Manager
12 31 (4.32%) Software Engineer
13 30 (4.18%) Consultant
14 28 (3.90%) AWS Engineer
15 27 (3.76%) DevOps Engineer
16 26 (3.62%) Principal Engineer
17 25 (3.48%) Java Engineer
18 23 (3.20%) Hadoop Engineer
19 22 (3.06%) Cloud Developer
19 22 (3.06%) Scala Engineer
Libraries, Frameworks & Software Standards
1 270 (37.60%) Kafka
2 67 (9.33%) Apache Beam
3 65 (9.05%) REST
4 43 (5.99%) Spring
5 37 (5.15%) PySpark
6 33 (4.60%) Web Services
7 32 (4.46%) CSS
8 30 (4.18%) RESTful
9 27 (3.76%) Apache Thrift
9 27 (3.76%) RabbitMQ
10 24 (3.34%) Hibernate
11 23 (3.20%) JSON
12 22 (3.06%) Guava
12 22 (3.06%) JAX-RS
13 20 (2.79%) ActiveMQ
13 20 (2.79%) Node.js
13 20 (2.79%) Spring Boot
14 18 (2.51%) XML
15 17 (2.37%) JMS
15 17 (2.37%) SOAP
Miscellaneous
1 73 (10.17%) Algorithms
2 40 (5.57%) Data Structures
3 35 (4.87%) Public Cloud
4 32 (4.46%) Virtual Team
5 22 (3.06%) User Experience
6 20 (2.79%) Greenfield Project
7 19 (2.65%) Self-Motivation
8 16 (2.23%) Cloud Native
8 16 (2.23%) Management Information System
9 15 (2.09%) Blog
9 15 (2.09%) Social Network
10 9 (1.25%) Private Cloud
10 9 (1.25%) Social Media
11 7 (0.97%) Equities
12 6 (0.84%) Life Science
13 5 (0.70%) Credit Risk
13 5 (0.70%) Replication
14 4 (0.56%) Derivative
14 4 (0.56%) Hybrid Cloud
15 3 (0.42%) Marketing Technology
Operating Systems
1 87 (12.12%) Unix
2 58 (8.08%) Linux
3 12 (1.67%) Windows
4 3 (0.42%) CentOS
4 3 (0.42%) DC/OS
4 3 (0.42%) Red Hat Enterprise Linux
5 2 (0.28%) Embedded Linux
6 1 (0.14%) Android
6 1 (0.14%) Apple iOS
6 1 (0.14%) Debian
6 1 (0.14%) Mac OS X
6 1 (0.14%) SUSE
6 1 (0.14%) Ubuntu
6 1 (0.14%) Windows Server
Processes & Methodologies
1 335 (46.66%) Agile Software Development
2 321 (44.71%) Analytics
3 266 (37.05%) Data Science
4 225 (31.34%) ETL
5 185 (25.77%) Data Modelling
6 170 (23.68%) Machine Learning
7 169 (23.54%) DevOps
8 166 (23.12%) CI/CD
9 155 (21.59%) Data Pipeline
10 146 (20.33%) Data Engineering
11 145 (20.19%) Business Intelligence
12 144 (20.06%) Software Engineering
13 113 (15.74%) Mentoring
14 100 (13.93%) Data Management
15 99 (13.79%) Visualisation
16 93 (12.95%) Computer Science
17 88 (12.26%) Microservices
18 87 (12.12%) Artificial Intelligence
19 79 (11.00%) Test Automation
20 77 (10.72%) Data Governance
Programming Languages
1 446 (62.12%) Python
2 349 (48.61%) SQL
3 344 (47.91%) Java
4 181 (25.21%) Scala
5 69 (9.61%) R
6 50 (6.96%) Go
7 41 (5.71%) JavaScript
8 32 (4.46%) PL/SQL
9 31 (4.32%) C++
10 30 (4.18%) Bash
11 25 (3.48%) Groovy
12 21 (2.92%) HiveQL
13 18 (2.51%) Java 8
14 17 (2.37%) C#
14 17 (2.37%) Ruby
14 17 (2.37%) Shell Script
15 13 (1.81%) Perl
16 10 (1.39%) T-SQL
17 9 (1.25%) C
18 8 (1.11%) PHP
Qualifications
1 93 (12.95%) Degree
2 46 (6.41%) Computer Science Degree
3 29 (4.04%) Security Cleared
4 19 (2.65%) Master's Degree
5 14 (1.95%) SC Cleared
6 13 (1.81%) PhD
6 13 (1.81%) SAS Certification
7 9 (1.25%) Microsoft Certification
8 6 (0.84%) MCSA
9 5 (0.70%) TOGAF Certification
10 4 (0.56%) AWS Certification
11 3 (0.42%) BPSS Clearance
11 3 (0.42%) DV Cleared
12 2 (0.28%) CCA
12 2 (0.28%) MCSE
13 1 (0.14%) CCNA
13 1 (0.14%) Cisco Certification
13 1 (0.14%) CISSP
13 1 (0.14%) PMI Certification
13 1 (0.14%) PMP
Quality Assurance & Compliance
1 73 (10.17%) Data Quality
2 27 (3.76%) GDPR
2 27 (3.76%) QA
3 5 (0.70%) Actionable Recommendations
4 1 (0.14%) Dodd-Frank
4 1 (0.14%) EMIR
4 1 (0.14%) FATCA
4 1 (0.14%) MiFID
System Software
1 153 (21.31%) Docker
2 52 (7.24%) HDFS
3 35 (4.87%) Apache ZooKeeper
4 22 (3.06%) Apache Flume
5 8 (1.11%) VirtualBox
6 5 (0.70%) Virtual Machines
7 3 (0.42%) VMware Infrastructure
8 1 (0.14%) vCloud
8 1 (0.14%) vSphere
Systems Management
1 156 (21.73%) Kubernetes
2 57 (7.94%) Ansible
3 36 (5.01%) Terraform
4 32 (4.46%) Opscode Chef
5 31 (4.32%) Puppet
6 21 (2.92%) Oozie
7 13 (1.81%) Control-M
7 13 (1.81%) Docker Swarm
8 12 (1.67%) Grafana
9 11 (1.53%) Prometheus
10 8 (1.11%) Hadoop YARN
10 8 (1.11%) HAProxy
10 8 (1.11%) Single Sign-On
11 6 (0.84%) Salt
12 5 (0.70%) Graphite
13 4 (0.56%) Istio
14 3 (0.42%) Apache Brooklyn
14 3 (0.42%) Knative
14 3 (0.42%) Marathon
14 3 (0.42%) Mesos
Vendors
1 159 (22.14%) Google
2 127 (17.69%) Oracle
3 78 (10.86%) Databricks
4 55 (7.66%) Informatica
4 55 (7.66%) Microsoft
5 40 (5.57%) Cloudera
6 38 (5.29%) Talend
7 35 (4.87%) Splunk
8 34 (4.74%) Teradata
9 21 (2.92%) Hortonworks
10 17 (2.37%) IBM
11 16 (2.23%) Cognizant
12 11 (1.53%) Alteryx
13 9 (1.25%) Cisco
14 8 (1.11%) Checkmarx
14 8 (1.11%) Salesforce.com
15 7 (0.97%) Ab Initio
15 7 (0.97%) Samsung
16 6 (0.84%) DataFlux
16 6 (0.84%) MicroStrategy