Period
to

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 9 August 2022 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
9 Aug 2022
Same period 2021 Same period 2020
Rank 268 211 169
Rank change year-on-year -57 -42 -42
Permanent jobs citing Hadoop 1,083 809 572
As % of all permanent jobs advertised in London 1.49% 1.78% 2.12%
As % of the Database & Business Intelligence category 4.78% 5.59% 7.56%
Number of salaries quoted 403 529 409
10th Percentile £51,193 £47,500 £50,000
25th Percentile £65,500 £57,500 £62,500
Median annual salary (50th Percentile) £85,000 £80,000 £75,000
Median % change year-on-year +6.25% +6.67% -6.25%
75th Percentile £103,750 £96,250 £100,000
90th Percentile £115,000 £112,500 £123,000
England median annual salary £80,000 £77,500 £75,000
% change year-on-year +3.23% +3.33% +7.14%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22,645 14,468 7,566
As % of all permanent IT jobs advertised in London 31.07% 31.79% 28.08%
Number of salaries quoted 9,111 8,629 6,130
10th Percentile £45,000 £43,750 £41,475
25th Percentile £55,000 £53,042 £51,250
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £90,000 £88,750 £85,188
90th Percentile £110,000 £105,000 £101,250
England median annual salary £60,000 £57,500 £55,000
% change year-on-year +4.35% +4.55% +4.76%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

3-month moving average salary quoted in jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

Salary distribution for jobs citing Hadoop in London over the 6 months to 9 August 2022.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 9 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London -120 83 £90,000 +9.09% 26
West London -26 15 £82,500 - 1
East London - 6 £85,000 - 2
South London -36 1 - -
Hadoop
England

For the 6 months to 9 August 2022, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 703 (64.91%) Python
2 694 (64.08%) Apache Spark
3 663 (61.22%) Agile
4 649 (59.93%) AWS
5 641 (59.19%) Big Data
6 629 (58.08%) Java
7 591 (54.57%) SQL
8 475 (43.86%) Kafka
9 455 (42.01%) Analytics
10 444 (41.00%) Azure
11 442 (40.81%) GCP
12 412 (38.04%) NoSQL
13 370 (34.16%) Data Science
14 356 (32.87%) Finance
15 333 (30.75%) Scala
16 322 (29.73%) ETL
17 318 (29.36%) CI/CD
18 317 (29.27%) Data Engineering
19 308 (28.44%) Machine Learning
20 306 (28.25%) DevOps
21 273 (25.21%) Kubernetes
22 266 (24.56%) Social Skills
23 259 (23.92%) MongoDB
24 257 (23.73%) Data Pipeline
25 252 (23.27%) Software Engineering
26 240 (22.16%) Apache Hive
26 240 (22.16%) Degree
27 220 (20.31%) Data Lake
28 218 (20.13%) Data Modelling
29 214 (19.76%) Docker

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 694 (64.08%) Apache Spark
2 183 (16.90%) Apache Airflow
3 95 (8.77%) Apache
4 73 (6.74%) Apache Pulsar
5 42 (3.88%) Apache Pig
6 33 (3.05%) Oracle Workflow
7 30 (2.77%) OpenStack
8 24 (2.22%) nginx
9 23 (2.12%) Confluence
10 18 (1.66%) SAS
11 15 (1.39%) Luigi
12 14 (1.29%) Apache Solr
13 9 (0.83%) SharePoint
14 8 (0.74%) Jupyter
15 7 (0.65%) Oracle SOA Suite
16 6 (0.55%) Pachyderm
17 3 (0.28%) JBoss
18 2 (0.18%) Appian
18 2 (0.18%) Ethereum
19 1 (0.092%) Hyperledger
Applications
1 11 (1.02%) Microsoft Excel
2 7 (0.65%) Microsoft Office
3 5 (0.46%) Maple
4 1 (0.092%) Microsoft PowerPoint
4 1 (0.092%) SPSS
Business Applications
1 19 (1.75%) Oracle Payables
2 18 (1.66%) Oracle BPM
3 5 (0.46%) SAP Oil and Gas
4 4 (0.37%) SAP Hybris
5 1 (0.092%) Distributed Ledger
Cloud Services
1 649 (59.93%) AWS
2 444 (41.00%) Azure
3 442 (40.81%) GCP
4 105 (9.70%) Snowflake
5 94 (8.68%) Amazon Kinesis
5 94 (8.68%) Amazon S3
6 79 (7.29%) Cloud Computing
7 71 (6.56%) Serverless
8 69 (6.37%) Power Platform
9 68 (6.28%) OpenShift
10 67 (6.19%) Azure Synapse Analytics
11 56 (5.17%) Google Kubernetes Engine
12 40 (3.69%) AWS CloudFormation
13 38 (3.51%) Azure Data Factory
13 38 (3.51%) SaaS
14 37 (3.42%) GitHub
15 29 (2.68%) MinIO
16 27 (2.49%) AWS Lambda
17 26 (2.40%) Amazon ECS
18 23 (2.12%) Amazon EMR
Communications & Networking
1 88 (8.13%) HTTP
2 56 (5.17%) TCP/IP
3 23 (2.12%) Firewall
4 22 (2.03%) Internet
5 19 (1.75%) DNS
6 10 (0.92%) Kerberos
6 10 (0.92%) VLAN
7 9 (0.83%) DHCP
8 5 (0.46%) Network Security
9 1 (0.092%) AMQP
9 1 (0.092%) DMZ
9 1 (0.092%) LAN
9 1 (0.092%) WAN
Database & Business Intelligence
1 641 (59.19%) Big Data
2 412 (38.04%) NoSQL
3 259 (23.92%) MongoDB
4 240 (22.16%) Apache Hive
5 220 (20.31%) Data Lake
6 213 (19.67%) Data Warehouse
7 190 (17.54%) HBase
8 188 (17.36%) Amazon Redshift
8 188 (17.36%) Flink
9 187 (17.27%) Apache Cassandra
10 139 (12.83%) BigQuery
11 128 (11.82%) Elasticsearch
12 124 (11.45%) Sqoop
13 122 (11.27%) MySQL
14 102 (9.42%) SQL Server
15 101 (9.33%) Relational Database
16 100 (9.23%) Tableau
17 96 (8.86%) Amazon Athena
18 95 (8.77%) PostgreSQL
19 84 (7.76%) Data Mining
Development Applications
1 202 (18.65%) Jenkins
2 169 (15.60%) Git (software)
3 93 (8.59%) JUnit
4 76 (7.02%) Atlassian Bamboo
5 64 (5.91%) CircleCI
5 64 (5.91%) Maven
6 58 (5.36%) Selenium
7 54 (4.99%) JIRA
8 52 (4.80%) JMeter
9 47 (4.34%) WebDriver
10 42 (3.88%) Gradle
11 25 (2.31%) Bitbucket
12 23 (2.12%) GitLab
12 23 (2.12%) Travis CI
13 22 (2.03%) Cucumber
14 18 (1.66%) Spock
15 17 (1.57%) IBM UrbanCode
16 16 (1.48%) Postman
17 13 (1.20%) ER Studio
17 13 (1.20%) MLflow
General
1 356 (32.87%) Finance
2 266 (24.56%) Social Skills
3 161 (14.87%) Analytical Skills
4 121 (11.17%) Banking
5 98 (9.05%) Inclusion and Diversity
6 89 (8.22%) Games
7 59 (5.45%) Marketing
8 51 (4.71%) Retail
9 39 (3.60%) Telecoms
10 24 (2.22%) Law
11 20 (1.85%) Front Office
12 19 (1.75%) Advertising
13 17 (1.57%) Presentation Skills
14 15 (1.39%) Legal
15 14 (1.29%) Public Sector
15 14 (1.29%) Retail Banking
16 11 (1.02%) Billing
16 11 (1.02%) Electronics
17 7 (0.65%) Organisational Skills
18 5 (0.46%) Police
Job Titles
1 351 (32.41%) Data Engineer
2 144 (13.30%) Software Engineer
3 120 (11.08%) Developer
4 112 (10.34%) Senior Data Engineer
5 93 (8.59%) Java Developer
6 90 (8.31%) Architect
7 85 (7.85%) Big Data Engineer
8 63 (5.82%) Consultant
8 63 (5.82%) Data Consultant
8 63 (5.82%) DevOps Engineer
9 50 (4.62%) Engineering Manager
10 47 (4.34%) Senior Developer
11 45 (4.16%) Python Engineer
11 45 (4.16%) Senior Java Developer
11 45 (4.16%) Test Engineer
12 43 (3.97%) Data Manager
13 42 (3.88%) Data Scientist
14 40 (3.69%) Principal Consultant
14 40 (3.69%) Senior Software Engineer
14 40 (3.69%) Software Test Engineer
Libraries, Frameworks & Software Standards
1 475 (43.86%) Kafka
2 141 (13.02%) REST
3 137 (12.65%) Spring
4 126 (11.63%) Web Services
5 123 (11.36%) PySpark
6 119 (10.99%) Apache Beam
7 83 (7.66%) Apache Thrift
8 74 (6.83%) JSON
9 66 (6.09%) Apache NiFi
10 65 (6.00%) Spring Boot
11 60 (5.54%) OAuth
12 53 (4.89%) Spark Streaming
13 52 (4.80%) RESTful
14 51 (4.71%) Node.js
15 43 (3.97%) ActiveMQ
16 41 (3.79%) Hibernate
16 41 (3.79%) TensorFlow
17 38 (3.51%) Protocol Buffers
18 36 (3.32%) Guice
18 36 (3.32%) Lucene
Miscellaneous
1 120 (11.08%) Algorithms
2 91 (8.40%) Data Structures
3 90 (8.31%) Social Media
4 89 (8.22%) Social Network
5 74 (6.83%) Public Cloud
6 59 (5.45%) Blog
6 59 (5.45%) Hackathon
7 52 (4.80%) Greenfield Project
8 37 (3.42%) Cloud Native
9 35 (3.23%) Private Cloud
9 35 (3.23%) User Experience
10 28 (2.59%) Hybrid Cloud
10 28 (2.59%) Self-Motivation
11 25 (2.31%) Linux Command Line
12 24 (2.22%) Virtual Team
13 22 (2.03%) Mobile App
13 22 (2.03%) Sports Betting
14 19 (1.75%) Management Information System
15 17 (1.57%) Equities
16 15 (1.39%) Robotics
Operating Systems
1 205 (18.93%) Linux
2 51 (4.71%) Unix
3 23 (2.12%) CentOS
4 22 (2.03%) Windows
5 20 (1.85%) Android
6 16 (1.48%) Red Hat Enterprise Linux
7 6 (0.55%) SUSE
8 5 (0.46%) Apple iOS
9 3 (0.28%) VMS
10 2 (0.18%) Mac OS X
11 1 (0.092%) MVS
11 1 (0.092%) Ubuntu
Processes & Methodologies
1 663 (61.22%) Agile
2 455 (42.01%) Analytics
3 370 (34.16%) Data Science
4 322 (29.73%) ETL
5 318 (29.36%) CI/CD
6 317 (29.27%) Data Engineering
7 308 (28.44%) Machine Learning
8 306 (28.25%) DevOps
9 257 (23.73%) Data Pipeline
10 252 (23.27%) Software Engineering
11 218 (20.13%) Data Modelling
12 211 (19.48%) Computer Science
13 199 (18.37%) Test Automation
14 175 (16.16%) Containerisation
14 175 (16.16%) Scrum
15 172 (15.88%) Microservices
16 168 (15.51%) Visualisation
17 164 (15.14%) Data Architecture
18 150 (13.85%) Mentoring
19 144 (13.30%) Data Management
Programming Languages
1 703 (64.91%) Python
2 629 (58.08%) Java
3 591 (54.57%) SQL
4 333 (30.75%) Scala
5 98 (9.05%) R
6 85 (7.85%) Bash
6 85 (7.85%) JavaScript
7 46 (4.25%) Groovy
8 43 (3.97%) C#
9 40 (3.69%) Go
9 40 (3.69%) TypeScript
10 27 (2.49%) Shell Script
11 21 (1.94%) C++
12 18 (1.66%) Perl
13 17 (1.57%) HiveQL
14 15 (1.39%) Ruby
15 14 (1.29%) Objective-C
16 12 (1.11%) PHP
17 11 (1.02%) PowerShell
18 10 (0.92%) PL/SQL
Qualifications
1 240 (22.16%) Degree
2 132 (12.19%) Computer Science Degree
3 104 (9.60%) Master's Degree
4 44 (4.06%) PhD
5 28 (2.59%) AWS Certification
5 28 (2.59%) Security Cleared
6 21 (1.94%) SC Cleared
7 9 (0.83%) MBA
8 6 (0.55%) CISSP
8 6 (0.55%) CRISC
9 4 (0.37%) DV Cleared
10 2 (0.18%) Microsoft Certification
10 2 (0.18%) TOGAF Certification
11 1 (0.092%) BPSS Clearance
11 1 (0.092%) Numerate Degree
Quality Assurance & Compliance
1 82 (7.57%) Data Quality
2 30 (2.77%) GDPR
3 27 (2.49%) QA
4 5 (0.46%) ISO/IEC 27001
4 5 (0.46%) NIST
5 3 (0.28%) PCI DSS
6 2 (0.18%) MiFID
7 1 (0.092%) PMO
7 1 (0.092%) SLA
System Software
1 214 (19.76%) Docker
2 122 (11.27%) Apache Flume
3 80 (7.39%) Apache ZooKeeper
4 39 (3.60%) HDFS
5 20 (1.85%) VMware Infrastructure
6 11 (1.02%) Virtual Machines
7 2 (0.18%) VirtualBox
8 1 (0.092%) Active Directory
Systems Management
1 273 (25.21%) Kubernetes
2 140 (12.93%) Ansible
3 133 (12.28%) Terraform
4 97 (8.96%) Oozie
5 67 (6.19%) Puppet
6 55 (5.08%) Opscode Chef
7 37 (3.42%) Grafana
8 33 (3.05%) HAProxy
9 30 (2.77%) Prometheus
10 18 (1.66%) Single Sign-On
11 15 (1.39%) Hadoop YARN
12 12 (1.11%) Docker Swarm
12 12 (1.11%) Kubeflow
13 10 (0.92%) Graphite
13 10 (0.92%) Salt
14 8 (0.74%) Istio
15 1 (0.092%) HP Fortify
15 1 (0.092%) Mesos
15 1 (0.092%) Packer
15 1 (0.092%) Rancher
Vendors
1 197 (18.19%) Google
2 180 (16.62%) Databricks
3 169 (15.60%) Oracle
4 124 (11.45%) Cloudera
5 102 (9.42%) Splunk
6 93 (8.59%) Microsoft
7 70 (6.46%) Teradata
8 35 (3.23%) Cisco
8 35 (3.23%) Salesforce.com
9 27 (2.49%) New Relic
10 26 (2.40%) Alteryx
11 25 (2.31%) Dell
11 25 (2.31%) VMware
12 24 (2.22%) IBM
13 23 (2.12%) F5
14 21 (1.94%) Informatica
15 19 (1.75%) CA
16 12 (1.11%) Facebook
16 12 (1.11%) Hitachi
16 12 (1.11%) SAP