Period
to 18 January 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 18 January 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
18 Jan 2020
Same period 2019 Same period 2018
Rank 190 132 130
Rank change year-on-year -58 -2 +3
Permanent jobs citing Hadoop 961 1,611 1,899
As % of all permanent IT jobs advertised in London 1.89% 2.56% 2.70%
As % of the Database & Business Intelligence category 6.73% 8.69% 8.98%
Number of salaries quoted 766 1,212 1,524
London median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% -
10th Percentile £51,875 £47,500 £45,250
90th Percentile £113,750 £106,250 £107,500
England median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 14,277 18,546 21,143
As % of all permanent IT jobs advertised in London 28.04% 29.46% 30.07%
Number of salaries quoted 11,791 15,335 17,245
London median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £38,750 £37,500 £36,250
90th Percentile £105,000 £95,000 £88,750
England median annual salary £52,500 £52,500 £50,000
% change year-on-year - +5.00% +5.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 18 January 2020.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 18 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +23 236 £75,000 - 60
East London +6 27 £79,500 -0.63% 15
West London +10 22 £65,000 -14.47% 9
South London +4 6 £90,000 +22.03% 1
Hadoop
England

For the 6 months to 18 January 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 675 (70.24%) Big Data
2 634 (65.97%) Apache Spark
3 620 (64.52%) Python
4 494 (51.40%) AWS
5 449 (46.72%) SQL
6 417 (43.39%) Agile Software Development
7 412 (42.87%) Azure
8 402 (41.83%) Java
9 390 (40.58%) Analytics
10 334 (34.76%) Data Science
11 324 (33.71%) Machine Learning
12 298 (31.01%) Scala
13 292 (30.39%) Apache Hive
14 281 (29.24%) NoSQL
15 224 (23.31%) ETL
16 223 (23.20%) GCP
17 221 (23.00%) Data Modelling
18 219 (22.79%) DevOps
19 201 (20.92%) Finance
20 199 (20.71%) Business Intelligence
21 193 (20.08%) Linux
22 191 (19.88%) Kafka
22 191 (19.88%) Data Engineering
23 189 (19.67%) Google
24 182 (18.94%) Artificial Intelligence
25 181 (18.83%) Docker
26 176 (18.31%) Software Engineering
27 172 (17.90%) Data Warehouse
28 168 (17.48%) Computer Science
29 163 (16.96%) Data Analytics

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 634 (65.97%) Apache Spark
2 85 (8.84%) Apache
3 56 (5.83%) Elasticsearch
4 52 (5.41%) SAS
5 50 (5.20%) Apache Airflow
6 23 (2.39%) Apache Pig
7 20 (2.08%) Confluence
8 19 (1.98%) Tomcat
9 18 (1.87%) IIS
9 18 (1.87%) Luigi
10 15 (1.56%) Jupyter
11 10 (1.04%) Apache Solr
12 8 (0.83%) nginx
13 6 (0.62%) IPython
14 5 (0.52%) SharePoint
15 4 (0.42%) Cloud Foundry
15 4 (0.42%) MQSeries
15 4 (0.42%) WebSphere
15 4 (0.42%) WebSphere Application Server
16 3 (0.31%) OpenStack
Applications
1 6 (0.62%) Microsoft Excel
1 6 (0.62%) SPSS
2 1 (0.10%) Chatbot
2 1 (0.10%) Microsoft Office
2 1 (0.10%) Microsoft PowerPoint
2 1 (0.10%) Microsoft Project
2 1 (0.10%) Simulink
2 1 (0.10%) Spreadsheet
2 1 (0.10%) SPSS Modeler
Business Applications
1 2 (0.21%) Eikon
1 2 (0.21%) SAP BPC
2 1 (0.10%) Adobe Campaign
2 1 (0.10%) Data Workbench
2 1 (0.10%) FINCAD Analytics
2 1 (0.10%) SAP ERP
2 1 (0.10%) SAP InfiniteInsight
2 1 (0.10%) SAP S/4HANA
2 1 (0.10%) Sparx Enterprise Architect
2 1 (0.10%) WebTrends
Cloud Services
1 494 (51.40%) AWS
2 412 (42.87%) Azure
3 223 (23.20%) GCP
4 92 (9.57%) Amazon EMR
5 90 (9.37%) Amazon S3
6 47 (4.89%) PaaS
7 45 (4.68%) Serverless
8 40 (4.16%) Azure Data Factory
9 39 (4.06%) Amazon Kinesis
9 39 (4.06%) Power Platform
10 31 (3.23%) AWS Lambda
11 27 (2.81%) GitHub
12 26 (2.71%) IBM Cloud
13 25 (2.60%) Amazon EC2
14 23 (2.39%) SaaS
15 18 (1.87%) Amazon SageMaker
15 18 (1.87%) IaaS
16 17 (1.77%) Amazon EKS
17 16 (1.66%) Azure Machine Learning
18 15 (1.56%) Amazon ECS
Communications & Networking
1 29 (3.02%) Firewall
2 22 (2.29%) TCP/IP
3 21 (2.19%) Internet
4 20 (2.08%) SSL
5 15 (1.56%) DNS
6 14 (1.46%) Kerberos
7 12 (1.25%) HTTP
8 10 (1.04%) VPN
9 9 (0.94%) Broadband
10 5 (0.52%) HTTPS
11 4 (0.42%) SSH
12 3 (0.31%) VLAN
13 2 (0.21%) SMS
14 1 (0.10%) 4G
14 1 (0.10%) IPFS
Database & Business Intelligence
1 675 (70.24%) Big Data
2 292 (30.39%) Apache Hive
3 281 (29.24%) NoSQL
4 172 (17.90%) Data Warehouse
5 132 (13.74%) Amazon Redshift
6 107 (11.13%) SQL Server
7 106 (11.03%) PostgreSQL
8 102 (10.61%) HBase
9 92 (9.57%) Relational Database
10 82 (8.53%) Apache Cassandra
11 81 (8.43%) Neo4j
12 78 (8.12%) MongoDB
13 77 (8.01%) BigQuery
14 73 (7.60%) Data Lake
15 67 (6.97%) Presto
16 61 (6.35%) Flink
17 59 (6.14%) Data Mining
18 54 (5.62%) Amazon Athena
19 52 (5.41%) MySQL
20 47 (4.89%) HDInsight
Development Applications
1 141 (14.67%) Git (software)
2 131 (13.63%) Jenkins
3 60 (6.24%) JIRA
4 58 (6.04%) Maven
5 41 (4.27%) Atlassian Bamboo
6 40 (4.16%) Artifactory
7 36 (3.75%) Vagrant
8 28 (2.91%) TeamCity
9 25 (2.60%) Bitbucket
9 25 (2.60%) SonarQube
10 23 (2.39%) Ant
11 20 (2.08%) Visual Studio Team System
12 17 (1.77%) Octopus Deploy
13 15 (1.56%) Bower
13 15 (1.56%) Chocolatey
13 15 (1.56%) MSBuild
13 15 (1.56%) ProC
13 15 (1.56%) Team Foundation Server
13 15 (1.56%) TestRail
13 15 (1.56%) Zephyr
General
1 201 (20.92%) Finance
2 79 (8.22%) Banking
3 68 (7.08%) Retail
4 36 (3.75%) Marketing
5 33 (3.43%) Front Office
6 32 (3.33%) Public Sector
7 27 (2.81%) Manufacturing
8 23 (2.39%) Games
9 21 (2.19%) Automotive
10 17 (1.77%) Telecoms
11 14 (1.46%) Advertising
11 14 (1.46%) Investment Banking
11 14 (1.46%) Legal
12 12 (1.25%) Law
13 6 (0.62%) Billing
14 4 (0.42%) Retail Banking
15 3 (0.31%) Financial Institution
16 2 (0.21%) Back Office
16 2 (0.21%) Electronics
16 2 (0.21%) Publishing
Job Titles
1 319 (33.19%) Data Engineer
2 171 (17.79%) Developer
3 127 (13.22%) Architect
4 87 (9.05%) Data Architect
5 85 (8.84%) Data Scientist
6 84 (8.74%) Java Developer
7 55 (5.72%) Senior Data Engineer
8 52 (5.41%) Python Engineer
9 47 (4.89%) Big Data Engineer
10 45 (4.68%) DevOps Engineer
11 43 (4.47%) Consultant
12 42 (4.37%) Senior Data Scientist
13 39 (4.06%) Platform Engineer
14 34 (3.54%) Software Engineer
15 33 (3.43%) Senior Developer
16 32 (3.33%) Cloud Architect
17 31 (3.23%) Analyst
17 31 (3.23%) Data Consultant
18 29 (3.02%) Java Engineer
18 29 (3.02%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 191 (19.88%) Kafka
2 90 (9.37%) TensorFlow
3 70 (7.28%) React
4 66 (6.87%) Natural Language Processing
5 59 (6.14%) Web Services
6 56 (5.83%) AngularJS
6 56 (5.83%) scikit-learn
7 55 (5.72%) Node.js
8 54 (5.62%) HTML
8 54 (5.62%) Spark Streaming
9 46 (4.79%) REST
10 39 (4.06%) HTML5
10 39 (4.06%) Pandas
11 34 (3.54%) RESTful
12 32 (3.33%) Apache Beam
12 32 (3.33%) Elastic Stack
13 28 (2.91%) CSS
14 25 (2.60%) Dask
14 25 (2.60%) GraphQL
14 25 (2.60%) NumPy
Miscellaneous
1 151 (15.71%) Analytical Skills
2 133 (13.84%) Algorithms
3 66 (6.87%) Data Structures
4 36 (3.75%) Linux Command Line
5 32 (3.33%) Greenfield Project
6 30 (3.12%) Management Information System
7 23 (2.39%) Virtual Team
8 21 (2.19%) Blog
9 20 (2.08%) Mobile App
10 19 (1.98%) Cloud Native
11 17 (1.77%) Derivative
11 17 (1.77%) User Experience
12 16 (1.66%) Acoustics
12 16 (1.66%) Data Centre
13 15 (1.56%) Self-Motivation
13 15 (1.56%) Social Media
14 11 (1.14%) Fixed Income
14 11 (1.14%) Public Cloud
15 10 (1.04%) Foreign Exchange (FX)
16 9 (0.94%) Market Risk
Operating Systems
1 193 (20.08%) Linux
2 65 (6.76%) Unix
3 29 (3.02%) Windows
4 15 (1.56%) Windows Server
5 12 (1.25%) CentOS
6 8 (0.83%) zOS
7 7 (0.73%) Debian
8 5 (0.52%) Ubuntu
9 2 (0.21%) Red Hat Enterprise Linux
10 1 (0.10%) Solaris
Processes & Methodologies
1 417 (43.39%) Agile Software Development
2 390 (40.58%) Analytics
3 334 (34.76%) Data Science
4 324 (33.71%) Machine Learning
5 224 (23.31%) ETL
6 221 (23.00%) Data Modelling
7 219 (22.79%) DevOps
8 199 (20.71%) Business Intelligence
9 191 (19.88%) Data Engineering
10 182 (18.94%) Artificial Intelligence
11 176 (18.31%) Software Engineering
12 168 (17.48%) Computer Science
13 163 (16.96%) Data Analytics
14 155 (16.13%) Visualisation
15 120 (12.49%) Statistics
16 109 (11.34%) Microservices
17 97 (10.09%) Fintech
18 95 (9.89%) Open Source
18 95 (9.89%) Problem-Solving
19 91 (9.47%) TDD
Programming Languages
1 620 (64.52%) Python
2 449 (46.72%) SQL
3 402 (41.83%) Java
4 298 (31.01%) Scala
5 137 (14.26%) JavaScript
6 123 (12.80%) R
7 88 (9.16%) C#
8 62 (6.45%) C
9 53 (5.52%) Bash Shell
9 53 (5.52%) PL/SQL
10 52 (5.41%) C++
11 43 (4.47%) PHP
12 42 (4.37%) TypeScript
13 27 (2.81%) Kotlin
13 27 (2.81%) T-SQL
14 26 (2.71%) PowerShell
15 24 (2.50%) Go
16 22 (2.29%) Shell Script
17 19 (1.98%) ES6
17 19 (1.98%) Ruby
Qualifications
1 151 (15.71%) Degree
2 62 (6.45%) Computer Science Degree
3 50 (5.20%) PhD
4 30 (3.12%) Master's Degree
5 20 (2.08%) Numerate Degree
6 13 (1.35%) Security Cleared
7 10 (1.04%) SC Cleared
8 3 (0.31%) MBA
9 2 (0.21%) MCSA
9 2 (0.21%) Microsoft Certification
9 2 (0.21%) Postgraduate
10 1 (0.10%) ACCA
10 1 (0.10%) APMP
10 1 (0.10%) AWS Certification
10 1 (0.10%) CCA
10 1 (0.10%) CIMA
10 1 (0.10%) DV Cleared
10 1 (0.10%) ITIL Certification
10 1 (0.10%) Six Sigma Black Belt
Quality Assurance & Compliance
1 87 (9.05%) Data Quality
2 69 (7.18%) QA
3 13 (1.35%) GDPR
4 11 (1.14%) ISO/IEC 27001
5 1 (0.10%) GxP
System Software
1 181 (18.83%) Docker
2 113 (11.76%) HDFS
3 34 (3.54%) VirtualBox
4 21 (2.19%) Apache ZooKeeper
5 17 (1.77%) Apache Flume
6 5 (0.52%) Active Directory
6 5 (0.52%) VMware Infrastructure
7 4 (0.42%) Cronacle
7 4 (0.42%) Hyper-V
8 3 (0.31%) Varnish
9 1 (0.10%) Alluxio
9 1 (0.10%) Ceph
9 1 (0.10%) etcd
9 1 (0.10%) Gluster
Systems Management
1 150 (15.61%) Kubernetes
2 118 (12.28%) Terraform
3 104 (10.82%) Ansible
4 56 (5.83%) Hadoop YARN
5 51 (5.31%) Oozie
6 39 (4.06%) Docker Swarm
7 36 (3.75%) Puppet
8 26 (2.71%) Opscode Chef
9 16 (1.66%) Consul
10 10 (1.04%) Ambari
10 10 (1.04%) Single Sign-On
11 6 (0.62%) Kibana
12 5 (0.52%) HP Quality Center
12 5 (0.52%) logstash
12 5 (0.52%) Mesos
13 4 (0.42%) Control-M
13 4 (0.42%) Marathon
13 4 (0.42%) Rancher
14 3 (0.31%) Prometheus
14 3 (0.31%) Salt
Vendors
1 189 (19.67%) Google
2 131 (13.63%) Cloudera
3 104 (10.82%) Oracle
4 96 (9.99%) Hortonworks
5 85 (8.84%) Microsoft
5 85 (8.84%) Tableau
6 64 (6.66%) Databricks
7 51 (5.31%) Teradata
8 46 (4.79%) Informatica
9 43 (4.47%) Talend
10 41 (4.27%) IBM
11 34 (3.54%) Splunk
12 17 (1.77%) Dataiku
13 16 (1.66%) Atlassian
14 15 (1.56%) Black Duck
15 12 (1.25%) MapR
16 11 (1.14%) Netezza
17 10 (1.04%) SAP
18 9 (0.94%) WorldPay
19 8 (0.83%) MicroStrategy