Period
to 21 January 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 January 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
21 Jan 2020
Same period 2019 Same period 2018
Rank 189 133 128
Rank change year-on-year -56 -5 +9
Permanent jobs citing Hadoop 968 1,606 1,890
As % of all permanent IT jobs advertised in London 1.88% 2.56% 2.72%
As % of the Database & Business Intelligence category 6.73% 8.69% 9.03%
Number of salaries quoted 770 1,211 1,523
London median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% -
10th Percentile £51,250 £47,500 £46,250
90th Percentile £113,750 £106,250 £106,250
England median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 14,388 18,481 20,941
As % of all permanent IT jobs advertised in London 28.00% 29.47% 30.18%
Number of salaries quoted 11,889 15,279 17,113
London median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £38,750 £37,500 £36,250
90th Percentile £105,000 £95,000 £88,750
England median annual salary £52,500 £52,500 £50,000
% change year-on-year - +5.00% +5.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 21 January 2020.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +32 237 £75,000 - 65
East London +5 27 £79,500 -0.63% 14
West London +12 23 £65,000 -14.47% 8
South London +6 6 £90,000 +22.03% 1
Hadoop
England

For the 6 months to 21 January 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 677 (69.94%) Big Data
2 636 (65.70%) Apache Spark
3 622 (64.26%) Python
4 499 (51.55%) AWS
5 456 (47.11%) SQL
6 422 (43.60%) Agile Software Development
7 412 (42.56%) Azure
8 403 (41.63%) Java
9 396 (40.91%) Analytics
10 337 (34.81%) Data Science
11 324 (33.47%) Machine Learning
12 296 (30.58%) Scala
13 290 (29.96%) Apache Hive
14 282 (29.13%) NoSQL
15 230 (23.76%) ETL
16 225 (23.24%) GCP
17 222 (22.93%) Data Modelling
18 220 (22.73%) DevOps
19 206 (21.28%) Finance
20 202 (20.87%) Business Intelligence
21 193 (19.94%) Data Engineering
22 192 (19.83%) Kafka
22 192 (19.83%) Linux
23 190 (19.63%) Google
24 186 (19.21%) Artificial Intelligence
25 183 (18.90%) Docker
26 179 (18.49%) Software Engineering
27 174 (17.98%) Data Warehouse
28 169 (17.46%) Computer Science
29 164 (16.94%) Data Analytics

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 636 (65.70%) Apache Spark
2 87 (8.99%) Apache
3 54 (5.58%) Elasticsearch
4 53 (5.48%) SAS
5 51 (5.27%) Apache Airflow
6 23 (2.38%) Apache Pig
7 20 (2.07%) Confluence
8 19 (1.96%) Luigi
8 19 (1.96%) Tomcat
9 18 (1.86%) IIS
10 15 (1.55%) Jupyter
11 10 (1.03%) Apache Solr
12 8 (0.83%) nginx
13 6 (0.62%) IPython
14 5 (0.52%) SharePoint
15 4 (0.41%) Cloud Foundry
15 4 (0.41%) MQSeries
15 4 (0.41%) Oracle SOA Suite
15 4 (0.41%) WebSphere
15 4 (0.41%) WebSphere Application Server
Applications
1 6 (0.62%) Microsoft Excel
1 6 (0.62%) SPSS
2 2 (0.21%) Microsoft Office
3 1 (0.10%) Chatbot
3 1 (0.10%) Microsoft PowerPoint
3 1 (0.10%) Microsoft Project
3 1 (0.10%) Simulink
3 1 (0.10%) Spreadsheet
3 1 (0.10%) SPSS Modeler
Business Applications
1 3 (0.31%) SAP BPC
2 2 (0.21%) Adobe Campaign
2 2 (0.21%) Eikon
3 1 (0.10%) Data Workbench
3 1 (0.10%) FINCAD Analytics
3 1 (0.10%) SAP ERP
3 1 (0.10%) SAP InfiniteInsight
3 1 (0.10%) SAP S/4HANA
3 1 (0.10%) Sparx Enterprise Architect
3 1 (0.10%) WebTrends
Cloud Services
1 499 (51.55%) AWS
2 412 (42.56%) Azure
3 225 (23.24%) GCP
4 96 (9.92%) Amazon EMR
5 89 (9.19%) Amazon S3
6 46 (4.75%) PaaS
7 44 (4.55%) Serverless
8 40 (4.13%) Power Platform
9 39 (4.03%) Azure Data Factory
10 38 (3.93%) Amazon Kinesis
11 30 (3.10%) AWS Lambda
12 29 (3.00%) GitHub
12 29 (3.00%) IBM Cloud
13 25 (2.58%) Amazon EC2
14 23 (2.38%) SaaS
15 18 (1.86%) Amazon SageMaker
15 18 (1.86%) IaaS
16 17 (1.76%) Amazon EKS
17 16 (1.65%) Azure Machine Learning
18 15 (1.55%) npm
Communications & Networking
1 29 (3.00%) Firewall
2 22 (2.27%) TCP/IP
3 21 (2.17%) Internet
4 20 (2.07%) SSL
5 15 (1.55%) DNS
6 14 (1.45%) Kerberos
7 12 (1.24%) HTTP
8 10 (1.03%) VPN
9 9 (0.93%) Broadband
10 5 (0.52%) HTTPS
11 4 (0.41%) SSH
12 3 (0.31%) VLAN
13 2 (0.21%) Reverse Proxy
13 2 (0.21%) SMS
14 1 (0.10%) 4G
14 1 (0.10%) IPFS
Database & Business Intelligence
1 677 (69.94%) Big Data
2 290 (29.96%) Apache Hive
3 282 (29.13%) NoSQL
4 174 (17.98%) Data Warehouse
5 134 (13.84%) Amazon Redshift
6 107 (11.05%) SQL Server
7 105 (10.85%) PostgreSQL
8 102 (10.54%) HBase
9 95 (9.81%) Relational Database
10 84 (8.68%) Apache Cassandra
11 83 (8.57%) Neo4j
12 78 (8.06%) MongoDB
13 77 (7.95%) BigQuery
14 72 (7.44%) Data Lake
15 67 (6.92%) Presto
16 62 (6.40%) Flink
17 59 (6.10%) Data Mining
18 58 (5.99%) Amazon Athena
19 56 (5.79%) MySQL
20 46 (4.75%) HDInsight
Development Applications
1 143 (14.77%) Git (software)
2 136 (14.05%) Jenkins
3 62 (6.40%) JIRA
4 58 (5.99%) Maven
5 44 (4.55%) Atlassian Bamboo
6 40 (4.13%) Artifactory
7 39 (4.03%) Vagrant
8 28 (2.89%) TeamCity
9 25 (2.58%) Bitbucket
9 25 (2.58%) SonarQube
10 23 (2.38%) Ant
11 20 (2.07%) Visual Studio Team System
12 17 (1.76%) Octopus Deploy
13 15 (1.55%) Bower
13 15 (1.55%) Chocolatey
13 15 (1.55%) MSBuild
13 15 (1.55%) ProC
13 15 (1.55%) Team Foundation Server
13 15 (1.55%) TestRail
13 15 (1.55%) Zephyr
General
1 206 (21.28%) Finance
2 81 (8.37%) Banking
3 70 (7.23%) Retail
4 37 (3.82%) Marketing
5 33 (3.41%) Front Office
5 33 (3.41%) Public Sector
6 30 (3.10%) Manufacturing
7 22 (2.27%) Automotive
7 22 (2.27%) Games
8 17 (1.76%) Telecoms
9 14 (1.45%) Advertising
9 14 (1.45%) Investment Banking
9 14 (1.45%) Legal
10 11 (1.14%) Law
11 6 (0.62%) Billing
12 3 (0.31%) Financial Institution
12 3 (0.31%) Retail Banking
13 2 (0.21%) Back Office
13 2 (0.21%) Electronics
13 2 (0.21%) Publishing
Job Titles
1 321 (33.16%) Data Engineer
2 172 (17.77%) Developer
3 127 (13.12%) Architect
4 86 (8.88%) Data Architect
4 86 (8.88%) Data Scientist
4 86 (8.88%) Java Developer
5 55 (5.68%) Senior Data Engineer
6 52 (5.37%) Python Engineer
7 47 (4.86%) Big Data Engineer
8 46 (4.75%) DevOps Engineer
9 42 (4.34%) Consultant
9 42 (4.34%) Senior Data Scientist
10 38 (3.93%) Platform Engineer
11 34 (3.51%) Software Engineer
12 33 (3.41%) Senior Developer
13 32 (3.31%) Cloud Architect
14 31 (3.20%) Analyst
15 30 (3.10%) Data Consultant
16 29 (3.00%) Java Engineer
17 28 (2.89%) Scala Developer
Libraries, Frameworks & Software Standards
1 192 (19.83%) Kafka
2 92 (9.50%) TensorFlow
3 72 (7.44%) React
4 67 (6.92%) Natural Language Processing
5 61 (6.30%) Web Services
6 58 (5.99%) Spark Streaming
7 56 (5.79%) AngularJS
8 55 (5.68%) Node.js
9 54 (5.58%) HTML
9 54 (5.58%) scikit-learn
10 46 (4.75%) REST
11 39 (4.03%) HTML5
12 36 (3.72%) Pandas
13 35 (3.62%) RESTful
14 32 (3.31%) Apache Beam
15 31 (3.20%) Elastic Stack
16 28 (2.89%) CSS
17 25 (2.58%) Dask
17 25 (2.58%) LAPP Stack
18 24 (2.48%) GraphQL
Miscellaneous
1 151 (15.60%) Analytical Skills
2 132 (13.64%) Algorithms
3 65 (6.71%) Data Structures
4 35 (3.62%) Linux Command Line
5 33 (3.41%) Greenfield Project
6 31 (3.20%) Management Information System
7 24 (2.48%) Blog
8 22 (2.27%) Virtual Team
9 20 (2.07%) Cloud Native
9 20 (2.07%) Mobile App
10 19 (1.96%) Acoustics
11 17 (1.76%) Derivative
12 16 (1.65%) Data Centre
12 16 (1.65%) User Experience
13 15 (1.55%) Self-Motivation
13 15 (1.55%) Social Media
14 11 (1.14%) Fixed Income
14 11 (1.14%) Public Cloud
15 10 (1.03%) Foreign Exchange (FX)
16 9 (0.93%) Hedge funds
Operating Systems
1 192 (19.83%) Linux
2 62 (6.40%) Unix
3 30 (3.10%) Windows
4 16 (1.65%) Windows Server
5 12 (1.24%) CentOS
6 8 (0.83%) zOS
7 7 (0.72%) Debian
8 5 (0.52%) Ubuntu
9 2 (0.21%) Red Hat Enterprise Linux
10 1 (0.10%) Solaris
Processes & Methodologies
1 422 (43.60%) Agile Software Development
2 396 (40.91%) Analytics
3 337 (34.81%) Data Science
4 324 (33.47%) Machine Learning
5 230 (23.76%) ETL
6 222 (22.93%) Data Modelling
7 220 (22.73%) DevOps
8 202 (20.87%) Business Intelligence
9 193 (19.94%) Data Engineering
10 186 (19.21%) Artificial Intelligence
11 179 (18.49%) Software Engineering
12 169 (17.46%) Computer Science
13 164 (16.94%) Data Analytics
14 156 (16.12%) Visualisation
15 121 (12.50%) Statistics
16 112 (11.57%) Microservices
17 100 (10.33%) Fintech
18 97 (10.02%) Open Source
19 95 (9.81%) Problem-Solving
20 93 (9.61%) TDD
Programming Languages
1 622 (64.26%) Python
2 456 (47.11%) SQL
3 403 (41.63%) Java
4 296 (30.58%) Scala
5 139 (14.36%) JavaScript
6 124 (12.81%) R
7 88 (9.09%) C#
8 61 (6.30%) C
9 54 (5.58%) Bash Shell
10 53 (5.48%) PL/SQL
11 50 (5.17%) C++
12 43 (4.44%) PHP
13 41 (4.24%) TypeScript
14 27 (2.79%) Kotlin
14 27 (2.79%) T-SQL
15 26 (2.69%) PowerShell
16 25 (2.58%) Go
17 22 (2.27%) Shell Script
18 21 (2.17%) Java 8
19 19 (1.96%) ES6
Qualifications
1 152 (15.70%) Degree
2 61 (6.30%) Computer Science Degree
3 51 (5.27%) PhD
4 31 (3.20%) Master's Degree
5 21 (2.17%) Numerate Degree
6 12 (1.24%) Security Cleared
7 10 (1.03%) SC Cleared
8 3 (0.31%) MBA
9 2 (0.21%) MCSA
9 2 (0.21%) Microsoft Certification
9 2 (0.21%) Postgraduate
10 1 (0.10%) ACCA
10 1 (0.10%) APMP
10 1 (0.10%) AWS Certification
10 1 (0.10%) CCA
10 1 (0.10%) CIMA
10 1 (0.10%) ITIL Certification
10 1 (0.10%) Six Sigma Black Belt
Quality Assurance & Compliance
1 87 (8.99%) Data Quality
2 68 (7.02%) QA
3 13 (1.34%) GDPR
4 11 (1.14%) ISO/IEC 27001
5 1 (0.10%) GxP
System Software
1 183 (18.90%) Docker
2 111 (11.47%) HDFS
3 37 (3.82%) VirtualBox
4 22 (2.27%) Apache ZooKeeper
5 17 (1.76%) Apache Flume
6 6 (0.62%) Active Directory
7 5 (0.52%) VMware Infrastructure
8 4 (0.41%) Cronacle
8 4 (0.41%) Hyper-V
9 3 (0.31%) Varnish
10 1 (0.10%) Alluxio
10 1 (0.10%) Ceph
10 1 (0.10%) etcd
10 1 (0.10%) Gluster
Systems Management
1 152 (15.70%) Kubernetes
2 120 (12.40%) Terraform
3 107 (11.05%) Ansible
4 53 (5.48%) Hadoop YARN
5 52 (5.37%) Oozie
6 42 (4.34%) Docker Swarm
7 36 (3.72%) Puppet
8 26 (2.69%) Opscode Chef
9 15 (1.55%) Consul
10 10 (1.03%) Ambari
10 10 (1.03%) Single Sign-On
11 5 (0.52%) HP Quality Center
11 5 (0.52%) Kibana
12 4 (0.41%) Control-M
12 4 (0.41%) logstash
12 4 (0.41%) Mesos
13 3 (0.31%) Marathon
13 3 (0.31%) Prometheus
13 3 (0.31%) Rancher
13 3 (0.31%) Salt
Vendors
1 190 (19.63%) Google
2 134 (13.84%) Cloudera
3 108 (11.16%) Oracle
4 99 (10.23%) Hortonworks
5 86 (8.88%) Tableau
6 85 (8.78%) Microsoft
7 63 (6.51%) Databricks
8 53 (5.48%) Teradata
9 49 (5.06%) Informatica
10 46 (4.75%) Talend
11 44 (4.55%) IBM
12 33 (3.41%) Splunk
13 17 (1.76%) Dataiku
14 16 (1.65%) Atlassian
15 15 (1.55%) Black Duck
16 12 (1.24%) MapR
17 11 (1.14%) Netezza
17 11 (1.14%) SAP
18 9 (0.93%) MicroStrategy
18 9 (0.93%) WorldPay