Period
to 17 October 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 October 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
17 Oct 2019
Same period 2018 Same period 2017
Rank 163 138 135
Rank change year-on-year -25 -3 +16
Permanent jobs citing Hadoop 1,170 1,703 1,936
As % of all permanent IT jobs advertised in London 2.14% 2.51% 2.60%
As % of the Database & Business Intelligence category 7.50% 8.14% 8.79%
Number of salaries quoted 893 1,243 1,438
London median annual salary £77,500 £75,000 £67,500
Median salary % change year-on-year +3.33% +11.11% -3.57%
10th Percentile £51,250 £46,500 £45,000
90th Percentile £112,500 £105,000 £105,000
England median annual salary £70,000 £70,000 £62,500
% change year-on-year - +12.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,607 20,912 22,026
As % of all permanent IT jobs advertised in London 28.54% 30.81% 29.58%
Number of salaries quoted 12,915 16,662 17,638
London median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £38,000 £37,500 £36,250
90th Percentile £97,500 £94,200 £90,000
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 17 October 2019.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 17 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +19 263 £77,500 +3.33% 53
West London +54 59 £70,000 +27.27% 9
East London +15 23 £79,500 -16.32% 20
South London -11 8 £83,750 +15.52% 1
North London - 7 £80,000 - 3
Hadoop
England

For the 6 months to 17 October 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 767 (65.56%) Big Data
2 751 (64.19%) Python
3 732 (62.56%) Apache Spark
4 551 (47.09%) SQL
5 519 (44.36%) Java
6 513 (43.85%) AWS
7 510 (43.59%) Agile Software Development
8 472 (40.34%) Analytics
9 428 (36.58%) Data Science
10 409 (34.96%) Scala
11 395 (33.76%) Azure
12 374 (31.97%) Apache Hive
13 358 (30.60%) Machine Learning
14 280 (23.93%) NoSQL
15 263 (22.48%) Kafka
16 249 (21.28%) Business Intelligence
17 243 (20.77%) GCP
18 236 (20.17%) ETL
18 236 (20.17%) Data Modelling
19 228 (19.49%) DevOps
20 224 (19.15%) Linux
21 219 (18.72%) Analytical Skills
22 218 (18.63%) Google
23 217 (18.55%) Finance
24 214 (18.29%) Software Engineering
25 206 (17.61%) Degree
26 204 (17.44%) Data Warehouse
27 201 (17.18%) Banking
28 195 (16.67%) Data Engineering
28 195 (16.67%) R

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 732 (62.56%) Apache Spark
2 104 (8.89%) Apache
3 69 (5.90%) Elasticsearch
4 61 (5.21%) Apache Pig
5 57 (4.87%) SAS
6 46 (3.93%) Apache Airflow
7 25 (2.14%) Apache Solr
8 14 (1.20%) IIS
9 12 (1.03%) Jupyter
9 12 (1.03%) nginx
10 10 (0.85%) Confluence
10 10 (0.85%) Tomcat
11 9 (0.77%) Luigi
12 8 (0.68%) WebSphere
13 6 (0.51%) MQSeries
13 6 (0.51%) WebSphere Application Server
14 5 (0.43%) SharePoint
15 4 (0.34%) Cloud Foundry
15 4 (0.34%) IPython
15 4 (0.34%) OpenStack
Applications
1 6 (0.51%) SPSS
2 4 (0.34%) GNU Octave
3 2 (0.17%) Microsoft PowerPoint
4 1 (0.085%) Chatbot
4 1 (0.085%) Microsoft Excel
4 1 (0.085%) Microsoft Office
4 1 (0.085%) Microsoft Project
4 1 (0.085%) Spreadsheet
4 1 (0.085%) SPSS Modeler
Business Applications
1 1 (0.085%) Adobe Campaign
1 1 (0.085%) Data Workbench
1 1 (0.085%) FINCAD Analytics
1 1 (0.085%) Magento
1 1 (0.085%) WebTrends
Cloud Services
1 513 (43.85%) AWS
2 395 (33.76%) Azure
3 243 (20.77%) GCP
4 85 (7.26%) Amazon EMR
5 83 (7.09%) PaaS
6 69 (5.90%) Amazon S3
7 60 (5.13%) Power Platform
8 52 (4.44%) Serverless
9 44 (3.76%) Azure Data Factory
10 42 (3.59%) SaaS
11 39 (3.33%) GitHub
12 32 (2.74%) Cloud Computing
13 28 (2.39%) Amazon EC2
13 28 (2.39%) Amazon Kinesis
14 22 (1.88%) IaaS
15 21 (1.79%) IBM Cloud
16 20 (1.71%) Amazon ECS
17 19 (1.62%) AWS Lambda
18 11 (0.94%) Azure Functions
19 10 (0.85%) Amazon EKS
Communications & Networking
1 42 (3.59%) Internet
2 20 (1.71%) Firewall
3 13 (1.11%) TCP/IP
4 12 (1.03%) Kerberos
4 12 (1.03%) SSL
5 10 (0.85%) HTTP
6 9 (0.77%) Broadband
6 9 (0.77%) VPN
7 7 (0.60%) DNS
8 5 (0.43%) HTTPS
9 4 (0.34%) VLAN
10 2 (0.17%) LAN
10 2 (0.17%) SMS
10 2 (0.17%) Software-Defined Networking
10 2 (0.17%) SSH
10 2 (0.17%) WAN
11 1 (0.085%) 4G
11 1 (0.085%) Network Security
11 1 (0.085%) Unified Communications
Database & Business Intelligence
1 767 (65.56%) Big Data
2 374 (31.97%) Apache Hive
3 280 (23.93%) NoSQL
4 204 (17.44%) Data Warehouse
5 152 (12.99%) HBase
6 122 (10.43%) Amazon Redshift
7 109 (9.32%) SQL Server
8 107 (9.15%) MongoDB
9 103 (8.80%) Apache Cassandra
10 102 (8.72%) PostgreSQL
11 91 (7.78%) Impala
12 81 (6.92%) Data Lake
13 78 (6.67%) BigQuery
14 76 (6.50%) MySQL
15 74 (6.32%) Relational Database
16 71 (6.07%) Sqoop
17 62 (5.30%) Data Mining
18 61 (5.21%) Presto
19 60 (5.13%) Flink
19 60 (5.13%) Power BI
Development Applications
1 144 (12.31%) Jenkins
2 122 (10.43%) Git (software)
3 65 (5.56%) Maven
4 47 (4.02%) JIRA
5 33 (2.82%) Artifactory
6 28 (2.39%) Atlassian Bamboo
6 28 (2.39%) Bitbucket
6 28 (2.39%) Selenium
7 21 (1.79%) SonarQube
7 21 (1.79%) Vagrant
8 19 (1.62%) Ant
9 18 (1.54%) TeamCity
10 17 (1.45%) Gradle
11 14 (1.20%) ProC
12 13 (1.11%) ERwin
13 12 (1.03%) ER Studio
13 12 (1.03%) PowerDesigner
14 11 (0.94%) Visual Studio Team System
15 9 (0.77%) Cucumber
15 9 (0.77%) Subversion
General
1 217 (18.55%) Finance
2 201 (17.18%) Banking
3 111 (9.49%) Retail
4 53 (4.53%) Law
5 51 (4.36%) Marketing
6 41 (3.50%) Games
7 33 (2.82%) Advertising
8 28 (2.39%) Investment Banking
9 27 (2.31%) Public Sector
9 27 (2.31%) Telecoms
10 22 (1.88%) Front Office
10 22 (1.88%) Manufacturing
11 15 (1.28%) Automotive
12 7 (0.60%) Financial Institution
12 7 (0.60%) Legal
12 7 (0.60%) Retail Banking
13 4 (0.34%) Billing
13 4 (0.34%) Electronics
13 4 (0.34%) Publishing
14 3 (0.26%) Music Industry
Job Titles
1 363 (31.03%) Data Engineer
2 225 (19.23%) Developer
3 133 (11.37%) Architect
4 103 (8.80%) Java Developer
5 100 (8.55%) Data Scientist
6 95 (8.12%) Data Architect
7 80 (6.84%) Big Data Engineer
8 72 (6.15%) Senior Data Engineer
9 64 (5.47%) Python Engineer
10 58 (4.96%) Hadoop Engineer
11 52 (4.44%) Software Engineer
12 45 (3.85%) DevOps Engineer
13 40 (3.42%) Platform Engineer
14 39 (3.33%) Senior Developer
15 38 (3.25%) Senior Data Scientist
16 37 (3.16%) Big Data Developer
17 35 (2.99%) Cloud Engineer
17 35 (2.99%) Consultant
17 35 (2.99%) Scala Developer
18 34 (2.91%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 263 (22.48%) Kafka
2 79 (6.75%) Web Services
3 74 (6.32%) TensorFlow
4 55 (4.70%) REST
5 53 (4.53%) Pandas
6 47 (4.02%) Spark Streaming
6 47 (4.02%) Spring
7 46 (3.93%) Apache Beam
8 43 (3.68%) HTML
8 43 (3.68%) Natural Language Processing
9 42 (3.59%) NumPy
9 42 (3.59%) scikit-learn
10 38 (3.25%) AngularJS
10 38 (3.25%) React
11 37 (3.16%) Node.js
11 37 (3.16%) Spring Boot
12 35 (2.99%) RESTful
13 30 (2.56%) JSON
14 29 (2.48%) SciPy
15 28 (2.39%) GraphQL
Miscellaneous
1 219 (18.72%) Analytical Skills
2 150 (12.82%) Algorithms
3 76 (6.50%) Data Structures
4 42 (3.59%) Linux Command Line
5 34 (2.91%) Greenfield Project
6 24 (2.05%) User Experience
7 23 (1.97%) Management Information System
8 22 (1.88%) Public Cloud
8 22 (1.88%) Virtual Team
9 18 (1.54%) Mobile App
10 16 (1.37%) Cloud Native
11 15 (1.28%) Data Centre
12 13 (1.11%) Derivative
13 12 (1.03%) Blog
13 12 (1.03%) Digital Media
13 12 (1.03%) Market Risk
13 12 (1.03%) Self-Motivation
13 12 (1.03%) Spread Betting
14 11 (0.94%) Fixed Income
14 11 (0.94%) Social Media
Operating Systems
1 224 (19.15%) Linux
2 135 (11.54%) Unix
3 36 (3.08%) Windows
4 11 (0.94%) CentOS
5 9 (0.77%) Ubuntu
5 9 (0.77%) Windows Server
5 9 (0.77%) zOS
6 6 (0.51%) Debian
6 6 (0.51%) Red Hat Enterprise Linux
7 1 (0.085%) Android
7 1 (0.085%) Apple iOS
Processes & Methodologies
1 510 (43.59%) Agile Software Development
2 472 (40.34%) Analytics
3 428 (36.58%) Data Science
4 358 (30.60%) Machine Learning
5 249 (21.28%) Business Intelligence
6 236 (20.17%) Data Modelling
6 236 (20.17%) ETL
7 228 (19.49%) DevOps
8 214 (18.29%) Software Engineering
9 195 (16.67%) Data Engineering
10 168 (14.36%) Data Analytics
11 153 (13.08%) Visualisation
12 142 (12.14%) Artificial Intelligence
12 142 (12.14%) Computer Science
13 139 (11.88%) Mathematics
14 124 (10.60%) Data Analysis
14 124 (10.60%) TDD
15 107 (9.15%) Microservices
16 106 (9.06%) Data Integration
16 106 (9.06%) Problem-Solving
Programming Languages
1 751 (64.19%) Python
2 551 (47.09%) SQL
3 519 (44.36%) Java
4 409 (34.96%) Scala
5 195 (16.67%) R
6 108 (9.23%) C
7 102 (8.72%) JavaScript
8 62 (5.30%) PL/SQL
9 60 (5.13%) C#
10 48 (4.10%) C++
11 42 (3.59%) Bash Shell
12 34 (2.91%) TypeScript
13 32 (2.74%) Java 8
14 30 (2.56%) PHP
14 30 (2.56%) Shell Script
15 19 (1.62%) Go
16 16 (1.37%) Ruby
17 14 (1.20%) Kotlin
17 14 (1.20%) PowerShell
18 13 (1.11%) T-SQL
Qualifications
1 206 (17.61%) Degree
2 71 (6.07%) PhD
3 41 (3.50%) Master's Degree
4 39 (3.33%) Computer Science Degree
5 27 (2.31%) Numerate Degree
6 19 (1.62%) Security Cleared
7 10 (0.85%) SC Cleared
8 6 (0.51%) DV Cleared
9 4 (0.34%) AWS Certification
10 3 (0.26%) ISTQB
10 3 (0.26%) ISTQB Foundation Certification
10 3 (0.26%) Microsoft Certification
11 2 (0.17%) MBA
11 2 (0.17%) MCSA
12 1 (0.085%) APMP
12 1 (0.085%) CCA
12 1 (0.085%) ITIL Certification
12 1 (0.085%) SAS Certification
12 1 (0.085%) Six Sigma Black Belt
Quality Assurance & Compliance
1 72 (6.15%) QA
2 69 (5.90%) Data Quality
3 11 (0.94%) ISO/IEC 27001
4 8 (0.68%) GDPR
5 2 (0.17%) GxP
System Software
1 190 (16.24%) Docker
2 135 (11.54%) HDFS
3 39 (3.33%) Apache ZooKeeper
4 25 (2.14%) Apache Flume
5 21 (1.79%) VirtualBox
6 10 (0.85%) Cronacle
7 2 (0.17%) Active Directory
7 2 (0.17%) Varnish
7 2 (0.17%) VMware Infrastructure
8 1 (0.085%) Hyper-V
Systems Management
1 138 (11.79%) Kubernetes
2 110 (9.40%) Terraform
3 106 (9.06%) Ansible
4 79 (6.75%) Hadoop YARN
5 66 (5.64%) Oozie
6 40 (3.42%) Puppet
7 37 (3.16%) Opscode Chef
8 24 (2.05%) Docker Swarm
9 17 (1.45%) Consul
10 14 (1.20%) Ambari
11 10 (0.85%) Control-M
12 9 (0.77%) Single Sign-On
13 8 (0.68%) logstash
13 8 (0.68%) Mesos
14 6 (0.51%) Kibana
14 6 (0.51%) Marathon
14 6 (0.51%) Rancher
15 5 (0.43%) HP Quality Center
15 5 (0.43%) Prometheus
16 4 (0.34%) ITRS Geneos
Vendors
1 218 (18.63%) Google
2 151 (12.91%) Cloudera
3 119 (10.17%) Tableau
4 116 (9.91%) Oracle
5 91 (7.78%) Microsoft
6 81 (6.92%) Hortonworks
7 58 (4.96%) Databricks
8 55 (4.70%) Talend
9 49 (4.19%) Teradata
10 44 (3.76%) Informatica
11 41 (3.50%) IBM
11 41 (3.50%) Splunk
12 16 (1.37%) Red Hat
13 14 (1.20%) Netezza
14 13 (1.11%) MapR
15 11 (0.94%) MuleSoft
16 10 (0.85%) Atlassian
17 9 (0.77%) HP
18 8 (0.68%) CA Agile Central
18 8 (0.68%) Facebook