Period
to 19 July 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 19 July 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
19 Jul 2018
Same period 2017 Same period 2016
Rank 128 156 118
Rank change year-on-year +28 -38 +34
Permanent jobs citing Hadoop 266 206 358
As % of all permanent IT jobs advertised in the City of London 2.40% 2.00% 2.63%
As % of the Database & Business Intelligence category 7.59% 6.33% 9.34%
Number of salaries quoted 238 184 320
City of London median annual salary £75,000 £70,000 £64,000
Median salary % change year-on-year +7.14% +9.38% -5.19%
10th Percentile £51,250 £47,875 £42,500
90th Percentile £103,750 £105,000 £105,000
Central London median annual salary £75,000 £70,000 £65,000
% change year-on-year +7.14% +7.69% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,505 3,255 3,835
As % of all permanent IT jobs advertised in the City of London 31.59% 31.63% 28.22%
Number of salaries quoted 3,176 2,922 3,444
City of London median annual salary £65,000 £60,000 £55,000
Median salary % change year-on-year +8.33% +9.09% -
10th Percentile £40,000 £37,500 £36,250
90th Percentile £92,500 £87,500 £82,500
Central London median annual salary £62,500 £60,000 £55,000
% change year-on-year +4.17% +9.09% -

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

The salary distribution of IT jobs citing Hadoop in the City of London over the 6 months to 19 July 2018.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 19 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 5 £80,000 -
Hadoop
Central London

For the 6 months to 19 July 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 174 (65.41%) Big Data
2 167 (62.78%) Apache Spark
3 149 (56.02%) Java
4 125 (46.99%) Python
5 101 (37.97%) Scala
6 90 (33.83%) SQL
7 89 (33.46%) Analytics
8 87 (32.71%) Kafka
9 83 (31.20%) Amazon AWS
10 77 (28.95%) Machine Learning
11 68 (25.56%) NoSQL
12 66 (24.81%) ETL
12 66 (24.81%) Artificial Intelligence
12 66 (24.81%) Data Science
13 65 (24.44%) Apache Hive
14 62 (23.31%) Finance
15 60 (22.56%) Agile Software Development
16 49 (18.42%) R
17 46 (17.29%) Linux
18 43 (16.17%) Docker
19 42 (15.79%) Analytical Skills
20 40 (15.04%) Data Warehouse
21 39 (14.66%) SQL Server
22 37 (13.91%) DevOps
22 37 (13.91%) Microsoft Azure
23 35 (13.16%) Apache Cassandra
23 35 (13.16%) Oracle
24 32 (12.03%) Elasticsearch
24 32 (12.03%) Algorithms
24 32 (12.03%) Visualisation

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 167 (62.78%) Apache Spark
2 32 (12.03%) Elasticsearch
3 28 (10.53%) Apache
4 10 (3.76%) Apache Pig
5 9 (3.38%) SAS
6 7 (2.63%) nginx
7 5 (1.88%) Apache Solr
7 5 (1.88%) Oracle Workflow
8 2 (0.75%) Confluence
8 2 (0.75%) GemFire
8 2 (0.75%) SharePoint
8 2 (0.75%) Tomcat
9 1 (0.38%) IIS
9 1 (0.38%) SharePoint Server
Applications
1 4 (1.50%) Microsoft Excel
2 1 (0.38%) GNU Octave
2 1 (0.38%) Microsoft Office
2 1 (0.38%) Microsoft PowerPoint
2 1 (0.38%) MS Visio
Cloud Services
1 83 (31.20%) Amazon AWS
2 37 (13.91%) Microsoft Azure
3 13 (4.89%) Amazon EMR
4 11 (4.14%) Google Cloud Platform
5 10 (3.76%) Amazon Kinesis
6 6 (2.26%) GitHub
6 6 (2.26%) Google Analytics
7 5 (1.88%) Adobe Analytics
7 5 (1.88%) Amazon EC2
7 5 (1.88%) OpenShift
7 5 (1.88%) SaaS
8 4 (1.50%) Datadog
9 3 (1.13%) Cloud Computing
10 2 (0.75%) Azure Data Factory
10 2 (0.75%) IaaS
10 2 (0.75%) PaaS
11 1 (0.38%) AWS Data Pipeline
11 1 (0.38%) Azure Machine Learning
11 1 (0.38%) CloudBees
Communications & Networking
1 6 (2.26%) Firewall
2 4 (1.50%) DNS
2 4 (1.50%) HTTP
2 4 (1.50%) SMTP
2 4 (1.50%) TCP/IP
2 4 (1.50%) VPN
3 2 (0.75%) Internet
4 1 (0.38%) Broadband
4 1 (0.38%) Kerberos
Database & Business Intelligence
1 174 (65.41%) Big Data
2 68 (25.56%) NoSQL
3 65 (24.44%) Apache Hive
4 40 (15.04%) Data Warehouse
5 39 (14.66%) SQL Server
6 35 (13.16%) Apache Cassandra
7 30 (11.28%) HBase
8 27 (10.15%) Relational Database
9 26 (9.77%) MongoDB
9 26 (9.77%) SQL Server Integration Services
9 26 (9.77%) SQL Server Reporting Services
10 25 (9.40%) Data Lake
10 25 (9.40%) MySQL
11 20 (7.52%) Power BI
12 14 (5.26%) Sqoop
13 13 (4.89%) SQL Server Analysis Services
14 12 (4.51%) Data Mining
15 11 (4.14%) MS Access
15 11 (4.14%) RDBMS
16 10 (3.76%) QlikView
Development Applications
1 25 (9.40%) Jenkins
2 13 (4.89%) Git (software)
3 11 (4.14%) SQL Server Management Studio (SSMS)
4 8 (3.01%) TeamCity
5 7 (2.63%) Maven
6 6 (2.26%) RStudio
6 6 (2.26%) Travis CI
6 6 (2.26%) webpack
7 5 (1.88%) Artifactory
7 5 (1.88%) Sonatype Nexus
8 4 (1.50%) Atlassian Bamboo
8 4 (1.50%) GoCD
8 4 (1.50%) Visual Studio
9 3 (1.13%) gulp
9 3 (1.13%) Jasmine
9 3 (1.13%) JIRA
9 3 (1.13%) Mocha
10 2 (0.75%) ERwin
10 2 (0.75%) GitLab
10 2 (0.75%) Subversion
General
1 62 (23.31%) Finance
2 18 (6.77%) Banking
3 16 (6.02%) Marketing
4 12 (4.51%) Games
5 10 (3.76%) Front Office
6 9 (3.38%) Pharmaceutical
7 8 (3.01%) Retail
8 5 (1.88%) Financial Institution
8 5 (1.88%) Investment Banking
9 4 (1.50%) Publishing
10 3 (1.13%) Retail Banking
11 2 (0.75%) Law
11 2 (0.75%) Telecoms
12 1 (0.38%) Advertising
12 1 (0.38%) French Language
12 1 (0.38%) Mandarin Language
Job Titles
1 97 (36.47%) Developer
2 65 (24.44%) Data Engineer
3 48 (18.05%) Big Data Engineer
3 48 (18.05%) Java Developer
4 34 (12.78%) Big Data Developer
5 25 (9.40%) Architect
6 24 (9.02%) Data Scientist
7 20 (7.52%) Data Architect
8 17 (6.39%) Big Data Architect
8 17 (6.39%) Hadoop Developer
8 17 (6.39%) Scala Developer
9 13 (4.89%) Administrator
9 13 (4.89%) Hadoop Engineer
9 13 (4.89%) SQL Developer
10 11 (4.14%) Apache Spark Developer
10 11 (4.14%) Java Engineer
10 11 (4.14%) Java Scala Developer
10 11 (4.14%) Senior Developer
11 10 (3.76%) Java Hadoop Developer
11 10 (3.76%) SQL Server Developer
Libraries, Frameworks & Software Standards
1 87 (32.71%) Kafka
2 23 (8.65%) Akka
3 19 (7.14%) REST
3 19 (7.14%) Web Services
4 16 (6.02%) .NET
5 13 (4.89%) Node.js
6 11 (4.14%) Elastic Stack
6 11 (4.14%) RabbitMQ
7 9 (3.38%) Spark Streaming
8 8 (3.01%) Redux
8 8 (3.01%) Spring
9 7 (2.63%) Hibernate
9 7 (2.63%) React
10 6 (2.26%) RESTful
10 6 (2.26%) Sass
10 6 (2.26%) Twitter Bootstrap
11 5 (1.88%) .NET Framework
11 5 (1.88%) AngularJS
11 5 (1.88%) D3.js
11 5 (1.88%) LDAP
Miscellaneous
1 42 (15.79%) Analytical Skills
2 32 (12.03%) Algorithms
3 28 (10.53%) Greenfield Project
4 23 (8.65%) Computer Science
4 23 (8.65%) Fintech
5 21 (7.89%) Data Structures
6 14 (5.26%) Self-Motivation
7 8 (3.01%) Public Cloud
7 8 (3.01%) User Experience
8 7 (2.63%) Equities
8 7 (2.63%) Management Information System
9 6 (2.26%) Foreign Exchange (FX)
9 6 (2.26%) Virtual Team
10 5 (1.88%) Derivative
10 5 (1.88%) Tandem
11 4 (1.50%) Blog
12 3 (1.13%) FMCG
12 3 (1.13%) Life Science
12 3 (1.13%) Market Risk
12 3 (1.13%) Mobile App
Operating Systems
1 46 (17.29%) Linux
2 19 (7.14%) Unix
3 2 (0.75%) Windows
4 1 (0.38%) CentOS
4 1 (0.38%) DC/OS
4 1 (0.38%) Debian
4 1 (0.38%) Windows Server
Processes & Methodologies
1 89 (33.46%) Analytics
2 77 (28.95%) Machine Learning
3 66 (24.81%) Artificial Intelligence
3 66 (24.81%) Data Science
3 66 (24.81%) ETL
4 60 (22.56%) Agile Software Development
5 37 (13.91%) DevOps
6 32 (12.03%) Visualisation
7 31 (11.65%) Open Source
8 30 (11.28%) Software Engineering
9 29 (10.90%) Business Intelligence
10 28 (10.53%) Data Integration
11 27 (10.15%) Microservices
12 25 (9.40%) Data Engineering
13 24 (9.02%) Data Management
14 23 (8.65%) Problem-Solving
15 21 (7.89%) Data Visualisation
16 20 (7.52%) TDD
17 19 (7.14%) Data Analytics
17 19 (7.14%) Test Automation
Programming Languages
1 149 (56.02%) Java
2 125 (46.99%) Python
3 101 (37.97%) Scala
4 90 (33.83%) SQL
5 49 (18.42%) R
6 29 (10.90%) JavaScript
7 23 (8.65%) C#
8 22 (8.27%) Java 8
9 19 (7.14%) T-SQL
10 9 (3.38%) Bash Shell
10 9 (3.38%) MATLAB
10 9 (3.38%) Ruby
11 8 (3.01%) C
11 8 (3.01%) Go
12 7 (2.63%) C++
12 7 (2.63%) Perl
12 7 (2.63%) PHP
12 7 (2.63%) Shell Script
13 6 (2.26%) ES6
14 5 (1.88%) Korn
Qualifications
1 25 (9.40%) Degree
2 8 (3.01%) PhD
3 6 (2.26%) Computer Science Degree
4 4 (1.50%) Master's Degree
4 4 (1.50%) MBA
5 3 (1.13%) Security Cleared
6 2 (0.75%) Numerate Degree
7 1 (0.38%) DV Cleared
Quality Assurance & Compliance
1 10 (3.76%) Data Quality
2 3 (1.13%) GCP
3 2 (0.75%) GDPR
3 2 (0.75%) Solvency II
4 1 (0.38%) EMIR
4 1 (0.38%) MiFID
System Software
1 43 (16.17%) Docker
2 22 (8.27%) Apache Flume
2 22 (8.27%) HDFS
3 6 (2.26%) Virtual Machines
3 6 (2.26%) VMware Infrastructure
4 5 (1.88%) KVM
4 5 (1.88%) Xen
5 4 (1.50%) Apache ZooKeeper
6 3 (1.13%) Oracle RAC
7 2 (0.75%) Active Directory
7 2 (0.75%) Virtual Servers
8 1 (0.38%) vSphere
Systems Management
1 24 (9.02%) Mesos
2 21 (7.89%) Ansible
3 20 (7.52%) Kubernetes
4 19 (7.14%) Puppet
5 15 (5.64%) Opscode Chef
6 11 (4.14%) Hadoop YARN
6 11 (4.14%) Oozie
6 11 (4.14%) Terraform
7 8 (3.01%) Prometheus
8 7 (2.63%) Docker Swarm
9 5 (1.88%) Nagios
9 5 (1.88%) Red Hat Spacewalk
10 4 (1.50%) Consul
10 4 (1.50%) Salt
11 3 (1.13%) Data Guard
11 3 (1.13%) Oracle RMAN
12 2 (0.75%) Kibana
12 2 (0.75%) logstash
12 2 (0.75%) ZABBIX
13 1 (0.38%) Graphite
Vendors
1 35 (13.16%) Oracle
2 28 (10.53%) Tableau
3 26 (9.77%) Hortonworks
4 24 (9.02%) Cloudera
5 23 (8.65%) Google
6 21 (7.89%) MapR
7 14 (5.26%) Informatica
8 12 (4.51%) Microsoft
8 12 (4.51%) VMware
9 7 (2.63%) Alteryx
9 7 (2.63%) Atlassian
9 7 (2.63%) New Relic
9 7 (2.63%) Solace
9 7 (2.63%) Talend
10 5 (1.88%) Adobe
10 5 (1.88%) Sun
11 4 (1.50%) Datameer
11 4 (1.50%) Facebook
11 4 (1.50%) SaltStack
11 4 (1.50%) Splunk