Period
to 19 November 2017

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 19 November 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
19 Nov 2017
Same period 2016 Same period 2015
Rank 122 134 111
Rank change year-on-year +12 -23 +78
Permanent jobs citing Hadoop 257 255 460
As % of all permanent IT jobs advertised in the City of London 2.54% 2.19% 2.68%
As % of the Database & Business Intelligence category 8.10% 7.26% 9.01%
Number of salaries quoted 233 234 388
City of London median annual salary £70,000 £67,500 £67,500
Median salary % change year-on-year +3.70% - +3.85%
10th Percentile £50,250 £41,650 £43,750
90th Percentile £112,500 £105,000 £95,750
Central London median annual salary £70,000 £67,500 £70,000
% change year-on-year +3.70% -3.57% +7.69%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3171 3510 5106
As % of all permanent IT jobs advertised in the City of London 31.30% 30.19% 29.70%
Number of salaries quoted 2899 3219 4436
City of London median annual salary £60,000 £57,500 £57,500
Median salary % change year-on-year +4.35% - +4.55%
10th Percentile £41,250 £36,250 £36,250
90th Percentile £87,500 £86,250 £85,000
Central London median annual salary £59,500 £55,000 £56,000
% change year-on-year +8.18% -1.79% +1.82%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

The salary distribution of IT jobs citing Hadoop in the City of London over the 6 months to 19 November 2017.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 19 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 3 £90,000 -
Hadoop
Central London

For the 6 months to 19 November 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the City of London region with a requirement for Hadoop.

1 163 (63.42%) Big Data
2 157 (61.09%) Apache Spark
3 145 (56.42%) Java
4 103 (40.08%) Python
5 96 (37.35%) SQL
6 93 (36.19%) Agile Software Development
7 92 (35.80%) Scala
8 87 (33.85%) Analytics
9 76 (29.57%) Finance
10 75 (29.18%) Machine Learning
11 73 (28.40%) NoSQL
12 61 (23.74%) Amazon AWS
13 52 (20.23%) SQL Server
14 48 (18.68%) Degree
15 47 (18.29%) Apache Hive
16 44 (17.12%) MongoDB
16 44 (17.12%) Apache Cassandra
17 42 (16.34%) R
17 42 (16.34%) Banking
18 41 (15.95%) Elasticsearch
19 39 (15.18%) Kafka
20 37 (14.40%) HDFS
21 34 (13.23%) Business Intelligence
22 33 (12.84%) Statistics
23 32 (12.45%) Algorithms
23 32 (12.45%) Microsoft Azure
24 31 (12.06%) MapReduce
24 31 (12.06%) JavaScript
25 30 (11.67%) ETL
25 30 (11.67%) AngularJS

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 157 (61.09%) Apache Spark
2 41 (15.95%) Elasticsearch
3 29 (11.28%) Apache
4 17 (6.61%) Apache Pig
5 15 (5.84%) Tomcat
6 14 (5.45%) SAS
7 13 (5.06%) Apache Solr
7 13 (5.06%) WebLogic
8 11 (4.28%) OpenStack
9 9 (3.50%) JBoss
9 9 (3.50%) Jetty
9 9 (3.50%) WebSphere
9 9 (3.50%) WebSphere Application Server
10 6 (2.33%) GemFire
11 2 (0.78%) BizTalk Server
12 1 (0.39%) Jupyter
Applications
1 8 (3.11%) SPSS
2 1 (0.39%) Microsoft Excel
Business Applications
1 1 (0.39%) Adobe Campaign
1 1 (0.39%) Dynamics CRM
1 1 (0.39%) FastStats PeopleStage
1 1 (0.39%) Unica
Cloud Services
1 61 (23.74%) Amazon AWS
2 32 (12.45%) Microsoft Azure
3 9 (3.50%) Google Cloud Platform
4 8 (3.11%) Cloud Computing
5 7 (2.72%) SaaS
6 5 (1.95%) Amazon EMR
6 5 (1.95%) OpenShift
7 3 (1.17%) Amazon Kinesis
7 3 (1.17%) Azure Machine Learning
7 3 (1.17%) BlueKai
8 2 (0.78%) Amazon EC2
8 2 (0.78%) Amazon S3
9 1 (0.39%) Boomi
9 1 (0.39%) IaaS
9 1 (0.39%) PaaS
Communications & Networking
1 4 (1.56%) Internet
2 2 (0.78%) Broadband
2 2 (0.78%) HTTP
3 1 (0.39%) Kerberos
3 1 (0.39%) LDAP
3 1 (0.39%) Network Security
3 1 (0.39%) SMS
3 1 (0.39%) SSL
Database & Business Intelligence
1 163 (63.42%) Big Data
2 73 (28.40%) NoSQL
3 52 (20.23%) SQL Server
4 47 (18.29%) Apache Hive
5 44 (17.12%) Apache Cassandra
5 44 (17.12%) MongoDB
6 26 (10.12%) MySQL
7 24 (9.34%) HBase
7 24 (9.34%) PostgreSQL
8 20 (7.78%) Redis
8 20 (7.78%) Relational Database
9 18 (7.00%) Amazon Redshift
9 18 (7.00%) SQL Server Integration Services
10 15 (5.84%) Data Mining
11 12 (4.67%) Couchbase
11 12 (4.67%) SQL Server Analysis Services
12 11 (4.28%) Data Lake
12 11 (4.28%) SQL Server Reporting Services
13 10 (3.89%) Sqoop
14 9 (3.50%) Riak
Development Applications
1 15 (5.84%) Subversion
2 14 (5.45%) RStudio
2 14 (5.45%) SQL Server Management Studio (SSMS)
3 12 (4.67%) Jenkins
4 10 (3.89%) Git (software)
4 10 (3.89%) Maven
5 8 (3.11%) JUnit
6 5 (1.95%) Hamcrest
6 5 (1.95%) jMock
6 5 (1.95%) Visual Studio
7 3 (1.17%) TeamCity
7 3 (1.17%) Travis CI
8 2 (0.78%) Codeship
8 2 (0.78%) Mockito
9 1 (0.39%) Cucumber
9 1 (0.39%) Hudson
9 1 (0.39%) JSUnit
9 1 (0.39%) Karma Test Runner
9 1 (0.39%) Mercurial
9 1 (0.39%) Mocha
General
1 76 (29.57%) Finance
2 42 (16.34%) Banking
3 20 (7.78%) Front Office
4 18 (7.00%) Retail
5 17 (6.61%) Investment Banking
5 17 (6.61%) Marketing
6 8 (3.11%) Games
7 5 (1.95%) Financial Institution
8 1 (0.39%) Advertising
8 1 (0.39%) Legal
8 1 (0.39%) Mandarin Language
8 1 (0.39%) Pharmaceutical
8 1 (0.39%) Publishing
8 1 (0.39%) Wholesale Banking
Job Titles
1 106 (41.25%) Developer
2 68 (26.46%) Java Developer
3 42 (16.34%) Data Scientist
4 32 (12.45%) Scala Developer
5 25 (9.73%) Architect
6 24 (9.34%) Java Scala Developer
7 20 (7.78%) Hadoop Developer
8 19 (7.39%) Apache Spark Developer
8 19 (7.39%) Big Data Developer
8 19 (7.39%) Data Engineer
9 18 (7.00%) Java Hadoop Developer
10 17 (6.61%) Data Manager
11 16 (6.23%) Big Data Engineer
12 13 (5.06%) Analyst
13 12 (4.67%) Solutions Architect
14 10 (3.89%) Data Analyst
14 10 (3.89%) Data Architect
14 10 (3.89%) Lead Developer
14 10 (3.89%) Lead Java Developer
14 10 (3.89%) Senior Developer
Libraries, Frameworks & Software Standards
1 39 (15.18%) Kafka
2 30 (11.67%) Akka
2 30 (11.67%) AngularJS
3 20 (7.78%) React
4 18 (7.00%) Node.js
4 18 (7.00%) Spring
5 14 (5.45%) Web Services
6 13 (5.06%) .NET
6 13 (5.06%) RESTful
7 12 (4.67%) Elastic Stack
8 11 (4.28%) RabbitMQ
9 10 (3.89%) GraphX
9 10 (3.89%) REST
10 9 (3.50%) Lucene
11 8 (3.11%) CSS
11 8 (3.11%) Hibernate
11 8 (3.11%) HTML
11 8 (3.11%) JMS
11 8 (3.11%) Natural Language Processing
12 7 (2.72%) Twitter Bootstrap
Miscellaneous
1 32 (12.45%) Algorithms
2 28 (10.89%) Computer Science
3 24 (9.34%) Greenfield Project
4 23 (8.95%) Analytical Skills
5 13 (5.06%) Enterprise Software
6 11 (4.28%) Fintech
7 7 (2.72%) Data Structures
7 7 (2.72%) Market Risk
8 6 (2.33%) Credit Risk
8 6 (2.33%) Equities
9 5 (1.95%) Derivative
10 4 (1.56%) Data Centre
10 4 (1.56%) User Experience
10 4 (1.56%) Virtual Team
11 3 (1.17%) Fixed Income
11 3 (1.17%) Robotics
12 2 (0.78%) Clustering
12 2 (0.78%) Mobile Games
12 2 (0.78%) Public Cloud
12 2 (0.78%) Taxonomies
Operating Systems
1 29 (11.28%) Linux
2 3 (1.17%) Mac OS X
2 3 (1.17%) Unix
2 3 (1.17%) Windows
3 2 (0.78%) AIX
Processes & Methodologies
1 93 (36.19%) Agile Software Development
2 87 (33.85%) Analytics
3 75 (29.18%) Machine Learning
4 34 (13.23%) Business Intelligence
5 33 (12.84%) Statistics
6 31 (12.06%) MapReduce
7 30 (11.67%) ETL
8 29 (11.28%) TDD
9 28 (10.89%) Data Analytics
10 27 (10.51%) Scrum
11 25 (9.73%) Data Modelling
11 25 (9.73%) Kanban
11 25 (9.73%) Mathematics
11 25 (9.73%) Software Engineering
12 23 (8.95%) Stakeholder Management
13 22 (8.56%) Open Source
14 20 (7.78%) Continuous Integration
14 20 (7.78%) Multithreading
15 17 (6.61%) E-Commerce
15 17 (6.61%) Predictive Analytics
Programming Languages
1 145 (56.42%) Java
2 103 (40.08%) Python
3 96 (37.35%) SQL
4 92 (35.80%) Scala
5 42 (16.34%) R
6 31 (12.06%) JavaScript
7 29 (11.28%) C++
8 28 (10.89%) C#
9 16 (6.23%) PHP
10 15 (5.84%) Bash Shell
10 15 (5.84%) Perl
10 15 (5.84%) T-SQL
11 13 (5.06%) C
12 12 (4.67%) Go
13 10 (3.89%) MATLAB
14 4 (1.56%) Groovy
14 4 (1.56%) PowerShell
15 3 (1.17%) CoffeeScript
15 3 (1.17%) F#
15 3 (1.17%) HiveQL
Qualifications
1 48 (18.68%) Degree
2 23 (8.95%) PhD
3 11 (4.28%) Computer Science Degree
4 9 (3.50%) ISEB
5 7 (2.72%) Security Cleared
6 6 (2.33%) Master's Degree
7 5 (1.95%) DV Cleared
7 5 (1.95%) Numerate Degree
8 3 (1.17%) SC Cleared
9 2 (0.78%) AWS Certification
10 1 (0.39%) CISM
10 1 (0.39%) CISSP
10 1 (0.39%) Postgraduate
Quality Assurance & Compliance
1 14 (5.45%) Data Quality
2 9 (3.50%) Sarbanes-Oxley
2 9 (3.50%) Solvency II
3 5 (1.95%) SLA
4 4 (1.56%) QA
5 3 (1.17%) GDPR
6 1 (0.39%) ISO/IEC 27001
System Software
1 37 (14.40%) HDFS
2 25 (9.73%) Docker
3 16 (6.23%) Apache Flume
4 2 (0.78%) Apache ZooKeeper
5 1 (0.39%) Cygwin
Systems Management
1 15 (5.84%) Ansible
1 15 (5.84%) Opscode Chef
2 14 (5.45%) Puppet
3 12 (4.67%) Kibana
3 12 (4.67%) logstash
4 11 (4.28%) Mesos
5 9 (3.50%) Salt
6 8 (3.11%) Hadoop YARN
7 3 (1.17%) Graphite
7 3 (1.17%) Kubernetes
7 3 (1.17%) Oozie
8 2 (0.78%) ZABBIX
9 1 (0.39%) CSIRT
9 1 (0.39%) Nagios
Vendors
1 28 (10.89%) Oracle
2 14 (5.45%) Cloudera
3 13 (5.06%) Tableau
4 12 (4.67%) Google
5 11 (4.28%) Informatica
6 9 (3.50%) Cognos
7 8 (3.11%) Microsoft
8 6 (2.33%) Autodesk
9 4 (1.56%) Facebook
10 3 (1.17%) Adobe
10 3 (1.17%) Adthena
10 3 (1.17%) IBM
10 3 (1.17%) Twitter
11 2 (0.78%) Birst
11 2 (0.78%) Capita
11 2 (0.78%) Hortonworks
11 2 (0.78%) SAP
11 2 (0.78%) SnapLogic
11 2 (0.78%) Splunk
11 2 (0.78%) Vertica