Period
to 19 January 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 19 January 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
19 Jan 2018
Same period 2017 Same period 2016
Rank 115 139 108
Rank change year-on-year +24 -31 +73
Permanent jobs citing Hadoop 267 234 414
As % of all permanent IT jobs advertised in the City of London 2.55% 2.20% 2.89%
As % of the Database & Business Intelligence category 8.25% 7.10% 9.44%
Number of salaries quoted 251 212 364
City of London median annual salary £75,000 £70,000 £70,000
Median salary % change year-on-year +7.14% - +7.69%
10th Percentile £52,500 £45,275 £47,500
90th Percentile £115,000 £113,750 £110,000
Central London median annual salary £75,000 £70,000 £72,500
% change year-on-year +7.14% -3.45% +11.54%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,236 3,295 4,384
As % of all permanent IT jobs advertised in the City of London 30.87% 31.00% 30.58%
Number of salaries quoted 2,910 3,049 3,872
City of London median annual salary £60,000 £57,500 £57,500
Median salary % change year-on-year +4.35% - +4.55%
10th Percentile £41,250 £36,950 £37,000
90th Percentile £88,750 £87,500 £86,125
Central London median annual salary £60,000 £57,500 £57,500
% change year-on-year +4.35% - +5.50%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

The salary distribution of IT jobs citing Hadoop in the City of London over the 6 months to 19 January 2018.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 19 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 3 £90,000 -
Hadoop
Central London

For the 6 months to 19 January 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the City of London region with a requirement for Hadoop.

1 187 (70.04%) Big Data
2 169 (63.30%) Apache Spark
3 147 (55.06%) Java
4 112 (41.95%) Scala
5 109 (40.82%) Python
6 105 (39.33%) Agile Software Development
7 103 (38.58%) SQL
8 94 (35.21%) Analytics
9 90 (33.71%) Machine Learning
10 77 (28.84%) Finance
11 74 (27.72%) Amazon AWS
12 66 (24.72%) NoSQL
13 52 (19.48%) Kafka
14 51 (19.10%) Apache Hive
15 49 (18.35%) MongoDB
16 44 (16.48%) R
17 42 (15.73%) Apache Cassandra
18 38 (14.23%) Algorithms
19 37 (13.86%) SQL Server
19 37 (13.86%) Apache
19 37 (13.86%) Business Intelligence
20 36 (13.48%) Elasticsearch
21 35 (13.11%) Degree
22 34 (12.73%) TDD
22 34 (12.73%) Docker
23 33 (12.36%) HDFS
23 33 (12.36%) HBase
23 33 (12.36%) Microsoft Azure
24 31 (11.61%) Banking
24 31 (11.61%) Statistics

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 169 (63.30%) Apache Spark
2 37 (13.86%) Apache
3 36 (13.48%) Elasticsearch
4 17 (6.37%) SAS
5 14 (5.24%) Apache Pig
6 10 (3.75%) Tomcat
7 7 (2.62%) WebLogic
8 6 (2.25%) Apache Solr
8 6 (2.25%) BizTalk Server
8 6 (2.25%) JBoss
9 5 (1.87%) OpenStack
10 3 (1.12%) Jetty
10 3 (1.12%) WebSphere
10 3 (1.12%) WebSphere Application Server
11 2 (0.75%) Apache Airflow
12 1 (0.37%) Cloud Foundry
12 1 (0.37%) Jupyter
Applications
1 12 (4.49%) SPSS
2 1 (0.37%) Microsoft Excel
Business Applications
1 1 (0.37%) Adobe Campaign
1 1 (0.37%) Dynamics CRM
1 1 (0.37%) FastStats PeopleStage
1 1 (0.37%) Unica
Cloud Services
1 74 (27.72%) Amazon AWS
2 33 (12.36%) Microsoft Azure
3 10 (3.75%) Cloud Computing
4 7 (2.62%) Google Cloud Platform
5 6 (2.25%) Amazon EMR
6 4 (1.50%) OpenShift
7 3 (1.12%) BlueKai
7 3 (1.12%) GitHub
7 3 (1.12%) SaaS
8 2 (0.75%) Amazon EC2
8 2 (0.75%) Amazon Kinesis
8 2 (0.75%) Amazon S3
8 2 (0.75%) Azure Data Factory
8 2 (0.75%) Cortana Intelligence Suite
9 1 (0.37%) Azure Machine Learning
9 1 (0.37%) Boomi
9 1 (0.37%) IaaS
9 1 (0.37%) Office 365
9 1 (0.37%) PaaS
Communications & Networking
1 5 (1.87%) Internet
2 2 (0.75%) Broadband
2 2 (0.75%) HTTP
2 2 (0.75%) Kerberos
3 1 (0.37%) LAN
3 1 (0.37%) Network Security
3 1 (0.37%) Software-Defined Networking
3 1 (0.37%) WAN
Database & Business Intelligence
1 187 (70.04%) Big Data
2 66 (24.72%) NoSQL
3 51 (19.10%) Apache Hive
4 49 (18.35%) MongoDB
5 42 (15.73%) Apache Cassandra
6 37 (13.86%) SQL Server
7 33 (12.36%) HBase
8 22 (8.24%) PostgreSQL
9 20 (7.49%) Data Lake
10 19 (7.12%) Amazon Redshift
11 18 (6.74%) Data Mining
12 12 (4.49%) Data Warehouse
12 12 (4.49%) MySQL
12 12 (4.49%) SQL Server Integration Services
13 11 (4.12%) Relational Database
14 10 (3.75%) QlikView
15 9 (3.37%) Power BI
15 9 (3.37%) SQL Server Reporting Services
16 8 (3.00%) Amazon DynamoDB
16 8 (3.00%) Neo4j
Development Applications
1 15 (5.62%) Jenkins
2 10 (3.75%) Git (software)
2 10 (3.75%) RStudio
2 10 (3.75%) SQL Server Management Studio (SSMS)
2 10 (3.75%) Subversion
3 7 (2.62%) Maven
4 6 (2.25%) TeamCity
5 5 (1.87%) Visual Studio
6 4 (1.50%) JUnit
6 4 (1.50%) Octopus Deploy
6 4 (1.50%) Travis CI
7 3 (1.12%) JIRA
8 2 (0.75%) Codeship
8 2 (0.75%) Gatling
8 2 (0.75%) Mockito
8 2 (0.75%) Selenium
8 2 (0.75%) Visual Studio Team System
9 1 (0.37%) gulp
9 1 (0.37%) Karma Test Runner
9 1 (0.37%) Visual Studio Code
General
1 77 (28.84%) Finance
2 31 (11.61%) Banking
3 17 (6.37%) Investment Banking
4 15 (5.62%) Marketing
4 15 (5.62%) Retail
5 14 (5.24%) Front Office
6 8 (3.00%) Publishing
7 6 (2.25%) Games
8 5 (1.87%) Financial Institution
9 2 (0.75%) Advertising
10 1 (0.37%) Automotive
10 1 (0.37%) Law
10 1 (0.37%) Mandarin Language
Job Titles
1 95 (35.58%) Developer
2 50 (18.73%) Java Developer
3 37 (13.86%) Data Scientist
4 36 (13.48%) Architect
4 36 (13.48%) Scala Developer
5 33 (12.36%) Data Engineer
6 28 (10.49%) Big Data Developer
6 28 (10.49%) Big Data Engineer
7 21 (7.87%) Java Scala Developer
8 15 (5.62%) Apache Spark Developer
9 14 (5.24%) Senior Architect
10 13 (4.87%) Analyst
10 13 (4.87%) Enterprise Architect
10 13 (4.87%) Hadoop Developer
10 13 (4.87%) Java Hadoop Developer
11 12 (4.49%) Data Manager
11 12 (4.49%) Senior Developer
12 11 (4.12%) Cloud Architect
12 11 (4.12%) Data Architect
13 10 (3.75%) Solutions Architect
Libraries, Frameworks & Software Standards
1 52 (19.48%) Kafka
2 26 (9.74%) Akka
3 23 (8.61%) AngularJS
4 18 (6.74%) Node.js
5 16 (5.99%) React
6 14 (5.24%) .NET
7 13 (4.87%) GraphX
7 13 (4.87%) Web Services
8 12 (4.49%) RabbitMQ
9 9 (3.37%) Spring
10 8 (3.00%) Natural Language Processing
10 8 (3.00%) NumPy
10 8 (3.00%) Pandas
10 8 (3.00%) RESTful
11 7 (2.62%) Elastic Stack
11 7 (2.62%) scikit-learn
11 7 (2.62%) TensorFlow
11 7 (2.62%) Twitter Bootstrap
12 6 (2.25%) MLlib
12 6 (2.25%) Samza
Miscellaneous
1 38 (14.23%) Algorithms
2 26 (9.74%) Computer Science
3 20 (7.49%) Greenfield Project
4 17 (6.37%) Analytical Skills
4 17 (6.37%) Fintech
5 12 (4.49%) Enterprise Software
6 6 (2.25%) Data Structures
6 6 (2.25%) Derivative
6 6 (2.25%) Equities
7 4 (1.50%) Life Science
7 4 (1.50%) User Experience
8 3 (1.12%) Data Centre
9 2 (0.75%) Cloud Native
9 2 (0.75%) Clustering
9 2 (0.75%) Equity Derivative
9 2 (0.75%) Linux Command Line
9 2 (0.75%) OTC Derivatives
9 2 (0.75%) Robotics
9 2 (0.75%) Social Media
9 2 (0.75%) Taxonomies
Operating Systems
1 20 (7.49%) Linux
2 3 (1.12%) Windows
3 2 (0.75%) AIX
3 2 (0.75%) Mac OS X
3 2 (0.75%) Red Hat Enterprise Linux
3 2 (0.75%) Unix
4 1 (0.37%) DC/OS
4 1 (0.37%) Windows Server
Processes & Methodologies
1 105 (39.33%) Agile Software Development
2 94 (35.21%) Analytics
3 90 (33.71%) Machine Learning
4 37 (13.86%) Business Intelligence
5 34 (12.73%) TDD
6 31 (11.61%) ETL
6 31 (11.61%) Statistics
7 30 (11.24%) Data Modelling
7 30 (11.24%) Software Engineering
8 26 (9.74%) Open Source
9 25 (9.36%) DevOps
9 25 (9.36%) E-Commerce
10 23 (8.61%) Data Analytics
10 23 (8.61%) Data Architecture
10 23 (8.61%) MapReduce
10 23 (8.61%) Visualisation
11 22 (8.24%) Scrum
12 20 (7.49%) Migration
12 20 (7.49%) Stakeholder Management
13 19 (7.12%) Mathematics
Programming Languages
1 147 (55.06%) Java
2 112 (41.95%) Scala
3 109 (40.82%) Python
4 103 (38.58%) SQL
5 44 (16.48%) R
6 30 (11.24%) C#
7 29 (10.86%) C++
7 29 (10.86%) JavaScript
8 14 (5.24%) C
8 14 (5.24%) MATLAB
9 13 (4.87%) T-SQL
10 12 (4.49%) Bash Shell
11 10 (3.75%) Perl
11 10 (3.75%) PHP
12 7 (2.62%) Go
13 6 (2.25%) PowerShell
14 5 (1.87%) F#
14 5 (1.87%) Fortran
14 5 (1.87%) Ruby
15 4 (1.50%) Groovy
Qualifications
1 35 (13.11%) Degree
2 17 (6.37%) PhD
3 9 (3.37%) Computer Science Degree
3 9 (3.37%) ISEB
4 8 (3.00%) Security Cleared
5 5 (1.87%) Master's Degree
6 4 (1.50%) DV Cleared
6 4 (1.50%) Numerate Degree
7 3 (1.12%) SC Cleared
8 2 (0.75%) AWS Certification
9 1 (0.37%) CISM
9 1 (0.37%) CISSP
9 1 (0.37%) Microsoft Certification
9 1 (0.37%) Postgraduate
Quality Assurance & Compliance
1 15 (5.62%) Data Quality
2 11 (4.12%) Solvency II
3 9 (3.37%) Sarbanes-Oxley
4 7 (2.62%) QA
5 5 (1.87%) SLA
6 4 (1.50%) GDPR
7 1 (0.37%) Dodd-Frank
7 1 (0.37%) EMIR
7 1 (0.37%) FATCA
7 1 (0.37%) ISO/IEC 27001
7 1 (0.37%) MiFID
System Software
1 34 (12.73%) Docker
2 33 (12.36%) HDFS
3 16 (5.99%) Apache Flume
4 3 (1.12%) Apache ZooKeeper
5 2 (0.75%) VMware Infrastructure
6 1 (0.37%) Cygwin
Systems Management
1 18 (6.74%) Mesos
2 14 (5.24%) Puppet
3 13 (4.87%) Ansible
4 12 (4.49%) Hadoop YARN
5 11 (4.12%) Kubernetes
5 11 (4.12%) Opscode Chef
6 8 (3.00%) logstash
7 7 (2.62%) Kibana
8 4 (1.50%) Graphite
8 4 (1.50%) Salt
9 3 (1.12%) Oozie
10 2 (0.75%) Control-M
10 2 (0.75%) Red Hat Satellite
10 2 (0.75%) Simian Army
10 2 (0.75%) Terraform
10 2 (0.75%) ZABBIX
11 1 (0.37%) Consul
11 1 (0.37%) Microsoft Intune
11 1 (0.37%) Nagios
11 1 (0.37%) SCCM
Vendors
1 26 (9.74%) Cloudera
2 22 (8.24%) Oracle
3 21 (7.87%) Tableau
4 19 (7.12%) Google
5 14 (5.24%) Microsoft
6 11 (4.12%) Informatica
7 9 (3.37%) Cognos
7 9 (3.37%) Hortonworks
8 8 (3.00%) Facebook
9 7 (2.62%) IBM
10 6 (2.25%) Autodesk
11 5 (1.87%) MapR
12 3 (1.12%) Adobe
12 3 (1.12%) Adthena
12 3 (1.12%) Capita
12 3 (1.12%) Twitter
13 2 (0.75%) BMC
13 2 (0.75%) Cognizant
13 2 (0.75%) Red Hat
13 2 (0.75%) SAP