Period
to 20 April 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 20 April 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
20 Apr 2018
Same period 2017 Same period 2016
Rank 129 146 96
Rank change year-on-year +17 -50 +107
Permanent jobs citing Hadoop 265 221 421
As % of all permanent IT jobs advertised in the City of London 2.45% 2.12% 3.06%
As % of the Database & Business Intelligence category 7.76% 6.75% 10.51%
Number of salaries quoted 245 204 382
City of London median annual salary £75,000 £73,750 £65,000
Median salary % change year-on-year +1.69% +13.46% -
10th Percentile £52,500 £48,750 £45,000
90th Percentile £110,000 £105,000 £110,000
Central London median annual salary £75,000 £75,000 £69,000
% change year-on-year - +8.70% +6.15%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,415 3,272 4,004
As % of all permanent IT jobs advertised in the City of London 31.60% 31.39% 29.06%
Number of salaries quoted 3,030 2,995 3,576
City of London median annual salary £62,500 £60,000 £55,000
Median salary % change year-on-year +4.17% +9.09% -
10th Percentile £41,250 £37,500 £37,000
90th Percentile £90,000 £87,500 £84,375
Central London median annual salary £60,000 £60,000 £55,000
% change year-on-year - +9.09% -

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

The salary distribution of IT jobs citing Hadoop in the City of London over the 6 months to 20 April 2018.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 20 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 1 £70,000 -
Hadoop
Central London

For the 6 months to 20 April 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 178 (67.17%) Big Data
2 165 (62.26%) Apache Spark
3 155 (58.49%) Java
4 114 (43.02%) Scala
5 110 (41.51%) Python
6 90 (33.96%) Analytics
7 87 (32.83%) Machine Learning
8 86 (32.45%) SQL
9 83 (31.32%) Agile Software Development
10 80 (30.19%) Amazon AWS
11 74 (27.92%) Data Science
12 71 (26.79%) Kafka
13 66 (24.91%) NoSQL
14 58 (21.89%) Artificial Intelligence
15 53 (20.00%) Finance
16 52 (19.62%) Apache Hive
17 48 (18.11%) ETL
18 45 (16.98%) Apache Cassandra
19 44 (16.60%) R
19 44 (16.60%) Docker
20 43 (16.23%) HBase
20 43 (16.23%) Elasticsearch
21 41 (15.47%) MongoDB
22 37 (13.96%) Algorithms
23 36 (13.58%) Linux
24 35 (13.21%) Apache
24 35 (13.21%) Mesos
24 35 (13.21%) Open Source
25 33 (12.45%) SQL Server
26 32 (12.08%) Cloudera

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 165 (62.26%) Apache Spark
2 43 (16.23%) Elasticsearch
3 35 (13.21%) Apache
4 15 (5.66%) SAS
5 9 (3.40%) Apache Pig
6 6 (2.26%) BizTalk Server
7 5 (1.89%) Apache Solr
7 5 (1.89%) nginx
8 3 (1.13%) JBoss
9 2 (0.75%) Apache Airflow
9 2 (0.75%) Tomcat
10 1 (0.38%) Cloud Foundry
10 1 (0.38%) Jupyter
10 1 (0.38%) WebLogic
Applications
1 8 (3.02%) SPSS
2 2 (0.75%) Microsoft Excel
Cloud Services
1 80 (30.19%) Amazon AWS
2 26 (9.81%) Microsoft Azure
3 12 (4.53%) Amazon EMR
4 7 (2.64%) GitHub
5 6 (2.26%) Amazon EC2
5 6 (2.26%) Cloud Computing
5 6 (2.26%) SaaS
6 5 (1.89%) Adobe Analytics
6 5 (1.89%) Amazon Kinesis
6 5 (1.89%) Google Analytics
6 5 (1.89%) OpenShift
7 4 (1.51%) Datadog
8 3 (1.13%) Azure Data Factory
8 3 (1.13%) Google Cloud Platform
9 2 (0.75%) Cortana Intelligence Suite
10 1 (0.38%) Azure Machine Learning
10 1 (0.38%) Boomi
10 1 (0.38%) IaaS
10 1 (0.38%) Office 365
Communications & Networking
1 4 (1.51%) DNS
1 4 (1.51%) Firewall
1 4 (1.51%) HTTP
1 4 (1.51%) SMTP
1 4 (1.51%) TCP/IP
1 4 (1.51%) VPN
2 3 (1.13%) Internet
3 2 (0.75%) Kerberos
4 1 (0.38%) Broadband
4 1 (0.38%) LAN
4 1 (0.38%) Software-Defined Networking
4 1 (0.38%) WAN
Database & Business Intelligence
1 178 (67.17%) Big Data
2 66 (24.91%) NoSQL
3 52 (19.62%) Apache Hive
4 45 (16.98%) Apache Cassandra
5 43 (16.23%) HBase
6 41 (15.47%) MongoDB
7 33 (12.45%) SQL Server
8 26 (9.81%) Data Lake
9 25 (9.43%) Data Warehouse
10 18 (6.79%) Relational Database
11 17 (6.42%) Data Mining
11 17 (6.42%) Power BI
11 17 (6.42%) SQL Server Reporting Services
12 15 (5.66%) Amazon Redshift
12 15 (5.66%) SQL Server Analysis Services
12 15 (5.66%) SQL Server Integration Services
13 13 (4.91%) MySQL
14 12 (4.53%) PostgreSQL
15 11 (4.15%) Neo4j
16 9 (3.40%) Impala
Development Applications
1 19 (7.17%) Jenkins
2 13 (4.91%) Git (software)
3 10 (3.77%) SQL Server Management Studio (SSMS)
4 9 (3.40%) RStudio
4 9 (3.40%) TeamCity
5 8 (3.02%) Subversion
6 6 (2.26%) Travis CI
7 5 (1.89%) Maven
7 5 (1.89%) Sonatype Nexus
8 4 (1.51%) Artifactory
8 4 (1.51%) Atlassian Bamboo
8 4 (1.51%) GoCD
8 4 (1.51%) Octopus Deploy
9 3 (1.13%) Jasmine
9 3 (1.13%) JIRA
9 3 (1.13%) Mocha
9 3 (1.13%) webpack
10 2 (0.75%) JUnit
10 2 (0.75%) Selenium
10 2 (0.75%) Visual Studio Team System
General
1 53 (20.00%) Finance
2 16 (6.04%) Banking
3 13 (4.91%) Front Office
4 10 (3.77%) Marketing
4 10 (3.77%) Retail
5 9 (3.40%) Publishing
6 8 (3.02%) Pharmaceutical
7 5 (1.89%) Investment Banking
8 3 (1.13%) Financial Institution
8 3 (1.13%) Games
8 3 (1.13%) Retail Banking
9 2 (0.75%) Advertising
9 2 (0.75%) Law
10 1 (0.38%) Automotive
10 1 (0.38%) Mandarin Language
Job Titles
1 88 (33.21%) Developer
2 55 (20.75%) Data Engineer
3 46 (17.36%) Java Developer
4 39 (14.72%) Big Data Engineer
5 31 (11.70%) Architect
6 29 (10.94%) Big Data Developer
6 29 (10.94%) Scala Developer
7 21 (7.92%) Data Scientist
8 17 (6.42%) Java Engineer
9 16 (6.04%) Java Scala Developer
10 15 (5.66%) Hadoop Developer
11 14 (5.28%) Analyst
12 13 (4.91%) Apache Spark Developer
12 13 (4.91%) Data Architect
12 13 (4.91%) Enterprise Architect
13 12 (4.53%) Senior Developer
14 11 (4.15%) Artificial Intelligence Developer
14 11 (4.15%) Big Data Architect
14 11 (4.15%) Java Hadoop Developer
15 10 (3.77%) Artificial Intelligence Engineer
Libraries, Frameworks & Software Standards
1 71 (26.79%) Kafka
2 19 (7.17%) Akka
3 15 (5.66%) Elastic Stack
3 15 (5.66%) Web Services
4 12 (4.53%) RabbitMQ
5 10 (3.77%) React
5 10 (3.77%) Spring
6 8 (3.02%) GraphX
6 8 (3.02%) Samza
7 7 (2.64%) .NET
7 7 (2.64%) AngularJS
7 7 (2.64%) Node.js
8 6 (2.26%) Hibernate
8 6 (2.26%) Spark Streaming
9 5 (1.89%) Apache Thrift
9 5 (1.89%) ASP.NET MVC
9 5 (1.89%) ASP.NET Web API
9 5 (1.89%) Natural Language Processing
9 5 (1.89%) PostGIS
9 5 (1.89%) Protocol Buffers
Miscellaneous
1 37 (13.96%) Algorithms
2 26 (9.81%) Analytical Skills
3 20 (7.55%) Fintech
4 19 (7.17%) Greenfield Project
5 16 (6.04%) Computer Science
6 11 (4.15%) Data Structures
7 8 (3.02%) User Experience
8 7 (2.64%) Enterprise Software
9 6 (2.26%) Derivative
9 6 (2.26%) Self-Motivation
10 5 (1.89%) Life Science
10 5 (1.89%) Tandem
11 4 (1.51%) Mobile App
11 4 (1.51%) Public Cloud
12 3 (1.13%) Blog
12 3 (1.13%) Equities
12 3 (1.13%) Foreign Exchange (FX)
12 3 (1.13%) Virtual Team
13 2 (0.75%) Market Risk
13 2 (0.75%) Semantic Web
Operating Systems
1 36 (13.58%) Linux
2 9 (3.40%) Unix
3 3 (1.13%) Windows
4 2 (0.75%) DC/OS
4 2 (0.75%) Red Hat Enterprise Linux
4 2 (0.75%) Windows Server
Processes & Methodologies
1 90 (33.96%) Analytics
2 87 (32.83%) Machine Learning
3 83 (31.32%) Agile Software Development
4 74 (27.92%) Data Science
5 58 (21.89%) Artificial Intelligence
6 48 (18.11%) ETL
7 35 (13.21%) Open Source
8 32 (12.08%) DevOps
9 30 (11.32%) Software Engineering
10 29 (10.94%) E-Commerce
10 29 (10.94%) TDD
10 29 (10.94%) Visualisation
11 26 (9.81%) Business Intelligence
12 24 (9.06%) MapReduce
13 18 (6.79%) Data Visualisation
13 18 (6.79%) Scrum
13 18 (6.79%) Statistics
14 17 (6.42%) Data Analytics
14 17 (6.42%) Data Engineering
15 16 (6.04%) Deep Learning
Programming Languages
1 155 (58.49%) Java
2 114 (43.02%) Scala
3 110 (41.51%) Python
4 86 (32.45%) SQL
5 44 (16.60%) R
6 30 (11.32%) Java 8
7 19 (7.17%) C#
8 16 (6.04%) JavaScript
9 14 (5.28%) MATLAB
10 13 (4.91%) C++
10 13 (4.91%) T-SQL
11 11 (4.15%) Ruby
12 8 (3.02%) C
13 6 (2.26%) F#
13 6 (2.26%) Go
14 5 (1.89%) Bash Shell
14 5 (1.89%) CoffeeScript
14 5 (1.89%) Kotlin
14 5 (1.89%) Perl
14 5 (1.89%) PHP
Qualifications
1 17 (6.42%) Degree
2 7 (2.64%) PhD
3 6 (2.26%) Computer Science Degree
4 5 (1.89%) Security Cleared
5 3 (1.13%) ISEB
5 3 (1.13%) Master's Degree
5 3 (1.13%) MBA
6 2 (0.75%) DV Cleared
6 2 (0.75%) TOGAF Certification
7 1 (0.38%) Microsoft Certification
7 1 (0.38%) Postgraduate
Quality Assurance & Compliance
1 15 (5.66%) Data Quality
2 7 (2.64%) Solvency II
3 4 (1.51%) QA
4 3 (1.13%) GDPR
4 3 (1.13%) Sarbanes-Oxley
5 2 (0.75%) EMIR
5 2 (0.75%) MiFID
6 1 (0.38%) Dodd-Frank
6 1 (0.38%) FATCA
6 1 (0.38%) SLA
System Software
1 44 (16.60%) Docker
2 27 (10.19%) HDFS
3 18 (6.79%) Apache Flume
4 6 (2.26%) VMware Infrastructure
5 4 (1.51%) Virtual Machines
6 3 (1.13%) Apache ZooKeeper
6 3 (1.13%) KVM
6 3 (1.13%) Xen
7 1 (0.38%) vSphere
Systems Management
1 35 (13.21%) Mesos
2 22 (8.30%) Kubernetes
3 21 (7.92%) Ansible
4 16 (6.04%) Hadoop YARN
4 16 (6.04%) Opscode Chef
4 16 (6.04%) Puppet
5 13 (4.91%) Terraform
6 6 (2.26%) Docker Swarm
6 6 (2.26%) logstash
7 5 (1.89%) Consul
7 5 (1.89%) Graphite
7 5 (1.89%) Kibana
7 5 (1.89%) Oozie
7 5 (1.89%) Salt
8 4 (1.51%) Prometheus
9 3 (1.13%) Nagios
9 3 (1.13%) Red Hat Spacewalk
10 2 (0.75%) Control-M
10 2 (0.75%) Red Hat Satellite
10 2 (0.75%) Simian Army
Vendors
1 32 (12.08%) Cloudera
2 28 (10.57%) Google
3 26 (9.81%) Tableau
4 22 (8.30%) Hortonworks
5 21 (7.92%) Oracle
6 16 (6.04%) MapR
7 12 (4.53%) VMware
8 10 (3.77%) Microsoft
9 8 (3.02%) Facebook
9 8 (3.02%) Informatica
10 7 (2.64%) New Relic
11 6 (2.26%) Alteryx
11 6 (2.26%) Atlassian
11 6 (2.26%) IBM
12 5 (1.89%) Adobe
13 4 (1.51%) SaltStack
14 3 (1.13%) Cognos
14 3 (1.13%) Splunk
14 3 (1.13%) Talend
15 2 (0.75%) BMC