Period
to 21 October 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 October 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
Central London > City of London
6 months to
21 Oct 2018
Same period 2017 Same period 2016
Rank 156 128 137
Rank change year-on-year -28 +9 -16
Permanent jobs citing Hadoop 237 238 263
As % of all permanent IT jobs advertised in the City of London 2.14% 2.39% 2.20%
As % of the Database & Business Intelligence category 7.00% 7.64% 7.51%
Number of salaries quoted 218 212 243
City of London median annual salary £76,250 £70,000 £67,500
Median salary % change year-on-year +8.93% +3.70% -
10th Percentile £47,500 £47,625 £42,300
90th Percentile £102,875 £109,750 £105,000
Central London median annual salary £75,000 £70,000 £67,500
% change year-on-year +7.14% +3.70% -3.57%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,386 3,116 3,504
As % of all permanent IT jobs advertised in the City of London 30.64% 31.34% 29.34%
Number of salaries quoted 3,075 2,842 3,202
City of London median annual salary £65,000 £60,000 £57,500
Median salary % change year-on-year +8.33% +4.35% -
10th Percentile £40,000 £40,000 £36,250
90th Percentile £95,000 £87,500 £85,000
Central London median annual salary £65,000 £60,000 £55,000
% change year-on-year +8.33% +9.09% -

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the City of London.

Salary trend for Hadoop in the City of London

Hadoop
Salary Histogram in the City of London

The salary distribution of IT jobs citing Hadoop in the City of London over the 6 months to 21 October 2018.

Salary histogram for Hadoop in the City of London

Hadoop
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 21 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 4 £80,000 -
Hadoop
Central London

For the 6 months to 21 October 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Hadoop.

1 151 (63.71%) Apache Spark
2 149 (62.87%) Big Data
3 116 (48.95%) Java
4 111 (46.84%) Python
5 83 (35.02%) SQL
5 83 (35.02%) Kafka
6 75 (31.65%) Scala
7 71 (29.96%) Amazon AWS
8 69 (29.11%) Analytics
9 68 (28.69%) Agile Software Development
10 65 (27.43%) Finance
11 63 (26.58%) Apache Hive
12 59 (24.89%) Machine Learning
13 57 (24.05%) ETL
14 54 (22.78%) NoSQL
15 53 (22.36%) Data Science
16 52 (21.94%) Microsoft Azure
17 41 (17.30%) R
17 41 (17.30%) Analytical Skills
18 40 (16.88%) DevOps
18 40 (16.88%) SQL Server
19 39 (16.46%) Data Warehouse
19 39 (16.46%) Artificial Intelligence
20 38 (16.03%) Microservices
21 33 (13.92%) Banking
21 33 (13.92%) Computer Science
21 33 (13.92%) JavaScript
21 33 (13.92%) Linux
22 31 (13.08%) Jenkins
22 31 (13.08%) Docker

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 151 (63.71%) Apache Spark
2 31 (13.08%) Apache
3 22 (9.28%) Elasticsearch
4 13 (5.49%) Apache Pig
5 11 (4.64%) SAS
6 5 (2.11%) Oracle Workflow
7 3 (1.27%) SharePoint
7 3 (1.27%) WebSphere
7 3 (1.27%) WebSphere Application Server
8 2 (0.84%) Confluence
8 2 (0.84%) GemFire
8 2 (0.84%) IIS
8 2 (0.84%) nginx
8 2 (0.84%) Tomcat
9 1 (0.42%) Apache Solr
9 1 (0.42%) MS Exchange
9 1 (0.42%) OpenStack
9 1 (0.42%) SharePoint Server
Applications
1 2 (0.84%) Microsoft Excel
2 1 (0.42%) GNU Octave
2 1 (0.42%) Microsoft Office
2 1 (0.42%) Microsoft PowerPoint
2 1 (0.42%) MS Visio
Cloud Services
1 71 (29.96%) Amazon AWS
2 52 (21.94%) Microsoft Azure
3 19 (8.02%) Google Cloud Platform
4 14 (5.91%) Amazon EMR
5 6 (2.53%) Azure Data Factory
5 6 (2.53%) GitHub
6 5 (2.11%) Amazon Kinesis
6 5 (2.11%) Serverless
7 4 (1.69%) Amazon EC2
7 4 (1.69%) Apigee
7 4 (1.69%) Azure Functions
7 4 (1.69%) Cloud Computing
7 4 (1.69%) Data Lake Analytics
8 3 (1.27%) Amazon CloudWatch
9 2 (0.84%) Amazon S3
9 2 (0.84%) Azure Machine Learning
9 2 (0.84%) Google App Engine
9 2 (0.84%) PaaS
10 1 (0.42%) Amazon SQS
10 1 (0.42%) Office 365
Communications & Networking
1 3 (1.27%) Firewall
2 1 (0.42%) Internet
2 1 (0.42%) Kerberos
2 1 (0.42%) LAN
2 1 (0.42%) NAS
2 1 (0.42%) PABX
2 1 (0.42%) SAN
2 1 (0.42%) VoIP
2 1 (0.42%) VPN
2 1 (0.42%) WAN
Database & Business Intelligence
1 149 (62.87%) Big Data
2 63 (26.58%) Apache Hive
3 54 (22.78%) NoSQL
4 40 (16.88%) SQL Server
5 39 (16.46%) Data Warehouse
6 30 (12.66%) MongoDB
7 29 (12.24%) Apache Cassandra
8 27 (11.39%) SQL Server Integration Services
9 24 (10.13%) Data Lake
10 22 (9.28%) SQL Server Reporting Services
11 18 (7.59%) Relational Database
12 15 (6.33%) HBase
12 15 (6.33%) Sqoop
13 14 (5.91%) MySQL
13 14 (5.91%) Power BI
14 11 (4.64%) BusinessObjects
15 10 (4.22%) Flink
15 10 (4.22%) MS Access
15 10 (4.22%) QlikView
16 8 (3.38%) Amazon Redshift
Development Applications
1 31 (13.08%) Jenkins
2 14 (5.91%) Git (software)
3 13 (5.49%) Maven
4 11 (4.64%) SQL Server Management Studio (SSMS)
5 10 (4.22%) JIRA
6 9 (3.80%) TeamCity
7 6 (2.53%) Octopus Deploy
7 6 (2.53%) RStudio
8 4 (1.69%) SpecFlow
8 4 (1.69%) tSQLt
8 4 (1.69%) Visual Studio
8 4 (1.69%) Visual Studio Team System
9 3 (1.27%) Eclipse
9 3 (1.27%) gulp
9 3 (1.27%) Jasmine
9 3 (1.27%) JUnit
9 3 (1.27%) Mocha
9 3 (1.27%) Mockito
9 3 (1.27%) TestNG
9 3 (1.27%) webpack
General
1 65 (27.43%) Finance
2 33 (13.92%) Banking
3 16 (6.75%) Games
4 13 (5.49%) Marketing
5 11 (4.64%) Retail
6 10 (4.22%) Retail Banking
7 9 (3.80%) Telecoms
8 8 (3.38%) Investment Banking
9 5 (2.11%) Front Office
10 4 (1.69%) Financial Institution
11 3 (1.27%) Advertising
11 3 (1.27%) Publishing
12 2 (0.84%) Automotive
12 2 (0.84%) Billing
12 2 (0.84%) Pharmaceutical
13 1 (0.42%) French Language
13 1 (0.42%) Law
13 1 (0.42%) Mandarin Language
Job Titles
1 90 (37.97%) Developer
2 53 (22.36%) Data Engineer
3 38 (16.03%) Java Developer
4 35 (14.77%) Big Data Engineer
5 32 (13.50%) Architect
5 32 (13.50%) Big Data Developer
6 28 (11.81%) Data Scientist
7 21 (8.86%) Scala Developer
8 19 (8.02%) Data Architect
9 17 (7.17%) Senior Developer
10 15 (6.33%) Hadoop Developer
11 14 (5.91%) Big Data Architect
12 13 (5.49%) Hadoop Engineer
12 13 (5.49%) Java Scala Developer
13 12 (5.06%) AWS Engineer
13 12 (5.06%) Consultant
13 12 (5.06%) Senior Data Scientist
13 12 (5.06%) SQL Developer
14 11 (4.64%) Python Developer
15 10 (4.22%) Data Consultant
Libraries, Frameworks & Software Standards
1 83 (35.02%) Kafka
2 23 (9.70%) REST
3 18 (7.59%) .NET
3 18 (7.59%) Akka
4 17 (7.17%) Node.js
5 15 (6.33%) RabbitMQ
5 15 (6.33%) Web Services
6 14 (5.91%) React
7 13 (5.49%) Redux
8 11 (4.64%) Spring
9 10 (4.22%) AngularJS
10 9 (3.80%) Natural Language Processing
11 8 (3.38%) Pandas
12 7 (2.95%) NumPy
13 6 (2.53%) Apache Avro
13 6 (2.53%) Apache Commons
13 6 (2.53%) JAX-RS
13 6 (2.53%) RESTful
13 6 (2.53%) SciPy
13 6 (2.53%) Spring Boot
Miscellaneous
1 41 (17.30%) Analytical Skills
2 33 (13.92%) Computer Science
3 27 (11.39%) Algorithms
3 27 (11.39%) Greenfield Project
4 22 (9.28%) Data Structures
5 21 (8.86%) Fintech
6 15 (6.33%) Self-Motivation
7 8 (3.38%) Management Information System
7 8 (3.38%) Social Network
8 7 (2.95%) Market Risk
8 7 (2.95%) Spread Betting
9 4 (1.69%) Equities
9 4 (1.69%) FMCG
9 4 (1.69%) Public Cloud
9 4 (1.69%) Virtual Team
10 3 (1.27%) Derivative
10 3 (1.27%) Foreign Exchange (FX)
10 3 (1.27%) Life Science
11 2 (0.84%) Enterprise Software
11 2 (0.84%) Mobile App
Operating Systems
1 33 (13.92%) Linux
2 13 (5.49%) Unix
3 2 (0.84%) Android
4 1 (0.42%) Apple iOS
4 1 (0.42%) CentOS
4 1 (0.42%) Debian
4 1 (0.42%) HPUX
4 1 (0.42%) Solaris
4 1 (0.42%) Windows
4 1 (0.42%) Windows Server
4 1 (0.42%) zOS
Processes & Methodologies
1 69 (29.11%) Analytics
2 68 (28.69%) Agile Software Development
3 59 (24.89%) Machine Learning
4 57 (24.05%) ETL
5 53 (22.36%) Data Science
6 40 (16.88%) DevOps
7 39 (16.46%) Artificial Intelligence
8 38 (16.03%) Microservices
9 27 (11.39%) Data Integration
10 26 (10.97%) Business Intelligence
11 24 (10.13%) Data Modelling
11 24 (10.13%) Software Engineering
11 24 (10.13%) Visualisation
12 22 (9.28%) Data Engineering
12 22 (9.28%) Problem-Solving
13 21 (8.86%) Mathematics
13 21 (8.86%) TDD
14 20 (8.44%) Data Analytics
14 20 (8.44%) Data Management
14 20 (8.44%) Open Source
Programming Languages
1 116 (48.95%) Java
2 111 (46.84%) Python
3 83 (35.02%) SQL
4 75 (31.65%) Scala
5 41 (17.30%) R
6 33 (13.92%) JavaScript
7 24 (10.13%) C#
8 22 (9.28%) T-SQL
9 20 (8.44%) Java 8
10 10 (4.22%) C++
11 9 (3.80%) Bash Shell
12 8 (3.38%) PowerShell
13 7 (2.95%) Shell Script
14 6 (2.53%) Kotlin
14 6 (2.53%) Perl
14 6 (2.53%) Ruby
15 5 (2.11%) C
15 5 (2.11%) Korn
15 5 (2.11%) PHP
16 4 (1.69%) Go
Qualifications
1 28 (11.81%) Degree
2 6 (2.53%) Computer Science Degree
2 6 (2.53%) PhD
3 4 (1.69%) Master's Degree
3 4 (1.69%) Numerate Degree
4 1 (0.42%) MBA
4 1 (0.42%) Postgraduate
4 1 (0.42%) Security Cleared
Quality Assurance & Compliance
1 4 (1.69%) Data Quality
2 2 (0.84%) GDPR
2 2 (0.84%) QA
System Software
1 31 (13.08%) Docker
2 25 (10.55%) HDFS
3 14 (5.91%) Apache Flume
4 7 (2.95%) Apache ZooKeeper
5 3 (1.27%) Oracle RAC
6 2 (0.84%) Active Directory
6 2 (0.84%) KVM
6 2 (0.84%) Virtual Machines
6 2 (0.84%) Virtual Servers
6 2 (0.84%) VMware Infrastructure
6 2 (0.84%) Xen
Systems Management
1 16 (6.75%) Kubernetes
2 13 (5.49%) Oozie
2 13 (5.49%) Puppet
3 12 (5.06%) Prometheus
4 8 (3.38%) Ansible
4 8 (3.38%) Mesos
5 7 (2.95%) Terraform
6 6 (2.53%) Kibana
7 4 (1.69%) Hadoop YARN
7 4 (1.69%) logstash
8 3 (1.27%) Data Guard
8 3 (1.27%) Grafana
8 3 (1.27%) Graphite
8 3 (1.27%) Opscode Chef
8 3 (1.27%) Oracle RMAN
9 2 (0.84%) Docker Swarm
9 2 (0.84%) Nagios
9 2 (0.84%) Red Hat Spacewalk
9 2 (0.84%) ZABBIX
10 1 (0.42%) SELinux
Vendors
1 25 (10.55%) Oracle
2 23 (9.70%) Tableau
3 22 (9.28%) Microsoft
4 16 (6.75%) Google
4 16 (6.75%) Hortonworks
5 14 (5.91%) Informatica
6 13 (5.49%) Cloudera
7 12 (5.06%) MapR
8 9 (3.80%) IBM
9 7 (2.95%) SAP
9 7 (2.95%) Solace
10 5 (2.11%) Sun
10 5 (2.11%) Talend
11 4 (1.69%) Teradata
12 2 (0.84%) AppDynamics
12 2 (0.84%) Databricks
12 2 (0.84%) Datameer
12 2 (0.84%) New Relic
12 2 (0.84%) VMware
13 1 (0.42%) Paxata