Period
to 18 November 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 18 November 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
18 Nov 2017
Same period 2016 Same period 2015
Rank 130 137 124
Rank change year-on-year +7 -13 +80
Permanent jobs citing Hadoop 1988 1810 2353
As % of all permanent IT jobs advertised in London 2.65% 2.38% 2.64%
As % of the Database & Business Intelligence category 9.00% 8.10% 8.60%
Number of salaries quoted 1497 1541 1970
London median annual salary £67,500 £70,000 £67,500
Median salary % change year-on-year -3.57% +3.70% +3.85%
10th Percentile £45,000 £46,250 £43,750
90th Percentile £105,000 £105,000 £97,500
England median annual salary £62,500 £62,500 £65,000
% change year-on-year - -3.85% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22080 22349 27350
As % of all permanent IT jobs advertised in London 29.43% 29.42% 30.64%
Number of salaries quoted 17685 19438 23124
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 18 November 2017.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 18 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -12 308 £70,000 +3.70% 24
West London -2 49 £60,000 - 8
East London +8 23 £63,750 -5.56% 5
South London +9 19 £67,500 - 3
North London +16 15 £100,000 +81.82% 3
Hadoop
England

For the 6 months to 18 November 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Hadoop.

1 1309 (65.85%) Big Data
2 1109 (55.78%) Apache Spark
3 1057 (53.17%) Java
4 945 (47.54%) Python
5 772 (38.83%) Agile Software Development
6 693 (34.86%) Analytics
7 670 (33.70%) SQL
8 607 (30.53%) Finance
9 549 (27.62%) Scala
10 514 (25.86%) NoSQL
11 463 (23.29%) Amazon AWS
12 421 (21.18%) Apache Cassandra
13 405 (20.37%) Machine Learning
14 392 (19.72%) Apache Hive
15 384 (19.32%) Kafka
16 372 (18.71%) Business Intelligence
17 362 (18.21%) Degree
17 362 (18.21%) MongoDB
18 345 (17.35%) Linux
19 340 (17.10%) Relational Database
20 334 (16.80%) Analytical Skills
21 319 (16.05%) Software Engineering
22 313 (15.74%) Open Source
23 305 (15.34%) Banking
24 294 (14.79%) R
25 289 (14.54%) Oracle
25 289 (14.54%) DevOps
26 287 (14.44%) SQL Server
27 275 (13.83%) Microsoft Azure
28 270 (13.58%) Apache

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1109 (55.78%) Apache Spark
2 270 (13.58%) Apache
3 212 (10.66%) Elasticsearch
4 169 (8.50%) SAS
5 116 (5.84%) Apache Pig
6 76 (3.82%) OpenStack
6 76 (3.82%) Tomcat
7 72 (3.62%) Apache Solr
8 34 (1.71%) Confluence
8 34 (1.71%) Jetty
9 33 (1.66%) Apache Airflow
9 33 (1.66%) JBoss
10 31 (1.56%) IIS
10 31 (1.56%) nginx
11 29 (1.46%) WebSphere
12 23 (1.16%) WebLogic
13 21 (1.06%) Cloud Foundry
14 18 (0.91%) CloudStack
15 10 (0.50%) WebSphere Application Server
16 8 (0.40%) GemFire
Applications
1 65 (3.27%) SPSS
2 49 (2.46%) Microsoft Excel
3 11 (0.55%) Microsoft Office
4 5 (0.25%) HipChat
4 5 (0.25%) Spreadsheet
5 4 (0.20%) CPLEX
6 3 (0.15%) Chatbot
7 1 (0.050%) GNU Octave
7 1 (0.050%) LaTeX
7 1 (0.050%) Microsoft PowerPoint
7 1 (0.050%) Stata
7 1 (0.050%) Weka
Business Applications
1 16 (0.80%) SAP InfiniteInsight
2 15 (0.75%) SAP ERP
3 3 (0.15%) Dynamics CRM
4 2 (0.10%) BusinessWorks
4 2 (0.10%) HFM
4 2 (0.10%) Hyperion Enterprise
4 2 (0.10%) Payment Gateway
4 2 (0.10%) SAP HR
5 1 (0.050%) Adobe Campaign
5 1 (0.050%) Capstone
5 1 (0.050%) FastStats PeopleStage
5 1 (0.050%) Oracle AML
5 1 (0.050%) SAP Hybris
5 1 (0.050%) Summit
5 1 (0.050%) Unica
Cloud Services
1 463 (23.29%) Amazon AWS
2 275 (13.83%) Microsoft Azure
3 146 (7.34%) Google Cloud Platform
4 62 (3.12%) Cloud Computing
5 61 (3.07%) GitHub
6 47 (2.36%) SaaS
7 35 (1.76%) IaaS
8 28 (1.41%) Amazon EC2
8 28 (1.41%) Amazon EMR
9 23 (1.16%) Amazon Kinesis
9 23 (1.16%) Amazon S3
9 23 (1.16%) PaaS
10 21 (1.06%) Azure Machine Learning
11 17 (0.86%) AWS CloudFormation
12 13 (0.65%) Google Analytics
13 10 (0.50%) Serverless
14 9 (0.45%) AWS Lambda
15 8 (0.40%) Datadog
15 8 (0.40%) OpenShift
16 6 (0.30%) Adobe Analytics
Communications & Networking
1 40 (2.01%) TCP/IP
2 35 (1.76%) Internet
3 33 (1.66%) Kerberos
4 27 (1.36%) Firewall
5 17 (0.86%) SSL
6 16 (0.80%) SMPP
7 14 (0.70%) HTTP
8 12 (0.60%) DNS
9 11 (0.55%) VLAN
10 9 (0.45%) LDAP
10 9 (0.45%) Network Security
10 9 (0.45%) VPN
11 7 (0.35%) ICMP
12 3 (0.15%) HTTPS
13 2 (0.10%) Broadband
13 2 (0.10%) SNMP
13 2 (0.10%) Wireshark
14 1 (0.050%) Ethernet
14 1 (0.050%) SMS
14 1 (0.050%) SMTP
Database & Business Intelligence
1 1309 (65.85%) Big Data
2 514 (25.86%) NoSQL
3 421 (21.18%) Apache Cassandra
4 392 (19.72%) Apache Hive
5 362 (18.21%) MongoDB
6 340 (17.10%) Relational Database
7 287 (14.44%) SQL Server
8 267 (13.43%) Data Warehouse
9 245 (12.32%) HBase
10 241 (12.12%) RDBMS
11 194 (9.76%) MySQL
12 142 (7.14%) Redis
13 111 (5.58%) SQL Server Integration Services
14 108 (5.43%) PostgreSQL
15 87 (4.38%) SQL Server Reporting Services
16 83 (4.18%) QlikView
17 79 (3.97%) Data Mining
18 73 (3.67%) Amazon Redshift
19 70 (3.52%) Power BI
19 70 (3.52%) Sqoop
Development Applications
1 191 (9.61%) Git (software)
2 190 (9.56%) Jenkins
3 111 (5.58%) JIRA
4 83 (4.18%) Atlassian Bamboo
5 68 (3.42%) Maven
6 66 (3.32%) JUnit
7 46 (2.31%) Bitbucket
8 40 (2.01%) Team Foundation Server
9 31 (1.56%) TeamCity
10 30 (1.51%) Cucumber
11 29 (1.46%) Selenium
12 27 (1.36%) Subversion
12 27 (1.36%) Vagrant
13 23 (1.16%) SQL Server Management Studio (SSMS)
14 22 (1.11%) Mockito
15 21 (1.06%) Hamcrest
15 21 (1.06%) IntelliJ
15 21 (1.06%) jMock
15 21 (1.06%) TestNG
16 20 (1.01%) RStudio
General
1 607 (30.53%) Finance
2 305 (15.34%) Banking
3 183 (9.21%) Investment Banking
4 171 (8.60%) Front Office
5 162 (8.15%) Marketing
6 150 (7.55%) Retail
7 109 (5.48%) Retail Banking
8 94 (4.73%) Telecoms
9 71 (3.57%) Manufacturing
10 68 (3.42%) Electronics
11 54 (2.72%) Games
12 34 (1.71%) Advertising
13 30 (1.51%) Pharmaceutical
14 21 (1.06%) Financial Institution
15 15 (0.75%) Aerospace
15 15 (0.75%) Legal
16 9 (0.45%) Automotive
17 8 (0.40%) Publishing
18 3 (0.15%) Corporate Banking
19 2 (0.10%) Mandarin Language
Job Titles
1 584 (29.38%) Developer
2 274 (13.78%) Java Developer
3 255 (12.83%) Data Engineer
4 209 (10.51%) Data Scientist
5 196 (9.86%) Architect
6 190 (9.56%) Software Engineer
7 170 (8.55%) Big Data Engineer
8 130 (6.54%) Big Data Developer
9 110 (5.53%) Senior Developer
10 108 (5.43%) Data Architect
11 92 (4.63%) Hadoop Engineer
12 77 (3.87%) Data Manager
12 77 (3.87%) Python Developer
13 75 (3.77%) Senior Java Developer
14 74 (3.72%) Analyst
14 74 (3.72%) Scala Developer
14 74 (3.72%) Senior Software Engineer
15 72 (3.62%) Hadoop Developer
16 67 (3.37%) Java Engineer
17 63 (3.17%) Big Data Architect
Libraries, Frameworks & Software Standards
1 384 (19.32%) Kafka
2 172 (8.65%) Spring
3 158 (7.95%) Web Services
4 142 (7.14%) AngularJS
5 129 (6.49%) REST
6 96 (4.83%) .NET
7 95 (4.78%) Node.js
8 87 (4.38%) HTML
9 81 (4.07%) Natural Language Processing
10 75 (3.77%) RESTful
11 74 (3.72%) React
12 73 (3.67%) Hibernate
13 64 (3.22%) RabbitMQ
14 59 (2.97%) Elastic Stack
15 58 (2.92%) CSS
15 58 (2.92%) HTML5
16 55 (2.77%) LAMP
17 51 (2.57%) ActiveMQ
18 49 (2.46%) Akka
19 44 (2.21%) NumPy
Miscellaneous
1 334 (16.80%) Analytical Skills
2 261 (13.13%) Computer Science
3 178 (8.95%) Algorithms
4 109 (5.48%) Greenfield Project
5 56 (2.82%) Data Structures
6 52 (2.62%) Fintech
7 48 (2.41%) Clustering
8 34 (1.71%) Data Centre
9 31 (1.56%) Enterprise Software
10 27 (1.36%) Public Cloud
11 25 (1.26%) Derivative
11 25 (1.26%) Private Cloud
12 24 (1.21%) Market Risk
13 18 (0.91%) Credit Risk
13 18 (0.91%) User Experience
14 17 (0.86%) Virtual Team
15 16 (0.80%) Management Information System
16 15 (0.75%) Equities
16 15 (0.75%) Fixed Income
16 15 (0.75%) Social Network
Operating Systems
1 345 (17.35%) Linux
2 112 (5.63%) Unix
3 85 (4.28%) Windows
4 22 (1.11%) Android
4 22 (1.11%) Apple iOS
5 18 (0.91%) Ubuntu
6 10 (0.50%) Windows Server
7 8 (0.40%) AIX
7 8 (0.40%) Red Hat Enterprise Linux
8 6 (0.30%) Mac OS X
9 4 (0.20%) CentOS
10 3 (0.15%) CoreOS
10 3 (0.15%) Solaris
10 3 (0.15%) VMS
11 1 (0.050%) Mesosphere
11 1 (0.050%) Windows Server 2012
Processes & Methodologies
1 772 (38.83%) Agile Software Development
2 693 (34.86%) Analytics
3 405 (20.37%) Machine Learning
4 372 (18.71%) Business Intelligence
5 319 (16.05%) Software Engineering
6 313 (15.74%) Open Source
7 289 (14.54%) DevOps
8 257 (12.93%) ETL
9 246 (12.37%) Data Analytics
10 231 (11.62%) BDD
11 219 (11.02%) OO
11 219 (11.02%) TDD
12 212 (10.66%) Scrum
13 197 (9.91%) Continuous Integration
14 196 (9.86%) Visualisation
15 182 (9.15%) SDLC
16 174 (8.75%) MapReduce
17 173 (8.70%) Multithreading
18 149 (7.49%) Test Automation
19 148 (7.44%) Microservices
Programming Languages
1 1057 (53.17%) Java
2 945 (47.54%) Python
3 670 (33.70%) SQL
4 549 (27.62%) Scala
5 294 (14.79%) R
6 207 (10.41%) JavaScript
7 194 (9.76%) C#
8 164 (8.25%) C++
9 122 (6.14%) Bash Shell
10 101 (5.08%) C
11 91 (4.58%) Go
12 83 (4.18%) Perl
13 74 (3.72%) PHP
13 74 (3.72%) Ruby
14 52 (2.62%) MATLAB
15 47 (2.36%) T-SQL
16 40 (2.01%) PowerShell
17 39 (1.96%) Shell Script
18 38 (1.91%) VBA
19 26 (1.31%) PL/SQL
Qualifications
1 362 (18.21%) Degree
2 118 (5.94%) Computer Science Degree
3 88 (4.43%) PhD
4 85 (4.28%) Security Cleared
5 52 (2.62%) DV Cleared
6 50 (2.52%) Master's Degree
6 50 (2.52%) SC Cleared
7 23 (1.16%) ISEB
8 20 (1.01%) Numerate Degree
9 15 (0.75%) MBA
9 15 (0.75%) Microsoft Certification
10 11 (0.55%) CISSP
11 8 (0.40%) MCITP
11 8 (0.40%) MCTS
12 7 (0.35%) CEH
12 7 (0.35%) GCIH
12 7 (0.35%) OSCP
12 7 (0.35%) Postgraduate
13 6 (0.30%) AWS Certification
14 4 (0.20%) Cisco Certification
Quality Assurance & Compliance
1 87 (4.38%) Data Quality
2 65 (3.27%) QA
3 25 (1.26%) GCP
4 19 (0.96%) GDPR
5 17 (0.86%) Solvency II
6 16 (0.80%) Sarbanes-Oxley
7 10 (0.50%) ISO/IEC 27001
7 10 (0.50%) SLA
8 8 (0.40%) PCI DSS
9 7 (0.35%) GPG13
10 2 (0.10%) MiFID
11 1 (0.050%) Actionable Recommendations
System Software
1 254 (12.78%) Docker
2 154 (7.75%) HDFS
3 106 (5.33%) Apache Flume
4 23 (1.16%) Apache ZooKeeper
5 19 (0.96%) VMware Infrastructure
6 17 (0.86%) Varnish
7 10 (0.50%) Active Directory
8 9 (0.45%) Virtual Machines
9 7 (0.35%) Snort
10 3 (0.15%) Tivoli Workload Scheduler
10 3 (0.15%) vSphere
11 2 (0.10%) VirtualBox
11 2 (0.10%) VMware ESXi
12 1 (0.050%) Cronacle
12 1 (0.050%) Cygwin
12 1 (0.050%) GridGain
12 1 (0.050%) Hyper-V
12 1 (0.050%) MapR-FS
Systems Management
1 134 (6.74%) Ansible
2 109 (5.48%) Puppet
3 106 (5.33%) Kubernetes
4 104 (5.23%) Opscode Chef
5 59 (2.97%) Oozie
6 58 (2.92%) Mesos
7 57 (2.87%) Terraform
8 49 (2.46%) Hadoop YARN
9 33 (1.66%) logstash
10 31 (1.56%) Salt
11 24 (1.21%) Kibana
12 20 (1.01%) HAProxy
13 16 (0.80%) ZABBIX
14 13 (0.65%) Graphite
14 13 (0.65%) Nagios
15 10 (0.50%) Ambari
15 10 (0.50%) Graylog
16 9 (0.45%) ITRS Geneos
17 7 (0.35%) QRadar
17 7 (0.35%) Suricata
Vendors
1 289 (14.54%) Oracle
2 175 (8.80%) Tableau
3 157 (7.90%) Cloudera
4 143 (7.19%) Google
5 132 (6.64%) SAP
6 127 (6.39%) Microsoft
7 91 (4.58%) Hortonworks
8 68 (3.42%) Teradata
9 60 (3.02%) Informatica
10 51 (2.57%) MapR
11 50 (2.52%) Splunk
12 31 (1.56%) IBM
13 29 (1.46%) SaltStack
14 26 (1.31%) Red Hat
15 25 (1.26%) RedGate
16 24 (1.21%) Netezza
16 24 (1.21%) Sybase
17 23 (1.16%) Vertica
18 20 (1.01%) Cognos
19 19 (0.96%) MicroStrategy