Period
to 22 September 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 22 September 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
22 Sep 2018
Same period 2017 Same period 2016
Rank 126 134 144
Rank change year-on-year +8 +10 -3
Permanent jobs citing Hadoop 1,790 1,919 1,880
As % of all permanent IT jobs advertised in London 2.62% 2.56% 2.38%
As % of the Database & Business Intelligence category 8.41% 8.70% 8.03%
Number of salaries quoted 1,313 1,439 1,583
London median annual salary £75,000 £67,500 £70,000
Median salary % change year-on-year +11.11% -3.57% +3.70%
10th Percentile £47,500 £45,000 £45,000
90th Percentile £105,000 £105,000 £105,000
England median annual salary £70,000 £62,500 £62,500
% change year-on-year +12.00% - -3.85%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,288 22,067 23,425
As % of all permanent IT jobs advertised in London 31.12% 29.46% 29.65%
Number of salaries quoted 16,914 17,736 20,407
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £93,750 £90,000 £87,500
England median annual salary £50,000 £49,000 £47,500
% change year-on-year +2.04% +3.16% +5.56%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 22 September 2018.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 22 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +11 284 £75,000 +7.14% 45
East London +21 43 £95,000 +58.33% 6
West London -12 29 £50,000 -16.67% 25
South London -2 5 £36,500 -45.93% 2
Hadoop
England

For the 6 months to 22 September 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 1,199 (66.98%) Big Data
2 1,100 (61.45%) Apache Spark
3 951 (53.13%) Python
4 847 (47.32%) Java
5 788 (44.02%) SQL
6 665 (37.15%) Agile Software Development
7 646 (36.09%) Analytics
8 580 (32.40%) Scala
9 539 (30.11%) Kafka
10 527 (29.44%) Apache Hive
11 521 (29.11%) Amazon AWS
12 494 (27.60%) NoSQL
13 458 (25.59%) Machine Learning
14 448 (25.03%) Data Science
15 418 (23.35%) Finance
16 417 (23.30%) ETL
17 276 (15.42%) Linux
17 276 (15.42%) Microsoft Azure
18 272 (15.20%) DevOps
19 266 (14.86%) Banking
20 265 (14.80%) Degree
21 264 (14.75%) Data Warehouse
22 257 (14.36%) R
23 256 (14.30%) Apache Cassandra
24 253 (14.13%) Apache
24 253 (14.13%) Problem-Solving
25 252 (14.08%) Analytical Skills
26 250 (13.97%) HBase
27 249 (13.91%) SQL Server
28 244 (13.63%) Tableau

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,100 (61.45%) Apache Spark
2 253 (14.13%) Apache
3 209 (11.68%) Elasticsearch
4 124 (6.93%) Apache Pig
5 90 (5.03%) SAS
6 61 (3.41%) Apache Solr
7 35 (1.96%) Tomcat
8 23 (1.28%) Confluence
9 13 (0.73%) Jetty
9 13 (0.73%) OpenStack
10 12 (0.67%) Apache Airflow
11 11 (0.61%) IIS
11 11 (0.61%) nginx
12 10 (0.56%) WebSphere
13 8 (0.45%) MS Exchange
14 7 (0.39%) GlassFish
15 6 (0.34%) Jupyter
16 5 (0.28%) JBoss
16 5 (0.28%) Oracle Workflow
16 5 (0.28%) SharePoint Server
Applications
1 26 (1.45%) SPSS
2 20 (1.12%) Microsoft Excel
3 18 (1.01%) MS Visio
4 10 (0.56%) Chatbot
5 8 (0.45%) Microsoft Office
6 4 (0.22%) Microsoft PowerPoint
6 4 (0.22%) Stata
7 2 (0.11%) CPLEX
7 2 (0.11%) GNU Octave
7 2 (0.11%) Mathematica
8 1 (0.056%) Microsoft Project
8 1 (0.056%) Mingle
8 1 (0.056%) SPSS Modeler
8 1 (0.056%) Weka
Business Applications
1 13 (0.73%) Dynamics AX
1 13 (0.73%) Dynamics CRM
1 13 (0.73%) Dynamics NAV
2 5 (0.28%) Actimize
3 4 (0.22%) SAP ERP
3 4 (0.22%) SAP InfiniteInsight
4 1 (0.056%) Magento
4 1 (0.056%) Oracle EBS
4 1 (0.056%) Oracle Procure-to-Pay
4 1 (0.056%) SAP S/4HANA
Cloud Services
1 521 (29.11%) Amazon AWS
2 276 (15.42%) Microsoft Azure
3 127 (7.09%) Google Cloud Platform
4 90 (5.03%) Amazon EMR
5 56 (3.13%) Amazon S3
6 50 (2.79%) Cloud Computing
7 44 (2.46%) Serverless
8 40 (2.23%) SaaS
9 34 (1.90%) AWS Lambda
10 32 (1.79%) Amazon EC2
10 32 (1.79%) Amazon Kinesis
11 31 (1.73%) IBM Cloud
11 31 (1.73%) PaaS
12 21 (1.17%) Adobe Analytics
13 20 (1.12%) IaaS
14 19 (1.06%) Cortana Intelligence Suite
15 18 (1.01%) GitHub
16 17 (0.95%) Google Analytics
17 16 (0.89%) AWS CloudFormation
18 15 (0.84%) Azure Machine Learning
Communications & Networking
1 36 (2.01%) TCP/IP
2 25 (1.40%) Kerberos
3 24 (1.34%) Sourcefire
4 23 (1.28%) Firewall
4 23 (1.28%) SSL
5 21 (1.17%) HTTP
6 20 (1.12%) LAN
6 20 (1.12%) WAN
7 14 (0.78%) SAN
8 13 (0.73%) FIX Connectivity
9 12 (0.67%) Network Security
10 10 (0.56%) SMPP
11 9 (0.50%) Internet
12 8 (0.45%) DNS
13 4 (0.22%) HTTPS
13 4 (0.22%) NAS
13 4 (0.22%) VPN
14 3 (0.17%) PABX
14 3 (0.17%) VoIP
15 2 (0.11%) DSL
Database & Business Intelligence
1 1,199 (66.98%) Big Data
2 527 (29.44%) Apache Hive
3 494 (27.60%) NoSQL
4 264 (14.75%) Data Warehouse
5 256 (14.30%) Apache Cassandra
6 250 (13.97%) HBase
7 249 (13.91%) SQL Server
8 223 (12.46%) MongoDB
9 153 (8.55%) Relational Database
10 149 (8.32%) Data Lake
11 148 (8.27%) MySQL
12 144 (8.04%) Impala
13 131 (7.32%) SQL Server Reporting Services
14 125 (6.98%) SQL Server Integration Services
15 116 (6.48%) Amazon Redshift
16 88 (4.92%) Power BI
17 86 (4.80%) QlikView
18 80 (4.47%) Sqoop
19 79 (4.41%) Flink
19 79 (4.41%) RDBMS
Development Applications
1 145 (8.10%) Jenkins
2 143 (7.99%) Git (software)
3 77 (4.30%) JIRA
4 74 (4.13%) JUnit
5 46 (2.57%) Maven
6 44 (2.46%) Atlassian Bamboo
7 37 (2.07%) Visual Studio
8 34 (1.90%) TeamCity
9 33 (1.84%) Selenium
10 29 (1.62%) Mockito
11 28 (1.56%) Vagrant
12 27 (1.51%) Cucumber
12 27 (1.51%) Gradle
13 23 (1.28%) RStudio
14 21 (1.17%) TestNG
15 19 (1.06%) SQL Server Management Studio (SSMS)
16 16 (0.89%) Bitbucket
16 16 (0.89%) Visual Studio Team System
17 13 (0.73%) Subversion
17 13 (0.73%) Team Foundation Server
General
1 418 (23.35%) Finance
2 266 (14.86%) Banking
3 152 (8.49%) Investment Banking
4 99 (5.53%) Marketing
5 98 (5.47%) Front Office
6 96 (5.36%) Games
7 87 (4.86%) Retail
8 54 (3.02%) Telecoms
9 48 (2.68%) Advertising
10 42 (2.35%) Financial Institution
11 36 (2.01%) Law
12 30 (1.68%) Pharmaceutical
13 25 (1.40%) Corporate Banking
14 23 (1.28%) Manufacturing
15 21 (1.17%) Automotive
16 11 (0.61%) Electronics
17 10 (0.56%) Military
18 8 (0.45%) Publishing
19 7 (0.39%) Retail Banking
20 6 (0.34%) Music Industry
Job Titles
1 482 (26.93%) Developer
2 428 (23.91%) Data Engineer
3 253 (14.13%) Big Data Engineer
4 233 (13.02%) Architect
5 193 (10.78%) Data Scientist
6 174 (9.72%) Java Developer
7 163 (9.11%) Data Architect
8 130 (7.26%) Big Data Developer
9 98 (5.47%) Analyst
10 91 (5.08%) Senior Data Scientist
11 80 (4.47%) Big Data Architect
12 76 (4.25%) Hadoop Engineer
13 69 (3.85%) Scala Developer
14 68 (3.80%) Java Engineer
15 67 (3.74%) Hadoop Developer
16 66 (3.69%) Software Engineer
17 65 (3.63%) Consultant
18 61 (3.41%) Senior Developer
19 52 (2.91%) DevOps Engineer
20 49 (2.74%) Solutions Architect
Libraries, Frameworks & Software Standards
1 539 (30.11%) Kafka
2 158 (8.83%) .NET
3 123 (6.87%) Web Services
4 117 (6.54%) Spring
5 111 (6.20%) Node.js
6 102 (5.70%) RESTful
7 81 (4.53%) REST
8 78 (4.36%) TensorFlow
9 77 (4.30%) Natural Language Processing
10 72 (4.02%) HTML
11 68 (3.80%) RabbitMQ
12 67 (3.74%) AngularJS
12 67 (3.74%) scikit-learn
13 63 (3.52%) Spark Streaming
14 62 (3.46%) Pandas
15 58 (3.24%) Hibernate
16 57 (3.18%) PySpark
17 55 (3.07%) NumPy
18 52 (2.91%) JSON
19 51 (2.85%) React
Miscellaneous
1 252 (14.08%) Analytical Skills
2 224 (12.51%) Computer Science
3 178 (9.94%) Algorithms
4 148 (8.27%) Fintech
5 109 (6.09%) Data Structures
6 76 (4.25%) Greenfield Project
7 75 (4.19%) Management Information System
8 66 (3.69%) Equities
9 60 (3.35%) Self-Motivation
10 59 (3.30%) User Experience
11 41 (2.29%) Tandem
12 39 (2.18%) Robotics
13 38 (2.12%) Cyberthreat
14 37 (2.07%) Fixed Income
15 33 (1.84%) Hedge funds
16 31 (1.73%) Foreign Exchange (FX)
17 28 (1.56%) Virtual Team
18 26 (1.45%) Credit Risk
19 25 (1.40%) Derivative
19 25 (1.40%) Linux Command Line
Operating Systems
1 276 (15.42%) Linux
2 142 (7.93%) Unix
3 58 (3.24%) Windows
4 25 (1.40%) Android
4 25 (1.40%) Apple iOS
5 15 (0.84%) Windows Server
6 12 (0.67%) Mac OS X
7 10 (0.56%) Red Hat Enterprise Linux
8 5 (0.28%) Solaris
9 4 (0.22%) CentOS
9 4 (0.22%) CoreOS
10 3 (0.17%) HPUX
10 3 (0.17%) Ubuntu
10 3 (0.17%) zOS
11 2 (0.11%) DC/OS
11 2 (0.11%) SUSE
12 1 (0.056%) AIX
12 1 (0.056%) Debian
12 1 (0.056%) Mesosphere
12 1 (0.056%) Windows 7
Processes & Methodologies
1 665 (37.15%) Agile Software Development
2 646 (36.09%) Analytics
3 458 (25.59%) Machine Learning
4 448 (25.03%) Data Science
5 417 (23.30%) ETL
6 272 (15.20%) DevOps
7 253 (14.13%) Problem-Solving
8 236 (13.18%) Business Intelligence
8 236 (13.18%) Visualisation
9 235 (13.13%) Software Engineering
10 219 (12.23%) Artificial Intelligence
11 212 (11.84%) Data Modelling
12 201 (11.23%) Data Analytics
13 186 (10.39%) Scrum
14 162 (9.05%) Data Engineering
15 154 (8.60%) TDD
16 152 (8.49%) Open Source
17 149 (8.32%) Microservices
18 145 (8.10%) Continuous Integration
19 138 (7.71%) Data Visualisation
Programming Languages
1 951 (53.13%) Python
2 847 (47.32%) Java
3 788 (44.02%) SQL
4 580 (32.40%) Scala
5 257 (14.36%) R
6 216 (12.07%) JavaScript
7 213 (11.90%) C#
8 123 (6.87%) Java 8
9 109 (6.09%) Bash Shell
10 95 (5.31%) C++
11 76 (4.25%) Perl
12 75 (4.19%) C
13 71 (3.97%) T-SQL
14 66 (3.69%) PowerShell
15 54 (3.02%) PHP
16 49 (2.74%) Ruby
17 43 (2.40%) PL/SQL
17 43 (2.40%) Shell Script
18 39 (2.18%) BeanShell
19 37 (2.07%) MATLAB
Qualifications
1 265 (14.80%) Degree
2 105 (5.87%) Computer Science Degree
3 67 (3.74%) Security Cleared
4 64 (3.58%) PhD
5 44 (2.46%) Master's Degree
6 43 (2.40%) DV Cleared
7 41 (2.29%) CISSP
8 33 (1.84%) Numerate Degree
9 24 (1.34%) CEH
9 24 (1.34%) GCIH
9 24 (1.34%) OSCP
10 21 (1.17%) Microsoft Certification
11 19 (1.06%) MCSE
12 14 (0.78%) CCNA
12 14 (0.78%) Cisco Certification
12 14 (0.78%) GIAC
12 14 (0.78%) Linux+ Certification
12 14 (0.78%) Network+ Certification
12 14 (0.78%) SANS
12 14 (0.78%) SSCP
Quality Assurance & Compliance
1 67 (3.74%) QA
2 56 (3.13%) Data Quality
3 20 (1.12%) GDPR
4 14 (0.78%) MiFID
5 13 (0.73%) PMO
6 12 (0.67%) ISO/IEC 27001
7 11 (0.61%) GPG13
7 11 (0.61%) PCI DSS
8 6 (0.34%) SLA
9 4 (0.22%) Actionable Recommendations
10 3 (0.17%) COBIT
10 3 (0.17%) GxP
10 3 (0.17%) Solvency II
11 1 (0.056%) HIPAA
System Software
1 244 (13.63%) HDFS
2 228 (12.74%) Docker
3 117 (6.54%) Apache Flume
4 39 (2.18%) Active Directory
5 27 (1.51%) VirtualBox
6 24 (1.34%) Snort
7 22 (1.23%) Apache ZooKeeper
8 17 (0.95%) VMware Infrastructure
9 12 (0.67%) vSphere
10 10 (0.56%) Hyper-V
11 7 (0.39%) Virtual Machines
12 4 (0.22%) Xen
13 3 (0.17%) KVM
13 3 (0.17%) Oracle RAC
14 2 (0.11%) NFS
14 2 (0.11%) Varnish
14 2 (0.11%) Virtual Servers
15 1 (0.056%) GridGain
15 1 (0.056%) SRDF
Systems Management
1 114 (6.37%) Kubernetes
2 106 (5.92%) Oozie
3 87 (4.86%) Ansible
4 74 (4.13%) Terraform
5 67 (3.74%) Puppet
6 64 (3.58%) Hadoop YARN
7 51 (2.85%) Opscode Chef
8 46 (2.57%) Mesos
9 45 (2.51%) Kibana
10 33 (1.84%) Prometheus
11 29 (1.62%) logstash
12 27 (1.51%) Docker Swarm
13 24 (1.34%) Suricata
14 22 (1.23%) Grafana
15 20 (1.12%) ITRS Geneos
15 20 (1.12%) Salt
16 12 (0.67%) QRadar
17 11 (0.61%) Ambari
18 10 (0.56%) Nagios
19 6 (0.34%) ZABBIX
Vendors
1 244 (13.63%) Tableau
2 242 (13.52%) Oracle
3 233 (13.02%) Cloudera
4 188 (10.50%) Microsoft
5 180 (10.06%) Hortonworks
6 162 (9.05%) Google
7 114 (6.37%) Informatica
8 97 (5.42%) Talend
9 78 (4.36%) MapR
10 74 (4.13%) IBM
11 72 (4.02%) WorldPay
12 61 (3.41%) SAP
13 56 (3.13%) Splunk
14 52 (2.91%) Databricks
15 43 (2.40%) Sybase
16 42 (2.35%) ServiceNow
17 25 (1.40%) Cognos
18 24 (1.34%) Teradata
18 24 (1.34%) TippingPoint
18 24 (1.34%) Vertica