Period
to 17 July 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 July 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
17 Jul 2018
Same period 2017 Same period 2016
Rank 122 139 129
Rank change year-on-year +17 -10 +26
Permanent jobs citing Hadoop 1,972 1,824 2,173
As % of all permanent IT jobs advertised in London 2.76% 2.50% 2.61%
As % of the Database & Business Intelligence category 8.74% 8.38% 8.65%
Number of salaries quoted 1,405 1,427 1,816
London median annual salary £72,500 £70,000 £70,000
Median salary % change year-on-year +3.57% - +7.69%
10th Percentile £46,250 £45,000 £45,000
90th Percentile £107,500 £105,000 £107,500
England median annual salary £67,500 £65,000 £62,500
% change year-on-year +3.85% +4.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22,560 21,761 25,125
As % of all permanent IT jobs advertised in London 31.56% 29.78% 30.23%
Number of salaries quoted 17,780 18,164 21,931
London median annual salary £62,500 £60,000 £55,500
Median salary % change year-on-year +4.17% +8.11% +0.91%
10th Percentile £37,500 £36,250 £35,500
90th Percentile £92,500 £90,000 £85,000
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 17 July 2018.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 17 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +18 312 £75,000 +7.14% 64
East London +25 38 £95,000 +58.33% 14
West London -14 33 £50,000 -13.04% 29
South London -7 6 £62,500 -15.54% 4
North London - 2 £42,283 - 2
Hadoop
England

For the 6 months to 17 July 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 1,325 (67.19%) Big Data
2 1,219 (61.82%) Apache Spark
3 1,015 (51.47%) Python
4 946 (47.97%) Java
5 819 (41.53%) SQL
6 788 (39.96%) Analytics
7 686 (34.79%) Scala
8 672 (34.08%) Agile Software Development
9 588 (29.82%) Kafka
10 551 (27.94%) Amazon AWS
11 546 (27.69%) Apache Hive
12 508 (25.76%) Data Science
13 506 (25.66%) NoSQL
14 497 (25.20%) Machine Learning
15 479 (24.29%) ETL
16 396 (20.08%) Finance
17 375 (19.02%) Linux
18 331 (16.78%) R
19 314 (15.92%) Analytical Skills
20 313 (15.87%) Apache Cassandra
21 306 (15.52%) Degree
22 299 (15.16%) Oracle
23 297 (15.06%) HBase
24 288 (14.60%) DevOps
25 287 (14.55%) Cloudera
26 284 (14.40%) Problem-Solving
27 275 (13.95%) Software Engineering
28 272 (13.79%) Visualisation
29 267 (13.54%) Apache
30 263 (13.34%) Business Intelligence

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,219 (61.82%) Apache Spark
2 267 (13.54%) Apache
3 205 (10.40%) Elasticsearch
4 118 (5.98%) Apache Pig
5 114 (5.78%) SAS
6 88 (4.46%) Apache Solr
7 61 (3.09%) Tomcat
8 30 (1.52%) Jetty
9 29 (1.47%) Confluence
10 19 (0.96%) nginx
11 18 (0.91%) OpenStack
12 17 (0.86%) JBoss
13 16 (0.81%) IIS
14 14 (0.71%) WebSphere
15 10 (0.51%) Apache Airflow
16 8 (0.41%) WebLogic
17 7 (0.35%) Jupyter
18 6 (0.30%) Cloud Foundry
19 5 (0.25%) Oracle Workflow
20 4 (0.20%) SharePoint Server
Applications
1 34 (1.72%) Microsoft Excel
2 25 (1.27%) SPSS
3 24 (1.22%) MS Visio
4 11 (0.56%) Chatbot
5 8 (0.41%) Microsoft Office
6 6 (0.30%) Microsoft PowerPoint
7 5 (0.25%) Stata
8 4 (0.20%) GNU Octave
9 3 (0.15%) Mathematica
10 1 (0.051%) CPLEX
10 1 (0.051%) Microsoft Project
10 1 (0.051%) Mingle
10 1 (0.051%) SPSS Modeler
10 1 (0.051%) Weka
Business Applications
1 11 (0.56%) Dynamics AX
1 11 (0.56%) Dynamics CRM
1 11 (0.56%) Dynamics NAV
2 5 (0.25%) Actimize
3 4 (0.20%) SAP ERP
3 4 (0.20%) SAP InfiniteInsight
4 3 (0.15%) Distributed Ledger
5 2 (0.10%) Oracle Procure-to-Pay
5 2 (0.10%) SAP S/4HANA
Cloud Services
1 551 (27.94%) Amazon AWS
2 249 (12.63%) Microsoft Azure
3 116 (5.88%) Google Cloud Platform
4 80 (4.06%) Amazon EMR
5 71 (3.60%) Amazon S3
6 54 (2.74%) SaaS
7 49 (2.48%) Serverless
8 48 (2.43%) Cloud Computing
9 45 (2.28%) AWS Lambda
10 44 (2.23%) GitHub
11 33 (1.67%) Amazon EC2
12 31 (1.57%) Amazon Kinesis
13 30 (1.52%) IBM Cloud
14 27 (1.37%) Adobe Analytics
15 21 (1.06%) Google Analytics
15 21 (1.06%) PaaS
16 20 (1.01%) IaaS
17 19 (0.96%) OpenShift
18 14 (0.71%) AWS CloudFormation
19 12 (0.61%) Azure Machine Learning
Communications & Networking
1 57 (2.89%) TCP/IP
2 42 (2.13%) Kerberos
3 33 (1.67%) HTTP
4 28 (1.42%) Firewall
5 27 (1.37%) SSL
6 20 (1.01%) DNS
6 20 (1.01%) Sourcefire
7 18 (0.91%) Internet
7 18 (0.91%) SMPP
8 17 (0.86%) LAN
8 17 (0.86%) WAN
9 14 (0.71%) FIX Connectivity
10 10 (0.51%) VPN
11 9 (0.46%) Network Security
11 9 (0.46%) SMTP
12 8 (0.41%) SAN
13 3 (0.15%) HTTPS
13 3 (0.15%) SSH
14 2 (0.10%) DSL
14 2 (0.10%) LTE
Database & Business Intelligence
1 1,325 (67.19%) Big Data
2 546 (27.69%) Apache Hive
3 506 (25.66%) NoSQL
4 313 (15.87%) Apache Cassandra
5 297 (15.06%) HBase
6 262 (13.29%) MongoDB
7 249 (12.63%) Data Warehouse
8 238 (12.07%) SQL Server
9 196 (9.94%) MySQL
10 181 (9.18%) Data Lake
11 180 (9.13%) Relational Database
12 179 (9.08%) Impala
13 117 (5.93%) SQL Server Integration Services
14 108 (5.48%) Sqoop
15 96 (4.87%) Amazon Redshift
16 95 (4.82%) SQL Server Reporting Services
17 94 (4.77%) RDBMS
17 94 (4.77%) Redis
18 90 (4.56%) PostgreSQL
19 88 (4.46%) QlikView
Development Applications
1 195 (9.89%) Jenkins
2 130 (6.59%) Git (software)
3 105 (5.32%) JIRA
4 79 (4.01%) JUnit
5 76 (3.85%) Maven
6 56 (2.84%) Atlassian Bamboo
7 50 (2.54%) Gradle
8 41 (2.08%) TeamCity
9 37 (1.88%) Selenium
9 37 (1.88%) Vagrant
10 35 (1.77%) Cucumber
11 30 (1.52%) TestNG
12 24 (1.22%) Mockito
13 20 (1.01%) Sonatype Nexus
14 19 (0.96%) Visual Studio
15 18 (0.91%) Hamcrest
15 18 (0.91%) jMock
16 16 (0.81%) RStudio
17 15 (0.76%) ERwin
17 15 (0.76%) GitLab
General
1 396 (20.08%) Finance
2 240 (12.17%) Banking
3 137 (6.95%) Investment Banking
4 112 (5.68%) Retail
5 103 (5.22%) Games
6 101 (5.12%) Marketing
7 95 (4.82%) Front Office
8 55 (2.79%) Telecoms
9 51 (2.59%) Financial Institution
10 40 (2.03%) Advertising
11 36 (1.83%) Law
12 29 (1.47%) Pharmaceutical
13 19 (0.96%) Manufacturing
14 16 (0.81%) Publishing
15 11 (0.56%) Military
16 8 (0.41%) Legal
17 6 (0.30%) Automotive
17 6 (0.30%) Corporate Banking
17 6 (0.30%) Electronics
18 4 (0.20%) Music Industry
Job Titles
1 500 (25.35%) Developer
2 434 (22.01%) Data Engineer
3 258 (13.08%) Architect
4 250 (12.68%) Data Scientist
5 245 (12.42%) Big Data Engineer
6 202 (10.24%) Java Developer
7 177 (8.98%) Data Architect
8 145 (7.35%) Big Data Developer
9 109 (5.53%) Big Data Architect
10 105 (5.32%) Analyst
11 103 (5.22%) Senior Data Scientist
12 82 (4.16%) Java Engineer
13 79 (4.01%) Scala Developer
14 75 (3.80%) Software Engineer
15 73 (3.70%) Hadoop Engineer
16 51 (2.59%) DevOps Engineer
16 51 (2.59%) Senior Developer
17 50 (2.54%) Data Analyst
18 48 (2.43%) Systems Engineer
19 47 (2.38%) Solutions Architect
Libraries, Frameworks & Software Standards
1 588 (29.82%) Kafka
2 150 (7.61%) Web Services
3 133 (6.74%) Spring
4 131 (6.64%) .NET
5 96 (4.87%) REST
6 91 (4.61%) Node.js
7 84 (4.26%) Natural Language Processing
8 82 (4.16%) Hibernate
9 81 (4.11%) RabbitMQ
10 76 (3.85%) RESTful
11 74 (3.75%) scikit-learn
11 74 (3.75%) Spark Streaming
12 72 (3.65%) Pandas
12 72 (3.65%) TensorFlow
13 64 (3.25%) HTML
14 63 (3.19%) Elastic Stack
15 60 (3.04%) AngularJS
16 59 (2.99%) Akka
16 59 (2.99%) JSON
17 58 (2.94%) NumPy
Miscellaneous
1 314 (15.92%) Analytical Skills
2 254 (12.88%) Computer Science
3 209 (10.60%) Algorithms
4 193 (9.79%) Fintech
5 119 (6.03%) Data Structures
6 75 (3.80%) Management Information System
7 74 (3.75%) Greenfield Project
8 67 (3.40%) User Experience
9 49 (2.48%) Equities
10 48 (2.43%) Self-Motivation
11 47 (2.38%) Cyberthreat
12 44 (2.23%) Linux Command Line
13 41 (2.08%) Fixed Income
14 37 (1.88%) Hedge funds
15 34 (1.72%) Tandem
16 31 (1.57%) Public Cloud
17 28 (1.42%) Foreign Exchange (FX)
17 28 (1.42%) Robotics
18 27 (1.37%) Virtual Team
19 24 (1.22%) Derivative
Operating Systems
1 375 (19.02%) Linux
2 140 (7.10%) Unix
3 58 (2.94%) Windows
4 22 (1.12%) CentOS
4 22 (1.12%) Red Hat Enterprise Linux
5 18 (0.91%) Apple iOS
6 15 (0.76%) Android
7 12 (0.61%) Windows Server
8 11 (0.56%) Mac OS X
9 9 (0.46%) Ubuntu
10 6 (0.30%) CoreOS
11 5 (0.25%) Amazon Linux
12 4 (0.20%) Windows 7
12 4 (0.20%) Windows 8
13 3 (0.15%) SUSE
14 2 (0.10%) DC/OS
14 2 (0.10%) Solaris
15 1 (0.051%) Debian
15 1 (0.051%) Mesosphere
15 1 (0.051%) Windows Server 2008
Processes & Methodologies
1 788 (39.96%) Analytics
2 672 (34.08%) Agile Software Development
3 508 (25.76%) Data Science
4 497 (25.20%) Machine Learning
5 479 (24.29%) ETL
6 288 (14.60%) DevOps
7 284 (14.40%) Problem-Solving
8 275 (13.95%) Software Engineering
9 272 (13.79%) Visualisation
10 263 (13.34%) Business Intelligence
11 237 (12.02%) Data Analytics
12 224 (11.36%) TDD
13 218 (11.05%) Data Modelling
14 208 (10.55%) Artificial Intelligence
15 203 (10.29%) Scrum
16 181 (9.18%) Data Engineering
17 169 (8.57%) Data Visualisation
17 169 (8.57%) Open Source
18 166 (8.42%) Mathematics
19 165 (8.37%) Continuous Integration
Programming Languages
1 1,015 (51.47%) Python
2 946 (47.97%) Java
3 819 (41.53%) SQL
4 686 (34.79%) Scala
5 331 (16.78%) R
6 174 (8.82%) JavaScript
7 168 (8.52%) C#
8 146 (7.40%) Java 8
9 143 (7.25%) Bash Shell
10 110 (5.58%) Perl
11 93 (4.72%) C++
12 83 (4.21%) C
13 74 (3.75%) T-SQL
14 70 (3.55%) Ruby
15 62 (3.14%) PowerShell
16 61 (3.09%) MATLAB
17 49 (2.48%) Shell Script
18 45 (2.28%) PHP
19 36 (1.83%) PL/SQL
20 34 (1.72%) Go
Qualifications
1 306 (15.52%) Degree
2 98 (4.97%) PhD
3 94 (4.77%) Computer Science Degree
4 68 (3.45%) Security Cleared
5 49 (2.48%) Master's Degree
6 43 (2.18%) Numerate Degree
7 37 (1.88%) CISSP
8 36 (1.83%) DV Cleared
9 24 (1.22%) Microsoft Certification
10 21 (1.06%) MCSE
11 20 (1.01%) CEH
11 20 (1.01%) GCIH
11 20 (1.01%) OSCP
12 13 (0.66%) Cisco Certification
12 13 (0.66%) GIAC
12 13 (0.66%) Linux+ Certification
12 13 (0.66%) Network+ Certification
12 13 (0.66%) SANS
12 13 (0.66%) SSCP
12 13 (0.66%) TOGAF Certification
Quality Assurance & Compliance
1 67 (3.40%) Data Quality
2 54 (2.74%) QA
3 22 (1.12%) GCP
4 13 (0.66%) PCI DSS
5 12 (0.61%) ISO/IEC 27001
5 12 (0.61%) MiFID
6 11 (0.56%) GDPR
7 8 (0.41%) GPG13
7 8 (0.41%) SLA
8 6 (0.30%) PMO
9 5 (0.25%) HIPAA
9 5 (0.25%) Solvency II
10 4 (0.20%) Actionable Recommendations
11 2 (0.10%) EMIR
12 1 (0.051%) Sarbanes-Oxley
12 1 (0.051%) Val IT
System Software
1 254 (12.88%) HDFS
2 245 (12.42%) Docker
3 145 (7.35%) Apache Flume
4 46 (2.33%) Active Directory
5 30 (1.52%) VMware Infrastructure
6 27 (1.37%) VirtualBox
7 26 (1.32%) Apache ZooKeeper
8 20 (1.01%) Snort
9 12 (0.61%) vSphere
10 10 (0.51%) Hyper-V
11 8 (0.41%) KVM
12 7 (0.35%) Virtual Machines
12 7 (0.35%) Xen
13 3 (0.15%) Oracle RAC
13 3 (0.15%) Varnish
13 3 (0.15%) VMware ESXi
14 2 (0.10%) Virtual Servers
15 1 (0.051%) Cronacle
15 1 (0.051%) GridGain
15 1 (0.051%) NFS
Systems Management
1 133 (6.74%) Ansible
2 128 (6.49%) Puppet
3 110 (5.58%) Kubernetes
4 100 (5.07%) Oozie
5 79 (4.01%) Hadoop YARN
6 78 (3.96%) Opscode Chef
7 74 (3.75%) Terraform
8 65 (3.30%) Mesos
9 34 (1.72%) Kibana
10 32 (1.62%) Docker Swarm
11 31 (1.57%) Salt
12 27 (1.37%) Nagios
13 25 (1.27%) Ambari
14 21 (1.06%) logstash
14 21 (1.06%) Prometheus
15 20 (1.01%) Suricata
16 16 (0.81%) ITRS Geneos
17 12 (0.61%) Consul
18 9 (0.46%) Grafana
19 8 (0.41%) QRadar
Vendors
1 299 (15.16%) Oracle
2 287 (14.55%) Cloudera
3 261 (13.24%) Tableau
4 202 (10.24%) Hortonworks
5 178 (9.03%) Google
6 168 (8.52%) Microsoft
7 132 (6.69%) Talend
8 130 (6.59%) Informatica
9 118 (5.98%) WorldPay
10 70 (3.55%) IBM
11 59 (2.99%) Sybase
12 55 (2.79%) MapR
12 55 (2.79%) Splunk
13 48 (2.43%) Teradata
14 47 (2.38%) SAP
15 39 (1.98%) VMware
16 33 (1.67%) EXASOL
17 31 (1.57%) Netezza
18 30 (1.52%) SnapLogic
18 30 (1.52%) TIBCO