Period
to 21 January 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 January 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
21 Jan 2019
Same period 2018 Same period 2017
Rank 132 127 136
Rank change year-on-year -5 +9 -23
Permanent jobs citing Hadoop 1,606 1,890 1,798
As % of all permanent IT jobs advertised in London 2.56% 2.72% 2.56%
As % of the Database & Business Intelligence category 8.69% 9.03% 8.58%
Number of salaries quoted 1,211 1,523 1,545
London median annual salary £75,000 £70,000 £70,000
Median salary % change year-on-year +7.14% - +3.70%
10th Percentile £47,500 £46,250 £46,250
90th Percentile £106,250 £106,250 £105,000
England median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% -3.85%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 18,481 20,941 20,951
As % of all permanent IT jobs advertised in London 29.47% 30.18% 29.80%
Number of salaries quoted 15,279 17,113 18,327
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £95,000 £88,750 £87,500
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% +3.26%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 21 January 2019.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -29 218 £75,000 - 72
East London +22 30 £80,000 - 18
West London +12 30 £76,000 +32.17% 36
South London -32 7 £73,750 +34.09% 1
North London +1 2 £80,000 -20.00% 1
Hadoop
England

For the 6 months to 21 January 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 1,119 (69.68%) Big Data
2 1,025 (63.82%) Apache Spark
3 1,015 (63.20%) Python
4 812 (50.56%) Java
5 692 (43.09%) Agile Software Development
6 626 (38.98%) SQL
7 622 (38.73%) Amazon AWS
8 597 (37.17%) Kafka
9 583 (36.30%) NoSQL
10 537 (33.44%) Scala
11 516 (32.13%) Apache Hive
12 509 (31.69%) Analytics
13 484 (30.14%) Machine Learning
14 421 (26.21%) Data Science
15 374 (23.29%) Finance
16 373 (23.23%) Microsoft Azure
17 370 (23.04%) HBase
18 340 (21.17%) ETL
19 331 (20.61%) DevOps
20 320 (19.93%) Data Modelling
21 302 (18.80%) Apache Cassandra
22 301 (18.74%) Software Engineering
23 276 (17.19%) Cloudera
24 254 (15.82%) Linux
25 252 (15.69%) Data Warehouse
26 249 (15.50%) Business Intelligence
27 230 (14.32%) Google Cloud Platform
28 222 (13.82%) Apache
29 218 (13.57%) Elasticsearch
30 215 (13.39%) Degree

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,025 (63.82%) Apache Spark
2 222 (13.82%) Apache
3 218 (13.57%) Elasticsearch
4 169 (10.52%) Apache Pig
5 81 (5.04%) Apache Solr
6 73 (4.55%) SAS
7 22 (1.37%) Apache Airflow
7 22 (1.37%) Tomcat
8 21 (1.31%) Confluence
9 15 (0.93%) GlassFish
10 14 (0.87%) MS Exchange
11 12 (0.75%) SharePoint
12 9 (0.56%) IIS
13 8 (0.50%) Luigi
14 7 (0.44%) CMS
14 7 (0.44%) Drupal
14 7 (0.44%) Oracle SOA Suite
14 7 (0.44%) WebSphere
14 7 (0.44%) WordPress
15 6 (0.37%) Jetty
Applications
1 24 (1.49%) SPSS
2 12 (0.75%) Microsoft Office
3 8 (0.50%) Microsoft Excel
3 8 (0.50%) MS Visio
4 7 (0.44%) Chatbot
4 7 (0.44%) Stata
5 4 (0.25%) Maple
6 3 (0.19%) GNU Octave
6 3 (0.19%) Microsoft PowerPoint
7 1 (0.062%) CPLEX
Business Applications
1 2 (0.12%) Dynamics AX
1 2 (0.12%) Dynamics CRM
1 2 (0.12%) Dynamics NAV
1 2 (0.12%) SAP ERP
1 2 (0.12%) SAP InfiniteInsight
2 1 (0.062%) Magento
2 1 (0.062%) Oracle EBS
Cloud Services
1 622 (38.73%) Amazon AWS
2 373 (23.23%) Microsoft Azure
3 230 (14.32%) Google Cloud Platform
4 81 (5.04%) Amazon EMR
5 54 (3.36%) Cloud Computing
5 54 (3.36%) Serverless
6 52 (3.24%) GitHub
7 48 (2.99%) Amazon S3
8 46 (2.86%) AWS Lambda
9 35 (2.18%) Amazon EC2
10 33 (2.05%) PaaS
11 31 (1.93%) SaaS
12 23 (1.43%) Amazon Kinesis
12 23 (1.43%) Azure Data Factory
12 23 (1.43%) Cortana Intelligence Suite
13 20 (1.25%) Amazon SQS
13 20 (1.25%) Office 365
14 17 (1.06%) Amazon SageMaker
14 17 (1.06%) AWS CloudFormation
14 17 (1.06%) IaaS
Communications & Networking
1 45 (2.80%) Internet
2 18 (1.12%) SAN
3 13 (0.81%) HTTP
4 10 (0.62%) Firewall
5 8 (0.50%) DNS
6 7 (0.44%) Sourcefire
6 7 (0.44%) VoIP
6 7 (0.44%) VPN
7 6 (0.37%) LAN
7 6 (0.37%) WAN
8 5 (0.31%) Kerberos
8 5 (0.31%) MQTT
8 5 (0.31%) NAS
8 5 (0.31%) SSL
9 4 (0.25%) Network Security
9 4 (0.25%) PABX
9 4 (0.25%) TCP/IP
10 3 (0.19%) Cisco IOS
10 3 (0.19%) MPLS
11 2 (0.12%) HTTPS
Database & Business Intelligence
1 1,119 (69.68%) Big Data
2 583 (36.30%) NoSQL
3 516 (32.13%) Apache Hive
4 370 (23.04%) HBase
5 302 (18.80%) Apache Cassandra
6 252 (15.69%) Data Warehouse
7 192 (11.96%) SQL Server
8 189 (11.77%) MongoDB
9 188 (11.71%) Amazon Redshift
10 187 (11.64%) Impala
11 132 (8.22%) Flink
12 128 (7.97%) Relational Database
13 118 (7.35%) Data Lake
13 118 (7.35%) MySQL
14 106 (6.60%) PostgreSQL
15 91 (5.67%) Power BI
15 91 (5.67%) SQL Server Integration Services
16 78 (4.86%) Couchbase
17 76 (4.73%) QlikView
17 76 (4.73%) SQL Server Reporting Services
Development Applications
1 122 (7.60%) Git (software)
2 107 (6.66%) Jenkins
3 55 (3.42%) JIRA
4 46 (2.86%) Maven
5 35 (2.18%) Visual Studio
6 30 (1.87%) Selenium
7 27 (1.68%) JUnit
8 20 (1.25%) TeamCity
9 19 (1.18%) Visual Studio Team System
10 18 (1.12%) Gradle
11 16 (1.00%) Atlassian Bamboo
11 16 (1.00%) EasyMock
12 15 (0.93%) Ant
12 15 (0.93%) Cucumber
12 15 (0.93%) RStudio
13 12 (0.75%) Vagrant
14 11 (0.68%) Octopus Deploy
15 10 (0.62%) ERwin
16 9 (0.56%) SQL Server Management Studio (SSMS)
16 9 (0.56%) Subversion
General
1 374 (23.29%) Finance
2 204 (12.70%) Banking
3 139 (8.66%) Law
4 119 (7.41%) Military
5 84 (5.23%) Telecoms
6 81 (5.04%) Marketing
6 81 (5.04%) Retail
7 64 (3.99%) Investment Banking
8 57 (3.55%) Games
9 29 (1.81%) Advertising
10 28 (1.74%) Automotive
11 26 (1.62%) Front Office
12 17 (1.06%) Corporate Banking
13 16 (1.00%) Manufacturing
14 15 (0.93%) Retail Banking
15 9 (0.56%) Electronics
15 9 (0.56%) Pharmaceutical
16 8 (0.50%) Billing
16 8 (0.50%) Financial Institution
17 4 (0.25%) Music Industry
Job Titles
1 489 (30.45%) Data Engineer
2 345 (21.48%) Developer
3 269 (16.75%) Big Data Engineer
4 255 (15.88%) Architect
5 190 (11.83%) Data Architect
6 144 (8.97%) Java Developer
7 124 (7.72%) Data Scientist
8 115 (7.16%) Hadoop Engineer
9 85 (5.29%) Big Data Architect
9 85 (5.29%) Big Data Developer
10 84 (5.23%) Python Engineer
11 77 (4.79%) Consultant
12 75 (4.67%) Senior Data Engineer
13 68 (4.23%) Software Engineer
14 67 (4.17%) Analyst
15 61 (3.80%) Senior Developer
16 59 (3.67%) Senior Data Scientist
17 54 (3.36%) Solutions Architect
18 47 (2.93%) Java Engineer
19 44 (2.74%) Scala Developer
Libraries, Frameworks & Software Standards
1 597 (37.17%) Kafka
2 110 (6.85%) Web Services
3 101 (6.29%) .NET
4 97 (6.04%) RESTful
4 97 (6.04%) Spring
5 90 (5.60%) Node.js
6 82 (5.11%) REST
7 81 (5.04%) Natural Language Processing
8 77 (4.79%) Spark Streaming
9 71 (4.42%) HTML
10 70 (4.36%) Apache NiFi
11 68 (4.23%) React
12 63 (3.92%) AngularJS
12 63 (3.92%) TensorFlow
13 52 (3.24%) Hibernate
14 51 (3.18%) PySpark
15 49 (3.05%) scikit-learn
16 48 (2.99%) HTML5
17 45 (2.80%) Pandas
17 45 (2.80%) RabbitMQ
Miscellaneous
1 172 (10.71%) Analytical Skills
2 140 (8.72%) Algorithms
3 108 (6.72%) Fintech
4 102 (6.35%) Data Structures
5 54 (3.36%) Greenfield Project
6 42 (2.62%) Self-Motivation
7 41 (2.55%) User Experience
8 35 (2.18%) Management Information System
9 27 (1.68%) Virtual Team
10 26 (1.62%) Equities
11 23 (1.43%) Social Media
12 22 (1.37%) Public Cloud
13 21 (1.31%) Market Risk
13 21 (1.31%) Robotics
14 20 (1.25%) Linux Command Line
14 20 (1.25%) Tandem
15 18 (1.12%) Clustering
15 18 (1.12%) Spread Betting
16 17 (1.06%) Derivative
17 16 (1.00%) Credit Risk
Operating Systems
1 254 (15.82%) Linux
2 135 (8.41%) Unix
3 83 (5.17%) Windows
4 31 (1.93%) Android
5 24 (1.49%) Windows Server
6 23 (1.43%) Apple iOS
7 16 (1.00%) Red Hat Enterprise Linux
8 9 (0.56%) Windows 7
8 9 (0.56%) Windows 8
9 8 (0.50%) CentOS
9 8 (0.50%) Ubuntu
10 4 (0.25%) HPUX
10 4 (0.25%) Solaris
10 4 (0.25%) Windows Mobile
10 4 (0.25%) zOS
11 3 (0.19%) Oracle Linux
12 2 (0.12%) DC/OS
12 2 (0.12%) Mac OS X
13 1 (0.062%) AIX
13 1 (0.062%) CoreOS
Processes & Methodologies
1 692 (43.09%) Agile Software Development
2 509 (31.69%) Analytics
3 484 (30.14%) Machine Learning
4 421 (26.21%) Data Science
5 340 (21.17%) ETL
6 331 (20.61%) DevOps
7 320 (19.93%) Data Modelling
8 301 (18.74%) Software Engineering
9 249 (15.50%) Business Intelligence
10 202 (12.58%) Data Analytics
11 199 (12.39%) Scrum
12 198 (12.33%) Artificial Intelligence
13 194 (12.08%) Visualisation
14 190 (11.83%) Data Engineering
15 176 (10.96%) Open Source
16 174 (10.83%) Computer Science
17 165 (10.27%) MapReduce
18 150 (9.34%) Data Analysis
19 147 (9.15%) TDD
20 131 (8.16%) Microservices
Programming Languages
1 1,015 (63.20%) Python
2 812 (50.56%) Java
3 626 (38.98%) SQL
4 537 (33.44%) Scala
5 184 (11.46%) C#
6 172 (10.71%) JavaScript
7 169 (10.52%) R
8 95 (5.92%) C++
9 80 (4.98%) Java 8
10 70 (4.36%) Bash Shell
11 56 (3.49%) C
12 51 (3.18%) PHP
13 50 (3.11%) Shell Script
14 49 (3.05%) PowerShell
15 47 (2.93%) Perl
16 45 (2.80%) Ruby
17 42 (2.62%) T-SQL
18 34 (2.12%) PL/SQL
19 26 (1.62%) Go
20 25 (1.56%) Groovy
Qualifications
1 215 (13.39%) Degree
2 93 (5.79%) Computer Science Degree
3 64 (3.99%) Security Cleared
4 40 (2.49%) DV Cleared
5 37 (2.30%) PhD
6 34 (2.12%) Master's Degree
7 29 (1.81%) Numerate Degree
8 18 (1.12%) SC Cleared
9 13 (0.81%) TOGAF Certification
10 12 (0.75%) AWS Certification
11 11 (0.68%) CISSP
12 9 (0.56%) CEH
13 7 (0.44%) GCIH
13 7 (0.44%) OSCP
14 5 (0.31%) PMI Certification
15 3 (0.19%) ISTQB
15 3 (0.19%) MCP
15 3 (0.19%) Postgraduate
16 2 (0.12%) Cisco Certification
16 2 (0.12%) MCSE
Quality Assurance & Compliance
1 79 (4.92%) Data Quality
2 57 (3.55%) QA
3 33 (2.05%) GDPR
4 16 (1.00%) MiFID
5 12 (0.75%) PMO
6 9 (0.56%) IFRS
7 8 (0.50%) ISO/IEC 27001
8 6 (0.37%) GxP
8 6 (0.37%) PCI DSS
9 5 (0.31%) Solvency II
10 4 (0.25%) COBIT
10 4 (0.25%) SLA
11 3 (0.19%) GPG13
12 2 (0.12%) EMIR
13 1 (0.062%) Basel III
System Software
1 184 (11.46%) HDFS
2 181 (11.27%) Docker
3 130 (8.09%) Apache Flume
4 79 (4.92%) Apache ZooKeeper
5 25 (1.56%) Active Directory
6 12 (0.75%) VirtualBox
7 7 (0.44%) Oracle RAC
7 7 (0.44%) Snort
8 6 (0.37%) Hyper-V
8 6 (0.37%) Virtual Machines
9 5 (0.31%) VMware Infrastructure
10 2 (0.12%) vSphere
11 1 (0.062%) KVM
11 1 (0.062%) NFS
11 1 (0.062%) SRDF
11 1 (0.062%) Xen
Systems Management
1 155 (9.65%) Oozie
2 120 (7.47%) Hadoop YARN
3 94 (5.85%) Kubernetes
4 86 (5.35%) Ansible
5 85 (5.29%) Terraform
6 60 (3.74%) Opscode Chef
7 56 (3.49%) Puppet
8 40 (2.49%) Kibana
8 40 (2.49%) Mesos
9 27 (1.68%) Prometheus
10 26 (1.62%) logstash
11 24 (1.49%) Ambari
12 16 (1.00%) Nagios
13 14 (0.87%) Grafana
14 12 (0.75%) Docker Swarm
14 12 (0.75%) Salt
15 7 (0.44%) Suricata
16 6 (0.37%) QRadar
17 5 (0.31%) ITRS Geneos
18 4 (0.25%) Marathon
Vendors
1 276 (17.19%) Cloudera
2 213 (13.26%) Tableau
3 200 (12.45%) Hortonworks
4 189 (11.77%) Oracle
5 177 (11.02%) Microsoft
6 175 (10.90%) Google
7 113 (7.04%) MapR
8 102 (6.35%) Databricks
9 77 (4.79%) Informatica
10 76 (4.73%) Talend
11 71 (4.42%) IBM
12 53 (3.30%) SAP
13 46 (2.86%) Splunk
14 41 (2.55%) WorldPay
15 31 (1.93%) TIBCO
16 28 (1.74%) Red Hat
17 24 (1.49%) HP
18 21 (1.31%) ServiceNow
18 21 (1.31%) Teradata
18 21 (1.31%) Vertica