Period
to 21 May 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 May 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
21 May 2019
Same period 2018 Same period 2017
Rank 116 116 136
Rank change year-on-year 0 +20 -25
Permanent jobs citing Hadoop 1,618 2,003 1,712
As % of all permanent IT jobs advertised in London 2.77% 2.91% 2.51%
As % of the Database & Business Intelligence category 9.61% 9.29% 8.26%
Number of salaries quoted 1,269 1,503 1,428
London median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% +2.94%
10th Percentile £50,000 £46,300 £46,250
90th Percentile £110,000 £108,750 £105,375
England median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +1.36%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 16,845 21,569 20,726
As % of all permanent IT jobs advertised in London 28.88% 31.32% 30.43%
Number of salaries quoted 13,996 17,245 17,826
London median annual salary £65,000 £60,000 £60,000
Median salary % change year-on-year +8.33% - +9.09%
10th Percentile £38,750 £37,500 £36,250
90th Percentile £95,000 £92,500 £90,000
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 21 May 2019.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -37 204 £76,000 +1.33% 17
West London +42 48 £70,000 +40.00% 13
East London +5 14 £62,500 -34.21% 5
South London +6 9 £85,000 +54.55% 1
North London +18 8 £77,500 +83.29% 1
Hadoop
England

For the 6 months to 21 May 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 1,105 (68.29%) Big Data
2 1,091 (67.43%) Python
3 1,030 (63.66%) Apache Spark
4 878 (54.26%) Java
5 747 (46.17%) Agile Software Development
6 704 (43.51%) SQL
7 665 (41.10%) Amazon AWS
8 644 (39.80%) Kafka
9 640 (39.56%) Scala
10 578 (35.72%) Analytics
11 569 (35.17%) NoSQL
12 535 (33.07%) Apache Hive
13 481 (29.73%) Machine Learning
14 456 (28.18%) Data Science
15 439 (27.13%) Microsoft Azure
16 383 (23.67%) DevOps
17 371 (22.93%) HBase
18 369 (22.81%) Data Modelling
19 357 (22.06%) Software Engineering
20 354 (21.88%) ETL
21 349 (21.57%) Google Cloud Platform
22 329 (20.33%) Finance
23 327 (20.21%) Cloudera
24 316 (19.53%) Business Intelligence
25 286 (17.68%) Apache Cassandra
26 273 (16.87%) Linux
27 270 (16.69%) Data Warehouse
28 261 (16.13%) Data Engineering
29 252 (15.57%) Apache Pig
30 249 (15.39%) Analytical Skills

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,030 (63.66%) Apache Spark
2 252 (15.57%) Apache Pig
3 200 (12.36%) Elasticsearch
4 153 (9.46%) Apache
5 79 (4.88%) Apache Solr
6 63 (3.89%) SAS
7 26 (1.61%) Apache Airflow
8 17 (1.05%) IIS
9 14 (0.87%) Confluence
10 13 (0.80%) SharePoint
11 12 (0.74%) Jupyter
12 9 (0.56%) IPython
13 8 (0.49%) CMS
13 8 (0.49%) Drupal
13 8 (0.49%) GlassFish
13 8 (0.49%) Tomcat
13 8 (0.49%) WordPress
14 7 (0.43%) Luigi
15 6 (0.37%) nginx
16 5 (0.31%) Oracle SOA Suite
Applications
1 9 (0.56%) Maple
2 8 (0.49%) Microsoft Excel
3 7 (0.43%) Microsoft Office
4 6 (0.37%) Microsoft PowerPoint
5 5 (0.31%) SPSS
6 4 (0.25%) MS Visio
7 2 (0.12%) GNU Octave
8 1 (0.062%) Chatbot
Business Applications
1 5 (0.31%) Dynamics CRM
2 2 (0.12%) Magento
2 2 (0.12%) SAP ERP
2 2 (0.12%) SAP InfiniteInsight
3 1 (0.062%) Adobe Campaign
Cloud Services
1 665 (41.10%) Amazon AWS
2 439 (27.13%) Microsoft Azure
3 349 (21.57%) Google Cloud Platform
4 132 (8.16%) Power Platform
5 82 (5.07%) PaaS
6 81 (5.01%) Serverless
7 60 (3.71%) Amazon EMR
8 54 (3.34%) Cloud Computing
9 51 (3.15%) SaaS
10 49 (3.03%) AWS Lambda
11 47 (2.90%) Amazon EC2
11 47 (2.90%) Amazon S3
12 46 (2.84%) Amazon Kinesis
13 45 (2.78%) GitHub
14 33 (2.04%) Amazon SQS
15 22 (1.36%) Azure Data Factory
16 18 (1.11%) Amazon CloudWatch
16 18 (1.11%) AWS CloudFormation
16 18 (1.11%) OpenShift
17 17 (1.05%) Cortana Intelligence Suite
Communications & Networking
1 57 (3.52%) Internet
2 20 (1.24%) HTTP
3 10 (0.62%) LAN
3 10 (0.62%) Software-Defined Networking
3 10 (0.62%) WAN
4 8 (0.49%) TCP/IP
5 5 (0.31%) DNS
5 5 (0.31%) Firewall
5 5 (0.31%) MQTT
6 4 (0.25%) FTP
6 4 (0.25%) Kerberos
6 4 (0.25%) VPN
7 3 (0.19%) Cisco IOS
7 3 (0.19%) MPLS
7 3 (0.19%) SAN
7 3 (0.19%) SMPP
7 3 (0.19%) SMS
7 3 (0.19%) SSL
7 3 (0.19%) VoIP
8 2 (0.12%) Network Security
Database & Business Intelligence
1 1,105 (68.29%) Big Data
2 569 (35.17%) NoSQL
3 535 (33.07%) Apache Hive
4 371 (22.93%) HBase
5 286 (17.68%) Apache Cassandra
6 270 (16.69%) Data Warehouse
7 231 (14.28%) MongoDB
8 210 (12.98%) Amazon Redshift
9 201 (12.42%) Impala
10 154 (9.52%) SQL Server
11 132 (8.16%) Power BI
12 130 (8.03%) Flink
13 129 (7.97%) Sqoop
14 101 (6.24%) Data Lake
15 100 (6.18%) MySQL
15 100 (6.18%) PostgreSQL
16 96 (5.93%) Relational Database
17 80 (4.94%) Pentaho
18 78 (4.82%) Couchbase
18 78 (4.82%) CouchDB
Development Applications
1 116 (7.17%) Git (software)
2 105 (6.49%) Jenkins
3 74 (4.57%) Maven
4 43 (2.66%) JIRA
5 38 (2.35%) Selenium
6 34 (2.10%) Atlassian Bamboo
6 34 (2.10%) Gradle
7 31 (1.92%) Ant
8 29 (1.79%) Visual Studio
9 27 (1.67%) Artifactory
10 24 (1.48%) Bitbucket
11 22 (1.36%) Travis CI
12 14 (0.87%) GitLab
12 14 (0.87%) Visual Studio Team System
13 13 (0.80%) JUnit
14 12 (0.74%) Hudson
14 12 (0.74%) JMeter
14 12 (0.74%) TeamCity
15 10 (0.62%) Subversion
16 9 (0.56%) Cucumber
General
1 329 (20.33%) Finance
2 222 (13.72%) Law
3 182 (11.25%) Banking
4 95 (5.87%) Retail
5 58 (3.58%) Games
6 50 (3.09%) Telecoms
7 48 (2.97%) Marketing
8 25 (1.55%) Front Office
9 22 (1.36%) Advertising
10 15 (0.93%) Investment Banking
11 14 (0.87%) Financial Institution
12 9 (0.56%) Billing
13 7 (0.43%) Retail Banking
14 6 (0.37%) Manufacturing
15 4 (0.25%) Back Office
15 4 (0.25%) Legal
16 3 (0.19%) Automotive
17 1 (0.062%) Electronics
17 1 (0.062%) Pharmaceutical
17 1 (0.062%) Publishing
Job Titles
1 556 (34.36%) Data Engineer
2 309 (19.10%) Developer
3 305 (18.85%) Big Data Engineer
4 241 (14.89%) Architect
5 185 (11.43%) Data Architect
6 171 (10.57%) Hadoop Engineer
7 150 (9.27%) Java Developer
8 117 (7.23%) Python Engineer
9 104 (6.43%) Senior Data Engineer
10 100 (6.18%) Data Scientist
11 93 (5.75%) Big Data Architect
12 92 (5.69%) Software Engineer
13 70 (4.33%) Big Data Developer
14 64 (3.96%) Senior Developer
15 61 (3.77%) Solutions Architect
16 57 (3.52%) Java Engineer
17 51 (3.15%) Consultant
18 48 (2.97%) Senior Software Engineer
19 47 (2.90%) AWS Engineer
20 45 (2.78%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 644 (39.80%) Kafka
2 138 (8.53%) Web Services
3 119 (7.35%) Apache NiFi
4 116 (7.17%) REST
5 88 (5.44%) Spark Streaming
6 85 (5.25%) .NET
7 83 (5.13%) Spring
8 74 (4.57%) Node.js
9 69 (4.26%) React
10 68 (4.20%) RESTful
11 64 (3.96%) Natural Language Processing
12 59 (3.65%) TensorFlow
13 56 (3.46%) AngularJS
14 53 (3.28%) JSON
15 49 (3.03%) scikit-learn
16 47 (2.90%) HTML
17 42 (2.60%) CSS
18 40 (2.47%) Pandas
19 37 (2.29%) PySpark
20 36 (2.22%) RabbitMQ
Miscellaneous
1 249 (15.39%) Analytical Skills
2 133 (8.22%) Algorithms
3 117 (7.23%) Data Structures
4 108 (6.67%) Fintech
5 56 (3.46%) Greenfield Project
6 48 (2.97%) User Experience
7 36 (2.22%) Self-Motivation
8 35 (2.16%) Linux Command Line
8 35 (2.16%) Virtual Team
9 29 (1.79%) Social Media
10 23 (1.42%) Cloud Native
11 20 (1.24%) Management Information System
12 19 (1.17%) Enterprise Software
13 18 (1.11%) Market Risk
14 15 (0.93%) Analytical Mindset
14 15 (0.93%) Credit Risk
14 15 (0.93%) Public Cloud
14 15 (0.93%) Semantic Web
15 12 (0.74%) Hedge funds
15 12 (0.74%) Mobile App
Operating Systems
1 273 (16.87%) Linux
2 143 (8.84%) Unix
3 83 (5.13%) Windows
4 24 (1.48%) Android
4 24 (1.48%) Apple iOS
4 24 (1.48%) CentOS
5 23 (1.42%) Ubuntu
6 17 (1.05%) Windows Server
7 16 (0.99%) Red Hat Enterprise Linux
8 7 (0.43%) Windows 7
8 7 (0.43%) Windows 8
9 4 (0.25%) Mac OS X
9 4 (0.25%) Oracle Linux
9 4 (0.25%) Windows Mobile
10 2 (0.12%) AIX
10 2 (0.12%) Debian
11 1 (0.062%) CoreOS
11 1 (0.062%) Solaris
11 1 (0.062%) VMS
Processes & Methodologies
1 747 (46.17%) Agile Software Development
2 578 (35.72%) Analytics
3 481 (29.73%) Machine Learning
4 456 (28.18%) Data Science
5 383 (23.67%) DevOps
6 369 (22.81%) Data Modelling
7 357 (22.06%) Software Engineering
8 354 (21.88%) ETL
9 316 (19.53%) Business Intelligence
10 261 (16.13%) Data Engineering
11 223 (13.78%) Visualisation
12 220 (13.60%) Scrum
13 218 (13.47%) MapReduce
14 183 (11.31%) Data Analytics
15 176 (10.88%) TDD
16 174 (10.75%) Artificial Intelligence
17 155 (9.58%) Data Analysis
18 145 (8.96%) Continuous Integration
19 144 (8.90%) Microservices
20 143 (8.84%) Data Architecture
Programming Languages
1 1,091 (67.43%) Python
2 878 (54.26%) Java
3 704 (43.51%) SQL
4 640 (39.56%) Scala
5 165 (10.20%) R
6 114 (7.05%) C#
6 114 (7.05%) JavaScript
7 62 (3.83%) Java 8
8 61 (3.77%) PL/SQL
9 59 (3.65%) Perl
10 57 (3.52%) C++
11 53 (3.28%) C
12 35 (2.16%) Bash Shell
13 34 (2.10%) T-SQL
14 32 (1.98%) Groovy
15 31 (1.92%) PHP
15 31 (1.92%) Shell Script
16 26 (1.61%) PowerShell
17 23 (1.42%) Clojure
18 19 (1.17%) Ruby
Qualifications
1 140 (8.65%) Degree
2 60 (3.71%) Security Cleared
3 45 (2.78%) Computer Science Degree
4 42 (2.60%) PhD
5 28 (1.73%) Numerate Degree
5 28 (1.73%) SC Cleared
6 27 (1.67%) DV Cleared
7 12 (0.74%) Master's Degree
7 12 (0.74%) TOGAF Certification
8 8 (0.49%) AWS Certification
8 8 (0.49%) ISTQB
8 8 (0.49%) ISTQB Foundation Certification
9 6 (0.37%) MCP
10 2 (0.12%) CEH
10 2 (0.12%) MBA
10 2 (0.12%) Microsoft Certification
10 2 (0.12%) PMI Certification
11 1 (0.062%) Postgraduate
Quality Assurance & Compliance
1 56 (3.46%) QA
2 55 (3.40%) Data Quality
3 24 (1.48%) GDPR
4 9 (0.56%) ISO/IEC 27001
4 9 (0.56%) MiFID
5 8 (0.49%) IFRS
6 5 (0.31%) PCI DSS
7 4 (0.25%) Solvency II
8 3 (0.19%) GxP
8 3 (0.19%) SLA
9 1 (0.062%) Basel III
9 1 (0.062%) COBIT
9 1 (0.062%) EMIR
System Software
1 197 (12.18%) Docker
2 150 (9.27%) HDFS
3 132 (8.16%) Apache ZooKeeper
4 123 (7.60%) Apache Flume
5 6 (0.37%) VirtualBox
6 3 (0.19%) Active Directory
6 3 (0.19%) Hyper-V
7 2 (0.12%) Tivoli Workload Scheduler
8 1 (0.062%) Virtual Machines
8 1 (0.062%) Virtual Servers
8 1 (0.062%) VMware Infrastructure
Systems Management
1 184 (11.37%) Oozie
2 143 (8.84%) Hadoop YARN
3 117 (7.23%) Kubernetes
4 97 (6.00%) Terraform
5 88 (5.44%) Ansible
6 65 (4.02%) Opscode Chef
7 60 (3.71%) Ambari
8 48 (2.97%) Puppet
9 28 (1.73%) Nagios
10 22 (1.36%) Kibana
11 17 (1.05%) Mesos
12 11 (0.68%) Docker Swarm
13 10 (0.62%) Microsoft Intune
13 10 (0.62%) SCCM
14 8 (0.49%) Prometheus
15 7 (0.43%) logstash
16 6 (0.37%) Marathon
17 4 (0.25%) Control-M
18 2 (0.12%) Salt
18 2 (0.12%) Tivoli
Vendors
1 327 (20.21%) Cloudera
2 193 (11.93%) Google
3 188 (11.62%) Oracle
4 172 (10.63%) Tableau
5 166 (10.26%) Microsoft
6 163 (10.07%) Hortonworks
7 116 (7.17%) Databricks
8 92 (5.69%) Talend
9 86 (5.32%) MapR
10 74 (4.57%) Informatica
11 60 (3.71%) IBM
12 38 (2.35%) Red Hat
13 30 (1.85%) Teradata
14 27 (1.67%) Netezza
15 26 (1.61%) HP
15 26 (1.61%) SAP
16 25 (1.55%) TIBCO
17 24 (1.48%) Vertica
18 23 (1.42%) Splunk
18 23 (1.42%) Sybase