Period
to 19 September 2017

The median annual salary for a Hadoop Engineer was £65,000 in advertised job vacancies during the 6 months to 19 September 2017.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
19 Sep 2017
Same period 2016 Same period 2015
Rank 1043 1131 1201
Rank change year-on-year +88 +70 -32
Permanent jobs requiring a Hadoop Engineer 138 118 110
As % of all permanent IT jobs advertised in the UK 0.078% 0.061% 0.050%
As % of the Job Titles category 0.081% 0.063% 0.052%
Number of salaries quoted 102 105 97
UK median annual salary £65,000 £65,000 £65,000
10th Percentile £45,000 £39,750 £45,000
90th Percentile £88,750 £103,750 £90,000
UK excluding London median annual salary £65,000 £57,500 £60,000
% change year-on-year +13.04% -4.17% +50.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 169773 187120 211546
% of permanent IT jobs with a recognized job title 95.82% 96.47% 96.45%
Number of salaries quoted 136138 157303 175314
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% -
10th Percentile £27,500 £26,750 £26,250
90th Percentile £78,750 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £40,000
% change year-on-year - +6.25% -

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 19 September 2017.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 9 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 19 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +86 137 £65,000 -7.14% 15
London +28 94 £65,000 -7.14% 11
UK excluding London +60 35 £65,000 +13.04% 5
South East +80 17 £70,000 +86.67% 3
North of England -10 11 £60,000 +41.18% 1
North West - 11 £60,000 - 1
East of England +15 5 £35,000 -39.13%
South West +2 1 £50,000 -
Scotland -10 1 - - 1

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 19 September 2017, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads featuring Hadoop Engineer in the job title.

1 138 (100.00%) Hadoop
2 113 (81.88%) Big Data
3 106 (76.81%) Apache Spark
4 86 (62.32%) Java
5 83 (60.14%) Agile Software Development
6 79 (57.25%) Python
7 59 (42.75%) Scala
8 50 (36.23%) Kafka
8 50 (36.23%) Apache Hive
9 46 (33.33%) NoSQL
10 43 (31.16%) Analytics
11 38 (27.54%) HDFS
12 34 (24.64%) Apache Flume
13 33 (23.91%) Finance
14 31 (22.46%) Relational Database
15 30 (21.74%) Cloudera
15 30 (21.74%) MapReduce
15 30 (21.74%) SQL
16 28 (20.29%) ETL
16 28 (20.29%) TDD
17 26 (18.84%) Linux
18 25 (18.12%) Scrum
18 25 (18.12%) HBase
19 24 (17.39%) Amazon AWS
20 23 (16.67%) Apache Pig
20 23 (16.67%) Oozie
21 20 (14.49%) Use Case
22 19 (13.77%) Continuous Integration
22 19 (13.77%) Information Management
23 18 (13.04%) Data Management

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 106 (76.81%) Apache Spark
2 23 (16.67%) Apache Pig
3 14 (10.14%) Apache
4 9 (6.52%) Apache Solr
5 3 (2.17%) Confluence
5 3 (2.17%) Elasticsearch
6 2 (1.45%) GeoServer
7 1 (0.72%) OpenStack
7 1 (0.72%) SAS
Applications
1 1 (0.72%) Microsoft Excel
Cloud Services
1 24 (17.39%) Amazon AWS
2 16 (11.59%) Google Cloud Platform
3 9 (6.52%) Amazon S3
4 7 (5.07%) Microsoft Azure
5 5 (3.62%) Amazon EC2
5 5 (3.62%) Azure Data Factory
6 2 (1.45%) Cloud Computing
7 1 (0.72%) Amazon EMR
7 1 (0.72%) Amazon Kinesis
7 1 (0.72%) AWS Lambda
7 1 (0.72%) SaaS
Communications & Networking
1 5 (3.62%) Kerberos
2 2 (1.45%) SSL
Database & Business Intelligence
1 138 (100.00%) Hadoop
2 113 (81.88%) Big Data
3 50 (36.23%) Apache Hive
4 46 (33.33%) NoSQL
5 31 (22.46%) Relational Database
6 25 (18.12%) HBase
7 13 (9.42%) MongoDB
7 13 (9.42%) PostgreSQL
8 12 (8.70%) RDBMS
9 10 (7.25%) Sqoop
10 9 (6.52%) Apache Cassandra
10 9 (6.52%) Data Warehouse
11 8 (5.80%) Data Mining
11 8 (5.80%) Impala
12 5 (3.62%) Cloudera CDH
12 5 (3.62%) Data Lake
13 4 (2.90%) BigQuery
13 4 (2.90%) Pentaho
14 3 (2.17%) Amazon Redshift
14 3 (2.17%) SQL Server
Development Applications
1 10 (7.25%) Git (software)
2 9 (6.52%) Jenkins
2 9 (6.52%) JIRA
3 7 (5.07%) Talend Open Studio
4 6 (4.35%) Maven
4 6 (4.35%) Sonatype Nexus
5 4 (2.90%) Cucumber
6 2 (1.45%) Hudson
6 2 (1.45%) JUnit
7 1 (0.72%) Mercurial
7 1 (0.72%) Mockito
7 1 (0.72%) Selenium
7 1 (0.72%) Subversion
7 1 (0.72%) Travis CI
General
1 33 (23.91%) Finance
2 12 (8.70%) Banking
3 11 (7.97%) Marketing
4 10 (7.25%) Retail
5 9 (6.52%) Legal
6 7 (5.07%) Games
7 5 (3.62%) Investment Banking
8 4 (2.90%) Electronics
8 4 (2.90%) Manufacturing
8 4 (2.90%) Telecoms
9 1 (0.72%) Retail Banking
Libraries, Frameworks & Software Standards
1 50 (36.23%) Kafka
2 6 (4.35%) PySpark
2 6 (4.35%) Spring
2 6 (4.35%) Web Services
3 5 (3.62%) REST
3 5 (3.62%) Spring Boot
4 4 (2.90%) ActiveMQ
4 4 (2.90%) Dropwizard
4 4 (2.90%) Scalatra
5 3 (2.17%) Apache Camel
5 3 (2.17%) Drools
5 3 (2.17%) RabbitMQ
5 3 (2.17%) RESTful
6 2 (1.45%) CSS
6 2 (1.45%) Elastic Stack
6 2 (1.45%) GeoTools
6 2 (1.45%) HTML
6 2 (1.45%) JTS
6 2 (1.45%) Natural Language Processing
6 2 (1.45%) Node.js
Miscellaneous
1 14 (10.14%) Analytical Skills
2 9 (6.52%) Fintech
3 8 (5.80%) Algorithms
4 6 (4.35%) Greenfield Project
5 5 (3.62%) Blog
6 3 (2.17%) Computer Science
6 3 (2.17%) Credit Risk
6 3 (2.17%) Online Games
7 2 (1.45%) Market Risk
8 1 (0.72%) Data Structures
8 1 (0.72%) Digital Currency
8 1 (0.72%) Grid Computing
8 1 (0.72%) Hybrid Cloud
8 1 (0.72%) Management Information System
8 1 (0.72%) Public Cloud
Operating Systems
1 26 (18.84%) Linux
2 9 (6.52%) Unix
3 2 (1.45%) Windows
Processes & Methodologies
1 83 (60.14%) Agile Software Development
2 43 (31.16%) Analytics
3 30 (21.74%) MapReduce
4 28 (20.29%) ETL
4 28 (20.29%) TDD
5 25 (18.12%) Scrum
6 20 (14.49%) Use Case
7 19 (13.77%) Continuous Integration
7 19 (13.77%) Information Management
8 18 (13.04%) Business Analytics
8 18 (13.04%) Data Management
8 18 (13.04%) Requirements Analysis
8 18 (13.04%) Technical Architecture
8 18 (13.04%) Waterfall
9 16 (11.59%) Kanban
9 16 (11.59%) Machine Learning
9 16 (11.59%) Open Source
10 13 (9.42%) Business Intelligence
10 13 (9.42%) Software Engineering
11 11 (7.97%) Test Automation
Programming Languages
1 86 (62.32%) Java
2 79 (57.25%) Python
3 59 (42.75%) Scala
4 30 (21.74%) SQL
5 13 (9.42%) R
6 9 (6.52%) Bash Shell
6 9 (6.52%) C
7 8 (5.80%) C++
8 7 (5.07%) Perl
8 7 (5.07%) Shell Script
9 4 (2.90%) JavaScript
10 2 (1.45%) C#
10 2 (1.45%) Ruby
11 1 (0.72%) Go
11 1 (0.72%) Jython
11 1 (0.72%) VBA
Qualifications
1 3 (2.17%) Security Cleared
2 2 (1.45%) Degree
2 2 (1.45%) DV Cleared
3 1 (0.72%) Computer Science Degree
3 1 (0.72%) PhD
Quality Assurance & Compliance
1 5 (3.62%) QA
2 3 (2.17%) GCP
3 1 (0.72%) SLA
System Software
1 38 (27.54%) HDFS
2 34 (24.64%) Apache Flume
3 17 (12.32%) Docker
4 4 (2.90%) Apache ZooKeeper
5 1 (0.72%) etcd
5 1 (0.72%) flannel
Systems Management
1 23 (16.67%) Oozie
2 12 (8.70%) Mesos
3 9 (6.52%) Puppet
4 8 (5.80%) Ansible
4 8 (5.80%) Hadoop YARN
4 8 (5.80%) Kubernetes
5 5 (3.62%) Cobbler
6 4 (2.90%) Terraform
7 3 (2.17%) Opscode Chef
8 2 (1.45%) Prometheus
9 1 (0.72%) Packer
9 1 (0.72%) Salt
Vendors
1 30 (21.74%) Cloudera
2 16 (11.59%) Google
2 16 (11.59%) Hortonworks
3 9 (6.52%) MapR
4 7 (5.07%) Oracle
4 7 (5.07%) Talend
5 5 (3.62%) IBM
5 5 (3.62%) Informatica
5 5 (3.62%) Microsoft
5 5 (3.62%) SAP
6 2 (1.45%) Atlassian
6 2 (1.45%) Splunk
6 2 (1.45%) Teradata
6 2 (1.45%) Vertica
7 1 (0.72%) EXASOL
7 1 (0.72%) MicroStrategy