Period
to 21 June 2018

The median annual salary for a Hadoop Engineer was £75,000 in advertised job vacancies during the 6 months to 21 June 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
21 Jun 2018
Same period 2017 Same period 2016
Rank 1029 1063 1108
Rank change year-on-year +34 +45 +96
Permanent jobs requiring a Hadoop Engineer 167 132 168
As % of all permanent IT jobs advertised in the UK 0.097% 0.077% 0.084%
As % of the Job Titles category 0.10% 0.079% 0.086%
Number of salaries quoted 116 104 156
UK median annual salary £75,000 £70,000 £67,500
Median salary % change year-on-year +7.14% +3.70% +10.20%
10th Percentile £47,500 £50,000 £41,250
90th Percentile £92,500 £88,000 £96,250
UK excluding London median annual salary £52,500 £65,000 £45,000
% change year-on-year -19.23% +44.44% -14.29%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 166,189 166,064 194,291
% of permanent IT jobs with a recognized job title 96.33% 96.24% 96.61%
Number of salaries quoted 135,115 136,769 163,202
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £27,500 £27,500 £26,500
90th Percentile £80,000 £77,500 £76,250
UK excluding London median annual salary £45,000 £42,500 £42,000
% change year-on-year +5.88% +1.19% +5.00%

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 21 June 2018.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 12 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 21 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +33 152 £75,000 +7.14% 18
UK excluding London +41 83 £52,500 -19.23% 6
London -25 70 £80,000 +14.29% 13
South East +35 47 £62,750 -3.46% 1
South West - 18 £50,000 -
East of England +6 7 £75,000 +57.89%
Midlands - 7 £52,500 - 1
West Midlands - 6 £52,500 - 1
North of England +5 3 £47,500 -22.45% 3
Yorkshire - 3 £47,500 -
Scotland -35 1 - - 1
East Midlands - 1 £70,000 -

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 21 June 2018, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Hadoop Engineer in the job title.

1 167 (100.00%) Hadoop
2 157 (94.01%) Big Data
3 118 (70.66%) Python
4 110 (65.87%) Apache Spark
5 101 (60.48%) Apache Hive
5 101 (60.48%) Scala
6 100 (59.88%) Java
7 93 (55.69%) Kafka
7 93 (55.69%) Analytics
8 92 (55.09%) Cloudera
9 87 (52.10%) Apache Flume
10 86 (51.50%) Impala
11 75 (44.91%) Agile Software Development
12 73 (43.71%) MapReduce
13 69 (41.32%) ETL
14 68 (40.72%) Hortonworks
15 64 (38.32%) Continuous Integration
16 62 (37.13%) Jenkins
17 56 (33.53%) Amazon AWS
18 55 (32.93%) Data Warehouse
19 53 (31.74%) Linux
19 53 (31.74%) MLlib
20 52 (31.14%) Hadoop YARN
21 50 (29.94%) Git (software)
22 49 (29.34%) Machine Learning
23 48 (28.74%) Visualisation
24 46 (27.54%) Elasticsearch
25 44 (26.35%) HDFS
25 44 (26.35%) SQL
26 43 (25.75%) Sqoop

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 110 (65.87%) Apache Spark
2 46 (27.54%) Elasticsearch
3 28 (16.77%) Apache Pig
4 20 (11.98%) Apache Solr
5 16 (9.58%) Apache
6 3 (1.80%) Confluence
6 3 (1.80%) SAS
7 1 (0.60%) IIS
Applications
1 2 (1.20%) Microsoft PowerPoint
Cloud Services
1 56 (33.53%) Amazon AWS
2 36 (21.56%) Microsoft Azure
3 28 (16.77%) GitHub
4 24 (14.37%) Amazon EMR
5 19 (11.38%) Amazon Kinesis
6 9 (5.39%) Google Cloud Platform
7 6 (3.59%) IBM Cloud
8 2 (1.20%) Cloud Computing
8 2 (1.20%) Heroku
9 1 (0.60%) Amazon S3
9 1 (0.60%) AWS Lambda
9 1 (0.60%) SaaS
Communications & Networking
1 3 (1.80%) Kerberos
2 1 (0.60%) HTTP
2 1 (0.60%) SSL
Database & Business Intelligence
1 167 (100.00%) Hadoop
2 157 (94.01%) Big Data
3 101 (60.48%) Apache Hive
4 86 (51.50%) Impala
5 55 (32.93%) Data Warehouse
6 43 (25.75%) Sqoop
7 40 (23.95%) HBase
8 33 (19.76%) NoSQL
9 32 (19.16%) Apache Cassandra
10 27 (16.17%) Amazon Redshift
11 25 (14.97%) Amazon Athena
12 23 (13.77%) PostgreSQL
13 21 (12.57%) BigQuery
14 19 (11.38%) Spotfire
15 18 (10.78%) Power BI
15 18 (10.78%) Presto
16 15 (8.98%) Flink
17 14 (8.38%) MongoDB
18 11 (6.59%) RDBMS
18 11 (6.59%) Relational Database
Development Applications
1 62 (37.13%) Jenkins
2 50 (29.94%) Git (software)
3 37 (22.16%) TeamCity
4 23 (13.77%) JIRA
5 13 (7.78%) JUnit
6 8 (4.79%) Cucumber
7 6 (3.59%) Atlassian Bamboo
7 6 (3.59%) Vagrant
8 2 (1.20%) CasperJS
8 2 (1.20%) CircleCI
8 2 (1.20%) PhantomJS
8 2 (1.20%) RStudio
9 1 (0.60%) GitLab
9 1 (0.60%) Maven
General
1 23 (13.77%) Marketing
2 11 (6.59%) Electronics
3 7 (4.19%) Manufacturing
4 6 (3.59%) Finance
4 6 (3.59%) Games
4 6 (3.59%) Retail
5 2 (1.20%) Advertising
6 1 (0.60%) Banking
6 1 (0.60%) Investment Banking
6 1 (0.60%) Telecoms
Libraries, Frameworks & Software Standards
1 93 (55.69%) Kafka
2 53 (31.74%) MLlib
3 35 (20.96%) TensorFlow
4 34 (20.36%) Keras
5 18 (10.78%) Pandas
6 12 (7.19%) Akka
7 11 (6.59%) RabbitMQ
8 9 (5.39%) Web Services
9 8 (4.79%) Middleware
9 8 (4.79%) XML
10 7 (4.19%) Spark Streaming
11 6 (3.59%) HTML
12 4 (2.40%) REST
13 3 (1.80%) CSS
14 2 (1.20%) Node.js
14 2 (1.20%) React
14 2 (1.20%) Ruby on Rails
14 2 (1.20%) SPNEGO
15 1 (0.60%) D3.js
15 1 (0.60%) JSON
Miscellaneous
1 31 (18.56%) User Experience
2 18 (10.78%) Clustering
2 18 (10.78%) Greenfield Project
3 13 (7.78%) Computer Science
4 9 (5.39%) Analytical Skills
5 7 (4.19%) Self-Motivation
6 6 (3.59%) Blog
7 3 (1.80%) Fintech
8 2 (1.20%) Linux Command Line
9 1 (0.60%) Algorithms
9 1 (0.60%) Data Structures
Operating Systems
1 53 (31.74%) Linux
2 17 (10.18%) Unix
3 5 (2.99%) Windows
4 2 (1.20%) Red Hat Enterprise Linux
Processes & Methodologies
1 93 (55.69%) Analytics
2 75 (44.91%) Agile Software Development
3 73 (43.71%) MapReduce
4 69 (41.32%) ETL
5 64 (38.32%) Continuous Integration
6 49 (29.34%) Machine Learning
7 48 (28.74%) Visualisation
8 43 (25.75%) Data Visualisation
9 40 (23.95%) DevOps
10 37 (22.16%) Deep Learning
11 32 (19.16%) Open Source
12 31 (18.56%) Data Analytics
12 31 (18.56%) Data Engineering
13 28 (16.77%) Software Engineering
14 24 (14.37%) Business Intelligence
14 24 (14.37%) Data Science
14 24 (14.37%) Operations Research
14 24 (14.37%) Scrum
15 23 (13.77%) Software Delivery
16 20 (11.98%) Data Transformation
Programming Languages
1 118 (70.66%) Python
2 101 (60.48%) Scala
3 100 (59.88%) Java
4 44 (26.35%) SQL
5 37 (22.16%) Go
5 37 (22.16%) Shell Script
6 28 (16.77%) C#
7 21 (12.57%) R
8 15 (8.98%) Bash Shell
9 6 (3.59%) JavaScript
10 5 (2.99%) C
11 3 (1.80%) Perl
12 2 (1.20%) Ruby
13 1 (0.60%) Clojure
13 1 (0.60%) F#
13 1 (0.60%) Groovy
13 1 (0.60%) PowerShell
13 1 (0.60%) T-SQL
Qualifications
1 8 (4.79%) Degree
2 5 (2.99%) DV Cleared
2 5 (2.99%) Security Cleared
3 2 (1.20%) AWS Certification
3 2 (1.20%) Computer Science Degree
3 2 (1.20%) Microsoft Certification
4 1 (0.60%) Master's Degree
4 1 (0.60%) MCSA
4 1 (0.60%) MCSD
4 1 (0.60%) Numerate Degree
Quality Assurance & Compliance
1 7 (4.19%) Data Quality
2 1 (0.60%) GCP
System Software
1 87 (52.10%) Apache Flume
2 44 (26.35%) HDFS
3 34 (20.36%) Docker
4 6 (3.59%) VirtualBox
5 5 (2.99%) Virtual Machines
6 2 (1.20%) Active Directory
7 1 (0.60%) Apache ZooKeeper
Systems Management
1 52 (31.14%) Hadoop YARN
2 15 (8.98%) Puppet
3 9 (5.39%) Ansible
3 9 (5.39%) Kubernetes
4 6 (3.59%) Docker Swarm
4 6 (3.59%) Kibana
4 6 (3.59%) Oozie
4 6 (3.59%) Terraform
5 2 (1.20%) Ambari
5 2 (1.20%) Prometheus
6 1 (0.60%) Grafana
6 1 (0.60%) logstash
6 1 (0.60%) Mesos
6 1 (0.60%) Opscode Chef
Vendors
1 92 (55.09%) Cloudera
2 68 (40.72%) Hortonworks
3 28 (16.77%) Tableau
4 24 (14.37%) Talend
5 23 (13.77%) Atlassian
6 17 (10.18%) Google
6 17 (10.18%) Informatica
7 14 (8.38%) IBM
8 11 (6.59%) Microsoft
9 10 (5.99%) MapR
10 8 (4.79%) MuleSoft
11 4 (2.40%) Greenplum
12 2 (1.20%) Red Hat
12 2 (1.20%) WorldPay
13 1 (0.60%) Alteryx
13 1 (0.60%) AppDynamics
13 1 (0.60%) Datameer
13 1 (0.60%) MicroStrategy
13 1 (0.60%) Splunk
13 1 (0.60%) Vertica