Period
to 19 October 2018

The median annual salary for a Hadoop Engineer was £76,400 in advertised job vacancies during the 6 months to 19 October 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
19 Oct 2018
Same period 2017 Same period 2016
Rank 997 1077 1143
Rank change year-on-year +80 +66 +66
Permanent jobs requiring a Hadoop Engineer 145 122 100
As % of all permanent IT jobs advertised in the UK 0.088% 0.070% 0.052%
As % of the Job Titles category 0.092% 0.073% 0.054%
Number of salaries quoted 105 92 84
UK median annual salary £76,400 £65,000 £65,000
Median salary % change year-on-year +17.54% - -3.70%
10th Percentile £52,500 £42,975 £42,500
90th Percentile £92,500 £89,875 £98,000
UK excluding London median annual salary £65,000 £65,000 £60,000
% change year-on-year - +8.33% -17.24%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 158,047 167,700 184,728
% of permanent IT jobs with a recognized job title 95.92% 95.94% 96.56%
Number of salaries quoted 127,340 134,271 154,809
UK median annual salary £50,000 £48,000 £47,500
Median salary % change year-on-year +4.17% +1.05% +5.56%
10th Percentile £27,500 £27,500 £26,750
90th Percentile £82,500 £78,750 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 19 October 2018.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 12 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 19 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +65 143 £75,000 +15.38% 13
London +28 80 £80,000 +23.08% 8
UK excluding London +60 63 £65,000 - 5
South East +14 32 £45,000 -35.71% 1
Midlands - 17 £65,000 -
East Midlands - 12 £72,500 -
North of England +25 8 £76,400 +42.80% 1
North West +5 5 £76,400 +42.80%
South West +2 5 £49,250 -1.50% 2
West Midlands - 5 £52,500 -
Yorkshire - 3 £65,000 - 1
East of England +21 1 £60,000 +71.43% 1

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 19 October 2018, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Hadoop Engineer in the job title.

1 145 (100.00%) Hadoop
2 119 (82.07%) Big Data
3 104 (71.72%) Python
4 93 (64.14%) Apache Spark
5 79 (54.48%) Scala
6 78 (53.79%) Apache Hive
7 76 (52.41%) Java
8 68 (46.90%) Kafka
9 64 (44.14%) Cloudera
10 61 (42.07%) Analytics
11 57 (39.31%) SQL
12 51 (35.17%) Apache Flume
13 49 (33.79%) Amazon AWS
14 45 (31.03%) Agile Software Development
15 43 (29.66%) Continuous Integration
16 42 (28.97%) Hortonworks
16 42 (28.97%) Jenkins
16 42 (28.97%) Impala
17 41 (28.28%) Machine Learning
18 39 (26.90%) ETL
19 38 (26.21%) Linux
19 38 (26.21%) MapReduce
20 34 (23.45%) NoSQL
20 34 (23.45%) Git (software)
21 33 (22.76%) Hadoop YARN
21 33 (22.76%) Data Engineering
22 32 (22.07%) HBase
23 30 (20.69%) Visualisation
24 29 (20.00%) Data Warehouse
24 29 (20.00%) MLlib

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 93 (64.14%) Apache Spark
2 25 (17.24%) Elasticsearch
3 13 (8.97%) Apache
3 13 (8.97%) Apache Pig
4 7 (4.83%) Apache Solr
5 2 (1.38%) SAS
6 1 (0.69%) IIS
Cloud Services
1 49 (33.79%) Amazon AWS
2 24 (16.55%) Microsoft Azure
3 23 (15.86%) Amazon EMR
4 20 (13.79%) Google Cloud Platform
5 14 (9.66%) Amazon S3
6 12 (8.28%) Amazon EC2
7 6 (4.14%) IBM Cloud
8 5 (3.45%) Amazon Kinesis
9 4 (2.76%) Amazon SageMaker
10 3 (2.07%) GitHub
11 2 (1.38%) AWS Data Pipeline
11 2 (1.38%) AWS Lambda
11 2 (1.38%) SaaS
Communications & Networking
1 1 (0.69%) TCP/IP
Database & Business Intelligence
1 145 (100.00%) Hadoop
2 119 (82.07%) Big Data
3 78 (53.79%) Apache Hive
4 42 (28.97%) Impala
5 34 (23.45%) NoSQL
6 32 (22.07%) HBase
7 29 (20.00%) Data Warehouse
8 28 (19.31%) Sqoop
9 19 (13.10%) Apache Cassandra
10 15 (10.34%) PostgreSQL
11 14 (9.66%) Flink
12 12 (8.28%) SQL Server
13 11 (7.59%) Amazon Redshift
14 10 (6.90%) Amazon Athena
14 10 (6.90%) Relational Database
15 8 (5.52%) SQL Server Integration Services
16 7 (4.83%) Power BI
17 6 (4.14%) Cosmos DB
17 6 (4.14%) Neo4j
17 6 (4.14%) SQL Server Reporting Services
Development Applications
1 42 (28.97%) Jenkins
2 34 (23.45%) Git (software)
3 22 (15.17%) TeamCity
4 6 (4.14%) Atlassian Bamboo
4 6 (4.14%) JUnit
4 6 (4.14%) Vagrant
5 4 (2.76%) SQL Server Management Studio (SSMS)
6 3 (2.07%) JIRA
6 3 (2.07%) RStudio
7 2 (1.38%) Ant
7 2 (1.38%) Gradle
7 2 (1.38%) Maven
8 1 (0.69%) CircleCI
8 1 (0.69%) Octopus Deploy
General
1 25 (17.24%) Finance
2 18 (12.41%) Banking
3 12 (8.28%) Marketing
4 9 (6.21%) Games
4 9 (6.21%) Law
4 9 (6.21%) Military
5 7 (4.83%) Retail
6 6 (4.14%) Manufacturing
7 4 (2.76%) French Language
7 4 (2.76%) German Language
8 2 (1.38%) Advertising
8 2 (1.38%) Investment Banking
9 1 (0.69%) Automotive
Libraries, Frameworks & Software Standards
1 68 (46.90%) Kafka
2 29 (20.00%) MLlib
3 22 (15.17%) TensorFlow
4 21 (14.48%) Keras
5 9 (6.21%) Akka
6 7 (4.83%) Spark Streaming
6 7 (4.83%) Web Services
7 6 (4.14%) PySpark
8 4 (2.76%) J2EE
8 4 (2.76%) RabbitMQ
9 3 (2.07%) Pandas
9 3 (2.07%) scikit-learn
10 2 (1.38%) Elastic Stack
10 2 (1.38%) HTML
10 2 (1.38%) Middleware
10 2 (1.38%) Rendezvous
11 1 (0.69%) gRPC
11 1 (0.69%) LAMP
11 1 (0.69%) REST
11 1 (0.69%) SparkR
Miscellaneous
1 16 (11.03%) Computer Science
2 15 (10.34%) User Experience
3 14 (9.66%) Data Structures
4 12 (8.28%) Greenfield Project
5 9 (6.21%) Analytical Skills
6 7 (4.83%) Self-Motivation
7 6 (4.14%) Blog
8 5 (3.45%) Algorithms
8 5 (3.45%) Public Cloud
9 3 (2.07%) Clustering
10 2 (1.38%) Enterprise Software
11 1 (0.69%) Data Centre
11 1 (0.69%) Fintech
Operating Systems
1 38 (26.21%) Linux
2 9 (6.21%) Unix
3 8 (5.52%) Windows
Processes & Methodologies
1 61 (42.07%) Analytics
2 45 (31.03%) Agile Software Development
3 43 (29.66%) Continuous Integration
4 41 (28.28%) Machine Learning
5 39 (26.90%) ETL
6 38 (26.21%) MapReduce
7 33 (22.76%) Data Engineering
8 30 (20.69%) Visualisation
9 27 (18.62%) DevOps
10 26 (17.93%) Deep Learning
11 22 (15.17%) Data Visualisation
12 20 (13.79%) Data Science
12 20 (13.79%) Software Engineering
13 17 (11.72%) Software Delivery
14 15 (10.34%) Configuration Management
14 15 (10.34%) Low Latency
14 15 (10.34%) Open Source
14 15 (10.34%) Operations Research
15 14 (9.66%) Data Analysis
15 14 (9.66%) Data Modelling
Programming Languages
1 104 (71.72%) Python
2 79 (54.48%) Scala
3 76 (52.41%) Java
4 57 (39.31%) SQL
5 22 (15.17%) Shell Script
6 21 (14.48%) Go
6 21 (14.48%) R
7 20 (13.79%) Bash Shell
8 8 (5.52%) C
9 5 (3.45%) C++
9 5 (3.45%) T-SQL
10 4 (2.76%) C#
10 4 (2.76%) MATLAB
11 3 (2.07%) Perl
12 2 (1.38%) Groovy
Qualifications
1 14 (9.66%) Degree
2 8 (5.52%) DV Cleared
2 8 (5.52%) Security Cleared
3 6 (4.14%) Computer Science Degree
Quality Assurance & Compliance
1 6 (4.14%) Data Quality
2 2 (1.38%) MiFID
3 1 (0.69%) GDPR
System Software
1 51 (35.17%) Apache Flume
2 26 (17.93%) HDFS
3 16 (11.03%) Docker
4 8 (5.52%) Virtual Machines
5 6 (4.14%) VirtualBox
6 3 (2.07%) Apache ZooKeeper
7 1 (0.69%) Active Directory
Systems Management
1 33 (22.76%) Hadoop YARN
2 13 (8.97%) Kibana
3 11 (7.59%) Puppet
4 10 (6.90%) Kubernetes
5 9 (6.21%) Ansible
5 9 (6.21%) Opscode Chef
6 6 (4.14%) Docker Swarm
6 6 (4.14%) Terraform
7 4 (2.76%) logstash
8 2 (1.38%) Ambari
8 2 (1.38%) Grafana
8 2 (1.38%) Nagios
8 2 (1.38%) Oozie
8 2 (1.38%) Prometheus
Vendors
1 64 (44.14%) Cloudera
2 42 (28.97%) Hortonworks
3 20 (13.79%) Talend
4 17 (11.72%) Google
5 11 (7.59%) Atlassian
6 9 (6.21%) Informatica
6 9 (6.21%) Oracle
6 9 (6.21%) Tableau
7 7 (4.83%) MapR
8 6 (4.14%) IBM
9 4 (2.76%) Teradata
10 2 (1.38%) Alteryx
10 2 (1.38%) Solace
10 2 (1.38%) TIBCO
11 1 (0.69%) Datameer
11 1 (0.69%) Microsoft
11 1 (0.69%) MicroStrategy
11 1 (0.69%) Paxata
11 1 (0.69%) Vertica