Period
to 22 February 2018

The median annual salary for a Hadoop Engineer was £70,000 in advertised job vacancies during the 6 months to 22 February 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
22 Feb 2018
Same period 2017 Same period 2016
Rank 1058 1104 1149
Rank change year-on-year +46 +45 +70
Permanent jobs requiring a Hadoop Engineer 134 81 142
As % of all permanent IT jobs advertised in the UK 0.076% 0.046% 0.068%
As % of the Job Titles category 0.079% 0.048% 0.070%
Number of salaries quoted 115 65 127
UK median annual salary £70,000 £70,000 £70,000
10th Percentile £47,500 £45,750 £52,500
90th Percentile £95,000 £87,000 £93,850
UK excluding London median annual salary £58,000 £55,000 £52,500
% change year-on-year +5.45% +4.76% -12.50%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 169,468 169,423 202,837
% of permanent IT jobs with a recognized job title 96.25% 96.48% 96.65%
Number of salaries quoted 138,985 140,739 169,592
UK median annual salary £50,000 £47,500 £46,309
Median salary % change year-on-year +5.26% +2.57% +2.91%
10th Percentile £27,500 £27,000 £26,750
90th Percentile £80,000 £77,500 £76,000
UK excluding London median annual salary £42,500 £42,500 £42,000
% change year-on-year - +1.19% +5.00%

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 22 February 2018.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 11 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 22 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +47 127 £70,000 - 23
London -3 71 £78,500 +12.14% 11
UK excluding London +53 57 £58,000 +5.45% 13
South East +26 25 £65,000 +15.56% 4
South West - 16 £50,000 - 2
East of England +16 10 £75,000 +25.00%
North of England +7 3 £47,500 -7.32% 4
Yorkshire - 3 £47,500 - 2
Midlands - 2 £58,750 - 2
West Midlands - 2 £58,750 - 2
Scotland -31 1 - - 1

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 22 February 2018, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Hadoop Engineer in the job title.

1 134 (100.00%) Hadoop
2 115 (85.82%) Big Data
3 100 (74.63%) Apache Spark
4 84 (62.69%) Python
5 75 (55.97%) Apache Hive
6 71 (52.99%) Java
7 67 (50.00%) Scala
8 64 (47.76%) Apache Flume
9 61 (45.52%) Impala
10 59 (44.03%) Cloudera
11 58 (43.28%) Agile Software Development
12 56 (41.79%) Kafka
13 51 (38.06%) SQL
14 50 (37.31%) Analytics
15 47 (35.07%) HBase
15 47 (35.07%) ETL
16 45 (33.58%) MapReduce
17 44 (32.84%) Elasticsearch
18 43 (32.09%) Amazon AWS
19 42 (31.34%) Apache Cassandra
20 38 (28.36%) Visualisation
21 37 (27.61%) Docker
22 36 (26.87%) NoSQL
23 35 (26.12%) Data Visualisation
24 34 (25.37%) Open Source
25 33 (24.63%) Hadoop YARN
25 33 (24.63%) Software Engineering
26 32 (23.88%) DevOps
27 31 (23.13%) Apache Pig
27 31 (23.13%) Hortonworks

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 100 (74.63%) Apache Spark
2 44 (32.84%) Elasticsearch
3 31 (23.13%) Apache Pig
4 26 (19.40%) Apache Solr
5 15 (11.19%) Apache
6 3 (2.24%) Cloud Foundry
6 3 (2.24%) Confluence
6 3 (2.24%) OpenStack
7 1 (0.75%) GeoServer
Applications
1 2 (1.49%) Microsoft PowerPoint
Cloud Services
1 43 (32.09%) Amazon AWS
2 30 (22.39%) Microsoft Azure
3 21 (15.67%) GitHub
4 16 (11.94%) Amazon Kinesis
5 15 (11.19%) Amazon EMR
6 9 (6.72%) Google Cloud Platform
7 3 (2.24%) Amazon S3
7 3 (2.24%) Cloud Computing
8 2 (1.49%) Azure Data Factory
8 2 (1.49%) Heroku
9 1 (0.75%) Amazon EC2
9 1 (0.75%) Amazon SQS
9 1 (0.75%) AWS Data Pipeline
9 1 (0.75%) AWS Lambda
Communications & Networking
1 3 (2.24%) Kerberos
2 2 (1.49%) SSL
3 1 (0.75%) HTTP
Database & Business Intelligence
1 134 (100.00%) Hadoop
2 115 (85.82%) Big Data
3 75 (55.97%) Apache Hive
4 61 (45.52%) Impala
5 47 (35.07%) HBase
6 42 (31.34%) Apache Cassandra
7 36 (26.87%) NoSQL
8 26 (19.40%) Data Warehouse
9 22 (16.42%) Sqoop
10 20 (14.93%) Flink
11 19 (14.18%) Amazon Redshift
11 19 (14.18%) BigQuery
11 19 (14.18%) MongoDB
12 16 (11.94%) Presto
12 16 (11.94%) Relational Database
13 15 (11.19%) RDBMS
14 14 (10.45%) Amazon Athena
14 14 (10.45%) Power BI
14 14 (10.45%) Spotfire
15 9 (6.72%) PostgreSQL
Development Applications
1 30 (22.39%) Jenkins
2 22 (16.42%) Git (software)
3 19 (14.18%) JIRA
4 12 (8.96%) TeamCity
5 7 (5.22%) JUnit
6 6 (4.48%) Cucumber
7 5 (3.73%) Maven
8 4 (2.99%) Sonatype Nexus
9 2 (1.49%) CasperJS
9 2 (1.49%) CircleCI
9 2 (1.49%) PhantomJS
9 2 (1.49%) Vagrant
10 1 (0.75%) GitLab
10 1 (0.75%) Mockito
10 1 (0.75%) Selenium
General
1 19 (14.18%) Electronics
2 18 (13.43%) Marketing
3 16 (11.94%) Finance
4 9 (6.72%) Banking
5 6 (4.48%) Telecoms
6 5 (3.73%) Manufacturing
7 3 (2.24%) Games
7 3 (2.24%) Publishing
7 3 (2.24%) Retail
8 2 (1.49%) Investment Banking
8 2 (1.49%) Legal
Libraries, Frameworks & Software Standards
1 56 (41.79%) Kafka
2 23 (17.16%) MLlib
3 15 (11.19%) Pandas
4 11 (8.21%) RabbitMQ
5 10 (7.46%) Spark Streaming
6 9 (6.72%) Keras
6 9 (6.72%) TensorFlow
7 6 (4.48%) HTML
7 6 (4.48%) XML
8 5 (3.73%) Middleware
9 4 (2.99%) CSS
9 4 (2.99%) REST
9 4 (2.99%) Web Services
10 3 (2.24%) Natural Language Processing
11 2 (1.49%) Akka
11 2 (1.49%) JSON
11 2 (1.49%) Node.js
11 2 (1.49%) React
11 2 (1.49%) Ruby on Rails
11 2 (1.49%) Spring
Miscellaneous
1 18 (13.43%) User Experience
2 14 (10.45%) Clustering
3 13 (9.70%) Analytical Skills
4 9 (6.72%) Computer Science
5 8 (5.97%) Greenfield Project
6 6 (4.48%) Algorithms
7 5 (3.73%) Hybrid Cloud
8 4 (2.99%) Fintech
9 3 (2.24%) Hedge funds
10 2 (1.49%) Linux Command Line
10 2 (1.49%) Social Network
11 1 (0.75%) Credit Risk
11 1 (0.75%) Data Centre
11 1 (0.75%) Data Structures
Operating Systems
1 30 (22.39%) Linux
2 23 (17.16%) Unix
3 2 (1.49%) Red Hat Enterprise Linux
3 2 (1.49%) Windows
Processes & Methodologies
1 58 (43.28%) Agile Software Development
2 50 (37.31%) Analytics
3 47 (35.07%) ETL
4 45 (33.58%) MapReduce
5 38 (28.36%) Visualisation
6 35 (26.12%) Data Visualisation
7 34 (25.37%) Open Source
8 33 (24.63%) Software Engineering
9 32 (23.88%) DevOps
10 31 (23.13%) Continuous Integration
11 26 (19.40%) Business Intelligence
11 26 (19.40%) Machine Learning
12 25 (18.66%) Data Science
13 24 (17.91%) Data Analytics
14 22 (16.42%) TDD
15 20 (14.93%) Scrum
16 18 (13.43%) Continuous Delivery
17 16 (11.94%) Coaching
18 14 (10.45%) Deep Learning
19 13 (9.70%) Data Engineering
Programming Languages
1 84 (62.69%) Python
2 71 (52.99%) Java
3 67 (50.00%) Scala
4 51 (38.06%) SQL
5 24 (17.91%) C#
6 18 (13.43%) Bash Shell
7 14 (10.45%) Shell Script
8 12 (8.96%) Go
9 11 (8.21%) R
10 8 (5.97%) JavaScript
11 7 (5.22%) Ruby
12 5 (3.73%) C++
13 4 (2.99%) C
14 3 (2.24%) Perl
15 2 (1.49%) Groovy
16 1 (0.75%) PowerShell
Qualifications
1 7 (5.22%) Degree
2 4 (2.99%) Computer Science Degree
3 3 (2.24%) Security Cleared
4 2 (1.49%) AWS Certification
4 2 (1.49%) DV Cleared
5 1 (0.75%) Master's Degree
5 1 (0.75%) Microsoft Certification
5 1 (0.75%) Numerate Degree
5 1 (0.75%) PhD
Quality Assurance & Compliance
1 4 (2.99%) QA
2 2 (1.49%) Data Quality
2 2 (1.49%) SLA
3 1 (0.75%) GCP
System Software
1 64 (47.76%) Apache Flume
2 37 (27.61%) Docker
3 30 (22.39%) HDFS
4 5 (3.73%) Apache ZooKeeper
5 2 (1.49%) Virtual Machines
6 1 (0.75%) Active Directory
Systems Management
1 33 (24.63%) Hadoop YARN
2 16 (11.94%) Puppet
3 14 (10.45%) Kubernetes
4 8 (5.97%) Ansible
5 6 (4.48%) Opscode Chef
6 4 (2.99%) Mesos
6 4 (2.99%) Oozie
7 2 (1.49%) Kibana
7 2 (1.49%) Prometheus
7 2 (1.49%) Terraform
8 1 (0.75%) Ambari
Vendors
1 59 (44.03%) Cloudera
2 31 (23.13%) Hortonworks
3 26 (19.40%) Tableau
4 16 (11.94%) Atlassian
5 13 (9.70%) Google
5 13 (9.70%) MapR
6 8 (5.97%) Microsoft
6 8 (5.97%) Talend
7 7 (5.22%) SAP
8 6 (4.48%) Informatica
9 5 (3.73%) Greenplum
9 5 (3.73%) IBM
9 5 (3.73%) MuleSoft
10 4 (2.99%) EXASOL
10 4 (2.99%) Splunk
11 3 (2.24%) Oracle
12 2 (1.49%) Netezza
12 2 (1.49%) Red Hat
12 2 (1.49%) Vertica
13 1 (0.75%) WorldPay