Period
to 14 August 2018

The median annual salary for a Hadoop Engineer was £75,000 in advertised job vacancies during the 6 months to 14 August 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
14 Aug 2018
Same period 2017 Same period 2016
Rank 1007 1040 1116
Rank change year-on-year +33 +76 +101
Permanent jobs requiring a Hadoop Engineer 162 156 154
As % of all permanent IT jobs advertised in the UK 0.096% 0.088% 0.078%
As % of the Job Titles category 0.099% 0.092% 0.080%
Number of salaries quoted 106 118 141
UK median annual salary £75,000 £65,000 £66,000
Median salary % change year-on-year +15.38% -1.52% +1.54%
10th Percentile £47,500 £45,000 £41,250
90th Percentile £92,500 £88,750 £103,750
UK excluding London median annual salary £57,500 £65,000 £47,500
% change year-on-year -11.54% +36.84% -19.15%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 163,107 170,225 191,964
% of permanent IT jobs with a recognized job title 96.17% 96.10% 96.62%
Number of salaries quoted 131,422 137,390 161,434
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £27,500 £27,500 £26,750
90th Percentile £81,250 £77,500 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 14 August 2018.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 11 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 14 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +68 152 £75,000 +15.38% 16
UK excluding London +43 78 £57,500 -11.54% 6
London -5 74 £80,000 +23.08% 10
South East +22 47 £67,500 -3.57% 1
Midlands - 15 £65,000 - 3
South West - 12 £50,000 - 1
East Midlands - 9 £75,000 - 3
West Midlands - 6 £52,500 -
North of England +17 4 £62,500 +8.70% 1
Yorkshire - 3 £65,000 -
North West -7 1 £45,000 -25.00% 1

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 14 August 2018, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Hadoop Engineer in the job title.

1 162 (100.00%) Hadoop
2 143 (88.27%) Big Data
3 118 (72.84%) Python
4 99 (61.11%) Apache Spark
5 94 (58.02%) Java
5 94 (58.02%) Scala
6 90 (55.56%) Apache Hive
7 87 (53.70%) Analytics
8 83 (51.23%) Kafka
9 79 (48.77%) Cloudera
10 76 (46.91%) Apache Flume
11 69 (42.59%) Impala
12 65 (40.12%) Agile Software Development
13 61 (37.65%) Continuous Integration
13 61 (37.65%) Jenkins
14 59 (36.42%) MapReduce
15 58 (35.80%) Hortonworks
16 57 (35.19%) Amazon AWS
17 54 (33.33%) Linux
18 53 (32.72%) ETL
19 49 (30.25%) Hadoop YARN
20 48 (29.63%) MLlib
20 48 (29.63%) Data Warehouse
20 48 (29.63%) Git (software)
21 45 (27.78%) SQL
22 43 (26.54%) Machine Learning
23 42 (25.93%) Sqoop
24 39 (24.07%) Deep Learning
25 38 (23.46%) HDFS
25 38 (23.46%) Data Engineering

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 99 (61.11%) Apache Spark
2 35 (21.60%) Elasticsearch
3 16 (9.88%) Apache
4 15 (9.26%) Apache Pig
5 11 (6.79%) Apache Solr
6 3 (1.85%) SAS
7 1 (0.62%) IIS
Cloud Services
1 57 (35.19%) Amazon AWS
2 28 (17.28%) Microsoft Azure
3 27 (16.67%) Amazon EMR
4 18 (11.11%) GitHub
5 14 (8.64%) Amazon Kinesis
6 11 (6.79%) Google Cloud Platform
7 9 (5.56%) Amazon EC2
7 9 (5.56%) Amazon S3
8 6 (3.70%) IBM Cloud
9 1 (0.62%) Cloud Computing
9 1 (0.62%) Heroku
9 1 (0.62%) SaaS
Communications & Networking
1 2 (1.23%) Kerberos
2 1 (0.62%) TCP/IP
Database & Business Intelligence
1 162 (100.00%) Hadoop
2 143 (88.27%) Big Data
3 90 (55.56%) Apache Hive
4 69 (42.59%) Impala
5 48 (29.63%) Data Warehouse
6 42 (25.93%) Sqoop
7 32 (19.75%) HBase
8 25 (15.43%) NoSQL
8 25 (15.43%) PostgreSQL
9 20 (12.35%) Amazon Redshift
10 19 (11.73%) Amazon Athena
11 17 (10.49%) Apache Cassandra
12 16 (9.88%) Flink
13 15 (9.26%) Power BI
14 13 (8.02%) Spotfire
15 12 (7.41%) BigQuery
15 12 (7.41%) Presto
16 7 (4.32%) Neo4j
17 6 (3.70%) Cosmos DB
17 6 (3.70%) Relational Database
Development Applications
1 61 (37.65%) Jenkins
2 48 (29.63%) Git (software)
3 36 (22.22%) TeamCity
4 13 (8.02%) JIRA
5 11 (6.79%) JUnit
6 6 (3.70%) Atlassian Bamboo
6 6 (3.70%) Vagrant
7 5 (3.09%) Cucumber
8 2 (1.23%) RStudio
8 2 (1.23%) SQL Server Management Studio (SSMS)
9 1 (0.62%) CasperJS
9 1 (0.62%) CircleCI
9 1 (0.62%) PhantomJS
General
1 16 (9.88%) Marketing
2 14 (8.64%) Finance
3 11 (6.79%) Banking
4 9 (5.56%) Games
5 7 (4.32%) Retail
6 6 (3.70%) Manufacturing
7 4 (2.47%) Electronics
8 3 (1.85%) Advertising
8 3 (1.85%) French Language
8 3 (1.85%) German Language
9 2 (1.23%) Investment Banking
Libraries, Frameworks & Software Standards
1 83 (51.23%) Kafka
2 48 (29.63%) MLlib
3 36 (22.22%) TensorFlow
4 35 (21.60%) Keras
5 14 (8.64%) Akka
6 12 (7.41%) Pandas
7 9 (5.56%) Web Services
8 6 (3.70%) Spark Streaming
9 5 (3.09%) Middleware
9 5 (3.09%) XML
10 4 (2.47%) RabbitMQ
11 2 (1.23%) PySpark
11 2 (1.23%) SPNEGO
12 1 (0.62%) D3.js
12 1 (0.62%) HTML
12 1 (0.62%) LAMP
12 1 (0.62%) Node.js
12 1 (0.62%) React
12 1 (0.62%) REST
12 1 (0.62%) SparkR
Miscellaneous
1 28 (17.28%) User Experience
2 18 (11.11%) Computer Science
3 17 (10.49%) Greenfield Project
4 12 (7.41%) Clustering
5 9 (5.56%) Self-Motivation
6 8 (4.94%) Analytical Skills
7 6 (3.70%) Blog
7 6 (3.70%) Data Structures
8 4 (2.47%) Public Cloud
9 2 (1.23%) Fintech
9 2 (1.23%) Linux Command Line
10 1 (0.62%) Data Centre
Operating Systems
1 54 (33.33%) Linux
2 13 (8.02%) Unix
3 8 (4.94%) Windows
Processes & Methodologies
1 87 (53.70%) Analytics
2 65 (40.12%) Agile Software Development
3 61 (37.65%) Continuous Integration
4 59 (36.42%) MapReduce
5 53 (32.72%) ETL
6 43 (26.54%) Machine Learning
7 39 (24.07%) Deep Learning
8 38 (23.46%) Data Engineering
8 38 (23.46%) Visualisation
9 36 (22.22%) DevOps
10 30 (18.52%) Data Visualisation
11 26 (16.05%) Software Delivery
12 25 (15.43%) Operations Research
13 24 (14.81%) Open Source
14 23 (14.20%) Data Analytics
15 20 (12.35%) Software Engineering
16 18 (11.11%) Business Intelligence
16 18 (11.11%) Data Science
16 18 (11.11%) Data Transformation
17 17 (10.49%) Low Latency
Programming Languages
1 118 (72.84%) Python
2 94 (58.02%) Java
2 94 (58.02%) Scala
3 45 (27.78%) SQL
4 37 (22.84%) Shell Script
5 36 (22.22%) Go
6 22 (13.58%) R
7 20 (12.35%) Bash Shell
8 18 (11.11%) C#
9 8 (4.94%) C
10 4 (2.47%) C++
11 3 (1.85%) MATLAB
11 3 (1.85%) Perl
11 3 (1.85%) T-SQL
12 1 (0.62%) Clojure
12 1 (0.62%) F#
12 1 (0.62%) Groovy
12 1 (0.62%) JavaScript
12 1 (0.62%) Ruby
Qualifications
1 13 (8.02%) Degree
2 8 (4.94%) DV Cleared
2 8 (4.94%) Security Cleared
3 5 (3.09%) Computer Science Degree
4 1 (0.62%) MCSA
4 1 (0.62%) MCSD
4 1 (0.62%) Microsoft Certification
Quality Assurance & Compliance
1 9 (5.56%) Data Quality
2 1 (0.62%) GDPR
System Software
1 76 (46.91%) Apache Flume
2 38 (23.46%) HDFS
3 21 (12.96%) Docker
4 8 (4.94%) Virtual Machines
5 6 (3.70%) VirtualBox
6 3 (1.85%) Active Directory
Systems Management
1 49 (30.25%) Hadoop YARN
2 16 (9.88%) Puppet
3 11 (6.79%) Kibana
4 9 (5.56%) Opscode Chef
5 8 (4.94%) Ansible
5 8 (4.94%) Kubernetes
6 6 (3.70%) Docker Swarm
6 6 (3.70%) Terraform
7 5 (3.09%) Oozie
8 2 (1.23%) Ambari
8 2 (1.23%) Grafana
8 2 (1.23%) logstash
8 2 (1.23%) Prometheus
Vendors
1 79 (48.77%) Cloudera
2 58 (35.80%) Hortonworks
3 22 (13.58%) Talend
4 20 (12.35%) Atlassian
5 17 (10.49%) Google
6 16 (9.88%) Tableau
7 14 (8.64%) Informatica
8 11 (6.79%) IBM
9 6 (3.70%) Microsoft
10 5 (3.09%) MuleSoft
11 4 (2.47%) Oracle
12 3 (1.85%) MapR
13 2 (1.23%) WorldPay
14 1 (0.62%) Alteryx
14 1 (0.62%) AppDynamics
14 1 (0.62%) Datameer
14 1 (0.62%) Greenplum
14 1 (0.62%) MicroStrategy
14 1 (0.62%) Paxata
14 1 (0.62%) Vertica