Period
to 23 November 2017

The median annual salary for a Hadoop Engineer was £65,000 in advertised job vacancies during the 6 months to 23 November 2017.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
23 Nov 2017
Same period 2016 Same period 2015
Rank 1059 1147 1184
Rank change year-on-year +88 +37 +29
Permanent jobs requiring a Hadoop Engineer 130 90 112
As % of all permanent IT jobs advertised in the UK 0.072% 0.047% 0.051%
As % of the Job Titles category 0.075% 0.049% 0.053%
Number of salaries quoted 101 74 103
UK median annual salary £65,000 £68,750 £70,000
Median salary % change year-on-year -5.45% -1.79% +6.06%
10th Percentile £45,000 £44,125 £52,500
90th Percentile £91,250 £96,250 £92,500
UK excluding London median annual salary £51,250 £60,000 £72,500
% change year-on-year -14.58% -17.24% +61.11%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 172559 183130 209788
% of permanent IT jobs with a recognized job title 95.79% 96.48% 96.46%
Number of salaries quoted 138476 153185 174290
UK median annual salary £48,000 £47,500 £45,000
Median salary % change year-on-year +1.05% +5.56% -
10th Percentile £27,500 £27,000 £26,250
90th Percentile £78,750 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £41,000
% change year-on-year - +3.66% +2.50%

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 23 November 2017.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 8 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 23 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +88 129 £65,000 -7.14% 12
London +28 90 £70,000 - 10
UK excluding London +57 33 £51,250 -14.58% 2
South East +49 19 £70,000 -3.45%
North West - 5 £50,000 -
North of England - 5 £50,000 -
East of England - 5 £35,000 -
South West +11 4 £50,000 - 2

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 23 November 2017, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads featuring Hadoop Engineer in the job title.

1 130 (100.00%) Hadoop
2 106 (81.54%) Big Data
3 101 (77.69%) Apache Spark
4 77 (59.23%) Java
5 72 (55.38%) Python
6 70 (53.85%) Agile Software Development
7 60 (46.15%) Scala
8 47 (36.15%) Kafka
9 41 (31.54%) Apache Flume
9 41 (31.54%) Apache Hive
10 38 (29.23%) NoSQL
11 36 (27.69%) Cloudera
12 34 (26.15%) Analytics
12 34 (26.15%) SQL
13 29 (22.31%) Finance
14 28 (21.54%) TDD
15 27 (20.77%) HBase
15 27 (20.77%) Amazon AWS
15 27 (20.77%) HDFS
16 25 (19.23%) MapReduce
17 24 (18.46%) Relational Database
18 23 (17.69%) Docker
18 23 (17.69%) Continuous Integration
18 23 (17.69%) Business Intelligence
19 22 (16.92%) Software Engineering
20 21 (16.15%) Apache
20 21 (16.15%) ETL
20 21 (16.15%) Open Source
21 20 (15.38%) Apache Pig
21 20 (15.38%) Linux

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 101 (77.69%) Apache Spark
2 21 (16.15%) Apache
3 20 (15.38%) Apache Pig
4 11 (8.46%) Apache Solr
4 11 (8.46%) Elasticsearch
5 3 (2.31%) Cloud Foundry
5 3 (2.31%) Confluence
5 3 (2.31%) GeoServer
5 3 (2.31%) OpenStack
Applications
1 1 (0.77%) Microsoft Excel
Cloud Services
1 27 (20.77%) Amazon AWS
2 11 (8.46%) Amazon S3
3 10 (7.69%) Microsoft Azure
4 7 (5.38%) Google Cloud Platform
5 6 (4.62%) Amazon EC2
5 6 (4.62%) Amazon Kinesis
6 5 (3.85%) Amazon EMR
7 4 (3.08%) GitHub
8 3 (2.31%) Azure Data Factory
9 2 (1.54%) Cloud Computing
10 1 (0.77%) Amazon SQS
10 1 (0.77%) AWS Lambda
10 1 (0.77%) SaaS
10 1 (0.77%) Serverless
Communications & Networking
1 5 (3.85%) Kerberos
2 2 (1.54%) SSL
Database & Business Intelligence
1 130 (100.00%) Hadoop
2 106 (81.54%) Big Data
3 41 (31.54%) Apache Hive
4 38 (29.23%) NoSQL
5 27 (20.77%) HBase
6 24 (18.46%) Relational Database
7 19 (14.62%) Impala
8 16 (12.31%) Apache Cassandra
9 15 (11.54%) Sqoop
10 10 (7.69%) RDBMS
11 8 (6.15%) Amazon Redshift
11 8 (6.15%) Flink
11 8 (6.15%) PostgreSQL
12 7 (5.38%) Data Mining
12 7 (5.38%) MongoDB
13 6 (4.62%) Data Lake
13 6 (4.62%) MySQL
14 5 (3.85%) Data Warehouse
14 5 (3.85%) Presto
15 4 (3.08%) BigQuery
Development Applications
1 14 (10.77%) Jenkins
2 8 (6.15%) Git (software)
3 6 (4.62%) JIRA
3 6 (4.62%) Maven
3 6 (4.62%) Sonatype Nexus
4 5 (3.85%) Cucumber
5 3 (2.31%) Talend Open Studio
6 2 (1.54%) JUnit
7 1 (0.77%) Mercurial
7 1 (0.77%) Mockito
7 1 (0.77%) Selenium
7 1 (0.77%) Subversion
7 1 (0.77%) Travis CI
General
1 29 (22.31%) Finance
2 16 (12.31%) Marketing
3 14 (10.77%) Banking
4 11 (8.46%) Legal
5 10 (7.69%) Electronics
6 8 (6.15%) Telecoms
7 7 (5.38%) Manufacturing
8 5 (3.85%) Investment Banking
9 3 (2.31%) Games
9 3 (2.31%) Publishing
9 3 (2.31%) Retail
10 1 (0.77%) Retail Banking
Libraries, Frameworks & Software Standards
1 47 (36.15%) Kafka
2 8 (6.15%) Spark Streaming
3 6 (4.62%) Web Services
4 5 (3.85%) REST
5 4 (3.08%) Dropwizard
5 4 (3.08%) Pandas
5 4 (3.08%) RabbitMQ
5 4 (3.08%) Scalatra
6 3 (2.31%) Apache Camel
6 3 (2.31%) Drools
6 3 (2.31%) GeoTools
6 3 (2.31%) JTS
6 3 (2.31%) MLlib
6 3 (2.31%) Natural Language Processing
6 3 (2.31%) Spring
6 3 (2.31%) Spring Boot
6 3 (2.31%) XML
7 2 (1.54%) HTML
7 2 (1.54%) JSON
7 2 (1.54%) RESTful
Miscellaneous
1 19 (14.62%) Analytical Skills
2 10 (7.69%) Algorithms
3 8 (6.15%) Computer Science
4 5 (3.85%) Blog
4 5 (3.85%) Hybrid Cloud
5 4 (3.08%) Fintech
5 4 (3.08%) Greenfield Project
6 3 (2.31%) Clustering
6 3 (2.31%) Credit Risk
6 3 (2.31%) User Experience
7 2 (1.54%) Data Structures
7 2 (1.54%) Market Risk
7 2 (1.54%) Social Network
8 1 (0.77%) Data Centre
8 1 (0.77%) Digital Currency
8 1 (0.77%) Linux Command Line
8 1 (0.77%) Online Games
Operating Systems
1 20 (15.38%) Linux
2 14 (10.77%) Unix
3 4 (3.08%) Windows
Processes & Methodologies
1 70 (53.85%) Agile Software Development
2 34 (26.15%) Analytics
3 28 (21.54%) TDD
4 25 (19.23%) MapReduce
5 23 (17.69%) Business Intelligence
5 23 (17.69%) Continuous Integration
6 22 (16.92%) Software Engineering
7 21 (16.15%) ETL
7 21 (16.15%) Open Source
8 18 (13.85%) Scrum
9 16 (12.31%) Test Automation
9 16 (12.31%) Use Case
9 16 (12.31%) Visualisation
10 15 (11.54%) Continuous Delivery
11 14 (10.77%) Machine Learning
12 13 (10.00%) DevOps
13 12 (9.23%) Business Analytics
13 12 (9.23%) Kanban
13 12 (9.23%) Requirements Analysis
13 12 (9.23%) Waterfall
Programming Languages
1 77 (59.23%) Java
2 72 (55.38%) Python
3 60 (46.15%) Scala
4 34 (26.15%) SQL
5 12 (9.23%) Bash Shell
5 12 (9.23%) C
6 11 (8.46%) C++
7 10 (7.69%) R
8 7 (5.38%) C#
8 7 (5.38%) Perl
8 7 (5.38%) Shell Script
9 5 (3.85%) JavaScript
10 3 (2.31%) Ruby
11 1 (0.77%) Groovy
11 1 (0.77%) VBA
Qualifications
1 5 (3.85%) Degree
1 5 (3.85%) Security Cleared
2 4 (3.08%) DV Cleared
3 3 (2.31%) Computer Science Degree
4 1 (0.77%) PhD
Quality Assurance & Compliance
1 4 (3.08%) QA
2 2 (1.54%) SLA
3 1 (0.77%) Data Quality
System Software
1 41 (31.54%) Apache Flume
2 27 (20.77%) HDFS
3 23 (17.69%) Docker
4 3 (2.31%) Apache ZooKeeper
5 2 (1.54%) Virtual Machines
Systems Management
1 15 (11.54%) Oozie
2 13 (10.00%) Puppet
3 12 (9.23%) Hadoop YARN
4 11 (8.46%) Kubernetes
4 11 (8.46%) Mesos
5 8 (6.15%) Ansible
6 5 (3.85%) Cobbler
6 5 (3.85%) Opscode Chef
7 3 (2.31%) Terraform
8 2 (1.54%) Kibana
8 2 (1.54%) Prometheus
Vendors
1 36 (27.69%) Cloudera
2 13 (10.00%) Hortonworks
3 11 (8.46%) MapR
4 9 (6.92%) Oracle
4 9 (6.92%) SAP
5 7 (5.38%) Atlassian
5 7 (5.38%) Google
6 6 (4.62%) IBM
7 4 (3.08%) EXASOL
7 4 (3.08%) Microsoft
7 4 (3.08%) Tableau
8 3 (2.31%) Informatica
8 3 (2.31%) Talend
8 3 (2.31%) Teradata
9 2 (1.54%) Netezza
9 2 (1.54%) Splunk
9 2 (1.54%) Vertica
10 1 (0.77%) Greenplum
10 1 (0.77%) MicroStrategy
10 1 (0.77%) MuleSoft