Period
to 23 May 2019

The median annual salary for a Hadoop Engineer was £75,000 in advertised job vacancies during the 6 months to 23 May 2019.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Hadoop Engineer
UK
6 months to
23 May 2019
Same period 2018 Same period 2017
Rank 903 1029 1043
Rank change year-on-year +126 +14 +70
Permanent jobs requiring a Hadoop Engineer 186 164 124
As % of all permanent IT jobs advertised in the UK 0.13% 0.095% 0.073%
As % of the Job Titles category 0.13% 0.099% 0.076%
Number of salaries quoted 172 118 101
UK median annual salary £75,000 £75,000 £70,000
Median salary % change year-on-year - +7.14% +3.70%
10th Percentile £46,250 £47,500 £50,000
90th Percentile £91,925 £96,500 £88,750
UK excluding London median annual salary £64,375 £52,500 £65,000
% change year-on-year +22.62% -19.23% +48.57%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 138,276 165,708 163,272
% of permanent IT jobs with a recognized job title 96.00% 96.42% 96.50%
Number of salaries quoted 109,719 134,905 135,119
UK median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% -
10th Percentile £28,448 £27,500 £27,500
90th Percentile £85,000 £80,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Hadoop Engineer
Job Vacancy Trend

Job postings that featured Hadoop Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop Engineer.

Salary trend for Hadoop Engineer in the UK

Hadoop Engineer
Salary Histogram

The salary distribution of IT jobs citing Hadoop Engineer over the 6 months to 23 May 2019.

Salary histogram for Hadoop Engineer in the UK

Hadoop Engineer
Top 7 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop Engineer within the UK over the 6 months to 23 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +139 186 £75,000 - 6
London +174 171 £75,000 -7.69% 3
UK excluding London +17 15 £64,375 +22.62% 3
South East +7 7 £64,250 -4.81% 2
East of England +74 6 £65,000 -13.33%
North of England +25 2 £60,000 +26.32% 1
North East - 2 £60,000 -

Hadoop Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 23 May 2019, Hadoop Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Hadoop Engineer in the job title.

1 186 (100.00%) Hadoop
2 157 (84.41%) Big Data
3 147 (79.03%) Python
4 142 (76.34%) Java
5 131 (70.43%) Apache Spark
6 125 (67.20%) SQL
7 104 (55.91%) Scala
7 104 (55.91%) Kafka
8 98 (52.69%) Apache Hive
9 95 (51.08%) NoSQL
10 82 (44.09%) Machine Learning
11 78 (41.94%) Cloudera
11 78 (41.94%) Data Modelling
11 78 (41.94%) Agile Software Development
12 77 (41.40%) Business Intelligence
13 76 (40.86%) Law
13 76 (40.86%) Apache ZooKeeper
14 69 (37.10%) Amazon AWS
15 68 (36.56%) HBase
16 65 (34.95%) DevOps
16 65 (34.95%) Data Engineering
17 64 (34.41%) Sqoop
18 63 (33.87%) Software Engineering
19 62 (33.33%) Microsoft Azure
20 61 (32.80%) Google Cloud Platform
21 56 (30.11%) Apache Pig
21 56 (30.11%) Oozie
22 53 (28.49%) MongoDB
22 53 (28.49%) Apache NiFi
23 50 (26.88%) Analytics

Hadoop Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 131 (70.43%) Apache Spark
2 56 (30.11%) Apache Pig
3 20 (10.75%) Apache
4 5 (2.69%) Apache Airflow
5 4 (2.15%) SAS
6 3 (1.61%) Apache Solr
6 3 (1.61%) Confluence
7 2 (1.08%) Elasticsearch
8 1 (0.54%) Oracle Workflow
Cloud Services
1 69 (37.10%) Amazon AWS
2 62 (33.33%) Microsoft Azure
3 61 (32.80%) Google Cloud Platform
4 34 (18.28%) Power Platform
5 5 (2.69%) PaaS
5 5 (2.69%) SaaS
6 4 (2.15%) Amazon EMR
7 3 (1.61%) Amazon S3
7 3 (1.61%) AWS Lambda
8 2 (1.08%) AWS Data Pipeline
8 2 (1.08%) Azure Data Factory
8 2 (1.08%) IaaS
9 1 (0.54%) Amazon CloudWatch
9 1 (0.54%) Amazon EC2
9 1 (0.54%) Amazon Kinesis
9 1 (0.54%) Amazon SageMaker
9 1 (0.54%) AWS CloudFormation
9 1 (0.54%) Serverless
Communications & Networking
1 3 (1.61%) Kerberos
2 2 (1.08%) DNS
2 2 (1.08%) Firewall
2 2 (1.08%) HTTP
2 2 (1.08%) SMTP
2 2 (1.08%) TCP/IP
2 2 (1.08%) VPN
3 1 (0.54%) MQTT
Database & Business Intelligence
1 186 (100.00%) Hadoop
2 157 (84.41%) Big Data
3 98 (52.69%) Apache Hive
4 95 (51.08%) NoSQL
5 68 (36.56%) HBase
6 64 (34.41%) Sqoop
7 53 (28.49%) MongoDB
8 39 (20.97%) Apache Cassandra
9 34 (18.28%) Power BI
10 33 (17.74%) Apache Kudu
11 24 (12.90%) Data Warehouse
12 22 (11.83%) Impala
13 20 (10.75%) Apache Zeppelin
14 19 (10.22%) Blockchain
14 19 (10.22%) MySQL
15 18 (9.68%) QlikView
15 18 (9.68%) Redis
16 4 (2.15%) Cloudera CDH
16 4 (2.15%) PostgreSQL
16 4 (2.15%) SQL Server
Development Applications
1 6 (3.23%) Git (software)
1 6 (3.23%) Jenkins
2 4 (2.15%) Maven
3 3 (1.61%) JIRA
3 3 (1.61%) Selenium
4 2 (1.08%) Ant
4 2 (1.08%) CircleCI
4 2 (1.08%) Cucumber
4 2 (1.08%) Gradle
5 1 (0.54%) Bitbucket
5 1 (0.54%) TeamCity
General
1 76 (40.86%) Law
2 21 (11.29%) Finance
3 18 (9.68%) Banking
4 9 (4.84%) Retail
5 2 (1.08%) Investment Banking
5 2 (1.08%) Telecoms
6 1 (0.54%) Financial Institution
6 1 (0.54%) Marketing
Libraries, Frameworks & Software Standards
1 104 (55.91%) Kafka
2 53 (28.49%) Apache NiFi
3 35 (18.82%) Spark Streaming
4 17 (9.14%) REST
5 3 (1.61%) Apache Camel
5 3 (1.61%) Drools
6 2 (1.08%) AngularJS
6 2 (1.08%) CSS
6 2 (1.08%) Elastic Stack
6 2 (1.08%) LDAP
6 2 (1.08%) Middleware
6 2 (1.08%) Rendezvous
6 2 (1.08%) scikit-learn
7 1 (0.54%) Akka
7 1 (0.54%) CSS3
7 1 (0.54%) MLlib
7 1 (0.54%) Pandas
7 1 (0.54%) PySpark
7 1 (0.54%) React
7 1 (0.54%) Twitter Bootstrap
Miscellaneous
1 36 (19.35%) Analytical Skills
2 19 (10.22%) Algorithms
2 19 (10.22%) Data Structures
3 18 (9.68%) Linux Command Line
4 5 (2.69%) Linked Data
4 5 (2.69%) Semantic Web
5 4 (2.15%) User Experience
6 3 (1.61%) Cloud Native
7 2 (1.08%) Fintech
7 2 (1.08%) Public Cloud
7 2 (1.08%) Self-Motivation
7 2 (1.08%) Virtual Team
8 1 (0.54%) Credit Risk
8 1 (0.54%) Greenfield Project
8 1 (0.54%) Market Risk
Operating Systems
1 40 (21.51%) Linux
2 9 (4.84%) Unix
3 4 (2.15%) Windows
Processes & Methodologies
1 82 (44.09%) Machine Learning
2 78 (41.94%) Agile Software Development
2 78 (41.94%) Data Modelling
3 77 (41.40%) Business Intelligence
4 65 (34.95%) Data Engineering
4 65 (34.95%) DevOps
5 63 (33.87%) Software Engineering
6 50 (26.88%) Analytics
7 43 (23.12%) ETL
8 38 (20.43%) Visualisation
9 36 (19.35%) Data Visualisation
10 30 (16.13%) MapReduce
11 24 (12.90%) TDD
12 21 (11.29%) Performance Analysis
13 20 (10.75%) Open Source
14 19 (10.22%) Data Privacy
14 19 (10.22%) Integration Testing
14 19 (10.22%) Microservices
14 19 (10.22%) Statistics
15 18 (9.68%) Continuous Integration
Programming Languages
1 147 (79.03%) Python
2 142 (76.34%) Java
3 125 (67.20%) SQL
4 104 (55.91%) Scala
5 19 (10.22%) PL/SQL
6 6 (3.23%) Shell Script
7 5 (2.69%) C
8 2 (1.08%) Groovy
8 2 (1.08%) JavaScript
8 2 (1.08%) Perl
9 1 (0.54%) C#
9 1 (0.54%) HiveQL
Qualifications
1 8 (4.30%) SC Cleared
1 8 (4.30%) Security Cleared
2 3 (1.61%) Degree
3 1 (0.54%) Computer Science Degree
3 1 (0.54%) PhD
Quality Assurance & Compliance
1 8 (4.30%) Data Quality
2 2 (1.08%) MiFID
2 2 (1.08%) QA
System Software
1 76 (40.86%) Apache ZooKeeper
2 13 (6.99%) HDFS
3 5 (2.69%) Docker
4 2 (1.08%) Apache Flume
5 1 (0.54%) Cronacle
Systems Management
1 56 (30.11%) Oozie
2 36 (19.35%) Ambari
3 20 (10.75%) Ansible
4 18 (9.68%) Terraform
5 11 (5.91%) Hadoop YARN
6 4 (2.15%) Kubernetes
7 2 (1.08%) Kibana
7 2 (1.08%) logstash
7 2 (1.08%) Nagios
7 2 (1.08%) Opscode Chef
8 1 (0.54%) Control-M
Vendors
1 78 (41.94%) Cloudera
2 35 (18.82%) Tableau
3 16 (8.60%) Oracle
4 9 (4.84%) Hortonworks
5 4 (2.15%) Google
6 2 (1.08%) Solace
6 2 (1.08%) TIBCO
7 1 (0.54%) Alteryx
7 1 (0.54%) Dynatrace
7 1 (0.54%) MicroStrategy