Period
to

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 29 June 2022 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > Work from Home
6 months to
29 Jun 2022
Same period 2021 Same period 2020
Rank 365 294 220
Rank change year-on-year -71 -74 -26
Permanent jobs citing Hadoop 694 362 95
As % of all permanent jobs with a WFH option 0.89% 0.98% 1.07%
As % of the Database & Business Intelligence category 3.01% 3.19% 3.70%
Number of salaries quoted 286 294 82
10th Percentile £47,500 £47,500 £47,500
25th Percentile £50,313 £57,813 £60,313
Median annual salary (50th Percentile) £75,000 £77,500 £80,000
Median % change year-on-year -3.23% -3.13% +14.29%
75th Percentile £97,500 £92,500 £86,250
90th Percentile £115,000 £97,500 £99,875
UK median annual salary £75,000 £75,000 £72,500
% change year-on-year - +3.45% +3.57%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Work from Home
Permanent vacancies with a requirement for database or business intelligence skills 23,085 11,338 2,565
As % of all permanent jobs with a WFH option 29.67% 30.81% 28.97%
Number of salaries quoted 11,239 8,561 2,179
10th Percentile £37,491 £33,500 £35,000
25th Percentile £45,000 £41,250 £42,500
Median annual salary (50th Percentile) £60,000 £55,000 £55,000
Median % change year-on-year +9.09% - -
75th Percentile £80,000 £72,500 £72,500
90th Percentile £93,750 £87,500 £85,000
UK median annual salary £60,000 £55,000 £55,000
% change year-on-year +9.09% - +8.91%

Hadoop
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Hadoop as a proportion of all IT jobs advertised.

Hadoop trend for jobs with a WFH option

Hadoop
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Hadoop.

Hadoop salary trend for jobs with a WFH option

Hadoop
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Hadoop over the 6 months to 29 June 2022.

Hadoop salary histogram for jobs with a WFH option

For the 6 months to 29 June 2022, Hadoop job roles required the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent jobs with a WFH option and a requirement for Hadoop.

1 430 (61.96%) AWS
2 402 (57.93%) Python
3 395 (56.92%) Apache Spark
4 388 (55.91%) Java
5 368 (53.03%) SQL
6 335 (48.27%) Agile
7 312 (44.96%) Azure
8 305 (43.95%) Big Data
9 284 (40.92%) Kafka
10 281 (40.49%) GCP
11 257 (37.03%) Finance
12 228 (32.85%) NoSQL
13 215 (30.98%) Analytics
14 206 (29.68%) Scala
15 204 (29.39%) Data Warehouse
16 202 (29.11%) ETL
17 190 (27.38%) Data Lake
18 183 (26.37%) CI/CD
19 171 (24.64%) Apache Hive
20 167 (24.06%) Software Engineering
21 164 (23.63%) Data Pipeline
22 157 (22.62%) Social Skills
23 154 (22.19%) Docker
24 146 (21.04%) DevOps
25 143 (20.61%) Oracle
26 136 (19.60%) Microservices
27 132 (19.02%) Inclusion and Diversity
27 132 (19.02%) Linux
28 129 (18.59%) Amazon Redshift
28 129 (18.59%) Data Engineering

Hadoop
Co-occurring IT Skills with a WFH Option by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 395 (56.92%) Apache Spark
2 128 (18.44%) Apache
3 119 (17.15%) Apache Airflow
4 20 (2.88%) Tomcat
5 19 (2.74%) Oracle Workflow
6 17 (2.45%) SAS
7 14 (2.02%) Apache Pig
8 13 (1.87%) Confluence
9 12 (1.73%) Apache Pulsar
10 11 (1.59%) Jupyter
11 10 (1.44%) Luigi
12 7 (1.01%) SharePoint
13 3 (0.43%) nginx
13 3 (0.43%) OpenStack
14 2 (0.29%) Apache Solr
15 1 (0.14%) IIS
15 1 (0.14%) JBoss
15 1 (0.14%) WebLogic
15 1 (0.14%) WebSphere
15 1 (0.14%) WebSphere Application Server
Applications
1 26 (3.75%) Microsoft Excel
2 23 (3.31%) Microsoft Office
3 14 (2.02%) Microsoft PowerPoint
4 12 (1.73%) MS Visio
5 7 (1.01%) Maple
6 4 (0.58%) SPSS
7 2 (0.29%) Campfire
7 2 (0.29%) Photoshop
8 1 (0.14%) Gephi
Business Applications
1 22 (3.17%) Oracle BPM
2 2 (0.29%) WebTrends
Cloud Services
1 430 (61.96%) AWS
2 312 (44.96%) Azure
3 281 (40.49%) GCP
4 117 (16.86%) Amazon S3
5 86 (12.39%) Snowflake
6 58 (8.36%) Amazon Kinesis
7 39 (5.62%) AWS CloudFormation
8 33 (4.76%) GitHub
9 31 (4.47%) Azure Data Factory
10 29 (4.18%) Power Platform
11 28 (4.03%) Google Data Studio
11 28 (4.03%) SaaS
12 25 (3.60%) Amazon EMR
13 24 (3.46%) Matillion
14 23 (3.31%) Azure Synapse Analytics
14 23 (3.31%) Cloud Composer
14 23 (3.31%) Cloud Computing
15 22 (3.17%) OpenShift
16 20 (2.88%) Serverless
17 12 (1.73%) AWS Lambda
Communications & Networking
1 17 (2.45%) Firewall
1 17 (2.45%) HTTP
2 14 (2.02%) DNS
3 12 (1.73%) Internet
3 12 (1.73%) VLAN
4 7 (1.01%) Network Security
4 7 (1.01%) TCP/IP
5 2 (0.29%) Broadband
5 2 (0.29%) DHCP
5 2 (0.29%) FCAPS
5 2 (0.29%) Kerberos
6 1 (0.14%) OpenLDAP
6 1 (0.14%) SAN
Database & Business Intelligence
1 305 (43.95%) Big Data
2 228 (32.85%) NoSQL
3 204 (29.39%) Data Warehouse
4 190 (27.38%) Data Lake
5 171 (24.64%) Apache Hive
6 129 (18.59%) Amazon Redshift
7 112 (16.14%) MongoDB
8 105 (15.13%) Flink
9 102 (14.70%) Relational Database
10 99 (14.27%) PostgreSQL
11 98 (14.12%) MySQL
12 87 (12.54%) BigQuery
13 65 (9.37%) Apache Cassandra
14 61 (8.79%) Amazon Athena
15 60 (8.65%) HBase
16 58 (8.36%) Elasticsearch
17 57 (8.21%) SQL Server
18 56 (8.07%) Looker
19 55 (7.93%) Tableau
20 53 (7.64%) Sqoop
Development Applications
1 110 (15.85%) Jenkins
2 99 (14.27%) Git (software)
3 46 (6.63%) JUnit
4 44 (6.34%) CircleCI
5 34 (4.90%) Maven
6 28 (4.03%) JIRA
7 16 (2.31%) JMeter
8 11 (1.59%) Atlassian Bamboo
9 9 (1.30%) Bitbucket
9 9 (1.30%) Cypress.io
9 9 (1.30%) Postman
9 9 (1.30%) Selenium
10 7 (1.01%) WebDriver
11 6 (0.86%) ER Studio
11 6 (0.86%) ERwin
11 6 (0.86%) GitLab
11 6 (0.86%) PowerDesigner
12 4 (0.58%) Mockito
12 4 (0.58%) Subversion
13 3 (0.43%) Gradle
General
1 257 (37.03%) Finance
2 157 (22.62%) Social Skills
3 132 (19.02%) Inclusion and Diversity
4 100 (14.41%) Banking
5 69 (9.94%) Analytical Skills
6 66 (9.51%) Retail
7 46 (6.63%) Advertising
8 40 (5.76%) Public Sector
9 33 (4.76%) Legal
10 32 (4.61%) Law
11 31 (4.47%) Marketing
12 26 (3.75%) Telecoms
13 22 (3.17%) Local Government
14 17 (2.45%) Automotive
15 16 (2.31%) Games
16 11 (1.59%) Retail Banking
17 7 (1.01%) Police
17 7 (1.01%) Presentation Skills
18 6 (0.86%) Manufacturing
19 5 (0.72%) Humanities
Job Titles
1 280 (40.35%) Data Engineer
2 115 (16.57%) Software Engineer
3 82 (11.82%) Developer
4 72 (10.37%) Java Developer
4 72 (10.37%) Senior Data Engineer
5 50 (7.20%) Java Engineer
6 44 (6.34%) Big Data Engineer
7 43 (6.20%) Architect
8 35 (5.04%) DevOps Engineer
9 33 (4.76%) Python Engineer
10 31 (4.47%) Senior Developer
11 28 (4.03%) AWS Data Engineer
11 28 (4.03%) AWS Engineer
11 28 (4.03%) Senior Java Developer
12 27 (3.89%) Consultant
13 25 (3.60%) Data Architect
13 25 (3.60%) Graduate
14 24 (3.46%) Data Consultant
15 23 (3.31%) Cloud Developer
15 23 (3.31%) Junior
Libraries, Frameworks & Software Standards
1 284 (40.92%) Kafka
2 93 (13.40%) Spring
3 79 (11.38%) Spark Streaming
4 77 (11.10%) PySpark
5 63 (9.08%) OAuth
6 61 (8.79%) Hibernate
7 55 (7.93%) RESTful
8 42 (6.05%) Web Services
9 40 (5.76%) .NET
9 40 (5.76%) HTML
10 33 (4.76%) Guava
10 33 (4.76%) JAX-RS
11 32 (4.61%) Elastic Stack
11 32 (4.61%) TensorFlow
12 31 (4.47%) REST
13 29 (4.18%) RabbitMQ
14 25 (3.60%) LDAP
14 25 (3.60%) SOAP
15 24 (3.46%) Apache Camel
15 24 (3.46%) XML
Miscellaneous
1 83 (11.96%) Public Cloud
2 72 (10.37%) Algorithms
3 60 (8.65%) Data Structures
4 48 (6.92%) Cyberattack
5 45 (6.48%) Cyber Defence
6 43 (6.20%) Greenfield Project
7 34 (4.90%) Cybercrime
8 21 (3.03%) Sports Betting
9 18 (2.59%) User Experience
10 15 (2.16%) IoT
11 13 (1.87%) Cloud Native
12 12 (1.73%) Private Cloud
13 10 (1.44%) Online Banking
14 9 (1.30%) Blockchain
15 8 (1.15%) Derivative
15 8 (1.15%) Management Information System
16 6 (0.86%) Digital Media
16 6 (0.86%) NHS
17 5 (0.72%) Enterprise Software
18 4 (0.58%) Clustering
Operating Systems
1 132 (19.02%) Linux
2 66 (9.51%) Windows
3 32 (4.61%) CentOS
4 20 (2.88%) Unix
5 18 (2.59%) Android
6 12 (1.73%) Ubuntu
7 7 (1.01%) Apple iOS
8 2 (0.29%) Mac OS X
9 1 (0.14%) MVS
9 1 (0.14%) Windows Server
Processes & Methodologies
1 335 (48.27%) Agile
2 215 (30.98%) Analytics
3 202 (29.11%) ETL
4 183 (26.37%) CI/CD
5 167 (24.06%) Software Engineering
6 164 (23.63%) Data Pipeline
7 146 (21.04%) DevOps
8 136 (19.60%) Microservices
9 129 (18.59%) Data Engineering
9 129 (18.59%) Data Science
10 121 (17.44%) Machine Learning
11 106 (15.27%) Business Intelligence
11 106 (15.27%) Open Source
12 103 (14.84%) Data Architecture
13 97 (13.98%) Problem-Solving
14 93 (13.40%) TDD
15 92 (13.26%) Visualisation
16 90 (12.97%) Scrum
17 88 (12.68%) Test Automation
18 86 (12.39%) Data Modelling
Programming Languages
1 402 (57.93%) Python
2 388 (55.91%) Java
3 368 (53.03%) SQL
4 206 (29.68%) Scala
5 91 (13.11%) JavaScript
6 67 (9.65%) R
7 55 (7.93%) Bash
8 54 (7.78%) C#
9 36 (5.19%) Groovy
10 34 (4.90%) Go
11 27 (3.89%) C++
12 18 (2.59%) TypeScript
13 13 (1.87%) MATLAB
14 10 (1.44%) Kotlin
15 9 (1.30%) HiveQL
16 7 (1.01%) T-SQL
17 4 (0.58%) Julia
17 4 (0.58%) Shell Script
17 4 (0.58%) U-SQL
18 3 (0.43%) Ruby
Qualifications
1 65 (9.37%) Degree
2 45 (6.48%) Security Cleared
3 41 (5.91%) Computer Science Degree
4 40 (5.76%) SC Cleared
5 22 (3.17%) Master's Degree
6 17 (2.45%) RHCE
7 10 (1.44%) PhD
8 3 (0.43%) Numerate Degree
9 2 (0.29%) Microsoft Certification
9 2 (0.29%) PMI Certification
10 1 (0.14%) AWS Certification
10 1 (0.14%) BPSS Clearance
10 1 (0.14%) DBS Check
10 1 (0.14%) DV Cleared
10 1 (0.14%) MBA
Quality Assurance & Compliance
1 47 (6.77%) Data Quality
2 30 (4.32%) QA
3 15 (2.16%) GDPR
4 14 (2.02%) ISO/IEC 27001
5 1 (0.14%) Accessibility
5 1 (0.14%) PMO
5 1 (0.14%) SLA
System Software
1 154 (22.19%) Docker
2 56 (8.07%) Apache Flume
3 34 (4.90%) Apache ZooKeeper
4 30 (4.32%) HDFS
5 29 (4.18%) VMware Infrastructure
6 17 (2.45%) Active Directory
7 16 (2.31%) GlusterFS
7 16 (2.31%) vSphere
8 13 (1.87%) Virtual Machines
Systems Management
1 106 (15.27%) Kubernetes
2 103 (14.84%) Terraform
3 75 (10.81%) Ansible
4 60 (8.65%) Oozie
5 57 (8.21%) Puppet
6 40 (5.76%) Opscode Chef
7 28 (4.03%) Prometheus
8 23 (3.31%) Single Sign-On
9 22 (3.17%) Hadoop YARN
10 15 (2.16%) Grafana
10 15 (2.16%) HAProxy
11 12 (1.73%) Docker Swarm
11 12 (1.73%) Graphite
11 12 (1.73%) Salt
12 3 (0.43%) Consul
13 1 (0.14%) HP Fortify
13 1 (0.14%) Istio
13 1 (0.14%) Kibana
13 1 (0.14%) Mesos
13 1 (0.14%) ZABBIX
Vendors
1 143 (20.61%) Oracle
2 125 (18.01%) Databricks
3 115 (16.57%) Google
4 101 (14.55%) Microsoft
5 63 (9.08%) Cloudera
6 51 (7.35%) Teradata
7 35 (5.04%) Splunk
8 32 (4.61%) VMware
9 30 (4.32%) Red Hat
10 22 (3.17%) Talend
11 19 (2.74%) F5
11 19 (2.74%) Hitachi
12 18 (2.59%) Marin
13 13 (1.87%) Alteryx
13 13 (1.87%) IBM
14 12 (1.73%) Informatica
15 8 (1.15%) Alibaba
16 5 (0.72%) Salesforce.com
17 4 (0.58%) MicroStrategy
17 4 (0.58%) New Relic