Period
to 25 September 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 25 September 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
25 Sep 2021
Same period 2020 Same period 2019
Rank 293 245 221
Rank change year-on-year -48 -24 -23
Permanent jobs citing Hadoop 1,264 641 2,054
As % of all permanent jobs advertised in England 1.18% 1.43% 1.58%
As % of the Database & Business Intelligence category 4.17% 4.92% 5.76%
Number of salaries quoted 742 457 1,538
10th Percentile £47,500 £46,250 £43,809
25th Percentile £56,250 £57,500 £53,750
Median annual salary (50th Percentile) £80,000 £73,000 £70,000
Median % change year-on-year +9.59% +4.29% -
75th Percentile £97,500 £98,750 £86,250
90th Percentile £110,000 £120,000 £107,500
UK median annual salary £75,000 £72,500 £70,000
% change year-on-year +3.45% +3.57% +3.70%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 30,328 13,030 35,635
As % of all permanent IT jobs advertised in England 28.20% 28.98% 27.41%
Number of salaries quoted 19,937 11,045 29,706
10th Percentile £35,000 £33,750 £31,500
25th Percentile £42,500 £42,500 £38,750
Median annual salary (50th Percentile) £57,500 £55,000 £52,500
Median % change year-on-year +4.55% +4.76% +5.00%
75th Percentile £77,500 £73,750 £70,213
90th Percentile £95,000 £90,000 £86,250
UK median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 25 September 2021.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 25 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -67 828 £80,000 +3.90% 92
South East -75 163 £75,000 +15.38% 15
Midlands -92 79 £60,000 -14.29% 8
South West -49 74 £62,358 +10.86% 5
North of England -69 69 £57,500 +4.55% 18
West Midlands -60 50 £60,000 +20.00% 6
Yorkshire -62 42 £60,000 +9.09% 4
East of England -78 35 £105,000 +75.00% 8
East Midlands -91 29 £54,000 -22.86% 2
North West -90 25 £57,500 +2.22% 11
North East -31 2 £56,914 +35.51% 3
Hadoop
UK

For the 6 months to 25 September 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 797 (63.05%) Apache Spark
2 739 (58.47%) Big Data
3 648 (51.27%) AWS
4 640 (50.63%) Python
5 599 (47.39%) Java
6 574 (45.41%) SQL
7 550 (43.51%) Agile Software Development
8 521 (41.22%) Kafka
9 486 (38.45%) Analytics
10 429 (33.94%) Azure
11 402 (31.80%) GCP
12 360 (28.48%) Kubernetes
12 360 (28.48%) Software Engineering
13 339 (26.82%) Data Science
14 338 (26.74%) DevOps
15 333 (26.34%) NoSQL
16 328 (25.95%) Jenkins
17 318 (25.16%) Docker
18 312 (24.68%) Finance
19 310 (24.53%) ETL
20 284 (22.47%) Continuous Integration
21 265 (20.97%) Ansible
22 262 (20.73%) Microservices
23 244 (19.30%) Data Engineering
23 244 (19.30%) Scala
24 239 (18.91%) Apache Hive
24 239 (18.91%) Social Skills
25 236 (18.67%) Degree
26 224 (17.72%) Data Pipeline
27 221 (17.48%) Business Intelligence

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 797 (63.05%) Apache Spark
2 170 (13.45%) Apache
3 147 (11.63%) Elasticsearch
4 96 (7.59%) Apache Airflow
5 71 (5.62%) SAS
6 52 (4.11%) Cloud Foundry
7 32 (2.53%) Jupyter
8 29 (2.29%) Apache Pig
9 26 (2.06%) Luigi
10 22 (1.74%) Confluence
11 11 (0.87%) Apache Solr
12 10 (0.79%) Oracle SOA Suite
13 9 (0.71%) GemFire
14 8 (0.63%) Tomcat
15 6 (0.47%) CMS
15 6 (0.47%) OpenStack
16 5 (0.40%) Apache Synapse
16 5 (0.40%) Oracle Workflow
17 4 (0.32%) Appian
17 4 (0.32%) SharePoint
Applications
1 18 (1.42%) Microsoft Excel
2 13 (1.03%) Microsoft PowerPoint
3 9 (0.71%) MS Visio
4 7 (0.55%) Microsoft Office
5 5 (0.40%) InVision
6 4 (0.32%) Chatbot
7 2 (0.16%) SPSS
8 1 (0.079%) Microsoft Project
8 1 (0.079%) Spreadsheet
Business Applications
1 13 (1.03%) Oracle BPM
2 4 (0.32%) Unit4 Business World
3 2 (0.16%) Oracle EBS
4 1 (0.079%) SAP Oil and Gas
Cloud Services
1 648 (51.27%) AWS
2 429 (33.94%) Azure
3 402 (31.80%) GCP
4 137 (10.84%) Serverless
5 121 (9.57%) Amazon Kinesis
6 109 (8.62%) Power Platform
7 89 (7.04%) Snowflake
8 80 (6.33%) Amazon EC2
9 75 (5.93%) AWS Lambda
10 74 (5.85%) Amazon EMR
11 61 (4.83%) OpenShift
12 49 (3.88%) Cloud Computing
13 47 (3.72%) IBM Cloud
13 47 (3.72%) PaaS
14 46 (3.64%) SaaS
15 45 (3.56%) Amazon S3
16 43 (3.40%) AWS CloudFormation
17 37 (2.93%) Cloud Functions
18 29 (2.29%) Azure Data Factory
19 27 (2.14%) Azure Synapse Analytics
Communications & Networking
1 64 (5.06%) HTTP
2 28 (2.22%) Internet
3 24 (1.90%) Wireless
4 10 (0.79%) Broadband
5 9 (0.71%) SMS
6 5 (0.40%) TCP/IP
7 4 (0.32%) Firewall
7 4 (0.32%) Kerberos
7 4 (0.32%) Sourcefire
7 4 (0.32%) SSL
8 3 (0.24%) DNS
9 2 (0.16%) FTP
9 2 (0.16%) Network Security
9 2 (0.16%) VLAN
10 1 (0.079%) Skype
Database & Business Intelligence
1 739 (58.47%) Big Data
2 333 (26.34%) NoSQL
3 239 (18.91%) Apache Hive
4 200 (15.82%) Data Warehouse
5 187 (14.79%) MongoDB
6 174 (13.77%) Amazon Redshift
7 172 (13.61%) HBase
8 169 (13.37%) Relational Database
9 150 (11.87%) Data Lake
10 136 (10.76%) MySQL
11 129 (10.21%) Apache Cassandra
12 119 (9.41%) Tableau
13 112 (8.86%) SQL Server
14 109 (8.62%) Power BI
15 103 (8.15%) PostgreSQL
16 92 (7.28%) Amazon DynamoDB
17 83 (6.57%) BigQuery
18 75 (5.93%) Flink
19 68 (5.38%) Neo4j
20 58 (4.59%) Amazon Athena
Development Applications
1 328 (25.95%) Jenkins
2 107 (8.47%) Atlassian Bamboo
3 100 (7.91%) Git (software)
3 100 (7.91%) JMeter
4 63 (4.98%) Selenium
5 60 (4.75%) Eclipse
6 58 (4.59%) JUnit
7 52 (4.11%) Vagrant
8 44 (3.48%) Gradle
8 44 (3.48%) Robot Framework
9 43 (3.40%) Bitbucket
9 43 (3.40%) JIRA
10 35 (2.77%) Cucumber
11 34 (2.69%) WebDriver
12 30 (2.37%) Maven
12 30 (2.37%) SonarQube
13 26 (2.06%) Postman
14 24 (1.90%) Cypress.io
15 19 (1.50%) ERwin
16 16 (1.27%) IntelliJ
General
1 312 (24.68%) Finance
2 239 (18.91%) Social Skills
3 135 (10.68%) Banking
4 117 (9.26%) Analytical Skills
5 91 (7.20%) Inclusion and Diversity
6 89 (7.04%) Retail
7 73 (5.78%) Law
7 73 (5.78%) Presentation Skills
8 38 (3.01%) Games
9 35 (2.77%) Manufacturing
10 28 (2.22%) Telecoms
11 24 (1.90%) Marketing
12 22 (1.74%) Pharmaceutical
13 21 (1.66%) Public Sector
13 21 (1.66%) Retail Banking
14 18 (1.42%) Advertising
15 16 (1.27%) Influencing Skills
16 15 (1.19%) Investment Banking
17 10 (0.79%) Legal
18 8 (0.63%) Automotive
Job Titles
1 326 (25.79%) Data Engineer
2 263 (20.81%) Developer
3 172 (13.61%) Architect
4 162 (12.82%) Java Developer
5 142 (11.23%) Software Engineer
6 128 (10.13%) Data Architect
7 95 (7.52%) Big Data Engineer
8 83 (6.57%) Data Scientist
9 80 (6.33%) Senior Data Engineer
10 53 (4.19%) Senior Developer
11 52 (4.11%) Java Engineer
12 48 (3.80%) Platform Engineer
12 48 (3.80%) Senior Software Engineer
13 47 (3.72%) DevOps Engineer
14 44 (3.48%) Senior Java Developer
15 41 (3.24%) Principal Engineer
16 39 (3.09%) Big Data Architect
17 36 (2.85%) Scala Engineer
18 33 (2.61%) Java Software Engineer
18 33 (2.61%) Principal Software Engineer
Libraries, Frameworks & Software Standards
1 521 (41.22%) Kafka
2 176 (13.92%) Spring Boot
3 171 (13.53%) Spring
4 135 (10.68%) REST
5 130 (10.28%) Web Services
6 117 (9.26%) RabbitMQ
7 83 (6.57%) Spark Streaming
8 81 (6.41%) React
9 80 (6.33%) JSON
10 75 (5.93%) Node.js
11 62 (4.91%) HTML
12 58 (4.59%) AngularJS
12 58 (4.59%) CSS
13 56 (4.43%) Apache Thrift
14 55 (4.35%) Apache NiFi
15 54 (4.27%) RESTful
16 53 (4.19%) PySpark
17 52 (4.11%) Elastic Stack
18 49 (3.88%) Middleware
19 45 (3.56%) Drools
Miscellaneous
1 121 (9.57%) Algorithms
2 65 (5.14%) User Experience
3 64 (5.06%) Data Structures
4 49 (3.88%) Cyberattack
5 46 (3.64%) Cloud Native
6 45 (3.56%) Self-Motivation
7 41 (3.24%) Virtual Team
8 36 (2.85%) Management Information System
9 35 (2.77%) Hybrid Cloud
10 32 (2.53%) Life Science
11 29 (2.29%) Social Media
12 28 (2.22%) Public Cloud
13 25 (1.98%) Greenfield Project
14 19 (1.50%) Equities
15 18 (1.42%) Hedge funds
16 17 (1.34%) Linux Command Line
17 12 (0.95%) Internet of Things
18 11 (0.87%) Enterprise Software
19 10 (0.79%) Online Banking
20 9 (0.71%) Private Cloud
Operating Systems
1 187 (14.79%) Linux
2 153 (12.10%) Unix
3 44 (3.48%) Windows
4 25 (1.98%) CentOS
5 24 (1.90%) Red Hat Enterprise Linux
6 8 (0.63%) Solaris
7 5 (0.40%) Windows Server
8 4 (0.32%) DC/OS
9 1 (0.079%) CoreOS
9 1 (0.079%) Windows Server 2012
Processes & Methodologies
1 550 (43.51%) Agile Software Development
2 486 (38.45%) Analytics
3 360 (28.48%) Software Engineering
4 339 (26.82%) Data Science
5 338 (26.74%) DevOps
6 310 (24.53%) ETL
7 284 (22.47%) Continuous Integration
8 262 (20.73%) Microservices
9 244 (19.30%) Data Engineering
10 224 (17.72%) Data Pipeline
11 221 (17.48%) Business Intelligence
12 212 (16.77%) Machine Learning
13 203 (16.06%) Data Modelling
14 201 (15.90%) Artificial Intelligence
15 177 (14.00%) Computer Science
16 171 (13.53%) Visualisation
17 149 (11.79%) Open Source
18 136 (10.76%) Data Management
19 132 (10.44%) Fintech
19 132 (10.44%) Mentoring
Programming Languages
1 640 (50.63%) Python
2 599 (47.39%) Java
3 574 (45.41%) SQL
4 244 (19.30%) Scala
5 112 (8.86%) R
6 95 (7.52%) JavaScript
7 61 (4.83%) C#
8 54 (4.27%) Shell Script
9 51 (4.03%) Bash Shell
10 49 (3.88%) Go
10 49 (3.88%) TypeScript
11 45 (3.56%) PowerShell
12 39 (3.09%) Java 8
13 38 (3.01%) PL/SQL
14 27 (2.14%) C++
15 21 (1.66%) Groovy
16 19 (1.50%) HiveQL
17 18 (1.42%) C
18 16 (1.27%) PHP
19 14 (1.11%) Kotlin
Qualifications
1 236 (18.67%) Degree
2 104 (8.23%) Security Cleared
3 80 (6.33%) SC Cleared
4 75 (5.93%) Computer Science Degree
5 35 (2.77%) DV Cleared
6 33 (2.61%) PhD
7 32 (2.53%) Master's Degree
8 11 (0.87%) SAS Certification
9 9 (0.71%) BPSS Clearance
10 5 (0.40%) AWS Certification
10 5 (0.40%) TOGAF Certification
11 4 (0.32%) MCSA
11 4 (0.32%) Microsoft Certification
12 3 (0.24%) CFA
13 2 (0.16%) CCA
14 1 (0.079%) PMI Certification
14 1 (0.079%) PMP
Quality Assurance & Compliance
1 61 (4.83%) Data Quality
2 42 (3.32%) QA
3 32 (2.53%) GDPR
4 16 (1.27%) GxP
5 8 (0.63%) Accessibility
6 4 (0.32%) PMO
7 3 (0.24%) ISO/IEC 27001
7 3 (0.24%) SLA
8 2 (0.16%) COBIT
8 2 (0.16%) NIST
8 2 (0.16%) Sarbanes-Oxley
9 1 (0.079%) IFRS
9 1 (0.079%) IFRS 9
System Software
1 318 (25.16%) Docker
2 68 (5.38%) HDFS
3 52 (4.11%) VirtualBox
4 43 (3.40%) Apache ZooKeeper
5 14 (1.11%) Apache Flume
6 10 (0.79%) VMware Infrastructure
7 3 (0.24%) Virtual Machines
8 2 (0.16%) Active Directory
9 1 (0.079%) Hyper-V
Systems Management
1 360 (28.48%) Kubernetes
2 265 (20.97%) Ansible
3 210 (16.61%) Terraform
4 53 (4.19%) Docker Swarm
5 33 (2.61%) Puppet
6 18 (1.42%) Opscode Chef
7 14 (1.11%) Mesos
8 11 (0.87%) Control-M
8 11 (0.87%) Hadoop YARN
9 10 (0.79%) Oozie
9 10 (0.79%) Prometheus
10 9 (0.71%) Single Sign-On
11 6 (0.47%) Istio
11 6 (0.47%) Kubeflow
12 4 (0.32%) Apache Brooklyn
12 4 (0.32%) Marathon
13 3 (0.24%) HAProxy
13 3 (0.24%) Salt
13 3 (0.24%) Tivoli
14 2 (0.16%) Grafana
Vendors
1 200 (15.82%) Oracle
2 193 (15.27%) Google
3 114 (9.02%) Microsoft
4 99 (7.83%) Databricks
5 95 (7.52%) Cloudera
6 86 (6.80%) Informatica
7 83 (6.57%) Talend
8 75 (5.93%) Hortonworks
9 68 (5.38%) IBM
10 62 (4.91%) Teradata
11 58 (4.59%) Splunk
12 56 (4.43%) Atlassian
13 21 (1.66%) Instagram
13 21 (1.66%) Samsung
14 19 (1.50%) StreamSets
15 18 (1.42%) Dataiku
16 17 (1.34%) Facebook
17 13 (1.03%) Alteryx
18 12 (0.95%) Cisco
18 12 (0.95%) MicroStrategy