Period
to 19 January 2022

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 19 January 2022 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
19 Jan 2022
Same period 2021 Same period 2020
Rank 339 284 250
Rank change year-on-year -55 -34 -61
Permanent jobs citing Hadoop 1,122 619 1,548
As % of all permanent jobs advertised in England 1.01% 1.10% 1.34%
As % of the Database & Business Intelligence category 3.77% 3.96% 4.97%
Number of salaries quoted 634 467 1,237
10th Percentile £47,500 £45,250 £45,915
25th Percentile £57,500 £51,875 £55,000
Median annual salary (50th Percentile) £75,000 £70,000 £70,000
Median % change year-on-year +7.14% - -
75th Percentile £95,000 £92,500 £85,000
90th Percentile £115,000 £110,000 £110,000
UK median annual salary £72,500 £67,500 £70,000
% change year-on-year +7.41% -3.57% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 29,785 15,637 31,175
As % of all permanent IT jobs advertised in England 26.80% 27.66% 27.07%
Number of salaries quoted 19,583 13,360 25,989
10th Percentile £36,250 £33,750 £32,250
25th Percentile £43,750 £42,500 £39,750
Median annual salary (50th Percentile) £60,000 £55,000 £52,500
Median % change year-on-year +9.09% +4.76% -
75th Percentile £77,500 £72,500 £72,500
90th Percentile £95,000 £88,750 £90,000
UK median annual salary £60,000 £55,000 £52,500
% change year-on-year +9.09% +4.76% -

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 19 January 2022.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 19 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London -85 720 £80,000 +3.23% 94
South East -28 141 £63,750 +27.50% 20
North of England -69 92 £62,500 +13.64% 15
Midlands -62 83 £60,000 +4.35% 17
North West -58 53 £70,000 +27.27% 7
West Midlands -56 47 £55,000 -4.35% 13
Yorkshire -49 39 £62,500 +13.64% 5
East of England -74 37 £46,250 -28.85% 13
East Midlands -55 36 £65,000 +17.12% 4
South West -75 25 £75,000 +15.38% 5
Hadoop
UK

For the 6 months to 19 January 2022, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 690 (61.50%) Apache Spark
2 689 (61.41%) Python
3 611 (54.46%) Big Data
4 588 (52.41%) SQL
5 531 (47.33%) Java
6 527 (46.97%) AWS
7 521 (46.43%) Agile Software Development
8 496 (44.21%) Analytics
9 439 (39.13%) Kafka
10 354 (31.55%) Azure
11 343 (30.57%) GCP
12 333 (29.68%) Data Science
13 327 (29.14%) NoSQL
14 300 (26.74%) ETL
15 299 (26.65%) DevOps
16 294 (26.20%) Apache Hive
17 288 (25.67%) Software Engineering
18 269 (23.98%) Data Modelling
19 251 (22.37%) Social Skills
20 249 (22.19%) Machine Learning
21 243 (21.66%) Finance
22 242 (21.57%) Scala
23 239 (21.30%) Data Warehouse
24 236 (21.03%) Business Intelligence
25 230 (20.50%) CI/CD
26 228 (20.32%) Kubernetes
27 224 (19.96%) Docker
28 219 (19.52%) Data Pipeline
29 212 (18.89%) Oracle
30 202 (18.00%) MongoDB

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 690 (61.50%) Apache Spark
2 156 (13.90%) Apache
3 108 (9.63%) Elasticsearch
4 103 (9.18%) Apache Airflow
5 95 (8.47%) SAS
6 28 (2.50%) Luigi
7 26 (2.32%) Apache Pig
8 24 (2.14%) Jupyter
9 23 (2.05%) Confluence
10 21 (1.87%) Cloud Foundry
11 15 (1.34%) Apache Pulsar
12 14 (1.25%) Apache Solr
13 8 (0.71%) Oracle SOA Suite
13 8 (0.71%) Oracle Workflow
14 5 (0.45%) Apache Synapse
14 5 (0.45%) nginx
14 5 (0.45%) OpenStack
14 5 (0.45%) Tornado
15 4 (0.36%) Appian
15 4 (0.36%) Tomcat
Applications
1 16 (1.43%) Microsoft Excel
2 8 (0.71%) Microsoft PowerPoint
3 5 (0.45%) Chatbot
3 5 (0.45%) InVision
4 4 (0.36%) Microsoft Office
5 2 (0.18%) MS Visio
5 2 (0.18%) Spreadsheet
6 1 (0.089%) SPSS
Business Applications
1 13 (1.16%) Oracle BPM
2 4 (0.36%) Oracle EBS
2 4 (0.36%) Unit4 Business World
3 2 (0.18%) SAP S/4HANA
4 1 (0.089%) SAP Oil and Gas
Cloud Services
1 527 (46.97%) AWS
2 354 (31.55%) Azure
3 343 (30.57%) GCP
4 108 (9.63%) Power Platform
5 100 (8.91%) Amazon S3
6 84 (7.49%) Amazon Kinesis
7 83 (7.40%) Serverless
8 72 (6.42%) Snowflake
9 59 (5.26%) Amazon EMR
10 55 (4.90%) Amazon EC2
11 40 (3.57%) GitHub
11 40 (3.57%) SaaS
12 36 (3.21%) PaaS
13 30 (2.67%) Azure Cosmos DB
14 29 (2.58%) OpenShift
15 28 (2.50%) AWS Lambda
16 24 (2.14%) Azure Data Factory
17 22 (1.96%) Cloud Computing
18 21 (1.87%) Azure Synapse Analytics
19 20 (1.78%) AWS CodeCommit
Communications & Networking
1 43 (3.83%) HTTP
2 23 (2.05%) Wireless
3 11 (0.98%) Broadband
3 11 (0.98%) Internet
4 8 (0.71%) TCP/IP
5 7 (0.62%) Kerberos
6 6 (0.53%) DNS
6 6 (0.53%) Firewall
6 6 (0.53%) SSL
6 6 (0.53%) VLAN
7 3 (0.27%) Network Security
7 3 (0.27%) SMS
8 2 (0.18%) FCAPS
9 1 (0.089%) 4G
9 1 (0.089%) LAN
9 1 (0.089%) WAN
Database & Business Intelligence
1 611 (54.46%) Big Data
2 327 (29.14%) NoSQL
3 294 (26.20%) Apache Hive
4 239 (21.30%) Data Warehouse
5 202 (18.00%) MongoDB
6 192 (17.11%) HBase
7 174 (15.51%) PostgreSQL
8 158 (14.08%) MySQL
9 156 (13.90%) Data Lake
10 155 (13.81%) Apache Cassandra
11 151 (13.46%) Amazon Redshift
12 145 (12.92%) Relational Database
13 125 (11.14%) Flink
14 117 (10.43%) Tableau
15 109 (9.71%) SQL Server
16 108 (9.63%) Power BI
17 100 (8.91%) BigQuery
18 97 (8.65%) Impala
19 71 (6.33%) Pentaho
20 68 (6.06%) Amazon DynamoDB
Development Applications
1 187 (16.67%) Jenkins
2 70 (6.24%) Git (software)
3 45 (4.01%) JUnit
4 44 (3.92%) Atlassian Bamboo
5 41 (3.65%) Bitbucket
6 35 (3.12%) JIRA
7 30 (2.67%) GitLab
8 29 (2.58%) Maven
9 25 (2.23%) JMeter
10 21 (1.87%) Selenium
11 14 (1.25%) ERwin
11 14 (1.25%) WebDriver
12 13 (1.16%) Eclipse
12 13 (1.16%) Gradle
12 13 (1.16%) Vagrant
13 12 (1.07%) ER Studio
13 12 (1.07%) PowerDesigner
14 10 (0.89%) CircleCI
15 9 (0.80%) Sonatype Nexus
15 9 (0.80%) TeamCity
General
1 251 (22.37%) Social Skills
2 243 (21.66%) Finance
3 113 (10.07%) Inclusion and Diversity
4 105 (9.36%) Analytical Skills
5 95 (8.47%) Banking
6 73 (6.51%) Retail
7 61 (5.44%) Law
8 51 (4.55%) Presentation Skills
9 44 (3.92%) Games
10 40 (3.57%) Public Sector
11 36 (3.21%) Marketing
12 28 (2.50%) Manufacturing
13 22 (1.96%) Telecoms
14 18 (1.60%) Advertising
15 17 (1.52%) Pharmaceutical
16 16 (1.43%) Aerospace
17 14 (1.25%) Influencing Skills
17 14 (1.25%) Investment Banking
18 11 (0.98%) Legal
19 10 (0.89%) Financial Institution
Job Titles
1 351 (31.28%) Data Engineer
2 213 (18.98%) Developer
3 124 (11.05%) Architect
4 105 (9.36%) Java Developer
5 94 (8.38%) Data Architect
6 75 (6.68%) Software Engineer
7 63 (5.61%) Big Data Engineer
8 62 (5.53%) Senior Data Engineer
9 61 (5.44%) Data Scientist
10 59 (5.26%) Data Manager
11 49 (4.37%) Senior Developer
12 42 (3.74%) Consultant
13 39 (3.48%) Principal Engineer
14 37 (3.30%) DevOps Engineer
14 37 (3.30%) Lead Developer
15 34 (3.03%) Python Engineer
16 31 (2.76%) AWS Engineer
16 31 (2.76%) Senior Java Developer
17 29 (2.58%) Lead Architect
18 28 (2.50%) Java Engineer
Libraries, Frameworks & Software Standards
1 439 (39.13%) Kafka
2 108 (9.63%) Spring
3 107 (9.54%) REST
4 72 (6.42%) Spring Boot
5 69 (6.15%) RabbitMQ
6 68 (6.06%) JSON
7 63 (5.61%) Apache Beam
7 63 (5.61%) Web Services
8 47 (4.19%) RESTful
9 46 (4.10%) Apache NiFi
10 45 (4.01%) CSS
11 42 (3.74%) Node.js
12 39 (3.48%) PySpark
12 39 (3.48%) React
13 32 (2.85%) Apache Thrift
13 32 (2.85%) TensorFlow
14 31 (2.76%) .NET
15 30 (2.67%) Hibernate
15 30 (2.67%) HTML
16 28 (2.50%) Spark Streaming
Miscellaneous
1 108 (9.63%) Algorithms
2 59 (5.26%) Data Structures
3 52 (4.63%) Public Cloud
4 44 (3.92%) Virtual Team
5 40 (3.57%) User Experience
6 39 (3.48%) Cloud Native
6 39 (3.48%) Management Information System
7 31 (2.76%) Self-Motivation
8 24 (2.14%) Life Science
9 23 (2.05%) Social Media
10 21 (1.87%) Greenfield Project
11 20 (1.78%) Social Network
12 18 (1.60%) Blog
13 15 (1.34%) Cyberattack
14 14 (1.25%) Hybrid Cloud
15 11 (0.98%) Linux Command Line
16 9 (0.80%) Credit Risk
16 9 (0.80%) Private Cloud
17 8 (0.71%) Cyber Defence
18 7 (0.62%) Tandem
Operating Systems
1 148 (13.19%) Unix
2 123 (10.96%) Linux
3 24 (2.14%) Windows
4 15 (1.34%) VMS
5 7 (0.62%) CentOS
6 6 (0.53%) Red Hat Enterprise Linux
6 6 (0.53%) Windows Server
7 4 (0.36%) DC/OS
8 2 (0.18%) Embedded Linux
8 2 (0.18%) Solaris
9 1 (0.089%) Android
9 1 (0.089%) Apple iOS
9 1 (0.089%) CoreOS
9 1 (0.089%) Debian
9 1 (0.089%) Mac OS X
9 1 (0.089%) Ubuntu
9 1 (0.089%) Windows Server 2012
Processes & Methodologies
1 521 (46.43%) Agile Software Development
2 496 (44.21%) Analytics
3 333 (29.68%) Data Science
4 300 (26.74%) ETL
5 299 (26.65%) DevOps
6 288 (25.67%) Software Engineering
7 269 (23.98%) Data Modelling
8 249 (22.19%) Machine Learning
9 236 (21.03%) Business Intelligence
10 230 (20.50%) CI/CD
11 219 (19.52%) Data Pipeline
12 192 (17.11%) Data Engineering
13 177 (15.78%) Mentoring
14 173 (15.42%) Microservices
15 166 (14.80%) Data Management
16 160 (14.26%) Computer Science
16 160 (14.26%) Continuous Integration
17 141 (12.57%) Visualisation
18 140 (12.48%) Scrum
19 138 (12.30%) Data Governance
Programming Languages
1 689 (61.41%) Python
2 588 (52.41%) SQL
3 531 (47.33%) Java
4 242 (21.57%) Scala
5 132 (11.76%) R
6 80 (7.13%) JavaScript
7 65 (5.79%) PL/SQL
8 61 (5.44%) C#
9 56 (4.99%) Go
10 46 (4.10%) C++
11 43 (3.83%) Bash
12 39 (3.48%) HiveQL
13 37 (3.30%) Shell Script
14 36 (3.21%) Groovy
15 35 (3.12%) C
16 21 (1.87%) Perl
17 19 (1.69%) Java 8
17 19 (1.69%) PowerShell
18 17 (1.52%) Ruby
19 14 (1.25%) TypeScript
Qualifications
1 181 (16.13%) Degree
2 72 (6.42%) Security Cleared
3 71 (6.33%) Computer Science Degree
4 37 (3.30%) SC Cleared
5 31 (2.76%) PhD
6 28 (2.50%) Master's Degree
7 14 (1.25%) SAS Certification
8 10 (0.89%) DV Cleared
8 10 (0.89%) Microsoft Certification
9 7 (0.62%) MCSA
10 5 (0.45%) AWS Certification
10 5 (0.45%) Numerate Degree
10 5 (0.45%) TOGAF Certification
11 4 (0.36%) BPSS Clearance
12 2 (0.18%) CCA
12 2 (0.18%) MCSE
13 1 (0.089%) CCNA
13 1 (0.089%) Cisco Certification
13 1 (0.089%) CISSP
13 1 (0.089%) PMP
Quality Assurance & Compliance
1 96 (8.56%) Data Quality
2 35 (3.12%) QA
3 25 (2.23%) GDPR
4 10 (0.89%) GxP
5 5 (0.45%) Actionable Recommendations
6 4 (0.36%) PMO
6 4 (0.36%) SLA
7 3 (0.27%) Sarbanes-Oxley
8 2 (0.18%) Accessibility
9 1 (0.089%) Dodd-Frank
9 1 (0.089%) EMIR
9 1 (0.089%) FATCA
9 1 (0.089%) IFRS
9 1 (0.089%) IFRS 9
9 1 (0.089%) MiFID
System Software
1 224 (19.96%) Docker
2 93 (8.29%) HDFS
3 47 (4.19%) Apache ZooKeeper
4 25 (2.23%) Apache Flume
5 21 (1.87%) Virtual Machines
5 21 (1.87%) VMware Infrastructure
6 13 (1.16%) VirtualBox
7 3 (0.27%) Active Directory
8 1 (0.089%) vCloud
8 1 (0.089%) vSphere
Systems Management
1 228 (20.32%) Kubernetes
2 147 (13.10%) Ansible
3 103 (9.18%) Terraform
4 45 (4.01%) Opscode Chef
5 39 (3.48%) Puppet
6 33 (2.94%) Oozie
7 18 (1.60%) Control-M
7 18 (1.60%) Docker Swarm
8 16 (1.43%) Hadoop YARN
9 15 (1.34%) Prometheus
10 13 (1.16%) Single Sign-On
11 12 (1.07%) Grafana
12 11 (0.98%) Mesos
13 9 (0.80%) HAProxy
14 8 (0.71%) Istio
14 8 (0.71%) Salt
15 5 (0.45%) Graphite
16 4 (0.36%) Apache Brooklyn
16 4 (0.36%) Kubeflow
16 4 (0.36%) Marathon
Vendors
1 212 (18.89%) Oracle
2 189 (16.84%) Google
3 110 (9.80%) Databricks
4 103 (9.18%) Microsoft
5 91 (8.11%) Informatica
6 65 (5.79%) Talend
7 52 (4.63%) Cloudera
7 52 (4.63%) Teradata
8 44 (3.92%) Splunk
9 36 (3.21%) Hortonworks
10 24 (2.14%) IBM
11 22 (1.96%) VMware
12 18 (1.60%) Cognizant
13 17 (1.52%) Facebook
13 17 (1.52%) StreamSets
14 13 (1.16%) Ab Initio
14 13 (1.16%) Atlassian
14 13 (1.16%) Dataiku
15 11 (0.98%) Alteryx
16 10 (0.89%) Cisco