Period
to

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 12 August 2022 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
12 Aug 2022
Same period 2021 Same period 2020
Rank 351 299 240
Rank change year-on-year -52 -59 -35
Permanent jobs citing Hadoop 1,471 1,197 828
As % of all permanent jobs advertised in England 1.03% 1.18% 1.42%
As % of the Database & Business Intelligence category 3.85% 4.23% 5.11%
Number of salaries quoted 557 730 570
10th Percentile £48,750 £46,250 £46,250
25th Percentile £60,625 £55,000 £57,500
Median annual salary (50th Percentile) £80,000 £77,500 £75,000
Median % change year-on-year +3.23% +3.33% +7.14%
75th Percentile £100,000 £95,000 £95,000
90th Percentile £112,500 £110,000 £117,500
UK median annual salary £77,500 £75,000 £72,500
% change year-on-year +3.33% +3.45% +3.57%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 38,208 28,319 16,217
As % of all permanent IT jobs advertised in England 26.86% 28.00% 27.81%
Number of salaries quoted 18,825 19,009 13,424
10th Percentile £36,250 £35,000 £32,500
25th Percentile £45,750 £42,500 £41,250
Median annual salary (50th Percentile) £60,000 £57,500 £55,000
Median % change year-on-year +4.35% +4.55% +4.76%
75th Percentile £82,500 £76,250 £72,500
90th Percentile £97,500 £92,750 £88,750
UK median annual salary £60,000 £55,000 £55,000
% change year-on-year +9.09% - +7.34%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 12 August 2022.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 12 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London -60 1,058 £85,000 +6.25% 71
South East -38 172 £63,750 -13.56% 10
North of England -46 83 £85,000 +47.83% 15
South West -41 63 £68,750 +10.50% 3
Midlands -70 57 £62,500 +8.70%
North West -54 46 £52,500 -10.64% 11
West Midlands -57 39 £77,000 +28.33%
East of England -58 29 £60,000 -43.53%
Yorkshire -38 25 £70,000 +33.33% 4
East Midlands -37 18 £62,500 +16.82%
North East +3 12 £85,000 +49.35%
Hadoop
UK

For the 6 months to 12 August 2022, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 945 (64.24%) Python
2 917 (62.34%) Apache Spark
3 871 (59.21%) Big Data
4 832 (56.56%) Agile
5 820 (55.74%) SQL
6 806 (54.79%) AWS
7 752 (51.12%) Java
8 641 (43.58%) Analytics
9 620 (42.15%) Azure
10 582 (39.56%) Kafka
11 517 (35.15%) GCP
12 497 (33.79%) Finance
13 488 (33.17%) Data Science
14 473 (32.15%) NoSQL
15 423 (28.76%) ETL
16 385 (26.17%) Data Engineering
17 382 (25.97%) Machine Learning
17 382 (25.97%) Social Skills
18 369 (25.08%) Scala
19 361 (24.54%) DevOps
20 347 (23.59%) Software Engineering
21 345 (23.45%) Data Pipeline
22 344 (23.39%) Apache Hive
23 334 (22.71%) CI/CD
24 320 (21.75%) Degree
25 312 (21.21%) Data Warehouse
26 302 (20.53%) Data Modelling
27 301 (20.46%) Kubernetes
28 292 (19.85%) Data Lake
29 291 (19.78%) Computer Science

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 917 (62.34%) Apache Spark
2 206 (14.00%) Apache Airflow
3 141 (9.59%) Apache
4 72 (4.89%) Apache Pulsar
5 43 (2.92%) Oracle Workflow
6 41 (2.79%) Apache Pig
7 30 (2.04%) SAS
8 29 (1.97%) OpenStack
9 24 (1.63%) Confluence
10 23 (1.56%) nginx
11 17 (1.16%) Cloud Foundry
12 14 (0.95%) Luigi
13 13 (0.88%) Apache Solr
14 12 (0.82%) SharePoint
15 8 (0.54%) Jupyter
16 7 (0.48%) Oracle SOA Suite
17 6 (0.41%) Pachyderm
18 4 (0.27%) JBoss
19 2 (0.14%) Ethereum
19 2 (0.14%) Tomcat
Applications
1 15 (1.02%) Microsoft Excel
2 12 (0.82%) Microsoft Office
3 8 (0.54%) Maple
4 7 (0.48%) Campfire
5 2 (0.14%) Photoshop
6 1 (0.068%) Microsoft PowerPoint
6 1 (0.068%) SPSS
Business Applications
1 19 (1.29%) Oracle Payables
2 17 (1.16%) Oracle BPM
3 5 (0.34%) SAP Oil and Gas
4 4 (0.27%) SAP Hybris
5 2 (0.14%) WebTrends
6 1 (0.068%) Distributed Ledger
Cloud Services
1 806 (54.79%) AWS
2 620 (42.15%) Azure
3 517 (35.15%) GCP
4 115 (7.82%) Snowflake
5 114 (7.75%) Power Platform
6 105 (7.14%) Amazon Kinesis
7 97 (6.59%) Amazon S3
8 92 (6.25%) Azure Synapse Analytics
8 92 (6.25%) Cloud Computing
9 82 (5.57%) Serverless
10 75 (5.10%) OpenShift
11 67 (4.55%) Azure Data Factory
12 62 (4.21%) GitHub
13 59 (4.01%) Google Data Studio
14 56 (3.81%) Google Kubernetes Engine
14 56 (3.81%) SaaS
15 47 (3.20%) AWS CloudFormation
16 36 (2.45%) Azure DevOps
17 30 (2.04%) Cloud Composer
18 28 (1.90%) MinIO
Communications & Networking
1 84 (5.71%) HTTP
2 57 (3.87%) TCP/IP
3 26 (1.77%) Firewall
4 24 (1.63%) Internet
5 19 (1.29%) DNS
6 14 (0.95%) Kerberos
7 10 (0.68%) VLAN
8 9 (0.61%) DHCP
9 8 (0.54%) Network Security
10 7 (0.48%) Broadband
11 6 (0.41%) AMQP
12 4 (0.27%) FCAPS
13 3 (0.20%) SMS
14 1 (0.068%) 3GPP
14 1 (0.068%) DMZ
14 1 (0.068%) LAN
14 1 (0.068%) OpenLDAP
14 1 (0.068%) RS-232
14 1 (0.068%) SAN
14 1 (0.068%) WAN
Database & Business Intelligence
1 871 (59.21%) Big Data
2 473 (32.15%) NoSQL
3 344 (23.39%) Apache Hive
4 312 (21.21%) Data Warehouse
5 292 (19.85%) Data Lake
6 284 (19.31%) MongoDB
7 228 (15.50%) Amazon Redshift
8 221 (15.02%) Flink
9 220 (14.96%) HBase
10 189 (12.85%) Apache Cassandra
11 180 (12.24%) Relational Database
12 173 (11.76%) Tableau
13 169 (11.49%) BigQuery
13 169 (11.49%) Elasticsearch
14 168 (11.42%) MySQL
15 138 (9.38%) SQL Server
16 127 (8.63%) PostgreSQL
17 125 (8.50%) Sqoop
18 114 (7.75%) Power BI
19 107 (7.27%) Looker
Development Applications
1 230 (15.64%) Jenkins
2 191 (12.98%) Git (software)
3 98 (6.66%) JUnit
4 77 (5.23%) Maven
5 74 (5.03%) JIRA
6 73 (4.96%) Atlassian Bamboo
6 73 (4.96%) Selenium
7 60 (4.08%) CircleCI
8 48 (3.26%) JMeter
9 45 (3.06%) WebDriver
10 40 (2.72%) Bitbucket
10 40 (2.72%) Gradle
11 37 (2.52%) Cucumber
12 28 (1.90%) Postman
13 27 (1.84%) GitLab
14 25 (1.70%) SoapUI
15 22 (1.50%) Travis CI
16 19 (1.29%) IBM UrbanCode
17 18 (1.22%) Spock
18 16 (1.09%) SQL Server Management Studio (SSMS)
General
1 497 (33.79%) Finance
2 382 (25.97%) Social Skills
3 212 (14.41%) Analytical Skills
4 142 (9.65%) Banking
5 136 (9.25%) Inclusion and Diversity
6 94 (6.39%) Retail
7 92 (6.25%) Games
8 78 (5.30%) Marketing
9 73 (4.96%) Law
10 52 (3.54%) Telecoms
11 33 (2.24%) Public Sector
12 28 (1.90%) Legal
13 27 (1.84%) Billing
13 27 (1.84%) Electronics
14 22 (1.50%) Advertising
14 22 (1.50%) Manufacturing
15 21 (1.43%) Automotive
15 21 (1.43%) Presentation Skills
16 20 (1.36%) Financial Institution
17 19 (1.29%) Front Office
Job Titles
1 483 (32.83%) Data Engineer
2 179 (12.17%) Software Engineer
3 147 (9.99%) Architect
4 144 (9.79%) Developer
5 121 (8.23%) Senior Data Engineer
6 108 (7.34%) Big Data Engineer
7 105 (7.14%) Java Developer
8 79 (5.37%) Data Manager
9 78 (5.30%) Analyst
10 69 (4.69%) Data Architect
11 68 (4.62%) Consultant
12 67 (4.55%) Data Consultant
13 64 (4.35%) DevOps Engineer
14 62 (4.21%) Data Scientist
15 53 (3.60%) Senior Developer
16 51 (3.47%) Senior Analyst
17 49 (3.33%) Engineering Manager
18 47 (3.20%) Development Engineer
18 47 (3.20%) Software Development Engineer
19 45 (3.06%) Python Engineer
Libraries, Frameworks & Software Standards
1 582 (39.56%) Kafka
2 175 (11.90%) Spring
3 174 (11.83%) REST
4 153 (10.40%) Web Services
5 137 (9.31%) PySpark
6 127 (8.63%) Apache Beam
7 81 (5.51%) Apache Thrift
8 80 (5.44%) Spring Boot
9 74 (5.03%) Apache NiFi
9 74 (5.03%) JSON
10 66 (4.49%) Spark Streaming
11 59 (4.01%) RabbitMQ
12 56 (3.81%) OAuth
13 53 (3.60%) Node.js
14 51 (3.47%) ActiveMQ
14 51 (3.47%) TensorFlow
15 49 (3.33%) RESTful
16 48 (3.26%) HTML
17 46 (3.13%) AngularJS
18 43 (2.92%) JMS
Miscellaneous
1 141 (9.59%) Algorithms
2 124 (8.43%) Data Structures
3 97 (6.59%) Public Cloud
4 86 (5.85%) Social Media
5 84 (5.71%) Social Network
6 61 (4.15%) Hackathon
7 58 (3.94%) Blog
8 49 (3.33%) Cloud Native
8 49 (3.33%) Greenfield Project
9 38 (2.58%) User Experience
10 35 (2.38%) Private Cloud
11 31 (2.11%) Self-Motivation
12 27 (1.84%) Cyberattack
12 27 (1.84%) Hybrid Cloud
13 26 (1.77%) Virtual Team
14 25 (1.70%) Cybercrime
14 25 (1.70%) IoT
14 25 (1.70%) Linux Command Line
15 23 (1.56%) Management Information System
15 23 (1.56%) Mobile App
Operating Systems
1 290 (19.71%) Linux
2 102 (6.93%) Unix
3 54 (3.67%) Windows
4 23 (1.56%) Android
5 22 (1.50%) CentOS
6 16 (1.09%) Red Hat Enterprise Linux
7 8 (0.54%) Apple iOS
8 6 (0.41%) SUSE
9 3 (0.20%) VMS
10 2 (0.14%) Mac OS X
11 1 (0.068%) MVS
11 1 (0.068%) Ubuntu
11 1 (0.068%) Windows Server
Processes & Methodologies
1 832 (56.56%) Agile
2 641 (43.58%) Analytics
3 488 (33.17%) Data Science
4 423 (28.76%) ETL
5 385 (26.17%) Data Engineering
6 382 (25.97%) Machine Learning
7 361 (24.54%) DevOps
8 347 (23.59%) Software Engineering
9 345 (23.45%) Data Pipeline
10 334 (22.71%) CI/CD
11 302 (20.53%) Data Modelling
12 291 (19.78%) Computer Science
13 255 (17.34%) Test Automation
14 249 (16.93%) Microservices
15 242 (16.45%) Visualisation
16 235 (15.98%) Data Architecture
17 222 (15.09%) Data Management
17 222 (15.09%) Scrum
18 197 (13.39%) Data Governance
19 193 (13.12%) Continuous Integration
Programming Languages
1 945 (64.24%) Python
2 820 (55.74%) SQL
3 752 (51.12%) Java
4 369 (25.08%) Scala
5 176 (11.96%) R
6 116 (7.89%) Bash
7 114 (7.75%) JavaScript
8 83 (5.64%) Go
9 72 (4.89%) C#
10 50 (3.40%) Groovy
11 42 (2.86%) TypeScript
12 39 (2.65%) Shell Script
13 37 (2.52%) C++
14 21 (1.43%) C
15 20 (1.36%) HiveQL
16 19 (1.29%) Perl
16 19 (1.29%) T-SQL
17 17 (1.16%) Ruby
18 14 (0.95%) PHP
18 14 (0.95%) PL/SQL
Qualifications
1 320 (21.75%) Degree
2 149 (10.13%) Computer Science Degree
3 132 (8.97%) Master's Degree
4 58 (3.94%) Security Cleared
5 46 (3.13%) PhD
6 44 (2.99%) SC Cleared
7 28 (1.90%) AWS Certification
8 15 (1.02%) Numerate Degree
9 10 (0.68%) MBA
10 7 (0.48%) DV Cleared
11 6 (0.41%) CISSP
11 6 (0.41%) CRISC
12 5 (0.34%) TOGAF Certification
13 2 (0.14%) Microsoft Certification
13 2 (0.14%) PMI Certification
14 1 (0.068%) BPSS Clearance
Quality Assurance & Compliance
1 96 (6.53%) Data Quality
2 59 (4.01%) QA
3 45 (3.06%) GDPR
4 21 (1.43%) ISO/IEC 27001
5 5 (0.34%) NIST
6 3 (0.20%) PCI DSS
6 3 (0.20%) SLA
7 2 (0.14%) MiFID
8 1 (0.068%) PMO
System Software
1 267 (18.15%) Docker
2 124 (8.43%) Apache Flume
3 81 (5.51%) Apache ZooKeeper
4 48 (3.26%) HDFS
5 20 (1.36%) VMware Infrastructure
6 11 (0.75%) Virtual Machines
7 3 (0.20%) VirtualBox
8 1 (0.068%) Active Directory
8 1 (0.068%) Hyper-V
8 1 (0.068%) Microsoft Virtual Server
8 1 (0.068%) Virtual Servers
8 1 (0.068%) vSphere
Systems Management
1 301 (20.46%) Kubernetes
2 175 (11.90%) Ansible
3 162 (11.01%) Terraform
4 94 (6.39%) Oozie
5 70 (4.76%) Puppet
6 52 (3.54%) Opscode Chef
7 42 (2.86%) Prometheus
8 36 (2.45%) Grafana
9 32 (2.18%) HAProxy
10 18 (1.22%) Single Sign-On
11 17 (1.16%) Hadoop YARN
12 13 (0.88%) Docker Swarm
13 12 (0.82%) Kubeflow
14 10 (0.68%) Graphite
14 10 (0.68%) Salt
15 8 (0.54%) Istio
16 2 (0.14%) Control-M
16 2 (0.14%) Kibana
17 1 (0.068%) Mesos
17 1 (0.068%) ZABBIX
Vendors
1 260 (17.68%) Google
2 248 (16.86%) Databricks
3 238 (16.18%) Oracle
4 134 (9.11%) Cloudera
5 126 (8.57%) Microsoft
6 116 (7.89%) Teradata
7 109 (7.41%) Splunk
8 37 (2.52%) Salesforce.com
9 36 (2.45%) Talend
10 33 (2.24%) Cisco
11 29 (1.97%) Alteryx
12 27 (1.84%) IBM
12 27 (1.84%) New Relic
13 26 (1.77%) Informatica
14 25 (1.70%) CA Agile Central
14 25 (1.70%) FIS
14 25 (1.70%) VMware
15 24 (1.63%) Dell
16 22 (1.50%) F5
16 22 (1.50%) Hitachi