Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 August 2022 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
17 Aug 2022		 Same period 2021 Same period 2020
Rank 360 304 237
Rank change year-on-year -56 -67 -21
Permanent jobs citing Hadoop 1,660 1,341 890
As % of all permanent jobs advertised in the UK 1.00% 1.16% 1.45%
As % of the Database & Business Intelligence category 3.66% 4.16% 5.19%
Number of salaries quoted 601 834 601
10th Percentile £48,750 £46,250 £45,000
25th Percentile £57,500 £53,750 £55,000
Median annual salary (50th Percentile) £77,500 £75,000 £72,500
Median % change year-on-year +3.33% +3.45% +3.57%
75th Percentile £100,000 £95,000 £95,000
90th Percentile £111,250 £110,000 £115,000
UK excluding London median annual salary £63,750 £60,000 £60,000
% change year-on-year +6.25% - +4.35%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 45,327 32,252 17,152
As % of all permanent IT jobs advertised in the UK 27.22% 27.92% 27.89%
Number of salaries quoted 20,559 21,204 14,096
10th Percentile £36,250 £35,000 £32,500
25th Percentile £45,000 £42,500 £41,250
Median annual salary (50th Percentile) £60,000 £55,000 £55,000
Median % change year-on-year +9.09% - +7.84%
75th Percentile £80,250 £75,000 £72,500
90th Percentile £96,250 £92,500 £87,500
UK excluding London median annual salary £52,500 £49,000 £47,500
% change year-on-year +7.14% +3.16% +5.56%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 17 August 2022.

Salary histogram for Hadoop in the UK

Hadoop
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 17 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
England -58 1,435 £80,000 +1.59% 96
London -59 1,039 £85,000 +6.25% 66
Work from Home -78 602 £75,000 -3.23% 33
UK excluding London -100 430 £63,750 +6.25% 30
South East -40 163 £63,750 -13.56% 9
North of England -42 79 £70,000 +21.74% 14
South West -22 63 £68,750 +10.50% 2
Midlands -83 54 £62,500 +8.70% 3
North West -43 42 £40,113 -31.72% 8
West Midlands -34 38 £86,500 +44.17% 3
Scotland -57 36 £60,000 +4.35% 1
East of England -57 29 £60,000 -43.53% 1
Yorkshire -34 25 £70,000 +21.74% 6
Wales -18 22 £50,000 +11.11%
East Midlands -28 16 £62,500 +16.82%
North East +3 12 £85,000 +49.35%
Northern Ireland -16 2 £73,000 +43.84%

For the 6 months to 17 August 2022, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,070 (64.46%) Apache Spark
2 1,065 (64.16%) Python
3 946 (56.99%) Big Data
4 939 (56.57%) AWS
5 904 (54.46%) SQL
6 892 (53.73%) Agile
7 840 (50.60%) Java
8 696 (41.93%) Azure
9 690 (41.57%) Analytics
10 681 (41.02%) Kafka
11 579 (34.88%) Finance
12 574 (34.58%) GCP
13 527 (31.75%) Data Science
14 524 (31.57%) NoSQL
15 482 (29.04%) ETL
16 429 (25.84%) Social Skills
17 423 (25.48%) Scala
18 421 (25.36%) Data Engineering
19 404 (24.34%) Machine Learning
19 404 (24.34%) Data Pipeline
20 399 (24.04%) DevOps
21 385 (23.19%) Apache Hive
22 384 (23.13%) CI/CD
23 367 (22.11%) Software Engineering
24 363 (21.87%) Data Warehouse
25 351 (21.14%) Linux
26 349 (21.02%) Data Lake
27 342 (20.60%) Kubernetes
28 332 (20.00%) Degree
29 328 (19.76%) Data Modelling

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,070 (64.46%) Apache Spark
2 245 (14.76%) Apache Airflow
3 233 (14.04%) Apache
4 74 (4.46%) Apache Pulsar
5 53 (3.19%) Apache Pig
6 43 (2.59%) Oracle Workflow
7 36 (2.17%) SAS
8 29 (1.75%) OpenStack
9 27 (1.63%) Luigi
10 25 (1.51%) Confluence
11 23 (1.39%) nginx
11 23 (1.39%) Tomcat
12 17 (1.02%) Cloud Foundry
13 13 (0.78%) Apache Solr
14 10 (0.60%) Jupyter
14 10 (0.60%) SharePoint
15 6 (0.36%) Oracle SOA Suite
15 6 (0.36%) Pachyderm
16 4 (0.24%) JBoss
17 2 (0.12%) WebLogic
Applications
1 30 (1.81%) Microsoft Excel
2 23 (1.39%) Microsoft Office
3 16 (0.96%) Microsoft PowerPoint
4 12 (0.72%) MS Visio
5 7 (0.42%) Campfire
5 7 (0.42%) Maple
6 5 (0.30%) SPSS
7 2 (0.12%) Photoshop
8 1 (0.060%) Gephi
Business Applications
1 19 (1.14%) Oracle Payables
2 17 (1.02%) Oracle BPM
3 5 (0.30%) SAP Oil and Gas
4 4 (0.24%) SAP Hybris
5 2 (0.12%) WebTrends
6 1 (0.060%) Actimize
6 1 (0.060%) Distributed Ledger
Cloud Services
1 939 (56.57%) AWS
2 696 (41.93%) Azure
3 574 (34.58%) GCP
4 131 (7.89%) Amazon Kinesis
4 131 (7.89%) Snowflake
5 123 (7.41%) Power Platform
6 120 (7.23%) Amazon S3
7 113 (6.81%) Cloud Computing
8 97 (5.84%) OpenShift
8 97 (5.84%) Serverless
9 91 (5.48%) Azure Synapse Analytics
10 69 (4.16%) GitHub
11 65 (3.92%) Azure Data Factory
12 61 (3.67%) Google Kubernetes Engine
12 61 (3.67%) SaaS
13 60 (3.61%) Google Data Studio
14 45 (2.71%) AWS CloudFormation
15 41 (2.47%) Azure DevOps
16 37 (2.23%) Amazon EMR
17 30 (1.81%) AWS Lambda
Communications & Networking
1 84 (5.06%) HTTP
2 57 (3.43%) TCP/IP
3 38 (2.29%) Firewall
4 24 (1.45%) Internet
5 20 (1.20%) DNS
6 12 (0.72%) Kerberos
7 10 (0.60%) VLAN
8 9 (0.54%) DHCP
9 7 (0.42%) Broadband
9 7 (0.42%) Network Security
10 6 (0.36%) AMQP
11 5 (0.30%) PPP
12 4 (0.24%) FCAPS
13 3 (0.18%) SMS
14 1 (0.060%) 3GPP
14 1 (0.060%) Modbus
14 1 (0.060%) MQTT
14 1 (0.060%) OpenLDAP
14 1 (0.060%) SAN
14 1 (0.060%) VPN
Database & Business Intelligence
1 946 (56.99%) Big Data
2 524 (31.57%) NoSQL
3 385 (23.19%) Apache Hive
4 363 (21.87%) Data Warehouse
5 349 (21.02%) Data Lake
6 299 (18.01%) MongoDB
7 255 (15.36%) Flink
8 254 (15.30%) Amazon Redshift
9 229 (13.80%) HBase
10 195 (11.75%) Relational Database
11 192 (11.57%) BigQuery
12 191 (11.51%) MySQL
13 190 (11.45%) Apache Cassandra
14 179 (10.78%) Tableau
15 175 (10.54%) Elasticsearch
16 157 (9.46%) PostgreSQL
17 140 (8.43%) SQL Server
18 127 (7.65%) Sqoop
19 123 (7.41%) Power BI
20 118 (7.11%) Presto
Development Applications
1 260 (15.66%) Jenkins
2 216 (13.01%) Git (software)
3 100 (6.02%) JUnit
4 91 (5.48%) Maven
5 76 (4.58%) JIRA
6 73 (4.40%) Atlassian Bamboo
6 73 (4.40%) Selenium
7 60 (3.61%) CircleCI
8 46 (2.77%) JMeter
9 45 (2.71%) WebDriver
10 44 (2.65%) Gradle
11 40 (2.41%) Bitbucket
12 37 (2.23%) Cucumber
13 27 (1.63%) GitLab
14 26 (1.57%) Postman
15 25 (1.51%) SoapUI
16 22 (1.33%) Travis CI
17 20 (1.20%) IBM UrbanCode
18 18 (1.08%) Spock
18 18 (1.08%) Subversion
General
1 579 (34.88%) Finance
2 429 (25.84%) Social Skills
3 244 (14.70%) Analytical Skills
4 174 (10.48%) Inclusion and Diversity
5 151 (9.10%) Banking
6 115 (6.93%) Retail
7 95 (5.72%) Games
8 90 (5.42%) Law
9 81 (4.88%) Marketing
10 67 (4.04%) Advertising
11 66 (3.98%) Public Sector
12 61 (3.67%) Telecoms
13 60 (3.61%) Legal
14 29 (1.75%) Automotive
15 27 (1.63%) Billing
15 27 (1.63%) Electronics
16 26 (1.57%) Financial Institution
17 25 (1.51%) Local Government
17 25 (1.51%) Presentation Skills
18 23 (1.39%) Manufacturing
Job Titles
1 578 (34.82%) Data Engineer
2 195 (11.75%) Software Engineer
3 162 (9.76%) Architect
4 161 (9.70%) Senior Data Engineer
5 156 (9.40%) Developer
6 116 (6.99%) Java Developer
7 105 (6.33%) Big Data Engineer
8 83 (5.00%) Data Manager
9 78 (4.70%) Analyst
10 70 (4.22%) Data Architect
11 69 (4.16%) Data Scientist
11 69 (4.16%) DevOps Engineer
12 66 (3.98%) Consultant
13 62 (3.73%) Data Consultant
14 52 (3.13%) Senior Developer
15 51 (3.07%) Senior Analyst
16 50 (3.01%) Engineering Manager
17 47 (2.83%) Development Engineer
17 47 (2.83%) Java Engineer
17 47 (2.83%) Software Development Engineer
Libraries, Frameworks & Software Standards
1 681 (41.02%) Kafka
2 189 (11.39%) Spring
3 170 (10.24%) REST
4 150 (9.04%) Web Services
5 148 (8.92%) PySpark
6 125 (7.53%) Apache Beam
7 95 (5.72%) Apache Thrift
8 88 (5.30%) JSON
9 86 (5.18%) Spring Boot
10 81 (4.88%) Apache NiFi
11 77 (4.64%) Spark Streaming
12 73 (4.40%) RabbitMQ
13 68 (4.10%) TensorFlow
14 65 (3.92%) RESTful
15 63 (3.80%) JMS
16 56 (3.37%) AngularJS
16 56 (3.37%) HTML
16 56 (3.37%) OAuth
17 55 (3.31%) Node.js
17 55 (3.31%) Protocol Buffers
Miscellaneous
1 159 (9.58%) Algorithms
2 126 (7.59%) Public Cloud
3 123 (7.41%) Data Structures
4 86 (5.18%) Social Media
5 84 (5.06%) Social Network
6 77 (4.64%) Hackathon
7 65 (3.92%) Cloud Native
8 61 (3.67%) Blog
9 52 (3.13%) Greenfield Project
10 45 (2.71%) Cyberattack
11 43 (2.59%) Cyber Defence
12 35 (2.11%) User Experience
13 34 (2.05%) Private Cloud
13 34 (2.05%) Self-Motivation
14 32 (1.93%) Cybercrime
15 27 (1.63%) Hybrid Cloud
16 26 (1.57%) Linux Command Line
17 25 (1.51%) Blockchain
18 24 (1.45%) Management Information System
18 24 (1.45%) Virtual Team
Operating Systems
1 351 (21.14%) Linux
2 96 (5.78%) Unix
3 89 (5.36%) Windows
4 55 (3.31%) CentOS
5 22 (1.33%) Android
6 13 (0.78%) Red Hat Enterprise Linux
6 13 (0.78%) Ubuntu
7 7 (0.42%) Apple iOS
8 4 (0.24%) SUSE
9 3 (0.18%) VMS
10 2 (0.12%) Mac OS X
11 1 (0.060%) MVS
11 1 (0.060%) Windows Server
Processes & Methodologies
1 892 (53.73%) Agile
2 690 (41.57%) Analytics
3 527 (31.75%) Data Science
4 482 (29.04%) ETL
5 421 (25.36%) Data Engineering
6 404 (24.34%) Data Pipeline
6 404 (24.34%) Machine Learning
7 399 (24.04%) DevOps
8 384 (23.13%) CI/CD
9 367 (22.11%) Software Engineering
10 328 (19.76%) Data Modelling
11 315 (18.98%) Computer Science
12 284 (17.11%) Data Architecture
13 276 (16.63%) Microservices
14 274 (16.51%) Test Automation
15 258 (15.54%) Continuous Integration
16 248 (14.94%) Data Management
17 245 (14.76%) Visualisation
18 239 (14.40%) Scrum
19 209 (12.59%) Containerisation
Programming Languages
1 1,065 (64.16%) Python
2 904 (54.46%) SQL
3 840 (50.60%) Java
4 423 (25.48%) Scala
5 213 (12.83%) R
6 125 (7.53%) JavaScript
7 114 (6.87%) Bash
8 86 (5.18%) Go
9 75 (4.52%) C#
10 63 (3.80%) C++
11 50 (3.01%) Groovy
12 40 (2.41%) Shell Script
13 38 (2.29%) TypeScript
14 23 (1.39%) C
15 19 (1.14%) Perl
15 19 (1.14%) T-SQL
16 17 (1.02%) HiveQL
17 16 (0.96%) Ruby
17 16 (0.96%) SPARQL
18 15 (0.90%) MATLAB
Qualifications
1 332 (20.00%) Degree
2 162 (9.76%) Computer Science Degree
3 131 (7.89%) Master's Degree
4 74 (4.46%) Security Cleared
5 59 (3.55%) SC Cleared
6 47 (2.83%) PhD
7 37 (2.23%) AWS Certification
8 28 (1.69%) AWS Certified Solutions Architect
9 21 (1.27%) RHCE
10 16 (0.96%) Numerate Degree
11 12 (0.72%) Azure Certification
12 10 (0.60%) MBA
13 7 (0.42%) TOGAF Certification
14 6 (0.36%) CISSP
14 6 (0.36%) CRISC
14 6 (0.36%) DV Cleared
15 4 (0.24%) PMI Certification
16 2 (0.12%) FFIEC
16 2 (0.12%) Microsoft Certification
16 2 (0.12%) PMP
Quality Assurance & Compliance
1 124 (7.47%) Data Quality
2 69 (4.16%) QA
3 44 (2.65%) GDPR
4 21 (1.27%) ISO/IEC 27001
5 7 (0.42%) NIST
6 5 (0.30%) PCI DSS
7 3 (0.18%) SLA
8 2 (0.12%) GLBA
8 2 (0.12%) MiFID
9 1 (0.060%) Accessibility
System Software
1 321 (19.34%) Docker
2 127 (7.65%) Apache Flume
3 92 (5.54%) Apache ZooKeeper
4 55 (3.31%) HDFS
5 52 (3.13%) VMware Infrastructure
6 21 (1.27%) Active Directory
7 19 (1.14%) vSphere
8 18 (1.08%) GlusterFS
9 11 (0.66%) Virtual Machines
10 3 (0.18%) VirtualBox
11 1 (0.060%) Hyper-V
11 1 (0.060%) Microsoft Virtual Server
11 1 (0.060%) Virtual Servers
Systems Management
1 342 (20.60%) Kubernetes
2 190 (11.45%) Ansible
3 180 (10.84%) Terraform
4 107 (6.45%) Oozie
5 90 (5.42%) Puppet
6 51 (3.07%) Opscode Chef
7 43 (2.59%) Prometheus
8 36 (2.17%) Grafana
9 32 (1.93%) HAProxy
10 27 (1.63%) Hadoop YARN
11 18 (1.08%) Single Sign-On
12 13 (0.78%) Docker Swarm
13 11 (0.66%) Kubeflow
14 10 (0.60%) Graphite
14 10 (0.60%) Salt
15 8 (0.48%) Istio
16 2 (0.12%) Control-M
16 2 (0.12%) Kibana
17 1 (0.060%) Mesos
17 1 (0.060%) ZABBIX
Vendors
1 294 (17.71%) Google
2 281 (16.93%) Databricks
3 245 (14.76%) Oracle
4 152 (9.16%) Microsoft
5 137 (8.25%) Cloudera
6 131 (7.89%) Teradata
7 108 (6.51%) Splunk
8 57 (3.43%) VMware
9 43 (2.59%) Salesforce.com
10 40 (2.41%) F5
11 38 (2.29%) Red Hat
12 33 (1.99%) Cisco
12 33 (1.99%) Talend
13 29 (1.75%) Alteryx
14 27 (1.63%) New Relic
15 25 (1.51%) CA Agile Central
15 25 (1.51%) FIS
15 25 (1.51%) IBM
16 24 (1.45%) Dell
16 24 (1.45%) Informatica
103 Hadoop job vacancies Nationwide