Period
to 21 April 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 April 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
21 Apr 2021
Same period 2020 Same period 2019
Rank 283 242 185
Rank change year-on-year -41 -57 +1
Permanent jobs citing Hadoop 855 1,370 2,628
As % of all permanent jobs advertised in England 1.14% 1.37% 1.91%
As % of the Database & Business Intelligence category 4.30% 5.08% 6.77%
Number of salaries quoted 639 1,042 2,031
10th Percentile £46,250 £46,368 £43,000
25th Percentile £53,750 £55,000 £53,750
Median annual salary (50th Percentile) £72,500 £70,000 £70,000
Median % change year-on-year +3.57% - +3.70%
75th Percentile £92,625 £86,250 £87,500
90th Percentile £110,000 £110,000 £105,000
UK median annual salary £70,000 £70,000 £70,000

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 19,873 26,974 38,845
As % of all permanent IT jobs advertised in England 26.53% 26.94% 28.24%
Number of salaries quoted 16,182 22,414 32,318
10th Percentile £33,750 £32,500 £31,250
25th Percentile £42,500 £40,000 £38,750
Median annual salary (50th Percentile) £55,000 £54,671 £52,500
Median % change year-on-year +0.60% +4.13% +5.00%
75th Percentile £75,000 £72,500 £71,250
90th Percentile £90,000 £90,000 £86,250
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 21 April 2021.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 21 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -4 586 £77,500 +6.90% 98
South East -21 74 £65,000 +6.56% 14
South West -7 62 £75,000 +30.43% 4
North of England +5 56 £57,500 +9.52% 13
Midlands -49 42 £57,500 -19.30% 10
North West +44 30 £60,000 +26.98% 7
Yorkshire -9 26 £55,000 +0.60% 6
West Midlands -22 23 £60,000 - 8
East of England +41 19 £65,000 -13.33% 10
East Midlands -36 19 £54,500 -27.33% 2
Hadoop
UK

For the 6 months to 21 April 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 555 (64.91%) Big Data
2 538 (62.92%) Apache Spark
3 529 (61.87%) Python
4 446 (52.16%) AWS
5 427 (49.94%) SQL
6 404 (47.25%) Java
7 351 (41.05%) Azure
8 334 (39.06%) Agile Software Development
9 320 (37.43%) Kafka
10 304 (35.56%) Analytics
11 272 (31.81%) GCP
11 272 (31.81%) NoSQL
12 271 (31.70%) ETL
13 268 (31.35%) Kubernetes
14 262 (30.64%) Docker
15 243 (28.42%) Software Engineering
16 225 (26.32%) Data Science
17 213 (24.91%) Apache Hive
18 209 (24.44%) Data Engineering
19 168 (19.65%) DevOps
20 159 (18.60%) Finance
21 157 (18.36%) Scala
22 152 (17.78%) Artificial Intelligence
23 148 (17.31%) Ansible
24 147 (17.19%) Terraform
25 146 (17.08%) Google
26 144 (16.84%) Amazon Redshift
27 141 (16.49%) Jenkins
28 140 (16.37%) Business Intelligence
29 138 (16.14%) Machine Learning

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 538 (62.92%) Apache Spark
2 74 (8.65%) Apache
3 72 (8.42%) Apache Airflow
4 64 (7.49%) Elasticsearch
4 64 (7.49%) SAS
5 40 (4.68%) Luigi
6 33 (3.86%) Apache Pig
7 16 (1.87%) Confluence
8 12 (1.40%) IIS
8 12 (1.40%) Oracle Workflow
9 9 (1.05%) OpenStack
10 8 (0.94%) Oracle SOA Suite
11 7 (0.82%) Cloud Foundry
11 7 (0.82%) CloudStack
11 7 (0.82%) nginx
11 7 (0.82%) WebLogic
12 6 (0.70%) Jupyter
12 6 (0.70%) Tornado
13 3 (0.35%) JBoss
13 3 (0.35%) WebSphere
Applications
1 8 (0.94%) SPSS
2 6 (0.70%) Microsoft Office
3 3 (0.35%) Microsoft Excel
4 2 (0.23%) Chatbot
4 2 (0.23%) Microsoft PowerPoint
5 1 (0.12%) Microsoft Project
5 1 (0.12%) MS Visio
Business Applications
1 4 (0.47%) Oracle EBS
2 1 (0.12%) Dynamics CRM
2 1 (0.12%) SAP APO
2 1 (0.12%) SAP Hybris
Cloud Services
1 446 (52.16%) AWS
2 351 (41.05%) Azure
3 272 (31.81%) GCP
4 76 (8.89%) Amazon EMR
5 73 (8.54%) Power Platform
6 53 (6.20%) Serverless
7 51 (5.96%) IBM Cloud
8 40 (4.68%) Amazon Kinesis
9 38 (4.44%) SaaS
10 33 (3.86%) Azure Data Factory
11 30 (3.51%) Cloud Functions
12 24 (2.81%) AWS Lambda
13 22 (2.57%) Amazon EC2
13 22 (2.57%) Amazon S3
14 20 (2.34%) Azure Synapse Analytics
14 20 (2.34%) Google Compute Engine
15 19 (2.22%) Google App Engine
15 19 (2.22%) Google Container Engine
16 17 (1.99%) PaaS
17 14 (1.64%) AWS CloudFormation
Communications & Networking
1 16 (1.87%) Firewall
1 16 (1.87%) HTTP
1 16 (1.87%) Internet
2 13 (1.52%) FTP
3 11 (1.29%) TCP/IP
4 7 (0.82%) VLAN
4 7 (0.82%) Wireless
5 5 (0.58%) DNS
6 4 (0.47%) 802.11
6 4 (0.47%) Fibre Channel
6 4 (0.47%) LAN
6 4 (0.47%) SAN
6 4 (0.47%) SNMP
6 4 (0.47%) SSH
6 4 (0.47%) WAN
7 3 (0.35%) DMZ
7 3 (0.35%) Reverse Proxy
7 3 (0.35%) Software-Defined Networking
7 3 (0.35%) VPN
8 2 (0.23%) SMS
Database & Business Intelligence
1 555 (64.91%) Big Data
2 272 (31.81%) NoSQL
3 213 (24.91%) Apache Hive
4 144 (16.84%) Amazon Redshift
5 135 (15.79%) MongoDB
6 132 (15.44%) Data Warehouse
7 118 (13.80%) Apache Cassandra
7 118 (13.80%) Data Lake
8 106 (12.40%) SQL Server
9 78 (9.12%) Amazon Athena
9 78 (9.12%) HBase
10 76 (8.89%) PostgreSQL
11 75 (8.77%) Relational Database
12 73 (8.54%) Power BI
13 71 (8.30%) Tableau
14 63 (7.37%) MySQL
15 57 (6.67%) Neo4j
16 53 (6.20%) Electronic Patient Records
16 53 (6.20%) SQL Server Integration Services
17 50 (5.85%) Data Mining
Development Applications
1 141 (16.49%) Jenkins
2 73 (8.54%) Atlassian Bamboo
3 71 (8.30%) Git (software)
4 56 (6.55%) Vagrant
5 49 (5.73%) Maven
6 27 (3.16%) JIRA
7 23 (2.69%) Bitbucket
8 22 (2.57%) JMeter
9 21 (2.46%) Gradle
10 17 (1.99%) SonarQube
11 15 (1.75%) TeamCity
12 14 (1.64%) Artifactory
12 14 (1.64%) Postman
13 13 (1.52%) Cucumber
14 12 (1.40%) JUnit
14 12 (1.40%) Selenium
14 12 (1.40%) Team Foundation Server
15 11 (1.29%) Cypress.io
16 10 (1.17%) ERwin
16 10 (1.17%) Visual Studio
General
1 159 (18.60%) Finance
2 76 (8.89%) Banking
3 38 (4.44%) Retail
4 32 (3.74%) Telecoms
5 30 (3.51%) Marketing
6 29 (3.39%) Games
7 23 (2.69%) Public Sector
8 22 (2.57%) Law
9 21 (2.46%) Advertising
10 14 (1.64%) Legal
11 13 (1.52%) Front Office
11 13 (1.52%) Investment Banking
11 13 (1.52%) Manufacturing
12 11 (1.29%) Retail Banking
13 7 (0.82%) Electronics
14 4 (0.47%) Automotive
14 4 (0.47%) Financial Institution
15 3 (0.35%) Military
16 2 (0.23%) Back Office
16 2 (0.23%) Pharmaceutical
Job Titles
1 306 (35.79%) Data Engineer
2 182 (21.29%) Developer
3 98 (11.46%) Big Data Engineer
4 88 (10.29%) Architect
5 80 (9.36%) Java Developer
6 69 (8.07%) Data Architect
7 65 (7.60%) Java Engineer
8 61 (7.13%) Software Engineer
9 50 (5.85%) Platform Engineer
10 49 (5.73%) Data Scientist
11 48 (5.61%) Senior Data Engineer
12 46 (5.38%) AWS Engineer
13 43 (5.03%) Python Developer
14 40 (4.68%) Full Stack Developer
15 39 (4.56%) Consultant
15 39 (4.56%) JavaScript Developer
16 37 (4.33%) Java Software Engineer
16 37 (4.33%) Senior Developer
17 31 (3.63%) DevOps Engineer
18 25 (2.92%) Big Data Software Engineer
Libraries, Frameworks & Software Standards
1 320 (37.43%) Kafka
2 83 (9.71%) Node.js
3 80 (9.36%) React
4 73 (8.54%) AngularJS
5 71 (8.30%) Spark Streaming
6 67 (7.84%) REST
7 65 (7.60%) Web Services
8 56 (6.55%) Spring Boot
9 54 (6.32%) Spring
10 41 (4.80%) Vue.js
11 39 (4.56%) KnockoutJS
12 33 (3.86%) TensorFlow
13 30 (3.51%) RabbitMQ
14 28 (3.27%) HTML
14 28 (3.27%) RESTful
15 26 (3.04%) ActiveMQ
15 26 (3.04%) JSON
16 25 (2.92%) Apache NiFi
16 25 (2.92%) CSS
17 21 (2.46%) JMS
Miscellaneous
1 91 (10.64%) Analytical Skills
2 36 (4.21%) Hybrid Cloud
3 31 (3.63%) Algorithms
4 30 (3.51%) Data Structures
5 29 (3.39%) Self-Motivation
6 21 (2.46%) Hedge funds
7 18 (2.11%) Equities
8 17 (1.99%) Virtual Team
9 15 (1.75%) Private Cloud
9 15 (1.75%) Public Cloud
10 14 (1.64%) Cloud Native
10 14 (1.64%) Greenfield Project
10 14 (1.64%) Video on Demand
11 12 (1.40%) Cyberattack
11 12 (1.40%) Data Centre
12 11 (1.29%) Management Information System
13 10 (1.17%) Credit Risk
14 9 (1.05%) Market Risk
15 7 (0.82%) Derivative
15 7 (0.82%) Replication
Operating Systems
1 98 (11.46%) Linux
2 62 (7.25%) Unix
3 27 (3.16%) Red Hat Enterprise Linux
4 22 (2.57%) Windows
5 20 (2.34%) CentOS
6 5 (0.58%) Windows Server
6 5 (0.58%) Windows Server 2016
7 4 (0.47%) Ubuntu
8 3 (0.35%) Oracle Linux
9 1 (0.12%) AIX
9 1 (0.12%) Solaris
Processes & Methodologies
1 334 (39.06%) Agile Software Development
2 304 (35.56%) Analytics
3 271 (31.70%) ETL
4 243 (28.42%) Software Engineering
5 225 (26.32%) Data Science
6 209 (24.44%) Data Engineering
7 168 (19.65%) DevOps
8 152 (17.78%) Artificial Intelligence
9 140 (16.37%) Business Intelligence
10 138 (16.14%) Machine Learning
11 136 (15.91%) Microservices
12 117 (13.68%) Visualisation
13 109 (12.75%) Continuous Integration
14 103 (12.05%) Open Source
15 97 (11.35%) Computer Science
16 91 (10.64%) Configuration Management
16 91 (10.64%) Fintech
17 89 (10.41%) Data Analytics
18 88 (10.29%) Data Modelling
19 83 (9.71%) Data Architecture
Programming Languages
1 529 (61.87%) Python
2 427 (49.94%) SQL
3 404 (47.25%) Java
4 157 (18.36%) Scala
5 105 (12.28%) JavaScript
6 94 (10.99%) C#
7 63 (7.37%) R
8 51 (5.96%) Bash Shell
9 36 (4.21%) C++
10 34 (3.98%) Java 8
11 31 (3.63%) PL/SQL
11 31 (3.63%) TypeScript
12 27 (3.16%) Perl
13 25 (2.92%) HiveQL
13 25 (2.92%) PHP
14 23 (2.69%) C
15 20 (2.34%) Shell Script
16 18 (2.11%) Kotlin
17 17 (1.99%) ES6
18 16 (1.87%) Go
Qualifications
1 108 (12.63%) Degree
2 51 (5.96%) Computer Science Degree
3 39 (4.56%) Security Cleared
4 27 (3.16%) PhD
5 20 (2.34%) SC Cleared
6 17 (1.99%) DV Cleared
7 11 (1.29%) BPSS Clearance
8 4 (0.47%) TOGAF Certification
9 2 (0.23%) DBS Check
9 2 (0.23%) SAS Certification
10 1 (0.12%) AWS Certification
10 1 (0.12%) HND
10 1 (0.12%) Master's Degree
Quality Assurance & Compliance
1 39 (4.56%) QA
2 26 (3.04%) Data Quality
3 5 (0.58%) SLA
4 4 (0.47%) ISO/IEC 27001
5 3 (0.35%) GDPR
6 1 (0.12%) COBIT
6 1 (0.12%) ISO 9001
6 1 (0.12%) NIST
System Software
1 262 (30.64%) Docker
2 73 (8.54%) HDFS
3 54 (6.32%) VirtualBox
4 26 (3.04%) Apache ZooKeeper
5 13 (1.52%) Apache Flume
6 8 (0.94%) VMware Infrastructure
7 7 (0.82%) Oracle RAC
8 6 (0.70%) Active Directory
9 1 (0.12%) NFS
9 1 (0.12%) oVirt
Systems Management
1 268 (31.35%) Kubernetes
2 148 (17.31%) Ansible
3 147 (17.19%) Terraform
4 54 (6.32%) Docker Swarm
5 45 (5.26%) Puppet
6 35 (4.09%) Opscode Chef
7 20 (2.34%) Hadoop YARN
8 13 (1.52%) Oozie
9 12 (1.40%) Prometheus
10 11 (1.29%) Nagios
11 7 (0.82%) Data Guard
11 7 (0.82%) Graphite
11 7 (0.82%) ITRS Geneos
11 7 (0.82%) Opsview
12 6 (0.70%) Oracle RMAN
13 2 (0.23%) ZABBIX
14 1 (0.12%) Cobbler
14 1 (0.12%) Control-M
14 1 (0.12%) logstash
14 1 (0.12%) SCCM
Vendors
1 146 (17.08%) Google
2 137 (16.02%) Cloudera
3 107 (12.51%) Oracle
4 106 (12.40%) Talend
5 99 (11.58%) Informatica
6 74 (8.65%) Microsoft
7 72 (8.42%) Databricks
8 63 (7.37%) Hortonworks
9 59 (6.90%) IBM
10 40 (4.68%) Teradata
11 18 (2.11%) Red Hat
11 18 (2.11%) SAP
11 18 (2.11%) Splunk
12 13 (1.52%) Salesforce.com
12 13 (1.52%) VMware
13 9 (1.05%) Alteryx
14 8 (0.94%) AppDynamics
15 6 (0.70%) Ab Initio
15 6 (0.70%) Facebook
15 6 (0.70%) Marin