Apache Hadoop
UK

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 6 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
6 May 2024
Same period 2023 Same period 2022
Rank 454 420 323
Rank change year-on-year -34 -97 -126
Contract jobs citing Hadoop 124 320 759
As % of all contract jobs advertised in the UK 0.29% 0.54% 0.86%
As % of the Database & Business Intelligence category 1.69% 3.03% 4.26%
Number of daily rates quoted 86 231 466
10th Percentile £334 £469 £425
25th Percentile £383 £513 £513
Median daily rate (50th Percentile) £500 £575 £600
Median % change year-on-year -13.04% -4.17% +9.09%
75th Percentile £629 £688 £718
90th Percentile £763 £750 £811
UK excluding London median daily rate £475 £540 £540
% change year-on-year -12.04% - +8.00%
Number of hourly rates quoted 5 9 2
10th Percentile - £76.50 £57.68
25th Percentile £41.25 - £57.94
Median hourly rate £45.00 £78.00 £60.25
Median % change year-on-year -42.31% +29.46% +123.15%
75th Percentile £52.50 £90.00 £62.31
90th Percentile £62.25 - £62.43
UK excluding London median hourly rate £67.50 £78.00 -
% change year-on-year -13.46% - -

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,337 10,575 17,822
As % of all contract IT jobs advertised in the UK 16.91% 17.90% 20.08%
Number of daily rates quoted 5,241 7,524 12,672
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £550
Median % change year-on-year -2.78% -1.82% +10.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.00%
Number of hourly rates quoted 143 186 186
10th Percentile £14.00 £21.24 £14.78
25th Percentile £20.98 £33.05 £21.91
Median hourly rate £40.00 £59.30 £43.38
Median % change year-on-year -32.54% +36.70% +60.89%
75th Percentile £58.88 £73.41 £62.41
90th Percentile £72.50 £81.25 £74.75
UK excluding London median hourly rate £40.00 £55.70 £35.00
% change year-on-year -28.19% +59.14% +42.86%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop.

Daily rate trend for Hadoop in the UK

Hadoop
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop over the 6 months to 6 May 2024.

Daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Hadoop.

Hourly rate trend for Hadoop in the UK

Hadoop
Hourly Rate Histogram

Hourly rate distribution of jobs citing Hadoop over the 6 months to 6 May 2024.

Hourly rate histogram for Hadoop in the UK

Hadoop
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 6 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -60 105 £500 -13.04% 72
London -10 60 £550 -5.78% 36
UK excluding London +10 45 £475 -12.04% 42
Work from Home +26 41 £500 -13.04% 72
Midlands +25 16 £413 -23.61% 4
East Midlands +30 13 £380 -5.00% 1
North of England +21 11 £500 +5.26% 12
North West +21 9 £535 +12.63% 7
South East +7 6 £463 -19.57% 9
East of England +7 5 £350 -36.36% 5
Scotland +40 4 £608 +9.95% 5
West Midlands +3 3 £550 +1.85% 3
Yorkshire +20 2 £425 -19.05% 2
South West 0 2 £541 -17.84% 4
Northern Ireland +7 1 £425 - 2

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 61 (49.19%) Apache Spark
2 17 (13.71%) Apache
3 9 (7.26%) Apache Airflow
4 5 (4.03%) Confluence
5 3 (2.42%) SAS
6 2 (1.61%) Apache Solr
7 1 (0.81%) Apache Pulsar
7 1 (0.81%) Cloud Foundry
7 1 (0.81%) Luigi
Business Applications
1 1 (0.81%) SAP Hybris
Cloud Services
1 34 (27.42%) AWS
2 23 (18.55%) Azure
3 17 (13.71%) GCP
3 17 (13.71%) PaaS
4 10 (8.06%) Amazon S3
5 7 (5.65%) Amazon EMR
5 7 (5.65%) AWS Lambda
5 7 (5.65%) Serverless
6 6 (4.84%) Snowflake
7 5 (4.03%) Amazon EC2
7 5 (4.03%) Azure Synapse Analytics
8 4 (3.23%) Cloud Computing
8 4 (3.23%) Power Platform
9 3 (2.42%) Amazon EKS
9 3 (2.42%) Amazon Kinesis
9 3 (2.42%) AWS Data Pipeline
9 3 (2.42%) Google Kubernetes Engine
9 3 (2.42%) OpenShift
9 3 (2.42%) Virtual Private Cloud
10 2 (1.61%) AWS CloudFormation
Communications & Networking
1 16 (12.90%) FTP
2 4 (3.23%) Firewall
2 4 (3.23%) Intrusion Detection
2 4 (3.23%) TCP/IP
2 4 (3.23%) tcpdump
2 4 (3.23%) Wireshark
3 2 (1.61%) DHCP
3 2 (1.61%) DNS
3 2 (1.61%) Internet
Database & Business Intelligence
1 71 (57.26%) Big Data
2 31 (25.00%) Apache Hive
3 26 (20.97%) Data Warehouse
4 24 (19.35%) Tableau
5 17 (13.71%) Impala
6 15 (12.10%) Amazon Redshift
7 13 (10.48%) HBase
8 10 (8.06%) Data Lake
9 9 (7.26%) PostgreSQL
9 9 (7.26%) Relational Database
10 8 (6.45%) Apache Cassandra
10 8 (6.45%) MySQL
10 8 (6.45%) Sqoop
11 7 (5.65%) MongoDB
11 7 (5.65%) Presto
11 7 (5.65%) SQL Server
12 6 (4.84%) Amazon Athena
12 6 (4.84%) NoSQL
13 5 (4.03%) BigQuery
13 5 (4.03%) Spark SQL
Development Applications
1 13 (10.48%) Git
1 13 (10.48%) JIRA
2 8 (6.45%) Jenkins
2 8 (6.45%) Maven
3 6 (4.84%) GitLab
3 6 (4.84%) Subversion
4 5 (4.03%) TeamCity
5 4 (3.23%) IDA Disassembler
6 3 (2.42%) Cypress.io
7 2 (1.61%) Bitbucket
7 2 (1.61%) Gradle
7 2 (1.61%) Liquibase
General
1 50 (40.32%) Analytical Skills
2 42 (33.87%) Social Skills
3 32 (25.81%) Finance
4 13 (10.48%) Banking
5 10 (8.06%) Public Sector
6 8 (6.45%) Manufacturing
7 6 (4.84%) Telecoms
8 5 (4.03%) Investment Banking
8 5 (4.03%) Presentation Skills
9 4 (3.23%) Electronics
9 4 (3.23%) Marketing
10 2 (1.61%) Legal
10 2 (1.61%) Organisational Skills
11 1 (0.81%) Corporate Banking
11 1 (0.81%) Inclusion and Diversity
11 1 (0.81%) Law
11 1 (0.81%) Retail
Job Titles
1 21 (16.94%) Developer
2 16 (12.90%) Implementation Specialist
3 15 (12.10%) Architect
4 14 (11.29%) Data Engineer
4 14 (11.29%) Data Scientist
4 14 (11.29%) Senior
5 13 (10.48%) Analyst
6 12 (9.68%) Data Analyst
7 8 (6.45%) Data Architect
8 5 (4.03%) Hadoop Developer
8 5 (4.03%) Senior Analyst
8 5 (4.03%) Senior Data Analyst
9 4 (3.23%) Business Data Analyst
9 4 (3.23%) Solutions Architect
10 3 (2.42%) Banking Analyst
10 3 (2.42%) Business Analyst
10 3 (2.42%) Consultant
10 3 (2.42%) Scala Developer
10 3 (2.42%) Senior Developer
10 3 (2.42%) Talend Developer
Libraries, Frameworks & Software Standards
1 32 (25.81%) Kafka
2 18 (14.52%) LDAP
3 10 (8.06%) PySpark
4 5 (4.03%) Apache NiFi
4 5 (4.03%) Elastic Stack
5 4 (3.23%) JSON
5 4 (3.23%) OLE
5 4 (3.23%) XML
6 3 (2.42%) .NET
6 3 (2.42%) .NET Core
7 2 (1.61%) Apache Avro
7 2 (1.61%) Flask
7 2 (1.61%) Java Concurrency
7 2 (1.61%) REST
8 1 (0.81%) Anaconda
8 1 (0.81%) NumPy
8 1 (0.81%) Pandas
8 1 (0.81%) pytest
8 1 (0.81%) SAML
8 1 (0.81%) TensorFlow
Miscellaneous
1 20 (16.13%) Algorithms
2 16 (12.90%) Replication
3 9 (7.26%) Cloud Native
4 8 (6.45%) Self-Motivation
5 4 (3.23%) Cyber Kill Chain
5 4 (3.23%) Data Structures
5 4 (3.23%) Public Cloud
5 4 (3.23%) YARA
6 3 (2.42%) Derivative
6 3 (2.42%) Distributed Systems
6 3 (2.42%) Management Information System
6 3 (2.42%) Social Media
7 2 (1.61%) Cyber Threat
7 2 (1.61%) Data Centre
7 2 (1.61%) Data Protection Act
7 2 (1.61%) Market Risk
7 2 (1.61%) Onboarding
7 2 (1.61%) Virtual Team
8 1 (0.81%) Analytical Mindset
8 1 (0.81%) Mobile App
Operating Systems
1 27 (21.77%) Linux
2 24 (19.35%) Unix
3 20 (16.13%) Windows
Processes & Methodologies
1 33 (26.61%) Agile
1 33 (26.61%) Data Modelling
2 32 (25.81%) Problem-Solving
3 30 (24.19%) ETL
4 28 (22.58%) Analytics
5 27 (21.77%) Computer Science
5 27 (21.77%) Data Science
6 26 (20.97%) Machine Learning
7 25 (20.16%) Business Intelligence
7 25 (20.16%) CI/CD
8 24 (19.35%) Data Analysis
9 21 (16.94%) Visualisation
10 20 (16.13%) Mathematics
11 19 (15.32%) Data Pipeline
11 19 (15.32%) Data Visualisation
11 19 (15.32%) Migration
11 19 (15.32%) Statistics
12 17 (13.71%) Capacity Management
12 17 (13.71%) Disaster Recovery
13 16 (12.90%) Data Engineering
Programming Languages
1 68 (54.84%) Python
2 50 (40.32%) SQL
3 32 (25.81%) Java
4 23 (18.55%) Scala
5 16 (12.90%) R
6 9 (7.26%) Perl
7 7 (5.65%) Shell Script
8 5 (4.03%) JavaScript
9 4 (3.23%) Bash
9 4 (3.23%) PL/SQL
10 3 (2.42%) C#
10 3 (2.42%) Groovy
11 2 (1.61%) Go
11 2 (1.61%) Haskell
11 2 (1.61%) Ruby
11 2 (1.61%) TypeScript
11 2 (1.61%) U-SQL
12 1 (0.81%) HiveQL
12 1 (0.81%) PowerShell
Qualifications
1 21 (16.94%) Degree
2 13 (10.48%) Computer Science Degree
3 8 (6.45%) Security Cleared
4 4 (3.23%) DV Cleared
4 4 (3.23%) Numerate Degree
5 3 (2.42%) SC Cleared
6 2 (1.61%) AWS Certification
6 2 (1.61%) Master's Degree
7 1 (0.81%) AWS Certified Solutions Architect
7 1 (0.81%) OCP
7 1 (0.81%) Oracle Certification
Quality Assurance & Compliance
1 17 (13.71%) Data Quality
2 6 (4.84%) GDPR
2 6 (4.84%) NIST
3 4 (3.23%) QA
4 2 (1.61%) ISO/IEC 27001
4 2 (1.61%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
4 2 (1.61%) PCI DSS
5 1 (0.81%) Accessibility
5 1 (0.81%) EMIR
5 1 (0.81%) FATCA
5 1 (0.81%) MiFID
System Software
1 32 (25.81%) HDFS
2 16 (12.90%) Active Directory
2 16 (12.90%) NFS
3 8 (6.45%) Docker
4 4 (3.23%) Snort
5 1 (0.81%) Apache Flume
5 1 (0.81%) Apache ZooKeeper
Systems Management
1 12 (9.68%) Kubernetes
2 8 (6.45%) Hadoop YARN
3 6 (4.84%) Ansible
4 5 (4.03%) Kibana
5 3 (2.42%) Oozie
5 3 (2.42%) Terraform
6 2 (1.61%) Ambari
6 2 (1.61%) Grafana
6 2 (1.61%) Progress Chef
6 2 (1.61%) Puppet
7 1 (0.81%) ITRS Geneos
7 1 (0.81%) Prometheus
Vendors
1 16 (12.90%) Isilon
2 15 (12.10%) Oracle
3 12 (9.68%) Databricks
4 11 (8.87%) SAP
5 8 (6.45%) Google
5 8 (6.45%) Informatica
5 8 (6.45%) Splunk
5 8 (6.45%) Teradata
6 7 (5.65%) Dell
7 6 (4.84%) Talend
8 4 (3.23%) Foundry
8 4 (3.23%) Microsoft
8 4 (3.23%) Palantir
9 3 (2.42%) Ab Initio
9 3 (2.42%) Cloudera
10 2 (1.61%) Adobe
10 2 (1.61%) Confluent
10 2 (1.61%) IBM
10 2 (1.61%) Salesforce
10 2 (1.61%) StreamSets