Apache Hadoop
UK

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 475 417 312
Rank change year-on-year -58 -105 -117
Contract jobs citing Hadoop 123 323 781
As % of all contract jobs advertised in the UK 0.28% 0.54% 0.88%
As % of the Database & Business Intelligence category 1.70% 3.00% 4.36%
Number of daily rates quoted 86 232 480
10th Percentile £303 £469 £425
25th Percentile £391 £513 £513
Median daily rate (50th Percentile) £505 £575 £600
Median % change year-on-year -12.17% -4.17% +9.09%
75th Percentile £642 £688 £721
90th Percentile £763 £750 £809
UK excluding London median daily rate £475 £540 £540
% change year-on-year -12.04% - +8.00%
Number of hourly rates quoted 5 6 2
10th Percentile - £74.25 £57.68
25th Percentile £41.25 - £57.94
Median hourly rate £45.00 £78.00 £60.25
Median % change year-on-year -42.31% +29.46% +79.85%
75th Percentile £52.50 - £62.31
90th Percentile £62.25 - £62.43
UK excluding London median hourly rate £67.50 £78.00 -
% change year-on-year -13.46% - -

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,245 10,781 17,916
As % of all contract IT jobs advertised in the UK 16.73% 18.03% 20.17%
Number of daily rates quoted 5,147 7,685 12,759
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £545
Median % change year-on-year -2.78% -0.92% +9.00%
75th Percentile £650 £658 £650
90th Percentile £763 £750 £750
UK excluding London median daily rate £483 £500 £488
% change year-on-year -3.40% +2.56% +9.86%
Number of hourly rates quoted 144 185 187
10th Percentile £14.00 £21.24 £15.00
25th Percentile £20.98 £35.00 £22.40
Median hourly rate £40.00 £60.00 £42.50
Median % change year-on-year -33.33% +41.18% +57.52%
75th Percentile £58.55 £71.50 £60.00
90th Percentile £72.50 £79.19 £69.05
UK excluding London median hourly rate £40.00 £57.50 £35.00
% change year-on-year -30.43% +64.29% +45.83%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop.

Daily rate trend for Hadoop in the UK

Hadoop
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop over the 6 months to 27 April 2024.

Daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Hadoop.

Hourly rate trend for Hadoop in the UK

Hadoop
Hourly Rate Histogram

Hourly rate distribution of jobs citing Hadoop over the 6 months to 27 April 2024.

Hourly rate histogram for Hadoop in the UK

Hadoop
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -36 102 £500 -13.04% 71
London -26 60 £550 -4.35% 38
UK excluding London +13 42 £475 -12.04% 41
Work from Home +18 38 £510 -11.30% 72
North of England +24 11 £500 - 11
Midlands +11 11 £438 -18.98% 4
North West +9 9 £535 +12.63% 9
East Midlands +23 7 £425 +6.25% 1
South East +13 7 £475 -17.39% 7
East of England +16 6 £325 -40.91% 5
Scotland +33 4 £608 +9.95% 6
West Midlands +13 4 £550 +1.85% 3
Yorkshire +18 2 £425 -19.05%
South West +4 2 £541 -2.48% 4
Northern Ireland +8 1 £425 - 3

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 63 (51.22%) Apache Spark
2 19 (15.45%) Apache
3 10 (8.13%) Apache Airflow
4 5 (4.07%) Confluence
5 3 (2.44%) Apache Solr
5 3 (2.44%) SAS
6 1 (0.81%) Apache Pulsar
6 1 (0.81%) Cloud Foundry
6 1 (0.81%) Luigi
Business Applications
1 2 (1.63%) SAP Hybris
Cloud Services
1 38 (30.89%) AWS
2 24 (19.51%) Azure
3 18 (14.63%) PaaS
4 17 (13.82%) GCP
5 12 (9.76%) Amazon S3
6 9 (7.32%) Amazon EMR
7 7 (5.69%) AWS Lambda
7 7 (5.69%) Serverless
7 7 (5.69%) Snowflake
8 5 (4.07%) Amazon EC2
8 5 (4.07%) Azure Synapse Analytics
9 4 (3.25%) Cloud Computing
9 4 (3.25%) Power Platform
10 3 (2.44%) Amazon EKS
10 3 (2.44%) Amazon Kinesis
10 3 (2.44%) AWS Data Pipeline
10 3 (2.44%) Azure Data Factory
10 3 (2.44%) Google Kubernetes Engine
10 3 (2.44%) OpenShift
10 3 (2.44%) Virtual Private Cloud
Communications & Networking
1 16 (13.01%) FTP
2 4 (3.25%) Firewall
2 4 (3.25%) Intrusion Detection
2 4 (3.25%) TCP/IP
2 4 (3.25%) tcpdump
2 4 (3.25%) Wireshark
3 3 (2.44%) DHCP
3 3 (2.44%) DNS
3 3 (2.44%) Internet
Database & Business Intelligence
1 74 (60.16%) Big Data
2 31 (25.20%) Apache Hive
3 29 (23.58%) Data Warehouse
4 25 (20.33%) Tableau
5 17 (13.82%) Amazon Redshift
6 13 (10.57%) HBase
7 12 (9.76%) Data Lake
8 11 (8.94%) Impala
9 10 (8.13%) PostgreSQL
9 10 (8.13%) SQL Server
10 9 (7.32%) Apache Cassandra
10 9 (7.32%) MySQL
10 9 (7.32%) Relational Database
11 8 (6.50%) MongoDB
11 8 (6.50%) NoSQL
11 8 (6.50%) Sqoop
12 7 (5.69%) Presto
13 5 (4.07%) BigQuery
13 5 (4.07%) Elasticsearch
13 5 (4.07%) Spark SQL
Development Applications
1 13 (10.57%) Git
1 13 (10.57%) JIRA
2 8 (6.50%) Jenkins
2 8 (6.50%) Maven
3 6 (4.88%) GitLab
3 6 (4.88%) Subversion
4 5 (4.07%) TeamCity
5 4 (3.25%) IDA Disassembler
6 3 (2.44%) Cypress.io
7 2 (1.63%) Bitbucket
7 2 (1.63%) Gradle
7 2 (1.63%) Liquibase
General
1 45 (36.59%) Analytical Skills
2 37 (30.08%) Social Skills
3 26 (21.14%) Finance
4 10 (8.13%) Banking
4 10 (8.13%) Public Sector
5 8 (6.50%) Manufacturing
6 6 (4.88%) Telecoms
7 5 (4.07%) Presentation Skills
8 4 (3.25%) Electronics
8 4 (3.25%) Investment Banking
8 4 (3.25%) Marketing
9 2 (1.63%) Legal
9 2 (1.63%) Organisational Skills
10 1 (0.81%) Corporate Banking
10 1 (0.81%) Inclusion and Diversity
10 1 (0.81%) Law
10 1 (0.81%) Retail
Job Titles
1 24 (19.51%) Developer
2 18 (14.63%) Data Engineer
3 16 (13.01%) Implementation Specialist
4 15 (12.20%) Architect
5 14 (11.38%) Data Scientist
5 14 (11.38%) Senior
6 8 (6.50%) Data Architect
7 7 (5.69%) Analyst
8 6 (4.88%) Data Analyst
9 5 (4.07%) Hadoop Developer
10 4 (3.25%) Senior Analyst
10 4 (3.25%) Senior Data Analyst
10 4 (3.25%) Senior Developer
10 4 (3.25%) Solutions Architect
11 3 (2.44%) Business Analyst
11 3 (2.44%) Consultant
11 3 (2.44%) Scala Developer
11 3 (2.44%) Site Engineer
11 3 (2.44%) SQL Developer
11 3 (2.44%) Talend Developer
Libraries, Frameworks & Software Standards
1 38 (30.89%) Kafka
2 19 (15.45%) LDAP
3 11 (8.94%) PySpark
4 5 (4.07%) Apache NiFi
4 5 (4.07%) Elastic Stack
5 4 (3.25%) JSON
5 4 (3.25%) OLE
5 4 (3.25%) XML
6 3 (2.44%) .NET
6 3 (2.44%) .NET Core
6 3 (2.44%) REST
7 2 (1.63%) Apache Avro
7 2 (1.63%) Flask
7 2 (1.63%) Java Concurrency
7 2 (1.63%) NumPy
7 2 (1.63%) Pandas
8 1 (0.81%) pytest
8 1 (0.81%) SAML
8 1 (0.81%) scikit-learn
8 1 (0.81%) TensorFlow
Miscellaneous
1 21 (17.07%) Algorithms
2 16 (13.01%) Replication
3 10 (8.13%) Cloud Native
4 4 (3.25%) Cyber Kill Chain
4 4 (3.25%) Data Structures
4 4 (3.25%) Distributed Systems
4 4 (3.25%) Public Cloud
4 4 (3.25%) YARA
5 3 (2.44%) Derivative
5 3 (2.44%) Management Information System
5 3 (2.44%) Self-Motivation
5 3 (2.44%) Social Media
6 2 (1.63%) Cyber Threat
6 2 (1.63%) Data Centre
6 2 (1.63%) Data Protection Act
6 2 (1.63%) Market Risk
6 2 (1.63%) Onboarding
6 2 (1.63%) Virtual Team
7 1 (0.81%) Distributed Computing
7 1 (0.81%) Mobile App
Operating Systems
1 27 (21.95%) Linux
2 24 (19.51%) Unix
3 20 (16.26%) Windows
Processes & Methodologies
1 36 (29.27%) Data Modelling
2 35 (28.46%) Agile
3 33 (26.83%) ETL
4 32 (26.02%) Problem-Solving
5 29 (23.58%) Data Science
6 27 (21.95%) Machine Learning
7 26 (21.14%) Computer Science
8 25 (20.33%) Data Analysis
9 24 (19.51%) Analytics
9 24 (19.51%) CI/CD
10 20 (16.26%) Business Intelligence
10 20 (16.26%) Data Pipeline
10 20 (16.26%) Mathematics
10 20 (16.26%) Statistics
10 20 (16.26%) Visualisation
11 19 (15.45%) Migration
12 18 (14.63%) Data Visualisation
12 18 (14.63%) Disaster Recovery
13 17 (13.82%) Capacity Management
14 16 (13.01%) DevOps
Programming Languages
1 65 (52.85%) Python
2 47 (38.21%) SQL
3 34 (27.64%) Java
4 26 (21.14%) Scala
5 12 (9.76%) R
6 9 (7.32%) Perl
7 7 (5.69%) Shell Script
8 5 (4.07%) JavaScript
9 4 (3.25%) Bash
9 4 (3.25%) PL/SQL
10 3 (2.44%) C#
10 3 (2.44%) Go
10 3 (2.44%) Groovy
10 3 (2.44%) Ruby
11 2 (1.63%) Haskell
11 2 (1.63%) TypeScript
11 2 (1.63%) U-SQL
12 1 (0.81%) HiveQL
12 1 (0.81%) PowerShell
12 1 (0.81%) T-SQL
Qualifications
1 21 (17.07%) Degree
2 12 (9.76%) Computer Science Degree
3 8 (6.50%) Security Cleared
4 4 (3.25%) DV Cleared
4 4 (3.25%) Numerate Degree
5 3 (2.44%) SC Cleared
6 2 (1.63%) AWS Certification
6 2 (1.63%) Master's Degree
7 1 (0.81%) AWS Certified Solutions Architect
7 1 (0.81%) OCP
7 1 (0.81%) Oracle Certification
Quality Assurance & Compliance
1 20 (16.26%) Data Quality
2 6 (4.88%) GDPR
2 6 (4.88%) NIST
3 5 (4.07%) QA
4 2 (1.63%) ISO/IEC 27001
4 2 (1.63%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
4 2 (1.63%) PCI DSS
5 1 (0.81%) Accessibility
5 1 (0.81%) EMIR
5 1 (0.81%) FATCA
5 1 (0.81%) MiFID
System Software
1 32 (26.02%) HDFS
2 16 (13.01%) Active Directory
2 16 (13.01%) NFS
3 9 (7.32%) Docker
4 4 (3.25%) Snort
5 1 (0.81%) Apache Flume
5 1 (0.81%) Apache ZooKeeper
Systems Management
1 13 (10.57%) Kubernetes
2 8 (6.50%) Hadoop YARN
3 7 (5.69%) Ansible
4 5 (4.07%) Kibana
5 3 (2.44%) Grafana
5 3 (2.44%) Oozie
5 3 (2.44%) Progress Chef
5 3 (2.44%) Puppet
5 3 (2.44%) Terraform
6 2 (1.63%) Ambari
7 1 (0.81%) ITRS Geneos
7 1 (0.81%) Prometheus
Vendors
1 16 (13.01%) Isilon
1 16 (13.01%) Oracle
2 13 (10.57%) Databricks
3 12 (9.76%) SAP
4 9 (7.32%) Informatica
4 9 (7.32%) Teradata
5 8 (6.50%) Google
5 8 (6.50%) Splunk
6 7 (5.69%) Dell
7 6 (4.88%) Talend
8 4 (3.25%) Foundry
8 4 (3.25%) Microsoft
8 4 (3.25%) Palantir
9 3 (2.44%) Ab Initio
9 3 (2.44%) Adobe
9 3 (2.44%) Cloudera
9 3 (2.44%) Salesforce
10 2 (1.63%) IBM
10 2 (1.63%) New Relic
10 2 (1.63%) PagerDuty