Hadoop Distributed File System (HDFS)
UK

The following table provides summary statistics for contract job vacancies with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 565 687 702
Rank change year-on-year +122 +15 -180
Contract jobs citing HDFS 33 32 147
As % of all contract jobs advertised in the UK 0.076% 0.054% 0.17%
As % of the System Software category 0.71% 0.41% 1.22%
Number of daily rates quoted 24 14 98
10th Percentile £281 - £424
25th Percentile £300 £500 £494
Median daily rate (50th Percentile) £385 £538 £570
Median % change year-on-year -28.37% -5.70% +3.64%
75th Percentile £500 £594 £638
90th Percentile £681 £635 £750
UK excluding London median daily rate £450 £588 £523
% change year-on-year -23.40% +12.44% +5.56%

All System Software Skills
UK

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

Contract vacancies with a requirement for system software skills 4,653 7,900 12,040
As % of all contract IT jobs advertised in the UK 10.75% 13.21% 13.55%
Number of daily rates quoted 3,179 5,646 8,623
10th Percentile £197 £205 £200
25th Percentile £331 £400 £400
Median daily rate (50th Percentile) £488 £525 £525
Median % change year-on-year -7.14% - +9.38%
75th Percentile £600 £638 £625
90th Percentile £688 £725 £700
UK excluding London median daily rate £460 £485 £450
% change year-on-year -5.13% +7.75% +7.14%
Number of hourly rates quoted 232 284 318
10th Percentile £14.06 £14.83 £13.21
25th Percentile £15.50 £18.25 £15.00
Median hourly rate £22.50 £53.75 £20.00
Median % change year-on-year -58.14% +168.75% -
75th Percentile £60.19 £66.00 £44.07
90th Percentile £77.95 £75.35 £60.92
UK excluding London median hourly rate £21.50 £44.93 £18.12
% change year-on-year -52.15% +148.01% +2.06%

HDFS
Job Vacancy Trend

Job postings citing HDFS as a proportion of all IT jobs advertised.

Job vacancy trend for HDFS in the UK

HDFS
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing HDFS.

Daily rate trend for HDFS in the UK

HDFS
Daily Rate Histogram

Daily rate distribution for jobs citing HDFS over the 6 months to 27 April 2024.

Daily rate histogram for HDFS in the UK

HDFS
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing HDFS.

Hourly rate trend for HDFS in the UK

HDFS
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the UK over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +127 29 £385 -28.37%
London +98 21 £385 -26.67%
Work from Home +119 9 £300 -47.83% 1
UK excluding London +67 9 £450 -23.40%
Midlands +24 2 £500 -4.76%
South East +23 2 - -
Yorkshire - 2 £425 -
North of England - 2 £425 -
East of England - 2 £350 -
West Midlands +30 1 £550 +4.76%
East Midlands - 1 £450 -
Scotland - 1 - -

HDFS
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 15 (45.45%) Apache Spark
2 7 (21.21%) Apache
3 3 (9.09%) Apache Airflow
4 1 (3.03%) Cloud Foundry
4 1 (3.03%) Confluence
4 1 (3.03%) SAS
Cloud Services
1 16 (48.48%) PaaS
2 7 (21.21%) AWS
3 3 (9.09%) Amazon EMR
3 3 (9.09%) Azure
3 3 (9.09%) GCP
3 3 (9.09%) Snowflake
4 2 (6.06%) Amazon S3
4 2 (6.06%) AWS Data Pipeline
4 2 (6.06%) Cloud Computing
5 1 (3.03%) Amazon EC2
5 1 (3.03%) Amazon SQS
5 1 (3.03%) AWS CodeDeploy
5 1 (3.03%) AWS CodePipeline
5 1 (3.03%) AWS Lambda
5 1 (3.03%) AWS Step Functions
5 1 (3.03%) Power Platform
5 1 (3.03%) Serverless
Communications & Networking
1 16 (48.48%) FTP
Database & Business Intelligence
1 32 (96.97%) Hadoop
2 16 (48.48%) Apache Hive
3 15 (45.45%) Big Data
4 8 (24.24%) HBase
5 6 (18.18%) Data Warehouse
5 6 (18.18%) Impala
6 5 (15.15%) Spark SQL
6 5 (15.15%) Sqoop
7 4 (12.12%) Relational Database
8 3 (9.09%) Amazon Redshift
8 3 (9.09%) Data Lake
8 3 (9.09%) Oracle Reports
9 2 (6.06%) Amazon Athena
9 2 (6.06%) BigQuery
9 2 (6.06%) BusinessObjects
10 1 (3.03%) Amazon RDS
10 1 (3.03%) Apache Cassandra
10 1 (3.03%) Pentaho
10 1 (3.03%) Presto
10 1 (3.03%) SAP Data Services
Development Applications
1 9 (27.27%) Git
2 7 (21.21%) JIRA
3 6 (18.18%) Maven
4 5 (15.15%) Subversion
4 5 (15.15%) TeamCity
5 3 (9.09%) Jenkins
6 2 (6.06%) Bitbucket
7 1 (3.03%) GitLab
General
1 11 (33.33%) Analytical Skills
2 10 (30.30%) Social Skills
3 8 (24.24%) Public Sector
4 6 (18.18%) Finance
5 4 (12.12%) Electronics
5 4 (12.12%) Manufacturing
5 4 (12.12%) Marketing
5 4 (12.12%) Telecoms
6 3 (9.09%) Banking
7 2 (6.06%) Organisational Skills
7 2 (6.06%) Presentation Skills
8 1 (3.03%) Investment Banking
Job Titles
1 16 (48.48%) Implementation Specialist
2 4 (12.12%) Data Engineer
3 3 (9.09%) Architect
4 2 (6.06%) Big Data Engineer
4 2 (6.06%) Business Analyst
4 2 (6.06%) Data Business Analyst
4 2 (6.06%) Developer
4 2 (6.06%) Programmer
5 1 (3.03%) Administrator
5 1 (3.03%) Data Architect
5 1 (3.03%) Hadoop Administrator
5 1 (3.03%) Hadoop Developer
5 1 (3.03%) Hadoop Engineer
5 1 (3.03%) Scala Developer
5 1 (3.03%) Scala Engineer
5 1 (3.03%) Site Engineer
5 1 (3.03%) Site Reliability Engineer
5 1 (3.03%) Solutions Architect
5 1 (3.03%) Technical Business Analyst
Libraries, Frameworks & Software Standards
1 16 (48.48%) LDAP
2 12 (36.36%) Kafka
3 2 (6.06%) Elastic Stack
Miscellaneous
1 16 (48.48%) Replication
2 5 (15.15%) Algorithms
3 1 (3.03%) Distributed Systems
3 1 (3.03%) Management Information System
Operating Systems
1 22 (66.67%) Unix
2 17 (51.52%) Linux
3 16 (48.48%) Windows
Processes & Methodologies
1 17 (51.52%) Capacity Management
1 17 (51.52%) Disaster Recovery
1 17 (51.52%) Migration
2 11 (33.33%) CI/CD
2 11 (33.33%) Problem-Solving
3 9 (27.27%) Agile
4 8 (24.24%) Data Pipeline
5 7 (21.21%) ETL
5 7 (21.21%) Machine Learning
6 6 (18.18%) Business Intelligence
6 6 (18.18%) Design Patterns
6 6 (18.18%) MapReduce
7 5 (15.15%) Data Modelling
7 5 (15.15%) Unit Testing
8 4 (12.12%) Analytics
8 4 (12.12%) Digital Marketing
8 4 (12.12%) Programme Management
9 3 (9.09%) Data Analysis
9 3 (9.09%) DevOps
9 3 (9.09%) Time Management
Programming Languages
1 10 (30.30%) Java
1 10 (30.30%) Python
2 8 (24.24%) Scala
3 7 (21.21%) Shell Script
3 7 (21.21%) SQL
4 1 (3.03%) Groovy
4 1 (3.03%) HiveQL
4 1 (3.03%) PL/SQL
4 1 (3.03%) PowerShell
Quality Assurance & Compliance
1 2 (6.06%) Data Quality
System Software
1 16 (48.48%) Active Directory
1 16 (48.48%) NFS
2 2 (6.06%) Apache ZooKeeper
2 2 (6.06%) Docker
Systems Management
1 9 (27.27%) Hadoop YARN
2 3 (9.09%) Kubernetes
3 1 (3.03%) Ansible
3 1 (3.03%) ITRS Geneos
3 1 (3.03%) Oozie
3 1 (3.03%) Terraform
Vendors
1 16 (48.48%) Isilon
2 7 (21.21%) Dell
3 5 (15.15%) Oracle
3 5 (15.15%) SAP
4 4 (12.12%) Informatica
5 2 (6.06%) Talend
6 1 (3.03%) Cloudera
6 1 (3.03%) Denodo
6 1 (3.03%) Splunk