Period
to

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for HDFS skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDFS over the 6 months to 21 May 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Hadoop Distributed File System (HDFS)
England > London
6 months to
21 May 2022
Same period 2021 Same period 2020
Rank 535 415 385
Rank change year-on-year -120 -30 +68
Contract jobs citing HDFS 59 60 46
As % of all contract jobs advertised in London 0.15% 0.25% 0.23%
As % of the System Software category 1.18% 1.73% 1.54%
Number of daily rates quoted 44 38 34
10th Percentile £374 £437 £496
25th Percentile £477 £500 £525
Median daily rate (50th Percentile) £590 £575 £600
Median % change year-on-year +2.61% -4.17% -
75th Percentile £703 £617 £688
90th Percentile £863 £633 £743
England median daily rate £550 £540 £558
% change year-on-year +1.85% -3.14% -7.08%

HDFS is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for system software skills.

All System Software Skills
London
Contract vacancies with a requirement for system software skills 4,998 3,468 2,981
As % of all contract IT jobs advertised in London 12.85% 14.22% 14.94%
Number of daily rates quoted 3,767 2,594 2,215
10th Percentile £313 £350 £216
25th Percentile £463 £450 £406
Median daily rate (50th Percentile) £560 £525 £500
Median % change year-on-year +6.67% +5.00% -4.76%
75th Percentile £675 £613 £600
90th Percentile £743 £700 £675
England median daily rate £525 £495 £475
% change year-on-year +6.06% +4.21% -
Number of hourly rates quoted 38 20 56
10th Percentile £14.75 £15.06 £12.43
25th Percentile £19.80 £31.81 £15.34
Median hourly rate £27.00 £48.50 £19.00
Median % change year-on-year -44.33% +155.26% -9.52%
75th Percentile £45.93 £61.25 £28.62
90th Percentile £53.79 £76.03 £47.83
England median hourly rate £18.68 £20.00 £16.85
% change year-on-year -6.63% +18.73% +2.09%

HDFS
Job Vacancy Trend in London

Job postings citing HDFS as a proportion of all IT jobs advertised in London.

Job vacancy trend for HDFS in London

HDFS
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing HDFS in London.

Daily rate trend for HDFS in London

HDFS
Daily Rate Histogram in London

Daily rate distribution for jobs citing HDFS in London over the 6 months to 21 May 2022.

Daily rate histogram for HDFS in London

HDFS
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDFS within the London region over the 6 months to 21 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London -35 3 £556 +25.71% 1
HDFS
England

For the 6 months to 21 May 2022, IT contractor jobs citing HDFS also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for HDFS.

1 55 (93.22%) Hadoop
2 40 (67.80%) SQL
2 40 (67.80%) Apache Spark
3 34 (57.63%) Big Data
3 34 (57.63%) Analytics
4 33 (55.93%) Apache Hive
5 32 (54.24%) Agile
5 32 (54.24%) Python
6 28 (47.46%) Finance
7 26 (44.07%) Linux
8 24 (40.68%) AWS
8 24 (40.68%) Scala
9 22 (37.29%) Data Warehouse
9 22 (37.29%) Git (software)
10 21 (35.59%) NoSQL
11 20 (33.90%) Azure
11 20 (33.90%) Data Modelling
11 20 (33.90%) Java
11 20 (33.90%) HBase
12 16 (27.12%) Apache
12 16 (27.12%) Software Engineering
13 15 (25.42%) ETL
14 14 (23.73%) Kafka
14 14 (23.73%) Data Pipeline
15 13 (22.03%) Data Governance
15 13 (22.03%) Analytical Skills
15 13 (22.03%) GCP
15 13 (22.03%) Impala
15 13 (22.03%) SQL Server
15 13 (22.03%) R

HDFS
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 40 (67.80%) Apache Spark
2 16 (27.12%) Apache
3 9 (15.25%) Apache Airflow
4 5 (8.47%) Apache Pig
5 3 (5.08%) SAS
6 2 (3.39%) Oracle Coherence
7 1 (1.69%) Confluence
7 1 (1.69%) OpenStack
Applications
1 5 (8.47%) Microsoft Excel
Cloud Services
1 24 (40.68%) AWS
2 20 (33.90%) Azure
3 13 (22.03%) GCP
4 7 (11.86%) Amazon S3
5 6 (10.17%) Azure Data Factory
5 6 (10.17%) Azure Synapse Analytics
6 4 (6.78%) Power Platform
7 3 (5.08%) Amazon Kinesis
7 3 (5.08%) Vertex AI
8 1 (1.69%) Amazon EKS
8 1 (1.69%) Amazon EMR
8 1 (1.69%) Amazon MSK
8 1 (1.69%) Amazon SageMaker
8 1 (1.69%) Snowflake
Communications & Networking
1 6 (10.17%) FTP
Database & Business Intelligence
1 55 (93.22%) Hadoop
2 34 (57.63%) Big Data
3 33 (55.93%) Apache Hive
4 22 (37.29%) Data Warehouse
5 21 (35.59%) NoSQL
6 20 (33.90%) HBase
7 13 (22.03%) Impala
7 13 (22.03%) SQL Server
8 9 (15.25%) Data Lake
9 8 (13.56%) Apache Cassandra
9 8 (13.56%) MongoDB
10 7 (11.86%) Metadata
11 6 (10.17%) Azure SQL Database
11 6 (10.17%) SAP HANA
12 5 (8.47%) DB2
12 5 (8.47%) Tableau
13 4 (6.78%) BusinessObjects
13 4 (6.78%) Data Mining
13 4 (6.78%) DataStage
13 4 (6.78%) MySQL
Development Applications
1 22 (37.29%) Git (software)
2 9 (15.25%) MLflow
3 7 (11.86%) ER Studio
3 7 (11.86%) ERwin
3 7 (11.86%) Jenkins
4 6 (10.17%) Subversion
5 4 (6.78%) kappa
6 3 (5.08%) Artifactory
7 1 (1.69%) Bitbucket
7 1 (1.69%) GitLab
7 1 (1.69%) JIRA
General
1 28 (47.46%) Finance
2 13 (22.03%) Analytical Skills
3 11 (18.64%) Banking
4 10 (16.95%) Social Skills
5 6 (10.17%) Front Office
6 4 (6.78%) Investment Banking
6 4 (6.78%) Retail
7 3 (5.08%) Presentation Skills
7 3 (5.08%) Public Sector
7 3 (5.08%) Telecoms
8 1 (1.69%) Influencing Skills
8 1 (1.69%) Law
8 1 (1.69%) Manufacturing
8 1 (1.69%) Publishing
Job Titles
1 23 (38.98%) Developer
2 11 (18.64%) Java Developer
3 9 (15.25%) Data Engineer
3 9 (15.25%) Senior Developer
3 9 (15.25%) Senior Java Developer
4 8 (13.56%) Machine Learning Engineer
5 7 (11.86%) Python Developer
5 7 (11.86%) Senior Python Developer
6 6 (10.17%) Azure Developer
7 5 (8.47%) Apache Spark Developer
7 5 (8.47%) Market Risk Developer
7 5 (8.47%) Market Risk Java Developer
7 5 (8.47%) Scala Developer
8 4 (6.78%) Analyst
8 4 (6.78%) Big Data Developer
8 4 (6.78%) Data Analyst
8 4 (6.78%) Hadoop Engineer
8 4 (6.78%) Senior Software Engineer
8 4 (6.78%) Software Engineer
8 4 (6.78%) Technical Analyst
Libraries, Frameworks & Software Standards
1 14 (23.73%) Kafka
2 9 (15.25%) Apache Beam
2 9 (15.25%) BentoML
2 9 (15.25%) PyTorch
2 9 (15.25%) TensorFlow
3 3 (5.08%) Apache NiFi
3 3 (5.08%) Spark Streaming
4 2 (3.39%) H2O
5 1 (1.69%) RabbitMQ
5 1 (1.69%) Spring
Miscellaneous
1 8 (13.56%) Market Risk
2 7 (11.86%) Self-Motivation
3 4 (6.78%) Equities
4 3 (5.08%) Data Structures
5 2 (3.39%) Data Fabric
5 2 (3.39%) Virtual Team
6 1 (1.69%) Management Information System
6 1 (1.69%) Public Cloud
Operating Systems
1 26 (44.07%) Linux
2 5 (8.47%) Unix
3 4 (6.78%) Windows
Processes & Methodologies
1 34 (57.63%) Analytics
2 32 (54.24%) Agile
3 20 (33.90%) Data Modelling
4 16 (27.12%) Software Engineering
5 15 (25.42%) ETL
6 14 (23.73%) Data Pipeline
7 13 (22.03%) Data Governance
8 12 (20.34%) Business Intelligence
8 12 (20.34%) Computer Science
8 12 (20.34%) Data Science
9 11 (18.64%) Continuous Integration
9 11 (18.64%) Low Latency
10 10 (16.95%) Data Analytics
10 10 (16.95%) Machine Learning
11 9 (15.25%) Artificial Intelligence
11 9 (15.25%) Data Architecture
11 9 (15.25%) Data Engineering
11 9 (15.25%) Data Ingestion
11 9 (15.25%) Data Integration
11 9 (15.25%) Natural Language Processing
Programming Languages
1 40 (67.80%) SQL
2 32 (54.24%) Python
3 24 (40.68%) Scala
4 20 (33.90%) Java
5 13 (22.03%) R
6 9 (15.25%) Shell Script
7 5 (8.47%) HiveQL
7 5 (8.47%) Perl
8 4 (6.78%) PL/SQL
8 4 (6.78%) VBA
9 3 (5.08%) SAS Macro
10 2 (3.39%) C++
11 1 (1.69%) Bash
11 1 (1.69%) Go
11 1 (1.69%) Kotlin
Qualifications
1 9 (15.25%) PhD
2 4 (6.78%) Security Cleared
3 3 (5.08%) Computer Science Degree
3 3 (5.08%) Degree
4 2 (3.39%) SC Cleared
5 1 (1.69%) Master's Degree
Quality Assurance & Compliance
1 7 (11.86%) Data Quality
2 3 (5.08%) QA
System Software
1 11 (18.64%) Docker
2 2 (3.39%) Apache ZooKeeper
3 1 (1.69%) Apache Flume
Systems Management
1 10 (16.95%) Kubeflow
2 2 (3.39%) Hadoop YARN
3 1 (1.69%) Kubernetes
Vendors
1 10 (16.95%) Informatica
2 9 (15.25%) Databricks
3 7 (11.86%) Cloudera
3 7 (11.86%) Talend
4 6 (10.17%) Salesforce.com
4 6 (10.17%) SAP
5 5 (8.47%) Hortonworks
5 5 (8.47%) MapR
5 5 (8.47%) Oracle
6 4 (6.78%) Teradata
7 3 (5.08%) Ab Initio
7 3 (5.08%) Google
8 2 (3.39%) Bloomberg
8 2 (3.39%) Refinitiv
8 2 (3.39%) StreamSets
9 1 (1.69%) Alteryx
9 1 (1.69%) MicroStrategy
9 1 (1.69%) Sage
9 1 (1.69%) Sybase