Period
to

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 19 May 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
19 May 2022
Same period 2021 Same period 2020
Rank 155 96 114
Rank change year-on-year -59 +18 -31
Contract jobs citing Hadoop 31 49 45
As % of all contract jobs advertised in the City of London 0.74% 1.75% 1.39%
As % of the Database & Business Intelligence category 3.58% 8.21% 5.75%
Number of daily rates quoted 15 35 33
10th Percentile £494 £513 £340
25th Percentile £538 £543 £513
Median daily rate (50th Percentile) £613 £600 £575
Median % change year-on-year +2.08% +4.35% +4.55%
75th Percentile £719 £638 £650
90th Percentile £775 £675 £700
Central London median daily rate £613 £600 £575
% change year-on-year +2.08% +4.35% +4.55%
Number of hourly rates quoted 1 0 0
10th Percentile - - -
25th Percentile £59.25 - -
Median hourly rate £60.50 - -
75th Percentile £61.75 - -
90th Percentile - - -
Central London median hourly rate £60.50 - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 866 597 782
As % of all contract IT jobs advertised in the City of London 20.63% 21.34% 24.11%
Number of daily rates quoted 666 400 594
10th Percentile £425 £385 £363
25th Percentile £500 £460 £417
Median daily rate (50th Percentile) £575 £550 £500
Median % change year-on-year +4.55% +10.00% -4.76%
75th Percentile £700 £638 £600
90th Percentile £800 £712 £675
Central London median daily rate £575 £550 £500
% change year-on-year +4.55% +10.00% -4.76%
Number of hourly rates quoted 5 6 5
10th Percentile £40.65 - £20.00
25th Percentile £47.25 - £24.50
Median hourly rate £60.50 £8.00 £25.00
Median % change year-on-year +656.25% -68.00% -28.57%
75th Percentile £61.75 £19.81 £39.25
90th Percentile £71.20 £24.46 £44.35
Central London median hourly rate £60.50 £14.00 £25.00
% change year-on-year +332.14% -44.00% -28.57%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 19 May 2022.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 19 May 2022, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 24 (77.42%) Python
1 24 (77.42%) Big Data
2 19 (61.29%) Apache Spark
3 18 (58.06%) Finance
4 15 (48.39%) Analytics
4 15 (48.39%) SQL
5 14 (45.16%) Azure
6 13 (41.94%) Linux
6 13 (41.94%) Kafka
7 12 (38.71%) Data Pipeline
7 12 (38.71%) Data Protection
8 11 (35.48%) AWS
8 11 (35.48%) Hedge funds
8 11 (35.48%) Java
8 11 (35.48%) Legal
8 11 (35.48%) Financial Institution
8 11 (35.48%) GDPR
9 10 (32.26%) Data Munging
9 10 (32.26%) OO
10 9 (29.03%) MySQL
10 9 (29.03%) Apache Hive
11 8 (25.81%) Statistics
11 8 (25.81%) Computer Science
11 8 (25.81%) SQL Server
11 8 (25.81%) CI/CD
12 7 (22.58%) AOP
12 7 (22.58%) Git (software)
12 7 (22.58%) Scala
12 7 (22.58%) NoSQL
12 7 (22.58%) HBase

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 19 (61.29%) Apache Spark
2 5 (16.13%) Apache Airflow
2 5 (16.13%) Luigi
3 3 (9.68%) Apache Pig
4 1 (3.23%) Apache
4 1 (3.23%) JBoss
4 1 (3.23%) nginx
4 1 (3.23%) OpenStack
4 1 (3.23%) Tomcat
4 1 (3.23%) WebSphere
Business Applications
1 1 (3.23%) SAP Oil and Gas
Cloud Services
1 14 (45.16%) Azure
2 11 (35.48%) AWS
3 6 (19.35%) Amazon EMR
3 6 (19.35%) GCP
4 5 (16.13%) Amazon EC2
4 5 (16.13%) Amazon SQS
5 2 (6.45%) Azure Cosmos DB
5 2 (6.45%) Power Platform
6 1 (3.23%) OpenShift
6 1 (3.23%) PaaS
Communications & Networking
1 1 (3.23%) DNS
1 1 (3.23%) SSH
1 1 (3.23%) SSL
Database & Business Intelligence
1 24 (77.42%) Big Data
2 9 (29.03%) Apache Hive
2 9 (29.03%) MySQL
3 8 (25.81%) SQL Server
4 7 (22.58%) HBase
4 7 (22.58%) NoSQL
5 6 (19.35%) PostgreSQL
6 5 (16.13%) Amazon Athena
6 5 (16.13%) Amazon RDS
6 5 (16.13%) Amazon Redshift
6 5 (16.13%) Apache Cassandra
6 5 (16.13%) Metadata
6 5 (16.13%) Presto
7 3 (9.68%) MongoDB
8 2 (6.45%) Data Mining
8 2 (6.45%) Data Warehouse
8 2 (6.45%) Power BI
8 2 (6.45%) QlikView
8 2 (6.45%) SAP BW
8 2 (6.45%) Spotfire
Development Applications
1 7 (22.58%) Git (software)
2 4 (12.90%) Jenkins
3 2 (6.45%) GitLab
3 2 (6.45%) JIRA
4 1 (3.23%) Eclipse
4 1 (3.23%) Gerrit
4 1 (3.23%) git-flow
4 1 (3.23%) HP UFT
4 1 (3.23%) IntelliJ
4 1 (3.23%) NetBeans
4 1 (3.23%) Rational Robot
4 1 (3.23%) RIATest
4 1 (3.23%) SilkTest
4 1 (3.23%) Sonatype Nexus
4 1 (3.23%) Subversion
4 1 (3.23%) TeamCity
4 1 (3.23%) VSS/SourceSafe
4 1 (3.23%) WinRunner
General
1 18 (58.06%) Finance
2 11 (35.48%) Financial Institution
2 11 (35.48%) Legal
3 5 (16.13%) Social Skills
4 4 (12.90%) Analytical Skills
4 4 (12.90%) Retail
5 3 (9.68%) Banking
6 1 (3.23%) Investment Banking
Job Titles
1 16 (51.61%) Data Engineer
2 9 (29.03%) Developer
3 7 (22.58%) Big Data Engineer
3 7 (22.58%) Hadoop Engineer
4 5 (16.13%) Cloud Engineer
5 4 (12.90%) Big Data Developer
6 3 (9.68%) Azure Engineer
6 3 (9.68%) Data Scientist
6 3 (9.68%) Senior Cloud Engineer
6 3 (9.68%) Senior Data Engineer
7 2 (6.45%) Apache Spark Developer
7 2 (6.45%) Hadoop Developer
7 2 (6.45%) Java Developer
7 2 (6.45%) Java Hadoop Developer
8 1 (3.23%) Consultant
8 1 (3.23%) DevOps Consultant
8 1 (3.23%) Python Engineer
8 1 (3.23%) Scala Developer
Libraries, Frameworks & Software Standards
1 13 (41.94%) Kafka
2 6 (19.35%) Spark Streaming
3 5 (16.13%) PySpark
4 2 (6.45%) Apache Tez
4 2 (6.45%) RabbitMQ
4 2 (6.45%) RESTful
4 2 (6.45%) TensorFlow
5 1 (3.23%) Elastic Stack
5 1 (3.23%) gRPC
5 1 (3.23%) Hibernate
5 1 (3.23%) J2EE
5 1 (3.23%) JWT
5 1 (3.23%) OAuth
5 1 (3.23%) SOAP
5 1 (3.23%) Spring
5 1 (3.23%) Spring Boot
5 1 (3.23%) Web Services
Miscellaneous
1 11 (35.48%) Hedge funds
2 6 (19.35%) Data Structures
3 5 (16.13%) Derivative
3 5 (16.13%) Equities
3 5 (16.13%) Foreign Exchange (FX)
3 5 (16.13%) Linux Command Line
3 5 (16.13%) Management Information System
4 4 (12.90%) Algorithms
5 2 (6.45%) Greenfield Project
5 2 (6.45%) Legacy Systems
5 2 (6.45%) PKI
6 1 (3.23%) Market Risk
6 1 (3.23%) Social Media
6 1 (3.23%) Virtual Team
Operating Systems
1 13 (41.94%) Linux
2 6 (19.35%) Unix
2 6 (19.35%) Windows
3 3 (9.68%) Ubuntu
4 2 (6.45%) CentOS
4 2 (6.45%) Windows Server
4 2 (6.45%) Windows Server 2012
5 1 (3.23%) Debian
Processes & Methodologies
1 15 (48.39%) Analytics
2 12 (38.71%) Data Pipeline
2 12 (38.71%) Data Protection
3 10 (32.26%) Data Munging
3 10 (32.26%) OO
4 8 (25.81%) CI/CD
4 8 (25.81%) Computer Science
4 8 (25.81%) Statistics
5 7 (22.58%) AOP
6 6 (19.35%) DevOps
7 5 (16.13%) Actionable Insight
7 5 (16.13%) Business Intelligence
7 5 (16.13%) Customer Acquisition
7 5 (16.13%) Data Transformation
7 5 (16.13%) Informatics
7 5 (16.13%) Infrastructure as Code
7 5 (16.13%) Performance Metrics
7 5 (16.13%) Process Improvement
7 5 (16.13%) Workflow Management
7 5 (16.13%) Workload Management
Programming Languages
1 24 (77.42%) Python
2 15 (48.39%) SQL
3 11 (35.48%) Java
4 7 (22.58%) Scala
5 4 (12.90%) Bash
6 3 (9.68%) R
7 2 (6.45%) JavaScript
8 1 (3.23%) C#
8 1 (3.23%) C++
8 1 (3.23%) PowerShell
8 1 (3.23%) Shell Script
Qualifications
1 3 (9.68%) Computer Science Degree
1 3 (9.68%) Degree
2 1 (3.23%) DV Cleared
2 1 (3.23%) Security Cleared
2 1 (3.23%) Sun Certification
Quality Assurance & Compliance
1 11 (35.48%) GDPR
2 1 (3.23%) QA
System Software
1 5 (16.13%) Docker
2 3 (9.68%) HDFS
3 2 (6.45%) Apache ZooKeeper
4 1 (3.23%) vCloud
Systems Management
1 6 (19.35%) Kubernetes
2 5 (16.13%) Terraform
3 3 (9.68%) Ambari
4 2 (6.45%) Hadoop YARN
4 2 (6.45%) Oozie
5 1 (3.23%) Ansible
5 1 (3.23%) Consul
5 1 (3.23%) Fluentd
5 1 (3.23%) Grafana
5 1 (3.23%) HAProxy
5 1 (3.23%) Prometheus
5 1 (3.23%) ZABBIX
Vendors
1 3 (9.68%) Hortonworks
1 3 (9.68%) Microsoft
1 3 (9.68%) Red Hat
2 2 (6.45%) Alteryx
2 2 (6.45%) Cloudera
2 2 (6.45%) Informatica
2 2 (6.45%) Oracle
2 2 (6.45%) SAP
3 1 (3.23%) Atlassian
3 1 (3.23%) CA
3 1 (3.23%) CyberArk
3 1 (3.23%) Google
3 1 (3.23%) Green Hat
3 1 (3.23%) HP
3 1 (3.23%) IBM
3 1 (3.23%) Sonatype
3 1 (3.23%) Sun
3 1 (3.23%) Teradata
3 1 (3.23%) VMware