Period
to 19 November 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 19 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
19 Nov 2019
Same period 2018 Same period 2017
Rank 110 91 79
Rank change year-on-year -19 -12 -11
Contract jobs citing Hadoop 124 205 217
As % of all contract IT jobs advertised in the City of London 2.11% 2.92% 3.09%
As % of the Database & Business Intelligence category 8.56% 11.60% 12.65%
Number of daily rates quoted 102 168 190
City of London median daily rate £575 £575 £600
Median daily rate % change year-on-year - -4.17% +4.35%
10th Percentile £492 £463 £471
90th Percentile £711 £704 £725
Central London median daily rate £575 £575 £575
Number of hourly rates quoted 1 0 0
City of London median hourly rate £44.57 - -
Central London median hourly rate £44.57 - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,449 1,768 1,715
As % of all contract IT jobs advertised in the City of London 24.61% 25.22% 24.40%
Number of daily rates quoted 1,144 1,414 1,392
City of London median daily rate £525 £525 £525
10th Percentile £388 £370 £363
90th Percentile £684 £675 £688
Central London median daily rate £525 £525 £525
Number of hourly rates quoted 5 10 11
City of London median hourly rate £44.57 £29.80 £27.50
Median hourly rate % change year-on-year +49.57% +8.35% -38.89%
10th Percentile £21.20 £18.60 £20.75
90th Percentile £86.70 £48.05 £33.25
Central London median hourly rate £39.78 £29.80 £25.99
% change year-on-year +33.52% +14.63% -42.24%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 19 November 2019.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in the City of London.

Contractor hourly rate trend for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 19 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 10 £500 -
London Bridge +9 3 £550 +4.76%
Hadoop
Central London

For the 6 months to 19 November 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 79 (63.71%) Apache Spark
2 75 (60.48%) Python
3 70 (56.45%) Big Data
4 68 (54.84%) Java
5 63 (50.81%) SQL
6 55 (44.35%) AWS
7 50 (40.32%) Agile Software Development
8 45 (36.29%) Scala
8 45 (36.29%) Apache Hive
9 43 (34.68%) Kafka
10 38 (30.65%) Finance
11 37 (29.84%) Analytics
12 32 (25.81%) Data Science
13 29 (23.39%) DevOps
13 29 (23.39%) Docker
14 27 (21.77%) NoSQL
15 24 (19.35%) Spring
15 24 (19.35%) Microservices
15 24 (19.35%) Kubernetes
16 23 (18.55%) Jenkins
16 23 (18.55%) Machine Learning
17 22 (17.74%) TDD
17 22 (17.74%) ETL
18 21 (16.94%) GCP
19 19 (15.32%) Spark Streaming
20 18 (14.52%) HBase
20 18 (14.52%) Git (software)
20 18 (14.52%) Google
21 17 (13.71%) MongoDB
21 17 (13.71%) Banking

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 79 (63.71%) Apache Spark
2 13 (10.48%) Apache
2 13 (10.48%) Elasticsearch
3 11 (8.87%) Apache Airflow
4 9 (7.26%) JBoss
4 9 (7.26%) Jetty
4 9 (7.26%) Tomcat
5 4 (3.23%) Confluence
5 4 (3.23%) Luigi
6 3 (2.42%) Jupyter
6 3 (2.42%) SAS
7 2 (1.61%) Oracle Self-Service HR
7 2 (1.61%) WebLogic
Applications
1 4 (3.23%) Microsoft Excel
Business Applications
1 1 (0.81%) FINCAD Analytics
1 1 (0.81%) SAP Oil and Gas
Cloud Services
1 55 (44.35%) AWS
2 21 (16.94%) GCP
3 14 (11.29%) Amazon S3
4 12 (9.68%) Amazon EMR
4 12 (9.68%) Azure
5 8 (6.45%) Amazon EC2
5 8 (6.45%) GitHub
6 7 (5.65%) Amazon Kinesis
6 7 (5.65%) Power Platform
7 6 (4.84%) AWS Lambda
7 6 (4.84%) Cloud Computing
7 6 (4.84%) Serverless
8 5 (4.03%) AWS CloudFormation
9 3 (2.42%) Amazon SageMaker
9 3 (2.42%) AWS Step Functions
10 2 (1.61%) Amazon CloudWatch
10 2 (1.61%) Amazon Cognito
10 2 (1.61%) Amazon EKS
10 2 (1.61%) AWS CloudTrail
10 2 (1.61%) Virtual Private Cloud
Communications & Networking
1 2 (1.61%) SSH
2 1 (0.81%) Broadband
2 1 (0.81%) InfiniBand
2 1 (0.81%) Internet
2 1 (0.81%) Kerberos
2 1 (0.81%) NAS
2 1 (0.81%) Wi-Fi
Database & Business Intelligence
1 70 (56.45%) Big Data
2 45 (36.29%) Apache Hive
3 27 (21.77%) NoSQL
4 18 (14.52%) HBase
5 17 (13.71%) Data Warehouse
5 17 (13.71%) MongoDB
6 14 (11.29%) PostgreSQL
7 12 (9.68%) MySQL
8 11 (8.87%) Data Lake
8 11 (8.87%) Spark SQL
9 10 (8.06%) Impala
9 10 (8.06%) Presto
10 9 (7.26%) Relational Database
11 8 (6.45%) Amazon Redshift
11 8 (6.45%) BigQuery
12 7 (5.65%) Amazon Athena
12 7 (5.65%) Flink
12 7 (5.65%) Power BI
12 7 (5.65%) Sqoop
13 5 (4.03%) Apache Cassandra
Development Applications
1 23 (18.55%) Jenkins
2 18 (14.52%) Git (software)
3 15 (12.10%) JIRA
4 9 (7.26%) Maven
5 6 (4.84%) Atlassian Bamboo
6 5 (4.03%) Travis CI
7 3 (2.42%) Cucumber
7 3 (2.42%) Eclipse
7 3 (2.42%) Hudson
7 3 (2.42%) Vagrant
8 2 (1.61%) Ant
8 2 (1.61%) ClearCase
8 2 (1.61%) FishEye
8 2 (1.61%) Gradle
8 2 (1.61%) IntelliJ
8 2 (1.61%) Mercurial
8 2 (1.61%) Poseidon for UML
8 2 (1.61%) Selenium
8 2 (1.61%) Subversion
8 2 (1.61%) Team Foundation Server
General
1 38 (30.65%) Finance
2 17 (13.71%) Banking
3 9 (7.26%) Investment Banking
4 6 (4.84%) Marketing
5 5 (4.03%) Retail Banking
6 3 (2.42%) Front Office
6 3 (2.42%) Publishing
6 3 (2.42%) Retail
7 2 (1.61%) Games
7 2 (1.61%) Public Sector
7 2 (1.61%) Telecoms
8 1 (0.81%) Financial Institution
Job Titles
1 48 (38.71%) Data Engineer
2 31 (25.00%) Developer
3 19 (15.32%) Java Developer
4 16 (12.90%) Architect
5 11 (8.87%) Java Engineer
6 9 (7.26%) Hadoop Developer
6 9 (7.26%) Hadoop Engineer
7 8 (6.45%) Big Data Engineer
7 8 (6.45%) Data Architect
8 7 (5.65%) AWS Engineer
8 7 (5.65%) Big Data Developer
8 7 (5.65%) Java Hadoop Developer
9 6 (4.84%) Analyst
9 6 (4.84%) Python Engineer
10 5 (4.03%) Cloud Architect
10 5 (4.03%) Data Scientist
10 5 (4.03%) DevOps Engineer
10 5 (4.03%) Scala Developer
11 4 (3.23%) Python Developer
11 4 (3.23%) Software Engineer
Libraries, Frameworks & Software Standards
1 43 (34.68%) Kafka
2 24 (19.35%) Spring
3 19 (15.32%) Spark Streaming
4 14 (11.29%) PySpark
5 9 (7.26%) Hibernate
6 7 (5.65%) Java Concurrency
6 7 (5.65%) Lambda Expressions
6 7 (5.65%) Spring Boot
7 6 (4.84%) Apache NiFi
7 6 (4.84%) Play Framework
7 6 (4.84%) XML
8 5 (4.03%) JSON
8 5 (4.03%) React
8 5 (4.03%) REST
8 5 (4.03%) RESTful
8 5 (4.03%) scikit-learn
9 4 (3.23%) Node.js
9 4 (3.23%) NumPy
9 4 (3.23%) Web Services
10 3 (2.42%) HTML
Miscellaneous
1 17 (13.71%) Algorithms
2 15 (12.10%) Data Structures
3 10 (8.06%) Greenfield Project
4 8 (6.45%) Analytical Skills
5 6 (4.84%) Linux Command Line
5 6 (4.84%) User Experience
6 3 (2.42%) Cloud Native
6 3 (2.42%) Derivative
7 2 (1.61%) Equities
7 2 (1.61%) Foreign Exchange (FX)
7 2 (1.61%) Self-Motivation
8 1 (0.81%) Credit Risk
8 1 (0.81%) Enterprise Cloud
8 1 (0.81%) Fixed Income
8 1 (0.81%) Grid Computing
8 1 (0.81%) Hedge funds
8 1 (0.81%) Industry 4.0
8 1 (0.81%) Market Risk
8 1 (0.81%) Spread Betting
Operating Systems
1 16 (12.90%) Unix
2 12 (9.68%) Linux
3 3 (2.42%) CentOS
3 3 (2.42%) Red Hat Enterprise Linux
3 3 (2.42%) Windows
4 2 (1.61%) Android
4 2 (1.61%) Apple iOS
4 2 (1.61%) Debian
4 2 (1.61%) Mac OS X
4 2 (1.61%) Ubuntu
Processes & Methodologies
1 50 (40.32%) Agile Software Development
2 37 (29.84%) Analytics
3 32 (25.81%) Data Science
4 29 (23.39%) DevOps
5 24 (19.35%) Microservices
6 23 (18.55%) Machine Learning
7 22 (17.74%) ETL
7 22 (17.74%) TDD
8 17 (13.71%) Data Modelling
9 16 (12.90%) Software Engineering
10 15 (12.10%) Business Intelligence
10 15 (12.10%) Open Source
11 11 (8.87%) BDD
11 11 (8.87%) Computer Science
11 11 (8.87%) Data Engineering
11 11 (8.87%) Scrum
12 9 (7.26%) Artificial Intelligence
12 9 (7.26%) Migration
13 8 (6.45%) Data Architecture
14 7 (5.65%) Test Automation
Programming Languages
1 75 (60.48%) Python
2 68 (54.84%) Java
3 63 (50.81%) SQL
4 45 (36.29%) Scala
5 12 (9.68%) R
6 7 (5.65%) C++
7 5 (4.03%) Bash Shell
7 5 (4.03%) Go
7 5 (4.03%) JavaScript
8 4 (3.23%) AWK
8 4 (3.23%) Clojure
8 4 (3.23%) sed
9 3 (2.42%) Perl
9 3 (2.42%) Ruby
10 2 (1.61%) C
10 2 (1.61%) PHP
10 2 (1.61%) PL/SQL
10 2 (1.61%) Shell Script
10 2 (1.61%) T-SQL
10 2 (1.61%) VBA
Qualifications
1 4 (3.23%) Security Cleared
2 3 (2.42%) Degree
2 3 (2.42%) SC Cleared
3 2 (1.61%) Numerate Degree
3 2 (1.61%) PhD
4 1 (0.81%) AWS Certification
4 1 (0.81%) CCA
4 1 (0.81%) Computer Science Degree
4 1 (0.81%) DV Cleared
4 1 (0.81%) RHCE
Quality Assurance & Compliance
1 5 (4.03%) Data Quality
2 1 (0.81%) GDPR
2 1 (0.81%) QA
System Software
1 29 (23.39%) Docker
2 15 (12.10%) HDFS
3 3 (2.42%) Apache ZooKeeper
4 1 (0.81%) Samba
4 1 (0.81%) VirtualBox
4 1 (0.81%) VMware ESXi
4 1 (0.81%) VMware Infrastructure
Systems Management
1 24 (19.35%) Kubernetes
2 17 (13.71%) Ansible
2 17 (13.71%) Hadoop YARN
3 10 (8.06%) Puppet
4 9 (7.26%) Opscode Chef
4 9 (7.26%) Terraform
5 7 (5.65%) Cobbler
6 5 (4.03%) Oozie
7 2 (1.61%) Grafana
7 2 (1.61%) Kibana
7 2 (1.61%) Prometheus
7 2 (1.61%) Salt
8 1 (0.81%) Ambari
8 1 (0.81%) Docker Swarm
8 1 (0.81%) ITRS Geneos
8 1 (0.81%) Nagios
8 1 (0.81%) Suricata
Vendors
1 18 (14.52%) Google
2 15 (12.10%) Cloudera
3 11 (8.87%) Tableau
4 9 (7.26%) Oracle
5 7 (5.65%) Hortonworks
6 6 (4.84%) Microsoft
7 4 (3.23%) Teradata
8 3 (2.42%) Informatica
8 3 (2.42%) Red Hat
8 3 (2.42%) Sybase
8 3 (2.42%) Talend
9 2 (1.61%) Palantir
9 2 (1.61%) SAP
9 2 (1.61%) Splunk
10 1 (0.81%) Foundry
10 1 (0.81%) HP
10 1 (0.81%) Huawei
10 1 (0.81%) IBM
10 1 (0.81%) Isilon
10 1 (0.81%) Qualys