Period
to 17 July 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 17 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
17 Jul 2019
Same period 2018 Same period 2017
Rank 87 80 73
Rank change year-on-year -7 -7 +48
Contract jobs citing Hadoop 190 215 210
As % of all contract IT jobs advertised in the City of London 2.85% 3.03% 3.25%
As % of the Database & Business Intelligence category 10.66% 12.02% 12.59%
Number of daily rates quoted 153 184 185
City of London median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.55% +0.92%
10th Percentile £500 £463 £425
90th Percentile £700 £713 £695
Central London median daily rate £550 £563 £550
% change year-on-year -2.22% +2.27% +1.85%
Number of hourly rates quoted 3 0 0
City of London median hourly rate £44.57 - -
Central London median hourly rate £44.57 - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,782 1,788 1,668
As % of all contract IT jobs advertised in the City of London 26.77% 25.21% 25.82%
Number of daily rates quoted 1,399 1,437 1,306
City of London median daily rate £525 £525 £513
Median daily rate % change year-on-year - +2.44% +7.89%
10th Percentile £400 £363 £349
90th Percentile £687 £688 £675
Central London median daily rate £525 £525 £500
% change year-on-year - +5.00% +5.26%
Number of hourly rates quoted 11 12 6
City of London median hourly rate £44.57 £22.00 £21.92
Median hourly rate % change year-on-year +102.57% +0.38% +15.36%
10th Percentile £22.25 £17.57 £20.75
90th Percentile £60.75 £33.00 £27.74
Central London median hourly rate £35.00 £22.50 £21.92
% change year-on-year +55.56% +2.66% +15.36%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 17 July 2019.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in the City of London.

Contractor hourly rate trend for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 17 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -11 47 £550 +4.76%
Moorgate - 11 £575 -
Hadoop
Central London

For the 6 months to 17 July 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 152 (80.00%) Apache Spark
2 128 (67.37%) Big Data
3 96 (50.53%) SQL
4 95 (50.00%) Apache Hive
5 94 (49.47%) Kafka
6 90 (47.37%) Python
7 85 (44.74%) Finance
8 79 (41.58%) Data Science
9 77 (40.53%) Analytics
10 69 (36.32%) Machine Learning
10 69 (36.32%) Data Modelling
11 68 (35.79%) Java
12 65 (34.21%) Agile Software Development
13 63 (33.16%) Amazon AWS
14 58 (30.53%) Scala
15 55 (28.95%) Data Warehouse
16 46 (24.21%) DevOps
17 41 (21.58%) OLAP
18 39 (20.53%) Star Schema
18 39 (20.53%) Oozie
18 39 (20.53%) Enterprise Data Warehouse
19 38 (20.00%) SQL Optimisation
19 38 (20.00%) OLAP Cube
19 38 (20.00%) Data Quality
20 36 (18.95%) HBase
20 36 (18.95%) Linux
21 32 (16.84%) Google Cloud Platform
22 30 (15.79%) Banking
22 30 (15.79%) Jenkins
23 28 (14.74%) Docker

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 152 (80.00%) Apache Spark
2 17 (8.95%) Elasticsearch
3 15 (7.89%) Apache
4 12 (6.32%) Confluence
5 10 (5.26%) Apache Airflow
6 3 (1.58%) Apache Solr
6 3 (1.58%) JBoss
6 3 (1.58%) Jetty
6 3 (1.58%) Jupyter
6 3 (1.58%) Tomcat
7 2 (1.05%) Luigi
7 2 (1.05%) Oracle Self-Service HR
7 2 (1.05%) SAS
7 2 (1.05%) WebLogic
8 1 (0.53%) Apache Pig
8 1 (0.53%) Cloud Foundry
8 1 (0.53%) nginx
Applications
1 4 (2.11%) Microsoft Excel
2 1 (0.53%) SPSS
2 1 (0.53%) Stata
Business Applications
1 2 (1.05%) SAP ERP
1 2 (1.05%) SAP Oil and Gas
1 2 (1.05%) SAP S/4HANA
Cloud Services
1 63 (33.16%) Amazon AWS
2 32 (16.84%) Google Cloud Platform
3 18 (9.47%) Microsoft Azure
4 13 (6.84%) Amazon S3
5 12 (6.32%) Amazon EMR
6 10 (5.26%) Amazon SageMaker
6 10 (5.26%) Serverless
7 9 (4.74%) Power Platform
8 8 (4.21%) Amazon EC2
9 7 (3.68%) Amazon Kinesis
9 7 (3.68%) AWS Lambda
9 7 (3.68%) Cloud Computing
9 7 (3.68%) GitHub
10 6 (3.16%) AWS CloudFormation
10 6 (3.16%) Azure Data Factory
11 4 (2.11%) Datadog
11 4 (2.11%) SaaS
12 3 (1.58%) Apigee
12 3 (1.58%) Data Lake Analytics
12 3 (1.58%) PaaS
Communications & Networking
1 3 (1.58%) Kerberos
2 2 (1.05%) SSH
3 1 (0.53%) DNS
3 1 (0.53%) FTP
3 1 (0.53%) HTTP
3 1 (0.53%) InfiniBand
3 1 (0.53%) Internet
3 1 (0.53%) NAS
3 1 (0.53%) SSL
3 1 (0.53%) TCP/IP
Database & Business Intelligence
1 128 (67.37%) Big Data
2 95 (50.00%) Apache Hive
3 55 (28.95%) Data Warehouse
4 41 (21.58%) OLAP
5 39 (20.53%) Enterprise Data Warehouse
5 39 (20.53%) Star Schema
6 38 (20.00%) OLAP Cube
7 36 (18.95%) HBase
8 23 (12.11%) NoSQL
9 18 (9.47%) Data Lake
9 18 (9.47%) MongoDB
10 16 (8.42%) MySQL
11 15 (7.89%) Impala
12 14 (7.37%) PostgreSQL
13 13 (6.84%) SQL Server
14 10 (5.26%) Amazon Redshift
14 10 (5.26%) Relational Database
14 10 (5.26%) Sqoop
15 9 (4.74%) Power BI
16 8 (4.21%) Apache Cassandra
Development Applications
1 30 (15.79%) Jenkins
2 25 (13.16%) JIRA
3 20 (10.53%) Git (software)
4 9 (4.74%) RStudio
5 7 (3.68%) IBM UrbanCode
5 7 (3.68%) Maven
5 7 (3.68%) Travis CI
5 7 (3.68%) Visual Studio Team System
6 5 (2.63%) Subversion
7 4 (2.11%) Atlassian Bamboo
7 4 (2.11%) Sonatype Nexus
8 3 (1.58%) Cucumber
8 3 (1.58%) FishEye
8 3 (1.58%) Gradle
8 3 (1.58%) Hudson
8 3 (1.58%) Octopus Deploy
8 3 (1.58%) SpecFlow
8 3 (1.58%) TeamCity
8 3 (1.58%) tSQLt
9 2 (1.05%) Poseidon for UML
General
1 85 (44.74%) Finance
2 30 (15.79%) Banking
3 10 (5.26%) Retail
4 9 (4.74%) Investment Banking
5 7 (3.68%) Retail Banking
6 5 (2.63%) Front Office
7 3 (1.58%) Publishing
8 2 (1.05%) Games
8 2 (1.05%) Telecoms
9 1 (0.53%) Back Office
9 1 (0.53%) Financial Institution
9 1 (0.53%) Pharmaceutical
Job Titles
1 95 (50.00%) Data Engineer
2 50 (26.32%) Hadoop Engineer
3 31 (16.32%) Developer
4 23 (12.11%) Java Developer
5 19 (10.00%) Architect
6 17 (8.95%) Big Data Engineer
7 12 (6.32%) Python Engineer
8 11 (5.79%) Data Architect
8 11 (5.79%) DevOps Engineer
9 10 (5.26%) Hadoop Developer
10 9 (4.74%) Java Hadoop Developer
11 8 (4.21%) AWS Engineer
11 8 (4.21%) Java Engineer
12 7 (3.68%) Big Data Architect
12 7 (3.68%) Big Data Developer
12 7 (3.68%) Cloud Engineer
12 7 (3.68%) Platform Engineer
12 7 (3.68%) Unix Engineer
13 6 (3.16%) Administrator
13 6 (3.16%) Hadoop Administrator
Libraries, Frameworks & Software Standards
1 94 (49.47%) Kafka
2 21 (11.05%) Spring
3 20 (10.53%) PySpark
4 15 (7.89%) Spark Streaming
5 12 (6.32%) Play Framework
6 11 (5.79%) scikit-learn
7 10 (5.26%) MLlib
8 9 (4.74%) Spring Boot
9 8 (4.21%) Apache NiFi
9 8 (4.21%) RESTful
10 6 (3.16%) Web Services
11 5 (2.63%) Elastic Stack
11 5 (2.63%) Velocity
11 5 (2.63%) XML
12 4 (2.11%) Java Concurrency
12 4 (2.11%) JSON
12 4 (2.11%) Lambda Expressions
12 4 (2.11%) REST
13 3 (1.58%) HTML
13 3 (1.58%) HTML5
Miscellaneous
1 20 (10.53%) Algorithms
2 18 (9.47%) Data Structures
3 13 (6.84%) Analytical Skills
4 12 (6.32%) Greenfield Project
5 7 (3.68%) Linux Command Line
6 6 (3.16%) User Experience
7 3 (1.58%) Market Risk
8 2 (1.05%) Client/Server
8 2 (1.05%) Cloud Native
8 2 (1.05%) Derivative
8 2 (1.05%) Foreign Exchange (FX)
8 2 (1.05%) Industry 4.0
9 1 (0.53%) Credit Risk
9 1 (0.53%) Data Centre
9 1 (0.53%) Data Protection Act
9 1 (0.53%) Enterprise Cloud
9 1 (0.53%) Enterprise Software
9 1 (0.53%) Public Cloud
9 1 (0.53%) Self-Motivation
9 1 (0.53%) Spread Betting
Operating Systems
1 36 (18.95%) Linux
2 27 (14.21%) Unix
3 6 (3.16%) Red Hat Enterprise Linux
4 4 (2.11%) CentOS
4 4 (2.11%) Windows
5 3 (1.58%) Debian
5 3 (1.58%) Ubuntu
6 2 (1.05%) Android
6 2 (1.05%) Apple iOS
6 2 (1.05%) Mac OS X
Processes & Methodologies
1 79 (41.58%) Data Science
2 77 (40.53%) Analytics
3 69 (36.32%) Data Modelling
3 69 (36.32%) Machine Learning
4 65 (34.21%) Agile Software Development
5 46 (24.21%) DevOps
6 38 (20.00%) SQL Optimisation
7 24 (12.63%) TDD
8 20 (10.53%) Artificial Intelligence
8 20 (10.53%) ETL
9 18 (9.47%) Microservices
10 16 (8.42%) Business Intelligence
11 15 (7.89%) Computer Science
12 14 (7.37%) Scrum
13 13 (6.84%) Configuration Management
14 12 (6.32%) Open Source
14 12 (6.32%) Test Automation
15 11 (5.79%) Data Architecture
15 11 (5.79%) Performance Tuning
15 11 (5.79%) Visualisation
Programming Languages
1 96 (50.53%) SQL
2 90 (47.37%) Python
3 68 (35.79%) Java
4 58 (30.53%) Scala
5 21 (11.05%) R
6 9 (4.74%) Java 8
6 9 (4.74%) JavaScript
7 8 (4.21%) Shell Script
8 6 (3.16%) Clojure
8 6 (3.16%) Perl
8 6 (3.16%) T-SQL
9 5 (2.63%) U-SQL
10 4 (2.11%) Bash Shell
10 4 (2.11%) C++
10 4 (2.11%) Kotlin
10 4 (2.11%) Ruby
10 4 (2.11%) VBA
11 3 (1.58%) Go
11 3 (1.58%) Groovy
12 2 (1.05%) PowerShell
Qualifications
1 7 (3.68%) Degree
1 7 (3.68%) Security Cleared
2 6 (3.16%) SC Cleared
3 3 (1.58%) PhD
4 2 (1.05%) Master's Degree
4 2 (1.05%) Numerate Degree
4 2 (1.05%) RHCE
5 1 (0.53%) AWS Certification
5 1 (0.53%) CCA
5 1 (0.53%) Computer Science Degree
5 1 (0.53%) DV Cleared
5 1 (0.53%) Postgraduate
Quality Assurance & Compliance
1 38 (20.00%) Data Quality
2 2 (1.05%) GDPR
System Software
1 28 (14.74%) Docker
2 24 (12.63%) HDFS
3 7 (3.68%) Apache Flume
4 2 (1.05%) Apache ZooKeeper
5 1 (0.53%) Oracle RAC
5 1 (0.53%) Samba
5 1 (0.53%) VMware ESXi
5 1 (0.53%) VMware Infrastructure
Systems Management
1 39 (20.53%) Oozie
2 25 (13.16%) Hadoop YARN
3 24 (12.63%) Kubernetes
4 14 (7.37%) Ansible
5 8 (4.21%) Terraform
6 5 (2.63%) Puppet
7 3 (1.58%) Kibana
7 3 (1.58%) logstash
7 3 (1.58%) Marathon
7 3 (1.58%) Mesos
7 3 (1.58%) Opscode Chef
8 2 (1.05%) Ambari
8 2 (1.05%) Grafana
8 2 (1.05%) Salt
8 2 (1.05%) Tivoli
9 1 (0.53%) Cobbler
9 1 (0.53%) Docker Swarm
9 1 (0.53%) Nagios
9 1 (0.53%) Prometheus
9 1 (0.53%) Suricata
Vendors
1 27 (14.21%) Google
2 15 (7.89%) Oracle
3 12 (6.32%) Cloudera
4 11 (5.79%) Microsoft
5 9 (4.74%) Tableau
6 5 (2.63%) Hortonworks
6 5 (2.63%) Talend
7 4 (2.11%) IBM
7 4 (2.11%) Red Hat
7 4 (2.11%) StreamSets
7 4 (2.11%) Sybase
7 4 (2.11%) Teradata
8 3 (1.58%) Informatica
8 3 (1.58%) SAP
8 3 (1.58%) Splunk
9 2 (1.05%) Alteryx
9 2 (1.05%) AppDynamics
9 2 (1.05%) Datameer
9 2 (1.05%) Dynatrace
9 2 (1.05%) Logi