Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 6 December 2019

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 6 December 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
London > Central London
6 months to
6 Dec 2019		 Same period 2018 Same period 2017
Rank 117 102 94
Rank change year-on-year -15 -8 -27
Contract jobs citing Hadoop 142 253 238
As % of all contract IT jobs advertised in Central London 1.96% 2.71% 2.74%
As % of the Database & Business Intelligence category 7.88% 11.08% 11.10%
Number of daily rates quoted 119 202 202
Central London median daily rate £575 £575 £600
Median daily rate % change year-on-year - -4.17% +3.45%
10th Percentile £463 £479 £475
90th Percentile £715 £700 £725
London median daily rate £575 £575 £550
% change year-on-year - +4.55% -
Number of hourly rates quoted 0 0 0
Central London median hourly rate - - -
London median hourly rate - £55.00 -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 1,802 2,283 2,145
As % of all contract IT jobs advertised in Central London 24.89% 24.42% 24.71%
Number of daily rates quoted 1,405 1,825 1,739
Central London median daily rate £523 £525 £523
Median daily rate % change year-on-year -0.48% +0.48% +10.00%
10th Percentile £373 £368 £363
90th Percentile £675 £675 £688
London median daily rate £525 £525 £500
% change year-on-year - +5.00% +5.26%
Number of hourly rates quoted 5 11 14
Central London median hourly rate £35.00 £35.00 £25.99
Median hourly rate % change year-on-year - +34.65% -42.24%
10th Percentile £21.20 £19.50 £20.75
90th Percentile £86.70 £42.19 £33.25
London median hourly rate £35.00 £27.50 £26.60
% change year-on-year +27.27% +3.38% -10.98%

Hadoop
Job Vacancy Trend in Central London

Job postings citing Hadoop as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Central London.

Contractor daily rate trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Hadoop in Central London over the 6 months to 6 December 2019.

Contractor daily rate histogram for Hadoop in Central London

Hadoop
Contractor Hourly Rate Trend in Central London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in Central London.

Contractor hourly rate trend for Hadoop in Central London

Hadoop
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the Central London region over the 6 months to 6 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
City of London -22 115 £575 - 39
Southwark +12 2 £550 +2.33%
City of Westminster +2 2 £900 +71.43%
Hadoop
London

For the 6 months to 6 December 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Hadoop.

1 97 (68.31%) Apache Spark
2 84 (59.15%) Python
3 81 (57.04%) Big Data
4 71 (50.00%) Java
5 66 (46.48%) SQL
6 60 (42.25%) AWS
7 52 (36.62%) Kafka
8 51 (35.92%) Agile Software Development
9 48 (33.80%) Scala
10 47 (33.10%) Finance
11 46 (32.39%) Apache Hive
12 38 (26.76%) Analytics
13 37 (26.06%) Data Science
14 29 (20.42%) ETL
14 29 (20.42%) NoSQL
15 28 (19.72%) Docker
16 27 (19.01%) DevOps
16 27 (19.01%) Kubernetes
16 27 (19.01%) Data Warehouse
17 26 (18.31%) Spring
18 25 (17.61%) Jenkins
19 24 (16.90%) Microservices
20 23 (16.20%) Data Structures
20 23 (16.20%) TDD
21 22 (15.49%) Data Modelling
22 21 (14.79%) Cloudera
22 21 (14.79%) Machine Learning
23 20 (14.08%) GCP
23 20 (14.08%) PySpark
24 19 (13.38%) Git (software)

Hadoop
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 97 (68.31%) Apache Spark
2 13 (9.15%) Elasticsearch
3 11 (7.75%) Apache
4 10 (7.04%) Tomcat
5 9 (6.34%) Apache Airflow
5 9 (6.34%) JBoss
5 9 (6.34%) Jetty
6 6 (4.23%) Luigi
7 5 (3.52%) Confluence
8 4 (2.82%) SAS
9 3 (2.11%) Jupyter
10 2 (1.41%) Oracle Self-Service HR
10 2 (1.41%) WebLogic
11 1 (0.70%) Pachyderm
Applications
1 4 (2.82%) Microsoft Excel
Business Applications
1 2 (1.41%) SAP Oil and Gas
2 1 (0.70%) FINCAD Analytics
2 1 (0.70%) SAP MDM
Cloud Services
1 60 (42.25%) AWS
2 20 (14.08%) GCP
3 18 (12.68%) Amazon EMR
3 18 (12.68%) Amazon S3
3 18 (12.68%) Azure
4 9 (6.34%) Amazon EC2
5 7 (4.93%) AWS Lambda
5 7 (4.93%) GitHub
5 7 (4.93%) Serverless
6 6 (4.23%) Amazon Kinesis
6 6 (4.23%) AWS CloudFormation
7 5 (3.52%) Power Platform
8 3 (2.11%) Amazon EKS
8 3 (2.11%) AWS Step Functions
8 3 (2.11%) Cloud Computing
8 3 (2.11%) Virtual Private Cloud
9 2 (1.41%) Amazon CloudWatch
9 2 (1.41%) Amazon Cognito
9 2 (1.41%) Amazon SageMaker
9 2 (1.41%) AWS CloudTrail
Communications & Networking
1 4 (2.82%) SSH
2 1 (0.70%) Broadband
2 1 (0.70%) HTTP
2 1 (0.70%) InfiniBand
2 1 (0.70%) Internet
2 1 (0.70%) NAS
2 1 (0.70%) TCP/IP
2 1 (0.70%) Wi-Fi
2 1 (0.70%) Wireshark
Database & Business Intelligence
1 81 (57.04%) Big Data
2 46 (32.39%) Apache Hive
3 29 (20.42%) NoSQL
4 27 (19.01%) Data Warehouse
5 19 (13.38%) HBase
6 17 (11.97%) MongoDB
7 16 (11.27%) PostgreSQL
8 15 (10.56%) Data Lake
9 12 (8.45%) Amazon Redshift
10 11 (7.75%) Impala
11 10 (7.04%) Spark SQL
12 9 (6.34%) Amazon Athena
12 9 (6.34%) MySQL
12 9 (6.34%) Presto
12 9 (6.34%) Relational Database
13 8 (5.63%) Apache Cassandra
14 7 (4.93%) Flink
15 6 (4.23%) Azkaban
15 6 (4.23%) BigQuery
15 6 (4.23%) Sqoop
Development Applications
1 25 (17.61%) Jenkins
2 19 (13.38%) Git (software)
3 16 (11.27%) JIRA
4 11 (7.75%) Maven
5 6 (4.23%) Atlassian Bamboo
5 6 (4.23%) Travis CI
6 3 (2.11%) Cucumber
6 3 (2.11%) Eclipse
6 3 (2.11%) Mercurial
6 3 (2.11%) Subversion
6 3 (2.11%) Vagrant
7 2 (1.41%) Ant
7 2 (1.41%) ClearCase
7 2 (1.41%) FishEye
7 2 (1.41%) Hudson
7 2 (1.41%) IntelliJ
7 2 (1.41%) Leiningen
7 2 (1.41%) Poseidon for UML
7 2 (1.41%) Selenium
7 2 (1.41%) Team Foundation Server
General
1 47 (33.10%) Finance
2 14 (9.86%) Banking
3 9 (6.34%) Front Office
4 7 (4.93%) Retail
5 6 (4.23%) Marketing
5 6 (4.23%) Retail Banking
6 5 (3.52%) Investment Banking
7 2 (1.41%) Games
7 2 (1.41%) Public Sector
7 2 (1.41%) Publishing
7 2 (1.41%) Telecoms
8 1 (0.70%) Financial Institution
Job Titles
1 58 (40.85%) Data Engineer
2 38 (26.76%) Developer
3 20 (14.08%) Java Developer
4 16 (11.27%) Architect
5 13 (9.15%) Big Data Engineer
6 10 (7.04%) Hadoop Developer
6 10 (7.04%) Java Engineer
6 10 (7.04%) Python Engineer
7 9 (6.34%) AWS Engineer
7 9 (6.34%) Big Data Developer
7 9 (6.34%) Data Architect
7 9 (6.34%) Hadoop Engineer
7 9 (6.34%) Python Developer
8 8 (5.63%) Java Hadoop Developer
9 6 (4.23%) Analyst
9 6 (4.23%) Cloud Architect
10 5 (3.52%) Data Scientist
10 5 (3.52%) Scala Developer
11 4 (2.82%) DevOps Engineer
11 4 (2.82%) JavaScript Developer
Libraries, Frameworks & Software Standards
1 52 (36.62%) Kafka
2 26 (18.31%) Spring
3 20 (14.08%) PySpark
4 19 (13.38%) Spark Streaming
5 9 (6.34%) Hibernate
6 8 (5.63%) Lambda Expressions
7 7 (4.93%) Java Concurrency
7 7 (4.93%) Spring Boot
8 6 (4.23%) React
8 6 (4.23%) REST
8 6 (4.23%) XML
9 5 (3.52%) JSON
9 5 (3.52%) Node.js
9 5 (3.52%) NumPy
9 5 (3.52%) Play Framework
10 4 (2.82%) AngularJS
10 4 (2.82%) RabbitMQ
10 4 (2.82%) RESTful
10 4 (2.82%) scikit-learn
10 4 (2.82%) Web Services
Miscellaneous
1 23 (16.20%) Data Structures
2 18 (12.68%) Algorithms
3 13 (9.15%) Greenfield Project
4 10 (7.04%) Analytical Skills
5 8 (5.63%) Linux Command Line
6 6 (4.23%) User Experience
7 5 (3.52%) Cloud Native
8 4 (2.82%) Derivative
9 3 (2.11%) Fixed Income
9 3 (2.11%) Hedge funds
10 2 (1.41%) Equities
10 2 (1.41%) Foreign Exchange (FX)
10 2 (1.41%) Self-Motivation
11 1 (0.70%) Client/Server
11 1 (0.70%) Credit Risk
11 1 (0.70%) Enterprise Cloud
11 1 (0.70%) Grid Computing
11 1 (0.70%) Management Information System
11 1 (0.70%) Market Risk
11 1 (0.70%) Spread Betting
Operating Systems
1 16 (11.27%) Unix
2 13 (9.15%) Linux
3 4 (2.82%) Red Hat Enterprise Linux
4 3 (2.11%) CentOS
4 3 (2.11%) Debian
4 3 (2.11%) Ubuntu
4 3 (2.11%) Windows
5 2 (1.41%) Android
5 2 (1.41%) Apple iOS
5 2 (1.41%) Mac OS X
Processes & Methodologies
1 51 (35.92%) Agile Software Development
2 38 (26.76%) Analytics
3 37 (26.06%) Data Science
4 29 (20.42%) ETL
5 27 (19.01%) DevOps
6 24 (16.90%) Microservices
7 23 (16.20%) TDD
8 22 (15.49%) Data Modelling
9 21 (14.79%) Machine Learning
10 16 (11.27%) Computer Science
11 15 (10.56%) Software Engineering
12 14 (9.86%) Business Intelligence
12 14 (9.86%) Data Engineering
12 14 (9.86%) Open Source
13 11 (7.75%) BDD
14 10 (7.04%) Scrum
15 9 (6.34%) Data Transformation
15 9 (6.34%) Migration
15 9 (6.34%) Problem-Solving
16 8 (5.63%) Actionable Insight
Programming Languages
1 84 (59.15%) Python
2 71 (50.00%) Java
3 66 (46.48%) SQL
4 48 (33.80%) Scala
5 11 (7.75%) JavaScript
5 11 (7.75%) R
6 9 (6.34%) C++
7 5 (3.52%) AWK
7 5 (3.52%) sed
8 4 (2.82%) Bash Shell
8 4 (2.82%) Clojure
9 3 (2.11%) Go
9 3 (2.11%) Perl
9 3 (2.11%) Ruby
10 2 (1.41%) ClojureScript
10 2 (1.41%) Groovy
10 2 (1.41%) Kotlin
10 2 (1.41%) PL/SQL
10 2 (1.41%) T-SQL
10 2 (1.41%) VBA
Qualifications
1 7 (4.93%) Degree
2 6 (4.23%) Security Cleared
3 5 (3.52%) Computer Science Degree
4 3 (2.11%) DV Cleared
4 3 (2.11%) SC Cleared
5 2 (1.41%) Numerate Degree
5 2 (1.41%) PhD
6 1 (0.70%) AWS Certification
6 1 (0.70%) CCA
6 1 (0.70%) RHCE
6 1 (0.70%) SAS Certification
Quality Assurance & Compliance
1 4 (2.82%) Data Quality
2 1 (0.70%) GDPR
2 1 (0.70%) QA
System Software
1 28 (19.72%) Docker
2 17 (11.97%) HDFS
3 3 (2.11%) Apache Flume
4 2 (1.41%) Apache ZooKeeper
5 1 (0.70%) VirtualBox
Systems Management
1 27 (19.01%) Kubernetes
2 17 (11.97%) Ansible
3 16 (11.27%) Hadoop YARN
4 10 (7.04%) Puppet
5 9 (6.34%) Opscode Chef
6 7 (4.93%) Cobbler
7 6 (4.23%) Terraform
8 4 (2.82%) Oozie
9 2 (1.41%) Grafana
9 2 (1.41%) Kibana
9 2 (1.41%) Prometheus
9 2 (1.41%) Salt
10 1 (0.70%) Docker Swarm
10 1 (0.70%) ITRS Geneos
10 1 (0.70%) Kubeflow
10 1 (0.70%) Nagios
10 1 (0.70%) SELinux
10 1 (0.70%) Single Sign-On
10 1 (0.70%) Suricata
Vendors
1 21 (14.79%) Cloudera
2 15 (10.56%) Google
3 9 (6.34%) Oracle
3 9 (6.34%) Tableau
4 8 (5.63%) Talend
5 7 (4.93%) Microsoft
6 6 (4.23%) Hortonworks
7 5 (3.52%) Informatica
7 5 (3.52%) Teradata
8 4 (2.82%) SAP
9 3 (2.11%) Palantir
9 3 (2.11%) Sybase
10 2 (1.41%) Ab Initio
10 2 (1.41%) Red Hat
10 2 (1.41%) Splunk
11 1 (0.70%) Atlassian
11 1 (0.70%) Bloomberg
11 1 (0.70%) Foundry
11 1 (0.70%) Huawei
11 1 (0.70%) Qualys