Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 19 July 2019

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 19 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
London > Central London
6 months to
19 Jul 2019		 Same period 2018 Same period 2017
Rank 89 79 86
Rank change year-on-year -10 +7 +23
Contract jobs citing Hadoop 243 287 214
As % of all contract IT jobs advertised in Central London 2.81% 3.09% 2.81%
As % of the Database & Business Intelligence category 10.42% 12.14% 11.08%
Number of daily rates quoted 195 250 187
Central London median daily rate £550 £563 £550
Median daily rate % change year-on-year -2.22% +2.27% +0.92%
10th Percentile £513 £463 £425
90th Percentile £688 £700 £693
London median daily rate £575 £550 £537
% change year-on-year +4.55% +2.52% -2.45%
Number of hourly rates quoted 3 0 0
Central London median hourly rate £44.57 - -
London median hourly rate £42.50 £75.00 -
% change year-on-year -43.33% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 2,333 2,365 1,931
As % of all contract IT jobs advertised in Central London 26.97% 25.50% 25.36%
Number of daily rates quoted 1,830 1,876 1,491
Central London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +8.11%
10th Percentile £387 £363 £325
90th Percentile £675 £675 £663
London median daily rate £525 £520 £500
% change year-on-year +0.96% +4.00% +5.26%
Number of hourly rates quoted 15 15 6
Central London median hourly rate £35.00 £22.50 £21.92
Median hourly rate % change year-on-year +55.56% +2.66% +15.36%
10th Percentile £20.00 £18.38 £20.75
90th Percentile £59.05 £36.45 £27.74
London median hourly rate £35.00 £30.00 £26.88
% change year-on-year +16.67% +11.60% -0.16%

Hadoop
Job Vacancy Trend in Central London

Job postings citing Hadoop as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Central London.

Contractor daily rate trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Hadoop in Central London over the 6 months to 19 July 2019.

Contractor daily rate histogram for Hadoop in Central London

Hadoop
Contractor Hourly Rate Trend in Central London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in Central London.

Contractor hourly rate trend for Hadoop in Central London

Hadoop
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the Central London region over the 6 months to 19 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
City of London -4 190 £575 - 47
Southwark -8 47 £550 +4.76%
West End of London +5 4 - -
City of Westminster -18 4 £563 +7.14%
Kensington and Chelsea - 1 - -
Hadoop
London

For the 6 months to 19 July 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Hadoop.

1 194 (79.84%) Apache Spark
2 177 (72.84%) Big Data
3 137 (56.38%) Kafka
4 133 (54.73%) Python
5 122 (50.21%) Apache Hive
6 114 (46.91%) Finance
7 108 (44.44%) SQL
8 96 (39.51%) Data Modelling
9 88 (36.21%) Data Warehouse
9 88 (36.21%) Data Science
10 82 (33.74%) Analytics
11 79 (32.51%) Amazon AWS
12 76 (31.28%) Java
13 75 (30.86%) Agile Software Development
14 74 (30.45%) Machine Learning
15 62 (25.51%) Scala
16 50 (20.58%) DevOps
17 44 (18.11%) Data Lake
17 44 (18.11%) Google Cloud Platform
18 41 (16.87%) OLAP
18 41 (16.87%) Linux
19 40 (16.46%) Cloudera
20 39 (16.05%) Oozie
20 39 (16.05%) HBase
20 39 (16.05%) Enterprise Data Warehouse
20 39 (16.05%) Star Schema
21 38 (15.64%) OLAP Cube
21 38 (15.64%) SQL Optimisation
21 38 (15.64%) Data Quality
22 37 (15.23%) Google

Hadoop
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 194 (79.84%) Apache Spark
2 19 (7.82%) Elasticsearch
3 17 (7.00%) Apache
4 13 (5.35%) Confluence
5 11 (4.53%) Apache Airflow
6 4 (1.65%) Apache Solr
6 4 (1.65%) Jupyter
7 3 (1.23%) JBoss
7 3 (1.23%) Jetty
7 3 (1.23%) Luigi
7 3 (1.23%) Pachyderm
7 3 (1.23%) Tomcat
8 2 (0.82%) Oracle Self-Service HR
8 2 (0.82%) SAS
8 2 (0.82%) WebLogic
9 1 (0.41%) Apache Pig
9 1 (0.41%) Cloud Foundry
9 1 (0.41%) nginx
Applications
1 4 (1.65%) Microsoft Excel
2 1 (0.41%) SPSS
2 1 (0.41%) Stata
Business Applications
1 5 (2.06%) SAP Oil and Gas
2 2 (0.82%) SAP ERP
2 2 (0.82%) SAP S/4HANA
Cloud Services
1 79 (32.51%) Amazon AWS
2 44 (18.11%) Google Cloud Platform
3 32 (13.17%) Microsoft Azure
4 18 (7.41%) Amazon EMR
5 14 (5.76%) Amazon S3
6 11 (4.53%) Serverless
7 10 (4.12%) Amazon SageMaker
8 9 (3.70%) Power Platform
9 8 (3.29%) Amazon EC2
9 8 (3.29%) Amazon Kinesis
9 8 (3.29%) AWS Lambda
10 7 (2.88%) AWS CloudFormation
10 7 (2.88%) Cloud Computing
10 7 (2.88%) GitHub
11 6 (2.47%) Azure Data Factory
12 5 (2.06%) PaaS
13 4 (1.65%) Datadog
13 4 (1.65%) SaaS
14 3 (1.23%) Azure Functions
14 3 (1.23%) Data Lake Analytics
Communications & Networking
1 4 (1.65%) Kerberos
2 2 (0.82%) SSH
3 1 (0.41%) DNS
3 1 (0.41%) FTP
3 1 (0.41%) HTTP
3 1 (0.41%) InfiniBand
3 1 (0.41%) Internet
3 1 (0.41%) NAS
3 1 (0.41%) SSL
3 1 (0.41%) TCP/IP
Database & Business Intelligence
1 177 (72.84%) Big Data
2 122 (50.21%) Apache Hive
3 88 (36.21%) Data Warehouse
4 44 (18.11%) Data Lake
5 41 (16.87%) OLAP
6 39 (16.05%) Enterprise Data Warehouse
6 39 (16.05%) HBase
6 39 (16.05%) Star Schema
7 38 (15.64%) OLAP Cube
8 27 (11.11%) NoSQL
9 21 (8.64%) MongoDB
10 18 (7.41%) PostgreSQL
11 16 (6.58%) Impala
11 16 (6.58%) MySQL
12 14 (5.76%) Amazon Redshift
13 13 (5.35%) SQL Server
14 12 (4.94%) Apache Cassandra
14 12 (4.94%) Sqoop
15 10 (4.12%) Relational Database
16 9 (3.70%) Power BI
Development Applications
1 31 (12.76%) Jenkins
2 26 (10.70%) JIRA
3 21 (8.64%) Git (software)
4 9 (3.70%) RStudio
5 7 (2.88%) IBM UrbanCode
5 7 (2.88%) Maven
5 7 (2.88%) Travis CI
5 7 (2.88%) Visual Studio Team System
6 5 (2.06%) Atlassian Bamboo
6 5 (2.06%) Subversion
7 4 (1.65%) Hudson
7 4 (1.65%) Sonatype Nexus
8 3 (1.23%) Cucumber
8 3 (1.23%) FishEye
8 3 (1.23%) Gradle
8 3 (1.23%) Octopus Deploy
8 3 (1.23%) SpecFlow
8 3 (1.23%) TeamCity
8 3 (1.23%) tSQLt
9 2 (0.82%) Mercurial
General
1 114 (46.91%) Finance
2 30 (12.35%) Banking
3 12 (4.94%) Retail
4 9 (3.70%) Investment Banking
5 7 (2.88%) Retail Banking
6 5 (2.06%) Front Office
7 3 (1.23%) Publishing
8 2 (0.82%) Games
8 2 (0.82%) Telecoms
9 1 (0.41%) Back Office
9 1 (0.41%) Financial Institution
9 1 (0.41%) Pharmaceutical
Job Titles
1 137 (56.38%) Data Engineer
2 53 (21.81%) Hadoop Engineer
3 49 (20.16%) Big Data Engineer
4 35 (14.40%) Developer
5 24 (9.88%) Java Developer
5 24 (9.88%) Python Engineer
6 20 (8.23%) Architect
7 15 (6.17%) AWS Engineer
8 13 (5.35%) DevOps Engineer
9 11 (4.53%) Data Architect
10 10 (4.12%) Hadoop Developer
11 9 (3.70%) Java Hadoop Developer
12 8 (3.29%) Java Engineer
13 7 (2.88%) Administrator
13 7 (2.88%) Big Data Architect
13 7 (2.88%) Big Data Developer
13 7 (2.88%) Cloud Engineer
13 7 (2.88%) Platform Engineer
13 7 (2.88%) Unix Engineer
14 6 (2.47%) Senior Developer
Libraries, Frameworks & Software Standards
1 137 (56.38%) Kafka
2 25 (10.29%) PySpark
3 22 (9.05%) Spring
4 18 (7.41%) Spark Streaming
5 12 (4.94%) Play Framework
6 11 (4.53%) scikit-learn
7 10 (4.12%) MLlib
8 9 (3.70%) RESTful
8 9 (3.70%) Spring Boot
9 8 (3.29%) Apache NiFi
9 8 (3.29%) Web Services
10 7 (2.88%) RabbitMQ
11 6 (2.47%) XML
12 5 (2.06%) Elastic Stack
12 5 (2.06%) JSON
12 5 (2.06%) Pandas
12 5 (2.06%) Velocity
13 4 (1.65%) Lambda Expressions
13 4 (1.65%) REST
13 4 (1.65%) TensorFlow
Miscellaneous
1 25 (10.29%) Algorithms
2 19 (7.82%) Data Structures
3 17 (7.00%) Greenfield Project
4 13 (5.35%) Analytical Skills
5 7 (2.88%) Linux Command Line
5 7 (2.88%) User Experience
6 4 (1.65%) Life Science
7 3 (1.23%) Cloud Native
7 3 (1.23%) Market Risk
7 3 (1.23%) Self-Motivation
8 2 (0.82%) Client/Server
8 2 (0.82%) Derivative
8 2 (0.82%) Foreign Exchange (FX)
8 2 (0.82%) Hedge funds
8 2 (0.82%) Industry 4.0
8 2 (0.82%) Public Cloud
9 1 (0.41%) Data Protection Act
9 1 (0.41%) Enterprise Cloud
9 1 (0.41%) SCADA
9 1 (0.41%) Spread Betting
Operating Systems
1 41 (16.87%) Linux
2 28 (11.52%) Unix
3 8 (3.29%) Windows
4 6 (2.47%) Red Hat Enterprise Linux
5 5 (2.06%) CentOS
6 3 (1.23%) Debian
6 3 (1.23%) Ubuntu
7 2 (0.82%) Android
7 2 (0.82%) Apple iOS
7 2 (0.82%) Mac OS X
Processes & Methodologies
1 96 (39.51%) Data Modelling
2 88 (36.21%) Data Science
3 82 (33.74%) Analytics
4 75 (30.86%) Agile Software Development
5 74 (30.45%) Machine Learning
6 50 (20.58%) DevOps
7 38 (15.64%) SQL Optimisation
8 33 (13.58%) ETL
9 26 (10.70%) TDD
10 25 (10.29%) Single Customer View
11 24 (9.88%) Artificial Intelligence
12 20 (8.23%) Business Intelligence
13 19 (7.82%) Microservices
14 17 (7.00%) Computer Science
14 17 (7.00%) Visualisation
15 16 (6.58%) Scrum
16 14 (5.76%) Configuration Management
17 13 (5.35%) Data Engineering
17 13 (5.35%) Problem-Solving
18 12 (4.94%) Performance Tuning
Programming Languages
1 133 (54.73%) Python
2 108 (44.44%) SQL
3 76 (31.28%) Java
4 62 (25.51%) Scala
5 21 (8.64%) R
6 11 (4.53%) JavaScript
7 10 (4.12%) Java 8
8 9 (3.70%) Shell Script
9 8 (3.29%) Clojure
9 8 (3.29%) Perl
10 6 (2.47%) Bash Shell
10 6 (2.47%) T-SQL
11 5 (2.06%) Go
11 5 (2.06%) U-SQL
12 4 (1.65%) C++
12 4 (1.65%) Kotlin
12 4 (1.65%) Ruby
12 4 (1.65%) VBA
13 3 (1.23%) Groovy
13 3 (1.23%) Julia
Qualifications
1 14 (5.76%) Security Cleared
2 12 (4.94%) Degree
2 12 (4.94%) SC Cleared
3 4 (1.65%) PhD
4 2 (0.82%) Computer Science Degree
4 2 (0.82%) DV Cleared
4 2 (0.82%) Master's Degree
4 2 (0.82%) Numerate Degree
4 2 (0.82%) RHCE
5 1 (0.41%) AWS Certification
5 1 (0.41%) CCA
5 1 (0.41%) Postgraduate
Quality Assurance & Compliance
1 38 (15.64%) Data Quality
2 6 (2.47%) GDPR
3 1 (0.41%) QA
System Software
1 33 (13.58%) Docker
2 30 (12.35%) Apache Flume
3 25 (10.29%) HDFS
4 2 (0.82%) Apache ZooKeeper
4 2 (0.82%) Samba
4 2 (0.82%) VMware ESXi
4 2 (0.82%) VMware Infrastructure
5 1 (0.41%) Oracle RAC
Systems Management
1 39 (16.05%) Oozie
2 30 (12.35%) Hadoop YARN
2 30 (12.35%) Kubernetes
3 15 (6.17%) Ansible
4 10 (4.12%) Terraform
5 5 (2.06%) Puppet
6 3 (1.23%) Ambari
6 3 (1.23%) Kibana
6 3 (1.23%) Kubeflow
6 3 (1.23%) logstash
6 3 (1.23%) Marathon
6 3 (1.23%) Mesos
6 3 (1.23%) Opscode Chef
7 2 (0.82%) Grafana
7 2 (0.82%) Salt
7 2 (0.82%) Tivoli
8 1 (0.41%) Cobbler
8 1 (0.41%) Docker Swarm
8 1 (0.41%) Nagios
8 1 (0.41%) Prometheus
Vendors
1 40 (16.46%) Cloudera
2 37 (15.23%) Google
3 30 (12.35%) Talend
4 18 (7.41%) Tableau
5 15 (6.17%) Oracle
6 11 (4.53%) Microsoft
7 10 (4.12%) Hortonworks
8 7 (2.88%) Informatica
9 6 (2.47%) SAP
10 5 (2.06%) Red Hat
11 4 (1.65%) IBM
11 4 (1.65%) StreamSets
11 4 (1.65%) Sybase
11 4 (1.65%) Teradata
12 3 (1.23%) Databricks
12 3 (1.23%) Splunk
13 2 (0.82%) Alteryx
13 2 (0.82%) AppDynamics
13 2 (0.82%) Dataiku
13 2 (0.82%) Logi