Period
to 19 March 2019

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 19 March 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
London > Central London
6 months to
19 Mar 2019
Same period 2018 Same period 2017
Rank 111 113 66
Rank change year-on-year +2 -47 +42
Contract jobs citing Hadoop 213 210 247
As % of all contract IT jobs advertised in Central London 2.40% 2.31% 3.46%
As % of the Database & Business Intelligence category 9.81% 9.47% 12.88%
Number of daily rates quoted 161 178 207
Central London median daily rate £575 £575 £580
Median daily rate % change year-on-year - -0.86% +6.42%
10th Percentile £513 £463 £438
90th Percentile £700 £700 £688
London median daily rate £575 £550 £550
% change year-on-year +4.55% - -
Number of hourly rates quoted 0 0 0
Central London median hourly rate - - -
London median hourly rate £55.00 £82.50 £100.00
% change year-on-year -33.33% -17.50% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 2,172 2,218 1,918
As % of all contract IT jobs advertised in Central London 24.48% 24.43% 26.85%
Number of daily rates quoted 1,678 1,850 1,504
Central London median daily rate £525 £513 £475
Median daily rate % change year-on-year +2.44% +7.89% -
10th Percentile £375 £363 £325
90th Percentile £675 £675 £650
London median daily rate £525 £513 £475
% change year-on-year +2.44% +7.89% +1.33%
Number of hourly rates quoted 9 12 2
Central London median hourly rate £35.00 £27.75 £33.67
Median hourly rate % change year-on-year +26.13% -17.58% +74.90%
10th Percentile £20.00 £20.75 £23.75
90th Percentile £56.50 £37.88 £45.05
London median hourly rate £28.50 £27.75 £31.25
% change year-on-year +2.70% -11.20% +20.19%

Hadoop
Job Vacancy Trend in Central London

Job postings citing Hadoop as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Central London.

Contractor daily rate trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Hadoop in Central London over the 6 months to 19 March 2019.

Contractor daily rate histogram for Hadoop in Central London

Hadoop
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the Central London region over the 6 months to 19 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London +16 175 £575 -4.17% 53
Southwark -13 34 £550 +12.82%
West End of London -22 11 - -
City of Westminster -7 3 £600 +20.00%
Hadoop
London

For the 6 months to 19 March 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Hadoop.

1 159 (74.65%) Apache Spark
2 153 (71.83%) Big Data
3 127 (59.62%) Kafka
4 100 (46.95%) Python
5 92 (43.19%) Apache Hive
6 87 (40.85%) Data Modelling
7 84 (39.44%) Finance
8 72 (33.80%) SQL
9 71 (33.33%) Data Warehouse
10 70 (32.86%) Data Science
11 64 (30.05%) Analytics
12 61 (28.64%) Java
13 55 (25.82%) Machine Learning
14 49 (23.00%) Amazon AWS
15 48 (22.54%) Agile Software Development
16 39 (18.31%) Linux
17 36 (16.90%) Cloudera
17 36 (16.90%) DevOps
17 36 (16.90%) Data Lake
18 34 (15.96%) Data Quality
19 33 (15.49%) Microsoft Azure
19 33 (15.49%) OLAP
19 33 (15.49%) Star Schema
19 33 (15.49%) Enterprise Data Warehouse
19 33 (15.49%) Talend
19 33 (15.49%) Oozie
20 32 (15.02%) Apache Flume
20 32 (15.02%) HBase
20 32 (15.02%) OLAP Cube
20 32 (15.02%) SQL Optimisation

Hadoop
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 159 (74.65%) Apache Spark
2 20 (9.39%) Apache
3 16 (7.51%) Elasticsearch
4 14 (6.57%) Confluence
5 8 (3.76%) SAS
6 5 (2.35%) Apache Solr
7 4 (1.88%) Apache Pig
7 4 (1.88%) Cloud Foundry
8 2 (0.94%) Apache Airflow
8 2 (0.94%) Jupyter
9 1 (0.47%) nginx
Applications
1 3 (1.41%) Microsoft Excel
2 1 (0.47%) Spreadsheet
Business Applications
1 11 (5.16%) SAP Oil and Gas
2 1 (0.47%) Dynamics NAV
2 1 (0.47%) Eloqua
2 1 (0.47%) SAP ERP
2 1 (0.47%) SAP S/4HANA
Cloud Services
1 49 (23.00%) Amazon AWS
2 33 (15.49%) Microsoft Azure
3 18 (8.45%) Google Cloud Platform
4 14 (6.57%) Amazon EMR
5 8 (3.76%) Azure Data Factory
5 8 (3.76%) Heroku
6 6 (2.82%) Data Lake Analytics
7 4 (1.88%) Amazon S3
7 4 (1.88%) Apigee
7 4 (1.88%) IBM Cloud
7 4 (1.88%) Serverless
8 2 (0.94%) Amazon EC2
8 2 (0.94%) Amazon Kinesis
8 2 (0.94%) AWS Lambda
8 2 (0.94%) GitHub
9 1 (0.47%) Adobe Analytics
9 1 (0.47%) Azure Functions
9 1 (0.47%) iPaaS
9 1 (0.47%) PaaS
9 1 (0.47%) SaaS
Communications & Networking
1 12 (5.63%) HTTP
2 9 (4.23%) DNS
2 9 (4.23%) Kerberos
2 9 (4.23%) SSL
3 8 (3.76%) FTP
3 8 (3.76%) TCP/IP
Database & Business Intelligence
1 153 (71.83%) Big Data
2 92 (43.19%) Apache Hive
3 71 (33.33%) Data Warehouse
4 36 (16.90%) Data Lake
5 33 (15.49%) Enterprise Data Warehouse
5 33 (15.49%) OLAP
5 33 (15.49%) Star Schema
6 32 (15.02%) HBase
6 32 (15.02%) OLAP Cube
7 28 (13.15%) MongoDB
8 27 (12.68%) Impala
8 27 (12.68%) SQL Server
9 21 (9.86%) Apache Cassandra
10 20 (9.39%) NoSQL
10 20 (9.39%) Relational Database
11 15 (7.04%) Power BI
12 13 (6.10%) Data Mining
12 13 (6.10%) SQL Server Integration Services
13 12 (5.63%) SAP HANA
14 11 (5.16%) Apache Kudu
Development Applications
1 29 (13.62%) Git (software)
2 18 (8.45%) JIRA
3 16 (7.51%) Maven
4 15 (7.04%) Jenkins
5 11 (5.16%) Cucumber
5 11 (5.16%) Subversion
6 10 (4.69%) Atlassian Bamboo
6 10 (4.69%) FishEye
6 10 (4.69%) jMock
6 10 (4.69%) JUnit
7 9 (4.23%) GitLab
7 9 (4.23%) Gradle
8 8 (3.76%) gulp
9 6 (2.82%) Sonatype Nexus
10 5 (2.35%) Visual Studio Team System
11 3 (1.41%) Artifactory
11 3 (1.41%) Visual Studio
12 2 (0.94%) JMeter
12 2 (0.94%) Selenium
13 1 (0.47%) WATIR
General
1 84 (39.44%) Finance
2 21 (9.86%) Retail
3 16 (7.51%) Banking
4 14 (6.57%) Front Office
5 3 (1.41%) Marketing
6 2 (0.94%) Investment Banking
6 2 (0.94%) Telecoms
7 1 (0.47%) Corporate Banking
7 1 (0.47%) Legal
7 1 (0.47%) Pharmaceutical
Job Titles
1 97 (45.54%) Data Engineer
2 51 (23.94%) Developer
3 36 (16.90%) Big Data Engineer
4 35 (16.43%) Hadoop Engineer
5 29 (13.62%) Java Developer
6 18 (8.45%) Python Engineer
7 14 (6.57%) Architect
7 14 (6.57%) Data Scientist
7 14 (6.57%) Senior Developer
8 13 (6.10%) Data Architect
9 12 (5.63%) Apache Spark Developer
9 12 (5.63%) DevOps Engineer
10 11 (5.16%) Big Data Developer
11 10 (4.69%) Senior Java Developer
12 9 (4.23%) Administrator
12 9 (4.23%) Azure Engineer
12 9 (4.23%) Hadoop Administrator
12 9 (4.23%) Technical Leader
13 5 (2.35%) Senior Data Engineer
13 5 (2.35%) Senior DevOps
Libraries, Frameworks & Software Standards
1 127 (59.62%) Kafka
2 18 (8.45%) Spring
3 16 (7.51%) PySpark
4 12 (5.63%) AngularJS
4 12 (5.63%) REST
4 12 (5.63%) Spark Streaming
5 11 (5.16%) Spring Boot
6 10 (4.69%) CSS
6 10 (4.69%) HTML
6 10 (4.69%) HTML5
6 10 (4.69%) SOAP
7 8 (3.76%) Dropwizard
7 8 (3.76%) Ember.js
7 8 (3.76%) Guice
7 8 (3.76%) LDAP
7 8 (3.76%) OAuth
7 8 (3.76%) OAuth2
7 8 (3.76%) Ratpack
8 6 (2.82%) Pandas
8 6 (2.82%) TensorFlow
Miscellaneous
1 18 (8.45%) Algorithms
2 11 (5.16%) Analytical Skills
3 8 (3.76%) Greenfield Project
4 5 (2.35%) Fintech
5 4 (1.88%) iPad
6 3 (1.41%) Market Risk
7 2 (0.94%) Hedge funds
8 1 (0.47%) Cloud Native
8 1 (0.47%) Data Centre
8 1 (0.47%) Enterprise Software
8 1 (0.47%) HoloLens
8 1 (0.47%) Management Information System
8 1 (0.47%) Robotics
8 1 (0.47%) User Experience
8 1 (0.47%) Virtual Team
Operating Systems
1 39 (18.31%) Linux
2 15 (7.04%) Unix
3 6 (2.82%) Red Hat Enterprise Linux
4 1 (0.47%) CentOS
4 1 (0.47%) Debian
4 1 (0.47%) Ubuntu
Processes & Methodologies
1 87 (40.85%) Data Modelling
2 70 (32.86%) Data Science
3 64 (30.05%) Analytics
4 55 (25.82%) Machine Learning
5 48 (22.54%) Agile Software Development
6 36 (16.90%) DevOps
7 32 (15.02%) SQL Optimisation
8 31 (14.55%) Business Intelligence
8 31 (14.55%) ETL
9 25 (11.74%) TDD
10 22 (10.33%) Visualisation
11 20 (9.39%) BDD
12 19 (8.92%) Data Integration
13 18 (8.45%) Single Customer View
14 14 (6.57%) Computer Science
14 14 (6.57%) Data Analysis
15 13 (6.10%) SDLC
16 12 (5.63%) Data Security
16 12 (5.63%) Microservices
16 12 (5.63%) Statistical Modelling
Programming Languages
1 100 (46.95%) Python
2 72 (33.80%) SQL
3 61 (28.64%) Java
4 32 (15.02%) Scala
5 27 (12.68%) Java 8
6 14 (6.57%) JavaScript
6 14 (6.57%) R
7 8 (3.76%) ES6
7 8 (3.76%) TypeScript
8 6 (2.82%) Shell Script
9 5 (2.35%) Groovy
9 5 (2.35%) Julia
10 4 (1.88%) C#
10 4 (1.88%) PowerShell
11 3 (1.41%) Bash Shell
11 3 (1.41%) MATLAB
11 3 (1.41%) Perl
11 3 (1.41%) Ruby
11 3 (1.41%) T-SQL
12 2 (0.94%) VBA
Qualifications
1 15 (7.04%) Degree
2 8 (3.76%) Master's Degree
2 8 (3.76%) PhD
3 7 (3.29%) Security Cleared
4 6 (2.82%) Computer Science Degree
5 3 (1.41%) SC Cleared
6 2 (0.94%) DV Cleared
7 1 (0.47%) Numerate Degree
7 1 (0.47%) Postgraduate
7 1 (0.47%) RHCE
Quality Assurance & Compliance
1 34 (15.96%) Data Quality
2 1 (0.47%) QA
System Software
1 32 (15.02%) Apache Flume
2 26 (12.21%) HDFS
3 23 (10.80%) Docker
4 3 (1.41%) Active Directory
4 3 (1.41%) Apache ZooKeeper
5 1 (0.47%) Oracle RAC
Systems Management
1 33 (15.49%) Oozie
2 21 (9.86%) Kubernetes
3 19 (8.92%) Hadoop YARN
4 11 (5.16%) Ansible
5 8 (3.76%) Docker Swarm
6 7 (3.29%) Terraform
7 5 (2.35%) Tivoli
8 3 (1.41%) Ambari
8 3 (1.41%) Grafana
8 3 (1.41%) ITRS Geneos
9 2 (0.94%) Puppet
10 1 (0.47%) Opscode Chef
Vendors
1 36 (16.90%) Cloudera
2 33 (15.49%) Talend
3 27 (12.68%) Oracle
4 20 (9.39%) Google
4 20 (9.39%) Hortonworks
5 14 (6.57%) Microsoft
5 14 (6.57%) Tableau
6 13 (6.10%) Informatica
6 13 (6.10%) SAP
7 11 (5.16%) Databricks
8 10 (4.69%) Atlassian
8 10 (4.69%) Sybase
9 9 (4.23%) Alteryx
10 6 (2.82%) IBM
11 5 (2.35%) MapR
12 4 (1.88%) Red Hat
13 2 (0.94%) Ab Initio
13 2 (0.94%) Adobe
13 2 (0.94%) Datameer
14 1 (0.47%) ServiceNow