Period
to 1 June 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 1 June 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
1 Jun 2020
Same period 2019 Same period 2018
Rank 152 106 88
Rank change year-on-year -46 -18 -8
Contract jobs citing Hadoop 338 1,016 1,293
As % of all contract jobs advertised in London 1.78% 2.52% 2.81%
As % of the Database & Business Intelligence category 7.36% 10.13% 11.21%
Number of daily rates quoted 246 724 987
Median daily rate £550 £575 £550
Median daily rate % change year-on-year -4.35% +4.55% +2.42%
10th Percentile £413 £463 £413
90th Percentile £706 £725 £700
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 9 4
Median hourly rate £35.00 £42.50 £78.75
Median hourly rate % change year-on-year -17.65% -46.03% -
England median hourly rate £35.00 £46.85 £45.00
% change year-on-year -25.29% +4.11% -4.26%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 4,592 10,026 11,538
As % of all contract IT jobs advertised in London 24.17% 24.83% 25.10%
Number of daily rates quoted 3,215 7,265 8,652
Median daily rate £525 £525 £513
Median daily rate % change year-on-year - +2.44% +3.02%
10th Percentile £363 £363 £356
90th Percentile £713 £675 £675
England median daily rate £500 £488 £475
% change year-on-year +2.56% +2.63% +5.56%
Number of hourly rates quoted 51 60 76
Median hourly rate £35.00 £35.00 £30.00
Median hourly rate % change year-on-year - +16.67% -7.69%
10th Percentile £20.40 £19.44 £19.25
90th Percentile £41.50 £56.50 £46.50
Median hourly rate £35.00 £35.00 £33.50
% change year-on-year - +4.48% +11.67%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Hadoop in London.

Daily rate trend for Hadoop in London

Hadoop
Daily Rate Histogram in London

Daily rate distribution for jobs citing Hadoop in London over the 6 months to 1 June 2020.

Daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Hadoop in London.

Hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 1 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -35 49 £588 +6.82% 17
West London +49 14 £550 +10.00% 3
South London +19 14 £500 -22.48% 2
East London -14 9 £525 - 6
Hadoop
England

For the 6 months to 1 June 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 235 (69.53%) Python
2 202 (59.76%) Apache Spark
3 197 (58.28%) Big Data
4 116 (34.32%) SQL
5 114 (33.73%) Analytics
6 106 (31.36%) AWS
7 104 (30.77%) Agile Software Development
8 97 (28.70%) Java
9 91 (26.92%) Scala
10 85 (25.15%) Kafka
11 79 (23.37%) Apache Hive
12 73 (21.60%) Cloudera
12 73 (21.60%) DevOps
13 71 (21.01%) GCP
14 69 (20.41%) Azure
15 67 (19.82%) Kubernetes
15 67 (19.82%) PySpark
16 66 (19.53%) NoSQL
17 65 (19.23%) Machine Learning
17 65 (19.23%) ETL
18 62 (18.34%) Finance
19 60 (17.75%) Data Science
20 57 (16.86%) Docker
21 56 (16.57%) TensorFlow
22 55 (16.27%) HBase
23 52 (15.38%) Jenkins
24 48 (14.20%) Data Warehouse
25 46 (13.61%) Terraform
25 46 (13.61%) Business Intelligence
26 45 (13.31%) Git (software)

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 202 (59.76%) Apache Spark
2 29 (8.58%) Apache
3 20 (5.92%) Elasticsearch
4 15 (4.44%) Apache Pig
5 14 (4.14%) Apache Airflow
6 11 (3.25%) SAS
7 7 (2.07%) Jupyter
8 4 (1.18%) Confluence
9 3 (0.89%) Apache Pulsar
9 3 (0.89%) Oracle Workflow
9 3 (0.89%) Tomcat
10 2 (0.59%) WebLogic
11 1 (0.30%) Apache Solr
11 1 (0.30%) IBM Domino
11 1 (0.30%) JBoss
11 1 (0.30%) nginx
11 1 (0.30%) Oracle SOA Suite
11 1 (0.30%) Red Hat Fuse
11 1 (0.30%) WebSphere
11 1 (0.30%) WebSphere Application Server
Applications
1 1 (0.30%) Chatbot
1 1 (0.30%) Microsoft Office
Business Applications
1 2 (0.59%) SAP Oil and Gas
2 1 (0.30%) FINCAD Analytics
Cloud Services
1 106 (31.36%) AWS
2 71 (21.01%) GCP
3 69 (20.41%) Azure
4 14 (4.14%) GitHub
5 13 (3.85%) Serverless
6 12 (3.55%) Amazon Kinesis
7 10 (2.96%) AWS Lambda
8 7 (2.07%) Amazon EMR
8 7 (2.07%) AWS CloudFormation
9 6 (1.78%) Amazon S3
9 6 (1.78%) Power Platform
10 4 (1.18%) Cloud Computing
10 4 (1.18%) IaaS
10 4 (1.18%) OpenShift
10 4 (1.18%) PaaS
11 3 (0.89%) Amazon SageMaker
11 3 (0.89%) Amazon SQS
11 3 (0.89%) Azure Machine Learning
11 3 (0.89%) Virtual Private Cloud
12 2 (0.59%) Data Lake Analytics
Communications & Networking
1 17 (5.03%) Kerberos
2 7 (2.07%) HTTP
3 6 (1.78%) VPN
4 5 (1.48%) SSL
5 4 (1.18%) 5G
5 4 (1.18%) HTTPS
6 3 (0.89%) DNS
6 3 (0.89%) Firewall
7 2 (0.59%) Internet
7 2 (0.59%) TCP/IP
8 1 (0.30%) Broadband
8 1 (0.30%) OpenLDAP
Database & Business Intelligence
1 197 (58.28%) Big Data
2 79 (23.37%) Apache Hive
3 66 (19.53%) NoSQL
4 55 (16.27%) HBase
5 48 (14.20%) Data Warehouse
6 42 (12.43%) Apache Cassandra
7 36 (10.65%) BigQuery
8 34 (10.06%) Data Lake
8 34 (10.06%) MongoDB
9 31 (9.17%) SQL Server
10 30 (8.88%) Impala
10 30 (8.88%) PostgreSQL
11 27 (7.99%) Relational Database
12 17 (5.03%) Sqoop
13 15 (4.44%) Presto
13 15 (4.44%) Spark SQL
14 13 (3.85%) Amazon Redshift
14 13 (3.85%) RDBMS
15 12 (3.55%) Data Mining
16 11 (3.25%) Flink
Development Applications
1 52 (15.38%) Jenkins
2 45 (13.31%) Git (software)
3 23 (6.80%) JIRA
4 18 (5.33%) TeamCity
5 16 (4.73%) GitLab
6 14 (4.14%) Artifactory
7 13 (3.85%) Visual Studio Team System
8 9 (2.66%) Team Foundation Server
9 8 (2.37%) CircleCI
10 7 (2.07%) Maven
11 5 (1.48%) Octopus Deploy
12 4 (1.18%) Bitbucket
12 4 (1.18%) Sonatype Nexus
12 4 (1.18%) Travis CI
13 3 (0.89%) ER Studio
13 3 (0.89%) ERwin
13 3 (0.89%) GoCD
13 3 (0.89%) PowerDesigner
13 3 (0.89%) RStudio
14 2 (0.59%) Atlassian Bamboo
General
1 62 (18.34%) Finance
2 34 (10.06%) Telecoms
3 30 (8.88%) Banking
4 23 (6.80%) Retail
5 21 (6.21%) Public Sector
6 13 (3.85%) Marketing
7 10 (2.96%) Legal
8 9 (2.66%) Investment Banking
9 7 (2.07%) Front Office
10 5 (1.48%) Manufacturing
10 5 (1.48%) Retail Banking
11 3 (0.89%) Electronics
11 3 (0.89%) Games
11 3 (0.89%) Pharmaceutical
12 2 (0.59%) Financial Institution
12 2 (0.59%) Law
13 1 (0.30%) Aerospace
Job Titles
1 124 (36.69%) Data Engineer
2 59 (17.46%) Developer
3 48 (14.20%) Python Engineer
4 42 (12.43%) Architect
4 42 (12.43%) DevOps Engineer
5 37 (10.95%) Big Data Engineer
6 30 (8.88%) Data Scientist
7 26 (7.69%) Data Architect
8 24 (7.10%) Cloud Engineer
9 23 (6.80%) AWS Engineer
10 20 (5.92%) Java Developer
11 19 (5.62%) Python Developer
12 18 (5.33%) Senior Data Scientist
13 17 (5.03%) Big Data Developer
13 17 (5.03%) Hadoop Engineer
14 15 (4.44%) Azure Engineer
14 15 (4.44%) Hadoop Developer
15 12 (3.55%) Big Data Architect
15 12 (3.55%) Hadoop Architect
16 11 (3.25%) Consultant
Libraries, Frameworks & Software Standards
1 85 (25.15%) Kafka
2 67 (19.82%) PySpark
3 56 (16.57%) TensorFlow
4 39 (11.54%) scikit-learn
5 21 (6.21%) Natural Language Processing
5 21 (6.21%) Web Services
6 20 (5.92%) Spark Streaming
7 19 (5.62%) H2O
8 15 (4.44%) LDAP
8 15 (4.44%) Spring
9 12 (3.55%) Elastic Stack
10 11 (3.25%) .NET
10 11 (3.25%) Apache NiFi
10 11 (3.25%) React
11 10 (2.96%) Django
11 10 (2.96%) Keras
11 10 (2.96%) MLlib
11 10 (2.96%) Spring Boot
12 9 (2.66%) HTML
12 9 (2.66%) RESTful
Miscellaneous
1 25 (7.40%) Algorithms
2 19 (5.62%) Analytical Skills
3 14 (4.14%) Cloud Native
4 13 (3.85%) Greenfield Project
5 12 (3.55%) Data Structures
5 12 (3.55%) Public Cloud
6 10 (2.96%) Self-Motivation
6 10 (2.96%) Social Media
7 8 (2.37%) Enterprise Software
8 7 (2.07%) Credit Risk
8 7 (2.07%) Management Information System
9 6 (1.78%) Data Centre
9 6 (1.78%) Hedge funds
10 4 (1.18%) Derivative
10 4 (1.18%) Equities
10 4 (1.18%) Fixed Income
10 4 (1.18%) Linux Command Line
10 4 (1.18%) Market Risk
10 4 (1.18%) PMI
10 4 (1.18%) User Experience
Operating Systems
1 36 (10.65%) Linux
2 16 (4.73%) Unix
3 3 (0.89%) Red Hat Enterprise Linux
3 3 (0.89%) Windows
4 2 (0.59%) CentOS
Processes & Methodologies
1 114 (33.73%) Analytics
2 104 (30.77%) Agile Software Development
3 73 (21.60%) DevOps
4 65 (19.23%) ETL
4 65 (19.23%) Machine Learning
5 60 (17.75%) Data Science
6 46 (13.61%) Business Intelligence
7 41 (12.13%) Data Modelling
8 40 (11.83%) Visualisation
9 36 (10.65%) Data Analytics
10 30 (8.88%) Microservices
11 29 (8.58%) Artificial Intelligence
11 29 (8.58%) Data Visualisation
11 29 (8.58%) Migration
12 28 (8.28%) Data Integration
13 27 (7.99%) Data Engineering
14 26 (7.69%) Computer Science
15 25 (7.40%) Statistics
16 24 (7.10%) Data Management
16 24 (7.10%) Scrum
Programming Languages
1 235 (69.53%) Python
2 116 (34.32%) SQL
3 97 (28.70%) Java
4 91 (26.92%) Scala
5 30 (8.88%) R
6 27 (7.99%) Bash Shell
7 14 (4.14%) C#
7 14 (4.14%) Ruby
8 12 (3.55%) PL/SQL
9 11 (3.25%) C++
9 11 (3.25%) Go
9 11 (3.25%) Java 8
9 11 (3.25%) JavaScript
9 11 (3.25%) PowerShell
9 11 (3.25%) Shell Script
10 8 (2.37%) T-SQL
11 5 (1.48%) C
11 5 (1.48%) Korn
11 5 (1.48%) PHP
12 4 (1.18%) Groovy
Qualifications
1 42 (12.43%) Security Cleared
2 38 (11.24%) SC Cleared
3 18 (5.33%) Degree
4 10 (2.96%) Computer Science Degree
5 5 (1.48%) DV Cleared
6 4 (1.18%) PMI Certification
7 3 (0.89%) CCA
8 2 (0.59%) AWS Certification
8 2 (0.59%) Master's Degree
8 2 (0.59%) Numerate Degree
8 2 (0.59%) PhD
9 1 (0.30%) MBA
Quality Assurance & Compliance
1 8 (2.37%) Data Quality
2 2 (0.59%) QA
3 1 (0.30%) ISO/IEC 27001
3 1 (0.30%) MiFID
System Software
1 57 (16.86%) Docker
2 41 (12.13%) HDFS
3 9 (2.66%) Apache ZooKeeper
4 8 (2.37%) Apache Flume
5 1 (0.30%) Active Directory
Systems Management
1 67 (19.82%) Kubernetes
2 46 (13.61%) Terraform
3 34 (10.06%) Ansible
4 21 (6.21%) Hadoop YARN
5 18 (5.33%) Puppet
6 11 (3.25%) Oozie
7 7 (2.07%) Ambari
8 6 (1.78%) Kibana
8 6 (1.78%) Single Sign-On
9 5 (1.48%) logstash
10 3 (0.89%) Grafana
10 3 (0.89%) Kubeflow
10 3 (0.89%) Packer
11 2 (0.59%) Control-M
12 1 (0.30%) Docker Swarm
12 1 (0.30%) HAProxy
12 1 (0.30%) Opscode Chef
12 1 (0.30%) Tivoli
12 1 (0.30%) ZABBIX
Vendors
1 73 (21.60%) Cloudera
2 38 (11.24%) Hortonworks
3 30 (8.88%) Tableau
4 27 (7.99%) Oracle
5 26 (7.69%) Google
6 24 (7.10%) Microsoft
7 19 (5.62%) MapR
8 18 (5.33%) Databricks
9 14 (4.14%) Teradata
10 11 (3.25%) SAP
11 9 (2.66%) Ab Initio
12 8 (2.37%) Informatica
13 7 (2.07%) Sybase
14 5 (1.48%) Splunk
14 5 (1.48%) StreamSets
15 3 (0.89%) Birst
15 3 (0.89%) IBM
15 3 (0.89%) Red Hat
15 3 (0.89%) Talend
16 2 (0.59%) New Relic