Period
to 29 September 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 29 September 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
29 Sep 2020
Same period 2019 Same period 2018
Rank 147 117 98
Rank change year-on-year -30 -19 -12
Contract jobs citing Hadoop 244 867 1,247
As % of all contract jobs advertised in London 1.81% 2.29% 2.74%
As % of the Database & Business Intelligence category 7.24% 9.46% 11.00%
Number of daily rates quoted 149 654 922
Median daily rate £550 £575 £550
Median daily rate % change year-on-year -4.35% +4.55% -
10th Percentile £413 £425 £425
90th Percentile £713 £725 £713
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 8 4
Median hourly rate £35.00 £42.50 £60.00
Median hourly rate % change year-on-year -17.65% -29.17% -
England median hourly rate £35.00 £43.53 £47.50
% change year-on-year -19.60% -8.35% +35.71%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 3,371 9,161 11,336
As % of all contract IT jobs advertised in London 25.06% 24.24% 24.92%
Number of daily rates quoted 2,269 6,632 8,457
Median daily rate £525 £525 £525
10th Percentile £363 £363 £363
90th Percentile £713 £694 £675
England median daily rate £500 £480 £475
% change year-on-year +4.17% +1.05% +5.56%
Number of hourly rates quoted 42 57 54
Median hourly rate £35.00 £35.00 £27.62
Median hourly rate % change year-on-year - +26.74% +1.68%
10th Percentile £20.04 £15.60 £19.25
90th Percentile £50.22 £53.75 £47.68
Median hourly rate £35.00 £35.00 £30.00
% change year-on-year - +16.67% -1.64%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Hadoop in London.

Daily rate trend for Hadoop in London

Hadoop
Daily Rate Histogram in London

Daily rate distribution for jobs citing Hadoop in London over the 6 months to 29 September 2020.

Daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Hadoop in London.

Hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 29 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +11 40 £550 -0.90% 32
West London +56 15 £630 +20.00% 3
South London +47 4 £540 -4.00% 1
Hadoop
England

For the 6 months to 29 September 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 159 (65.16%) Apache Spark
2 145 (59.43%) Big Data
2 145 (59.43%) Python
3 77 (31.56%) AWS
4 74 (30.33%) Java
5 73 (29.92%) SQL
6 71 (29.10%) Agile Software Development
7 66 (27.05%) Kafka
8 64 (26.23%) Analytics
9 63 (25.82%) Apache Hive
10 58 (23.77%) Azure
11 55 (22.54%) Security Cleared
12 53 (21.72%) Scala
12 53 (21.72%) DevOps
13 49 (20.08%) SC Cleared
14 48 (19.67%) Git (software)
15 47 (19.26%) Cloudera
15 47 (19.26%) Kubernetes
16 46 (18.85%) Data Science
17 44 (18.03%) Finance
18 43 (17.62%) Machine Learning
19 42 (17.21%) Jenkins
20 41 (16.80%) ETL
21 40 (16.39%) PySpark
22 37 (15.16%) Visualisation
23 35 (14.34%) Microservices
24 32 (13.11%) Data Modelling
24 32 (13.11%) Degree
25 31 (12.70%) Banking
25 31 (12.70%) GCP

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 159 (65.16%) Apache Spark
2 20 (8.20%) Apache Pig
3 19 (7.79%) Apache
3 19 (7.79%) Elasticsearch
4 11 (4.51%) SAS
5 10 (4.10%) Apache Airflow
6 9 (3.69%) Confluence
7 5 (2.05%) JBoss
7 5 (2.05%) Jetty
7 5 (2.05%) Jupyter
7 5 (2.05%) MQSeries
7 5 (2.05%) Oracle Self-Service HR
7 5 (2.05%) Red Hat Fuse
7 5 (2.05%) Tomcat
7 5 (2.05%) WebLogic
8 2 (0.82%) Luigi
9 1 (0.41%) OpenStack
9 1 (0.41%) R Markdown
Applications
1 5 (2.05%) Microsoft Excel
2 2 (0.82%) MS Visio
3 1 (0.41%) Microsoft PowerPoint
Business Applications
1 6 (2.46%) Sparx Enterprise Architect
2 1 (0.41%) FINCAD Analytics
Cloud Services
1 77 (31.56%) AWS
2 58 (23.77%) Azure
3 31 (12.70%) GCP
4 14 (5.74%) Serverless
5 10 (4.10%) Virtual Private Cloud
6 9 (3.69%) Azure Data Factory
7 8 (3.28%) Amazon EC2
7 8 (3.28%) Amazon EKS
8 7 (2.87%) AWS Lambda
9 6 (2.46%) Amazon EMR
9 6 (2.46%) AWS CloudFormation
9 6 (2.46%) Power Platform
10 5 (2.05%) PaaS
11 3 (1.23%) Amazon Kinesis
11 3 (1.23%) Amazon SQS
11 3 (1.23%) Azure Machine Learning
11 3 (1.23%) SaaS
12 2 (0.82%) Azure Functions
12 2 (0.82%) Cloud Computing
13 1 (0.41%) Amazon ECS
Communications & Networking
1 6 (2.46%) SSL
2 5 (2.05%) Kerberos
2 5 (2.05%) SSH
3 3 (1.23%) 5G
3 3 (1.23%) VPN
4 1 (0.41%) HTTP
4 1 (0.41%) HTTPS
4 1 (0.41%) Network Security
4 1 (0.41%) Wi-Fi
Database & Business Intelligence
1 145 (59.43%) Big Data
2 63 (25.82%) Apache Hive
3 29 (11.89%) Impala
4 27 (11.07%) HBase
5 25 (10.25%) NoSQL
6 23 (9.43%) MongoDB
7 22 (9.02%) Apache Cassandra
7 22 (9.02%) Data Warehouse
8 17 (6.97%) PostgreSQL
8 17 (6.97%) SQL Server
9 16 (6.56%) Relational Database
10 13 (5.33%) Data Lake
11 12 (4.92%) BigQuery
11 12 (4.92%) MySQL
12 11 (4.51%) Spark SQL
13 10 (4.10%) Data Mining
13 10 (4.10%) Presto
14 9 (3.69%) Amazon RDS
14 9 (3.69%) Redis
15 8 (3.28%) ArangoDB
Development Applications
1 48 (19.67%) Git (software)
2 42 (17.21%) Jenkins
3 18 (7.38%) TeamCity
4 10 (4.10%) JIRA
5 8 (3.28%) Cucumber
5 8 (3.28%) Selenium
6 7 (2.87%) Maven
7 6 (2.46%) Artifactory
7 6 (2.46%) GitLab
8 5 (2.05%) Ant
8 5 (2.05%) Atlassian Bamboo
8 5 (2.05%) ClearCase
8 5 (2.05%) Eclipse
8 5 (2.05%) FishEye
8 5 (2.05%) Gradle
8 5 (2.05%) Hudson
8 5 (2.05%) Mercurial
8 5 (2.05%) Poseidon for UML
8 5 (2.05%) Subversion
8 5 (2.05%) Vagrant
General
1 44 (18.03%) Finance
2 31 (12.70%) Banking
3 20 (8.20%) Front Office
4 16 (6.56%) Investment Banking
5 15 (6.15%) Marketing
6 12 (4.92%) Public Sector
6 12 (4.92%) Retail
6 12 (4.92%) Telecoms
7 6 (2.46%) Legal
8 5 (2.05%) Law
9 4 (1.64%) Manufacturing
10 2 (0.82%) Electronics
10 2 (0.82%) Games
10 2 (0.82%) Military
10 2 (0.82%) Pharmaceutical
11 1 (0.41%) Financial Institution
11 1 (0.41%) Retail Banking
Job Titles
1 74 (30.33%) Data Engineer
2 62 (25.41%) Developer
3 35 (14.34%) Architect
4 28 (11.48%) Big Data Engineer
5 27 (11.07%) Python Engineer
6 24 (9.84%) Python Developer
7 19 (7.79%) DevOps Engineer
7 19 (7.79%) Java Developer
8 15 (6.15%) Azure Engineer
9 13 (5.33%) Data Architect
9 13 (5.33%) Data Scientist
10 12 (4.92%) Senior Data Engineer
11 10 (4.10%) AWS Engineer
11 10 (4.10%) Big Data Developer
11 10 (4.10%) Cloud Engineer
11 10 (4.10%) Consultant
12 9 (3.69%) Senior Developer
12 9 (3.69%) Solutions Architect
13 8 (3.28%) Agile Java Developer
13 8 (3.28%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 66 (27.05%) Kafka
2 40 (16.39%) PySpark
3 19 (7.79%) Spring
4 17 (6.97%) TensorFlow
5 14 (5.74%) Spark Streaming
6 13 (5.33%) scikit-learn
7 12 (4.92%) .NET
8 11 (4.51%) React
9 9 (3.69%) Elastic Stack
9 9 (3.69%) Web Services
10 8 (3.28%) .NET Core
10 8 (3.28%) AngularJS
10 8 (3.28%) GraphQL
10 8 (3.28%) JSON
10 8 (3.28%) REST
11 7 (2.87%) .NET Framework
11 7 (2.87%) ASP.NET Web API
11 7 (2.87%) Entity Framework
11 7 (2.87%) RabbitMQ
11 7 (2.87%) Spring Boot
Miscellaneous
1 23 (9.43%) Algorithms
2 22 (9.02%) Analytical Skills
3 13 (5.33%) Cloud Native
4 11 (4.51%) Derivative
5 10 (4.10%) Greenfield Project
6 9 (3.69%) FMCG
6 9 (3.69%) User Experience
7 8 (3.28%) Analytical Mindset
7 8 (3.28%) Data Structures
7 8 (3.28%) Fixed Income
7 8 (3.28%) Public Cloud
8 5 (2.05%) Data Centre
8 5 (2.05%) Hedge funds
8 5 (2.05%) Self-Motivation
9 4 (1.64%) Credit Risk
10 3 (1.23%) Enterprise Software
10 3 (1.23%) Equities
10 3 (1.23%) PMI
10 3 (1.23%) Taxonomies
10 3 (1.23%) Virtual Team
Operating Systems
1 28 (11.48%) Linux
2 10 (4.10%) Unix
3 5 (2.05%) Android
3 5 (2.05%) Apple iOS
3 5 (2.05%) CentOS
3 5 (2.05%) Debian
3 5 (2.05%) Mac OS X
3 5 (2.05%) Red Hat Enterprise Linux
3 5 (2.05%) Ubuntu
3 5 (2.05%) Windows
Processes & Methodologies
1 71 (29.10%) Agile Software Development
2 64 (26.23%) Analytics
3 53 (21.72%) DevOps
4 46 (18.85%) Data Science
5 43 (17.62%) Machine Learning
6 41 (16.80%) ETL
7 37 (15.16%) Visualisation
8 35 (14.34%) Microservices
9 32 (13.11%) Data Modelling
10 30 (12.30%) Computer Science
11 28 (11.48%) Business Intelligence
11 28 (11.48%) TDD
12 23 (9.43%) Data Analytics
12 23 (9.43%) Mathematics
13 22 (9.02%) Data Visualisation
13 22 (9.02%) Problem-Solving
14 21 (8.61%) Scrum
14 21 (8.61%) Statistics
15 20 (8.20%) Data Engineering
15 20 (8.20%) Software Engineering
Programming Languages
1 145 (59.43%) Python
2 74 (30.33%) Java
3 73 (29.92%) SQL
4 53 (21.72%) Scala
5 17 (6.97%) Bash Shell
6 16 (6.56%) C#
6 16 (6.56%) C++
6 16 (6.56%) R
7 15 (6.15%) Ruby
8 12 (4.92%) JavaScript
8 12 (4.92%) Shell Script
9 10 (4.10%) Perl
10 7 (2.87%) Groovy
10 7 (2.87%) PowerShell
11 6 (2.46%) Clojure
11 6 (2.46%) Java 8
11 6 (2.46%) T-SQL
12 5 (2.05%) ClojureScript
12 5 (2.05%) PL/SQL
13 4 (1.64%) Kotlin
Qualifications
1 55 (22.54%) Security Cleared
2 49 (20.08%) SC Cleared
3 32 (13.11%) Degree
4 18 (7.38%) Numerate Degree
5 9 (3.69%) Computer Science Degree
6 8 (3.28%) Master's Degree
7 6 (2.46%) TOGAF Certification
8 5 (2.05%) DV Cleared
9 4 (1.64%) AWS Certification
10 3 (1.23%) PMI Certification
11 2 (0.82%) CCA
12 1 (0.41%) BPSS Clearance
12 1 (0.41%) PhD
Quality Assurance & Compliance
1 4 (1.64%) Data Quality
2 1 (0.41%) CDISC
2 1 (0.41%) GDPR
2 1 (0.41%) MiFID
2 1 (0.41%) PCI DSS
System Software
1 29 (11.89%) Docker
2 22 (9.02%) HDFS
3 7 (2.87%) Apache ZooKeeper
4 3 (1.23%) Apache Flume
5 2 (0.82%) Active Directory Lightweight Directory Services
6 1 (0.41%) Active Directory
Systems Management
1 47 (19.26%) Kubernetes
2 29 (11.89%) Terraform
3 21 (8.61%) Ansible
4 12 (4.92%) Puppet
5 6 (2.46%) Oozie
6 5 (2.05%) Hadoop YARN
6 5 (2.05%) Salt
7 3 (1.23%) Opscode Chef
8 2 (0.82%) Packer
9 1 (0.41%) Ambari
9 1 (0.41%) Kubeflow
9 1 (0.41%) Single Sign-On
Vendors
1 47 (19.26%) Cloudera
2 27 (11.07%) Oracle
3 24 (9.84%) Microsoft
4 22 (9.02%) Hortonworks
4 22 (9.02%) Tableau
5 14 (5.74%) Databricks
5 14 (5.74%) Teradata
6 12 (4.92%) Informatica
7 11 (4.51%) Google
8 6 (2.46%) Ab Initio
8 6 (2.46%) MapR
8 6 (2.46%) Sparx
9 5 (2.05%) Axway
9 5 (2.05%) IBM
9 5 (2.05%) MuleSoft
9 5 (2.05%) Red Hat
9 5 (2.05%) Sybase
9 5 (2.05%) TIBCO
10 4 (1.64%) Palantir
10 4 (1.64%) StreamSets