Period
to 25 February 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 February 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
25 Feb 2020
Same period 2019 Same period 2018
Rank 139 103 91
Rank change year-on-year -36 -12 -26
Contract jobs citing Hadoop 539 1,113 1,242
As % of all contract IT jobs advertised in London 1.90% 2.55% 2.68%
As % of the Database & Business Intelligence category 7.95% 10.53% 11.38%
Number of daily rates quoted 391 789 940
London median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.55% -
10th Percentile £425 £461 £425
90th Percentile £738 £725 £700
England median daily rate £550 £550 £550
Number of hourly rates quoted 0 3 1
London median hourly rate - £55.00 £82.50
Median hourly rate % change year-on-year - -33.33% -17.50%
England median hourly rate - £50.00 £37.50
% change year-on-year - +33.33% -20.21%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 6,782 10,573 10,917
As % of all contract IT jobs advertised in London 23.92% 24.20% 23.57%
Number of daily rates quoted 4,843 7,811 8,299
London median daily rate £525 £525 £501
Median daily rate % change year-on-year - +4.90% +5.37%
10th Percentile £363 £365 £356
90th Percentile £700 £675 £663
England median daily rate £488 £488 £475
% change year-on-year - +2.63% +8.57%
Number of hourly rates quoted 47 50 62
London median hourly rate £35.00 £32.50 £27.50
Median hourly rate % change year-on-year +7.69% +18.18% -15.38%
10th Percentile £23.17 £17.99 £17.44
90th Percentile £62.55 £48.50 £42.80
England median hourly rate £31.25 £35.00 £33.50
% change year-on-year -10.71% +4.48% +21.82%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 25 February 2020.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 25 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -33 87 £575 +4.50% 56
West London +33 28 £550 +4.76% 15
South London -22 15 £500 -13.04% 5
East London -20 12 £525 -7.69% 8
Hadoop
England

For the 6 months to 25 February 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 329 (61.04%) Big Data
2 328 (60.85%) Python
3 317 (58.81%) Apache Spark
4 216 (40.07%) SQL
5 199 (36.92%) Java
6 161 (29.87%) Scala
7 159 (29.50%) AWS
8 156 (28.94%) Agile Software Development
9 155 (28.76%) Analytics
10 151 (28.01%) Kafka
11 136 (25.23%) NoSQL
12 125 (23.19%) Finance
12 125 (23.19%) ETL
13 119 (22.08%) Apache Hive
14 116 (21.52%) Azure
15 112 (20.78%) DevOps
16 107 (19.85%) Data Science
17 101 (18.74%) Machine Learning
18 91 (16.88%) Kubernetes
19 89 (16.51%) Linux
20 83 (15.40%) GCP
21 81 (15.03%) Docker
21 81 (15.03%) Data Warehouse
22 77 (14.29%) PySpark
23 76 (14.10%) Jenkins
24 75 (13.91%) HBase
25 74 (13.73%) Cloudera
26 73 (13.54%) Business Intelligence
26 73 (13.54%) HDFS
27 70 (12.99%) Data Modelling

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 317 (58.81%) Apache Spark
2 33 (6.12%) Elasticsearch
3 30 (5.57%) SAS
4 25 (4.64%) Apache
5 20 (3.71%) Apache Airflow
6 9 (1.67%) Jupyter
6 9 (1.67%) Tomcat
7 8 (1.48%) Apache Pig
8 7 (1.30%) Confluence
9 5 (0.93%) Apache Solr
9 5 (0.93%) Luigi
10 4 (0.74%) JBoss
11 3 (0.56%) Jetty
11 3 (0.56%) Oracle Workflow
11 3 (0.56%) WebLogic
12 2 (0.37%) CMS
12 2 (0.37%) nginx
13 1 (0.19%) IBM Domino
13 1 (0.19%) WebSphere
13 1 (0.19%) WebSphere Application Server
Applications
1 6 (1.11%) Microsoft Excel
2 1 (0.19%) Chatbot
2 1 (0.19%) Microsoft Office
Business Applications
1 10 (1.86%) FINCAD Analytics
2 6 (1.11%) SAP Oil and Gas
3 2 (0.37%) Oracle Subledger Accounting
4 1 (0.19%) SAP MDM
4 1 (0.19%) Sparx Enterprise Architect
Cloud Services
1 159 (29.50%) AWS
2 116 (21.52%) Azure
3 83 (15.40%) GCP
4 33 (6.12%) Amazon Kinesis
4 33 (6.12%) Power Platform
5 29 (5.38%) Amazon S3
6 27 (5.01%) Serverless
7 26 (4.82%) Amazon EMR
8 24 (4.45%) AWS Lambda
9 22 (4.08%) GitHub
10 19 (3.53%) OpenShift
11 13 (2.41%) Amazon SQS
12 12 (2.23%) Amazon EKS
13 10 (1.86%) AWS Step Functions
14 8 (1.48%) Azure Machine Learning
14 8 (1.48%) Virtual Private Cloud
15 7 (1.30%) Amazon EC2
15 7 (1.30%) Cloud Computing
16 6 (1.11%) Azure Data Factory
17 5 (0.93%) AWS CloudFormation
Communications & Networking
1 17 (3.15%) Kerberos
2 12 (2.23%) SSH
3 6 (1.11%) HTTP
3 6 (1.11%) SSL
3 6 (1.11%) VPN
4 5 (0.93%) TCP/IP
5 4 (0.74%) Wi-Fi
6 3 (0.56%) Firewall
6 3 (0.56%) HTTPS
6 3 (0.56%) Internet
6 3 (0.56%) Wireshark
7 1 (0.19%) 5G
7 1 (0.19%) OpenLDAP
Database & Business Intelligence
1 329 (61.04%) Big Data
2 136 (25.23%) NoSQL
3 119 (22.08%) Apache Hive
4 81 (15.03%) Data Warehouse
5 75 (13.91%) HBase
6 66 (12.24%) PostgreSQL
7 63 (11.69%) MongoDB
8 54 (10.02%) Data Lake
9 46 (8.53%) Relational Database
10 45 (8.35%) Apache Cassandra
11 43 (7.98%) Amazon Redshift
11 43 (7.98%) SQL Server
12 38 (7.05%) BigQuery
13 37 (6.86%) Impala
14 33 (6.12%) Power BI
15 31 (5.75%) Flink
16 30 (5.57%) Spark SQL
17 29 (5.38%) Amazon Athena
18 24 (4.45%) MySQL
18 24 (4.45%) Presto
Development Applications
1 76 (14.10%) Jenkins
2 63 (11.69%) Git (software)
3 34 (6.31%) JIRA
4 19 (3.53%) Maven
5 14 (2.60%) Team Foundation Server
6 12 (2.23%) Atlassian Bamboo
6 12 (2.23%) Vagrant
7 10 (1.86%) Artifactory
8 8 (1.48%) PowerDesigner
8 8 (1.48%) Visual Studio Team System
9 7 (1.30%) ER Studio
9 7 (1.30%) ERwin
9 7 (1.30%) GitLab
10 6 (1.11%) CircleCI
10 6 (1.11%) Subversion
10 6 (1.11%) Travis CI
11 4 (0.74%) Mercurial
11 4 (0.74%) Octopus Deploy
11 4 (0.74%) RStudio
11 4 (0.74%) Selenium
General
1 125 (23.19%) Finance
2 50 (9.28%) Banking
3 29 (5.38%) Retail
4 23 (4.27%) Front Office
5 22 (4.08%) Marketing
5 22 (4.08%) Telecoms
6 15 (2.78%) Public Sector
7 13 (2.41%) Investment Banking
8 8 (1.48%) Pharmaceutical
9 7 (1.30%) Games
9 7 (1.30%) Legal
9 7 (1.30%) Retail Banking
10 4 (0.74%) Financial Institution
11 2 (0.37%) Manufacturing
12 1 (0.19%) Advertising
12 1 (0.19%) Electronics
Job Titles
1 178 (33.02%) Data Engineer
2 108 (20.04%) Developer
3 60 (11.13%) Architect
4 54 (10.02%) Big Data Engineer
5 47 (8.72%) Python Engineer
6 44 (8.16%) Data Architect
7 43 (7.98%) Data Scientist
8 41 (7.61%) DevOps Engineer
9 29 (5.38%) Analyst
10 28 (5.19%) Java Developer
11 26 (4.82%) AWS Engineer
11 26 (4.82%) Big Data Architect
12 23 (4.27%) Hadoop Developer
12 23 (4.27%) Python Developer
13 22 (4.08%) Hadoop Architect
13 22 (4.08%) Hadoop Engineer
13 22 (4.08%) Senior Developer
14 20 (3.71%) Big Data Developer
14 20 (3.71%) Java Engineer
14 20 (3.71%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 151 (28.01%) Kafka
2 77 (14.29%) PySpark
3 39 (7.24%) Spark Streaming
3 39 (7.24%) TensorFlow
4 32 (5.94%) scikit-learn
5 31 (5.75%) Spring
6 30 (5.57%) React
7 26 (4.82%) Web Services
8 24 (4.45%) Natural Language Processing
9 21 (3.90%) Apache NiFi
10 19 (3.53%) LDAP
11 18 (3.34%) RESTful
11 18 (3.34%) Spring Boot
12 17 (3.15%) Pandas
13 16 (2.97%) AngularJS
14 15 (2.78%) NumPy
15 14 (2.60%) JSON
15 14 (2.60%) REST
16 13 (2.41%) Elastic Stack
16 13 (2.41%) XML
Miscellaneous
1 50 (9.28%) Algorithms
2 43 (7.98%) Analytical Skills
3 30 (5.57%) Data Structures
4 23 (4.27%) Greenfield Project
5 17 (3.15%) Self-Motivation
6 16 (2.97%) Hedge funds
7 13 (2.41%) Fixed Income
8 12 (2.23%) Public Cloud
9 11 (2.04%) Derivative
10 9 (1.67%) Linux Command Line
10 9 (1.67%) Management Information System
11 8 (1.48%) Cloud Native
11 8 (1.48%) Data Centre
11 8 (1.48%) Social Media
11 8 (1.48%) User Experience
12 7 (1.30%) Equities
13 5 (0.93%) Market Risk
14 4 (0.74%) Client/Server
14 4 (0.74%) Credit Risk
15 3 (0.56%) PKI
Operating Systems
1 89 (16.51%) Linux
2 51 (9.46%) Unix
3 18 (3.34%) Windows
4 10 (1.86%) Ubuntu
5 7 (1.30%) Red Hat Enterprise Linux
6 5 (0.93%) CentOS
7 4 (0.74%) Debian
8 2 (0.37%) Android
8 2 (0.37%) Apple iOS
8 2 (0.37%) Solaris
9 1 (0.19%) CoreOS
9 1 (0.19%) Mac OS X
Processes & Methodologies
1 156 (28.94%) Agile Software Development
2 155 (28.76%) Analytics
3 125 (23.19%) ETL
4 112 (20.78%) DevOps
5 107 (19.85%) Data Science
6 101 (18.74%) Machine Learning
7 73 (13.54%) Business Intelligence
8 70 (12.99%) Data Modelling
9 59 (10.95%) Computer Science
10 57 (10.58%) Open Source
11 56 (10.39%) Visualisation
12 55 (10.20%) Continuous Integration
13 51 (9.46%) Microservices
14 46 (8.53%) Data Management
14 46 (8.53%) Migration
15 45 (8.35%) Data Engineering
16 42 (7.79%) Software Engineering
17 41 (7.61%) TDD
18 39 (7.24%) Data Architecture
19 38 (7.05%) Problem-Solving
Programming Languages
1 328 (60.85%) Python
2 216 (40.07%) SQL
3 199 (36.92%) Java
4 161 (29.87%) Scala
5 57 (10.58%) R
6 29 (5.38%) Bash Shell
6 29 (5.38%) C#
7 27 (5.01%) JavaScript
8 23 (4.27%) C++
9 20 (3.71%) C
10 18 (3.34%) Go
11 15 (2.78%) PL/SQL
12 14 (2.60%) Java 8
13 12 (2.23%) PowerShell
13 12 (2.23%) Ruby
14 10 (1.86%) Shell Script
15 8 (1.48%) Kotlin
16 7 (1.30%) Perl
17 6 (1.11%) Groovy
17 6 (1.11%) HiveQL
Qualifications
1 43 (7.98%) Degree
2 29 (5.38%) Security Cleared
3 20 (3.71%) Computer Science Degree
4 17 (3.15%) SC Cleared
5 12 (2.23%) DV Cleared
6 11 (2.04%) PhD
7 7 (1.30%) Numerate Degree
8 5 (0.93%) SAS Certification
9 4 (0.74%) Master's Degree
10 1 (0.19%) MBA
10 1 (0.19%) Microsoft Certification
Quality Assurance & Compliance
1 11 (2.04%) Data Quality
2 10 (1.86%) QA
3 5 (0.93%) PMO
4 1 (0.19%) ISO/IEC 27001
System Software
1 81 (15.03%) Docker
2 73 (13.54%) HDFS
3 10 (1.86%) Apache Flume
3 10 (1.86%) Apache ZooKeeper
4 9 (1.67%) VirtualBox
5 1 (0.19%) Active Directory
Systems Management
1 91 (16.88%) Kubernetes
2 54 (10.02%) Ansible
3 49 (9.09%) Terraform
4 39 (7.24%) Hadoop YARN
5 26 (4.82%) Puppet
6 13 (2.41%) Oozie
7 11 (2.04%) ITRS Geneos
8 10 (1.86%) Kibana
8 10 (1.86%) Single Sign-On
9 9 (1.67%) Docker Swarm
9 9 (1.67%) Opscode Chef
10 6 (1.11%) Ambari
10 6 (1.11%) logstash
11 4 (0.74%) Cobbler
11 4 (0.74%) Prometheus
12 3 (0.56%) Kubeflow
12 3 (0.56%) Red Hat Satellite
12 3 (0.56%) SELinux
12 3 (0.56%) ZABBIX
13 2 (0.37%) Grafana
Vendors
1 74 (13.73%) Cloudera
2 57 (10.58%) Hortonworks
3 56 (10.39%) Oracle
4 48 (8.91%) Google
5 43 (7.98%) Microsoft
6 41 (7.61%) Tableau
7 29 (5.38%) Informatica
8 27 (5.01%) SAP
9 22 (4.08%) Teradata
10 21 (3.90%) Talend
11 20 (3.71%) Palantir
12 19 (3.53%) MapR
13 17 (3.15%) Ab Initio
13 17 (3.15%) Databricks
14 15 (2.78%) Splunk
15 13 (2.41%) Red Hat
16 10 (1.86%) IBM
17 9 (1.67%) Alteryx
17 9 (1.67%) Bloomberg
17 9 (1.67%) Datactics