Period
to 11 November 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 11 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
11 Nov 2019
Same period 2018 Same period 2017
Rank 133 100 89
Rank change year-on-year -33 -11 -10
Contract jobs citing Hadoop 731 1,192 1,413
As % of all contract IT jobs advertised in London 2.04% 2.62% 3.04%
As % of the Database & Business Intelligence category 8.53% 10.70% 12.79%
Number of daily rates quoted 549 854 1,046
London median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.55% -
10th Percentile £425 £427 £413
90th Percentile £738 £713 £700
England median daily rate £550 £550 £538
% change year-on-year - +2.33% +2.38%
Number of hourly rates quoted 2 4 0
London median hourly rate £43.53 £60.00 -
Median hourly rate % change year-on-year -27.45% - -
England median hourly rate £43.53 £47.50 £35.00
% change year-on-year -8.35% +35.71% -23.50%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,572 11,138 11,044
As % of all contract IT jobs advertised in London 23.95% 24.52% 23.73%
Number of daily rates quoted 6,208 8,300 8,164
London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +5.26%
10th Percentile £363 £363 £350
90th Percentile £700 £675 £655
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 57 50 61
London median hourly rate £35.00 £27.62 £26.61
Median hourly rate % change year-on-year +26.74% +3.80% -23.99%
10th Percentile £15.56 £16.15 £18.25
90th Percentile £53.75 £48.73 £58.75
England median hourly rate £32.50 £30.00 £31.08
% change year-on-year +8.33% -3.46% +10.63%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 11 November 2019.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 11 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -3 165 £575 - 50
West London +26 20 £525 -4.55% 10
East London -30 14 £575 - 16
South London -47 6 £556 +5.95% 1
Hadoop
England

For the 6 months to 11 November 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 476 (65.12%) Apache Spark
2 449 (61.42%) Python
3 438 (59.92%) Big Data
4 318 (43.50%) SQL
5 300 (41.04%) Java
6 261 (35.70%) AWS
7 235 (32.15%) Agile Software Development
8 232 (31.74%) Kafka
9 208 (28.45%) Finance
9 208 (28.45%) Scala
10 203 (27.77%) Apache Hive
11 197 (26.95%) Analytics
12 191 (26.13%) ETL
13 179 (24.49%) Data Science
14 158 (21.61%) DevOps
15 154 (21.07%) Docker
16 150 (20.52%) Azure
17 146 (19.97%) GCP
18 140 (19.15%) Machine Learning
19 134 (18.33%) Kubernetes
20 126 (17.24%) Google
21 125 (17.10%) NoSQL
22 116 (15.87%) Linux
23 112 (15.32%) Jenkins
24 104 (14.23%) Data Warehouse
25 94 (12.86%) MongoDB
26 93 (12.72%) Algorithms
27 89 (12.18%) Data Modelling
27 89 (12.18%) Oracle
28 86 (11.76%) Banking

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 476 (65.12%) Apache Spark
2 70 (9.58%) Apache
3 52 (7.11%) Elasticsearch
4 47 (6.43%) SAS
5 31 (4.24%) Apache Airflow
6 19 (2.60%) Confluence
7 17 (2.33%) Tomcat
8 14 (1.92%) JBoss
8 14 (1.92%) Jupyter
9 13 (1.78%) Jetty
10 11 (1.50%) Luigi
11 10 (1.37%) Pachyderm
12 9 (1.23%) Apache Solr
13 6 (0.82%) Oracle Self-Service HR
13 6 (0.82%) WebLogic
14 2 (0.27%) Apache Pig
14 2 (0.27%) CMS
14 2 (0.27%) SharePoint
14 2 (0.27%) SharePoint 2013
14 2 (0.27%) Tornado
Applications
1 12 (1.64%) Microsoft Excel
2 5 (0.68%) SPSS
2 5 (0.68%) Stata
Business Applications
1 10 (1.37%) SAP Oil and Gas
2 9 (1.23%) FINCAD Analytics
3 2 (0.27%) Oracle Subledger Accounting
4 1 (0.14%) Oracle Receivables
4 1 (0.14%) SAP MDM
4 1 (0.14%) Sparx Enterprise Architect
Cloud Services
1 261 (35.70%) AWS
2 150 (20.52%) Azure
3 146 (19.97%) GCP
4 59 (8.07%) Amazon EMR
5 43 (5.88%) Amazon S3
5 43 (5.88%) Serverless
6 36 (4.92%) GitHub
7 34 (4.65%) Power Platform
8 33 (4.51%) Amazon Kinesis
8 33 (4.51%) AWS Lambda
9 23 (3.15%) Amazon EC2
10 22 (3.01%) OpenShift
11 13 (1.78%) Amazon SQS
12 12 (1.64%) Amazon EKS
12 12 (1.64%) AWS CloudFormation
12 12 (1.64%) Azure Data Factory
12 12 (1.64%) Cloud Computing
13 11 (1.50%) Virtual Private Cloud
14 9 (1.23%) Amazon SageMaker
15 7 (0.96%) Azure Machine Learning
Communications & Networking
1 17 (2.33%) SSH
2 8 (1.09%) Firewall
2 8 (1.09%) Internet
3 6 (0.82%) Kerberos
4 5 (0.68%) Wi-Fi
5 4 (0.55%) TCP/IP
6 3 (0.41%) HTTP
6 3 (0.41%) Software-Defined Networking
6 3 (0.41%) Wireshark
7 2 (0.27%) Extranet
7 2 (0.27%) F5 BIG-IP GTM
7 2 (0.27%) F5 BIG-IP LTM
7 2 (0.27%) Intranet
7 2 (0.27%) SSL
8 1 (0.14%) Broadband
8 1 (0.14%) LAN
8 1 (0.14%) NAS
8 1 (0.14%) OpenLDAP
8 1 (0.14%) VPN
8 1 (0.14%) WAN
Database & Business Intelligence
1 438 (59.92%) Big Data
2 203 (27.77%) Apache Hive
3 125 (17.10%) NoSQL
4 104 (14.23%) Data Warehouse
5 94 (12.86%) MongoDB
6 84 (11.49%) PostgreSQL
7 79 (10.81%) Data Lake
8 78 (10.67%) HBase
9 60 (8.21%) Apache Cassandra
10 56 (7.66%) Relational Database
11 53 (7.25%) Impala
12 51 (6.98%) Amazon Redshift
13 50 (6.84%) MySQL
14 48 (6.57%) BigQuery
15 42 (5.75%) Flink
15 42 (5.75%) SQL Server
16 40 (5.47%) Spark SQL
17 35 (4.79%) Neo4j
18 34 (4.65%) Power BI
18 34 (4.65%) Sqoop
Development Applications
1 112 (15.32%) Jenkins
2 84 (11.49%) Git (software)
3 50 (6.84%) JIRA
4 28 (3.83%) Maven
5 24 (3.28%) Atlassian Bamboo
6 17 (2.33%) Vagrant
7 11 (1.50%) Subversion
8 9 (1.23%) Ant
8 9 (1.23%) Mercurial
8 9 (1.23%) Travis CI
9 8 (1.09%) Cucumber
9 8 (1.09%) Hudson
10 7 (0.96%) Eclipse
10 7 (0.96%) FishEye
10 7 (0.96%) Gradle
10 7 (0.96%) Selenium
10 7 (0.96%) Team Foundation Server
11 6 (0.82%) GitLab
11 6 (0.82%) Leiningen
11 6 (0.82%) SonarQube
General
1 208 (28.45%) Finance
2 86 (11.76%) Banking
3 43 (5.88%) Front Office
4 32 (4.38%) Investment Banking
5 30 (4.10%) Retail
6 19 (2.60%) Legal
7 11 (1.50%) Marketing
7 11 (1.50%) Telecoms
8 10 (1.37%) Publishing
8 10 (1.37%) Retail Banking
9 6 (0.82%) Public Sector
10 5 (0.68%) Advertising
10 5 (0.68%) Games
10 5 (0.68%) Pharmaceutical
11 4 (0.55%) Financial Institution
12 2 (0.27%) Greek Language
13 1 (0.14%) Aerospace
13 1 (0.14%) Automotive
13 1 (0.14%) International Banking
Job Titles
1 250 (34.20%) Data Engineer
2 167 (22.85%) Developer
3 82 (11.22%) Architect
4 69 (9.44%) Big Data Engineer
5 64 (8.76%) Java Developer
6 60 (8.21%) Python Engineer
7 46 (6.29%) Data Architect
8 43 (5.88%) Data Scientist
8 43 (5.88%) Python Developer
9 37 (5.06%) Senior Developer
10 36 (4.92%) AWS Engineer
10 36 (4.92%) Big Data Developer
10 36 (4.92%) Hadoop Developer
11 33 (4.51%) Hadoop Engineer
12 32 (4.38%) DevOps Engineer
13 29 (3.97%) Administrator
13 29 (3.97%) Big Data Architect
13 29 (3.97%) Java Engineer
14 28 (3.83%) Analyst
15 27 (3.69%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 232 (31.74%) Kafka
2 82 (11.22%) PySpark
3 52 (7.11%) Spark Streaming
4 45 (6.16%) Spring
5 41 (5.61%) Web Services
6 38 (5.20%) Pandas
7 37 (5.06%) React
8 34 (4.65%) Natural Language Processing
9 28 (3.83%) REST
10 27 (3.69%) RESTful
11 26 (3.56%) JSON
12 22 (3.01%) Flask
13 21 (2.87%) AngularJS
14 20 (2.74%) Apache NiFi
14 20 (2.74%) Hibernate
14 20 (2.74%) scikit-learn
14 20 (2.74%) Spring Boot
15 18 (2.46%) HTML
15 18 (2.46%) Play Framework
15 18 (2.46%) RabbitMQ
Miscellaneous
1 93 (12.72%) Algorithms
2 63 (8.62%) Analytical Skills
3 54 (7.39%) Data Structures
4 41 (5.61%) Greenfield Project
5 27 (3.69%) Self-Motivation
6 24 (3.28%) Derivative
7 17 (2.33%) Fixed Income
8 13 (1.78%) Hedge funds
8 13 (1.78%) Linux Command Line
8 13 (1.78%) User Experience
9 11 (1.50%) Credit Risk
10 10 (1.37%) Public Cloud
11 9 (1.23%) Foreign Exchange (FX)
12 8 (1.09%) Equities
13 7 (0.96%) Cloud Native
13 7 (0.96%) Equity Derivative
13 7 (0.96%) Market Risk
13 7 (0.96%) Virtual Team
14 6 (0.82%) Data Centre
14 6 (0.82%) Grid Computing
Operating Systems
1 116 (15.87%) Linux
2 72 (9.85%) Unix
3 30 (4.10%) Windows
4 17 (2.33%) Red Hat Enterprise Linux
5 15 (2.05%) Ubuntu
6 12 (1.64%) CentOS
7 9 (1.23%) Debian
8 8 (1.09%) Android
8 8 (1.09%) Apple iOS
9 6 (0.82%) Mac OS X
10 2 (0.27%) Solaris
11 1 (0.14%) CoreOS
11 1 (0.14%) Windows Server
Processes & Methodologies
1 235 (32.15%) Agile Software Development
2 197 (26.95%) Analytics
3 191 (26.13%) ETL
4 179 (24.49%) Data Science
5 158 (21.61%) DevOps
6 140 (19.15%) Machine Learning
7 89 (12.18%) Data Modelling
8 84 (11.49%) Computer Science
9 83 (11.35%) Business Intelligence
10 82 (11.22%) TDD
11 80 (10.94%) Microservices
12 79 (10.81%) Problem-Solving
13 73 (9.99%) Migration
14 71 (9.71%) Software Engineering
15 70 (9.58%) Data Engineering
16 61 (8.34%) Open Source
17 60 (8.21%) Visualisation
18 58 (7.93%) Artificial Intelligence
19 56 (7.66%) Continuous Integration
20 46 (6.29%) Configuration Management
Programming Languages
1 449 (61.42%) Python
2 318 (43.50%) SQL
3 300 (41.04%) Java
4 208 (28.45%) Scala
5 70 (9.58%) R
6 69 (9.44%) JavaScript
7 32 (4.38%) C++
8 31 (4.24%) Bash Shell
9 26 (3.56%) Perl
10 24 (3.28%) C#
11 23 (3.15%) Go
11 23 (3.15%) Java 8
12 19 (2.60%) C
13 17 (2.33%) Groovy
14 16 (2.19%) MATLAB
15 14 (1.92%) Ruby
16 13 (1.78%) PL/SQL
17 12 (1.64%) T-SQL
18 11 (1.50%) PHP
18 11 (1.50%) Shell Script
Qualifications
1 61 (8.34%) Degree
2 34 (4.65%) Computer Science Degree
3 31 (4.24%) Security Cleared
4 18 (2.46%) DV Cleared
5 17 (2.33%) PhD
6 14 (1.92%) Master's Degree
7 13 (1.78%) SC Cleared
8 6 (0.82%) Numerate Degree
9 5 (0.68%) CCA
9 5 (0.68%) SAS Certification
10 4 (0.55%) TOGAF Certification
11 3 (0.41%) CEH
12 2 (0.27%) CCIE
12 2 (0.27%) CCNP
12 2 (0.27%) Cisco Certification
12 2 (0.27%) DBS Check
12 2 (0.27%) PMI Certification
13 1 (0.14%) AWS Certification
13 1 (0.14%) CISSP
13 1 (0.14%) Microsoft Certification
Quality Assurance & Compliance
1 24 (3.28%) Data Quality
2 8 (1.09%) QA
3 4 (0.55%) PMO
4 1 (0.14%) Basel III
4 1 (0.14%) EMIR
4 1 (0.14%) GDPR
4 1 (0.14%) IFRS
4 1 (0.14%) IFRS 9
4 1 (0.14%) ISO/IEC 27001
4 1 (0.14%) MiFID
System Software
1 154 (21.07%) Docker
2 78 (10.67%) HDFS
3 16 (2.19%) Apache Flume
4 9 (1.23%) Apache ZooKeeper
4 9 (1.23%) VirtualBox
5 4 (0.55%) VMware ESXi
6 2 (0.27%) Samba
6 2 (0.27%) VMware Infrastructure
6 2 (0.27%) vSphere
7 1 (0.14%) Active Directory
7 1 (0.14%) Virtual Servers
Systems Management
1 134 (18.33%) Kubernetes
2 85 (11.63%) Ansible
3 55 (7.52%) Hadoop YARN
3 55 (7.52%) Terraform
4 39 (5.34%) Puppet
5 19 (2.60%) Opscode Chef
6 18 (2.46%) Oozie
7 11 (1.50%) Cobbler
8 10 (1.37%) ITRS Geneos
8 10 (1.37%) Kubeflow
9 9 (1.23%) Docker Swarm
10 8 (1.09%) Salt
11 6 (0.82%) Kibana
11 6 (0.82%) Prometheus
11 6 (0.82%) ZABBIX
12 5 (0.68%) Red Hat Satellite
12 5 (0.68%) Single Sign-On
13 4 (0.55%) Ambari
13 4 (0.55%) Consul
13 4 (0.55%) Grafana
Vendors
1 126 (17.24%) Google
2 89 (12.18%) Oracle
3 85 (11.63%) Cloudera
4 57 (7.80%) Microsoft
5 51 (6.98%) Hortonworks
6 47 (6.43%) Tableau
7 39 (5.34%) Talend
8 36 (4.92%) Teradata
9 35 (4.79%) Databricks
10 33 (4.51%) Informatica
11 27 (3.69%) Red Hat
12 24 (3.28%) SAP
13 20 (2.74%) MapR
14 16 (2.19%) Palantir
15 14 (1.92%) Splunk
16 13 (1.78%) Alteryx
16 13 (1.78%) Sybase
17 10 (1.37%) IBM
18 9 (1.23%) Datactics
19 8 (1.09%) Vertica