Period
to 24 August 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 24 August 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
24 Aug 2019
Same period 2018 Same period 2017
Rank 124 96 81
Rank change year-on-year -28 -15 +15
Contract jobs citing Hadoop 893 1,279 1,389
As % of all contract IT jobs advertised in London 2.26% 2.79% 3.23%
As % of the Database & Business Intelligence category 9.20% 11.06% 13.31%
Number of daily rates quoted 645 948 1,015
London median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -
10th Percentile £438 £414 £406
90th Percentile £713 £700 £688
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 6 3 0
London median hourly rate £42.50 £75.00 -
Median hourly rate % change year-on-year -43.33% - -
England median hourly rate £44.57 £47.50 £35.00
% change year-on-year -6.18% +35.71% -22.22%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 9,703 11,562 10,436
As % of all contract IT jobs advertised in London 24.53% 25.26% 24.27%
Number of daily rates quoted 7,037 8,595 7,583
London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +5.26%
10th Percentile £363 £358 £334
90th Percentile £688 £675 £650
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 63 69 57
London median hourly rate £35.00 £27.50 £27.16
Median hourly rate % change year-on-year +27.27% +1.25% -1.24%
10th Percentile £15.73 £19.50 £18.45
90th Percentile £56.30 £47.39 £58.75
England median hourly rate £35.00 £30.00 £30.25
% change year-on-year +16.67% -0.83% +6.14%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 24 August 2019.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 24 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -9 228 £561 -2.39% 39
East London -29 25 £569 +3.41% 11
South London -40 22 £625 +19.05% 2
West London +4 7 £375 -30.23% 14
North London -4 4 £525 +66.01% 1
Hadoop
England

For the 6 months to 24 August 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 604 (67.64%) Apache Spark
2 591 (66.18%) Big Data
3 517 (57.89%) Python
4 349 (39.08%) SQL
5 314 (35.16%) Kafka
6 309 (34.60%) Apache Hive
7 307 (34.38%) Java
8 304 (34.04%) AWS
9 285 (31.91%) Agile Software Development
10 267 (29.90%) Finance
11 256 (28.67%) Analytics
12 250 (28.00%) Data Science
13 223 (24.97%) Scala
14 192 (21.50%) ETL
15 191 (21.39%) Machine Learning
16 184 (20.60%) GCP
17 183 (20.49%) Docker
18 177 (19.82%) Azure
19 166 (18.59%) Data Warehouse
20 162 (18.14%) DevOps
21 159 (17.81%) Google
22 155 (17.36%) Kubernetes
23 151 (16.91%) Data Modelling
24 140 (15.68%) NoSQL
25 139 (15.57%) Data Lake
26 127 (14.22%) Linux
27 121 (13.55%) HBase
28 113 (12.65%) Jenkins
29 103 (11.53%) HDFS
30 99 (11.09%) Banking

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 604 (67.64%) Apache Spark
2 84 (9.41%) Apache
3 62 (6.94%) Elasticsearch
4 33 (3.70%) Confluence
4 33 (3.70%) SAS
5 26 (2.91%) Apache Airflow
6 20 (2.24%) Apache Solr
7 13 (1.46%) JBoss
7 13 (1.46%) Tomcat
8 12 (1.34%) Pachyderm
9 11 (1.23%) Apache Pig
9 11 (1.23%) Luigi
10 10 (1.12%) Jetty
11 8 (0.90%) Jupyter
12 5 (0.56%) Oracle Self-Service HR
12 5 (0.56%) WebLogic
13 2 (0.22%) nginx
13 2 (0.22%) SharePoint
13 2 (0.22%) SharePoint 2013
14 1 (0.11%) OpenStack
Applications
1 8 (0.90%) Microsoft Excel
1 8 (0.90%) SPSS
2 7 (0.78%) Stata
3 3 (0.34%) Microsoft PowerPoint
4 2 (0.22%) Chatbot
4 2 (0.22%) Microsoft Office
4 2 (0.22%) MS Visio
Business Applications
1 16 (1.79%) SAP Oil and Gas
2 4 (0.45%) SAP ERP
2 4 (0.45%) SAP S/4HANA
3 1 (0.11%) Oracle Receivables
3 1 (0.11%) Oracle Retail
3 1 (0.11%) Sparx Enterprise Architect
Cloud Services
1 304 (34.04%) AWS
2 184 (20.60%) GCP
3 177 (19.82%) Azure
4 68 (7.61%) Amazon EMR
5 58 (6.49%) Serverless
6 41 (4.59%) Amazon S3
7 37 (4.14%) Azure Data Factory
8 36 (4.03%) GitHub
9 34 (3.81%) Amazon Kinesis
10 33 (3.70%) AWS Lambda
11 32 (3.58%) Power Platform
12 27 (3.02%) Amazon EC2
13 19 (2.13%) SaaS
14 14 (1.57%) Amazon SageMaker
14 14 (1.57%) AWS CloudFormation
15 11 (1.23%) PaaS
16 10 (1.12%) Cloud Computing
16 10 (1.12%) Data Lake Analytics
17 9 (1.01%) Amazon CloudWatch
17 9 (1.01%) OpenShift
Communications & Networking
1 15 (1.68%) Kerberos
2 12 (1.34%) Internet
3 10 (1.12%) Firewall
4 7 (0.78%) TCP/IP
5 5 (0.56%) SSH
6 3 (0.34%) OpenLDAP
6 3 (0.34%) Software-Defined Networking
7 2 (0.22%) DNS
7 2 (0.22%) Extranet
7 2 (0.22%) F5 BIG-IP GTM
7 2 (0.22%) F5 BIG-IP LTM
7 2 (0.22%) Intranet
7 2 (0.22%) LAN
7 2 (0.22%) VLAN
7 2 (0.22%) VPN
7 2 (0.22%) VSAN
7 2 (0.22%) WAN
8 1 (0.11%) Broadband
8 1 (0.11%) NAS
8 1 (0.11%) Wi-Fi
Database & Business Intelligence
1 591 (66.18%) Big Data
2 309 (34.60%) Apache Hive
3 166 (18.59%) Data Warehouse
4 140 (15.68%) NoSQL
5 139 (15.57%) Data Lake
6 121 (13.55%) HBase
7 89 (9.97%) PostgreSQL
8 87 (9.74%) Apache Cassandra
9 82 (9.18%) MongoDB
10 70 (7.84%) Impala
11 58 (6.49%) Relational Database
12 57 (6.38%) SQL Server
13 52 (5.82%) MySQL
14 43 (4.82%) Amazon Redshift
14 43 (4.82%) Data Mining
15 41 (4.59%) BigQuery
16 39 (4.37%) Sqoop
17 34 (3.81%) OLAP
18 32 (3.58%) Enterprise Data Warehouse
18 32 (3.58%) Power BI
Development Applications
1 113 (12.65%) Jenkins
2 81 (9.07%) Git (software)
3 69 (7.73%) JIRA
4 22 (2.46%) Maven
5 21 (2.35%) Atlassian Bamboo
6 19 (2.13%) TeamCity
7 18 (2.02%) RStudio
8 17 (1.90%) Visual Studio Team System
9 15 (1.68%) Cucumber
10 12 (1.34%) Travis CI
11 11 (1.23%) GitLab
11 11 (1.23%) Hudson
12 10 (1.12%) IBM UrbanCode
12 10 (1.12%) Subversion
13 9 (1.01%) Gradle
13 9 (1.01%) IntelliJ
14 8 (0.90%) Octopus Deploy
14 8 (0.90%) Sonatype Nexus
14 8 (0.90%) SpecFlow
14 8 (0.90%) tSQLt
General
1 267 (29.90%) Finance
2 99 (11.09%) Banking
3 44 (4.93%) Retail
4 35 (3.92%) Front Office
5 30 (3.36%) Investment Banking
6 24 (2.69%) Legal
7 12 (1.34%) Marketing
7 12 (1.34%) Retail Banking
8 11 (1.23%) Publishing
9 8 (0.90%) Financial Institution
9 8 (0.90%) Telecoms
10 6 (0.67%) Advertising
10 6 (0.67%) Games
10 6 (0.67%) Public Sector
11 3 (0.34%) Aerospace
11 3 (0.34%) Back Office
11 3 (0.34%) Greek Language
12 2 (0.22%) Manufacturing
12 2 (0.22%) Pharmaceutical
13 1 (0.11%) Automotive
Job Titles
1 334 (37.40%) Data Engineer
2 183 (20.49%) Developer
3 122 (13.66%) Big Data Engineer
4 111 (12.43%) Architect
5 97 (10.86%) Java Developer
6 90 (10.08%) Hadoop Engineer
7 75 (8.40%) Python Engineer
8 64 (7.17%) Data Architect
9 63 (7.05%) Data Scientist
10 59 (6.61%) AWS Engineer
11 55 (6.16%) Big Data Developer
12 46 (5.15%) DevOps Engineer
13 42 (4.70%) Hadoop Developer
14 38 (4.26%) Senior Developer
15 37 (4.14%) Administrator
15 37 (4.14%) Senior Data Engineer
16 33 (3.70%) Big Data Architect
17 30 (3.36%) Hadoop Administrator
17 30 (3.36%) Senior Java Developer
18 29 (3.25%) Solutions Architect
Libraries, Frameworks & Software Standards
1 314 (35.16%) Kafka
2 67 (7.50%) PySpark
3 55 (6.16%) Spring
4 48 (5.38%) Web Services
5 46 (5.15%) Spark Streaming
6 37 (4.14%) Spring Boot
7 36 (4.03%) Natural Language Processing
8 33 (3.70%) Pandas
8 33 (3.70%) REST
9 32 (3.58%) RESTful
10 31 (3.47%) TensorFlow
11 26 (2.91%) Apache NiFi
11 26 (2.91%) HTML
12 25 (2.80%) Elastic Stack
13 24 (2.69%) Play Framework
14 22 (2.46%) React
15 21 (2.35%) HTML5
15 21 (2.35%) Velocity
16 20 (2.24%) Node.js
16 20 (2.24%) scikit-learn
Miscellaneous
1 95 (10.64%) Algorithms
2 78 (8.73%) Analytical Skills
3 59 (6.61%) Greenfield Project
4 52 (5.82%) Data Structures
5 31 (3.47%) Self-Motivation
6 17 (1.90%) Credit Risk
6 17 (1.90%) Data Protection Act
7 16 (1.79%) Public Cloud
7 16 (1.79%) User Experience
8 15 (1.68%) Derivative
8 15 (1.68%) Linux Command Line
9 12 (1.34%) Market Risk
10 10 (1.12%) Foreign Exchange (FX)
10 10 (1.12%) Virtual Team
11 8 (0.90%) Equity Derivative
12 7 (0.78%) Grid Computing
12 7 (0.78%) Hedge funds
13 6 (0.67%) Cloud Native
13 6 (0.67%) Equities
14 5 (0.56%) Fixed Income
Operating Systems
1 127 (14.22%) Linux
2 80 (8.96%) Unix
3 27 (3.02%) Windows
4 21 (2.35%) Red Hat Enterprise Linux
5 14 (1.57%) CentOS
6 8 (0.90%) Android
6 8 (0.90%) Apple iOS
7 7 (0.78%) Debian
7 7 (0.78%) Ubuntu
8 5 (0.56%) Mac OS X
9 2 (0.22%) Solaris
10 1 (0.11%) Mesosphere
10 1 (0.11%) Windows Server
Processes & Methodologies
1 285 (31.91%) Agile Software Development
2 256 (28.67%) Analytics
3 250 (28.00%) Data Science
4 192 (21.50%) ETL
5 191 (21.39%) Machine Learning
6 162 (18.14%) DevOps
7 151 (16.91%) Data Modelling
8 98 (10.97%) TDD
9 89 (9.97%) Business Intelligence
10 88 (9.85%) Computer Science
11 83 (9.29%) Microservices
11 83 (9.29%) Problem-Solving
12 81 (9.07%) Artificial Intelligence
13 74 (8.29%) Data Engineering
14 70 (7.84%) Visualisation
15 66 (7.39%) Software Engineering
16 64 (7.17%) Migration
17 52 (5.82%) MapReduce
17 52 (5.82%) Open Source
18 51 (5.71%) Data Analytics
Programming Languages
1 517 (57.89%) Python
2 349 (39.08%) SQL
3 307 (34.38%) Java
4 223 (24.97%) Scala
5 97 (10.86%) R
6 70 (7.84%) JavaScript
7 41 (4.59%) Java 8
8 37 (4.14%) Perl
9 30 (3.36%) Bash Shell
10 26 (2.91%) Go
11 25 (2.80%) C++
12 24 (2.69%) Shell Script
13 22 (2.46%) C#
13 22 (2.46%) T-SQL
14 19 (2.13%) MATLAB
15 18 (2.02%) Ruby
16 17 (1.90%) Clojure
17 16 (1.79%) Groovy
18 14 (1.57%) Julia
19 13 (1.46%) C
Qualifications
1 68 (7.61%) Degree
2 56 (6.27%) Security Cleared
3 40 (4.48%) SC Cleared
4 32 (3.58%) Computer Science Degree
5 21 (2.35%) Master's Degree
6 19 (2.13%) PhD
7 13 (1.46%) DV Cleared
8 11 (1.23%) TOGAF Certification
9 5 (0.56%) CCA
9 5 (0.56%) CEH
10 3 (0.34%) CISA
10 3 (0.34%) CISM
10 3 (0.34%) CISSP
10 3 (0.34%) GIAC
10 3 (0.34%) Numerate Degree
10 3 (0.34%) OSCP
11 2 (0.22%) Cisco Certification
11 2 (0.22%) DBS Check
11 2 (0.22%) PMI Certification
11 2 (0.22%) RHCE
Quality Assurance & Compliance
1 53 (5.94%) Data Quality
2 6 (0.67%) GDPR
3 2 (0.22%) QA
3 2 (0.22%) Sarbanes-Oxley
4 1 (0.11%) Basel III
4 1 (0.11%) EMIR
4 1 (0.11%) IFRS
4 1 (0.11%) IFRS 9
4 1 (0.11%) ISO/IEC 27001
4 1 (0.11%) MiFID
4 1 (0.11%) PMO
4 1 (0.11%) SLA
System Software
1 183 (20.49%) Docker
2 103 (11.53%) HDFS
3 46 (5.15%) Apache Flume
4 7 (0.78%) Apache ZooKeeper
4 7 (0.78%) VMware ESXi
5 6 (0.67%) VMware Infrastructure
6 4 (0.45%) Active Directory
6 4 (0.45%) Samba
7 3 (0.34%) vSphere
8 2 (0.22%) NFS
8 2 (0.22%) VMware NSX
9 1 (0.11%) Oracle RAC
9 1 (0.11%) Virtual Servers
Systems Management
1 155 (17.36%) Kubernetes
2 84 (9.41%) Ansible
3 63 (7.05%) Hadoop YARN
4 61 (6.83%) Terraform
5 49 (5.49%) Oozie
6 40 (4.48%) Puppet
7 17 (1.90%) Kibana
8 16 (1.79%) Opscode Chef
9 14 (1.57%) logstash
10 12 (1.34%) Kubeflow
11 8 (0.90%) Salt
12 7 (0.78%) Ambari
12 7 (0.78%) Cobbler
12 7 (0.78%) ZABBIX
13 5 (0.56%) Marathon
13 5 (0.56%) Mesos
14 3 (0.34%) Consul
14 3 (0.34%) Nagios
14 3 (0.34%) Packer
14 3 (0.34%) Prometheus
Vendors
1 159 (17.81%) Google
2 92 (10.30%) Cloudera
3 75 (8.40%) Oracle
4 69 (7.73%) Microsoft
5 54 (6.05%) Hortonworks
6 52 (5.82%) Tableau
7 47 (5.26%) Databricks
8 44 (4.93%) Talend
9 29 (3.25%) Red Hat
10 26 (2.91%) Informatica
10 26 (2.91%) MapR
11 25 (2.80%) SAP
12 24 (2.69%) Teradata
13 15 (1.68%) Splunk
14 14 (1.57%) Vertica
15 12 (1.34%) Alteryx
16 10 (1.12%) Sybase
17 8 (0.90%) DataFlux
17 8 (0.90%) Hyperion
17 8 (0.90%) VMware