Period
to 16 August 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 16 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
16 Aug 2018
Same period 2017 Same period 2016
Rank 65 60 93
Rank change year-on-year -5 +33 +46
Contract jobs citing Big Data 1,759 1,724 1,219
As % of all contract IT jobs advertised in London 3.86% 4.03% 2.69%
As % of the Database & Business Intelligence category 15.27% 16.62% 11.56%
Number of daily rates quoted 1,294 1,294 904
London median daily rate £550 £550 £550
10th Percentile £413 £400 £413
90th Percentile £713 £700 £713
England median daily rate £550 £538 £525
% change year-on-year +2.33% +2.38% -
Number of hourly rates quoted 3 1 0
London median hourly rate £27.50 £40.00 -
Median hourly rate % change year-on-year -31.25% - -
England median hourly rate £44.00 £27.50 £43.92
% change year-on-year +60.00% -37.39% +70.41%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,518 10,371 10,546
As % of all contract IT jobs advertised in London 25.30% 24.27% 23.25%
Number of daily rates quoted 8,582 7,546 7,617
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £356 £338 £313
90th Percentile £675 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 68 54 46
London median hourly rate £27.33 £27.16 £27.50
Median hourly rate % change year-on-year +0.63% -1.24% +10.00%
10th Percentile £19.50 £18.58 £17.11
90th Percentile £47.40 £58.75 £100.00
England median hourly rate £30.00 £30.00 £28.50
% change year-on-year - +5.26% +10.34%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 16 August 2018.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 16 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +3 372 £550 - 130
South London -25 87 £525 -2.33% 6
East London +30 83 £550 -15.38% 27
West London -10 44 £525 +10.53% 43
North London -1 2 £550 +10.00% 1
Big Data
England

For the 6 months to 16 August 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 926 (52.64%) Hadoop
2 696 (39.57%) Agile Software Development
3 692 (39.34%) Apache Spark
4 637 (36.21%) Python
5 620 (35.25%) Java
6 560 (31.84%) SQL
7 536 (30.47%) Analytics
8 515 (29.28%) Kafka
9 483 (27.46%) Finance
10 462 (26.26%) Amazon AWS
11 429 (24.39%) Apache Hive
12 368 (20.92%) Scala
13 354 (20.13%) Data Science
14 313 (17.79%) DevOps
15 309 (17.57%) NoSQL
16 296 (16.83%) HBase
17 280 (15.92%) Scrum
18 277 (15.75%) ETL
19 272 (15.46%) Linux
20 264 (15.01%) Machine Learning
21 256 (14.55%) Data Warehouse
22 245 (13.93%) Docker
23 241 (13.70%) Data Modelling
24 239 (13.59%) Jenkins
25 235 (13.36%) Business Intelligence
25 235 (13.36%) TDD
26 213 (12.11%) Microsoft Azure
27 207 (11.77%) SQL Server
28 202 (11.48%) HDFS
29 185 (10.52%) Analytical Skills

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 692 (39.34%) Apache Spark
2 160 (9.10%) Elasticsearch
3 143 (8.13%) Apache
4 81 (4.60%) Apache Pig
5 64 (3.64%) Confluence
6 62 (3.52%) Apache Solr
7 44 (2.50%) SAS
8 24 (1.36%) Tomcat
9 23 (1.31%) Apache Airflow
10 19 (1.08%) nginx
11 10 (0.57%) OpenStack
12 7 (0.40%) Cloud Foundry
12 7 (0.40%) Jupyter
12 7 (0.40%) Luigi
13 4 (0.23%) SharePoint
13 4 (0.23%) WildFly
14 3 (0.17%) IIS
14 3 (0.17%) WebSphere
15 2 (0.11%) Jetty
15 2 (0.11%) Oracle SOA Suite
Applications
1 52 (2.96%) Microsoft Excel
2 36 (2.05%) MS Visio
3 7 (0.40%) Microsoft Office
3 7 (0.40%) Microsoft PowerPoint
4 6 (0.34%) SPSS
5 4 (0.23%) Spreadsheet
6 2 (0.11%) Chatbot
6 2 (0.11%) Shockwave
7 1 (0.057%) HipChat
7 1 (0.057%) Microsoft Project
7 1 (0.057%) Stata
Business Applications
1 25 (1.42%) SAP Oil and Gas
2 5 (0.28%) Markit EDM
3 3 (0.17%) Dynamics CRM
3 3 (0.17%) ION MarketView
4 2 (0.11%) Adobe Campaign
4 2 (0.11%) Eloqua
4 2 (0.11%) FastStats
4 2 (0.11%) PolarLake
4 2 (0.11%) Salesforce.com CRM
4 2 (0.11%) Summit
4 2 (0.11%) Unica
5 1 (0.057%) Cognos TM1
5 1 (0.057%) Distributed Ledger
5 1 (0.057%) FLEXCUBE
5 1 (0.057%) HiPortfolio
5 1 (0.057%) Payment Gateway
5 1 (0.057%) SAP APO
5 1 (0.057%) SAP MDM
5 1 (0.057%) SAP MM
5 1 (0.057%) Temenos T24
Cloud Services
1 462 (26.26%) Amazon AWS
2 213 (12.11%) Microsoft Azure
3 108 (6.14%) Amazon S3
4 103 (5.86%) Google Cloud Platform
5 56 (3.18%) GitHub
6 54 (3.07%) Amazon EC2
6 54 (3.07%) Amazon EMR
7 42 (2.39%) Cloud Computing
8 41 (2.33%) Serverless
9 40 (2.27%) Virtual Private Cloud
10 34 (1.93%) PaaS
11 33 (1.88%) Amazon Kinesis
12 27 (1.53%) Azure Data Factory
13 20 (1.14%) AWS Lambda
14 19 (1.08%) SaaS
15 16 (0.91%) Google Analytics
16 13 (0.74%) Data Lake Analytics
17 11 (0.63%) Heroku
18 9 (0.51%) IaaS
19 8 (0.45%) Azure Functions
Communications & Networking
1 76 (4.32%) Kerberos
2 44 (2.50%) HTTP
3 30 (1.71%) SSL
4 25 (1.42%) DNS
5 21 (1.19%) Firewall
6 18 (1.02%) TCP/IP
7 15 (0.85%) VPN
8 13 (0.74%) Internet
9 12 (0.68%) FTP
10 11 (0.63%) RTMP
11 7 (0.40%) WAN
12 6 (0.34%) SNA
13 5 (0.28%) HTTPS
13 5 (0.28%) ICMP
13 5 (0.28%) Intrusion Detection
13 5 (0.28%) Network Security
13 5 (0.28%) SMS
14 3 (0.17%) Intranet
14 3 (0.17%) Reverse Proxy
14 3 (0.17%) Unified Communications
Database & Business Intelligence
1 926 (52.64%) Hadoop
2 429 (24.39%) Apache Hive
3 309 (17.57%) NoSQL
4 296 (16.83%) HBase
5 256 (14.55%) Data Warehouse
6 207 (11.77%) SQL Server
7 180 (10.23%) Apache Cassandra
8 177 (10.06%) MongoDB
9 158 (8.98%) Relational Database
10 140 (7.96%) Data Lake
11 132 (7.50%) PostgreSQL
12 128 (7.28%) Impala
13 109 (6.20%) Sqoop
14 107 (6.08%) Amazon Redshift
15 84 (4.78%) Power BI
16 80 (4.55%) MySQL
17 72 (4.09%) OLAP
18 64 (3.64%) RDBMS
19 57 (3.24%) Enterprise Data Warehouse
20 55 (3.13%) Star Schema
Development Applications
1 239 (13.59%) Jenkins
2 163 (9.27%) Git (software)
3 124 (7.05%) JIRA
4 72 (4.09%) Maven
5 47 (2.67%) Visual Studio Team System
6 37 (2.10%) Bitbucket
7 34 (1.93%) Artifactory
7 34 (1.93%) Cucumber
8 26 (1.48%) Gradle
9 25 (1.42%) GitLab
10 23 (1.31%) Selenium
11 22 (1.25%) TeamCity
12 20 (1.14%) Sonatype Nexus
13 19 (1.08%) IntelliJ
14 17 (0.97%) Subversion
14 17 (0.97%) Visual Studio
15 15 (0.85%) JUnit
15 15 (0.85%) SpecFlow
16 13 (0.74%) gulp
16 13 (0.74%) Team Foundation Server
General
1 483 (27.46%) Finance
2 184 (10.46%) Banking
3 80 (4.55%) Retail
4 62 (3.52%) Marketing
5 54 (3.07%) Investment Banking
6 41 (2.33%) Telecoms
7 35 (1.99%) Front Office
7 35 (1.99%) Games
8 29 (1.65%) Legal
9 22 (1.25%) Manufacturing
10 15 (0.85%) Publishing
11 14 (0.80%) Advertising
11 14 (0.80%) Retail Banking
12 13 (0.74%) Financial Institution
13 10 (0.57%) Electronics
14 8 (0.45%) Back Office
15 7 (0.40%) Law
16 4 (0.23%) Pharmaceutical
17 3 (0.17%) Private Banking
18 2 (0.11%) Wholesale Banking
Job Titles
1 525 (29.85%) Developer
2 393 (22.34%) Data Engineer
3 297 (16.88%) Big Data Engineer
4 219 (12.45%) Architect
5 196 (11.14%) Java Developer
6 192 (10.92%) Big Data Developer
7 134 (7.62%) Data Architect
8 130 (7.39%) Hadoop Engineer
9 107 (6.08%) Analyst
10 92 (5.23%) Senior Developer
11 83 (4.72%) Big Data Architect
12 82 (4.66%) DevOps Engineer
13 81 (4.60%) Data Scientist
14 65 (3.70%) Consultant
15 64 (3.64%) Scala Developer
16 59 (3.35%) AWS Engineer
17 58 (3.30%) Java Engineer
17 58 (3.30%) Python Engineer
18 56 (3.18%) Senior Data Engineer
19 55 (3.13%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 515 (29.28%) Kafka
2 172 (9.78%) REST
3 102 (5.80%) HTML
4 95 (5.40%) Spring
5 86 (4.89%) AngularJS
6 83 (4.72%) JSON
7 79 (4.49%) Spring Boot
8 76 (4.32%) HTML5
9 73 (4.15%) Web Services
10 64 (3.64%) CSS
11 62 (3.52%) RESTful
12 50 (2.84%) Samza
13 49 (2.79%) .NET
13 49 (2.79%) Node.js
14 47 (2.67%) Spark Streaming
15 44 (2.50%) React
16 43 (2.44%) Hibernate
17 42 (2.39%) XML
18 39 (2.22%) SOAP
19 37 (2.10%) Natural Language Processing
Miscellaneous
1 185 (10.52%) Analytical Skills
2 140 (7.96%) Algorithms
3 89 (5.06%) Computer Science
4 75 (4.26%) Greenfield Project
5 58 (3.30%) User Experience
6 46 (2.62%) Data Structures
7 40 (2.27%) Self-Motivation
8 39 (2.22%) Fintech
8 39 (2.22%) Wiki
9 29 (1.65%) Data Centre
10 24 (1.36%) HoloLens
11 21 (1.19%) Derivative
12 20 (1.14%) Public Cloud
13 19 (1.08%) Hedge funds
14 16 (0.91%) Equity Derivative
15 15 (0.85%) Linux Command Line
15 15 (0.85%) Management Information System
16 14 (0.80%) Fixed Income
16 14 (0.80%) Mobile App
17 12 (0.68%) Virtual Team
Operating Systems
1 272 (15.46%) Linux
2 148 (8.41%) Unix
3 68 (3.87%) Windows
4 24 (1.36%) Ubuntu
5 22 (1.25%) Red Hat Enterprise Linux
6 13 (0.74%) CoreOS
7 12 (0.68%) CentOS
8 9 (0.51%) Android
9 7 (0.40%) Apple iOS
9 7 (0.40%) Windows Server
10 5 (0.28%) DC/OS
10 5 (0.28%) Windows Server 2008
11 4 (0.23%) Mesosphere
12 2 (0.11%) Windows 10
13 1 (0.057%) HPUX
13 1 (0.057%) Solaris
13 1 (0.057%) VMS
13 1 (0.057%) Windows 7
13 1 (0.057%) Windows XP
13 1 (0.057%) zOS
Processes & Methodologies
1 696 (39.57%) Agile Software Development
2 536 (30.47%) Analytics
3 354 (20.13%) Data Science
4 313 (17.79%) DevOps
5 280 (15.92%) Scrum
6 277 (15.75%) ETL
7 264 (15.01%) Machine Learning
8 241 (13.70%) Data Modelling
9 235 (13.36%) Business Intelligence
9 235 (13.36%) TDD
10 183 (10.40%) Continuous Integration
10 183 (10.40%) Microservices
11 175 (9.95%) Visualisation
12 174 (9.89%) Problem-Solving
13 144 (8.19%) Data Analytics
14 139 (7.90%) Open Source
15 135 (7.67%) BDD
16 133 (7.56%) Test Automation
17 122 (6.94%) Data Engineering
18 110 (6.25%) Data Analysis
Programming Languages
1 637 (36.21%) Python
2 620 (35.25%) Java
3 560 (31.84%) SQL
4 368 (20.92%) Scala
5 166 (9.44%) Java 8
6 134 (7.62%) R
7 133 (7.56%) JavaScript
8 110 (6.25%) Bash Shell
9 94 (5.34%) C#
10 61 (3.47%) Shell Script
11 54 (3.07%) Groovy
12 48 (2.73%) C++
13 46 (2.62%) Perl
13 46 (2.62%) PowerShell
14 40 (2.27%) Ruby
15 36 (2.05%) Korn
16 33 (1.88%) C
17 32 (1.82%) T-SQL
18 29 (1.65%) TypeScript
19 26 (1.48%) ES6
Qualifications
1 163 (9.27%) Security Cleared
2 150 (8.53%) SC Cleared
3 81 (4.60%) Degree
4 34 (1.93%) Computer Science Degree
5 33 (1.88%) PhD
6 21 (1.19%) DV Cleared
7 13 (0.74%) Numerate Degree
8 12 (0.68%) AWS Certification
9 9 (0.51%) Master's Degree
10 6 (0.34%) CISSP
10 6 (0.34%) CTC Cleared
11 5 (0.28%) TOGAF Certification
12 4 (0.23%) ISEB
12 4 (0.23%) MBA
12 4 (0.23%) Microsoft Certification
13 3 (0.17%) CEH
13 3 (0.17%) CISM
13 3 (0.17%) SANS
14 2 (0.11%) ISTQB
14 2 (0.11%) PMP
Quality Assurance & Compliance
1 129 (7.33%) Data Quality
2 60 (3.41%) QA
3 45 (2.56%) GCP
4 26 (1.48%) GDPR
5 8 (0.45%) MiFID
6 7 (0.40%) PMO
7 4 (0.23%) IFRS
7 4 (0.23%) IFRS 9
7 4 (0.23%) ISO/IEC 27001
8 3 (0.17%) EMIR
8 3 (0.17%) PSD2
8 3 (0.17%) SLA
9 2 (0.11%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
10 1 (0.057%) Actionable Recommendations
10 1 (0.057%) Dodd-Frank
System Software
1 245 (13.93%) Docker
2 202 (11.48%) HDFS
3 73 (4.15%) Apache Flume
4 39 (2.22%) Apache ZooKeeper
5 13 (0.74%) Active Directory
6 4 (0.23%) Ceph
6 4 (0.23%) Lustre
6 4 (0.23%) Virtual Machines
7 1 (0.057%) etcd
7 1 (0.057%) Hyper-V
7 1 (0.057%) KVM
7 1 (0.057%) OpenDJ
7 1 (0.057%) OpenIDM
7 1 (0.057%) Oracle RAC
7 1 (0.057%) Platform Symphony
7 1 (0.057%) vCloud
7 1 (0.057%) VirtualBox
7 1 (0.057%) VMware Infrastructure
7 1 (0.057%) Xen
7 1 (0.057%) XenApp
Systems Management
1 167 (9.49%) Ansible
2 155 (8.81%) Kubernetes
3 140 (7.96%) Oozie
4 108 (6.14%) Hadoop YARN
5 81 (4.60%) Terraform
6 80 (4.55%) Puppet
7 60 (3.41%) Opscode Chef
8 26 (1.48%) Mesos
9 21 (1.19%) Prometheus
10 20 (1.14%) Kibana
11 17 (0.97%) Ambari
12 15 (0.85%) Docker Swarm
12 15 (0.85%) Packer
13 13 (0.74%) Consul
13 13 (0.74%) logstash
14 10 (0.57%) Single Sign-On
15 8 (0.45%) Nagios
16 7 (0.40%) Salt
17 6 (0.34%) Sysdig
17 6 (0.34%) ZABBIX
Vendors
1 174 (9.89%) Cloudera
2 120 (6.82%) Oracle
3 114 (6.48%) Tableau
4 107 (6.08%) Hortonworks
5 105 (5.97%) Google
6 101 (5.74%) Microsoft
7 51 (2.90%) SAP
8 44 (2.50%) Splunk
9 41 (2.33%) Alteryx
9 41 (2.33%) Informatica
10 39 (2.22%) MapR
11 37 (2.10%) Talend
12 31 (1.76%) IBM
13 30 (1.71%) Red Hat
14 25 (1.42%) Salesforce.com
14 25 (1.42%) Teradata
15 18 (1.02%) Databricks
16 17 (0.97%) SaltStack
17 16 (0.91%) Centrify
17 16 (0.91%) Sybase