Period
to 19 October 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
19 Oct 2018
Same period 2017 Same period 2016
Rank 75 60 80
Rank change year-on-year -15 +20 +41
Contract jobs citing Big Data 1,614 1,772 1,407
As % of all contract IT jobs advertised in London 3.50% 3.93% 3.15%
As % of the Database & Business Intelligence category 14.12% 16.68% 13.71%
Number of daily rates quoted 1,204 1,318 985
London median daily rate £550 £550 £550
10th Percentile £425 £406 £413
90th Percentile £725 £700 £725
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 5 0 0
London median hourly rate £27.50 - -
England median hourly rate £42.25 £35.00 £43.00
% change year-on-year +20.71% -18.60% -1.71%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,434 10,622 10,265
As % of all contract IT jobs advertised in London 24.80% 23.58% 22.99%
Number of daily rates quoted 8,491 7,792 7,342
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £350 £313
90th Percentile £675 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 53 54 40
London median hourly rate £27.50 £26.88 £35.00
Median hourly rate % change year-on-year +2.30% -23.19% +55.56%
10th Percentile £16.85 £18.56 £15.25
90th Percentile £47.70 £58.75 £108.75
England median hourly rate £32.24 £30.50 £28.50
% change year-on-year +5.70% +7.02% +3.64%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 19 October 2018.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Big Data in London over the 6 months to 19 October 2018.

Contractor hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 19 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -12 319 £575 - 125
East London +23 81 £506 -22.12% 16
South London -29 77 £525 -2.78% 11
West London +26 49 £550 +10.00% 53
North London 0 4 £550 +10.00% 4
Big Data
England

For the 6 months to 19 October 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 801 (49.63%) Hadoop
2 620 (38.41%) Apache Spark
3 619 (38.35%) Agile Software Development
4 610 (37.79%) Python
5 583 (36.12%) Java
6 473 (29.31%) SQL
7 457 (28.31%) Kafka
8 448 (27.76%) Amazon AWS
9 445 (27.57%) Finance
10 430 (26.64%) Analytics
11 387 (23.98%) Apache Hive
12 311 (19.27%) Data Science
13 304 (18.84%) Scala
14 299 (18.53%) DevOps
15 269 (16.67%) Scrum
16 264 (16.36%) Jenkins
17 262 (16.23%) Docker
18 260 (16.11%) HBase
19 246 (15.24%) NoSQL
20 237 (14.68%) Linux
21 231 (14.31%) Business Intelligence
22 229 (14.19%) ETL
23 216 (13.38%) Machine Learning
24 210 (13.01%) Microsoft Azure
25 202 (12.52%) Ansible
25 202 (12.52%) TDD
26 196 (12.14%) Data Warehouse
27 193 (11.96%) HDFS
28 182 (11.28%) SQL Server
29 179 (11.09%) Data Modelling

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 620 (38.41%) Apache Spark
2 172 (10.66%) Elasticsearch
3 131 (8.12%) Apache
4 67 (4.15%) Apache Pig
5 60 (3.72%) Confluence
6 59 (3.66%) Apache Solr
7 34 (2.11%) SAS
8 20 (1.24%) Apache Airflow
9 12 (0.74%) Cloud Foundry
10 11 (0.68%) Tomcat
11 9 (0.56%) Oracle Coherence
12 8 (0.50%) Jupyter
13 7 (0.43%) Luigi
14 6 (0.37%) nginx
15 5 (0.31%) Oracle SOA Suite
16 4 (0.25%) IIS
16 4 (0.25%) SharePoint
16 4 (0.25%) WildFly
17 3 (0.19%) OpenStack
18 2 (0.12%) Jetty
Applications
1 58 (3.59%) Microsoft Excel
2 49 (3.04%) MS Visio
3 8 (0.50%) Microsoft Office
4 5 (0.31%) SPSS
5 4 (0.25%) Spreadsheet
6 3 (0.19%) Microsoft PowerPoint
7 2 (0.12%) Chatbot
7 2 (0.12%) GNU Octave
7 2 (0.12%) Microsoft Project
8 1 (0.062%) Open Workbench
8 1 (0.062%) Shockwave
Business Applications
1 22 (1.36%) SAP Oil and Gas
2 5 (0.31%) Markit EDM
2 5 (0.31%) SAP MM
3 4 (0.25%) SAP R/3
4 2 (0.12%) Dynamics CRM
4 2 (0.12%) PolarLake
4 2 (0.12%) Summit
5 1 (0.062%) Adobe Campaign
5 1 (0.062%) Cognos TM1
5 1 (0.062%) Distributed Ledger
5 1 (0.062%) Dynamics AX
5 1 (0.062%) Dynamics NAV
5 1 (0.062%) FastStats
5 1 (0.062%) IBM Operational Decision Manager
5 1 (0.062%) Payment Gateway
5 1 (0.062%) Salesforce.com CRM
5 1 (0.062%) SAP APO
5 1 (0.062%) SAP MDM
5 1 (0.062%) Unica
Cloud Services
1 448 (27.76%) Amazon AWS
2 210 (13.01%) Microsoft Azure
3 112 (6.94%) Amazon S3
4 109 (6.75%) Google Cloud Platform
5 63 (3.90%) Amazon EC2
6 62 (3.84%) Amazon EMR
7 58 (3.59%) GitHub
8 53 (3.28%) Virtual Private Cloud
9 43 (2.66%) Cloud Computing
10 41 (2.54%) Serverless
11 37 (2.29%) Amazon Kinesis
12 31 (1.92%) SaaS
13 30 (1.86%) PaaS
14 24 (1.49%) AWS Lambda
15 20 (1.24%) IaaS
16 13 (0.81%) Azure Data Factory
17 12 (0.74%) Heroku
18 10 (0.62%) AWS CloudFormation
19 8 (0.50%) Google Analytics
20 7 (0.43%) Amazon CloudWatch
Communications & Networking
1 56 (3.47%) Kerberos
2 40 (2.48%) HTTP
3 32 (1.98%) SSL
4 26 (1.61%) DNS
5 21 (1.30%) Firewall
5 21 (1.30%) TCP/IP
6 14 (0.87%) VPN
7 13 (0.81%) FTP
8 11 (0.68%) RTMP
9 9 (0.56%) HTTPS
9 9 (0.56%) Internet
9 9 (0.56%) WAN
10 7 (0.43%) Network Security
11 5 (0.31%) SNA
12 4 (0.25%) SMS
13 3 (0.19%) Intranet
13 3 (0.19%) Intrusion Detection
13 3 (0.19%) LAN
13 3 (0.19%) SAN
14 2 (0.12%) VLAN
Database & Business Intelligence
1 801 (49.63%) Hadoop
2 387 (23.98%) Apache Hive
3 260 (16.11%) HBase
4 246 (15.24%) NoSQL
5 196 (12.14%) Data Warehouse
6 182 (11.28%) SQL Server
7 153 (9.48%) Apache Cassandra
7 153 (9.48%) MongoDB
8 133 (8.24%) Impala
9 122 (7.56%) Relational Database
10 121 (7.50%) Data Lake
10 121 (7.50%) Sqoop
11 97 (6.01%) PostgreSQL
12 88 (5.45%) Amazon Redshift
13 85 (5.27%) Power BI
14 61 (3.78%) MySQL
15 60 (3.72%) SQL Server Integration Services
16 42 (2.60%) RDBMS
17 40 (2.48%) OLAP
18 34 (2.11%) Data Mining
Development Applications
1 264 (16.36%) Jenkins
2 157 (9.73%) Git (software)
3 126 (7.81%) JIRA
4 73 (4.52%) Maven
5 43 (2.66%) Bitbucket
6 38 (2.35%) Visual Studio Team System
7 31 (1.92%) Artifactory
8 27 (1.67%) Cucumber
8 27 (1.67%) Gradle
9 25 (1.55%) Sonatype Nexus
10 22 (1.36%) IntelliJ
11 21 (1.30%) Selenium
11 21 (1.30%) Visual Studio
12 20 (1.24%) GitLab
13 19 (1.18%) TeamCity
14 16 (0.99%) JUnit
15 15 (0.93%) gulp
16 11 (0.68%) Eclipse
16 11 (0.68%) Mocha
17 10 (0.62%) webpack
General
1 445 (27.57%) Finance
2 152 (9.42%) Banking
3 81 (5.02%) Retail
4 50 (3.10%) Investment Banking
5 48 (2.97%) Marketing
6 41 (2.54%) Front Office
7 34 (2.11%) Legal
8 33 (2.04%) Telecoms
9 24 (1.49%) Games
10 22 (1.36%) Publishing
11 21 (1.30%) Manufacturing
12 15 (0.93%) Advertising
13 12 (0.74%) Financial Institution
13 12 (0.74%) Retail Banking
14 7 (0.43%) Back Office
14 7 (0.43%) Electronics
15 6 (0.37%) Law
15 6 (0.37%) Pharmaceutical
16 2 (0.12%) Dutch Language
16 2 (0.12%) Wholesale Banking
Job Titles
1 461 (28.56%) Developer
2 328 (20.32%) Data Engineer
3 261 (16.17%) Big Data Engineer
4 216 (13.38%) Architect
5 189 (11.71%) Java Developer
6 139 (8.61%) Big Data Developer
7 126 (7.81%) Data Architect
8 101 (6.26%) DevOps Engineer
9 98 (6.07%) Hadoop Engineer
10 90 (5.58%) Senior Developer
11 78 (4.83%) Analyst
12 75 (4.65%) Big Data Architect
13 70 (4.34%) Data Scientist
14 63 (3.90%) Java Engineer
15 62 (3.84%) Consultant
16 60 (3.72%) Senior Java Developer
17 56 (3.47%) Platform Engineer
17 56 (3.47%) Senior Data Engineer
18 55 (3.41%) Python Engineer
19 49 (3.04%) Solutions Architect
Libraries, Frameworks & Software Standards
1 457 (28.31%) Kafka
2 147 (9.11%) REST
3 96 (5.95%) Spring
4 82 (5.08%) AngularJS
5 76 (4.71%) Spring Boot
6 74 (4.58%) HTML
6 74 (4.58%) Web Services
7 61 (3.78%) CSS
8 58 (3.59%) JSON
9 51 (3.16%) Node.js
10 50 (3.10%) HTML5
10 50 (3.10%) RESTful
11 48 (2.97%) Spark Streaming
12 47 (2.91%) .NET
13 44 (2.73%) React
14 33 (2.04%) Samza
15 32 (1.98%) PySpark
16 30 (1.86%) Hibernate
16 30 (1.86%) TensorFlow
17 29 (1.80%) OAuth
Miscellaneous
1 140 (8.67%) Analytical Skills
2 123 (7.62%) Algorithms
3 102 (6.32%) Greenfield Project
4 85 (5.27%) Computer Science
5 52 (3.22%) Wiki
6 49 (3.04%) Fintech
7 46 (2.85%) User Experience
8 33 (2.04%) Self-Motivation
9 32 (1.98%) Data Structures
10 28 (1.73%) Data Centre
11 16 (0.99%) HoloLens
12 15 (0.93%) Derivative
12 15 (0.93%) Foreign Exchange (FX)
12 15 (0.93%) Management Information System
12 15 (0.93%) Market Risk
12 15 (0.93%) PKI
13 14 (0.87%) Equities
14 13 (0.81%) Fixed Income
14 13 (0.81%) Virtual Team
15 11 (0.68%) Public Cloud
Operating Systems
1 237 (14.68%) Linux
2 151 (9.36%) Unix
3 77 (4.77%) Windows
4 19 (1.18%) Ubuntu
5 13 (0.81%) Red Hat Enterprise Linux
6 10 (0.62%) CoreOS
7 8 (0.50%) Android
7 8 (0.50%) CentOS
8 6 (0.37%) Apple iOS
9 4 (0.25%) Mesosphere
10 3 (0.19%) DC/OS
10 3 (0.19%) Windows Server
11 2 (0.12%) Windows 10
12 1 (0.062%) AIX
12 1 (0.062%) HPUX
12 1 (0.062%) Mac OS X
12 1 (0.062%) Oracle Linux
12 1 (0.062%) Solaris
12 1 (0.062%) VMS
12 1 (0.062%) Windows 7
Processes & Methodologies
1 619 (38.35%) Agile Software Development
2 430 (26.64%) Analytics
3 311 (19.27%) Data Science
4 299 (18.53%) DevOps
5 269 (16.67%) Scrum
6 231 (14.31%) Business Intelligence
7 229 (14.19%) ETL
8 216 (13.38%) Machine Learning
9 202 (12.52%) TDD
10 179 (11.09%) Data Modelling
11 164 (10.16%) Continuous Integration
12 156 (9.67%) Microservices
13 141 (8.74%) Open Source
13 141 (8.74%) Visualisation
14 135 (8.36%) Test Automation
15 133 (8.24%) Data Analytics
16 120 (7.43%) BDD
17 115 (7.13%) Problem-Solving
18 114 (7.06%) Software Engineering
19 108 (6.69%) Data Analysis
Programming Languages
1 610 (37.79%) Python
2 583 (36.12%) Java
3 473 (29.31%) SQL
4 304 (18.84%) Scala
5 151 (9.36%) Java 8
6 123 (7.62%) JavaScript
7 118 (7.31%) Bash Shell
8 108 (6.69%) R
9 74 (4.58%) C#
10 69 (4.28%) Shell Script
11 58 (3.59%) PowerShell
12 51 (3.16%) Groovy
13 48 (2.97%) Korn
14 39 (2.42%) T-SQL
15 38 (2.35%) C++
16 35 (2.17%) Ruby
17 30 (1.86%) TypeScript
18 27 (1.67%) Perl
19 25 (1.55%) ES6
20 24 (1.49%) MATLAB
Qualifications
1 140 (8.67%) Security Cleared
2 130 (8.05%) SC Cleared
3 78 (4.83%) Degree
4 35 (2.17%) Computer Science Degree
5 31 (1.92%) PhD
6 17 (1.05%) Master's Degree
7 12 (0.74%) AWS Certification
8 11 (0.68%) CISSP
9 10 (0.62%) DV Cleared
10 7 (0.43%) PMI Certification
11 6 (0.37%) CEH
11 6 (0.37%) CISM
12 5 (0.31%) Microsoft Certification
12 5 (0.31%) Numerate Degree
12 5 (0.31%) SANS
13 4 (0.25%) MBA
14 3 (0.19%) CTC Cleared
14 3 (0.19%) ISEB
14 3 (0.19%) PMP
14 3 (0.19%) TOGAF Certification
Quality Assurance & Compliance
1 69 (4.28%) Data Quality
2 48 (2.97%) QA
3 19 (1.18%) GDPR
4 8 (0.50%) PMO
5 6 (0.37%) ISO/IEC 27001
6 5 (0.31%) MiFID
7 4 (0.25%) PSD2
8 3 (0.19%) EMIR
9 2 (0.12%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
9 2 (0.12%) SLA
10 1 (0.062%) Dodd-Frank
System Software
1 262 (16.23%) Docker
2 193 (11.96%) HDFS
3 67 (4.15%) Apache Flume
4 34 (2.11%) Apache ZooKeeper
5 13 (0.81%) Active Directory
6 4 (0.25%) Oracle RAC
6 4 (0.25%) Virtual Machines
7 3 (0.19%) Hyper-V
8 2 (0.12%) LXC
8 2 (0.12%) VMware Infrastructure
8 2 (0.12%) XenApp
9 1 (0.062%) Ceph
9 1 (0.062%) Lustre
9 1 (0.062%) OpenDJ
9 1 (0.062%) OpenIDM
9 1 (0.062%) vCloud
9 1 (0.062%) Virtual Desktop
9 1 (0.062%) VirtualBox
9 1 (0.062%) vSphere
9 1 (0.062%) XenDesktop
Systems Management
1 202 (12.52%) Ansible
2 169 (10.47%) Kubernetes
3 129 (7.99%) Hadoop YARN
4 105 (6.51%) Puppet
5 103 (6.38%) Oozie
6 96 (5.95%) Terraform
7 82 (5.08%) Opscode Chef
8 19 (1.18%) Kibana
9 17 (1.05%) logstash
10 16 (0.99%) Docker Swarm
11 15 (0.93%) Mesos
11 15 (0.93%) Prometheus
12 13 (0.81%) Ambari
13 10 (0.62%) Packer
14 8 (0.50%) Nagios
15 6 (0.37%) ArcSight ESM
15 6 (0.37%) ZABBIX
16 5 (0.31%) Consul
16 5 (0.31%) Control-M
16 5 (0.31%) Single Sign-On
Vendors
1 167 (10.35%) Cloudera
2 131 (8.12%) Oracle
3 121 (7.50%) Tableau
4 109 (6.75%) Hortonworks
5 103 (6.38%) Google
6 96 (5.95%) Microsoft
7 59 (3.66%) Splunk
8 43 (2.66%) SAP
9 41 (2.54%) Informatica
10 35 (2.17%) Talend
11 30 (1.86%) Alteryx
11 30 (1.86%) MapR
12 26 (1.61%) IBM
13 24 (1.49%) Red Hat
14 22 (1.36%) Teradata
15 16 (0.99%) Databricks
15 16 (0.99%) Salesforce.com
16 14 (0.87%) Ab Initio
17 13 (0.81%) Greenplum
17 13 (0.81%) SaltStack