Period
to 22 May 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 May 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
22 May 2018
Same period 2017 Same period 2016
Rank 62 54 101
Rank change year-on-year -8 +47 +29
Contract jobs citing Big Data 1,757 1,602 1,071
As % of all contract IT jobs advertised in London 3.85% 4.07% 2.47%
As % of the Database & Business Intelligence category 15.51% 16.70% 10.48%
Number of daily rates quoted 1,289 1,146 795
London median daily rate £563 £550 £550
Median daily rate % change year-on-year +2.27% - -
10th Percentile £425 £386 £375
90th Percentile £701 £700 £700
England median daily rate £550 £525 £525
% change year-on-year +4.76% - -
Number of hourly rates quoted 0 1 4
London median hourly rate - £40.00 £24.25
Median hourly rate % change year-on-year - +64.95% -11.22%
England median hourly rate £45.00 £47.00 £24.25
% change year-on-year -4.26% +93.81% -5.91%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,327 9,595 10,219
As % of all contract IT jobs advertised in London 24.85% 24.39% 23.58%
Number of daily rates quoted 8,524 6,935 7,385
London median daily rate £513 £490 £475
Median daily rate % change year-on-year +4.59% +3.16% +5.56%
10th Percentile £355 £325 £313
90th Percentile £663 £650 £638
England median daily rate £475 £445 £425
% change year-on-year +6.74% +4.71% +6.25%
Number of hourly rates quoted 75 40 64
London median hourly rate £30.00 £33.25 £27.50
Median hourly rate % change year-on-year -9.77% +20.91% -8.33%
10th Percentile £20.25 £18.35 £16.32
90th Percentile £44.92 £47.05 £100.00
England median hourly rate £30.00 £30.00 £27.50
% change year-on-year - +9.09% -4.15%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 22 May 2018.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 22 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -10 334 £550 - 109
South London -2 79 £550 +22.22% 3
East London +9 55 £563 -5.26% 24
West London -26 42 £525 +10.53% 46
North London -1 5 £550 +4.76% 2
Big Data
England

For the 6 months to 22 May 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 885 (50.37%) Hadoop
2 677 (38.53%) Apache Spark
3 651 (37.05%) Agile Software Development
4 631 (35.91%) Python
5 592 (33.69%) Java
6 567 (32.27%) Analytics
7 550 (31.30%) SQL
8 462 (26.29%) Kafka
9 453 (25.78%) Finance
10 428 (24.36%) Amazon AWS
11 404 (22.99%) Scala
12 396 (22.54%) Apache Hive
13 335 (19.07%) Data Science
14 327 (18.61%) NoSQL
15 300 (17.07%) ETL
16 295 (16.79%) Data Warehouse
17 293 (16.68%) DevOps
18 292 (16.62%) Machine Learning
19 272 (15.48%) Linux
20 260 (14.80%) Data Modelling
21 257 (14.63%) HBase
22 229 (13.03%) Scrum
22 229 (13.03%) Banking
23 227 (12.92%) Docker
24 224 (12.75%) Microsoft Azure
25 217 (12.35%) Business Intelligence
26 201 (11.44%) SQL Server
27 194 (11.04%) TDD
28 193 (10.98%) Data Analytics
29 192 (10.93%) Analytical Skills

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 677 (38.53%) Apache Spark
2 181 (10.30%) Apache
3 125 (7.11%) Elasticsearch
4 85 (4.84%) Apache Pig
5 53 (3.02%) SAS
6 49 (2.79%) Apache Solr
6 49 (2.79%) Confluence
7 32 (1.82%) nginx
8 29 (1.65%) Tomcat
9 14 (0.80%) Apache Airflow
9 14 (0.80%) SharePoint
10 13 (0.74%) OpenStack
11 10 (0.57%) WebSphere
12 8 (0.46%) Jupyter
13 5 (0.28%) CMS
13 5 (0.28%) Oracle Coherence
14 4 (0.23%) IIS
14 4 (0.23%) WildFly
15 3 (0.17%) Luigi
15 3 (0.17%) Oracle SOA Suite
Applications
1 40 (2.28%) Microsoft Excel
2 10 (0.57%) Microsoft PowerPoint
2 10 (0.57%) MS Visio
3 9 (0.51%) Microsoft Office
4 8 (0.46%) SPSS
5 7 (0.40%) Spreadsheet
6 3 (0.17%) Adobe Illustrator
6 3 (0.17%) HipChat
6 3 (0.17%) InVision
7 2 (0.11%) Microsoft Project
8 1 (0.057%) Shockwave
8 1 (0.057%) Stata
Business Applications
1 21 (1.20%) SAP Oil and Gas
2 4 (0.23%) HiPortfolio
2 4 (0.23%) Markit EDM
2 4 (0.23%) Summit
3 3 (0.17%) Eloqua
3 3 (0.17%) ION MarketView
4 2 (0.11%) Adobe Campaign
4 2 (0.11%) FastStats
4 2 (0.11%) Relativity
4 2 (0.11%) Salesforce.com CRM
4 2 (0.11%) Unica
5 1 (0.057%) Actimize
5 1 (0.057%) Dynamics CRM
5 1 (0.057%) Finacle
5 1 (0.057%) FLEXCUBE
5 1 (0.057%) Oracle Procure-to-Pay
5 1 (0.057%) PolarLake
5 1 (0.057%) Revive Adserver
5 1 (0.057%) SAP Hybris
5 1 (0.057%) Temenos T24
Cloud Services
1 428 (24.36%) Amazon AWS
2 224 (12.75%) Microsoft Azure
3 80 (4.55%) Google Cloud Platform
4 64 (3.64%) Amazon S3
5 53 (3.02%) Amazon Kinesis
6 48 (2.73%) Serverless
7 41 (2.33%) Amazon EMR
8 33 (1.88%) Amazon EC2
9 29 (1.65%) PaaS
10 27 (1.54%) AWS Lambda
10 27 (1.54%) Azure Data Factory
10 27 (1.54%) Cloud Computing
10 27 (1.54%) GitHub
11 26 (1.48%) Virtual Private Cloud
12 21 (1.20%) Google Analytics
13 18 (1.02%) Amazon CloudWatch
13 18 (1.02%) AWS CloudTrail
13 18 (1.02%) SaaS
14 16 (0.91%) Data Lake Analytics
15 13 (0.74%) IaaS
Communications & Networking
1 63 (3.59%) Kerberos
2 32 (1.82%) HTTP
3 22 (1.25%) SSL
4 20 (1.14%) Firewall
5 16 (0.91%) DNS
6 15 (0.85%) VPN
7 14 (0.80%) Internet
8 10 (0.57%) TCP/IP
9 7 (0.40%) Intrusion Detection
9 7 (0.40%) WAN
10 6 (0.34%) ICMP
11 4 (0.23%) Network Security
12 3 (0.17%) RTMP
12 3 (0.17%) SMS
12 3 (0.17%) VLAN
13 2 (0.11%) FIX Connectivity
13 2 (0.11%) LAN
13 2 (0.11%) Multicast
13 2 (0.11%) Reverse Proxy
13 2 (0.11%) SMTP
Database & Business Intelligence
1 885 (50.37%) Hadoop
2 396 (22.54%) Apache Hive
3 327 (18.61%) NoSQL
4 295 (16.79%) Data Warehouse
5 257 (14.63%) HBase
6 201 (11.44%) SQL Server
7 177 (10.07%) Apache Cassandra
8 173 (9.85%) MongoDB
9 156 (8.88%) Data Lake
9 156 (8.88%) Relational Database
10 148 (8.42%) PostgreSQL
11 112 (6.37%) Amazon Redshift
12 106 (6.03%) MySQL
13 102 (5.81%) Impala
14 72 (4.10%) Sqoop
15 68 (3.87%) Power BI
16 64 (3.64%) Star Schema
17 63 (3.59%) OLAP
18 60 (3.41%) RDBMS
19 58 (3.30%) Enterprise Data Warehouse
Development Applications
1 165 (9.39%) Jenkins
2 121 (6.89%) Git (software)
3 88 (5.01%) JIRA
4 49 (2.79%) Maven
5 31 (1.76%) Visual Studio Team System
6 28 (1.59%) Cucumber
6 28 (1.59%) Selenium
7 26 (1.48%) JUnit
8 25 (1.42%) Subversion
9 24 (1.37%) Visual Studio
10 23 (1.31%) TeamCity
11 21 (1.20%) Team Foundation Server
12 20 (1.14%) Artifactory
12 20 (1.14%) SpecFlow
13 18 (1.02%) GitLab
14 13 (0.74%) Vagrant
15 11 (0.63%) SonarQube
16 10 (0.57%) ERwin
17 8 (0.46%) Bitbucket
17 8 (0.46%) NUnit
General
1 453 (25.78%) Finance
2 229 (13.03%) Banking
3 90 (5.12%) Retail
4 77 (4.38%) Investment Banking
5 76 (4.33%) Marketing
6 51 (2.90%) Games
7 44 (2.50%) Telecoms
8 35 (1.99%) Front Office
9 30 (1.71%) Manufacturing
10 15 (0.85%) Legal
11 12 (0.68%) Retail Banking
12 11 (0.63%) Advertising
12 11 (0.63%) Financial Institution
13 10 (0.57%) Law
13 10 (0.57%) Publishing
14 8 (0.46%) Electronics
15 7 (0.40%) Back Office
16 6 (0.34%) French Language
17 5 (0.28%) Automotive
17 5 (0.28%) Pharmaceutical
Job Titles
1 489 (27.83%) Developer
2 385 (21.91%) Data Engineer
3 266 (15.14%) Big Data Engineer
4 264 (15.03%) Architect
5 182 (10.36%) Big Data Developer
6 156 (8.88%) Data Architect
7 154 (8.76%) Java Developer
8 118 (6.72%) Analyst
8 118 (6.72%) Hadoop Engineer
9 92 (5.24%) Big Data Architect
10 91 (5.18%) DevOps Engineer
11 86 (4.89%) Data Scientist
12 81 (4.61%) Senior Developer
13 76 (4.33%) Scala Developer
14 65 (3.70%) AWS Engineer
15 64 (3.64%) Consultant
16 62 (3.53%) Solutions Architect
17 56 (3.19%) Data Analyst
18 54 (3.07%) Python Engineer
19 48 (2.73%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 462 (26.29%) Kafka
2 123 (7.00%) REST
3 90 (5.12%) Web Services
4 82 (4.67%) HTML
5 80 (4.55%) JSON
6 69 (3.93%) AngularJS
7 68 (3.87%) Spring
8 65 (3.70%) HTML5
9 63 (3.59%) RESTful
10 61 (3.47%) .NET
11 51 (2.90%) XML
12 50 (2.85%) React
13 47 (2.68%) Spark Streaming
14 45 (2.56%) CSS
15 44 (2.50%) Akka
16 41 (2.33%) Hibernate
17 40 (2.28%) Spring Boot
18 38 (2.16%) Node.js
19 35 (1.99%) Samza
20 34 (1.94%) JMS
Miscellaneous
1 192 (10.93%) Analytical Skills
2 115 (6.55%) Computer Science
3 108 (6.15%) Algorithms
4 63 (3.59%) Greenfield Project
5 56 (3.19%) User Experience
6 53 (3.02%) Data Structures
7 42 (2.39%) Fintech
8 34 (1.94%) Data Centre
9 28 (1.59%) Self-Motivation
10 25 (1.42%) Public Cloud
11 23 (1.31%) Management Information System
12 22 (1.25%) Hedge funds
13 20 (1.14%) Derivative
14 19 (1.08%) Linux Command Line
15 17 (0.97%) Foreign Exchange (FX)
16 16 (0.91%) Cyberthreat
16 16 (0.91%) Enterprise Software
16 16 (0.91%) Virtual Team
17 15 (0.85%) Market Risk
17 15 (0.85%) Mobile App
Operating Systems
1 272 (15.48%) Linux
2 112 (6.37%) Unix
3 61 (3.47%) Windows
4 33 (1.88%) Red Hat Enterprise Linux
5 23 (1.31%) Ubuntu
6 13 (0.74%) CentOS
7 12 (0.68%) Windows Server
8 11 (0.63%) CoreOS
9 8 (0.46%) Android
9 8 (0.46%) Windows Server 2008
10 7 (0.40%) Apple iOS
11 6 (0.34%) DC/OS
12 3 (0.17%) Windows 10
13 2 (0.11%) Debian
13 2 (0.11%) Windows 7
14 1 (0.057%) Mesosphere
14 1 (0.057%) VMS
14 1 (0.057%) Windows XP
Processes & Methodologies
1 651 (37.05%) Agile Software Development
2 567 (32.27%) Analytics
3 335 (19.07%) Data Science
4 300 (17.07%) ETL
5 293 (16.68%) DevOps
6 292 (16.62%) Machine Learning
7 260 (14.80%) Data Modelling
8 229 (13.03%) Scrum
9 217 (12.35%) Business Intelligence
10 194 (11.04%) TDD
11 193 (10.98%) Data Analytics
12 178 (10.13%) Visualisation
13 169 (9.62%) Problem-Solving
14 159 (9.05%) Continuous Integration
15 150 (8.54%) Microservices
16 140 (7.97%) Open Source
17 136 (7.74%) Data Engineering
18 117 (6.66%) Data Architecture
19 115 (6.55%) Stakeholder Management
20 109 (6.20%) Test Automation
Programming Languages
1 631 (35.91%) Python
2 592 (33.69%) Java
3 550 (31.30%) SQL
4 404 (22.99%) Scala
5 148 (8.42%) R
6 145 (8.25%) JavaScript
7 132 (7.51%) Java 8
8 111 (6.32%) C#
9 81 (4.61%) Bash Shell
10 59 (3.36%) Perl
11 44 (2.50%) C++
11 44 (2.50%) Shell Script
12 38 (2.16%) Ruby
13 36 (2.05%) Go
13 36 (2.05%) Groovy
13 36 (2.05%) PowerShell
14 32 (1.82%) C
15 31 (1.76%) T-SQL
16 17 (0.97%) PHP
17 14 (0.80%) TypeScript
Qualifications
1 153 (8.71%) Security Cleared
2 136 (7.74%) SC Cleared
3 108 (6.15%) Degree
4 37 (2.11%) Computer Science Degree
5 25 (1.42%) DV Cleared
6 23 (1.31%) PhD
7 22 (1.25%) Numerate Degree
8 16 (0.91%) Master's Degree
9 8 (0.46%) CTC Cleared
10 7 (0.40%) TOGAF Certification
11 4 (0.23%) CISSP
12 3 (0.17%) AWS Certification
12 3 (0.17%) BPSS Clearance
12 3 (0.17%) ISEB
12 3 (0.17%) ISTQB
13 2 (0.11%) CISM
13 2 (0.11%) IISP
13 2 (0.11%) Microsoft Certification
13 2 (0.11%) PMI Certification
14 1 (0.057%) MBA
Quality Assurance & Compliance
1 145 (8.25%) Data Quality
2 66 (3.76%) QA
3 32 (1.82%) GDPR
4 26 (1.48%) GCP
5 14 (0.80%) MiFID
6 8 (0.46%) IFRS
6 8 (0.46%) IFRS 9
7 6 (0.34%) EMIR
8 5 (0.28%) Dodd-Frank
8 5 (0.28%) SLA
9 4 (0.23%) GAAP
9 4 (0.23%) PMO
10 2 (0.11%) ISO/IEC 27001
10 2 (0.11%) Sarbanes-Oxley
11 1 (0.057%) Actionable Recommendations
11 1 (0.057%) Basel III
11 1 (0.057%) Disclosure Scotland
11 1 (0.057%) HL7
11 1 (0.057%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
11 1 (0.057%) PSD2
System Software
1 227 (12.92%) Docker
2 162 (9.22%) HDFS
3 87 (4.95%) Apache Flume
4 42 (2.39%) Apache ZooKeeper
5 19 (1.08%) Active Directory
6 8 (0.46%) VMware Infrastructure
7 5 (0.28%) Ceph
7 5 (0.28%) Virtual Machines
8 4 (0.23%) Lustre
8 4 (0.23%) NFS
9 3 (0.17%) OpenDJ
9 3 (0.17%) OpenIDM
9 3 (0.17%) vCloud
10 2 (0.11%) KVM
10 2 (0.11%) VMware NSX
10 2 (0.11%) vSphere
11 1 (0.057%) Platform Symphony
11 1 (0.057%) RHEV
11 1 (0.057%) Samba
11 1 (0.057%) Xen
Systems Management
1 136 (7.74%) Oozie
2 129 (7.34%) Ansible
3 105 (5.98%) Kubernetes
4 75 (4.27%) Hadoop YARN
5 65 (3.70%) Terraform
6 51 (2.90%) Puppet
7 33 (1.88%) Mesos
7 33 (1.88%) Opscode Chef
8 19 (1.08%) Salt
9 17 (0.97%) Ambari
10 14 (0.80%) Consul
11 11 (0.63%) Kibana
11 11 (0.63%) Rancher
12 10 (0.57%) Nagios
13 9 (0.51%) ITRS Geneos
14 8 (0.46%) Packer
14 8 (0.46%) Prometheus
15 7 (0.40%) Host Intrusion Detection System
15 7 (0.40%) Network Intrusion Detection System
15 7 (0.40%) Sysdig
Vendors
1 162 (9.22%) Cloudera
2 141 (8.03%) Microsoft
3 126 (7.17%) Oracle
4 108 (6.15%) Hortonworks
5 105 (5.98%) Tableau
6 96 (5.46%) Google
7 68 (3.87%) Splunk
8 53 (3.02%) SAP
9 47 (2.68%) MapR
10 44 (2.50%) Talend
11 40 (2.28%) Informatica
12 30 (1.71%) Alteryx
13 29 (1.65%) Salesforce.com
13 29 (1.65%) Teradata
14 27 (1.54%) IBM
15 26 (1.48%) SaltStack
16 20 (1.14%) Red Hat
17 18 (1.02%) Sybase
18 15 (0.85%) AlienVault
19 14 (0.80%) Atlassian