Period
to 16 December 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 16 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
16 Dec 2018
Same period 2017 Same period 2016
Rank 75 69 61
Rank change year-on-year -6 -8 +36
Contract jobs citing Big Data 1,610 1,762 1,702
As % of all contract IT jobs advertised in London 3.46% 3.73% 3.83%
As % of the Database & Business Intelligence category 14.21% 15.81% 16.23%
Number of daily rates quoted 1,219 1,298 1,148
London median daily rate £563 £550 £550
Median daily rate % change year-on-year +2.27% - -
10th Percentile £425 £411 £411
90th Percentile £725 £700 £713
England median daily rate £550 £550 £525
% change year-on-year - +4.76% +0.96%
Number of hourly rates quoted 4 0 1
London median hourly rate £45.00 - £100.00
10th Percentile £31.13 - £90.00
90th Percentile £54.50 - £110.00
England median hourly rate £45.00 £30.91 £43.00
% change year-on-year +45.61% -28.13% -7.53%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,332 11,147 10,486
As % of all contract IT jobs advertised in London 24.38% 23.61% 23.58%
Number of daily rates quoted 8,445 8,319 7,401
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £353 £325
90th Percentile £675 £663 £638
England median daily rate £475 £463 £425
% change year-on-year +2.70% +8.82% +1.19%
Number of hourly rates quoted 48 64 42
London median hourly rate £27.62 £26.97 £32.25
Median hourly rate % change year-on-year +2.40% -16.38% +44.94%
10th Percentile £18.35 £18.08 £15.25
90th Percentile £50.50 £58.75 £65.00
England median hourly rate £32.50 £32.75 £27.75
% change year-on-year -0.76% +18.02% +0.91%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 16 December 2018.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Big Data in London over the 6 months to 16 December 2018.

Contractor hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 16 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -1 322 £575 - 114
South London -30 82 £525 -4.55% 7
East London +14 75 £525 -12.50% 31
West London +44 55 £550 +6.80% 64
North London - 9 £663 - 1
Big Data
England

For the 6 months to 16 December 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 753 (46.77%) Hadoop
2 614 (38.14%) Python
3 588 (36.52%) Apache Spark
4 568 (35.28%) Agile Software Development
5 562 (34.91%) Java
6 475 (29.50%) Amazon AWS
7 464 (28.82%) SQL
8 448 (27.83%) Kafka
9 444 (27.58%) Analytics
10 407 (25.28%) Finance
11 374 (23.23%) Apache Hive
12 319 (19.81%) Data Science
13 297 (18.45%) DevOps
14 280 (17.39%) Docker
15 265 (16.46%) Scala
16 264 (16.40%) Jenkins
17 257 (15.96%) Microsoft Azure
18 238 (14.78%) ETL
19 234 (14.53%) HBase
20 227 (14.10%) Machine Learning
21 226 (14.04%) Business Intelligence
22 220 (13.66%) Scrum
23 213 (13.23%) NoSQL
24 209 (12.98%) Data Warehouse
25 208 (12.92%) Linux
26 202 (12.55%) Ansible
27 201 (12.48%) Cloudera
28 196 (12.17%) Data Modelling
29 180 (11.18%) Kubernetes
30 175 (10.87%) Analytical Skills

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 588 (36.52%) Apache Spark
2 173 (10.75%) Elasticsearch
3 128 (7.95%) Apache
4 59 (3.66%) Confluence
5 54 (3.35%) Apache Pig
6 43 (2.67%) SAS
7 40 (2.48%) Apache Solr
8 20 (1.24%) Apache Airflow
9 15 (0.93%) Oracle Coherence
10 12 (0.75%) Cloud Foundry
10 12 (0.75%) Tomcat
11 10 (0.62%) nginx
12 8 (0.50%) Oracle SOA Suite
13 7 (0.43%) Luigi
14 6 (0.37%) WebSphere
15 5 (0.31%) Jupyter
16 4 (0.25%) Appian
17 3 (0.19%) CMS
17 3 (0.19%) SharePoint
18 2 (0.12%) IIS
Applications
1 44 (2.73%) Microsoft Excel
2 38 (2.36%) MS Visio
3 9 (0.56%) Microsoft Office
4 6 (0.37%) Chatbot
5 3 (0.19%) Spreadsheet
5 3 (0.19%) SPSS
6 2 (0.12%) GNU Octave
7 1 (0.062%) LaTeX
7 1 (0.062%) Microsoft PowerPoint
7 1 (0.062%) Microsoft Project
7 1 (0.062%) Open Workbench
Business Applications
1 21 (1.30%) SAP Oil and Gas
2 5 (0.31%) SAP MM
3 4 (0.25%) IBM Operational Decision Manager
3 4 (0.25%) SAP R/3
4 2 (0.12%) Dynamics CRM
4 2 (0.12%) Dynamics NAV
4 2 (0.12%) Markit EDM
4 2 (0.12%) PolarLake
5 1 (0.062%) Distributed Ledger
5 1 (0.062%) Dynamics AX
5 1 (0.062%) Remedy ITSM
5 1 (0.062%) SAP APO
5 1 (0.062%) SAP MDG
5 1 (0.062%) SAP MDM
5 1 (0.062%) Summit
5 1 (0.062%) WebTrends
Cloud Services
1 475 (29.50%) Amazon AWS
2 257 (15.96%) Microsoft Azure
3 142 (8.82%) Google Cloud Platform
4 94 (5.84%) Amazon S3
5 75 (4.66%) Amazon EMR
6 58 (3.60%) Amazon EC2
7 52 (3.23%) GitHub
8 42 (2.61%) Virtual Private Cloud
9 37 (2.30%) SaaS
10 31 (1.93%) PaaS
11 29 (1.80%) IaaS
12 28 (1.74%) Amazon Kinesis
12 28 (1.74%) Serverless
13 27 (1.68%) Cloud Computing
14 23 (1.43%) Heroku
15 22 (1.37%) AWS Lambda
16 21 (1.30%) Azure Data Factory
17 18 (1.12%) AWS CloudFormation
18 12 (0.75%) Data Lake Analytics
19 11 (0.68%) Amazon CloudWatch
Communications & Networking
1 36 (2.24%) Kerberos
2 33 (2.05%) HTTP
3 29 (1.80%) DNS
3 29 (1.80%) SSL
4 27 (1.68%) TCP/IP
5 17 (1.06%) Firewall
5 17 (1.06%) FTP
6 15 (0.93%) VPN
7 10 (0.62%) Internet
8 9 (0.56%) HTTPS
9 8 (0.50%) Network Security
10 6 (0.37%) DSL
10 6 (0.37%) WAN
11 5 (0.31%) LAN
12 4 (0.25%) SAN
12 4 (0.25%) SMS
12 4 (0.25%) SNA
13 3 (0.19%) AMQP
13 3 (0.19%) ICMP
14 2 (0.12%) Unified Communications
Database & Business Intelligence
1 753 (46.77%) Hadoop
2 374 (23.23%) Apache Hive
3 234 (14.53%) HBase
4 213 (13.23%) NoSQL
5 209 (12.98%) Data Warehouse
6 158 (9.81%) Apache Cassandra
6 158 (9.81%) SQL Server
7 150 (9.32%) MongoDB
8 137 (8.51%) Data Lake
9 124 (7.70%) Impala
10 113 (7.02%) Relational Database
11 97 (6.02%) Sqoop
12 95 (5.90%) Power BI
13 78 (4.84%) SQL Server Integration Services
14 75 (4.66%) Amazon Redshift
15 73 (4.53%) PostgreSQL
16 61 (3.79%) MySQL
17 41 (2.55%) OLAP
18 38 (2.36%) Presto
18 38 (2.36%) Redis
Development Applications
1 264 (16.40%) Jenkins
2 161 (10.00%) Git (software)
3 123 (7.64%) JIRA
4 59 (3.66%) Maven
5 40 (2.48%) Bitbucket
6 37 (2.30%) Visual Studio Team System
7 32 (1.99%) Artifactory
8 27 (1.68%) GitLab
8 27 (1.68%) Gradle
9 26 (1.61%) Cucumber
9 26 (1.61%) Sonatype Nexus
10 22 (1.37%) Selenium
11 20 (1.24%) gulp
12 19 (1.18%) TeamCity
13 18 (1.12%) Visual Studio
14 15 (0.93%) JUnit
15 14 (0.87%) IntelliJ
16 10 (0.62%) CircleCI
17 9 (0.56%) ERwin
17 9 (0.56%) Travis CI
General
1 407 (25.28%) Finance
2 136 (8.45%) Banking
3 101 (6.27%) Retail
4 54 (3.35%) Legal
5 51 (3.17%) Front Office
6 46 (2.86%) Marketing
7 36 (2.24%) Telecoms
8 33 (2.05%) Investment Banking
9 28 (1.74%) Publishing
10 19 (1.18%) Games
10 19 (1.18%) Manufacturing
11 18 (1.12%) Advertising
12 15 (0.93%) Financial Institution
13 9 (0.56%) Automotive
13 9 (0.56%) Retail Banking
14 7 (0.43%) Back Office
15 5 (0.31%) Electronics
16 4 (0.25%) Law
17 3 (0.19%) Pharmaceutical
18 2 (0.12%) Dutch Language
Job Titles
1 438 (27.20%) Developer
2 352 (21.86%) Data Engineer
3 259 (16.09%) Big Data Engineer
4 215 (13.35%) Architect
5 183 (11.37%) Java Developer
6 130 (8.07%) Big Data Developer
7 114 (7.08%) Data Architect
7 114 (7.08%) DevOps Engineer
8 90 (5.59%) Senior Developer
9 87 (5.40%) Data Scientist
10 81 (5.03%) Hadoop Engineer
11 72 (4.47%) Analyst
12 69 (4.29%) Java Engineer
12 69 (4.29%) Python Engineer
13 65 (4.04%) Big Data Architect
14 60 (3.73%) Apache Spark Developer
15 58 (3.60%) Senior Java Developer
16 53 (3.29%) Platform Engineer
17 51 (3.17%) Senior Data Engineer
18 49 (3.04%) Consultant
Libraries, Frameworks & Software Standards
1 448 (27.83%) Kafka
2 135 (8.39%) REST
3 95 (5.90%) Spring
4 81 (5.03%) Web Services
5 73 (4.53%) AngularJS
6 60 (3.73%) HTML
6 60 (3.73%) Spring Boot
7 55 (3.42%) JSON
8 54 (3.35%) PySpark
9 48 (2.98%) Spark Streaming
9 48 (2.98%) TensorFlow
10 46 (2.86%) CSS
11 44 (2.73%) RESTful
12 42 (2.61%) .NET
13 41 (2.55%) Samza
14 39 (2.42%) Elastic Stack
14 39 (2.42%) Node.js
15 36 (2.24%) HTML5
15 36 (2.24%) Natural Language Processing
16 34 (2.11%) React
Miscellaneous
1 175 (10.87%) Analytical Skills
2 154 (9.57%) Algorithms
3 129 (8.01%) Greenfield Project
4 59 (3.66%) Fintech
5 45 (2.80%) Data Structures
6 41 (2.55%) Wiki
7 36 (2.24%) Self-Motivation
8 27 (1.68%) User Experience
9 24 (1.49%) Data Centre
9 24 (1.49%) Market Risk
10 17 (1.06%) Virtual Team
11 16 (0.99%) Management Information System
12 15 (0.93%) Foreign Exchange (FX)
13 13 (0.81%) Equities
13 13 (0.81%) HoloLens
14 11 (0.68%) Cloud Native
14 11 (0.68%) Credit Risk
14 11 (0.68%) Fixed Income
15 10 (0.62%) PKI
15 10 (0.62%) Robotics
Operating Systems
1 208 (12.92%) Linux
2 135 (8.39%) Unix
3 65 (4.04%) Windows
4 12 (0.75%) Red Hat Enterprise Linux
5 9 (0.56%) Android
5 9 (0.56%) Ubuntu
6 6 (0.37%) Apple iOS
7 4 (0.25%) Mesosphere
8 3 (0.19%) CoreOS
8 3 (0.19%) Solaris
8 3 (0.19%) Windows Server
9 2 (0.12%) CentOS
9 2 (0.12%) DC/OS
10 1 (0.062%) AIX
10 1 (0.062%) Debian
10 1 (0.062%) HPUX
10 1 (0.062%) Mac OS X
10 1 (0.062%) Oracle Linux
10 1 (0.062%) Windows 10
10 1 (0.062%) zOS
Processes & Methodologies
1 568 (35.28%) Agile Software Development
2 444 (27.58%) Analytics
3 319 (19.81%) Data Science
4 297 (18.45%) DevOps
5 238 (14.78%) ETL
6 227 (14.10%) Machine Learning
7 226 (14.04%) Business Intelligence
8 220 (13.66%) Scrum
9 196 (12.17%) Data Modelling
10 171 (10.62%) TDD
11 143 (8.88%) Continuous Integration
11 143 (8.88%) Open Source
12 136 (8.45%) Software Engineering
13 135 (8.39%) Microservices
13 135 (8.39%) Visualisation
14 132 (8.20%) Data Analytics
15 124 (7.70%) Data Analysis
16 118 (7.33%) Test Automation
17 117 (7.27%) BDD
18 111 (6.89%) Computer Science
Programming Languages
1 614 (38.14%) Python
2 562 (34.91%) Java
3 464 (28.82%) SQL
4 265 (16.46%) Scala
5 128 (7.95%) Java 8
6 117 (7.27%) Bash Shell
7 111 (6.89%) R
8 107 (6.65%) JavaScript
9 65 (4.04%) C#
10 61 (3.79%) Shell Script
11 59 (3.66%) Groovy
12 51 (3.17%) T-SQL
13 50 (3.11%) PowerShell
14 37 (2.30%) Korn
15 29 (1.80%) Ruby
16 26 (1.61%) C++
16 26 (1.61%) Perl
16 26 (1.61%) TypeScript
17 24 (1.49%) ES6
17 24 (1.49%) MATLAB
Qualifications
1 118 (7.33%) Degree
2 117 (7.27%) Security Cleared
3 108 (6.71%) SC Cleared
4 45 (2.80%) Master's Degree
5 44 (2.73%) Computer Science Degree
6 35 (2.17%) PhD
7 9 (0.56%) AWS Certification
7 9 (0.56%) CISSP
7 9 (0.56%) DV Cleared
8 8 (0.50%) PMI Certification
9 7 (0.43%) Numerate Degree
10 5 (0.31%) PRINCE2 Certification
11 4 (0.25%) CEH
11 4 (0.25%) CISM
11 4 (0.25%) MBA
12 3 (0.19%) CTC Cleared
12 3 (0.19%) Microsoft Certification
12 3 (0.19%) PMP
12 3 (0.19%) SANS
13 2 (0.12%) CISA
Quality Assurance & Compliance
1 63 (3.91%) Data Quality
2 45 (2.80%) QA
3 17 (1.06%) GDPR
4 6 (0.37%) PMO
5 5 (0.31%) ISO/IEC 27001
6 4 (0.25%) EMIR
6 4 (0.25%) MiFID
6 4 (0.25%) PSD2
6 4 (0.25%) SLA
7 2 (0.12%) Dodd-Frank
8 1 (0.062%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 280 (17.39%) Docker
2 153 (9.50%) HDFS
3 71 (4.41%) Apache Flume
4 37 (2.30%) Apache ZooKeeper
5 9 (0.56%) Active Directory
6 7 (0.43%) Oracle RAC
6 7 (0.43%) Virtual Machines
7 3 (0.19%) Hyper-V
7 3 (0.19%) VMware Infrastructure
8 2 (0.12%) etcd
8 2 (0.12%) flannel
8 2 (0.12%) LXC
8 2 (0.12%) XenApp
9 1 (0.062%) Cronacle
9 1 (0.062%) Terminal Services
9 1 (0.062%) Virtual Desktop
9 1 (0.062%) VirtualBox
9 1 (0.062%) vSphere
9 1 (0.062%) XenDesktop
Systems Management
1 202 (12.55%) Ansible
2 180 (11.18%) Kubernetes
3 118 (7.33%) Hadoop YARN
4 110 (6.83%) Terraform
5 82 (5.09%) Puppet
6 78 (4.84%) Oozie
7 73 (4.53%) Opscode Chef
8 24 (1.49%) Kibana
9 18 (1.12%) Prometheus
10 17 (1.06%) Docker Swarm
11 16 (0.99%) logstash
12 15 (0.93%) Ambari
13 11 (0.68%) Mesos
14 8 (0.50%) Grafana
14 8 (0.50%) Nagios
14 8 (0.50%) ZABBIX
15 7 (0.43%) Salt
16 6 (0.37%) Control-M
16 6 (0.37%) Packer
17 5 (0.31%) Consul
Vendors
1 201 (12.48%) Cloudera
2 133 (8.26%) Hortonworks
2 133 (8.26%) Oracle
3 129 (8.01%) Tableau
4 120 (7.45%) Google
5 114 (7.08%) Microsoft
6 72 (4.47%) Splunk
7 50 (3.11%) Talend
8 43 (2.67%) Informatica
9 41 (2.55%) Alteryx
9 41 (2.55%) SAP
10 29 (1.80%) Databricks
11 28 (1.74%) MapR
12 26 (1.61%) IBM
13 18 (1.12%) New Relic
13 18 (1.12%) Red Hat
14 16 (0.99%) Greenplum
14 16 (0.99%) Teradata
15 14 (0.87%) Salesforce.com
15 14 (0.87%) Sybase