Period
to 19 September 2018

The median contractor rate for a Big Data Engineer was £575 per day in advertised job vacancies in the City of London during the 6 months to 19 September 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data Engineer
Central London > City of London
6 months to
19 Sep 2018
Same period 2017 Same period 2016
Rank 198 221 221
Rank change year-on-year +23 0 +67
Contract jobs requiring a Big Data Engineer 56 22 14
As % of all contract IT jobs advertised in the City of London 0.80% 0.32% 0.21%
As % of the Job Titles category 0.84% 0.34% 0.22%
Number of daily rates quoted 50 19 8
City of London median daily rate £575 £550 £595
Median daily rate % change year-on-year +4.55% -7.56% -0.83%
10th Percentile £513 £400 £499
90th Percentile £675 £675 £650
Central London median daily rate £575 £550 £590
% change year-on-year +4.55% -6.78% -1.67%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 6,646 6,477 6,489
% of contract IT jobs with a recognized job title 94.92% 95.35% 95.55%
Number of daily rates quoted 5,249 5,027 5,204
City of London median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% +5.56%
10th Percentile £313 £313 £305
90th Percentile £675 £675 £650
Central London median daily rate £500 £500 £463
% change year-on-year +0.10% +8.00% +2.78%
Number of hourly rates quoted 126 88 73
City of London median hourly rate £18.70 £18.10 £19.00
Median hourly rate % change year-on-year +3.31% -4.74% +5.56%
10th Percentile £13.00 £12.52 £11.30
90th Percentile £25.50 £30.23 £49.51
Central London median hourly rate £18.70 £18.70 £17.50
% change year-on-year +0.01% +6.84% -2.78%

Big Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Big Data Engineer in the job title as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data Engineer in the City of London

Big Data Engineer
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data Engineer in the City of London.

Contractor daily rate trend for Big Data Engineer in the City of London

Big Data Engineer
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data Engineer in the City of London over the 6 months to 19 September 2018.

Contractor daily rate histogram for Big Data Engineer in the City of London

Big Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data Engineer within the City of London region over the 6 months to 19 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 6 £525 -
Big Data Engineer
Central London

Big Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 19 September 2018, Big Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Big Data Engineer in the job title.

1 56 (100.00%) Big Data
2 55 (98.21%) Hadoop
3 40 (71.43%) Kafka
4 39 (69.64%) Apache Hive
5 35 (62.50%) Java
6 32 (57.14%) Apache Spark
7 29 (51.79%) Finance
8 22 (39.29%) Elasticsearch
9 20 (35.71%) Maven
9 20 (35.71%) Java 8
10 19 (33.93%) AngularJS
11 16 (28.57%) Scala
11 16 (28.57%) Python
12 14 (25.00%) SQL
13 13 (23.21%) ETL
13 13 (23.21%) HBase
13 13 (23.21%) Machine Learning
14 12 (21.43%) Amazon AWS
14 12 (21.43%) Agile Software Development
15 10 (17.86%) Data Modelling
15 10 (17.86%) Oozie
16 9 (16.07%) Analytics
16 9 (16.07%) Jenkins
16 9 (16.07%) DevOps
16 9 (16.07%) Data Warehouse
16 9 (16.07%) Data Science
17 8 (14.29%) HDFS
18 7 (12.50%) Sqoop
18 7 (12.50%) MapReduce
18 7 (12.50%) SQL Server

Big Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 32 (57.14%) Apache Spark
2 22 (39.29%) Elasticsearch
3 5 (8.93%) Apache
4 2 (3.57%) Cloud Foundry
4 2 (3.57%) Confluence
5 1 (1.79%) Apache Pig
5 1 (1.79%) OpenStack
Cloud Services
1 12 (21.43%) Amazon AWS
2 6 (10.71%) Google Cloud Platform
3 5 (8.93%) IBM Cloud
3 5 (8.93%) Microsoft Azure
4 4 (7.14%) GitHub
5 3 (5.36%) Amazon S3
6 2 (3.57%) Amazon EMR
7 1 (1.79%) Amazon EC2
7 1 (1.79%) Amazon Kinesis
Database & Business Intelligence
1 56 (100.00%) Big Data
2 55 (98.21%) Hadoop
3 39 (69.64%) Apache Hive
4 13 (23.21%) HBase
5 9 (16.07%) Data Warehouse
6 7 (12.50%) SQL Server
6 7 (12.50%) Sqoop
7 5 (8.93%) MongoDB
7 5 (8.93%) NoSQL
7 5 (8.93%) OLAP
7 5 (8.93%) PostgreSQL
7 5 (8.93%) Star Schema
8 4 (7.14%) Apache Cassandra
8 4 (7.14%) Enterprise Data Warehouse
8 4 (7.14%) OLAP Cube
8 4 (7.14%) Relational Database
9 3 (5.36%) SQL Server Integration Services
10 2 (3.57%) Amazon Redshift
10 2 (3.57%) Impala
10 2 (3.57%) SQL Server 2008
Development Applications
1 20 (35.71%) Maven
2 9 (16.07%) Jenkins
3 7 (12.50%) Git (software)
4 3 (5.36%) JIRA
4 3 (5.36%) Visual Studio Team System
5 2 (3.57%) Sonatype Nexus
5 2 (3.57%) Subversion
5 2 (3.57%) Visual Studio
6 1 (1.79%) Vagrant
General
1 29 (51.79%) Finance
2 6 (10.71%) Advertising
3 2 (3.57%) Banking
3 2 (3.57%) Marketing
4 1 (1.79%) Front Office
4 1 (1.79%) Publishing
4 1 (1.79%) Retail
Libraries, Frameworks & Software Standards
1 40 (71.43%) Kafka
2 19 (33.93%) AngularJS
3 3 (5.36%) PySpark
3 3 (5.36%) RabbitMQ
4 2 (3.57%) Spark Streaming
5 1 (1.79%) CSS
5 1 (1.79%) CSS3
5 1 (1.79%) Dask
5 1 (1.79%) Elastic Stack
5 1 (1.79%) HTML
5 1 (1.79%) HTML5
5 1 (1.79%) LAMP
5 1 (1.79%) LAPP Stack
5 1 (1.79%) OpenCV
5 1 (1.79%) RESTful
5 1 (1.79%) TensorFlow
Miscellaneous
1 5 (8.93%) Greenfield Project
2 3 (5.36%) Algorithms
2 3 (5.36%) Fintech
3 2 (3.57%) iPad
4 1 (1.79%) Computer Science
4 1 (1.79%) Data Structures
Operating Systems
1 5 (8.93%) Linux
2 3 (5.36%) Unix
3 1 (1.79%) CentOS
3 1 (1.79%) Red Hat Enterprise Linux
Processes & Methodologies
1 13 (23.21%) ETL
1 13 (23.21%) Machine Learning
2 12 (21.43%) Agile Software Development
3 10 (17.86%) Data Modelling
4 9 (16.07%) Analytics
4 9 (16.07%) Data Science
4 9 (16.07%) DevOps
5 7 (12.50%) MapReduce
6 6 (10.71%) Data Engineering
7 5 (8.93%) Open Source
7 5 (8.93%) Scrum
8 4 (7.14%) SQL Optimisation
9 3 (5.36%) ETL Development
9 3 (5.36%) Kanban
9 3 (5.36%) Software Deployment
10 2 (3.57%) Campaign Management
10 2 (3.57%) Continuous Integration
10 2 (3.57%) Digital Marketing
10 2 (3.57%) Mentoring
10 2 (3.57%) Visualisation
Programming Languages
1 35 (62.50%) Java
2 20 (35.71%) Java 8
3 16 (28.57%) Python
3 16 (28.57%) Scala
4 14 (25.00%) SQL
5 4 (7.14%) T-SQL
6 3 (5.36%) JavaScript
7 2 (3.57%) C#
7 2 (3.57%) Groovy
7 2 (3.57%) R
8 1 (1.79%) HiveQL
8 1 (1.79%) PL/SQL
8 1 (1.79%) Shell Script
Quality Assurance & Compliance
1 5 (8.93%) Data Quality
2 1 (1.79%) GDPR
System Software
1 8 (14.29%) HDFS
2 5 (8.93%) Docker
3 4 (7.14%) Apache Flume
4 1 (1.79%) Apache ZooKeeper
Systems Management
1 10 (17.86%) Oozie
2 6 (10.71%) Hadoop YARN
3 4 (7.14%) Ansible
4 3 (5.36%) Ambari
4 3 (5.36%) Kubernetes
5 2 (3.57%) Kibana
5 2 (3.57%) Terraform
6 1 (1.79%) logstash
Vendors
1 6 (10.71%) Google
1 6 (10.71%) IBM
2 4 (7.14%) Tableau
3 3 (5.36%) Cloudera
3 3 (5.36%) Hortonworks
3 3 (5.36%) Informatica
3 3 (5.36%) Microsoft
3 3 (5.36%) Oracle
3 3 (5.36%) Talend
4 2 (3.57%) Splunk