Period
to 13 December 2018

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in the City of London during the 6 months to 13 December 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
13 Dec 2018
Same period 2017 Same period 2016
Rank 137 202 179
Rank change year-on-year +65 -23 +65
Contract jobs requiring a Data Engineer 126 56 58
As % of all contract IT jobs advertised in the City of London 1.77% 0.78% 0.89%
As % of the Job Titles category 1.85% 0.82% 0.93%
Number of daily rates quoted 105 48 40
City of London median daily rate £550 £550 £550
10th Percentile £416 £367 £438
90th Percentile £700 £638 £653
Central London median daily rate £550 £538 £550
% change year-on-year +2.33% -2.27% +10.00%
Number of hourly rates quoted 0 0 1
City of London median hourly rate - - £13.00
Central London median hourly rate - - £13.00

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 6,800 6,804 6,227
% of contract IT jobs with a recognized job title 95.26% 94.67% 95.54%
Number of daily rates quoted 5,368 5,399 4,938
City of London median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% +5.56%
10th Percentile £300 £313 £313
90th Percentile £675 £688 £663
Central London median daily rate £500 £500 £475
% change year-on-year - +5.26% +5.56%
Number of hourly rates quoted 110 92 73
City of London median hourly rate £18.70 £17.00 £17.50
Median hourly rate % change year-on-year +10.00% -2.86% -6.67%
10th Percentile £13.00 £11.25 £12.58
90th Percentile £25.70 £30.75 £54.03
Central London median hourly rate £18.70 £18.05 £17.21
% change year-on-year +3.60% +4.90% -4.40%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in the City of London.

Contractor daily rate trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Engineer in the City of London over the 6 months to 13 December 2018.

Contractor daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in the City of London.

Contractor hourly rate trend for Data Engineer in the City of London

Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the City of London region over the 6 months to 13 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 20 £550 -
Data Engineer
Central London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 13 December 2018, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Data Engineer in the job title.

1 82 (65.08%) Python
2 75 (59.52%) Apache Spark
3 68 (53.97%) Hadoop
4 63 (50.00%) Kafka
5 61 (48.41%) SQL
6 57 (45.24%) Big Data
7 56 (44.44%) Data Science
8 49 (38.89%) Finance
9 44 (34.92%) Apache Hive
10 43 (34.13%) Data Modelling
11 39 (30.95%) ETL
11 39 (30.95%) Data Warehouse
12 36 (28.57%) Machine Learning
12 36 (28.57%) Analytics
13 33 (26.19%) Amazon AWS
14 29 (23.02%) Scala
15 26 (20.63%) Data Quality
16 25 (19.84%) Agile Software Development
17 24 (19.05%) Oozie
18 22 (17.46%) Java
19 21 (16.67%) Visualisation
20 20 (15.87%) Microsoft Azure
20 20 (15.87%) OLAP Cube
20 20 (15.87%) OLAP
20 20 (15.87%) Star Schema
20 20 (15.87%) Enterprise Data Warehouse
20 20 (15.87%) SQL Optimisation
21 18 (14.29%) Power BI
21 18 (14.29%) Business Intelligence
22 17 (13.49%) Jenkins

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 75 (59.52%) Apache Spark
2 8 (6.35%) SAS
3 7 (5.56%) Apache
4 5 (3.97%) Apache Pig
5 4 (3.17%) Apache Airflow
6 2 (1.59%) Elasticsearch
7 1 (0.79%) Luigi
Applications
1 3 (2.38%) Microsoft Excel
2 2 (1.59%) MS Visio
Business Applications
1 1 (0.79%) SAP MM
1 1 (0.79%) SAP Oil and Gas
1 1 (0.79%) SAP R/3
Cloud Services
1 33 (26.19%) Amazon AWS
2 20 (15.87%) Microsoft Azure
3 13 (10.32%) Amazon S3
4 10 (7.94%) Google Cloud Platform
5 8 (6.35%) Amazon EMR
6 7 (5.56%) Amazon Kinesis
6 7 (5.56%) AWS Lambda
6 7 (5.56%) Serverless
7 6 (4.76%) GitHub
8 4 (3.17%) Amazon EC2
9 3 (2.38%) IBM Cloud
10 2 (1.59%) AWS CloudFormation
10 2 (1.59%) Cloud Computing
11 1 (0.79%) Azure Data Factory
Communications & Networking
1 1 (0.79%) HTTP
1 1 (0.79%) Internet
1 1 (0.79%) SNA
Database & Business Intelligence
1 68 (53.97%) Hadoop
2 57 (45.24%) Big Data
3 44 (34.92%) Apache Hive
4 39 (30.95%) Data Warehouse
5 20 (15.87%) Enterprise Data Warehouse
5 20 (15.87%) OLAP
5 20 (15.87%) OLAP Cube
5 20 (15.87%) Star Schema
6 18 (14.29%) Power BI
7 17 (13.49%) NoSQL
8 16 (12.70%) Amazon Redshift
9 15 (11.90%) SQL Server Integration Services
10 14 (11.11%) Data Lake
10 14 (11.11%) HBase
11 12 (9.52%) Impala
11 12 (9.52%) PostgreSQL
11 12 (9.52%) SQL Server
12 10 (7.94%) Relational Database
13 8 (6.35%) MongoDB
14 7 (5.56%) Apache Cassandra
Development Applications
1 17 (13.49%) Jenkins
2 14 (11.11%) Git (software)
3 4 (3.17%) JIRA
3 4 (3.17%) Subversion
3 4 (3.17%) Visual Studio
3 4 (3.17%) Visual Studio Team System
4 3 (2.38%) Maven
5 2 (1.59%) Bitbucket
5 2 (1.59%) Team Foundation Server
6 1 (0.79%) Cucumber
6 1 (0.79%) Eclipse
6 1 (0.79%) Gerrit
6 1 (0.79%) JBehave
6 1 (0.79%) LSMW
6 1 (0.79%) Robot Framework
6 1 (0.79%) RStudio
6 1 (0.79%) Selenium
General
1 49 (38.89%) Finance
2 12 (9.52%) Retail
3 7 (5.56%) Banking
4 3 (2.38%) Back Office
5 2 (1.59%) Front Office
6 1 (0.79%) Advertising
6 1 (0.79%) Corporate Banking
6 1 (0.79%) Games
6 1 (0.79%) Manufacturing
6 1 (0.79%) Marketing
6 1 (0.79%) Publishing
Libraries, Frameworks & Software Standards
1 63 (50.00%) Kafka
2 9 (7.14%) NumPy
2 9 (7.14%) Pandas
3 8 (6.35%) Spark Streaming
4 4 (3.17%) Lambda Expressions
4 4 (3.17%) Protocol Buffers
4 4 (3.17%) PySpark
5 3 (2.38%) JSON
5 3 (2.38%) scikit-learn
5 3 (2.38%) TensorFlow
5 3 (2.38%) XML
6 2 (1.59%) CSS
6 2 (1.59%) CSS3
6 2 (1.59%) HTML
6 2 (1.59%) HTML5
6 2 (1.59%) OpenCV
6 2 (1.59%) React
6 2 (1.59%) RESTful
6 2 (1.59%) Spring
6 2 (1.59%) Velocity
Miscellaneous
1 16 (12.70%) Algorithms
2 9 (7.14%) Greenfield Project
3 6 (4.76%) Analytical Skills
4 5 (3.97%) Data Structures
5 4 (3.17%) Fintech
6 2 (1.59%) Mobile App
6 2 (1.59%) Self-Motivation
6 2 (1.59%) Virtual Team
7 1 (0.79%) Derivative
7 1 (0.79%) Equities
7 1 (0.79%) HoloLens
7 1 (0.79%) Internet of Things
7 1 (0.79%) Marketing Technology
7 1 (0.79%) NHS
Operating Systems
1 5 (3.97%) Linux
2 4 (3.17%) Unix
3 3 (2.38%) Windows
4 2 (1.59%) Apple iOS
5 1 (0.79%) Red Hat Enterprise Linux
Processes & Methodologies
1 56 (44.44%) Data Science
2 43 (34.13%) Data Modelling
3 39 (30.95%) ETL
4 36 (28.57%) Analytics
4 36 (28.57%) Machine Learning
5 25 (19.84%) Agile Software Development
6 21 (16.67%) Visualisation
7 20 (15.87%) SQL Optimisation
8 18 (14.29%) Business Intelligence
9 16 (12.70%) Data Visualisation
10 15 (11.90%) Data Engineering
11 14 (11.11%) Artificial Intelligence
11 14 (11.11%) TDD
12 13 (10.32%) BDD
12 13 (10.32%) Open Source
12 13 (10.32%) Software Engineering
13 9 (7.14%) Continuous Integration
13 9 (7.14%) Data Analysis
13 9 (7.14%) MapReduce
14 8 (6.35%) Scrum
Programming Languages
1 82 (65.08%) Python
2 61 (48.41%) SQL
3 29 (23.02%) Scala
4 22 (17.46%) Java
5 15 (11.90%) R
6 7 (5.56%) JavaScript
7 6 (4.76%) Bash Shell
7 6 (4.76%) MATLAB
8 5 (3.97%) C#
9 3 (2.38%) Java 8
9 3 (2.38%) Kotlin
9 3 (2.38%) T-SQL
10 2 (1.59%) Ruby
11 1 (0.79%) AWK
11 1 (0.79%) C
11 1 (0.79%) Groovy
11 1 (0.79%) Perl
11 1 (0.79%) PowerShell
11 1 (0.79%) sed
11 1 (0.79%) VBA
Qualifications
1 4 (3.17%) Degree
2 2 (1.59%) MCSA
2 2 (1.59%) Microsoft Certification
3 1 (0.79%) Computer Science Degree
3 1 (0.79%) Master's Degree
3 1 (0.79%) Numerate Degree
3 1 (0.79%) OSCP
3 1 (0.79%) Security Cleared
Quality Assurance & Compliance
1 26 (20.63%) Data Quality
2 1 (0.79%) QA
System Software
1 16 (12.70%) Apache Flume
2 13 (10.32%) Docker
3 6 (4.76%) HDFS
Systems Management
1 24 (19.05%) Oozie
2 11 (8.73%) Hadoop YARN
3 6 (4.76%) Kubernetes
4 4 (3.17%) Terraform
5 3 (2.38%) Ambari
5 3 (2.38%) Ansible
6 2 (1.59%) Prometheus
7 1 (0.79%) Kibana
7 1 (0.79%) logstash
Vendors
1 13 (10.32%) Talend
2 12 (9.52%) Cloudera
2 12 (9.52%) Oracle
2 12 (9.52%) Tableau
3 11 (8.73%) Google
4 9 (7.14%) Microsoft
5 8 (6.35%) Alteryx
6 7 (5.56%) Informatica
7 5 (3.97%) Hortonworks
8 3 (2.38%) IBM
9 2 (1.59%) New Relic
10 1 (0.79%) Databricks
10 1 (0.79%) Palantir
10 1 (0.79%) SAP
10 1 (0.79%) Splunk
10 1 (0.79%) Sybase
10 1 (0.79%) Teradata
10 1 (0.79%) TIBCO