Period
to 24 September 2018

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in the City of London during the 6 months to 24 September 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
24 Sep 2018
Same period 2017 Same period 2016
Rank 134 196 207
Rank change year-on-year +62 +11 +66
Contract jobs requiring a Data Engineer 111 41 32
As % of all contract IT jobs advertised in the City of London 1.60% 0.61% 0.48%
As % of the Job Titles category 1.69% 0.64% 0.50%
Number of daily rates quoted 99 36 17
City of London median daily rate £550 £525 £550
Median daily rate % change year-on-year +4.76% -4.55% +5.77%
10th Percentile £425 £355 £378
90th Percentile £688 £625 £641
Central London median daily rate £550 £525 £550
% change year-on-year +4.76% -4.55% +7.84%
Number of hourly rates quoted 0 0 1
City of London median hourly rate - - £13.00
Central London median hourly rate - - £13.00

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 6,577 6,384 6,415
% of contract IT jobs with a recognized job title 94.99% 95.23% 95.52%
Number of daily rates quoted 5,201 4,961 5,131
City of London median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% +5.56%
10th Percentile £313 £313 £306
90th Percentile £675 £675 £650
Central London median daily rate £500 £498 £463
% change year-on-year +0.50% +7.57% +2.78%
Number of hourly rates quoted 127 86 71
City of London median hourly rate £18.70 £18.05 £17.50
Median hourly rate % change year-on-year +3.60% +3.14% -2.78%
10th Percentile £13.00 £12.52 £11.25
90th Percentile £25.50 £30.38 £50.14
Central London median hourly rate £18.70 £18.40 £17.50
% change year-on-year +1.66% +5.11% -2.78%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in the City of London.

Contractor daily rate trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Engineer in the City of London over the 6 months to 24 September 2018.

Contractor daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in the City of London.

Contractor hourly rate trend for Data Engineer in the City of London

Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the City of London region over the 6 months to 24 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 9 £550 -
Moorgate -7 1 £450 -21.74%
Data Engineer
Central London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 24 September 2018, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Data Engineer in the job title.

1 74 (66.67%) Python
2 63 (56.76%) Apache Spark
3 55 (49.55%) Hadoop
4 52 (46.85%) SQL
5 50 (45.05%) Big Data
6 39 (35.14%) Kafka
6 39 (35.14%) Amazon AWS
7 38 (34.23%) ETL
7 38 (34.23%) Data Science
8 36 (32.43%) Scala
9 34 (30.63%) Finance
10 29 (26.13%) Apache Hive
11 28 (25.23%) Java
12 27 (24.32%) Machine Learning
13 26 (23.42%) Agile Software Development
14 24 (21.62%) Data Modelling
15 22 (19.82%) Analytics
16 19 (17.12%) NoSQL
16 19 (17.12%) Amazon Redshift
16 19 (17.12%) Data Warehouse
17 18 (16.22%) Visualisation
18 17 (15.32%) R
18 17 (15.32%) Docker
18 17 (15.32%) Software Engineering
19 16 (14.41%) PostgreSQL
19 16 (14.41%) HBase
20 15 (13.51%) Microsoft Azure
20 15 (13.51%) Data Quality
20 15 (13.51%) Business Intelligence
21 14 (12.61%) Jenkins

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 63 (56.76%) Apache Spark
2 10 (9.01%) Apache
3 5 (4.50%) Apache Pig
3 5 (4.50%) SAS
4 4 (3.60%) Apache Airflow
4 4 (3.60%) Elasticsearch
5 1 (0.90%) OpenStack
Applications
1 6 (5.41%) Microsoft Excel
Business Applications
1 1 (0.90%) SAP MM
1 1 (0.90%) SAP Oil and Gas
1 1 (0.90%) SAP R/3
Cloud Services
1 39 (35.14%) Amazon AWS
2 15 (13.51%) Microsoft Azure
3 11 (9.91%) Amazon S3
4 10 (9.01%) Google Cloud Platform
5 7 (6.31%) Amazon EMR
5 7 (6.31%) Amazon Kinesis
6 6 (5.41%) GitHub
7 4 (3.60%) AWS Lambda
7 4 (3.60%) Serverless
8 3 (2.70%) IBM Cloud
9 2 (1.80%) Amazon EC2
10 1 (0.90%) AdWords
10 1 (0.90%) AWS CloudFormation
10 1 (0.90%) Azure Data Factory
10 1 (0.90%) Cloud Computing
Communications & Networking
1 1 (0.90%) Internet
1 1 (0.90%) SNA
Database & Business Intelligence
1 55 (49.55%) Hadoop
2 50 (45.05%) Big Data
3 29 (26.13%) Apache Hive
4 19 (17.12%) Amazon Redshift
4 19 (17.12%) Data Warehouse
4 19 (17.12%) NoSQL
5 16 (14.41%) HBase
5 16 (14.41%) PostgreSQL
6 13 (11.71%) Power BI
6 13 (11.71%) SQL Server
7 12 (10.81%) MongoDB
7 12 (10.81%) SQL Server Integration Services
8 10 (9.01%) OLAP
8 10 (9.01%) Star Schema
9 9 (8.11%) Enterprise Data Warehouse
9 9 (8.11%) OLAP Cube
9 9 (8.11%) Relational Database
10 7 (6.31%) Apache Cassandra
10 7 (6.31%) Impala
11 6 (5.41%) Sqoop
Development Applications
1 14 (12.61%) Jenkins
2 11 (9.91%) Git (software)
3 5 (4.50%) Subversion
4 3 (2.70%) JIRA
4 3 (2.70%) Visual Studio
4 3 (2.70%) Visual Studio Team System
5 2 (1.80%) Bitbucket
5 2 (1.80%) Maven
6 1 (0.90%) Bundler
6 1 (0.90%) LSMW
6 1 (0.90%) Robot Framework
6 1 (0.90%) RStudio
6 1 (0.90%) Vagrant
General
1 34 (30.63%) Finance
2 9 (8.11%) Banking
3 6 (5.41%) Advertising
4 4 (3.60%) Retail
5 3 (2.70%) Back Office
5 3 (2.70%) Marketing
6 2 (1.80%) Games
7 1 (0.90%) Front Office
7 1 (0.90%) Manufacturing
7 1 (0.90%) Publishing
Libraries, Frameworks & Software Standards
1 39 (35.14%) Kafka
2 11 (9.91%) Pandas
3 9 (8.11%) NumPy
4 5 (4.50%) Spark Streaming
5 4 (3.60%) Lambda Expressions
5 4 (3.60%) PySpark
5 4 (3.60%) scikit-learn
6 3 (2.70%) CSS
6 3 (2.70%) JSON
6 3 (2.70%) Protocol Buffers
6 3 (2.70%) RabbitMQ
6 3 (2.70%) React
6 3 (2.70%) TensorFlow
6 3 (2.70%) XML
7 2 (1.80%) CSS3
7 2 (1.80%) HTML
7 2 (1.80%) HTML5
7 2 (1.80%) Natural Language Processing
7 2 (1.80%) Velocity
8 1 (0.90%) SciPy
Miscellaneous
1 13 (11.71%) Greenfield Project
2 9 (8.11%) Algorithms
3 8 (7.21%) Fintech
4 7 (6.31%) Data Structures
5 5 (4.50%) Computer Science
6 3 (2.70%) Analytical Skills
7 2 (1.80%) Mobile App
7 2 (1.80%) Self-Motivation
7 2 (1.80%) Virtual Team
8 1 (0.90%) Derivative
8 1 (0.90%) Equities
8 1 (0.90%) Internet of Things
8 1 (0.90%) Linux Command Line
8 1 (0.90%) Marketing Technology
Operating Systems
1 6 (5.41%) Linux
2 3 (2.70%) Unix
3 2 (1.80%) Apple iOS
3 2 (1.80%) Red Hat Enterprise Linux
4 1 (0.90%) CentOS
4 1 (0.90%) Windows
Processes & Methodologies
1 38 (34.23%) Data Science
1 38 (34.23%) ETL
2 27 (24.32%) Machine Learning
3 26 (23.42%) Agile Software Development
4 24 (21.62%) Data Modelling
5 22 (19.82%) Analytics
6 18 (16.22%) Visualisation
7 17 (15.32%) Software Engineering
8 15 (13.51%) Business Intelligence
9 13 (11.71%) Data Visualisation
10 11 (9.91%) Artificial Intelligence
10 11 (9.91%) Open Source
10 11 (9.91%) TDD
11 10 (9.01%) Data Engineering
11 10 (9.01%) DevOps
12 9 (8.11%) Data Analysis
12 9 (8.11%) SQL Optimisation
13 8 (7.21%) BDD
14 7 (6.31%) Continuous Integration
14 7 (6.31%) MapReduce
Programming Languages
1 74 (66.67%) Python
2 52 (46.85%) SQL
3 36 (32.43%) Scala
4 28 (25.23%) Java
5 17 (15.32%) R
6 9 (8.11%) JavaScript
7 5 (4.50%) T-SQL
8 4 (3.60%) Bash Shell
8 4 (3.60%) C#
9 3 (2.70%) MATLAB
9 3 (2.70%) VBA
10 2 (1.80%) C
10 2 (1.80%) Java 8
10 2 (1.80%) Kotlin
10 2 (1.80%) Perl
11 1 (0.90%) C++
11 1 (0.90%) ES6
11 1 (0.90%) PL/SQL
11 1 (0.90%) Ruby
11 1 (0.90%) Shell Script
Qualifications
1 5 (4.50%) Degree
2 2 (1.80%) Computer Science Degree
2 2 (1.80%) PhD
3 1 (0.90%) Numerate Degree
Quality Assurance & Compliance
1 15 (13.51%) Data Quality
2 1 (0.90%) GDPR
2 1 (0.90%) QA
System Software
1 17 (15.32%) Docker
2 8 (7.21%) Apache Flume
3 6 (5.41%) HDFS
4 1 (0.90%) Apache ZooKeeper
Systems Management
1 13 (11.71%) Oozie
2 9 (8.11%) Hadoop YARN
3 7 (6.31%) Kubernetes
4 4 (3.60%) Terraform
5 3 (2.70%) Ambari
5 3 (2.70%) Ansible
6 2 (1.80%) Kibana
6 2 (1.80%) Prometheus
7 1 (0.90%) logstash
Vendors
1 11 (9.91%) Oracle
2 10 (9.01%) Google
3 9 (8.11%) Tableau
4 6 (5.41%) Cloudera
4 6 (5.41%) Microsoft
4 6 (5.41%) Talend
5 5 (4.50%) Alteryx
5 5 (4.50%) Informatica
6 4 (3.60%) IBM
7 3 (2.70%) Hortonworks
7 3 (2.70%) Splunk
8 2 (1.80%) Bloomberg
8 2 (1.80%) New Relic
8 2 (1.80%) Reuters
9 1 (0.90%) Palantir
9 1 (0.90%) SAP
9 1 (0.90%) Sybase
9 1 (0.90%) Teradata
9 1 (0.90%) TIBCO