Period
to 16 July 2018

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in the City of London during the 6 months to 16 July 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
16 Jul 2018
Same period 2017 Same period 2016
Rank 161 203 225
Rank change year-on-year +42 +22 +57
Contract jobs requiring a Data Engineer 102 41 22
As % of all contract IT jobs advertised in the City of London 1.44% 0.63% 0.32%
As % of the Job Titles category 1.52% 0.66% 0.34%
Number of daily rates quoted 91 33 19
City of London median daily rate £550 £500 £525
Median daily rate % change year-on-year +10.00% -4.76% +16.67%
10th Percentile £431 £405 £353
90th Percentile £688 £585 £592
Central London median daily rate £550 £506 £540
% change year-on-year +8.64% -6.25% +20.00%
Number of hourly rates quoted 0 1 0
City of London median hourly rate - £12.50 -
Central London median hourly rate - £12.50 -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 6,728 6,192 6,515
% of contract IT jobs with a recognized job title 94.81% 95.88% 95.57%
Number of daily rates quoted 5,287 4,760 5,223
City of London median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% +5.56%
10th Percentile £313 £310 £300
90th Percentile £688 £675 £650
Central London median daily rate £500 £485 £450
% change year-on-year +3.09% +7.78% -
Number of hourly rates quoted 123 76 84
City of London median hourly rate £18.70 £17.39 £19.00
Median hourly rate % change year-on-year +7.56% -8.50% -3.63%
10th Percentile £12.55 £12.52 £11.33
90th Percentile £32.40 £30.04 £32.18
Central London median hourly rate £18.70 £17.00 £19.00
% change year-on-year +10.00% -10.53% -

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in the City of London.

Contractor daily rate trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Engineer in the City of London over the 6 months to 16 July 2018.

Contractor daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in the City of London.

Contractor hourly rate trend for Data Engineer in the City of London

Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the City of London region over the 6 months to 16 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 2 £450 -
London Bridge - 1 £475 -
Data Engineer
Central London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 16 July 2018, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Data Engineer in the job title.

1 75 (73.53%) Python
2 55 (53.92%) Big Data
3 54 (52.94%) Apache Spark
4 51 (50.00%) Hadoop
5 50 (49.02%) SQL
6 49 (48.04%) ETL
7 38 (37.25%) Amazon AWS
8 36 (35.29%) Analytics
9 35 (34.31%) Scala
9 35 (34.31%) Java
10 28 (27.45%) Apache Hive
11 24 (23.53%) Data Science
12 23 (22.55%) Finance
13 22 (21.57%) Machine Learning
14 21 (20.59%) Agile Software Development
15 20 (19.61%) Kafka
15 20 (19.61%) HDFS
16 19 (18.63%) R
17 18 (17.65%) NoSQL
18 17 (16.67%) Microsoft Azure
18 17 (16.67%) Amazon Redshift
18 17 (16.67%) SQL Server
19 16 (15.69%) Data Warehouse
19 16 (15.69%) Linux
19 16 (15.69%) Docker
19 16 (15.69%) Data Engineering
20 14 (13.73%) Relational Database
20 14 (13.73%) PostgreSQL
21 13 (12.75%) Software Engineering
21 13 (12.75%) Business Intelligence

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 54 (52.94%) Apache Spark
2 11 (10.78%) Apache
3 7 (6.86%) Apache Pig
4 5 (4.90%) Elasticsearch
5 4 (3.92%) Apache Solr
5 4 (3.92%) SAS
5 4 (3.92%) SharePoint
6 1 (0.98%) Apache Airflow
6 1 (0.98%) OpenStack
Applications
1 6 (5.88%) Microsoft Excel
2 1 (0.98%) Stata
Cloud Services
1 38 (37.25%) Amazon AWS
2 17 (16.67%) Microsoft Azure
3 6 (5.88%) Amazon S3
4 5 (4.90%) Amazon Kinesis
4 5 (4.90%) Google Cloud Platform
5 3 (2.94%) Amazon EMR
6 2 (1.96%) AdWords
6 2 (1.96%) Amazon EC2
6 2 (1.96%) Azure Data Factory
7 1 (0.98%) AWS CloudFormation
7 1 (0.98%) Data Lake Analytics
7 1 (0.98%) GitHub
7 1 (0.98%) Google Analytics
7 1 (0.98%) Serverless
Communications & Networking
1 1 (0.98%) Internet
1 1 (0.98%) Kerberos
1 1 (0.98%) SNA
Database & Business Intelligence
1 55 (53.92%) Big Data
2 51 (50.00%) Hadoop
3 28 (27.45%) Apache Hive
4 18 (17.65%) NoSQL
5 17 (16.67%) Amazon Redshift
5 17 (16.67%) SQL Server
6 16 (15.69%) Data Warehouse
7 14 (13.73%) PostgreSQL
7 14 (13.73%) Relational Database
8 12 (11.76%) MongoDB
9 11 (10.78%) Apache Cassandra
9 11 (10.78%) HBase
10 10 (9.80%) SQL Server Integration Services
11 8 (7.84%) MySQL
11 8 (7.84%) Power BI
12 7 (6.86%) Impala
12 7 (6.86%) RDBMS
13 5 (4.90%) Spotfire
13 5 (4.90%) SQL Server Analysis Services
13 5 (4.90%) Sqoop
Development Applications
1 9 (8.82%) Git (software)
1 9 (8.82%) Jenkins
2 4 (3.92%) TeamCity
3 3 (2.94%) JUnit
3 3 (2.94%) Subversion
4 2 (1.96%) Maven
4 2 (1.96%) RStudio
4 2 (1.96%) Visual Studio
5 1 (0.98%) Bitbucket
5 1 (0.98%) Bundler
5 1 (0.98%) GitLab
5 1 (0.98%) JIRA
5 1 (0.98%) Robot Framework
5 1 (0.98%) SpecFlow
5 1 (0.98%) Team Foundation Server
5 1 (0.98%) Vagrant
5 1 (0.98%) Visual Studio Team System
General
1 23 (22.55%) Finance
2 10 (9.80%) Banking
3 6 (5.88%) Advertising
3 6 (5.88%) Retail
4 4 (3.92%) Marketing
5 1 (0.98%) Games
Libraries, Frameworks & Software Standards
1 20 (19.61%) Kafka
2 9 (8.82%) Pandas
3 6 (5.88%) NumPy
3 6 (5.88%) scikit-learn
3 6 (5.88%) TensorFlow
4 4 (3.92%) React
4 4 (3.92%) XML
5 3 (2.94%) CSS
5 3 (2.94%) Keras
5 3 (2.94%) MLlib
5 3 (2.94%) RabbitMQ
6 2 (1.96%) CSS3
6 2 (1.96%) HTML
6 2 (1.96%) HTML5
6 2 (1.96%) Matplotlib
6 2 (1.96%) Natural Language Processing
6 2 (1.96%) Node.js
6 2 (1.96%) PySpark
6 2 (1.96%) Spark Streaming
6 2 (1.96%) Velocity
Miscellaneous
1 10 (9.80%) Data Structures
2 9 (8.82%) Greenfield Project
3 7 (6.86%) Algorithms
3 7 (6.86%) Fintech
4 6 (5.88%) Analytical Skills
5 5 (4.90%) Computer Science
6 1 (0.98%) Clustering
6 1 (0.98%) Data Centre
6 1 (0.98%) Derivative
6 1 (0.98%) Equities
6 1 (0.98%) Internet of Things
6 1 (0.98%) Linux Command Line
6 1 (0.98%) Self-Motivation
Operating Systems
1 16 (15.69%) Linux
2 3 (2.94%) Unix
3 1 (0.98%) CentOS
3 1 (0.98%) Red Hat Enterprise Linux
3 1 (0.98%) Windows
Processes & Methodologies
1 49 (48.04%) ETL
2 36 (35.29%) Analytics
3 24 (23.53%) Data Science
4 22 (21.57%) Machine Learning
5 21 (20.59%) Agile Software Development
6 16 (15.69%) Data Engineering
7 13 (12.75%) Business Intelligence
7 13 (12.75%) Software Engineering
7 13 (12.75%) Visualisation
8 12 (11.76%) Data Modelling
9 8 (7.84%) DevOps
10 7 (6.86%) Artificial Intelligence
10 7 (6.86%) Continuous Integration
10 7 (6.86%) Data Visualisation
10 7 (6.86%) Deep Learning
10 7 (6.86%) E-Commerce
11 6 (5.88%) Data Analysis
11 6 (5.88%) Open Source
12 5 (4.90%) Data Transformation
12 5 (4.90%) Test Automation
Programming Languages
1 75 (73.53%) Python
2 50 (49.02%) SQL
3 35 (34.31%) Java
3 35 (34.31%) Scala
4 19 (18.63%) R
5 9 (8.82%) JavaScript
6 8 (7.84%) C#
7 7 (6.86%) T-SQL
8 5 (4.90%) PowerShell
8 5 (4.90%) Shell Script
9 4 (3.92%) MATLAB
10 3 (2.94%) VBA
11 2 (1.96%) Bash Shell
11 2 (1.96%) C
11 2 (1.96%) Java 8
11 2 (1.96%) Perl
12 1 (0.98%) Clojure
12 1 (0.98%) ES6
12 1 (0.98%) Go
12 1 (0.98%) U-SQL
Qualifications
1 6 (5.88%) Degree
2 3 (2.94%) PhD
2 3 (2.94%) SC Cleared
2 3 (2.94%) Security Cleared
3 2 (1.96%) Computer Science Degree
3 2 (1.96%) DV Cleared
4 1 (0.98%) Numerate Degree
Quality Assurance & Compliance
1 6 (5.88%) Data Quality
2 1 (0.98%) GCP
2 1 (0.98%) GDPR
2 1 (0.98%) QA
System Software
1 20 (19.61%) HDFS
2 16 (15.69%) Docker
3 7 (6.86%) Apache Flume
4 2 (1.96%) Apache ZooKeeper
Systems Management
1 6 (5.88%) Hadoop YARN
1 6 (5.88%) Kubernetes
2 2 (1.96%) Kibana
2 2 (1.96%) Oozie
3 1 (0.98%) Ansible
3 1 (0.98%) Prometheus
Vendors
1 13 (12.75%) Oracle
2 8 (7.84%) Cloudera
3 6 (5.88%) Google
3 6 (5.88%) Microsoft
4 5 (4.90%) Hortonworks
4 5 (4.90%) Tableau
5 4 (3.92%) Hitachi
5 4 (3.92%) Informatica
5 4 (3.92%) Splunk
5 4 (3.92%) Talend
6 3 (2.94%) Alteryx
6 3 (2.94%) MapR
7 2 (1.96%) Bloomberg
7 2 (1.96%) Reuters
8 1 (0.98%) IBM
8 1 (0.98%) Palantir
8 1 (0.98%) Red Hat
8 1 (0.98%) Salesforce.com
8 1 (0.98%) Sybase
8 1 (0.98%) TIBCO